CN100401264C - Data-driven automatic testing system and method - Google Patents

Data-driven automatic testing system and method Download PDF

Info

Publication number
CN100401264C
CN100401264C CNB2005100351973A CN200510035197A CN100401264C CN 100401264 C CN100401264 C CN 100401264C CN B2005100351973 A CNB2005100351973 A CN B2005100351973A CN 200510035197 A CN200510035197 A CN 200510035197A CN 100401264 C CN100401264 C CN 100401264C
Authority
CN
China
Prior art keywords
test
logic
environment
data
generation module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2005100351973A
Other languages
Chinese (zh)
Other versions
CN1877543A (en
Inventor
林培兴
吕学
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Global Innovation Polymerization LLC
Gw Partnership Co ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CNB2005100351973A priority Critical patent/CN100401264C/en
Publication of CN1877543A publication Critical patent/CN1877543A/en
Application granted granted Critical
Publication of CN100401264C publication Critical patent/CN100401264C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The present invention relates to a data-driven automation testing system which comprises a testing tool, a testing instrument, a tested device, a testing platform and a function library connected with the testing platform, wherein the function library comprises a product function library, a testing tool function library and a testing instrument function library. The testing platform comprises a testing environment generation module, a test case generation module, an operation engine, a test logic generation module and a testing set generation module. The present invention also provides a data-driven automation testing method. The system and the method of the present invention have the advantages of cross platform transplantation, cross tool platform transplantation, high loading efficiency of the function libraries, low maintenance cost, etc., and the testing environment and the test logic can be shared and reused. Because the present invention uses a testing set, the testing efficiency is improved.

Description

The automatization test system of data-driven and method
Technical field
The present invention relates to the automatic test field, more specifically, the present invention relates to a kind of automatization test system and method for data-driven.
Background technology
In the R﹠D process of product, after product enters the system testing stage,, need comprehensively test its function and performance under the actual environment for use of simulation in order to guarantee the quality of product.According to the defective of the product of being found in test process, the developer revises product design.For guaranteeing can not introduce new mistake, need repeatedly product to be carried out regression test to the modification of inherited error.Each test of product all need manually be built environment by the tester and be simulated actual service condition, and we are referred to as to construct test environment.In order to guarantee the accurate of test result, also need finish the measurement of the every index of system by use test instrument/instrument.Use for convenience, most of instrument/instrument provide the graphical operation interface, and some adopts embedded OS, some in addition the Control Software Package that can install on computers is provided.
And the carrying out of script (as TCL, PYTHON etc.) such as explaining, can embed, extendible etc. characteristic lays a good foundation for the realization automatic test.Being write the product (as telecommunication apparatus or software) that forms by these scripts not only provides graphic user interface (Graphical User Interfaces GUI), simultaneously also provides command line interface or man-machine interface, so can carry out automatic test.And in existing automatic test script design, have all multi-modes, drive the test script Design Mode as linear test script Design Mode, structuring test script Design Mode, shared test script Design Mode or key word.
For example, based on the Robot tool platform of Rational company, just can realize that the key word in the automatic test of a kind of GUI of being applied to drives method of testing.The function that whole process comprises of this method of testing all is to be driven by key word, and whole test process controlled in key word.Please, can more clearly understand the realization mechanism and the process of this method of testing in conjunction with Figure 1 and Figure 2.In this method of testing, the tester can at first use the form of similar Excel worksheet, sets up test case in the mode of input key word (Key-Word).In Fig. 1, be exactly the example of a kind of test case (as Key Words_Web.xls), it is made up of key word and parameter thereof, wherein, first row are key words, the action that explanation will be carried out, and it comprises such as input (ENTER), action (ACTION) and verification (VERIFY) or the like; Second to the 4th row are necessary parameters of action of carrying out first row; And whether the 5th row have indicated each testing procedure and have passed through.
Test case drives script (Drive TSL script) operation initialization script (LogonTSL script) in operational process, for initial work is carried out in whole test, and be written into control documents (Run.txt), obtain the current test case that will move ( *.xls).
Drive script (Drive TSL script) after initial work is finished, start-up control script (ControllerTSL script), come responsible key word of resolving whole test case file by control script (Controller TSL script), call corresponding with it realization script (User Defined TSLscript) according to these key words.
Realize actual each test action of execution of script, and use other row, after executing execution result is returned to the control script as parameter.When controlling script executing delegation to the end, whole test case just finishes to carry out; All use-case files in control documents (Run.txt) ( *.xls) operation finishes, and this test process finishes.
But the automated testing method that existing this key word drives has following weak point:
Existing technology is mainly used in the GUI automatic test, and based on the Robot tool platform of Rational company, and its cross-platform (refering in particular to operating system) and stride a little less than the transplantability of tool platform is not suitable for being applied to the automatic test of communication facilities series products; Test data is not separated with test logic, and its machine-processed immature to the foundation of test environment and recovery, and in a single day test data changes, and will cause the maintenance cost height; The test logic redundancy, sharing is relatively poor; Can not load required product function library according to actual needs, transplant the cost height, dirigibility is relatively poor; Loading too much product function library simultaneously can cause whole automatic test course to become slow.
Summary of the invention
The present invention is directed to the prior art weak point a kind of automatization test system and method for data-driven are provided, its test case can be cross-platform/strides tool platform to transplant; Its test environment can be shared and reuse; The loading efficiency of function library is high and possess the ability that configuration/control the 3rd testing tool is tested.
In order to address the above problem, the technical solution used in the present invention is: the automatization test system that a kind of data-driven is provided, it includes testing tool and testing tool and equipment under test, it is characterized in that, further include the test platform that is used to drive described testing tool and testing tool, and link to each other, be used for function library that described testing tool and testing tool and equipment under test are configured and control with this test platform; Test environment generation module, test case generation module, test logic generation module and test suite generation module that described test platform includes a runtime engine at least and links to each other with this runtime engine; Wherein, described test environment generation module, test logic generation module, test case generation module generate test environment, test logic, test case respectively; Described runtime engine from test environment generation module, test logic generation module, and the test case generation module read test environment, test logic, test case, and loading function storehouse, set up the operation of test environment and test logic according to the test logic of selecting and set, and set tested testing equipment according to the operation of described test environment and test logic; Described test suite generation module generates the test suite of this test according to the test result of test case, described test suite is used for test case is classified, and comprises the operation information that this carries out unsanctioned test environment, test logic, test case data information and test script at least.
Wherein, described function library includes equipment under test function library, testing tool function library and testing tool function library; The test environment that described test environment generation module generates is used to set up or recover the test environment of this test, and described test environment definition has needs the function library that loads and the condition of setting up and the recovery condition of test environment under global data required in the test, the test environment; Described test case generation module generates test case according to test case data, this test case data define function library that the required test environment of this test logic, this test logic move required loading, and test process in the required test data of test logic; Described test logic generation module is used to generate the test logic of this test, this test logic is used to define testing process, used testing tool of synchronism detection and testing tool, and according to the test case data that runtime engine provides, equipment under test is tested;
Wherein, described test platform further includes the operational factor generation module, is used to generate the operational factor that the test log output condition is provided and the test report output condition is provided; Described runtime engine is exported test log and test report according to the defined output condition of operational factor generation module after end of test (EOT).
Wherein, described test report is used for representing the situation of the passing through statistics of these all test cases of test, it can comprise test data statistics, the test case inventory of each test result and the detecting information of each test case, and this test data statistics comprises: the test logic script sum of test time, operation, the test case sum of operation, execution result are respectively the test case sum of OK, POK, NG, NT; This test case inventory and detecting information comprise: test logic numbering, execution number of times, automatic test cases numbering, system testing use-case numbering, execution time, test environment, automatic test cases title.
Wherein, described test log is used for writing down the implementation status of the test case of this test process, and it records each step of this test, the start time and the time spent information of each step, and the error message when carrying out failure.
Wherein, described testing tool function library and testing tool function library are provided by described testing tool and testing tool respectively, and described testing tool and testing tool can be integrated in the test platform.
Wherein, described equipment under test function library, testing tool function library or testing tool function library are configured according to test environment and test case data, are loaded in test process by runtime engine, or load by test platform is static.
The present invention also provides a kind of automated testing method of data-driven, is used at test platform equipment under test being carried out automatic test, comprises the steps: the test logic that the test platform selection will move, and starts test; Runtime engine carries out initialization according to the operational factor that the operational factor generation module is generated; Runtime engine is set up the operation tree of test environment and test logic according to the test logic of selecting; Runtime engine is carried out this test according to the operation tree of test environment and test logic; Wherein, carrying out this test according to the operation of test environment and test logic tree further comprises: the privately owned environment of described environment of each layer test set and undermost test logic during the operation of setting up described test environment and test logic is set; Carry out undermost test logic successively; Recover the privately owned environment and the described environment of each layer test set of undermost test logic.
Wherein, the step of carrying out undermost test logic also comprises: load the required equipment under test function library of test logic; Load the required testing tool function library of test logic; Take out each bar test case data, carry out test logic; Start the daily record of carrying out test logic; Generate the test case reports on the implementation of test logic.
Wherein, described method also comprises: the test result according to test case generates the test suite that this tests unsanctioned test case composition.
Wherein, described method also comprises: according to defined output condition output test log of operational factor and test report.
Beneficial effect of the present invention is: in the present invention, runtime engine is by realizing possessing cross-platform, as to stride tool platform transplanting ability such as pure TCL script; In automatic test course, test environment and test logic can be shared and reuse, and can drive identical test logic in different test environments; By the test logic configuration file, can specify the function library of the testing tool/instrument/product that will load, the loading efficiency of function library is improved; Test logic and test data are separated, and make that the maintenance cost of test case is lower; Test data is represented with form, makes that the expansion of test case is more quick; After a robotization executes, if the test case that has not execution to pass through, then generate a test suite by runtime engine, comprise this and carry out information such as unsanctioned test environment, test logic, test case data, only need carry out test suite when carry out next time like this, just can carry out unsanctioned test case, improve the efficient of test.
Description of drawings
Fig. 1 is a kind of test case form synoptic diagram in the prior art.
Fig. 2 is the test system structure synoptic diagram that existing a kind of key word drives.
Fig. 3 is the structural representation of the automatization test system of data-driven of the present invention.
Fig. 4 is the more detailed high-level schematic functional block diagram of the automatization test system of data-driven of the present invention.
Fig. 5 is the synoptic diagram of test report form in the automatization test system of data-driven of the present invention.
Fig. 6 is a test log form synoptic diagram in the automatization test system of data-driven of the present invention.
Fig. 7 is the process flow diagram of the automated testing method of data-driven of the present invention.
Fig. 8 is the operation tree and the operation explanation synoptic diagram of test environment and test logic in the automated testing method of data-driven of the present invention.
Fig. 9 is a process flow diagram of carrying out test logic among Fig. 8.
Figure 10 is the physical storage structure synoptic diagram of the automatization test system of data-driven of the present invention.
Embodiment
At first technical term involved in the present invention is described as follows:
Test set (Test Cluster), it is the same test environment configurations and the networking configuration of some test logics, is test environment division logically, is the minimum material of forming test environment.
Test logic (Test Logic), it is the identical testing process of some test cases, the script describing of one group of test case that promptly testing process is identical, test data is different, test logic can move under different test environments.
Test case data (TestCaseData), its value by different test data items is formed, and each of the value of test data item makes up, and has constituted the test case data of different test cases.
Test case (TestCase), each combination of the value of the test data item of composition test case data, the test logic corresponding with test case data is called a test case together.
Test suite (TestSuite), by product performance, module or other (basic function, systemic-function) differentiation, the set of some test environments, test logic, test case data operation order, number of run.
Tool Command Language (tool command language, TCL), a kind of explanation execution script language.
As shown in Figure 3, be the structural representation of the automatization test system of data-driven among the present invention.Therefrom as can be seen, this test macro mainly includes test platform 1, testing tool and testing tool 3, equipment under test 4.And the function library 2 that includes runtime engine 10 and be connected with this runtime engine 10.
Wherein, test platform 1 can be any one test platform that is integrated with script interpreter (as TCL), the also Shell (as TCL Shell) of script, and it can manage, edit test script, and starts test script and begin test.Test script comprises test environment, test logic, test case data.
Testing tool and testing tool 3 are third party's program, and it is used to test equipment under test 4, and both can also be integrated in the test platform 1 for this, accept the centralized management of test platform 1.
Runtime engine 10 logically belongs to test platform 1, finishes adaptive between test platform 1 and the test script, according to the configuration in the test script, loads required function library 2, and the control whole test process;
In test process, test script is set up test environment, and tests equipment under test 4 by script control third party's testing tool and testing tool 3; In test process, between the testing tool 3, between the testing tool 3 and the coordination between testing tool 3 and the testing tool 3 come synchronously by test script.
As shown in Figure 4, be the more detailed functional block diagram of the automatization test system of data-driven among the present invention.It includes test platform 1, reaches the function library 2, testing tool/instrument 3 and the equipment under test 4 that link to each other with test platform 1 respectively.Wherein test platform 1 further includes runtime engine 10, test environment generation module 11, test case generation module 12, operational factor generation module 13, test suite generation module 14 and test logic generation module 15 again, wherein, test suite generation module 14 is optional module.Respectively each functional module is described below:
Function library 2 can include multiple function library, as equipment under test function library, testing tool function library and testing tool function library etc.Wherein, the equipment under test function library is used for configuration and control equipment under test; The testing tool function library is used for configuration and control testing tool; The testing tool function library is used for configuration and control testing tool.These function libraries are configured according to test environment and test case data, are loaded in test process by runtime engine, also can be configured to load by test platform is static.
And testing tool and testing tool 3, it can provide above-mentioned testing tool function library or testing tool function library, accepts the configuration and the control of test environment and test logic, and finishes the test to equipment under test 4.
Equipment under test 4 is an equipment tested in the test process, and it accepts the configuration and the control of test environment, accepts configuration, control and the test of test logic.
Test environment generation module 11 is mainly used in the foundation and the recovery of the test environment of finishing this test.This test environment comprises equipment under test and peripheral equipment 4, testing tool/testing tool 3; Required global data (variable) in its definition test; Definition needs the function library that loads under the test environment; The condition of setting up of definition test environment (as the initialization of equipment under test and peripheral equipment, testing tool/testing tool etc.); The recovery condition (as the release of equipment under test and peripheral equipment 4 resources, the release of testing tool/testing tool 3 public resources such as grade etc.) of definition test environment.
Test case generation module 12 is mainly used in according to test case data and generates test case, and wherein, this test case data definition test logic need in which test environment operation; The definition test logic moves necessary peculiar test environment; Definition test logic operation institute must loading specific function library; Be defined in the test process test data that test logic is required; Be used for runtime engine 10 driving test logics and finish test.
Operational factor generation module 13 is mainly used in the generating run parameter, and this operational factor provides the test log output condition and the test report output condition is provided.
Test logic generation module 15 is used to generate the test logic of this test, and this test logic is used to define testing process; In test process, used testing tool of synchronism detection and testing tool 3; According to the test case data that runtime engine 10 provides, finish test to equipment under test 4.
Test suite generation module 14 is used to generate the test suite of this test.Described test suite comprises this and carries out information such as unsanctioned test environment, test logic, test case data.Test suite is test script division logically, can reduce basic function test suite, characteristic test cover or the like.Content only in test suite: move which test script (test environment, test logic, test case data), and the operation information (as operation order, number of run) of these test scripts (test environment, test logic, test case data).
Runtime engine 10, it finishes the editor of test logic, test environment, test case data at test platform 1, and starts after the test of current selected test logic, the execution of control test script.Runtime engine can from test environment generation module 11, test logic generation module 15, and test case generation module 12 read test environment, test logic, test case data (and before the test beginning, set up test environment; After the end of test (EOT), recover test environment); The loading function storehouse, the version number in automatic recognition function storehouse, renewal function index file; In the test process,, drive test logic equipment under test 4 is tested according to test case data; In test process, according to operational factor, output test report and test log; According to the test result of test case, drive test suite generation module 14 and generate the test suite that this tests unsanctioned test case composition, convenient follow-up test once more unsanctioned test case.
Test report is after end of test (EOT), is provided by runtime engine 10.After this test report is used to represent this end of test (EOT), the statistics of the situation of passing through of all test cases in this test.As shown in Figure 5, be the example of a kind of test report among the present invention.Therefrom as can be seen, this test report has been listed the test data statistics, this test data statistics comprise such as: the test logic script sum of test time, operation, the test case sum of operation, execution result are respectively OK, part of O K (partial OK, POK), bad (NotGood, NG), do not test (Not Test, NT) the test case sum of Denging.And list the details of above-mentioned different execution results.
In the expression test process, write down the implementation status of the test case of current operation by runtime engine 10; After the end of test (EOT), by the implementation status (being test log) of the complete test case of runtime engine 10 outputs; As shown in Figure 6, be the format sample of a kind of test log among the present invention, it has at length write down each step of this test, and information such as the start time of each step and time spent.
As shown in Figure 7, be the process flow diagram of the method for data driven automation test of the present invention.In step S70, the test logic that the test platform selection will move, and start test.In step S71, runtime engine is finished initial work according to the operational factor that the operational factor generation module is generated.In step S72, runtime engine is set up the operation tree of test environment and test logic according to the test logic of this operation, and the operation tree and the operation explanation of this test environment and test logic can be referring to shown in Figure 8.In step S74, runtime engine begins to carry out this test according to the operation tree of test environment and test logic.At first in step S76, set up the described environment of test set of each layer, with reference to operation tree shown in Figure 8, promptly successively: carry out function 1 and set up environment TestCluster1; Carry out function 2, set up environment TestCluster11; Carry out function 3: set up environment TestCluster111; Carry out function 4: the privately owned environment of setting up test logic TestLogic1.And in step S78, carry out undermost test logic successively, promptly carry out TestLogic1; Carry out function D: the privately owned environment that recovers test logic TestLogic1; In like manner, continue to carry out function 5: the privately owned environment of setting up test logic TestLogic2; Carry out TestLogic2; Carry out function E: the privately owned environment that recovers test logic TestLogic2; Carry out function 6: set up the privately owned environment of test logic TestLogic3 and carry out TestLogic3; Carry out function F: the privately owned environment that recovers test logic TestLogic3.Then, in step S79, recover the described environment of each layer test set in the other direction.Promptly carry out function C: recover environment TestCluster111; Carry out function 7: set up environment TestCluster112, and carry out the test logic that under test set TestCluster112, moves; Carry out function G: recover environment TestCluster112; Carry out function 8: set up environment TestCluster113, and carry out the test logic that under test set TestCluster113, moves; Carry out function H: recover environment TestCluster113; Carry out function B: recover environment TestCluster11; Carry out function 9: set up environment TestCluster12, and carry out the test logic of TestCluster12: carry out function I: recover environment TestCluster12.Carry out function A: recover environment TestCluster1.
As shown in Figure 9, be the process flow diagram of carrying out the orlop test logic among Fig. 8 of the present invention.In this Fig. 9, be to be that example describes to carry out TestLogic1.In step S780, load the required equipment under test function library of test logic; In step S782, load the required testing tool function library of test logic; In step S784, take out each bar test case data, carry out test logic; In step S786, start the daily record of carrying out test logic; In step S788, generate the test case reports on the implementation of test logic.The process of undermost other test logics (such as TestLogic2, TestLogic2....TestLogic5) all similarly.
Wherein, from operation tree as can be seen, test logic TestLogic2 carries out under two environment, reaches the purpose that test logic is shared in test process, and corresponding data item is represented in the different test results use-case data under varying environment.
As shown in figure 10, be the physical storage structure synoptic diagram of data driven automation test among the present invention.The storage organization of the data driven automation test of Huawei Company is made up of five parts: function library (Lib), test script library (Scripts), test suite (TestSuites), test report (Report), test log (Log);
Wherein, function library can be divided into public function storehouse of dividing by testing tool, testing tool and the equipment under test function library of dividing by equipment under test again, the corresponding function library of each equipment under test.
Test script library also is to divide by equipment under test; Deposit test environment, test logic and the test case data of equipment under test in this test script library; And deposit the environmental parameter configuration file of data driven automation test system.
The test suite storehouse also is to divide by equipment under test; Deposit the test suite of equipment under test.
The test report catalogue also is to divide by equipment under test; Test process of every startup produces the test report of this test process, writes down the situation of passing through of the test case of moving in this test process.
The test log catalogue also is to divide by equipment under test; Test process of every startup produces the test log of this test process, writes down the operational process of test case in this test process.
In the present invention, the realization of runtime engine also can pass through other script (as Python etc.) or compiler language (as C/C++, Pascal etc.) realization except TCL realizes; The physical storage structure of data driven automation test system also can be realized by database (as Oracle, SQL Server etc.).
In the present invention, runtime engine is by realizing possessing cross-platform, as to stride tool platform transplanting ability such as pure TCL script; In the automatic test course, test environment and test logic can be shared and reuse, and can drive identical test logic in different test environments; By the test logic configuration file, can specify the function library of the testing tool/instrument/equipment under test that will load, the loading efficiency of function library is improved; Test logic and test data are separated, and make that the maintenance cost of test case is lower; Test data is represented with form, makes that the expansion of test case is more quick; After a robotization executes, if unsanctioned test case is arranged, then generate a test suite by runtime engine, comprise this and carry out information such as unsanctioned test environment, test logic, test case data, only need carry out this test suite when carry out next time like this, just can carry out unsanctioned test case, improve the efficient of test.

Claims (11)

1. the automatization test system of a data-driven, it includes testing tool and testing tool and equipment under test, it is characterized in that, further include the test platform that is used to drive described testing tool and testing tool, and link to each other, be used for function library that described testing tool and testing tool and equipment under test are configured and control with this test platform; Test environment generation module, test case generation module, test logic generation module and test suite generation module that described test platform includes a runtime engine at least and links to each other with this runtime engine; Wherein,
Described test environment generation module, test logic generation module, test case generation module generate test environment, test logic, test case respectively;
Described runtime engine is read test environment, test logic, test case from described test environment generation module, test logic generation module and test case generation module, and load described function library, set up the operation of test environment and test logic according to the test logic of selecting and set, and set tested testing equipment according to the operation of described test environment and test logic;
Described test suite generation module generates the test suite of this test according to the test result of test case, described test suite is used for test case is classified, and comprises the operation information that this carries out unsanctioned test environment, test logic, test case data information and test script at least.
2. the automatization test system of data-driven as claimed in claim 1, it is characterized in that: described test platform further includes the operational factor generation module, is used to generate the operational factor that the test log output condition is provided and the test report output condition is provided; Described runtime engine is exported test log and test report according to the defined output condition of described operational factor generation module after end of test (EOT).
3. the automatization test system of data-driven as claimed in claim 2, it is characterized in that, described test report is used for representing the situation of the passing through statistics of these all test cases of test, it comprises test data statistics, the test case inventory of each test result and the detecting information of each test case, and this test data statistics comprises: the test logic script sum of test time, operation, the test case sum of operation, execution result are respectively the test case sum of OK, POK, NG, NT; This test case inventory and detecting information comprise: test logic numbering, execution number of times, automatic test cases numbering, system testing use-case numbering, execution time, test environment, automatic test cases title.
4. the automatization test system of data-driven as claimed in claim 2, it is characterized in that, described test log is used for writing down the implementation status of the test case of this test process, it records each step of this test, the start time and the time spent information of each step, and carries out the error message when failing.
5. the automatization test system of data-driven as claimed in claim 1 is characterized in that, described function library comprises equipment under test function library, testing tool function library and testing tool function library;
The test environment that described test environment generation module generates is used to set up or recover the test environment of this test, and described test environment definition has needs the function library that loads and the condition of setting up and the recovery condition of test environment under global data required in the test, the test environment;
Described test case generation module generates test case according to test case data, and the definition of this test case data has the required test environment of test logic, test logic to move the required test data of test logic in the function library of required loading and the test process;
The test logic that described test logic generation module generates is used to define testing process, used testing tool of synchronism detection and testing tool, and according to the test case data that runtime engine provides equipment under test is tested.
6. the automatization test system of data-driven as claimed in claim 5, it is characterized in that, described testing tool function library and testing tool function library are provided by described testing tool and testing tool respectively, and described testing tool and testing tool can be integrated in the test platform.
7. the automatization test system of data-driven as claimed in claim 5, it is characterized in that, described equipment under test function library, testing tool function library or testing tool function library are configured according to test environment and test case data, load in test process by runtime engine, or load by test platform is static.
8. the automated testing method of a data-driven is used at test platform equipment under test being carried out automatic test, it is characterized in that, comprises the steps:
The test logic that the test platform selection will move, and start test;
Runtime engine carries out initialization according to the operational factor that the operational factor generation module is generated;
Runtime engine is set up the operation tree of test environment and test logic according to the test logic of selecting;
Runtime engine is carried out this test according to the operation tree of test environment and test logic;
Wherein, carrying out this test according to the operation tree of test environment and test logic further comprises:
Set up the privately owned environment of described environment of each layer test set in the operation tree of described test environment and test logic and undermost test logic;
Carry out undermost test logic in the operation tree of described test environment and test logic successively;
Recover the privately owned environment and the described environment of each layer test set of described undermost test logic.
9. the automated testing method of data-driven as claimed in claim 8 is characterized in that, the step of the undermost test logic of described execution also comprises:
Load the required test product function library of described test logic;
Load the required testing tool function library of described test logic;
Take out each bar test case data, carry out described test logic;
Start the daily record of carrying out described test logic;
Generate the test case reports on the implementation of described test logic.
10. the automated testing method of data-driven as claimed in claim 8 is characterized in that, described method also comprises: the test result according to test case generates the test suite that this tests unsanctioned test case composition.
11. the automated testing method of data-driven as claimed in claim 8 is characterized in that, described method also comprises: according to defined output condition output test log of operational factor and test report.
CNB2005100351973A 2005-06-06 2005-06-06 Data-driven automatic testing system and method Expired - Fee Related CN100401264C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2005100351973A CN100401264C (en) 2005-06-06 2005-06-06 Data-driven automatic testing system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2005100351973A CN100401264C (en) 2005-06-06 2005-06-06 Data-driven automatic testing system and method

Publications (2)

Publication Number Publication Date
CN1877543A CN1877543A (en) 2006-12-13
CN100401264C true CN100401264C (en) 2008-07-09

Family

ID=37509986

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2005100351973A Expired - Fee Related CN100401264C (en) 2005-06-06 2005-06-06 Data-driven automatic testing system and method

Country Status (1)

Country Link
CN (1) CN100401264C (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101770423B (en) * 2009-12-25 2013-02-27 中兴通讯股份有限公司 Test data generation method and test system

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100451989C (en) * 2007-04-20 2009-01-14 北京航空航天大学 Software testing system and testing method
CN101526917B (en) * 2009-04-22 2011-08-10 南京大学 Method for reproducing test scripts based on data drive
CN101662394B (en) * 2009-09-15 2012-07-18 中兴通讯股份有限公司 Automated testing system and automated testing method
CN101882107A (en) * 2010-06-28 2010-11-10 山东中创软件商用中间件股份有限公司 Method and device for automatically testing WEB (World Wide Web) application
CN101916221A (en) * 2010-07-23 2010-12-15 中兴通讯股份有限公司 Method and system for performing unit testing on equipment
CN102375777A (en) * 2010-08-12 2012-03-14 盛科网络(苏州)有限公司 Object-oriented test platform
CN101976219A (en) * 2010-08-19 2011-02-16 北京星网锐捷网络技术有限公司 Method and system for debugging automatic testing script and agent device
CN103019927B (en) * 2011-09-27 2015-11-18 北京新媒传信科技有限公司 A kind of performance test methods and system
CN103150249B (en) * 2011-12-07 2015-12-16 北京新媒传信科技有限公司 A kind of method and system of automatic test
CN104978532B (en) * 2011-12-27 2018-10-23 北京奇虎科技有限公司 A kind of bug-fixing client logic testing method and bug-fixing client logic testing system
CN103186561A (en) * 2011-12-28 2013-07-03 深圳市金蝶友商电子商务服务有限公司 Data test method, test library generating method and related device
CN103186460B (en) * 2011-12-30 2016-03-02 金蝶软件(中国)有限公司 A kind of method, Apparatus and system of generating test use case script
CN103198009B (en) * 2012-01-04 2016-09-07 中国移动通信集团公司 A kind of universal testing method, system and related device
CN103577907B (en) * 2012-07-24 2016-12-07 阿里巴巴集团控股有限公司 A kind of continuous integrating method of testing and system
CN104298589B (en) * 2013-07-16 2018-01-16 阿里巴巴集团控股有限公司 A kind of performance test methods and equipment
CN104778118B (en) * 2013-12-30 2018-08-28 深圳键桥通讯技术股份有限公司 The improved method of automatization testing technique
CN103885882A (en) * 2014-04-10 2014-06-25 国家电网公司 Testing script based on SAP platform and parameter integration method
CN105243013B (en) * 2015-09-17 2018-07-20 浪潮(北京)电子信息产业有限公司 A kind of method for testing software and system
CN106209515B (en) * 2016-07-12 2019-06-28 中国南方电网有限责任公司电网技术研究中心 Access network equipment automatization test system
CN106502898A (en) * 2016-10-25 2017-03-15 广州神马移动信息科技有限公司 Method of testing and test driver and test platform
CN106569953A (en) * 2016-11-03 2017-04-19 武汉烽火网络有限责任公司 Method for enhancing the transportability and robustness of communication device automated test scripts
CN107391376A (en) * 2017-07-26 2017-11-24 成都科来软件有限公司 A kind of regression testing method
CN107919998B (en) * 2017-11-02 2020-10-30 千寻位置网络有限公司 Sensor server function testing method and system based on JMeter
CN107943635A (en) * 2017-11-30 2018-04-20 郑州云海信息技术有限公司 A kind of test method of storage device, device and medium
CN108333445B (en) * 2017-12-26 2020-04-03 北京航天测控技术有限公司 Instrument management method of data acquisition instrument based on VxWorks
CN108829555A (en) * 2018-06-25 2018-11-16 郑州云海信息技术有限公司 Authentication test method and device in Citrix system
CN109656573B (en) * 2018-11-26 2022-03-15 Oppo(重庆)智能科技有限公司 System installation method and device, electronic equipment and computer readable storage medium
CN111309584B (en) * 2018-12-11 2024-02-23 迈普通信技术股份有限公司 Data processing method, device, electronic equipment and storage medium
CN110321281A (en) * 2019-05-24 2019-10-11 中国工程物理研究院计算机应用研究所 Web test platform and test method based on mixing automated test frame
CN111983998B (en) * 2020-09-04 2021-11-30 华人运通(江苏)技术有限公司 Automatic diagnosis test case generation system and method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5784553A (en) * 1996-01-16 1998-07-21 Parasoft Corporation Method and system for generating a computer program test suite using dynamic symbolic execution of JAVA programs
US20030056150A1 (en) * 2001-09-14 2003-03-20 David Dubovsky Environment based data driven automated test engine for GUI applications
US6601018B1 (en) * 1999-02-04 2003-07-29 International Business Machines Corporation Automatic test framework system and method in software component testing
CN1499374A (en) * 2002-11-04 2004-05-26 华为技术有限公司 Automatic approach for unit testing
US20040128652A1 (en) * 2002-12-31 2004-07-01 Sun Microsystems, Inc. Method and system for generating and maintaining uniform test results
CN1527509A (en) * 2003-03-06 2004-09-08 华为技术有限公司 Test method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5784553A (en) * 1996-01-16 1998-07-21 Parasoft Corporation Method and system for generating a computer program test suite using dynamic symbolic execution of JAVA programs
US6601018B1 (en) * 1999-02-04 2003-07-29 International Business Machines Corporation Automatic test framework system and method in software component testing
US20030056150A1 (en) * 2001-09-14 2003-03-20 David Dubovsky Environment based data driven automated test engine for GUI applications
CN1499374A (en) * 2002-11-04 2004-05-26 华为技术有限公司 Automatic approach for unit testing
US20040128652A1 (en) * 2002-12-31 2004-07-01 Sun Microsystems, Inc. Method and system for generating and maintaining uniform test results
CN1527509A (en) * 2003-03-06 2004-09-08 华为技术有限公司 Test method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
数据驱动自动化测试方法研究. 金大海,宫云战.装甲兵工程学院院报,第18卷第2期. 2004
数据驱动自动化测试方法研究. 金大海,宫云战.装甲兵工程学院院报,第18卷第2期. 2004 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101770423B (en) * 2009-12-25 2013-02-27 中兴通讯股份有限公司 Test data generation method and test system

Also Published As

Publication number Publication date
CN1877543A (en) 2006-12-13

Similar Documents

Publication Publication Date Title
CN100401264C (en) Data-driven automatic testing system and method
CN100401265C (en) Keyword-driven automatic testing system and method
CN100377109C (en) Method for completing product automation test utilizing test kit
CN103441900B (en) Centralized cross-platform automatization test system and control method thereof
CN110309071B (en) Test code generation method and module, and test method and system
Memon Automatically repairing event sequence-based GUI test suites for regression testing
US6268853B1 (en) Data structure for use in enterprise controls
US6556950B1 (en) Diagnostic method and apparatus for use with enterprise control
CN103164328B (en) The regression testing method of a kind of business function, Apparatus and system
CN103150249B (en) A kind of method and system of automatic test
US6618856B2 (en) Simulation method and apparatus for use in enterprise controls
US7546232B2 (en) Mechanical-electrical template based method and apparatus
CN100353327C (en) Method for realizing product automatic test by test environment composed of test set
CN110321281A (en) Web test platform and test method based on mixing automated test frame
CN101046763A (en) Implementing method of automatic test system based on scenario
US20050223360A1 (en) System and method for providing a generic user interface testing framework
CN100375057C (en) Automatic test auxiliary system and corresponding software automatic test method
CN106227654B (en) A kind of test platform
WO2012063070A1 (en) A method of automatically testing different software applications for defects
CN110928783A (en) RobotFramework-based automatic test datamation reconstruction platform
US20050229161A1 (en) Generic user interface testing framework with load-time libraries
CN106776326B (en) Modeling method and system of data analysis model
CN112433948A (en) Simulation test system and method based on network data analysis
CN109933521A (en) Automated testing method, device, computer equipment and storage medium based on BDD
US20050228644A1 (en) Generic user interface testing framework with rules-based wizard

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20180710

Address after: California, USA

Patentee after: Global innovation polymerization LLC

Address before: London, England

Patentee before: GW partnership Co.,Ltd.

Effective date of registration: 20180710

Address after: London, England

Patentee after: GW partnership Co.,Ltd.

Address before: 518129 office building, Buji, Bantian, HUAWEI headquarters, Longgang District, Shenzhen, Guangdong

Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd.

TR01 Transfer of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20080709

CF01 Termination of patent right due to non-payment of annual fee