Abstract: The present subject matter relates to a computer implemented method and a computer system for optimizing execution of test cases. The method comprises calculating failure probability level of plurality of test cases based on plurality of test results associated to each of the plurality of test cases and determining dynamic risk profile level based on weights assigned to the failure probability level and risk impact parameter of the plurality of test cases. The method further comprises determining one or more set of optimal test cases to be executed based on the dynamic risk profile level of the plurality of test cases satisfying one or more test rule parameters. Upon determining, the method comprises identifying sequence of executing the one or more set of optimal test cases based on the one or more test sequence parameters and executing the one or more set of optimal test cases in the identified sequence. FIG. 2
CLIAMS:We Claim:
1. A computer implemented method of optimizing execution of test cases, comprising
calculating, by a test optimization system, failure probability level of a plurality of test cases based on a plurality of test results associated with each of the plurality of test cases;
determining, by the test optimization system, dynamic risk profile level based on weights assigned to the failure probability level and risk impact parameter of the plurality of test cases;
determining, by the test optimization system, one or more set of optimal test cases to be executed from the plurality of test cases based on the dynamic risk profile level of the plurality of test cases and satisfying one or more test rule parameters; and
executing, by the test optimization system, the one or more set of optimal test cases.
2. The method as claimed in claim 1, wherein upon determining the one or more set of optimal test cases, the method comprises identifying, by the test optimization system, a sequence of execution of the one or more set of optimal test cases based on one or more test sequence parameters for executing the one or more set of optimal test cases in the identified sequence.
3. The method as claimed in claim 1, wherein the plurality of test results, a plurality of risk impact parameters associated with the plurality of test cases, and weights of the failure probability level and the plurality of risk impact parameters of plurality of test cases are received by the test optimization system from a Test Management System (TMS) over a communication network.
4. The method as claimed in claim 1, wherein determining the dynamic risk profile level comprises:
determining a risk profile score for the plurality of test cases based on the weighted failure probability level and weighted risk impact parameters;
comparing the risk profile score with one or more risk profile threshold score, wherein the one or more risk profile threshold score includes high risk profile threshold score, medium risk profile threshold score, low risk threshold score and very low risk profile threshold score; and
determining dynamic risk profile level of each of the plurality of test cases based on the comparison.
5. The method as claimed in claim 1, wherein determining the one or more set of optimal test cases comprises:
identifying one or more test cases of the plurality of test cases assigned with one or more risk profiles satisfying the one or more test rule parameters; and
eliminating one or more unidentified test cases of the plurality of test cases from executing.
6. The method as claimed in claim 1, further comprising:
updating one or more execution results associated with the one or more optimal set of executed test cases in the TMS;
monitoring, by the test optimization system, the one or more execution results updated in the TMS to determine whether the one or more execution results satisfy one or more predetermined conditions; and
updating, by the test optimization system, one or more non-executed test cases in the TMS upon determining that the one or more execution results satisfy the one or more predetermined conditions.
7. The method as claimed in claim 1, wherein the weights associated with the failure probability level and risk impact parameter are configurable by a user.
8. The method as claimed in claim 1, wherein the dynamic risk profile level of each of the plurality of test cases and corresponding sequence of execution are updated in the TMS by the test optimization system.
9. A test optimization system for optimizing execution of test cases, comprising:
a processor; and
a memory communicatively coupled to the processor, wherein the memory stores processor-executable instructions, which, on execution, causes the processor to:
calculate failure probability level of plurality of test cases based on a plurality of test results associated with each of the plurality of test cases;
determine dynamic risk profile level based on weights assigned to the failure probability level and risk impact parameter of the plurality of test cases;
determine one or more set of optimal test cases to be executed from the plurality of test cases based on the dynamic risk profile level of the plurality of test cases and satisfying one or more test rule parameters; and
execute each test case of the one or more set of optimal test cases.
10. The system as claimed in claim 9, wherein the instructions, on execution, further cause the processor to identify a sequence of execution of the one or more set of optimal test cases based on the one or more test sequence parameters for executing the one or more set of optimal test cases in the identified sequence.
11. The system as claimed in claim 9, wherein the instructions, on execution, further cause the processor to:
receive the plurality of test results, a plurality of risk impact parameters associated with the plurality of test cases, and weights of the failure probability level and the plurality of risk impact parameters of plurality of test cases from an externally coupled Test Management System (TMS) over a communication network.
12. The system as claimed in claim 9, wherein the instructions, on execution, further cause the processor to:
determine a risk profile score for the plurality of test cases based on the weighted failure probability level and weighted risk impact parameters;
compare the risk profile score with one or more risk profile threshold score, wherein the one or more risk profile threshold score includes high risk profile threshold score, medium risk profile threshold score, low risk threshold score and very low risk profile threshold score; and
determine dynamic risk profile level of each of the plurality of test cases based on the comparison.
13. The system as claimed in claim 9, wherein the instructions, on execution, further cause the processor to:
identify one or more test cases of the plurality of test cases assigned with one or more risk profiles satisfying the one or more test rule parameters; and
eliminate one or more unidentified test cases of the plurality of test cases from executing.
14. The system as claimed in claim 9, wherein the instructions, on execution, further cause the processor to:
update one or more execution results associated with the one or more optimal set of executed test cases in the TMS;
monitor the one or more execution results updated in the TMS to determine whether the one or more execution results satisfy one or more predetermined conditions; and
update one or more non-executed test cases in the TMS upon determining that the one or more execution results satisfy the one or more predetermined conditions.
15. The system as claimed in claim 9, wherein the instructions, on execution, further cause the processor to transmit the execution results and the plurality of dynamic risk profile levels assigned to the plurality of test cases to the TMS for updating.
16. A non-transitory computer readable medium including operations stored thereon that when processed by at least one processor cause a system to perform the acts of:
calculating failure probability level of plurality of test cases based on a plurality of test results associated with each of the plurality of test cases;
determining dynamic risk profile level based on weights assigned to the failure probability level and risk impact parameter of the plurality of test cases;
determining one or more set of optimal test cases to be executed from the plurality of test cases based on the dynamic risk profile level of the plurality of test cases and satisfying one or more test rule parameters; and
executing each test case of the one or more set of optimal test cases.
Dated this 25th day of April, 2014
Madhusudan S.T.
Of K&S Partners
Attorney for the Applicant
,TagSPECI:FIELD OF THE DISCLOSURE
The present subject matter is related, in general to software testing, and more particularly, but not exclusively to a method and system for optimizing execution of test cases during software testing.
| Section | Controller | Decision Date |
|---|---|---|
| # | Name | Date |
|---|---|---|
| 1 | 2098-CHE-2014-RELEVANT DOCUMENTS [30-09-2023(online)].pdf | 2023-09-30 |
| 1 | 2098-CHE-2014-Request For Certified Copy-Online(25-04-2014).pdf | 2014-04-25 |
| 2 | 2098-CHE-2014 FORM-2 25-04-2014.pdf | 2014-04-25 |
| 2 | 2098-CHE-2014-PROOF OF ALTERATION [20-04-2022(online)].pdf | 2022-04-20 |
| 3 | 2098-CHE-2014-US(14)-HearingNotice-(HearingDate-02-11-2020).pdf | 2021-10-17 |
| 3 | 2098-CHE-2014 DRAWINGS 25-04-2014.pdf | 2014-04-25 |
| 4 | 2098-CHE-2014-IntimationOfGrant03-05-2021.pdf | 2021-05-03 |
| 4 | 2098-CHE-2014 POWER OF ATTORNEY 25-04-2014.pdf | 2014-04-25 |
| 5 | 2098-CHE-2014-PatentCertificate03-05-2021.pdf | 2021-05-03 |
| 5 | 2098-CHE-2014 FORM-9 25-04-2014.pdf | 2014-04-25 |
| 6 | 2098-CHE-2014-Annexure [17-11-2020(online)].pdf | 2020-11-17 |
| 6 | 2098-CHE-2014 FORM-5 25-04-2014.pdf | 2014-04-25 |
| 7 | 2098-CHE-2014-PETITION UNDER RULE 137 [17-11-2020(online)].pdf | 2020-11-17 |
| 7 | 2098-CHE-2014 FORM-3 25-04-2014.pdf | 2014-04-25 |
| 8 | 2098-CHE-2014-RELEVANT DOCUMENTS [17-11-2020(online)].pdf | 2020-11-17 |
| 8 | 2098-CHE-2014 DESCRIPTION (COMPLETE) 25-04-2014.pdf | 2014-04-25 |
| 9 | 2098-CHE-2014 CLAIMS 25-04-2014.pdf | 2014-04-25 |
| 9 | 2098-CHE-2014-Written submissions and relevant documents [17-11-2020(online)].pdf | 2020-11-17 |
| 10 | 2098-CHE-2014 ABSTRACT 25-04-2014.pdf | 2014-04-25 |
| 10 | 2098-CHE-2014-Correspondence to notify the Controller [01-10-2020(online)].pdf | 2020-10-01 |
| 11 | 2098-CHE-2014-FORM-26 [01-10-2020(online)].pdf | 2020-10-01 |
| 11 | IP26687-spec.pdf | 2014-04-28 |
| 12 | 2098-CHE-2014-FER_SER_REPLY [29-04-2020(online)].pdf | 2020-04-29 |
| 12 | IP26687-fig.pdf | 2014-04-28 |
| 13 | 2098-CHE-2014-FORM 3 [28-04-2020(online)].pdf | 2020-04-28 |
| 13 | Form-9(Online).pdf | 2014-04-28 |
| 14 | 2098-CHE-2014-FER.pdf | 2019-11-01 |
| 14 | FORM 5.pdf | 2014-04-28 |
| 15 | 2098-CHE-2014 CORRESPONDENCE OTHERS 03-09-2014.pdf | 2014-09-03 |
| 15 | FORM 3.pdf | 2014-04-28 |
| 16 | 2098-CHE-2014 FORM-1 03-09-2014.pdf | 2014-09-03 |
| 16 | 2098CHE2014_CertifiedCopyRequest.pdf | 2014-04-28 |
| 17 | abstract2098-CHE-2014.jpg | 2014-04-29 |
| 17 | 2098-CHE-2014 POWER OF ATTORNEY 03-09-2014.pdf | 2014-09-03 |
| 18 | 2098-CHE-2014 POWER OF ATTORNEY 03-09-2014.pdf | 2014-09-03 |
| 18 | abstract2098-CHE-2014.jpg | 2014-04-29 |
| 19 | 2098-CHE-2014 FORM-1 03-09-2014.pdf | 2014-09-03 |
| 19 | 2098CHE2014_CertifiedCopyRequest.pdf | 2014-04-28 |
| 20 | 2098-CHE-2014 CORRESPONDENCE OTHERS 03-09-2014.pdf | 2014-09-03 |
| 20 | FORM 3.pdf | 2014-04-28 |
| 21 | 2098-CHE-2014-FER.pdf | 2019-11-01 |
| 21 | FORM 5.pdf | 2014-04-28 |
| 22 | 2098-CHE-2014-FORM 3 [28-04-2020(online)].pdf | 2020-04-28 |
| 22 | Form-9(Online).pdf | 2014-04-28 |
| 23 | 2098-CHE-2014-FER_SER_REPLY [29-04-2020(online)].pdf | 2020-04-29 |
| 23 | IP26687-fig.pdf | 2014-04-28 |
| 24 | IP26687-spec.pdf | 2014-04-28 |
| 24 | 2098-CHE-2014-FORM-26 [01-10-2020(online)].pdf | 2020-10-01 |
| 25 | 2098-CHE-2014 ABSTRACT 25-04-2014.pdf | 2014-04-25 |
| 25 | 2098-CHE-2014-Correspondence to notify the Controller [01-10-2020(online)].pdf | 2020-10-01 |
| 26 | 2098-CHE-2014 CLAIMS 25-04-2014.pdf | 2014-04-25 |
| 26 | 2098-CHE-2014-Written submissions and relevant documents [17-11-2020(online)].pdf | 2020-11-17 |
| 27 | 2098-CHE-2014 DESCRIPTION (COMPLETE) 25-04-2014.pdf | 2014-04-25 |
| 27 | 2098-CHE-2014-RELEVANT DOCUMENTS [17-11-2020(online)].pdf | 2020-11-17 |
| 28 | 2098-CHE-2014 FORM-3 25-04-2014.pdf | 2014-04-25 |
| 28 | 2098-CHE-2014-PETITION UNDER RULE 137 [17-11-2020(online)].pdf | 2020-11-17 |
| 29 | 2098-CHE-2014 FORM-5 25-04-2014.pdf | 2014-04-25 |
| 29 | 2098-CHE-2014-Annexure [17-11-2020(online)].pdf | 2020-11-17 |
| 30 | 2098-CHE-2014 FORM-9 25-04-2014.pdf | 2014-04-25 |
| 30 | 2098-CHE-2014-PatentCertificate03-05-2021.pdf | 2021-05-03 |
| 31 | 2098-CHE-2014-IntimationOfGrant03-05-2021.pdf | 2021-05-03 |
| 31 | 2098-CHE-2014 POWER OF ATTORNEY 25-04-2014.pdf | 2014-04-25 |
| 32 | 2098-CHE-2014-US(14)-HearingNotice-(HearingDate-02-11-2020).pdf | 2021-10-17 |
| 32 | 2098-CHE-2014 DRAWINGS 25-04-2014.pdf | 2014-04-25 |
| 33 | 2098-CHE-2014-PROOF OF ALTERATION [20-04-2022(online)].pdf | 2022-04-20 |
| 33 | 2098-CHE-2014 FORM-2 25-04-2014.pdf | 2014-04-25 |
| 34 | 2098-CHE-2014-Request For Certified Copy-Online(25-04-2014).pdf | 2014-04-25 |
| 34 | 2098-CHE-2014-RELEVANT DOCUMENTS [30-09-2023(online)].pdf | 2023-09-30 |
| 1 | gonzalez-sanchez2009_01-11-2019.pdf |
| 1 | SearchStrategy_A2098CHE2014AE_14-07-2020.pdf |
| 2 | SearchStrategyMatrix_2098che2014_01-11-2019.pdf |
| 3 | gonzalez-sanchez2009_01-11-2019.pdf |
| 3 | SearchStrategy_A2098CHE2014AE_14-07-2020.pdf |