System And Method For Optimizing Software Quality Assurance During Software Development Process

Cognizant Technology Solutions India Pvt. Ltd.
Granted App No 201941050955 Patent 533135 Computer Science

Patent information

IP India · live record
Application number
201941050955
Filing date
10 December 2019
Status
Granted
Legal status
Inforce
Publication number
24/2021
Publication type
INA
Invention field
Computer Science
Patent number
533135
Grant date
15 April 2024
Next renewal due
10 December 2034

Abstract

A system (104) and a method for optimizing software quality assurance during various phases of Software Development Process (SDP) is provided. In particular, the present invention provides for generating machine learning (ML) models corresponding to respective phases of the SDP based on historical data. Further, each of the generated ML models associated with respective phases of the SDP are configured with a set of parameters. Furthermore, a model configuration corresponding to each phase of SDP is identified by executing configured models on the historical data and a set of predefined result-parameters is analyzed. Yet further, quality assurance events are optimized by analyzing real-time data associated with respective phases of SDP using the identified model configuration corresponding to respective phases. Finally, the prediction-results of the identified model configuration are monitored for respective phases and another model configuration(s) is selected if the performance metrics of the identified model configuration are unsatisfactory. Fig 2.

Applicants

1
India
Cognizant Technology Solutions India Pvt. Ltd. Techno Complex, No. 5/535, Old Mahabalipuram Road, Okkiyam Thoraipakkam, Chennai 600 097, Tamil Nadu, India

Inventors

3
U.S.A.
Vasanthkumar Velayudham8100 Memorial Lane Apt # 1204, Plano, TX 75024 United States of America
U.S.A.
Vikul Gupta202 Kings Castle Dr. Apex, NC 27502, United States of America
India
Dattaprasad KulkarniJ-101, Samrajya Balwantpuram, Shivtirthnagar Kothrud, Pune – 411038, Maharashtra, India

Claims

26
1 A method for optimizing software quality assurance during various phases of software development process(SDP), wherein the method is implemented by at least one processor (112) executing program instructions stored in a memory(114), the method comprising: generating, by the processor(112), one or more machine learning models corresponding to respective phases of the SDP from a historical data, wherein the historical data includes various types of data-artifacts associated with the respective phases of SDP; configuring, by the processor (112), each of the generated ML models associated with the respective phases of SDP with a set of variable parameters corresponding to the respective phases of SDP to generate a plurality of configured models for the respective phases of SDP; selecting, by the processor (112), a model configuration from the plurality of configured models for the respective phases of SDP for analyzing real-time data associated with the respective phases of SDP based on a predefined result-parameters; and optimizing, by the processor(112), events associated with quality assurance by analyzing real-time data associated with the respective phases of SDP using the selected model configuration corresponding to the respective phases.
2 The method as claimed in claim 1, wherein prediction-results obtained by analyzing real-time data via the selected model configuration corresponding to the respective phases of SDP are monitored based on a predefined performance metrics associated with the selected model configuration, and another model configuration is selected if the performance metrics of the selected model configuration is unsatisfactory or dips below a predefined threshold of the performance metrics.
3 The method as claimed in claim 1, wherein the historical data is associated with at least one of: application under development (AUT), other related applications having common software modules, and unrelated applications having common software modules, further wherein the historical data may include structured, semi-structured and unstructured data type.
4 The method as claimed in claim 1, wherein generating the machine learning models corresponding to the respective phases of the SDP comprises: parsing the historical data using one or more parsing techniques, wherein the one or more parsing techniques may be selected based on a data type in the historical data; analyzing the parsed historical data to identify a general pattern of defects associated with the respective phases of SDP and abstracting complex technical details by analyzing the parsed historical data; and generating one or more machine learning (ML) models corresponding to the respective phases of SDP based on the analyzed historical data using one or more machine learning techniques.
5 The method as claimed in claim 4, wherein the one or more parsing techniques may be selected from at least one of a regular expression based technique and a Grok pattern based parsing technique.
6 The method as claimed in claim 4, wherein the one or more machine learning techniques may be selected from at least one of: text processing, classification, regression, and clustering.
7 The method as claimed in claim 1, wherein the phases of software development process(SDP) include requirement gathering and analysis, system design, coding, testing, and deployment.
8 The method as claimed in claim 1, wherein each of the generated one or more machine learning models are configured with the set of variable parameters corresponding to the respective phases of SDP.
9 The method as claimed in claim 1, wherein the variable set of parameters include duration of collection of historical data, filters on the priority of data, text processing based parameters including: RegEx pattern, Stopwords, ngram configuration and vectorization parameters, and hyper parameters of algorithms including random forest, Naïve Bayes and K-Means clustering.
10 The method as claimed in claim 1, wherein selecting the model configuration for the respective phases of SDP comprises iteratively executing each of the plurality of configured models corresponding to each phase of SDP on the historical data, and analyzing the set of predefined result-parameters, wherein the model configuration showing closest proximity with the predefined result-parameter values are selected for the respective phases.
11 The method as claimed in claim 1, wherein the predefined result parameters include model accuracy, model f1-score, precision, recall, and cluster quality score.
12 The method as claimed in claim 1, wherein optimizing the events associated with quality assurance comprises: parsing the real-time data using one or more parsing techniques; identifying the phases of SDP associated with the real-time data; and analyzing the parsed real-time data using the selected model configuration associated with the identified phases of SDP to identify data artifacts associated with the identified phases of SDP to optimize quality assurance.
13 The method as claimed in claim 1, wherein events associated with quality assurance include performing risk based testing, pruning and optimizing defect backlogs, predicting number of defects, predicting success percentage of test cases, identifying frequently failing test cases, identifying gaps in testing process, test optimization, triage effort optimization, defect turnaround time improvement, and identifying frequent defects.
14 A system (104) for optimizing software quality assurance during various phases of software development process(SDP), the system (104) comprising: a memory (114) storing program instructions; a processor (112) configured to execute program instructions stored in the memory (114); and a quality analysis engine (110) executed by the processor (112) to: generate machine learning (ML) models corresponding to respective phases of the SDP from a historical data, wherein the historical data includes various types of data-artifacts associated with the respective phases of SDP; configure each of the generated ML models associated with the respective phases of SDP with a set of variable parameters corresponding to the respective phases of SDP to generate a plurality of configured models for the respective phases of SDP; select a model configuration from the plurality of configured models for the respective phases of SDP for analyzing real-time data associated with the respective phases of SDP based on a predefined result-parameters; and optimize events associated with quality assurance by analyzing real-time data associated with the respective phases of SDP using the selected model configuration corresponding to the respective phases.
15 The system (104) as claimed in claim 14, wherein prediction-results obtained by analyzing real-time data via the selected model configuration corresponding to the respective phases of SDP are monitored based on a predefined performance metrics associated with the selected model configuration, and another model configuration is selected if the performance metrics of the selected model configuration is unsatisfactory or dips below a predefined threshold of the performance metrics.
16 The system (104) as claimed in claim 14, wherein the historical data is associated with at least one of: application under development (AUT), other related applications having common software modules, and unrelated applications having common software modules, further wherein the historical data may include structured, semi-structured and unstructured data type.
17 The system (104) as claimed in claim 14, wherein the quality analysis engine (110) comprises a data analysis unit (116) in communication with the processor (112), said data analysis unit (116) configured to generate the machine learning models corresponding to the respective phases of the SDP by: parsing the historical data using one or more parsing techniques, wherein the one or more parsing techniques may be selected based on a data type in the historical data; analyzing the parsed historical data to identify a general pattern of defects associated with the respective phases of SDP and abstracting complex technical details by analyzing the parsed historical data; and generating one or more machine learning (ML) models corresponding to the respective phases of SDP based on the analyzed historical data using one or more machine learning techniques.
18 The system (104) as claimed in claim 17, wherein the one or more parsing techniques may be selected from at least one of a regular expression based technique and a Grok pattern based parsing technique.
19 The system (104) as claimed in claim 17, wherein the one or more machine learning techniques may be selected from at least one of: text processing, classification, regression, and clustering.
20 The system (104) as claimed in claim 14, wherein the phases of software development process(SDP) include requirement gathering and analysis, system design, coding, testing, and deployment.
21 The system (104) as claimed in claim 14, wherein the quality analysis engine (110) comprises a configuration and selection unit (120) in communication with the processor (112), said configuration and selection unit(120) configured to configure each of the generated one or more machine learning models with the set of variable parameters corresponding to the respective phases of SDP.
22 The system (104) as claimed in claim 14, wherein the variable set of parameters include duration of collection of historical data, filters on the priority of data, text processing based parameters including: RegEx pattern, Stopwords, ngram configuration and vectorization parameters, and hyper parameters of algorithms including random forest, Naïve Bayes and K-Means clustering.
23 The system (104) as claimed in claim 14, wherein the quality analysis engine (110) comprises a configuration and selection unit (120) in communication with the processor (112), said configuration and selection unit (120) configured to select the model configuration for the respective phases of SDP by iteratively executing each of the plurality of configured models corresponding to each phase of SDP on the historical data, and analyzing the set of predefined result-parameters, wherein the model configuration showing closest proximity with the predefined result-parameter values are selected for the respective phases.
24 The system (104) as claimed in claim 14, wherein the predefined result parameters include model accuracy, model f1-score, precision, recall, and cluster quality score.
25 The system (104) as claimed in claim 14, wherein the quality analysis engine (110) comprises a quality prediction unit (122) in communication with the processor (112), said quality prediction unit (122) configured to optimize the events associated with quality assurance by: parsing the real-time data using one or more parsing techniques; identifying the phases of SDP associated with the real-time data; and analyzing the parsed real-time data using the selected model configuration associated with the identified phases of SDP to identify data artifacts associated with the identified phases of SDP to optimize quality assurance.
26 The system (104) as claimed in claim 14, wherein events associated with quality assurance include performing risk based testing, pruning and optimizing defect backlogs, predicting number of defects, predicting success percentage of test cases, identifying frequently failing test cases, identifying gaps in testing process, test optimization, triage effort optimization, defect turnaround time improvement, and identifying frequent defects.

Specification

Show full textCollapse

We claim: 1. A method for optimizing software quality assurance during various phases of software development process(SDP), wherein the method is implemented by at least one processor (112) executing program instructions stored in a memory(114), the method comprising: generating, by the processor(112), one or more machine learning models corresponding to respective phases of the SDP from a historical data, wherein the historical data includes various types of data-artifacts associated with the respective phases of SDP; configuring, by the processor (112), each of the generated ML models associated with the respective phases of SDP with a set of variable parameters corresponding to the respective phases of SDP to generate a plurality of configured models for the respective phases of SDP; selecting, by the processor (112), a model configuration from the plurality of configured models for the respective phases of SDP for analyzing real-time data associated with the respective phases of SDP based on a predefined result-parameters; and optimizing, by the processor(112), events associated with quality assurance by analyzing real-time data associated with the respective phases of SDP using the selected model configuration corresponding to the respective phases. 2. The method as claimed in claim 1, wherein prediction-results obtained by analyzing real-time data via the selected model configuration corresponding to the respective phases of SDP are monitored based on a predefined performance metrics associated with the selected model configuration, and another model configuration is

selected if the performance metrics of the selected model configuration is unsatisfactory or dips below a predefined threshold of the performance metrics. 3. The method as claimed in claim 1, wherein the historical data is associated with at least one of: application under development (AUT), other related applications having common software modules, and unrelated applications having common software modules, further wherein the historical data may include structured, semi-structured and unstructured data type. 4. The method as claimed in claim 1, wherein generating the machine learning models corresponding to the respective phases of the SDP comprises: parsing the historical data using one or more parsing techniques, wherein the one or more parsing techniques may be selected based on a data type in the historical data; analyzing the parsed historical data to identify a general pattern of defects associated with the respective phases of SDP and abstracting complex technical details by analyzing the parsed historical data; and generating one or more machine learning (ML) models corresponding to the respective phases of SDP based on the analyzed historical data using one or more machine learning techniques. 5. The method as claimed in claim 4, wherein the one or more parsing techniques may be selected from at least one of a regular expression based technique and a Grok pattern based parsing technique. 6. The method as claimed in claim 4, wherein the one or more machine learning techniques may be selected from at least one of: text processing, classification, regression, and clustering.

7. The method as claimed in claim 1, wherein the phases of software development process(SDP) include requirement gathering and analysis, system design, coding, testing, and deployment. 8. The method as claimed in claim 1, wherein each of the generated one or more machine learning models are configured with the set of variable parameters corresponding to the respective phases of SDP. 9. The method as claimed in claim 1, wherein the variable set of parameters include duration of collection of historical data, filters on the priority of data, text processing based parameters including: RegEx pattern, Stopwords, ngram configuration and vectorization parameters, and hyper parameters of algorithms including random forest, Naïve Bayes and K-Means clustering. 10. The method as claimed in claim 1, wherein selecting the model configuration for the respective phases of SDP comprises iteratively executing each of the plurality of configured models corresponding to each phase of SDP on the historical data, and analyzing the set of predefined result-parameters, wherein the model configuration showing closest proximity with the predefined result-parameter values are selected for the respective phases. 11. The method as claimed in claim 1, wherein the predefined result parameters include model accuracy, model f1-score, precision, recall, and cluster quality score. 12. The method as claimed in claim 1, wherein optimizing the events associated with quality assurance comprises: parsing the real-time data using one or more parsing techniques; identifying the phases of SDP associated with the real-time data; and

analyzing the parsed real-time data using the selected model configuration associated with the identified phases of SDP to identify data artifacts associated with the identified phases of SDP to optimize quality assurance. 13. The method as claimed in claim 1, wherein events associated with quality assurance include performing risk based testing, pruning and optimizing defect backlogs, predicting number of defects, predicting success percentage of test cases, identifying frequently failing test cases, identifying gaps in testing process, test optimization, triage effort optimization, defect turnaround time improvement, and identifying frequent defects. 14. A system (104) for optimizing software quality assurance during various phases of software development process(SDP), the system (104) comprising: a memory (114) storing program instructions; a processor (112) configured to execute program instructions stored in the memory (114); and a quality analysis engine (110) executed by the processor (112) to: generate machine learning (ML) models corresponding to respective phases of the SDP from a historical data, wherein the historical data includes various types of data-artifacts associated with the respective phases of SDP; configure each of the generated ML models associated with the respective phases of SDP with a set of variable parameters corresponding to the respective phases of SDP to generate a plurality of configured models for the respective phases of SDP; select a model configuration from the plurality of configured models for the respective phases of SDP for analyzing real-time data associated with the respective phases of SDP based on a predefined result-parameters; and

optimize events associated with quality assurance by analyzing real-time data associated with the respective phases of SDP using the selected model configuration corresponding to the respective phases. 15. The system (104) as claimed in claim 14, wherein prediction-results obtained by analyzing real-time data via the selected model configuration corresponding to the respective phases of SDP are monitored based on a predefined performance metrics associated with the selected model configuration, and another model configuration is selected if the performance metrics of the selected model configuration is unsatisfactory or dips below a predefined threshold of the performance metrics. 16. The system (104) as claimed in claim 14, wherein the historical data is associated with at least one of: application under development (AUT), other related applications having common software modules, and unrelated applications having common software modules, further wherein the historical data may include structured, semi-structured and unstructured data type. 17. The system (104) as claimed in claim 14, wherein the quality analysis engine (110) comprises a data analysis unit (116) in communication with the processor (112), said data analysis unit (116) configured to generate the machine learning models corresponding to the respective phases of the SDP by: parsing the historical data using one or more parsing techniques, wherein the one or more parsing techniques may be selected based on a data type in the historical data; analyzing the parsed historical data to identify a general pattern of defects associated with the respective phases of SDP and abstracting complex technical details by analyzing the parsed historical data; and

generating one or more machine learning (ML) models corresponding to the respective phases of SDP based on the analyzed historical data using one or more machine learning techniques. 18. The system (104) as claimed in claim 17, wherein the one or more parsing techniques may be selected from at least one of a regular expression based technique and a Grok pattern based parsing technique. 19. The system (104) as claimed in claim 17, wherein the one or more machine learning techniques may be selected from at least one of: text processing, classification, regression, and clustering. 20. The system (104) as claimed in claim 14, wherein the phases of software development process(SDP) include requirement gathering and analysis, system design, coding, testing, and deployment. 21. The system (104) as claimed in claim 14, wherein the quality analysis engine (110) comprises a configuration and selection unit (120) in communication with the processor (112), said configuration and selection unit(120) configured to configure each of the generated one or more machine learning models with the set of variable parameters corresponding to the respective phases of SDP. 22. The system (104) as claimed in claim 14, wherein the variable set of parameters include duration of collection of historical data, filters on the priority of data, text processing based parameters including: RegEx pattern, Stopwords, ngram configuration and vectorization parameters, and hyper parameters of algorithms including random forest, Naïve Bayes and K-Means clustering. 23. The system (104) as claimed in claim 14, wherein the quality analysis engine (110) comprises a configuration and selection unit (120) in communication with the processor (112), said configuration and selection unit (120)

configured to select the model configuration for the respective phases of SDP by iteratively executing each of the plurality of configured models corresponding to each phase of SDP on the historical data, and analyzing the set of predefined result-parameters, wherein the model configuration showing closest proximity with the predefined result-parameter values are selected for the respective phases. 24. The system (104) as claimed in claim 14, wherein the predefined result parameters include model accuracy, model f1-score, precision, recall, and cluster quality score. 25. The system (104) as claimed in claim 14, wherein the quality analysis engine (110) comprises a quality prediction unit (122) in communication with the processor (112), said quality prediction unit (122) configured to optimize the events associated with quality assurance by: parsing the real-time data using one or more parsing techniques; identifying the phases of SDP associated with the real-time data; and analyzing the parsed real-time data using the selected model configuration associated with the identified phases of SDP to identify data artifacts associated with the identified phases of SDP to optimize quality assurance. 26. The system (104) as claimed in claim 14, wherein events associated with quality assurance include performing risk based testing, pruning and optimizing defect backlogs, predicting number of defects, predicting success percentage of test cases, identifying frequently failing test cases, identifying gaps in testing process, test optimization, triage effort optimization, defect turnaround time improvement, and identifying frequent defects.

Documents

Sign in to open
Application documents
1 201941050955-STATEMENT OF UNDERTAKING (FORM 3) [10-12-2019(online)].pdf 10 Dec 2019
2 201941050955-PROOF OF RIGHT [10-12-2019(online)].pdf 10 Dec 2019
3 201941050955-POWER OF AUTHORITY [10-12-2019(online)].pdf 10 Dec 2019
4 201941050955-FORM 1 [10-12-2019(online)].pdf 10 Dec 2019
5 201941050955-DRAWINGS [10-12-2019(online)].pdf 10 Dec 2019
6 201941050955-COMPLETE SPECIFICATION [10-12-2019(online)].pdf 10 Dec 2019
7 Abstract 201941050955.jpg 12 Dec 2019
8 201941050955-FORM 18 [12-12-2019(online)].pdf 12 Dec 2019
9 Correspondence by Agent_Form1-Power of Attorney_18-12-2019.pdf 18 Dec 2019
10 201941050955-Request Letter-Correspondence [23-12-2019(online)].pdf 23 Dec 2019
11 201941050955-Form 1 (Submitted on date of filing) [23-12-2019(online)].pdf 23 Dec 2019
12 201941050955-FORM 3 [19-05-2020(online)].pdf 19 May 2020
13 201941050955-FER.pdf 17 Oct 2021
14 201941050955-PETITION UNDER RULE 137 [29-03-2022(online)].pdf 29 Mar 2022
15 201941050955-FORM 3 [29-03-2022(online)].pdf 29 Mar 2022
16 201941050955-FER_SER_REPLY [29-03-2022(online)].pdf 29 Mar 2022
17 201941050955-CLAIMS [29-03-2022(online)].pdf 29 Mar 2022
18 201941050955-PatentCertificate15-04-2024.pdf 15 Apr 2024
19 201941050955-IntimationOfGrant15-04-2024.pdf 15 Apr 2024
Search strategy
1SearchStrategyE_05-07-2021.pdf

ERegister / renewals

Inforce
3rd Renewed 25 Apr 2024 Period 10 Dec 2021 – 10 Dec 2022 · CBR 27931 · Certificate 83603 ₹4,000
4th Renewed 25 Apr 2024 Period 10 Dec 2022 – 10 Dec 2023 · CBR 27931 · Certificate 83604 ₹4,000
5th Renewed 25 Apr 2024 Period 10 Dec 2023 – 10 Dec 2024 · CBR 27931 · Certificate 83605 ₹4,000
6th Renewed 25 Apr 2024 Period 10 Dec 2024 – 10 Dec 2025 · CBR 27931 · Certificate 83606 ₹4,000
7th Renewed 25 Apr 2024 Period 10 Dec 2025 – 10 Dec 2026 · CBR 27931 · Certificate 83607 ₹10,800
8th Renewed 25 Apr 2024 Period 10 Dec 2026 – 10 Dec 2027 · CBR 27931 · Certificate 83608 ₹10,800
9th Renewed 25 Apr 2024 Period 10 Dec 2027 – 10 Dec 2028 · CBR 27931 · Certificate 83609 ₹10,800
10th Renewed 25 Apr 2024 Period 10 Dec 2028 – 10 Dec 2029 · CBR 27931 · Certificate 83610 ₹10,800
11th Renewed 25 Apr 2024 Period 10 Dec 2029 – 10 Dec 2030 · CBR 27931 · Certificate 83611 ₹21,600
12th Renewed 25 Apr 2024 Period 10 Dec 2030 – 10 Dec 2031 · CBR 27931 · Certificate 83612 ₹21,600
13th Renewed 25 Apr 2024 Period 10 Dec 2031 – 10 Dec 2032 · CBR 27931 · Certificate 83613 ₹21,600
14th Renewed 25 Apr 2024 Period 10 Dec 2032 – 10 Dec 2033 · CBR 27931 · Certificate 83614 ₹21,600
15th Renewed 25 Apr 2024 Period 10 Dec 2033 – 10 Dec 2034 · CBR 27931 · Certificate 83615 ₹21,600