Abstract: A system and method for real-time operational predictive scoring of components and services of an information technology system (ITS) for forecasting and assessing performance of the components of the ITS are provided. A data pipeline is configured to collect and store, in real-time, multiple time series signals corresponding to health, performance, and functionality of each of the components of the ITS. An operational predictive score (OPS) engine of a scoring module calculates an OPS for each of the time series signals. An OPS roll-up module of the scoring module calculates an OPS for each of the components and services in the ITS by aggregating the OPS for the individual time series signals. An alerting engine to notify operational issues and provide root cause analysis using OPS score decomposition. A visualization layer for OPS based analytics.
5. CLAIMS
We claim:
1. A computer implemented system for real-time operational predictive scoring of components and services of an information technology system for forecasting and assessing performance of said components of said information technology system, comprising:
a data pipeline configured to collect, in real-time, a plurality of time series signals comprising multiple metrics corresponding to one or more of health, performance, and functionality of each of said components of said information technology system;
a data store configured to receive a data stream comprising said collected plurality of time series signals, and store said received data stream as individual time series data;
a scoring module, comprising:
an operational predictive score engine configured to calculate an operational predictive score for each of said time series signals of said components of said information technology system corresponding to said individual time series data of each of said plurality of time series signals; and
an operational predictive score roll-up module configured to aggregate said calculated operational predictive score of each of said time series signals of said components of said information technology system into an operational predictive score for each of said components of said information technology system.
2. The system of claim 1, wherein said operational predictive score engine comprises a forecasting engine and a statistical scoring engine.
3. The system of claim 2, wherein said forecasting engine is configured to generate a probabilistic forecast for each of said time series signals of said components of said information technology system, using a plurality of customized machine learning models.
4. The system of claim 3, wherein said statistical scoring engine is configured to calculate said operational predictive score for each of said time series signals of said components of said information technology system, using a statistical model on said probabilistic forecast from said forecasting engine for each of said time series signals of said components of said information technology system.
5. The system of claim 4, further comprising a statistical modeling engine configured to calculate a probability of said plurality of time series signals moving into an erroneous state in near future time, using a statistical model on said probabilistic forecast from said forecasting engine for each of said time series signals of said components of said information technology system, wherein said probability calculated by said statistical modeling engine is used to derive said operational predictive score for each of said time series signals of said components of said information technology system.
6. The system of claim 3, further comprising a training module configured to train said customized machine learning models comprising autoregressive Recurrent Neural Network based forecasting models.
7. The system of claim 6, wherein said training module is further configured to train a common machine learned model for a set of related time series signals.
8. The system of claim 1, wherein said data store is further configured to receive said operational predictive score of each of said time series signals of said components of said information technology system from said operational predictive score engine, and said operational predictive score for each of said components of said information technology system from said operational predictive score roll-up module.
9. The system of claim 1, further comprising an alerting engine configured to monitor a value of said operational predictive score for each of said time series signals and said components of said information technology system, and alert a user when said value falls below a set threshold.
10. The system of claim 1, further comprising a graphical user interface configured to provide a visualization of said operational predictive scores of each of said time series signals and said components to said user, for facilitating one or more of real-time monitoring, historical trend analysis, and system improvement.
11. The system of claim 1, further comprising an operational predictive score quality monitor module configured to monitor a quality and an effectiveness of said operational predictive score of each of said time series signals and said components.
12. The system of claim 6, further comprising automatic triggering of said training module for retraining said customized machines learning models when a quality and an effectiveness of said operational predictive score of any of said time series signals and said components falls below a pre-defined value.
13. The system of claim 1, further comprising calculating an operational predictive score for said services implemented using said components of said information technology system.
14. The system of claim 13, further comprising calculating an operational predictive score for said components in said services implemented using said components of said information technology system.
15. The system of claim 14, further comprising a root cause analysis module configured to decompose said operational predictive score for any of said components of said information technology system into a responsibility matrix when said operational predictive score for any of said components of said information technology system deteriorates during a user transaction journey within said services implemented using said components of said information technology system, to locate one or more of said components that are contributing to said deterioration.
16. A computer implemented method for real-time operational predictive scoring of components and services of an information technology system for forecasting and assessing performance of said components of said information technology system, comprising:
providing a computer implemented system comprising a data pipeline, a data store, a scoring module comprising an operational predictive score engine and an operational predictive score roll-up module, a statistical modeling engine, a training module, an alerting engine, a graphical user interface, an operational predictive score quality monitor module, and a root cause analysis module;
collecting, in real-time, by said data pipeline, a plurality of time series signals comprising multiple metrics corresponding to one or more of
health, performance, and functionality of each of said components of said information technology system;
receiving, by said data store, a data stream comprising said collected plurality of time series signals, and storing said received data stream as individual time series data;
calculating, by said operational predictive score engine of said scoring module, an operational predictive score for each of said time series signals of said components of said information technology system; and
aggregating, by said operational predictive score roll-up module of said scoring module, said calculated operational predictive score of each of said time series signals of said components of said information technology system into an operational predictive score for each of said components of said information technology system.
17. The method of claim 16, wherein said operational predictive score engine comprises a forecasting engine and a statistical scoring engine.
18. The method of claim 17, further comprising generating by said forecasting engine a probabilistic forecast for each of said time series signals of said components of said information technology system, using a plurality of customized machine learning models.
19. The method of claim 18, further comprising calculating by said statistical scoring engine said operational predictive score for each of said time series signals of said components of said information technology system, using a statistical model on said probabilistic forecast from said forecasting engine for each of said time series signals of said components of said information technology system.
20. The method of claim 19, further comprising calculating, by said statistical modeling engine, a probability of said plurality of time series signals moving into an erroneous state in near future time, using a statistical model on said probabilistic forecast from said forecasting engine for each of said time series signals of said components of said information technology system, wherein said probability calculated by said statistical modeling engine is used to derive said operational predictive score for each of said time series signals of said components of said information technology system.
21. The method of claim 18, further comprising training, by said training module, said customized machine learning models comprising autoregressive Recurrent Neural Network based forecasting models.
22. The method of claim 21, further comprising training, by said training module, a common machine learned model for a set of related times series signals.
23. The method of claim 16, further comprising receiving, by said data store, said operational predictive score of each of said time series signals of said components of said information technology system from said operational predictive score engine, and said operational predictive score for each of said components of said information technology system from said operational predictive score roll-up module.
24. The method of claim 16, further comprising monitoring, by said alerting engine, a value of said operational predictive score of each of said time series signals and said components, and alert a user when said value falls below a set threshold.
25. The method of claim 16, further comprising providing, on said graphical user interface, a visualization of said operational predictive score of each of said time series signals and said components to said user, for facilitating one or more of real-time monitoring, historical trend analysis, and system improvement.
26. The method of claim 16, further comprising monitoring, by said operational predictive score quality monitor module, a quality and an effectiveness of said operational predictive score of each of said time series signals and said components.
27. The method of claim 22, further comprising automatic triggering of said training module for retraining of said customized machine learning models when a quality and an effectiveness of said operational predictive score of any of said time series signals and said components falls below a pre-defined value.
28. The method of claim 16, further comprising calculating an operational predictive score for said services implemented using said components of said information technology system.
29. The method of claim 28, further comprising calculating said operational predictive score for said components in said services implemented using said components of said information technology system.
30. The method of claim 29, further comprising decomposing, by said root cause analysis module, said operational predictive score for each of said components of said information technology system into a responsibility matrix when said operational predictive score for any of said components of said information technology system deteriorates during a user transaction journey within said services implemented using said components of said information technology
system, to locate one or more of said components that are contributing to said deterioration.
| # | Name | Date |
|---|---|---|
| 1 | 202041043080-STATEMENT OF UNDERTAKING (FORM 3) [04-10-2020(online)].pdf | 2020-10-04 |
| 2 | 202041043080-POWER OF AUTHORITY [04-10-2020(online)].pdf | 2020-10-04 |
| 3 | 202041043080-OTHERS [04-10-2020(online)].pdf | 2020-10-04 |
| 4 | 202041043080-FORM FOR STARTUP [04-10-2020(online)].pdf | 2020-10-04 |
| 5 | 202041043080-FORM FOR SMALL ENTITY(FORM-28) [04-10-2020(online)].pdf | 2020-10-04 |
| 6 | 202041043080-FORM 1 [04-10-2020(online)].pdf | 2020-10-04 |
| 7 | 202041043080-EVIDENCE FOR REGISTRATION UNDER SSI(FORM-28) [04-10-2020(online)].pdf | 2020-10-04 |
| 8 | 202041043080-EVIDENCE FOR REGISTRATION UNDER SSI [04-10-2020(online)].pdf | 2020-10-04 |
| 9 | 202041043080-DRAWINGS [04-10-2020(online)].pdf | 2020-10-04 |
| 10 | 202041043080-DECLARATION OF INVENTORSHIP (FORM 5) [04-10-2020(online)].pdf | 2020-10-04 |
| 11 | 202041043080-COMPLETE SPECIFICATION [04-10-2020(online)].pdf | 2020-10-04 |
| 12 | 202041043080-REQUEST FOR CERTIFIED COPY [05-10-2020(online)].pdf | 2020-10-05 |
| 13 | 202041043080-FORM28 [05-10-2020(online)].pdf | 2020-10-05 |
| 14 | 202041043080-FORM 18 [05-10-2020(online)].pdf | 2020-10-05 |
| 15 | 202041043080-MARKED COPY [14-10-2020(online)].pdf | 2020-10-14 |
| 16 | 202041043080-CORRECTED PAGES [14-10-2020(online)].pdf | 2020-10-14 |
| 17 | 202041043080-Correspondence, Form1, POA_20-10-2020.pdf | 2020-10-20 |
| 18 | 202041043080-Annexure [20-01-2021(online)].pdf | 2021-01-20 |
| 19 | 202041043080-Retyped Pages under Rule 14(1) [21-01-2021(online)].pdf | 2021-01-21 |
| 20 | 202041043080-2. Marked Copy under Rule 14(2) [21-01-2021(online)].pdf | 2021-01-21 |
| 21 | 202041043080-Correspondence And Form-1_29-01-2021.pdf | 2021-01-29 |
| 22 | 202041043080-FER.pdf | 2022-04-25 |
| 23 | 202041043080-PETITION UNDER RULE 138 [21-10-2022(online)].pdf | 2022-10-21 |
| 24 | 202041043080-PETITION UNDER RULE 137 [21-10-2022(online)].pdf | 2022-10-21 |
| 25 | 202041043080-MARKED COPIES OF AMENDEMENTS [21-10-2022(online)].pdf | 2022-10-21 |
| 26 | 202041043080-FORM 3 [21-10-2022(online)].pdf | 2022-10-21 |
| 27 | 202041043080-FORM 13 [21-10-2022(online)].pdf | 2022-10-21 |
| 28 | 202041043080-FER_SER_REPLY [21-10-2022(online)].pdf | 2022-10-21 |
| 29 | 202041043080-DRAWING [21-10-2022(online)].pdf | 2022-10-21 |
| 30 | 202041043080-CLAIMS [21-10-2022(online)].pdf | 2022-10-21 |
| 31 | 202041043080-AMMENDED DOCUMENTS [21-10-2022(online)].pdf | 2022-10-21 |
| 32 | 202041043080-RELEVANT DOCUMENTS [25-10-2024(online)].pdf | 2024-10-25 |
| 33 | 202041043080-POA [25-10-2024(online)].pdf | 2024-10-25 |
| 34 | 202041043080-MARKED COPIES OF AMENDEMENTS [25-10-2024(online)].pdf | 2024-10-25 |
| 35 | 202041043080-FORM 13 [25-10-2024(online)].pdf | 2024-10-25 |
| 36 | 202041043080-FORM 13 [25-10-2024(online)]-1.pdf | 2024-10-25 |
| 37 | 202041043080-AMMENDED DOCUMENTS [25-10-2024(online)].pdf | 2024-10-25 |
| 38 | 202041043080-Response to office action [30-12-2024(online)].pdf | 2024-12-30 |
| 39 | 202041043080-Annexure [30-12-2024(online)].pdf | 2024-12-30 |
| 40 | 202041043080-US(14)-HearingNotice-(HearingDate-17-03-2025).pdf | 2025-02-14 |
| 41 | 202041043080-Correspondence to notify the Controller [10-03-2025(online)].pdf | 2025-03-10 |
| 42 | 202041043080-Written submissions and relevant documents [28-03-2025(online)].pdf | 2025-03-28 |
| 43 | 202041043080-RELEVANT DOCUMENTS [28-03-2025(online)].pdf | 2025-03-28 |
| 44 | 202041043080-PETITION UNDER RULE 137 [28-03-2025(online)].pdf | 2025-03-28 |
| 45 | 202041043080-MARKED COPIES OF AMENDEMENTS [28-03-2025(online)].pdf | 2025-03-28 |
| 46 | 202041043080-FORM 13 [28-03-2025(online)].pdf | 2025-03-28 |
| 47 | 202041043080-Annexure [28-03-2025(online)].pdf | 2025-03-28 |
| 48 | 202041043080-AMMENDED DOCUMENTS [28-03-2025(online)].pdf | 2025-03-28 |
| 49 | 202041043080-PatentCertificate30-04-2025.pdf | 2025-04-30 |
| 50 | 202041043080-IntimationOfGrant30-04-2025.pdf | 2025-04-30 |
| 51 | 202041043080-FORM FOR SMALL ENTITY [05-08-2025(online)].pdf | 2025-08-05 |
| 52 | 202041043080-EVIDENCE FOR REGISTRATION UNDER SSI [05-08-2025(online)].pdf | 2025-08-05 |
| 1 | 202041043080E_22-04-2022.pdf |