Abstract: The present disclosure relates to a method and system for assessing quality of incremental heterogeneous data by a data quality assessing system. The data quality assessing system determines an incremental heterogeneous data from at least one data source, obtains details associated with the incremental heterogeneous data from the at least one data source, identifies type of the incremental heterogeneous data based on the details and pattern templates, selects one or more data quality tests from a plurality of data quality tests for the incremental heterogeneous data based on the identified type of the incremental heterogeneous data and determines a score for the incremental heterogeneous data based on the one or more data quality tests and user defined parameters to assess quality of heterogeneous incremental data. Fig.1
Claims:WE CLAIM:
1. A method for assessing quality of incremental heterogeneous data, the method comprising:
determining, by a data quality assessing system (101), an incremental heterogeneous data from at least one data source;
obtaining, by the data quality assessing system (101), details associated with the incremental heterogeneous data from the at least one data source;
identifying, by the data quality assessing system (101), type of the incremental heterogeneous data based on the details and pattern templates;
selecting, by the data quality assessing system (101), one or more data quality tests from a plurality of data quality tests for the incremental heterogeneous data based on the identified type of the incremental heterogeneous data; and
determining, by the data quality assessing system (101), a score for the incremental heterogeneous data based on the one or more data quality tests and user defined parameters to assess quality of heterogeneous incremental data.
2. The method as claimed in claim 1, wherein the incremental heterogeneous data comprises diverse data types.
3. The method as claimed in claim 1, wherein the incremental heterogeneous data is obtained from a diverse data source.
4. The method as claimed in claim 1, wherein determining the incremental heterogeneous data comprises:
comparing, by the data quality assessing system (101), data present in the least at one data source with corresponding data transferred and stored at target system (105); and
determining, by the data quality assessing system (101), the incremental heterogeneous data by identifying dissimilarity between data present in the at least at one data source with corresponding data transferred and stored at the target system (105) based on the comparison.
5. The method as claimed in claim 1, wherein the pattern templates are generated automatically by analyzing user defined patterns.
6. The method as claimed in claim 1, wherein the plurality of data quality tests comprises accessibility of source check, consistency check, timeliness check, validity check, accuracy check and non-duplicity check.
7. The method as claimed in claim 1, wherein the user defined parameters comprises priorities for data quality ranking, time criteria required for assessing the incremental data and frequency of pinging the at least one data sources.
8. The method as claimed in claim 1 further comprising generating a scoreboard representing the quality of the incremental data based on the score.
9. A data quality assessing system (101) for assessing quality of incremental heterogeneous data comprising:
a processor (117); and
a memory (115) communicatively coupled to the processor (117), wherein the memory (115) stores processor instructions, which, on execution, causes the processor (117) to:
determine an incremental heterogeneous data from at least one data source;
obtain details associated with the incremental heterogeneous data from the at least one data source;
identify type of the incremental heterogeneous data based on the details and pattern templates;
select one or more data quality tests from a plurality of data quality tests for the incremental heterogeneous data based on the identified type of the incremental heterogeneous data; and
determine by the data quality assessing system, a score for the incremental heterogeneous data based on the one or more data quality tests and user defined parameters to assess quality of heterogeneous incremental data.
10. The data quality assessing system (101) as claimed in claim 9, wherein the incremental heterogeneous data comprises diverse data types.
11. The data quality assessing system (101) as claimed in claim 9, wherein the incremental heterogeneous data is obtained from a diverse data source.
12. The data quality assessing system (101) as claimed in claim 9, wherein the processor determines the incremental heterogeneous data by:
comparing data present in the least at one data source with corresponding data transferred and stored at target system (105); and
determining the incremental heterogeneous data by identifying dissimilarity between data present in the at least at one data source with corresponding data transferred and stored at the target system (105) based on the comparison.
13. The data quality assessing system (101) as claimed in claim 9, wherein the processor generates the pattern templates automatically by analyzing user defined patterns.
14. The data quality assessing system (101) as claimed in claim 9, wherein the plurality of data quality tests comprises accessibility of source check, consistency check, timeliness check, validity check, accuracy check and non-duplicity check.
15. The data quality assessing system (101) as claimed in claim 9, wherein the user defined parameters comprises priorities for data quality ranking, time criteria required for assessing the incremental data and frequency of pinging the at least one data sources.
16. The data quality assessing system (101) as claimed in claim 9, wherein the processor generates a scoreboard representing the quality of the incremental data based on the score.
Dated this 10th day of February 2017
R Ramya Rao
Of K&S Partners
Agent for the Applicant
, Description:TECHNICAL FIELD
The present subject matter is related in general to the assessing data quality, more particularly, but not exclusively, to a method and system for assessing quality of incremental heterogeneous data.
| Section | Controller | Decision Date |
|---|---|---|
| # | Name | Date |
|---|---|---|
| 1 | 201741004903-IntimationOfGrant29-02-2024.pdf | 2024-02-29 |
| 1 | Power of Attorney [10-02-2017(online)].pdf | 2017-02-10 |
| 2 | 201741004903-PatentCertificate29-02-2024.pdf | 2024-02-29 |
| 2 | Form 5 [10-02-2017(online)].pdf | 2017-02-10 |
| 3 | Form 3 [10-02-2017(online)].pdf | 2017-02-10 |
| 3 | 201741004903-FORM 3 [21-02-2024(online)].pdf | 2024-02-21 |
| 4 | Form 18 [10-02-2017(online)].pdf_212.pdf | 2017-02-10 |
| 4 | 201741004903-FORM-26 [21-02-2024(online)].pdf | 2024-02-21 |
| 5 | Form 18 [10-02-2017(online)].pdf | 2017-02-10 |
| 5 | 201741004903-Information under section 8(2) [21-02-2024(online)].pdf | 2024-02-21 |
| 6 | Drawing [10-02-2017(online)].pdf | 2017-02-10 |
| 6 | 201741004903-Written submissions and relevant documents [21-02-2024(online)].pdf | 2024-02-21 |
| 7 | Description(Complete) [10-02-2017(online)].pdf_211.pdf | 2017-02-10 |
| 7 | 201741004903-FORM-26 [06-02-2024(online)].pdf | 2024-02-06 |
| 8 | Description(Complete) [10-02-2017(online)].pdf | 2017-02-10 |
| 8 | 201741004903-AMENDED DOCUMENTS [18-01-2024(online)].pdf | 2024-01-18 |
| 9 | 201741004903-Correspondence to notify the Controller [18-01-2024(online)].pdf | 2024-01-18 |
| 9 | REQUEST FOR CERTIFIED COPY [13-02-2017(online)].pdf | 2017-02-13 |
| 10 | 201741004903-FORM 13 [18-01-2024(online)].pdf | 2024-01-18 |
| 10 | 201741004903-Proof of Right (MANDATORY) [26-04-2018(online)].pdf | 2018-04-26 |
| 11 | 201741004903-POA [18-01-2024(online)].pdf | 2024-01-18 |
| 11 | Correspondence by Agent_Form-1_01-05-2018.pdf | 2018-05-01 |
| 12 | 201741004903-FER.pdf | 2020-07-17 |
| 12 | 201741004903-US(14)-HearingNotice-(HearingDate-06-02-2024).pdf | 2024-01-12 |
| 13 | 201741004903-CLAIMS [04-01-2021(online)].pdf | 2021-01-04 |
| 13 | 201741004903-RELEVANT DOCUMENTS [04-01-2021(online)].pdf | 2021-01-04 |
| 14 | 201741004903-COMPLETE SPECIFICATION [04-01-2021(online)].pdf | 2021-01-04 |
| 14 | 201741004903-RELEVANT DOCUMENTS [04-01-2021(online)]-1.pdf | 2021-01-04 |
| 15 | 201741004903-CORRESPONDENCE [04-01-2021(online)].pdf | 2021-01-04 |
| 15 | 201741004903-PETITION UNDER RULE 137 [04-01-2021(online)].pdf | 2021-01-04 |
| 16 | 201741004903-DRAWING [04-01-2021(online)].pdf | 2021-01-04 |
| 16 | 201741004903-PETITION UNDER RULE 137 [04-01-2021(online)]-1.pdf | 2021-01-04 |
| 17 | 201741004903-OTHERS [04-01-2021(online)].pdf | 2021-01-04 |
| 17 | 201741004903-FER_SER_REPLY [04-01-2021(online)].pdf | 2021-01-04 |
| 18 | 201741004903-FORM 3 [04-01-2021(online)].pdf | 2021-01-04 |
| 18 | 201741004903-Information under section 8(2) [04-01-2021(online)].pdf | 2021-01-04 |
| 19 | 201741004903-FORM 3 [04-01-2021(online)].pdf | 2021-01-04 |
| 19 | 201741004903-Information under section 8(2) [04-01-2021(online)].pdf | 2021-01-04 |
| 20 | 201741004903-FER_SER_REPLY [04-01-2021(online)].pdf | 2021-01-04 |
| 20 | 201741004903-OTHERS [04-01-2021(online)].pdf | 2021-01-04 |
| 21 | 201741004903-DRAWING [04-01-2021(online)].pdf | 2021-01-04 |
| 21 | 201741004903-PETITION UNDER RULE 137 [04-01-2021(online)]-1.pdf | 2021-01-04 |
| 22 | 201741004903-CORRESPONDENCE [04-01-2021(online)].pdf | 2021-01-04 |
| 22 | 201741004903-PETITION UNDER RULE 137 [04-01-2021(online)].pdf | 2021-01-04 |
| 23 | 201741004903-RELEVANT DOCUMENTS [04-01-2021(online)]-1.pdf | 2021-01-04 |
| 23 | 201741004903-COMPLETE SPECIFICATION [04-01-2021(online)].pdf | 2021-01-04 |
| 24 | 201741004903-CLAIMS [04-01-2021(online)].pdf | 2021-01-04 |
| 24 | 201741004903-RELEVANT DOCUMENTS [04-01-2021(online)].pdf | 2021-01-04 |
| 25 | 201741004903-FER.pdf | 2020-07-17 |
| 25 | 201741004903-US(14)-HearingNotice-(HearingDate-06-02-2024).pdf | 2024-01-12 |
| 26 | 201741004903-POA [18-01-2024(online)].pdf | 2024-01-18 |
| 26 | Correspondence by Agent_Form-1_01-05-2018.pdf | 2018-05-01 |
| 27 | 201741004903-FORM 13 [18-01-2024(online)].pdf | 2024-01-18 |
| 27 | 201741004903-Proof of Right (MANDATORY) [26-04-2018(online)].pdf | 2018-04-26 |
| 28 | 201741004903-Correspondence to notify the Controller [18-01-2024(online)].pdf | 2024-01-18 |
| 28 | REQUEST FOR CERTIFIED COPY [13-02-2017(online)].pdf | 2017-02-13 |
| 29 | 201741004903-AMENDED DOCUMENTS [18-01-2024(online)].pdf | 2024-01-18 |
| 29 | Description(Complete) [10-02-2017(online)].pdf | 2017-02-10 |
| 30 | Description(Complete) [10-02-2017(online)].pdf_211.pdf | 2017-02-10 |
| 30 | 201741004903-FORM-26 [06-02-2024(online)].pdf | 2024-02-06 |
| 31 | Drawing [10-02-2017(online)].pdf | 2017-02-10 |
| 31 | 201741004903-Written submissions and relevant documents [21-02-2024(online)].pdf | 2024-02-21 |
| 32 | Form 18 [10-02-2017(online)].pdf | 2017-02-10 |
| 32 | 201741004903-Information under section 8(2) [21-02-2024(online)].pdf | 2024-02-21 |
| 33 | Form 18 [10-02-2017(online)].pdf_212.pdf | 2017-02-10 |
| 33 | 201741004903-FORM-26 [21-02-2024(online)].pdf | 2024-02-21 |
| 34 | Form 3 [10-02-2017(online)].pdf | 2017-02-10 |
| 34 | 201741004903-FORM 3 [21-02-2024(online)].pdf | 2024-02-21 |
| 35 | Form 5 [10-02-2017(online)].pdf | 2017-02-10 |
| 35 | 201741004903-PatentCertificate29-02-2024.pdf | 2024-02-29 |
| 36 | 201741004903-IntimationOfGrant29-02-2024.pdf | 2024-02-29 |
| 36 | Power of Attorney [10-02-2017(online)].pdf | 2017-02-10 |
| 1 | Searchamended_201741004903AE_09-01-2023.pdf |
| 1 | searchE_17-07-2020.pdf |
| 2 | Searchamended_201741004903AE_09-01-2023.pdf |
| 2 | searchE_17-07-2020.pdf |