Abstract: A method and system of language independent iterative learning mechanism for Natural Language Processing (NLP) tasks is disclosed. The method includes identifying at least one NLP feature associated with a set of words within a sentence for an NLP task. The method includes creating a pattern associated with the sentence for the NLP task, based on the at least one NLP feature associated with the set of words and the linkage relationship between each subset of two adjacent words. The method further includes computing a confidence score corresponding to the pattern, based on a comparison within a trained dataset. The method further includes assigning a pattern category to the pattern, based on the confidence score and a predefined threshold score. The method further includes executing the NLP task based on the assigned pattern category. Fig. 2
Claims:WE CLAIM:
1. A method of language independent iterative learning mechanism for Natural Language Processing (NLP) tasks, the method comprising:
identifying, by an NLP device, at least one NLP feature associated with a set of words within a sentence for an NLP task;
identifying, by the NLP device, a linkage relationship between each subset of two adjacent words within the set of words;
creating a pattern associated with the sentence for the NLP task, based on the at least one NLP feature associated with the set of words and the linkage relationship between each subset of two adjacent words;
computing a confidence score corresponding to the pattern, based on a comparison within a trained dataset;
assigning a pattern category to the pattern, based on the confidence score and a predefined threshold score, wherein the pattern category corresponds to the NLP task; and
executing the NLP task based on the assigned pattern category.
2. The method of claim 1, wherein the pattern comprises a sequence of the set of words, wherein each subset of two adjacent words in the sequence are interlinked based on an associated linkage relationship.
3. The method of claim 1, wherein the trained dataset is created for the NLP task and comprises at least one of:
a plurality of unique patterns, wherein each of the plurality of unique patterns corresponds to the at least one NLP feature derived for the NLP task; and
a plurality of unique tuples derived from the plurality of unique patterns.
4. The method of claim 1, wherein the confidence score is derived based on a weighted average of a first confidence score and a second confidence score,
wherein,
the first confidence score is a pattern confidence score determined for the pattern, and wherein the pattern confidence score is derived based on a percentage match of the pattern with one of the plurality of unique patterns, wherein the pattern confidence score is independent of the language associated with the sentence; and
wherein,
the second confidence score is a tuple confidence score determined for each of the set of words in the sentence, and wherein the tuple confidence score is derived based on semantic similarity with at least one of the plurality of unique tuples within the trained dataset, wherein the tuple confidence score is dependent of the language associated with the sentence.
5. The method of claim 1, wherein the pattern category is assigned to the pattern when the confidence score is greater than or equal to the predefined threshold score.
6. The method of claim 1 further comprising identifying the pattern as a new pattern, when the confidence score is below the predefined threshold score.
7. A system for language independent iterative learning mechanism for Natural Language Processing (NLP) tasks, the system comprising:
a processor; and
a memory communicatively coupled to the processor, wherein the memory stores processor instructions, which, on execution, causes the processor to:
identify at least one NLP feature associated with a set of words within a sentence for an NLP task;
identify a linkage relationship between each subset of two adjacent words within the set of words;
create a pattern associated with the sentence for the NLP task, based on the at least one NLP feature associated with the set of words and the linkage relationship between each subset of two adjacent words;
compute a confidence score corresponding to the pattern, based on a comparison within a trained dataset;
assign a pattern category to the pattern, based on the confidence score and a predefined threshold score, wherein the pattern category corresponds to the NLP task; and
execute the NLP task based on the assigned pattern category.
8. The system of claim 7, wherein the pattern comprises a sequence of the set of words, wherein each subset of two adjacent words in the sequence are interlinked based on an associated linkage relationship.
9. The system of claim 7, wherein the trained dataset is created for the NLP task and comprises at least one of:
a plurality of unique patterns, wherein each of the plurality of unique patterns corresponds to the at least one NLP feature derived for the NLP task; and
a plurality of unique tuples derived from the plurality of unique patterns.
10. The system of claim 7, wherein the confidence score is derived based on a weighted average of a first confidence score and a second confidence score,
wherein,
the first confidence score is a pattern confidence score determined for the pattern, and wherein the pattern confidence score is derived based on a percentage match of the pattern with one of the plurality of unique patterns, wherein the pattern confidence score is independent of the language associated with the sentence; and
wherein,
the second confidence score is a tuple confidence score determined for each of the set of words in the sentence, and wherein the tuple confidence score is derived based on semantic similarity with at least one of the plurality of unique tuples within the trained dataset, wherein the tuple confidence score is dependent of the language associated with the sentence.
Dated this 15th day of February, 2019
Madhusudan S.T
Of K&S Partner
Agent for the Applicant
IN/PA-1297 , Description:TECHNICAL FIELD
This disclosure relates generally to Natural Language Processing (NLP) tasks, and more particularly to system and method for language independent iterative learning mechanism for NLP tasks.
| # | Name | Date |
|---|---|---|
| 1 | 201941006161-PROOF OF ALTERATION [01-05-2024(online)].pdf | 2024-05-01 |
| 1 | 201941006161-STATEMENT OF UNDERTAKING (FORM 3) [15-02-2019(online)].pdf | 2019-02-15 |
| 2 | 201941006161-IntimationOfGrant04-01-2024.pdf | 2024-01-04 |
| 2 | 201941006161-REQUEST FOR EXAMINATION (FORM-18) [15-02-2019(online)].pdf | 2019-02-15 |
| 3 | 201941006161-POWER OF AUTHORITY [15-02-2019(online)].pdf | 2019-02-15 |
| 3 | 201941006161-PatentCertificate04-01-2024.pdf | 2024-01-04 |
| 4 | 201941006161-FORM 18 [15-02-2019(online)].pdf | 2019-02-15 |
| 4 | 201941006161-FER.pdf | 2021-10-17 |
| 5 | 201941006161-FORM 1 [15-02-2019(online)].pdf | 2019-02-15 |
| 5 | 201941006161-CLAIMS [21-06-2021(online)].pdf | 2021-06-21 |
| 6 | 201941006161-DRAWINGS [15-02-2019(online)].pdf | 2019-02-15 |
| 6 | 201941006161-CORRESPONDENCE [21-06-2021(online)].pdf | 2021-06-21 |
| 7 | 201941006161-DRAWING [21-06-2021(online)].pdf | 2021-06-21 |
| 7 | 201941006161-DECLARATION OF INVENTORSHIP (FORM 5) [15-02-2019(online)].pdf | 2019-02-15 |
| 8 | 201941006161-FER_SER_REPLY [21-06-2021(online)].pdf | 2021-06-21 |
| 8 | 201941006161-COMPLETE SPECIFICATION [15-02-2019(online)].pdf | 2019-02-15 |
| 9 | 201941006161-FORM 3 [21-06-2021(online)].pdf | 2021-06-21 |
| 9 | 201941006161-Request Letter-Correspondence [19-02-2019(online)].pdf | 2019-02-19 |
| 10 | 201941006161-Information under section 8(2) [21-06-2021(online)].pdf | 2021-06-21 |
| 10 | 201941006161-Power of Attorney [19-02-2019(online)].pdf | 2019-02-19 |
| 11 | 201941006161-Form 1 (Submitted on date of filing) [19-02-2019(online)].pdf | 2019-02-19 |
| 11 | 201941006161-OTHERS [21-06-2021(online)].pdf | 2021-06-21 |
| 12 | 201941006161-PETITION UNDER RULE 137 [21-06-2021(online)].pdf | 2021-06-21 |
| 12 | 201941006161-Proof of Right (MANDATORY) [14-08-2019(online)].pdf | 2019-08-14 |
| 13 | 201941006161-RELEVANT DOCUMENTS [21-06-2021(online)].pdf | 2021-06-21 |
| 13 | Correspondence by Agent _Form-1 _19-08-2019.pdf | 2019-08-19 |
| 14 | 201941006161-RELEVANT DOCUMENTS [21-06-2021(online)].pdf | 2021-06-21 |
| 14 | Correspondence by Agent _Form-1 _19-08-2019.pdf | 2019-08-19 |
| 15 | 201941006161-PETITION UNDER RULE 137 [21-06-2021(online)].pdf | 2021-06-21 |
| 15 | 201941006161-Proof of Right (MANDATORY) [14-08-2019(online)].pdf | 2019-08-14 |
| 16 | 201941006161-Form 1 (Submitted on date of filing) [19-02-2019(online)].pdf | 2019-02-19 |
| 16 | 201941006161-OTHERS [21-06-2021(online)].pdf | 2021-06-21 |
| 17 | 201941006161-Power of Attorney [19-02-2019(online)].pdf | 2019-02-19 |
| 17 | 201941006161-Information under section 8(2) [21-06-2021(online)].pdf | 2021-06-21 |
| 18 | 201941006161-FORM 3 [21-06-2021(online)].pdf | 2021-06-21 |
| 18 | 201941006161-Request Letter-Correspondence [19-02-2019(online)].pdf | 2019-02-19 |
| 19 | 201941006161-COMPLETE SPECIFICATION [15-02-2019(online)].pdf | 2019-02-15 |
| 19 | 201941006161-FER_SER_REPLY [21-06-2021(online)].pdf | 2021-06-21 |
| 20 | 201941006161-DECLARATION OF INVENTORSHIP (FORM 5) [15-02-2019(online)].pdf | 2019-02-15 |
| 20 | 201941006161-DRAWING [21-06-2021(online)].pdf | 2021-06-21 |
| 21 | 201941006161-CORRESPONDENCE [21-06-2021(online)].pdf | 2021-06-21 |
| 21 | 201941006161-DRAWINGS [15-02-2019(online)].pdf | 2019-02-15 |
| 22 | 201941006161-CLAIMS [21-06-2021(online)].pdf | 2021-06-21 |
| 22 | 201941006161-FORM 1 [15-02-2019(online)].pdf | 2019-02-15 |
| 23 | 201941006161-FER.pdf | 2021-10-17 |
| 23 | 201941006161-FORM 18 [15-02-2019(online)].pdf | 2019-02-15 |
| 24 | 201941006161-PatentCertificate04-01-2024.pdf | 2024-01-04 |
| 24 | 201941006161-POWER OF AUTHORITY [15-02-2019(online)].pdf | 2019-02-15 |
| 25 | 201941006161-REQUEST FOR EXAMINATION (FORM-18) [15-02-2019(online)].pdf | 2019-02-15 |
| 25 | 201941006161-IntimationOfGrant04-01-2024.pdf | 2024-01-04 |
| 26 | 201941006161-STATEMENT OF UNDERTAKING (FORM 3) [15-02-2019(online)].pdf | 2019-02-15 |
| 26 | 201941006161-PROOF OF ALTERATION [01-05-2024(online)].pdf | 2024-05-01 |
| 1 | 2021-01-2215-02-51E_23-01-2021.pdf |