Abstract: A method and system are described for generating structured relations between words in sentences. The method includes generating encoded hidden state vectors using a single layer bi-directional Long Short Term Memory (LSTM) neural network. The method includes generating current hidden state vectors based on word embedding associated with each word at a time stamp ‘t’. The method includes computing attention distribution of each word based on encoded hidden state vectors and current hidden state vectors. The method includes computing context vector of sentences based on attention distribution of each word and the encoded hidden state vectors. The method includes computing vocabulary distribution at time stamp “t” based on context vector and current hidden state vectors. The method includes computing probability distribution of words based on encoded hidden state vectors, current hidden state vectors, and vocabulary distribution. The method includes generating plurality of structured relations between words based on probability distribution. FIG. 4
Claims:We Claim:
1. A method for generating a plurality of structured relations between a plurality of words in a plurality of sentences, the method comprising:
receiving, by a processor, a plurality of sentences comprising a plurality of words, wherein the plurality of sentences comprises numerical data and textual data;
generating, by the processor, a plurality of encoded hidden state vectors associated with the plurality of sentences using a single layer bi-directional Long Short Term Memory (LSTM) neural network;
generating, by the processor, a plurality of current hidden state vectors based on word embedding associated with each word in the plurality of sentences at a time stamp ‘t’;
computing, by the processor, an attention distribution of each word in the plurality of sentences based on the plurality of encoded hidden state vectors and plurality of current hidden state vectors, wherein the attention distribution is indicative of importance of each word in the plurality of sentences;
computing, by the processor, a context vector of the plurality of sentences based on the attention distribution of each word in the plurality of sentences and the plurality of encoded hidden state vectors;
computing, by the processor, a vocabulary distribution at the time stamp “t” based on the context vector and the plurality of current hidden state vectors;
computing, by the processor, a probability distribution of each of the plurality of words in the plurality of sentences based on the plurality of encoded hidden state vectors, the plurality of current hidden state vectors, and the vocabulary distribution;
generating, by the processor, an output comprising a plurality of structured relations between the plurality of words based on the probability distribution; and
rendering, by the processor, a knowledge graph depicting the plurality of structured relations between the plurality of words.
2. The method of claim 1, further comprising computing a coverage vector based on the probability distribution and the attention distribution, wherein the coverage vector avoids duplicate generation of relations within the generated plurality of structured relations.
3. The method of claim 1, further comprising selecting one of: generation of structured relations and sampling of the plurality of words from the plurality of sentences based on the probability distribution.
4. The method of claim 1, wherein the probability distribution includes a pointer mechanism to control when to generate a new relation or to copy the received words to the output, wherein the probability distribution is further indicative of a location of a word in the plurality of sentences, and wherein based on the pointer mechanism words in the plurality of sentences are directly copied from the received plurality of sentences to the output, and wherein the output is independent of an output length.
5. The method of claim 1, wherein the plurality of current hidden state vectors is used to generate a plurality of output words that is indicative of mapping of the plurality of words in the plurality of sentence.
6. The method of claim 1, wherein the context vector is a weighted sum between the attention distribution and the plurality of encoded hidden state vectors.
7. The method of claim 1, wherein the context vector is further concatenated with the plurality of current hidden state vectors at the time stamp “t”.
8. The method of claim 1, wherein the plurality of words in the plurality of sentences correspond to plurality of annotated entities.
9. An application server to generate a plurality of structured relations between a plurality of words in a plurality of sentences, the application server comprising:
a processor; and
a memory communicatively coupled to the processor, wherein the memory stores processor instructions, which, on execution, causes the processor to:
receive a plurality of sentences comprising a plurality of words, wherein the plurality of sentences comprises numerical data and textual data;
generate a plurality of encoded hidden state vectors associated with the plurality of sentences using a single layer bi-directional Long Short Term Memory (LSTM) neural network;
generate a plurality of current hidden state vectors based on word embedding associated with each word in the plurality of sentences at a time stamp ‘t’;
compute an attention distribution of each word in the plurality of sentences based on the plurality of encoded hidden state vectors and plurality of current hidden state vectors, wherein the attention distribution is indicative of importance of each word in the plurality of sentences;
compute a context vector of the plurality of sentences based on the attention distribution of each word in the plurality of sentences and the plurality of encoded hidden state vectors;
compute a vocabulary distribution at the time stamp “t” based on the context vector and the plurality of current hidden state vectors;
compute a probability distribution of each of the plurality of words in the plurality of sentences based on the plurality of encoded hidden state vectors, the plurality of current hidden state vectors, and the vocabulary distribution;
generate an output comprising a plurality of structured relations between the plurality of words based on the probability distribution; and
render a knowledge graph depicting the plurality of structured relations between the plurality of words.
10. The application server of claim 9, wherein the processor is further configured to:
compute a coverage vector based on the probability distribution and the attention distribution, wherein the coverage vector avoids duplicate generation of relations within the generated plurality of structured relations, and
select one of: generation of structured relations and sampling of the plurality of words from the plurality of sentences based on the probability distribution.
Dated this 8th day of March, 2019
Madhusudan S T
Of K&S Partners
Agent for the Applicant
IN/PA-1297 , Description:Technical Field
The present subject matter is related, in general to natural language processing, and more particularly, but not exclusively to a method and system for generating a plurality of structured relations between a plurality of words in a plurality of sentences.
| # | Name | Date |
|---|---|---|
| 1 | 201941009036-AMENDED DOCUMENTS [22-10-2024(online)].pdf | 2024-10-22 |
| 1 | 201941009036-FORM 13 [19-11-2024(online)].pdf | 2024-11-19 |
| 1 | 201941009036-STATEMENT OF UNDERTAKING (FORM 3) [08-03-2019(online)].pdf | 2019-03-08 |
| 2 | 201941009036-Correspondence to notify the Controller [22-10-2024(online)].pdf | 2024-10-22 |
| 2 | 201941009036-FORM-26 [19-11-2024(online)].pdf | 2024-11-19 |
| 2 | 201941009036-REQUEST FOR EXAMINATION (FORM-18) [08-03-2019(online)].pdf | 2019-03-08 |
| 3 | 201941009036-FORM 13 [22-10-2024(online)].pdf | 2024-10-22 |
| 3 | 201941009036-POWER OF AUTHORITY [08-03-2019(online)].pdf | 2019-03-08 |
| 3 | 201941009036-Written submissions and relevant documents [19-11-2024(online)].pdf | 2024-11-19 |
| 4 | 201941009036-POA [22-10-2024(online)].pdf | 2024-10-22 |
| 4 | 201941009036-FORM 18 [08-03-2019(online)].pdf | 2019-03-08 |
| 4 | 201941009036-AMENDED DOCUMENTS [22-10-2024(online)].pdf | 2024-10-22 |
| 5 | 201941009036-US(14)-HearingNotice-(HearingDate-04-11-2024).pdf | 2024-10-18 |
| 5 | 201941009036-FORM 1 [08-03-2019(online)].pdf | 2019-03-08 |
| 5 | 201941009036-Correspondence to notify the Controller [22-10-2024(online)].pdf | 2024-10-22 |
| 6 | 201941009036-FORM 13 [22-10-2024(online)].pdf | 2024-10-22 |
| 6 | 201941009036-DRAWINGS [08-03-2019(online)].pdf | 2019-03-08 |
| 6 | 201941009036-CLAIMS [18-10-2021(online)].pdf | 2021-10-18 |
| 7 | 201941009036-POA [22-10-2024(online)].pdf | 2024-10-22 |
| 7 | 201941009036-DECLARATION OF INVENTORSHIP (FORM 5) [08-03-2019(online)].pdf | 2019-03-08 |
| 7 | 201941009036-COMPLETE SPECIFICATION [18-10-2021(online)].pdf | 2021-10-18 |
| 8 | 201941009036-COMPLETE SPECIFICATION [08-03-2019(online)].pdf | 2019-03-08 |
| 8 | 201941009036-CORRESPONDENCE [18-10-2021(online)].pdf | 2021-10-18 |
| 8 | 201941009036-US(14)-HearingNotice-(HearingDate-04-11-2024).pdf | 2024-10-18 |
| 9 | 201941009036-CLAIMS [18-10-2021(online)].pdf | 2021-10-18 |
| 9 | 201941009036-DRAWING [18-10-2021(online)].pdf | 2021-10-18 |
| 9 | 201941009036-Request Letter-Correspondence [10-03-2019(online)].pdf | 2019-03-10 |
| 10 | 201941009036-COMPLETE SPECIFICATION [18-10-2021(online)].pdf | 2021-10-18 |
| 10 | 201941009036-FER_SER_REPLY [18-10-2021(online)].pdf | 2021-10-18 |
| 10 | 201941009036-Power of Attorney [10-03-2019(online)].pdf | 2019-03-10 |
| 11 | 201941009036-CORRESPONDENCE [18-10-2021(online)].pdf | 2021-10-18 |
| 11 | 201941009036-Form 1 (Submitted on date of filing) [10-03-2019(online)].pdf | 2019-03-10 |
| 11 | 201941009036-FORM 3 [18-10-2021(online)].pdf | 2021-10-18 |
| 12 | 201941009036-DRAWING [18-10-2021(online)].pdf | 2021-10-18 |
| 12 | 201941009036-Information under section 8(2) [18-10-2021(online)].pdf | 2021-10-18 |
| 12 | abstract 201941009036.jpg | 2019-03-13 |
| 13 | 201941009036-Proof of Right (MANDATORY) [07-09-2019(online)].pdf | 2019-09-07 |
| 13 | 201941009036-OTHERS [18-10-2021(online)].pdf | 2021-10-18 |
| 13 | 201941009036-FER_SER_REPLY [18-10-2021(online)].pdf | 2021-10-18 |
| 14 | 201941009036-FORM 3 [18-10-2021(online)].pdf | 2021-10-18 |
| 14 | 201941009036-PETITION UNDER RULE 137 [18-10-2021(online)].pdf | 2021-10-18 |
| 14 | Correspondence by Agent_Form1_16-09-2019.pdf | 2019-09-16 |
| 15 | 201941009036-FER.pdf | 2021-10-17 |
| 15 | 201941009036-Information under section 8(2) [18-10-2021(online)].pdf | 2021-10-18 |
| 15 | 201941009036-RELEVANT DOCUMENTS [18-10-2021(online)].pdf | 2021-10-18 |
| 16 | 201941009036-FER.pdf | 2021-10-17 |
| 16 | 201941009036-OTHERS [18-10-2021(online)].pdf | 2021-10-18 |
| 16 | 201941009036-RELEVANT DOCUMENTS [18-10-2021(online)].pdf | 2021-10-18 |
| 17 | 201941009036-PETITION UNDER RULE 137 [18-10-2021(online)].pdf | 2021-10-18 |
| 17 | Correspondence by Agent_Form1_16-09-2019.pdf | 2019-09-16 |
| 18 | 201941009036-Proof of Right (MANDATORY) [07-09-2019(online)].pdf | 2019-09-07 |
| 18 | 201941009036-RELEVANT DOCUMENTS [18-10-2021(online)].pdf | 2021-10-18 |
| 18 | 201941009036-OTHERS [18-10-2021(online)].pdf | 2021-10-18 |
| 19 | 201941009036-FER.pdf | 2021-10-17 |
| 19 | 201941009036-Information under section 8(2) [18-10-2021(online)].pdf | 2021-10-18 |
| 19 | abstract 201941009036.jpg | 2019-03-13 |
| 20 | 201941009036-Form 1 (Submitted on date of filing) [10-03-2019(online)].pdf | 2019-03-10 |
| 20 | 201941009036-FORM 3 [18-10-2021(online)].pdf | 2021-10-18 |
| 20 | Correspondence by Agent_Form1_16-09-2019.pdf | 2019-09-16 |
| 21 | 201941009036-Proof of Right (MANDATORY) [07-09-2019(online)].pdf | 2019-09-07 |
| 21 | 201941009036-Power of Attorney [10-03-2019(online)].pdf | 2019-03-10 |
| 21 | 201941009036-FER_SER_REPLY [18-10-2021(online)].pdf | 2021-10-18 |
| 22 | 201941009036-DRAWING [18-10-2021(online)].pdf | 2021-10-18 |
| 22 | 201941009036-Request Letter-Correspondence [10-03-2019(online)].pdf | 2019-03-10 |
| 22 | abstract 201941009036.jpg | 2019-03-13 |
| 23 | 201941009036-COMPLETE SPECIFICATION [08-03-2019(online)].pdf | 2019-03-08 |
| 23 | 201941009036-CORRESPONDENCE [18-10-2021(online)].pdf | 2021-10-18 |
| 23 | 201941009036-Form 1 (Submitted on date of filing) [10-03-2019(online)].pdf | 2019-03-10 |
| 24 | 201941009036-Power of Attorney [10-03-2019(online)].pdf | 2019-03-10 |
| 24 | 201941009036-DECLARATION OF INVENTORSHIP (FORM 5) [08-03-2019(online)].pdf | 2019-03-08 |
| 24 | 201941009036-COMPLETE SPECIFICATION [18-10-2021(online)].pdf | 2021-10-18 |
| 25 | 201941009036-CLAIMS [18-10-2021(online)].pdf | 2021-10-18 |
| 25 | 201941009036-DRAWINGS [08-03-2019(online)].pdf | 2019-03-08 |
| 25 | 201941009036-Request Letter-Correspondence [10-03-2019(online)].pdf | 2019-03-10 |
| 26 | 201941009036-COMPLETE SPECIFICATION [08-03-2019(online)].pdf | 2019-03-08 |
| 26 | 201941009036-FORM 1 [08-03-2019(online)].pdf | 2019-03-08 |
| 26 | 201941009036-US(14)-HearingNotice-(HearingDate-04-11-2024).pdf | 2024-10-18 |
| 27 | 201941009036-DECLARATION OF INVENTORSHIP (FORM 5) [08-03-2019(online)].pdf | 2019-03-08 |
| 27 | 201941009036-FORM 18 [08-03-2019(online)].pdf | 2019-03-08 |
| 27 | 201941009036-POA [22-10-2024(online)].pdf | 2024-10-22 |
| 28 | 201941009036-DRAWINGS [08-03-2019(online)].pdf | 2019-03-08 |
| 28 | 201941009036-FORM 13 [22-10-2024(online)].pdf | 2024-10-22 |
| 28 | 201941009036-POWER OF AUTHORITY [08-03-2019(online)].pdf | 2019-03-08 |
| 29 | 201941009036-Correspondence to notify the Controller [22-10-2024(online)].pdf | 2024-10-22 |
| 29 | 201941009036-FORM 1 [08-03-2019(online)].pdf | 2019-03-08 |
| 29 | 201941009036-REQUEST FOR EXAMINATION (FORM-18) [08-03-2019(online)].pdf | 2019-03-08 |
| 30 | 201941009036-AMENDED DOCUMENTS [22-10-2024(online)].pdf | 2024-10-22 |
| 30 | 201941009036-FORM 18 [08-03-2019(online)].pdf | 2019-03-08 |
| 30 | 201941009036-STATEMENT OF UNDERTAKING (FORM 3) [08-03-2019(online)].pdf | 2019-03-08 |
| 31 | 201941009036-Written submissions and relevant documents [19-11-2024(online)].pdf | 2024-11-19 |
| 31 | 201941009036-POWER OF AUTHORITY [08-03-2019(online)].pdf | 2019-03-08 |
| 32 | 201941009036-REQUEST FOR EXAMINATION (FORM-18) [08-03-2019(online)].pdf | 2019-03-08 |
| 32 | 201941009036-FORM-26 [19-11-2024(online)].pdf | 2024-11-19 |
| 33 | 201941009036-STATEMENT OF UNDERTAKING (FORM 3) [08-03-2019(online)].pdf | 2019-03-08 |
| 33 | 201941009036-FORM 13 [19-11-2024(online)].pdf | 2024-11-19 |
| 1 | 2021-04-0917-17-55E_09-04-2021.pdf |
| 1 | searchAE_28-12-2021.pdf |
| 2 | 2021-04-0917-17-55E_09-04-2021.pdf |
| 2 | searchAE_28-12-2021.pdf |