Sign In to Follow Application
View All Documents & Correspondence

A Method And System For Generating Structured Relations Between Words

Abstract: A method and system are described for generating structured relations between words in sentences. The method includes generating encoded hidden state vectors using a single layer bi-directional Long Short Term Memory (LSTM) neural network. The method includes generating current hidden state vectors based on word embedding associated with each word at a time stamp ‘t’. The method includes computing attention distribution of each word based on encoded hidden state vectors and current hidden state vectors. The method includes computing context vector of sentences based on attention distribution of each word and the encoded hidden state vectors. The method includes computing vocabulary distribution at time stamp “t” based on context vector and current hidden state vectors. The method includes computing probability distribution of words based on encoded hidden state vectors, current hidden state vectors, and vocabulary distribution. The method includes generating plurality of structured relations between words based on probability distribution. FIG. 4

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
08 March 2019
Publication Number
37/2020
Publication Type
INA
Invention Field
COMPUTER SCIENCE
Status
Email
bangalore@knspartners.com
Parent Application

Applicants

WIPRO LIMITED
Doddakannelli, Sarjapur Road, Bangalore 560035

Inventors

1. ANKIT KUMAR SINGH
S/o Saroj Kumar Singh, Surendra Nagar, Joraphatak, Dhansar, Bank-more, Dhanbad, Jharkhand - 828106
2. AMRIT BHASKAR
S/0: Mukesh Kr. Verma, Koet Para, Dudhani, Dumka, Jharkhand, Pin - 814101
3. PARUL CHOPRA
Flat 503, Krishan Kunj Aptts, Plot 14, Sec 7, Dwarka, New Delhi - 110075
4. SIBSAMBHU KAR
Flat 003, Srinidhi Enclave, Nisarga Layout, Hoskote, Bangalore 562114

Specification

Claims:We Claim:
1. A method for generating a plurality of structured relations between a plurality of words in a plurality of sentences, the method comprising:
receiving, by a processor, a plurality of sentences comprising a plurality of words, wherein the plurality of sentences comprises numerical data and textual data;
generating, by the processor, a plurality of encoded hidden state vectors associated with the plurality of sentences using a single layer bi-directional Long Short Term Memory (LSTM) neural network;
generating, by the processor, a plurality of current hidden state vectors based on word embedding associated with each word in the plurality of sentences at a time stamp ‘t’;
computing, by the processor, an attention distribution of each word in the plurality of sentences based on the plurality of encoded hidden state vectors and plurality of current hidden state vectors, wherein the attention distribution is indicative of importance of each word in the plurality of sentences;
computing, by the processor, a context vector of the plurality of sentences based on the attention distribution of each word in the plurality of sentences and the plurality of encoded hidden state vectors;
computing, by the processor, a vocabulary distribution at the time stamp “t” based on the context vector and the plurality of current hidden state vectors;
computing, by the processor, a probability distribution of each of the plurality of words in the plurality of sentences based on the plurality of encoded hidden state vectors, the plurality of current hidden state vectors, and the vocabulary distribution;
generating, by the processor, an output comprising a plurality of structured relations between the plurality of words based on the probability distribution; and
rendering, by the processor, a knowledge graph depicting the plurality of structured relations between the plurality of words.
2. The method of claim 1, further comprising computing a coverage vector based on the probability distribution and the attention distribution, wherein the coverage vector avoids duplicate generation of relations within the generated plurality of structured relations.
3. The method of claim 1, further comprising selecting one of: generation of structured relations and sampling of the plurality of words from the plurality of sentences based on the probability distribution.
4. The method of claim 1, wherein the probability distribution includes a pointer mechanism to control when to generate a new relation or to copy the received words to the output, wherein the probability distribution is further indicative of a location of a word in the plurality of sentences, and wherein based on the pointer mechanism words in the plurality of sentences are directly copied from the received plurality of sentences to the output, and wherein the output is independent of an output length.
5. The method of claim 1, wherein the plurality of current hidden state vectors is used to generate a plurality of output words that is indicative of mapping of the plurality of words in the plurality of sentence.
6. The method of claim 1, wherein the context vector is a weighted sum between the attention distribution and the plurality of encoded hidden state vectors.
7. The method of claim 1, wherein the context vector is further concatenated with the plurality of current hidden state vectors at the time stamp “t”.
8. The method of claim 1, wherein the plurality of words in the plurality of sentences correspond to plurality of annotated entities.
9. An application server to generate a plurality of structured relations between a plurality of words in a plurality of sentences, the application server comprising:
a processor; and
a memory communicatively coupled to the processor, wherein the memory stores processor instructions, which, on execution, causes the processor to:
receive a plurality of sentences comprising a plurality of words, wherein the plurality of sentences comprises numerical data and textual data;
generate a plurality of encoded hidden state vectors associated with the plurality of sentences using a single layer bi-directional Long Short Term Memory (LSTM) neural network;
generate a plurality of current hidden state vectors based on word embedding associated with each word in the plurality of sentences at a time stamp ‘t’;
compute an attention distribution of each word in the plurality of sentences based on the plurality of encoded hidden state vectors and plurality of current hidden state vectors, wherein the attention distribution is indicative of importance of each word in the plurality of sentences;
compute a context vector of the plurality of sentences based on the attention distribution of each word in the plurality of sentences and the plurality of encoded hidden state vectors;
compute a vocabulary distribution at the time stamp “t” based on the context vector and the plurality of current hidden state vectors;
compute a probability distribution of each of the plurality of words in the plurality of sentences based on the plurality of encoded hidden state vectors, the plurality of current hidden state vectors, and the vocabulary distribution;
generate an output comprising a plurality of structured relations between the plurality of words based on the probability distribution; and
render a knowledge graph depicting the plurality of structured relations between the plurality of words.
10. The application server of claim 9, wherein the processor is further configured to:
compute a coverage vector based on the probability distribution and the attention distribution, wherein the coverage vector avoids duplicate generation of relations within the generated plurality of structured relations, and
select one of: generation of structured relations and sampling of the plurality of words from the plurality of sentences based on the probability distribution.
Dated this 8th day of March, 2019

Madhusudan S T
Of K&S Partners
Agent for the Applicant
IN/PA-1297 , Description:Technical Field
The present subject matter is related, in general to natural language processing, and more particularly, but not exclusively to a method and system for generating a plurality of structured relations between a plurality of words in a plurality of sentences.

Documents

Application Documents

# Name Date
1 201941009036-AMENDED DOCUMENTS [22-10-2024(online)].pdf 2024-10-22
1 201941009036-FORM 13 [19-11-2024(online)].pdf 2024-11-19
1 201941009036-STATEMENT OF UNDERTAKING (FORM 3) [08-03-2019(online)].pdf 2019-03-08
2 201941009036-Correspondence to notify the Controller [22-10-2024(online)].pdf 2024-10-22
2 201941009036-FORM-26 [19-11-2024(online)].pdf 2024-11-19
2 201941009036-REQUEST FOR EXAMINATION (FORM-18) [08-03-2019(online)].pdf 2019-03-08
3 201941009036-FORM 13 [22-10-2024(online)].pdf 2024-10-22
3 201941009036-POWER OF AUTHORITY [08-03-2019(online)].pdf 2019-03-08
3 201941009036-Written submissions and relevant documents [19-11-2024(online)].pdf 2024-11-19
4 201941009036-POA [22-10-2024(online)].pdf 2024-10-22
4 201941009036-FORM 18 [08-03-2019(online)].pdf 2019-03-08
4 201941009036-AMENDED DOCUMENTS [22-10-2024(online)].pdf 2024-10-22
5 201941009036-US(14)-HearingNotice-(HearingDate-04-11-2024).pdf 2024-10-18
5 201941009036-FORM 1 [08-03-2019(online)].pdf 2019-03-08
5 201941009036-Correspondence to notify the Controller [22-10-2024(online)].pdf 2024-10-22
6 201941009036-FORM 13 [22-10-2024(online)].pdf 2024-10-22
6 201941009036-DRAWINGS [08-03-2019(online)].pdf 2019-03-08
6 201941009036-CLAIMS [18-10-2021(online)].pdf 2021-10-18
7 201941009036-POA [22-10-2024(online)].pdf 2024-10-22
7 201941009036-DECLARATION OF INVENTORSHIP (FORM 5) [08-03-2019(online)].pdf 2019-03-08
7 201941009036-COMPLETE SPECIFICATION [18-10-2021(online)].pdf 2021-10-18
8 201941009036-COMPLETE SPECIFICATION [08-03-2019(online)].pdf 2019-03-08
8 201941009036-CORRESPONDENCE [18-10-2021(online)].pdf 2021-10-18
8 201941009036-US(14)-HearingNotice-(HearingDate-04-11-2024).pdf 2024-10-18
9 201941009036-CLAIMS [18-10-2021(online)].pdf 2021-10-18
9 201941009036-DRAWING [18-10-2021(online)].pdf 2021-10-18
9 201941009036-Request Letter-Correspondence [10-03-2019(online)].pdf 2019-03-10
10 201941009036-COMPLETE SPECIFICATION [18-10-2021(online)].pdf 2021-10-18
10 201941009036-FER_SER_REPLY [18-10-2021(online)].pdf 2021-10-18
10 201941009036-Power of Attorney [10-03-2019(online)].pdf 2019-03-10
11 201941009036-CORRESPONDENCE [18-10-2021(online)].pdf 2021-10-18
11 201941009036-Form 1 (Submitted on date of filing) [10-03-2019(online)].pdf 2019-03-10
11 201941009036-FORM 3 [18-10-2021(online)].pdf 2021-10-18
12 201941009036-DRAWING [18-10-2021(online)].pdf 2021-10-18
12 201941009036-Information under section 8(2) [18-10-2021(online)].pdf 2021-10-18
12 abstract 201941009036.jpg 2019-03-13
13 201941009036-Proof of Right (MANDATORY) [07-09-2019(online)].pdf 2019-09-07
13 201941009036-OTHERS [18-10-2021(online)].pdf 2021-10-18
13 201941009036-FER_SER_REPLY [18-10-2021(online)].pdf 2021-10-18
14 201941009036-FORM 3 [18-10-2021(online)].pdf 2021-10-18
14 201941009036-PETITION UNDER RULE 137 [18-10-2021(online)].pdf 2021-10-18
14 Correspondence by Agent_Form1_16-09-2019.pdf 2019-09-16
15 201941009036-FER.pdf 2021-10-17
15 201941009036-Information under section 8(2) [18-10-2021(online)].pdf 2021-10-18
15 201941009036-RELEVANT DOCUMENTS [18-10-2021(online)].pdf 2021-10-18
16 201941009036-FER.pdf 2021-10-17
16 201941009036-OTHERS [18-10-2021(online)].pdf 2021-10-18
16 201941009036-RELEVANT DOCUMENTS [18-10-2021(online)].pdf 2021-10-18
17 201941009036-PETITION UNDER RULE 137 [18-10-2021(online)].pdf 2021-10-18
17 Correspondence by Agent_Form1_16-09-2019.pdf 2019-09-16
18 201941009036-Proof of Right (MANDATORY) [07-09-2019(online)].pdf 2019-09-07
18 201941009036-RELEVANT DOCUMENTS [18-10-2021(online)].pdf 2021-10-18
18 201941009036-OTHERS [18-10-2021(online)].pdf 2021-10-18
19 201941009036-FER.pdf 2021-10-17
19 201941009036-Information under section 8(2) [18-10-2021(online)].pdf 2021-10-18
19 abstract 201941009036.jpg 2019-03-13
20 201941009036-Form 1 (Submitted on date of filing) [10-03-2019(online)].pdf 2019-03-10
20 201941009036-FORM 3 [18-10-2021(online)].pdf 2021-10-18
20 Correspondence by Agent_Form1_16-09-2019.pdf 2019-09-16
21 201941009036-Proof of Right (MANDATORY) [07-09-2019(online)].pdf 2019-09-07
21 201941009036-Power of Attorney [10-03-2019(online)].pdf 2019-03-10
21 201941009036-FER_SER_REPLY [18-10-2021(online)].pdf 2021-10-18
22 201941009036-DRAWING [18-10-2021(online)].pdf 2021-10-18
22 201941009036-Request Letter-Correspondence [10-03-2019(online)].pdf 2019-03-10
22 abstract 201941009036.jpg 2019-03-13
23 201941009036-COMPLETE SPECIFICATION [08-03-2019(online)].pdf 2019-03-08
23 201941009036-CORRESPONDENCE [18-10-2021(online)].pdf 2021-10-18
23 201941009036-Form 1 (Submitted on date of filing) [10-03-2019(online)].pdf 2019-03-10
24 201941009036-Power of Attorney [10-03-2019(online)].pdf 2019-03-10
24 201941009036-DECLARATION OF INVENTORSHIP (FORM 5) [08-03-2019(online)].pdf 2019-03-08
24 201941009036-COMPLETE SPECIFICATION [18-10-2021(online)].pdf 2021-10-18
25 201941009036-CLAIMS [18-10-2021(online)].pdf 2021-10-18
25 201941009036-DRAWINGS [08-03-2019(online)].pdf 2019-03-08
25 201941009036-Request Letter-Correspondence [10-03-2019(online)].pdf 2019-03-10
26 201941009036-COMPLETE SPECIFICATION [08-03-2019(online)].pdf 2019-03-08
26 201941009036-FORM 1 [08-03-2019(online)].pdf 2019-03-08
26 201941009036-US(14)-HearingNotice-(HearingDate-04-11-2024).pdf 2024-10-18
27 201941009036-DECLARATION OF INVENTORSHIP (FORM 5) [08-03-2019(online)].pdf 2019-03-08
27 201941009036-FORM 18 [08-03-2019(online)].pdf 2019-03-08
27 201941009036-POA [22-10-2024(online)].pdf 2024-10-22
28 201941009036-DRAWINGS [08-03-2019(online)].pdf 2019-03-08
28 201941009036-FORM 13 [22-10-2024(online)].pdf 2024-10-22
28 201941009036-POWER OF AUTHORITY [08-03-2019(online)].pdf 2019-03-08
29 201941009036-Correspondence to notify the Controller [22-10-2024(online)].pdf 2024-10-22
29 201941009036-FORM 1 [08-03-2019(online)].pdf 2019-03-08
29 201941009036-REQUEST FOR EXAMINATION (FORM-18) [08-03-2019(online)].pdf 2019-03-08
30 201941009036-AMENDED DOCUMENTS [22-10-2024(online)].pdf 2024-10-22
30 201941009036-FORM 18 [08-03-2019(online)].pdf 2019-03-08
30 201941009036-STATEMENT OF UNDERTAKING (FORM 3) [08-03-2019(online)].pdf 2019-03-08
31 201941009036-Written submissions and relevant documents [19-11-2024(online)].pdf 2024-11-19
31 201941009036-POWER OF AUTHORITY [08-03-2019(online)].pdf 2019-03-08
32 201941009036-REQUEST FOR EXAMINATION (FORM-18) [08-03-2019(online)].pdf 2019-03-08
32 201941009036-FORM-26 [19-11-2024(online)].pdf 2024-11-19
33 201941009036-STATEMENT OF UNDERTAKING (FORM 3) [08-03-2019(online)].pdf 2019-03-08
33 201941009036-FORM 13 [19-11-2024(online)].pdf 2024-11-19

Search Strategy

1 2021-04-0917-17-55E_09-04-2021.pdf
1 searchAE_28-12-2021.pdf
2 2021-04-0917-17-55E_09-04-2021.pdf
2 searchAE_28-12-2021.pdf