Abstract: A method an system for extracting factoid associated words from natural language sentences is disclosed. The method includes creating an input vector that includes a plurality of parameters for each target word in a sentence. For a target word, the plurality of parameters includes a Part of Speech (POS) vector, a word embedding, a word embedding for a head word of the target word, a dependency label, and a semantic role label. The method includes processing for each target word, the input vector through a trained neural network and assigning one or more factoid tags to each target word in the sentence. The method includes extracting text associated with factoids from the sentence based on the one or more factoid tags. The method further includes providing a response to the sentence inputted by the user based on the text associated with the factoids.
Claims:
We Claim:
1. A method for extracting factoid associated words from natural language sentences, the method comprising:
creating, by a factoid processing device, an input vector comprising a plurality of parameters for each target word in a sentence inputted by a user, wherein the plurality of parameters for each target word comprise a Part of Speech (POS) vector associated with the target word and at least two words preceding the target word, a word embedding for the target word, a word embedding for a head word of the target word in a dependency parse tree of the sentence, a dependency label for the target word, and a semantic role label of the target word;
processing for each target word, by the factoid processing device, the input vector through a trained neural network comprising a bidirectional Long Short Term Memory (LSTM) layer, an LSTM layer, a dense layer, and a Softmax layer, wherein the trained neural network is trained to identify words associated with each of a plurality of factoids from a plurality of sentences;
assigning, by the factoid processing device, one or more factoid tags to each target word in the sentence based on processing of associated input vector through the trained neural network;
extracting, by the factoid processing device, text associated with one or more factoids of the plurality of factoids from the sentence based on the one or more factoid tags associated with each target word in the sentence, wherein the sentence comprises text associated with the one or more factoids; and
providing, by the factoid processing device, a response to the sentence inputted by the user based on the text associated with the one or more factoids, wherein the response comprises at least one of an answer to a user query and an action corresponding to the user query.
2. The method of claim 1, wherein the plurality of factoids comprises at least one of who, what, when, what, why, or how.
3. The method of claim 1 further comprising determining the plurality of parameters for each target word in the sentence inputted by the user.
4. The method of claim 1, wherein the dependency label for the target word indicates relation of the target word with the head word in the sentence.
5. The method of claim 1 further comprising training the neural network to identify one or more factoid tags for words within sentences.
6. The method of claim 5, wherein training the neural network comprises:
annotating one or more factoid tags to each word in a plurality natural language sentences retrieved from a data repository of natural language sentences comprising a plurality of factoid scenarios; and
inputting, iteratively, the annotated one or more factoid tags associated with each word along with the associated word in a plurality of natural language sentences to the neural network for training.
7. The method of claim 1, wherein the one or more factoid tags comprise a begin who tag, an inside who tag, a begin what tag, an inside what tag, a begin where tag, an inside where tag, a begin when tag, an inside when tag, a begin how tag, an inside how tag, a begin why tag, an inside why tag, or others tag.
8. The method of claim 7, wherein a begin tag marks a first word of text associated with a factoid and an inside tag marks subsequent words of the text associated with the factoid.
9. A factoid processing device for extracting factoid associated words from natural language sentences, the factoid processing device comprising:
a processor; and
a memory communicatively coupled to the processor, wherein the memory stores processor instructions, which, on execution, causes the processor to:
create an input vector comprising a plurality of parameters for each target word in a sentence inputted by a user, wherein the plurality of parameters for each target word comprise a Part of Speech (POS) vector associated with the target word and at least two words preceding the target word, a word embedding for the target word, a word embedding for a head word of the target word in a dependency parse tree of the sentence, a dependency label for the target word, and a semantic role label of the target word;
process for each target word, the input vector through a trained neural network comprising a bidirectional Long Short Term Memory (LSTM) layer, an LSTM layer, a dense layer, and a Softmax layer, wherein the trained neural network is trained to identify words associated with each of a plurality of factoids from a plurality of sentences;
assign one or more factoid tags to each target word in the sentence based on processing of associated input vector through the trained neural network;
extract text associated with one or more factoids of the plurality of factoids from the sentence based on the one or more factoid tags associated with each target word in the sentence, wherein the sentence comprises text associated with the one or more factoids; and
provide a response to the sentence inputted by the user based on the text associated with the one or more factoids, wherein the response comprises at least one of an answer to a user query and an action corresponding to the user query.
| Section | Controller | Decision Date |
|---|---|---|
| # | Name | Date |
|---|---|---|
| 1 | 201941012259-IntimationOfGrant30-10-2023.pdf | 2023-10-30 |
| 1 | 201941012259-Response to office action (Mandatory) [04-02-2019(online)].pdf | 2019-02-04 |
| 2 | 201941012259-PatentCertificate30-10-2023.pdf | 2023-10-30 |
| 2 | 201941012259-STATEMENT OF UNDERTAKING (FORM 3) [28-03-2019(online)].pdf | 2019-03-28 |
| 3 | 201941012259-REQUEST FOR EXAMINATION (FORM-18) [28-03-2019(online)].pdf | 2019-03-28 |
| 3 | 201941012259-FORM 3 [30-09-2023(online)].pdf | 2023-09-30 |
| 4 | 201941012259-POWER OF AUTHORITY [28-03-2019(online)].pdf | 2019-03-28 |
| 4 | 201941012259-FORM-26 [30-09-2023(online)].pdf | 2023-09-30 |
| 5 | 201941012259-Written submissions and relevant documents [30-09-2023(online)].pdf | 2023-09-30 |
| 5 | 201941012259-FORM 18 [28-03-2019(online)].pdf | 2019-03-28 |
| 6 | 201941012259-FORM 1 [28-03-2019(online)].pdf | 2019-03-28 |
| 6 | 201941012259-AMENDED DOCUMENTS [05-09-2023(online)].pdf | 2023-09-05 |
| 7 | 201941012259-DRAWINGS [28-03-2019(online)].pdf | 2019-03-28 |
| 7 | 201941012259-Correspondence to notify the Controller [05-09-2023(online)].pdf | 2023-09-05 |
| 8 | 201941012259-FORM 13 [05-09-2023(online)].pdf | 2023-09-05 |
| 8 | 201941012259-DECLARATION OF INVENTORSHIP (FORM 5) [28-03-2019(online)].pdf | 2019-03-28 |
| 9 | 201941012259-COMPLETE SPECIFICATION [28-03-2019(online)].pdf | 2019-03-28 |
| 9 | 201941012259-POA [05-09-2023(online)].pdf | 2023-09-05 |
| 10 | 201941012259-Request Letter-Correspondence [29-03-2019(online)].pdf | 2019-03-29 |
| 10 | 201941012259-US(14)-HearingNotice-(HearingDate-15-09-2023).pdf | 2023-08-31 |
| 11 | 201941012259-FER.pdf | 2021-10-17 |
| 11 | 201941012259-Power of Attorney [29-03-2019(online)].pdf | 2019-03-29 |
| 12 | 201941012259-ABSTRACT [26-08-2021(online)].pdf | 2021-08-26 |
| 12 | 201941012259-Form 1 (Submitted on date of filing) [29-03-2019(online)].pdf | 2019-03-29 |
| 13 | 201941012259-CLAIMS [26-08-2021(online)].pdf | 2021-08-26 |
| 13 | 201941012259-Proof of Right (MANDATORY) [29-08-2019(online)].pdf | 2019-08-29 |
| 14 | 201941012259-COMPLETE SPECIFICATION [26-08-2021(online)].pdf | 2021-08-26 |
| 14 | Correspondence by Agent_Form1_04-09-2019.pdf | 2019-09-04 |
| 15 | 201941012259-DRAWING [26-08-2021(online)].pdf | 2021-08-26 |
| 15 | 201941012259-PETITION UNDER RULE 137 [26-08-2021(online)].pdf | 2021-08-26 |
| 16 | 201941012259-FER_SER_REPLY [26-08-2021(online)].pdf | 2021-08-26 |
| 16 | 201941012259-OTHERS [26-08-2021(online)].pdf | 2021-08-26 |
| 17 | 201941012259-Information under section 8(2) [26-08-2021(online)].pdf | 2021-08-26 |
| 17 | 201941012259-FORM 3 [26-08-2021(online)].pdf | 2021-08-26 |
| 18 | 201941012259-FORM 3 [26-08-2021(online)].pdf | 2021-08-26 |
| 18 | 201941012259-Information under section 8(2) [26-08-2021(online)].pdf | 2021-08-26 |
| 19 | 201941012259-FER_SER_REPLY [26-08-2021(online)].pdf | 2021-08-26 |
| 19 | 201941012259-OTHERS [26-08-2021(online)].pdf | 2021-08-26 |
| 20 | 201941012259-DRAWING [26-08-2021(online)].pdf | 2021-08-26 |
| 20 | 201941012259-PETITION UNDER RULE 137 [26-08-2021(online)].pdf | 2021-08-26 |
| 21 | 201941012259-COMPLETE SPECIFICATION [26-08-2021(online)].pdf | 2021-08-26 |
| 21 | Correspondence by Agent_Form1_04-09-2019.pdf | 2019-09-04 |
| 22 | 201941012259-CLAIMS [26-08-2021(online)].pdf | 2021-08-26 |
| 22 | 201941012259-Proof of Right (MANDATORY) [29-08-2019(online)].pdf | 2019-08-29 |
| 23 | 201941012259-ABSTRACT [26-08-2021(online)].pdf | 2021-08-26 |
| 23 | 201941012259-Form 1 (Submitted on date of filing) [29-03-2019(online)].pdf | 2019-03-29 |
| 24 | 201941012259-Power of Attorney [29-03-2019(online)].pdf | 2019-03-29 |
| 24 | 201941012259-FER.pdf | 2021-10-17 |
| 25 | 201941012259-Request Letter-Correspondence [29-03-2019(online)].pdf | 2019-03-29 |
| 25 | 201941012259-US(14)-HearingNotice-(HearingDate-15-09-2023).pdf | 2023-08-31 |
| 26 | 201941012259-COMPLETE SPECIFICATION [28-03-2019(online)].pdf | 2019-03-28 |
| 26 | 201941012259-POA [05-09-2023(online)].pdf | 2023-09-05 |
| 27 | 201941012259-DECLARATION OF INVENTORSHIP (FORM 5) [28-03-2019(online)].pdf | 2019-03-28 |
| 27 | 201941012259-FORM 13 [05-09-2023(online)].pdf | 2023-09-05 |
| 28 | 201941012259-Correspondence to notify the Controller [05-09-2023(online)].pdf | 2023-09-05 |
| 28 | 201941012259-DRAWINGS [28-03-2019(online)].pdf | 2019-03-28 |
| 29 | 201941012259-AMENDED DOCUMENTS [05-09-2023(online)].pdf | 2023-09-05 |
| 29 | 201941012259-FORM 1 [28-03-2019(online)].pdf | 2019-03-28 |
| 30 | 201941012259-FORM 18 [28-03-2019(online)].pdf | 2019-03-28 |
| 30 | 201941012259-Written submissions and relevant documents [30-09-2023(online)].pdf | 2023-09-30 |
| 31 | 201941012259-POWER OF AUTHORITY [28-03-2019(online)].pdf | 2019-03-28 |
| 31 | 201941012259-FORM-26 [30-09-2023(online)].pdf | 2023-09-30 |
| 32 | 201941012259-REQUEST FOR EXAMINATION (FORM-18) [28-03-2019(online)].pdf | 2019-03-28 |
| 32 | 201941012259-FORM 3 [30-09-2023(online)].pdf | 2023-09-30 |
| 33 | 201941012259-STATEMENT OF UNDERTAKING (FORM 3) [28-03-2019(online)].pdf | 2019-03-28 |
| 33 | 201941012259-PatentCertificate30-10-2023.pdf | 2023-10-30 |
| 34 | 201941012259-Response to office action (Mandatory) [04-02-2019(online)].pdf | 2019-02-04 |
| 34 | 201941012259-IntimationOfGrant30-10-2023.pdf | 2023-10-30 |
| 1 | search201941012259E_03-03-2021.pdf |