Abstract: A method and a system are described for multi-modal input based platform for intent based product recommendations. The method comprises receiving, by the product recommendation device, one or more multi-modal user inputs associated with a first product, wherein the one or more multi-modal user inputs are at least speech, text, bodily expressions and clickstream data. It further includes determining an intent-score for each of the one or more multi-modal user inputs using one or more trained data models. It further includes computing an emotion-score by aggregating the intent-score for each of the one or more multi-modal user inputs based on a weighted average of the intent-score for each of the one or more multi-modal user inputs and the method then includes recommending one or more second products based on the emotion-score.
1. A method for user-intent based product recommendations, the method comprising:
receiving, by a product recommendation device, one or more multi-modal user inputs
associated with a first product, wherein the one or more multi-modal user inputs are at least speech, text, bodily expressions and clickstream data;
determining, by the product recommendation device, an intent-score for each of the one or more multi-modal user inputs using one or more trained data models;
computing, by the product recommendation device, an emotion-score by aggregating the intent-score for each of the one or more multi-modal user inputs based on a weighted average of the intent-score for each of the one or more multi-modal user inputs; and
recommending, by the product recommendation device, one or more second products based on the emotion-score.
2. The method of claim 1, wherein the one or more trained data models comprises a natural language processing model, a text model, and a convolution neural network model.
3. The method of claim 2, wherein the natural language processing model, the speech to text model, and the convolution neural network model determines the intent-score for text, the intent-score for speech and the intent-score for bodily expressions respectively.
4. The method as claimed in claim 1, wherein the bodily expressions comprise at least one of hand gestures, eye movements, facial expressions, and head rotation, and age.
5. The method of claim 1, wherein the intent-score associated with the one or more multi-modal inputs is further adjusted dynamically based on the clickstream data of the user.
6. The method of claim 5, wherein the intent-scores adjusted are determined into a preconfigured range based on the clickstream data of the user.
7. A product recommendation device for recommending products to a user comprising:
a processor; and
a memory communicatively coupled to the processor, wherein the memory stores processor executable instructions, which on execution causes the processor to:
receive one or more multi-modal user inputs associated with a first product, wherein the one or more multi-modal user inputs are at least speech, text, bodily expressions and clickstream data;
determine an intent-score for each of the one or more multi-modal user inputs using one or more trained data models;
compute an emotion-score by aggregating the intent-score for each of the one or more multi-modal user inputs based on a weighted average of the intent-score for each of the one or more multi-modal user inputs;
recommending, by the product recommendation device, one or more second products based on the emotion-score.
8. The product recommendation device of claim 7, wherein the one or more trained data models comprises a natural language processing model, a speech to text model, and a convolution neural network model.
9. The product recommendation device of claim 8, wherein the natural language processing model, the speech to text model, and the convolution neural network model determines the intent-score for text, the intent-score for speech to text and the intent-score for bodily expressions respectively.
10. The product recommendation device of claim 7, wherein the bodily expressions comprise at least one of hand gestures, eye movements, facial expressions, and head rotation, and age.
11. The product recommendation device of claim 7, wherein the intent-score associated with the one or more multi-modal inputs is further adjusted dynamically based on the clickstream data of the user.
12. The product recommendation device of claim 11, wherein the intent-scores adjusted are determined into a preconfigured range based on the clickstream data of the user.
| # | Name | Date |
|---|---|---|
| 1 | 201841036901-STATEMENT OF UNDERTAKING (FORM 3) [29-09-2018(online)].pdf | 2018-09-29 |
| 2 | 201841036901-REQUEST FOR EXAMINATION (FORM-18) [29-09-2018(online)].pdf | 2018-09-29 |
| 3 | 201841036901-POWER OF AUTHORITY [29-09-2018(online)].pdf | 2018-09-29 |
| 4 | 201841036901-FORM 18 [29-09-2018(online)].pdf | 2018-09-29 |
| 5 | 201841036901-FORM 1 [29-09-2018(online)].pdf | 2018-09-29 |
| 6 | 201841036901-DRAWINGS [29-09-2018(online)].pdf | 2018-09-29 |
| 7 | 201841036901-DECLARATION OF INVENTORSHIP (FORM 5) [29-09-2018(online)].pdf | 2018-09-29 |
| 8 | 201841036901-COMPLETE SPECIFICATION [29-09-2018(online)].pdf | 2018-09-29 |
| 9 | abstract 201841036901.jpg | 2018-10-01 |
| 10 | 201841036901-Request Letter-Correspondence [09-10-2018(online)].pdf | 2018-10-09 |
| 11 | 201841036901-Power of Attorney [09-10-2018(online)].pdf | 2018-10-09 |
| 12 | 201841036901-Form 1 (Submitted on date of filing) [09-10-2018(online)].pdf | 2018-10-09 |
| 13 | 201841036901-Proof of Right (MANDATORY) [21-12-2018(online)].pdf | 2018-12-21 |
| 14 | Corresondence by Agent_Form-1_31-12-2018.pdf | 2018-12-31 |
| 15 | 201841036901-RELEVANT DOCUMENTS [28-09-2021(online)].pdf | 2021-09-28 |
| 16 | 201841036901-PETITION UNDER RULE 137 [28-09-2021(online)].pdf | 2021-09-28 |
| 17 | 201841036901-OTHERS [28-09-2021(online)].pdf | 2021-09-28 |
| 18 | 201841036901-Information under section 8(2) [28-09-2021(online)].pdf | 2021-09-28 |
| 19 | 201841036901-FORM 3 [28-09-2021(online)].pdf | 2021-09-28 |
| 20 | 201841036901-FER_SER_REPLY [28-09-2021(online)].pdf | 2021-09-28 |
| 21 | 201841036901-DRAWING [28-09-2021(online)].pdf | 2021-09-28 |
| 22 | 201841036901-CORRESPONDENCE [28-09-2021(online)].pdf | 2021-09-28 |
| 23 | 201841036901-COMPLETE SPECIFICATION [28-09-2021(online)].pdf | 2021-09-28 |
| 24 | 201841036901-CLAIMS [28-09-2021(online)].pdf | 2021-09-28 |
| 25 | 201841036901-ABSTRACT [28-09-2021(online)].pdf | 2021-09-28 |
| 26 | 201841036901-FER.pdf | 2021-10-17 |
| 27 | 201841036901-PatentCertificate08-09-2023.pdf | 2023-09-08 |
| 28 | 201841036901-IntimationOfGrant08-09-2023.pdf | 2023-09-08 |
| 29 | 201841036901-PROOF OF ALTERATION [05-12-2023(online)].pdf | 2023-12-05 |
| 1 | search11E_16-03-2021.pdf |