Sign In to Follow Application
View All Documents & Correspondence

A Method And System For Multi Modal Input Based Platform For Intent Based Product Recommendations

Abstract: A method and a system are described for multi-modal input based platform for intent based product recommendations. The method comprises receiving, by the product recommendation device, one or more multi-modal user inputs associated with a first product, wherein the one or more multi-modal user inputs are at least speech, text, bodily expressions and clickstream data. It further includes determining an intent-score for each of the one or more multi-modal user inputs using one or more trained data models. It further includes computing an emotion-score by aggregating the intent-score for each of the one or more multi-modal user inputs based on a weighted average of the intent-score for each of the one or more multi-modal user inputs and the method then includes recommending one or more second products based on the emotion-score.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
29 September 2018
Publication Number
14/2020
Publication Type
INA
Invention Field
COMPUTER SCIENCE
Status
Email
bangalore@knspartners.com
Parent Application
Patent Number
Legal Status
Grant Date
2023-09-08
Renewal Date

Applicants

WIPRO LIMITED
Doddakannelli, Sarjapur Road, Bangalore

Inventors

1. Ghulam Mohiuddin Khan
F-901, Concorde Manhattans, Electronic City Phase -1, Bangalore – 560100
2. Dr. Gopichand Agnihotram
A-207, S.K. Aster, Doddathogur Village, Electronics City, Near Narashimha Swami Temple, Bangalore - 560100

Specification

1. A method for user-intent based product recommendations, the method comprising:
receiving, by a product recommendation device, one or more multi-modal user inputs
associated with a first product, wherein the one or more multi-modal user inputs are at least speech, text, bodily expressions and clickstream data;
determining, by the product recommendation device, an intent-score for each of the one or more multi-modal user inputs using one or more trained data models;
computing, by the product recommendation device, an emotion-score by aggregating the intent-score for each of the one or more multi-modal user inputs based on a weighted average of the intent-score for each of the one or more multi-modal user inputs; and
recommending, by the product recommendation device, one or more second products based on the emotion-score.
2. The method of claim 1, wherein the one or more trained data models comprises a natural language processing model, a text model, and a convolution neural network model.
3. The method of claim 2, wherein the natural language processing model, the speech to text model, and the convolution neural network model determines the intent-score for text, the intent-score for speech and the intent-score for bodily expressions respectively.
4. The method as claimed in claim 1, wherein the bodily expressions comprise at least one of hand gestures, eye movements, facial expressions, and head rotation, and age.
5. The method of claim 1, wherein the intent-score associated with the one or more multi-modal inputs is further adjusted dynamically based on the clickstream data of the user.
6. The method of claim 5, wherein the intent-scores adjusted are determined into a preconfigured range based on the clickstream data of the user.
7. A product recommendation device for recommending products to a user comprising:
a processor; and
a memory communicatively coupled to the processor, wherein the memory stores processor executable instructions, which on execution causes the processor to:
receive one or more multi-modal user inputs associated with a first product, wherein the one or more multi-modal user inputs are at least speech, text, bodily expressions and clickstream data;

determine an intent-score for each of the one or more multi-modal user inputs using one or more trained data models;
compute an emotion-score by aggregating the intent-score for each of the one or more multi-modal user inputs based on a weighted average of the intent-score for each of the one or more multi-modal user inputs;
recommending, by the product recommendation device, one or more second products based on the emotion-score.
8. The product recommendation device of claim 7, wherein the one or more trained data models comprises a natural language processing model, a speech to text model, and a convolution neural network model.
9. The product recommendation device of claim 8, wherein the natural language processing model, the speech to text model, and the convolution neural network model determines the intent-score for text, the intent-score for speech to text and the intent-score for bodily expressions respectively.
10. The product recommendation device of claim 7, wherein the bodily expressions comprise at least one of hand gestures, eye movements, facial expressions, and head rotation, and age.
11. The product recommendation device of claim 7, wherein the intent-score associated with the one or more multi-modal inputs is further adjusted dynamically based on the clickstream data of the user.
12. The product recommendation device of claim 11, wherein the intent-scores adjusted are determined into a preconfigured range based on the clickstream data of the user.

Documents

Application Documents

# Name Date
1 201841036901-STATEMENT OF UNDERTAKING (FORM 3) [29-09-2018(online)].pdf 2018-09-29
2 201841036901-REQUEST FOR EXAMINATION (FORM-18) [29-09-2018(online)].pdf 2018-09-29
3 201841036901-POWER OF AUTHORITY [29-09-2018(online)].pdf 2018-09-29
4 201841036901-FORM 18 [29-09-2018(online)].pdf 2018-09-29
5 201841036901-FORM 1 [29-09-2018(online)].pdf 2018-09-29
6 201841036901-DRAWINGS [29-09-2018(online)].pdf 2018-09-29
7 201841036901-DECLARATION OF INVENTORSHIP (FORM 5) [29-09-2018(online)].pdf 2018-09-29
8 201841036901-COMPLETE SPECIFICATION [29-09-2018(online)].pdf 2018-09-29
9 abstract 201841036901.jpg 2018-10-01
10 201841036901-Request Letter-Correspondence [09-10-2018(online)].pdf 2018-10-09
11 201841036901-Power of Attorney [09-10-2018(online)].pdf 2018-10-09
12 201841036901-Form 1 (Submitted on date of filing) [09-10-2018(online)].pdf 2018-10-09
13 201841036901-Proof of Right (MANDATORY) [21-12-2018(online)].pdf 2018-12-21
14 Corresondence by Agent_Form-1_31-12-2018.pdf 2018-12-31
15 201841036901-RELEVANT DOCUMENTS [28-09-2021(online)].pdf 2021-09-28
16 201841036901-PETITION UNDER RULE 137 [28-09-2021(online)].pdf 2021-09-28
17 201841036901-OTHERS [28-09-2021(online)].pdf 2021-09-28
18 201841036901-Information under section 8(2) [28-09-2021(online)].pdf 2021-09-28
19 201841036901-FORM 3 [28-09-2021(online)].pdf 2021-09-28
20 201841036901-FER_SER_REPLY [28-09-2021(online)].pdf 2021-09-28
21 201841036901-DRAWING [28-09-2021(online)].pdf 2021-09-28
22 201841036901-CORRESPONDENCE [28-09-2021(online)].pdf 2021-09-28
23 201841036901-COMPLETE SPECIFICATION [28-09-2021(online)].pdf 2021-09-28
24 201841036901-CLAIMS [28-09-2021(online)].pdf 2021-09-28
25 201841036901-ABSTRACT [28-09-2021(online)].pdf 2021-09-28
26 201841036901-FER.pdf 2021-10-17
27 201841036901-PatentCertificate08-09-2023.pdf 2023-09-08
28 201841036901-IntimationOfGrant08-09-2023.pdf 2023-09-08
29 201841036901-PROOF OF ALTERATION [05-12-2023(online)].pdf 2023-12-05

Search Strategy

1 search11E_16-03-2021.pdf

ERegister / Renewals

3rd: 02 Dec 2023

From 29/09/2020 - To 29/09/2021

4th: 02 Dec 2023

From 29/09/2021 - To 29/09/2022

5th: 02 Dec 2023

From 29/09/2022 - To 29/09/2023

6th: 02 Dec 2023

From 29/09/2023 - To 29/09/2024

7th: 26 Sep 2024

From 29/09/2024 - To 29/09/2025

8th: 25 Sep 2025

From 29/09/2025 - To 29/09/2026