Abstract: The present disclosure discloses method and guidance providing system for providing real-time guidance to users during troubleshooting of devices. The guidance providing system receives user input indicating troubleshooting actions on device, by user, where user input comprises textual input and non-textual input, identifies object in device associated with troubleshooting actions and state of user while performing troubleshooting actions, from non-textual input. The object identified from non-textual input is mapped with textual input to obtain mapped user input. Consistency of mapped user input is verified based on conversation information and domain specific content associated with device. Sequence of instructions corresponding to mapped user input, based on state of user and one or more similar troubleshooting actions, may be extracted from knowledge database. Thereby troubleshooting instructions are provided based on sequence of instructions and one or more similar troubleshooting actions, to user for real-time guidance during troubleshooting of the device. Fig.1
Claims:WE CLAIM:
1. A method of providing real-time guidance to users during troubleshooting of devices, the method comprising:
receiving, by a guidance providing system (101), user input indicating troubleshooting actions on a device (105), by a user (106), wherein the user input comprises textual input and non-textual input;
identifying, by the guidance providing system (101), an object in the device (105) associated with the troubleshooting actions and state of the user (106) while performing the troubleshooting actions, from the non-textual input;
mapping, by the guidance providing system (101), the object, identified from the non-textual input with the textual input to obtain a mapped user input;
verifying, by the guidance providing system (101), consistency of the mapped user input based on a conversation information (207) and domain specific content associated with the device;
extracting, by the guidance providing system (101), at least one of, sequence of instructions corresponding to the mapped user input, based on the state of the user (106) and one or more similar troubleshooting actions, obtained from a knowledge database (107); and
providing, by the guidance providing system (101), troubleshooting instructions based on at least one of, the sequence of instructions and the one or more similar troubleshooting actions, to the user (106) for real-time guidance, during troubleshooting of the device (105).
2. The method as claimed in claim 1, wherein the textual input comprises at least one of speech data and text data associated with the troubleshooting actions.
3. The method as claimed in claim 1, wherein the non-textual input comprises at least one of images, videos, actions, and gestures of the user (106) while executing the troubleshooting actions and one or more region of interest provided by the user (106) by annotating the images.
4. The method as claimed in claim 1, wherein the conversation information (207) comprises at least one of, pre-stored conversation history and response to real-time queries provided to the user (106).
5. The method as claimed in claim 1, wherein the one or more similar troubleshooting actions are obtained by comparing the troubleshooting actions with one or more troubleshooting actions performed previously by the user (106) for a similar problem.
6. The method as claimed in claim 1, wherein verifying the consistency of the mapped user input comprises:
determining, by the guidance providing system (101), one or more collocation terms in the mapped user input by splitting the mapped user input into one or more sentences;
detecting, by the guidance providing system (101), context of the mapped user input by mapping the mapped user input against the knowledge database (107);
identifying, by the guidance providing system (101), a relation among one or more frames of the one or more sentences based on predefined frames and VerbNet analysis;
creating, by the guidance providing system (101), one or more lexical chains by detecting prominent named entities based on prestored domain specific features; and
mapping, by the guidance providing system (101), one or more co-references identified in the one or more sentences with the prominent named entities based on predefined reference score.
7. The method as claimed in claim 1, wherein the knowledge database (107) comprises troubleshooting information for a plurality of domains and one or more troubleshooting actions performed by the user (106).
8. A guidance providing system (101) for providing real-time guidance to users during troubleshooting of devices, comprising:
a processor (113); and
a memory (111) communicatively coupled to the processor (113), wherein the memory (111) stores processor instructions, which, on execution, causes the processor (113) to:
receive user input indicating troubleshooting actions on a device (105), by a user (106), wherein the user input comprises textual input and non-textual input;
identify an object in the device (105) associated with the troubleshooting actions and state of the user (106) while performing the troubleshooting actions, from the non-textual input,
map the object, identified from the non-textual input, with the textual input to obtain a mapped user input;
verify consistency of the mapped user input based on a conversation information (207) and domain specific content associated with the device (105);
extract at least one of, sequence of instructions corresponding to the mapped user input, based on the state of the user (106) and one or more similar troubleshooting actions, obtained from a knowledge database (107); and
provide troubleshooting instructions based on at least one of, the sequence of instructions and the one or more similar troubleshooting actions, to the user (106) for real-time guidance during troubleshooting of the device (105).
9. The guidance providing system (101) as claimed in claim 8, wherein the textual input comprises at least one of speech and text data associated with the troubleshooting actions.
10. The guidance providing system (101) as claimed in claim 8, wherein the non-textual input comprises at least one of images, videos, actions, and gestures of the user (106) while executing the troubleshooting actions and one or more region of interest provided by the user (106) by annotating the images.
11. The guidance providing system (101) as claimed in claim 8, wherein the conversation information (207) comprises at least one of, pre-stored conversation history and response to real-time queries provided to the user (106).
12. The guidance providing system (101) as claimed in claim 8, wherein the processor (113) obtains the one or more similar troubleshooting actions by comparing the troubleshooting actions with one or more troubleshooting actions performed previously by the user (106) for a similar problem.
13. The guidance providing system (101) as claimed in claim 8, wherein the processor (113) verifies the consistency of the mapped user input by:
determining one or more collocation terms in the mapped user input by splitting the mapped user input into one or more sentences;
detecting context of the mapped user input by mapping the mapped user input against the knowledge database (107);
identifying a relation among one or more frames of the one or more sentences based on predefined frames and VerbNet analysis;
creating one or more lexical chains by detecting prominent named entities based on prestored domain specific features; and
mapping one or more co-references identified in the one or more sentences with the prominent named entities based on predefined reference score.
14. The guidance providing system (101) as claimed in claim 8, wherein the knowledge database (107) comprises troubleshooting information for a plurality of domains and one or more troubleshooting actions performed by the user (106).
Dated this 29th day of May, 2018
R Ramya Rao
Of K&S Partners
Agent for the Applicant
IN/PA-1607
, Description:TECHNICAL FIELD
The present subject matter is related in general to troubleshooting guidance, more particularly, but not exclusively to method and system for providing real-time guidance to users during troubleshooting of devices.
| # | Name | Date |
|---|---|---|
| 1 | 201841020108-STATEMENT OF UNDERTAKING (FORM 3) [29-05-2018(online)].pdf | 2018-05-29 |
| 2 | 201841020108-REQUEST FOR EXAMINATION (FORM-18) [29-05-2018(online)].pdf | 2018-05-29 |
| 3 | 201841020108-POWER OF AUTHORITY [29-05-2018(online)].pdf | 2018-05-29 |
| 4 | 201841020108-FORM 18 [29-05-2018(online)].pdf | 2018-05-29 |
| 5 | 201841020108-FORM 1 [29-05-2018(online)].pdf | 2018-05-29 |
| 6 | 201841020108-DRAWINGS [29-05-2018(online)].pdf | 2018-05-29 |
| 7 | 201841020108-DECLARATION OF INVENTORSHIP (FORM 5) [29-05-2018(online)].pdf | 2018-05-29 |
| 8 | 201841020108-COMPLETE SPECIFICATION [29-05-2018(online)].pdf | 2018-05-29 |
| 9 | 201841020108-REQUEST FOR CERTIFIED COPY [05-06-2018(online)].pdf | 2018-06-05 |
| 10 | 201841020108-Proof of Right (MANDATORY) [15-09-2018(online)].pdf | 2018-09-15 |
| 11 | Correspondence by Agent_Form1_19-09-2018.pdf | 2018-09-19 |
| 12 | 201841020108-RELEVANT DOCUMENTS [18-03-2021(online)].pdf | 2021-03-18 |
| 13 | 201841020108-PETITION UNDER RULE 137 [18-03-2021(online)].pdf | 2021-03-18 |
| 14 | 201841020108-OTHERS [18-03-2021(online)].pdf | 2021-03-18 |
| 15 | 201841020108-Information under section 8(2) [18-03-2021(online)].pdf | 2021-03-18 |
| 16 | 201841020108-FORM 3 [18-03-2021(online)].pdf | 2021-03-18 |
| 17 | 201841020108-FER_SER_REPLY [18-03-2021(online)].pdf | 2021-03-18 |
| 18 | 201841020108-DRAWING [18-03-2021(online)].pdf | 2021-03-18 |
| 19 | 201841020108-CORRESPONDENCE [18-03-2021(online)].pdf | 2021-03-18 |
| 20 | 201841020108-CLAIMS [18-03-2021(online)].pdf | 2021-03-18 |
| 21 | 201841020108-FER.pdf | 2021-10-17 |
| 22 | 201841020108-PatentCertificate01-01-2024.pdf | 2024-01-01 |
| 23 | 201841020108-IntimationOfGrant01-01-2024.pdf | 2024-01-01 |
| 24 | 201841020108-PROOF OF ALTERATION [01-05-2024(online)].pdf | 2024-05-01 |
| 1 | 2020-10-2012-25-32E_20-10-2020.pdf |