Abstract: SYSTEM AND METHOD FOR IDENTIFYING FAULT RESOLUTION STEPS FOR EQUIPMENT BASED ON MULTI-MODAL DIAGNOSIS DATA ABSTRACT The present disclosure discloses a method and a system for identifying fault resolution steps for an equipment. Method captures multi-modal diagnosis data associated with at least one primary part in the equipment. Method obtains multi-modal features of the at least one primary part from the multi-modal diagnosis data. Method detects a condition state of the at least one primary part using the multi-modal features and a trained object fault detection model. Method determines location of a fault on the at least one primary part using a trained fault location prediction model when the condition state is detected as a faulty state. Method identifies primary fault resolution steps for the at least one primary part based on historic data associated with the at least one primary part and the location of the fault. Method identifies secondary resolution steps for secondary parts based on the primary fault resolution steps before rendering. Fig. 1
Description:PLEASE SEE THE ATTACHMENTS. , Claims:1. A method of identifying fault resolution steps for an equipment, the method comprising:
capturing multi-modal diagnosis data associated with at least one primary part in the equipment;
obtaining multi-modal features of the at least one primary part from the multi-modal diagnosis data;
detecting a condition state of the at least one primary part using the multi-modal features and a trained object fault detection model;
determining location of a fault on the at least one primary part using a trained fault location prediction model when the condition state of the at least one primary part is detected as a faulty state; and
identifying primary fault resolution steps for the at least one primary part based on historic data associated with the at least one primary part and the location of the fault.
2. The method as claimed in claim 1, further comprising:
identifying secondary resolution steps for secondary parts based on the primary fault resolution steps; and
rendering at least one of the primary fault resolution steps and the secondary resolution steps on at least one of a display interface and an Augmented Reality (AR) device for resolution of the fault,
wherein the secondary parts are communicably connected to the at least one primary part.
3. The method as claimed in claim 1, wherein the obtaining multi-modal features of the at least one primary part from the multi-modal diagnosis data comprises:
extracting a plurality of object feature data from the multi-modal diagnosis data; and
combining the plurality of object feature data to obtain the multi-modal features of the at least one primary part.
4. The method as claimed in claim 1, wherein the multi-modal diagnosis data comprises at least one of visual data, audio data, and sensor data; and
wherein the condition state is one of the faulty state and a healthy state.
5. The method as claimed in claim 1, further comprising:
providing a hidden issue checklist to identify a problem in at least one of secondary parts and related parts of the at least one primary part, based on at least one of the historic data associated with the secondary parts, the historic data associated with the related parts of the at least one primary part and the primary fault resolution steps, when the problem associated with at least one of the secondary parts and the related parts of the at least one primary part is not detectable; and
rendering at least one of the primary fault resolution steps and the hidden issue checklist on at least one of a display interface and an Augmented Reality (AR) device for resolution of the fault,
wherein the secondary parts are communicably connected to the at least one primary part.
6. A system for identifying fault resolution steps for an equipment, the system comprising:
a processor; and
a memory communicatively coupled to the processor, wherein the memory stores processor-executable instructions, which on execution, cause the processor to:
capture multi-modal diagnosis data associated with at least one primary part in the equipment;
obtain multi-modal features of the at least one primary part from the multi-modal diagnosis data;
detect a condition state of the at least one primary part using the multi-modal features and a trained object fault detection model;
determine location of a fault on the at least one primary part using a trained fault location prediction model when the condition state of the at least one primary part is detected as a faulty state; and
identify primary fault resolution steps for the at least one primary part based on historic data associated with the at least one primary part and the location of the fault.
7. The system as claimed in claim 6, wherein the processor is configured to:
identify secondary resolution steps for secondary parts based on the primary fault resolution steps; and
render at least one of the primary fault resolution steps and the secondary resolution steps on at least one of a display interface and an Augmented Reality (AR) device for resolution of the fault,
wherein the secondary parts are communicably connected to the at least one primary part.
8. The system as claimed in claim 6, wherein the processor is configured to:
extract a plurality of object feature data from the multi-modal diagnosis data; and
combine the plurality of object feature data to obtain the multi-modal features of the at least one primary part.
9. The system as claimed in claim 6, wherein the multi-modal diagnosis data comprises at least one of visual data, audio data, and sensor data; and
wherein the condition state is one of the faulty state and a healthy state.
10. The system as claimed in claim 6, wherein the processor is configured to:
provide a hidden issue checklist to identify a problem in at least one of secondary parts and related parts of the at least one primary part, based on at least one of the historic data associated with the secondary parts, the historic data associated with the related parts of the at least one primary part and the primary fault resolution steps, when the problem associated with at least one of the secondary parts and the related parts of the at least one primary part is not detectable; and
render at least one of the primary fault resolution steps and the hidden issue checklist on at least one of a display interface and an Augmented Reality (AR) device for resolution of the fault,
wherein the secondary parts are communicably connected to the at least one primary part.
| # | Name | Date |
|---|---|---|
| 1 | 202341057821-STATEMENT OF UNDERTAKING (FORM 3) [29-08-2023(online)].pdf | 2023-08-29 |
| 2 | 202341057821-REQUEST FOR EXAMINATION (FORM-18) [29-08-2023(online)].pdf | 2023-08-29 |
| 3 | 202341057821-POWER OF AUTHORITY [29-08-2023(online)].pdf | 2023-08-29 |
| 4 | 202341057821-FORM 18 [29-08-2023(online)].pdf | 2023-08-29 |
| 5 | 202341057821-FORM 1 [29-08-2023(online)].pdf | 2023-08-29 |
| 6 | 202341057821-DRAWINGS [29-08-2023(online)].pdf | 2023-08-29 |
| 7 | 202341057821-DECLARATION OF INVENTORSHIP (FORM 5) [29-08-2023(online)].pdf | 2023-08-29 |
| 8 | 202341057821-COMPLETE SPECIFICATION [29-08-2023(online)].pdf | 2023-08-29 |
| 9 | 202341057821-Power of Attorney [08-09-2023(online)].pdf | 2023-09-08 |
| 10 | 202341057821-Form 1 (Submitted on date of filing) [08-09-2023(online)].pdf | 2023-09-08 |
| 11 | 202341057821-Covering Letter [08-09-2023(online)].pdf | 2023-09-08 |