Abstract: AR Assistance for Instrument Operation and Calibration is proposed in the present invention is to design a virtual assistant to correct any errors in the instrument and to aid novice users to operate complex instruments in various fields such that errors and accidents can be suppressed greatly. The present invention uses Augmented Reality (AR) guides to simplify the working and calibration of the instrument. It is also powered with a chatbot that can clear queries with visual elements like pictures and videos. (Refer Fig. 1)
Claims:We claim:
1. A medical guidance system for providing real-time 3D augmented reality (AR) feedback guidance in the use of a medical equipment system (101), the medical guidance system comprising;
a. A medical equipment interface (102) is capable of receiving data from the manual of the medical equipment system (101) or during a medical procedure performed by a technician;
b. An augmented reality user interface (103) for presenting data pertaining to both real and virtual objects to the technician;
c. A three-dimensional guidance system (104) that is capable of sensing real-time user positioning data relating to one or more of the movements, position, and orientation of at least a portion of the medical equipment system (101) during said medical procedure performed by the technician;
d. A library (105) stored reference positioning data of the medical equipment system (101) during a reference medical procedure and stored reference outcome data relating to an outcome of said reference medical procedure; and
e. A data analysis module (106) may receive real-time data relating positioning data of a portion of the medical equipment during the novice technician’s performance of a desired medical task and data received from the medical equipment relating to the outcome data;
f. The augmented reality information is displayed or otherwise provided in a sensory manner (e.g., visually or via sound) in the AR device.
2. The medical guidance system for providing real-time 3D augmented reality (AR) feedback guidance as claimed in claim (1), the positioning data is obtained by the guidance system (104), which senses the position and/or orientation of a portion of the medical device at a desired sampling rate (e.g., 100 times per second (Hz) up to 0.1 Hz or once every 10 seconds).
3. The medical guidance system for providing real-time 3D augmented reality (AR) feedback guidance as claimed in claim (1), the library (105) has instructions for performing one or more medical procedures using the medical equipment system (101) and generic data associated with the use of the medical equipment system (101) on a number of different patients.
4. The medical guidance system for providing real-time 3D augmented reality (AR) feedback guidance as claimed in claim (1), the patient-specific data relating to the use of the medical equipment system (101) on one or more specific patients is also stored in the library (105).
5. The medical guidance system for providing real-time 3D augmented reality (AR) feedback guidance as claimed in claim (1), wherein at least one of said real-time position-based 3D AR feedback and said real-time outcome-based 3D AR feedback is selected from a virtual still image, a virtual video image, sounds, or tactile information.
Dated this 12th day of February 2021 , Description:[001] The present invention generally relates to Instrument monitoring and assistance. More specifically, the invention describes the application that uses Augmented Reality (AR) to monitor and assist in the operation and calibration data of instruments.
BACKGROUND OF THE INVENTION
[002] A recent survey says that there have been a lot of accidents and loss of life due to lack of qualified technicians and operators to handle complex instruments in industrial sectors as well as medical sectors.
[003] This problem mainly occurs because of the complexity of the existing manuals provided to them which is very difficult for the user to understand and to operate.
[004] Subsequently, augmented reality is something whose applications have spanned commercial industries and also in medicine. Even the future of AR will bring significant advances in this field too.
[005] Using AR technology, any information or data can be passed to a learner in real-time with a better sense of vision. AR also helps to view the 3D representation using which the user feels Interactive. One technology that's truly shaking up the landscape is AR, which superimposes an image onto a user's view of the real world and enhances it with sound. Indeed, AR is blurring the lines of reality.
[006] A patent WO2000052536A1 titled “Operating and monitoring system utilizing augmented reality technology” describes instruments are often required for operating and monitoring a process or a system. This requires a relatively high amount of hardware. In addition, the clear operation and monitoring often suffers when the person responsible is to watch and control a large number of displays. With the help of the mobile display means, for example in the form of data glasses, the person responsible is visualized on the same display device, namely on the data glasses. The visualization of certain process data, signals etc. can take place either as a function of predefinable process data and / or specifically in that the operator and observer have one Plant and / or a process considered a certain area or sub-area of the plant or process. With the help of augmented reality techniques, certain information data are visualized depending on the area or sub-area under consideration.
[007] Thus, there is a need for AR systems capable of guiding a novice user of equipment in real time through a wide range of unfamiliar tasks in remote environments such as space or remote wilderness (e.g., arctic) conditions. These may include daily checklist items (e.g., habitat systems procedures and general equipment maintenance), assembly and testing of complex electronics setups, and diagnostic and interventional medical procedures. AR guidance systems desirably would allow novice users to be capable of autonomously using medical and other equipment or devices with a high degree of procedural competence, even where the outcome is technique-sensitive.
SUMMARY OF THE INVENTION
[008] The following summary is provided to facilitate a clear understanding of the new features in the disclosed embodiment and it is not intended to be a full, detailed description. A detailed description of all aspects of the disclosed invention can be understood by reviewing the full specification, the drawing and the claims and the abstract, as a whole.
[009] The objective of the present invention is to design a virtual assistant to correct any errors in the instrument and to aid novice users to operate complex instruments in various fields such that errors and accidents can be suppressed greatly.
[010] The present invention uses Augmented Reality (AR) guides to simplify the working and calibration of the instrument. It is also powered with a chatbot that can clear queries with visual elements like pictures and videos.
[011] The usability of the invention is to reduce the mistakes and deaths which occur due to the mishandling of instruments and also to reduce the time taken for the user to correct the errors in it due to the availability of chatbot and AR.
[012] The invention is environmentally friendly as it helps to reduce environmental pollution by checking the parts of the instruments and correcting them thereby reducing any harm to mother nature.
[013] In an embodiment of the present invention, a virtual assistant for the instrument is created using AR which can be used by the user effectively without facing any hardships in operating the instrument.
[014] The aforementioned aspects along with the objectives and the advantages can be achieved as described herein.
BRIEF DESCRIPTION OF FIGURES
[015] Other features and advantages of the present invention will become apparent from the detailed description of the invention which follows, when considered in light of the accompanying drawings in which:
[016] Fig. 1 illustrates the block diagram of the present invention;
DETAILED DESCRIPTION OF THE INVENTION
[017] The principles of operation, design configurations and evaluation values in these non-limiting examples can be varied and are merely cited to illustrate at least one embodiment of the invention, without limiting the scope thereof.
[018] The embodiments will be described in detail with corresponding marked references to the drawings, in which the illustrative components of the invention are outlined. The embodiments disclosed herein can be expressed in different forms and should not be considered as limited to the listed embodiments in the disclosed invention. The various embodiments outlined in the subsequent sections are construed such that it provides a complete and a thorough understanding of the disclosed invention, by clearly describing the scope of the invention, for those skilled in the art.
[019] It must also be noted that as used herein and in the appended claims, the singular forms "a," "an," and "the" include plural references unless the context clearly dictates otherwise. Although any systems and methods similar or equivalent to those described herein can be used in the practice or testing of embodiments of the present invention, the preferred, systems and methods are now described.
[020] The present invention comprises a medical guidance system for providing real-time, three-dimensional (3D) augmented reality (AR) feedback guidance in the use of a medical equipment system (101).
[021] The medical guidance system comprises of a medical equipment interface (102) to a medical equipment system (101), wherein said medical equipment interface (102) is capable of receiving data from the medical equipment system (101) during a medical procedure performed by a user.
[022] An augmented reality user interface (103) for presenting data pertaining to both real and virtual objects to the user during at least a portion of the performance of the medical procedure.
[023] A three-dimensional guidance system (104) that is capable of sensing real-time user positioning data relating to one or more of the movements, position, and orientation of at least a portion of the medical equipment system (101) during said medical procedure performed by the user.
[024] A library (105) containing stored reference positioning data relating to one or more of the movements, position, and orientation of at least a portion of the medical equipment system (101) during a reference medical procedure and stored reference outcome data relating to an outcome of said reference medical procedure.
[025] A data analysing module (106) for providing at least one of position-based 3D AR feedback to the user based on the sensed user positioning data and the reference positioning data and outcome-based 3D AR feedback to the user based on data received from the medical equipment system (101) during the medical procedure performed by the user and reference outcome data.
[026] The invention can be utilised in other fields such as nuclear plants, Production plants, etc., by extending the data library of the invention which includes the data of the instruments that are used in the respective fields.
[027] It is emphasized that the Abstract of the Disclosure is provided to allow a reader to quickly ascertain the nature of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, it can be seen that various features are grouped together in a single embodiment for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment. Thus, the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separate embodiment. In the appended claims, the terms “including” and “in which” are used as the plain-English equivalents of the respective terms “comprising” and “wherein,” respectively. Moreover, the terms “first”, “second,” “third,” and so forth, are used merely as labels, and are not intended to impose numerical requirements on their objects.
[028] What has been described above includes examples of the disclosed architecture. It is, of course, not possible to describe every conceivable combination of components and/or methodologies, but one of ordinary skill in the art may recognize that many further combinations and permutations are possible. Accordingly, the novel architecture is intended to embrace all such alterations, modifications and variations that fall within the spirit and scope of the appended claims.
[029] Without further description, it is believed that one of ordinary skill in the art can, using the preceding description and the illustrative examples, make and utilize the present invention and practice the claimed methods. It should be understood that the foregoing discussion and examples merely present a detailed description of certain preferred embodiments. It will be apparent to those of ordinary skill in the art that various modifications and equivalents can be made without departing from the spirit and scope of the invention.
| Section | Controller | Decision Date |
|---|---|---|
| # | Name | Date |
|---|---|---|
| 1 | 202141006094-EDUCATIONAL INSTITUTION(S) [21-01-2025(online)].pdf | 2025-01-21 |
| 1 | 202141006094-IntimationOfGrant28-10-2024.pdf | 2024-10-28 |
| 1 | 202141006094-STATEMENT OF UNDERTAKING (FORM 3) [12-02-2021(online)].pdf | 2021-02-12 |
| 2 | 202141006094-REQUEST FOR EARLY PUBLICATION(FORM-9) [12-02-2021(online)].pdf | 2021-02-12 |
| 2 | 202141006094-PatentCertificate28-10-2024.pdf | 2024-10-28 |
| 2 | 202141006094-OTHERS [21-01-2025(online)].pdf | 2025-01-21 |
| 3 | 202141006094-FORM-9 [12-02-2021(online)].pdf | 2021-02-12 |
| 3 | 202141006094-IntimationOfGrant28-10-2024.pdf | 2024-10-28 |
| 3 | 202141006094-Written submissions and relevant documents [24-10-2024(online)].pdf | 2024-10-24 |
| 4 | 202141006094-Annexure [12-09-2024(online)].pdf | 2024-09-12 |
| 4 | 202141006094-FORM 1 [12-02-2021(online)].pdf | 2021-02-12 |
| 4 | 202141006094-PatentCertificate28-10-2024.pdf | 2024-10-28 |
| 5 | 202141006094-Written submissions and relevant documents [24-10-2024(online)].pdf | 2024-10-24 |
| 5 | 202141006094-FIGURE OF ABSTRACT [12-02-2021(online)].jpg | 2021-02-12 |
| 5 | 202141006094-Correspondence to notify the Controller [12-09-2024(online)].pdf | 2024-09-12 |
| 6 | 202141006094-US(14)-HearingNotice-(HearingDate-24-10-2024).pdf | 2024-09-12 |
| 6 | 202141006094-DRAWINGS [12-02-2021(online)].pdf | 2021-02-12 |
| 6 | 202141006094-Annexure [12-09-2024(online)].pdf | 2024-09-12 |
| 7 | 202141006094-FER_SER_REPLY [12-04-2023(online)].pdf | 2023-04-12 |
| 7 | 202141006094-DECLARATION OF INVENTORSHIP (FORM 5) [12-02-2021(online)].pdf | 2021-02-12 |
| 7 | 202141006094-Correspondence to notify the Controller [12-09-2024(online)].pdf | 2024-09-12 |
| 8 | 202141006094-COMPLETE SPECIFICATION [12-02-2021(online)].pdf | 2021-02-12 |
| 8 | 202141006094-FER.pdf | 2022-11-01 |
| 8 | 202141006094-US(14)-HearingNotice-(HearingDate-24-10-2024).pdf | 2024-09-12 |
| 9 | 202141006094-EDUCATIONAL INSTITUTION(S) [29-04-2022(online)].pdf | 2022-04-29 |
| 9 | 202141006094-FER_SER_REPLY [12-04-2023(online)].pdf | 2023-04-12 |
| 9 | 202141006094-POA [29-04-2022(online)].pdf | 2022-04-29 |
| 10 | 202141006094-FER.pdf | 2022-11-01 |
| 10 | 202141006094-FORM 13 [29-04-2022(online)].pdf | 2022-04-29 |
| 10 | 202141006094-OTHERS [29-04-2022(online)].pdf | 2022-04-29 |
| 11 | 202141006094-EDUCATIONAL INSTITUTION(S) [29-04-2022(online)].pdf | 2022-04-29 |
| 11 | 202141006094-FORM 18 [29-04-2022(online)].pdf | 2022-04-29 |
| 12 | 202141006094-FORM 13 [29-04-2022(online)].pdf | 2022-04-29 |
| 12 | 202141006094-OTHERS [29-04-2022(online)].pdf | 2022-04-29 |
| 13 | 202141006094-EDUCATIONAL INSTITUTION(S) [29-04-2022(online)].pdf | 2022-04-29 |
| 13 | 202141006094-FORM 18 [29-04-2022(online)].pdf | 2022-04-29 |
| 13 | 202141006094-POA [29-04-2022(online)].pdf | 2022-04-29 |
| 14 | 202141006094-OTHERS [29-04-2022(online)].pdf | 2022-04-29 |
| 14 | 202141006094-FER.pdf | 2022-11-01 |
| 14 | 202141006094-COMPLETE SPECIFICATION [12-02-2021(online)].pdf | 2021-02-12 |
| 15 | 202141006094-DECLARATION OF INVENTORSHIP (FORM 5) [12-02-2021(online)].pdf | 2021-02-12 |
| 15 | 202141006094-FER_SER_REPLY [12-04-2023(online)].pdf | 2023-04-12 |
| 15 | 202141006094-POA [29-04-2022(online)].pdf | 2022-04-29 |
| 16 | 202141006094-COMPLETE SPECIFICATION [12-02-2021(online)].pdf | 2021-02-12 |
| 16 | 202141006094-DRAWINGS [12-02-2021(online)].pdf | 2021-02-12 |
| 16 | 202141006094-US(14)-HearingNotice-(HearingDate-24-10-2024).pdf | 2024-09-12 |
| 17 | 202141006094-Correspondence to notify the Controller [12-09-2024(online)].pdf | 2024-09-12 |
| 17 | 202141006094-DECLARATION OF INVENTORSHIP (FORM 5) [12-02-2021(online)].pdf | 2021-02-12 |
| 17 | 202141006094-FIGURE OF ABSTRACT [12-02-2021(online)].jpg | 2021-02-12 |
| 18 | 202141006094-Annexure [12-09-2024(online)].pdf | 2024-09-12 |
| 18 | 202141006094-DRAWINGS [12-02-2021(online)].pdf | 2021-02-12 |
| 18 | 202141006094-FORM 1 [12-02-2021(online)].pdf | 2021-02-12 |
| 19 | 202141006094-Written submissions and relevant documents [24-10-2024(online)].pdf | 2024-10-24 |
| 19 | 202141006094-FORM-9 [12-02-2021(online)].pdf | 2021-02-12 |
| 19 | 202141006094-FIGURE OF ABSTRACT [12-02-2021(online)].jpg | 2021-02-12 |
| 20 | 202141006094-REQUEST FOR EARLY PUBLICATION(FORM-9) [12-02-2021(online)].pdf | 2021-02-12 |
| 20 | 202141006094-PatentCertificate28-10-2024.pdf | 2024-10-28 |
| 20 | 202141006094-FORM 1 [12-02-2021(online)].pdf | 2021-02-12 |
| 21 | 202141006094-STATEMENT OF UNDERTAKING (FORM 3) [12-02-2021(online)].pdf | 2021-02-12 |
| 21 | 202141006094-IntimationOfGrant28-10-2024.pdf | 2024-10-28 |
| 21 | 202141006094-FORM-9 [12-02-2021(online)].pdf | 2021-02-12 |
| 22 | 202141006094-OTHERS [21-01-2025(online)].pdf | 2025-01-21 |
| 22 | 202141006094-REQUEST FOR EARLY PUBLICATION(FORM-9) [12-02-2021(online)].pdf | 2021-02-12 |
| 23 | 202141006094-EDUCATIONAL INSTITUTION(S) [21-01-2025(online)].pdf | 2025-01-21 |
| 23 | 202141006094-STATEMENT OF UNDERTAKING (FORM 3) [12-02-2021(online)].pdf | 2021-02-12 |
| 1 | Amended_Stage_SearchAE_12-07-2024.pdf |
| 1 | Search_StrategyE_31-10-2022.pdf |
| 2 | Amended_Stage_SearchAE_12-07-2024.pdf |
| 2 | Search_StrategyE_31-10-2022.pdf |