Abstract: A virtual avionics maintenance training method according to embodiments of the present disclosure may include the steps of rendering, to a VR headset, a first virtual reality scene including an interior and one or more control panel components of the aeroplane cockpit within the VR setting that includes a first virtual object corresponding to a first real object at a first real location. In certain implementations, the user's hand's location in respect to the VR headset is detected and used to trigger an appropriate response. One such implementation involves using the user's eyes to interact with a displayed control panel rather of pressing buttons. Depending on the user's hand position and look direction, embodiments may additionally simulate the real aircraft instruments of the control panel, moving and reacting as the user intends.
1. A virtual avionics maintenance training method for providing training of aircraft maintenance to an aircraft maintenance officer, the method comprising the steps of: rendering, to a VR head set, a first virtual reality scene comprising an interior and one or more control panel components of the aeroplane cockpit within the VR setting that includes a first virtual object corresponding to a first real object at a first real location; monitoring a hand position in relation to the virtual reality headset to determine a required action; monitoring a gaze direction with respect to the rendered VR scene to actuate controls of a displayed control panel; mimicking the movements and responses of actual aircraft instruments of the control panel based on the determined hand position and gaze direction; outputting to the student via at least one output device and receiving input via at least one input device; communicating movements of actual aircraft instruments from an avionic communications system; and determining the performance of the aircraft maintenance officer based on the movements of the real aircraft instruments, with the performance including answers to presentations.
2. The method according to claim 1, wherein the step of communicating movements of actual aircraft instruments from an avionic communications system comprises communicating movements of actual aircraft instruments from an avionic communication system.
3. The method according to claim 1, further comprising rendering a set of corrective tasks, wherein each corrective task of the set of corrective tasks corresponds to a substantive task that, based on the aircraft maintenance log data.
4. The system according to claim 1, wherein the VR head set is configured to provide a respective training output video.
5. The system according to claim 1, wherein the aircraft maintenance officer operates a stimulatory gadget which is affixed with IoT based sensor to track movement in a 3D space to determine user input against the displayed control panel.
6. A system for providing training of aircraft maintenance to an aircraft maintenance officer, the system comprising: render, to a VR head set, a first virtual reality scene comprising an interior and one or more control panel components of the aeroplane cockpit within the VR setting that includes a first virtual object corresponding to a first real object at a first real location; monitor a hand position in relation to the virtual reality headset to determine a required action; monitor a gaze direction with respect to the rendered VR scene to actuate controls of a displayed control panel; mimick the movements and responses of actual aircraft instruments of the control panel based on the determined hand position and gaze direction; outputting to the student via at least one output device and receiving input via at least one input device; communicate movements of actual aircraft instruments from an avionic communications system; and determine the performance of the aircraft maintenance officer based on the movements of the real aircraft instruments, with the performance including answers to presentations.
7. The system according to claim 6, wherein the step of communicating movements of actual aircraft instruments from an avionic communications system comprises communicating movements of actual aircraft instruments from an avionic communication system.
8. The system according to claim 6, further comprising rendering a set of corrective tasks, wherein each corrective task of the set of corrective tasks corresponds to a substantive task that, based on the aircraft maintenance log data.
9. The system according to claim 6, wherein the VR head set is configured to provide a respective training output video.
10. The system according to claim 6, wherein the aircraft maintenance officer operates a stimulatory gadget which is affixed with IoT based sensor to track movement in a 3D space to determine user input against the displayed control panel. VIRTUAL AVIONICS MAINTENANCE TRAINING METHOD FOR PROVIDING TRAINING OF AIRCRAFT MAINTENANCE TO AN AIRCRAFT MAINTENANCE OFFICER Abstract A virtual avionics maintenance training method according to embodiments of the present disclosure may include the steps of rendering, to a VR headset, a first virtual reality scene including an interior and one or more control panel components of the aeroplane cockpit within the VR setting that includes a first virtual object corresponding to a first real object at a first real location. In certain implementations, the user's hand's location in respect to the VR headset is detected and used to trigger an appropriate response. One such implementation involves using the user's eyes to interact with a displayed control panel rather of pressing buttons. Depending on the user's hand position and look direction, embodiments may additionally simulate the real aircraft instruments of the control panel, moving and reacting as the user intends. s:
1. A virtual avionics maintenance training method for providing training of aircraft maintenance to an aircraft maintenance officer, the method comprising the steps of: rendering, to a VR head set, a first virtual reality scene comprising an interior and one or more control panel components of the aeroplane cockpit within the VR setting that includes a first virtual object corresponding to a first real object at a first real location; monitoring a hand position in relation to the virtual reality headset to determine a required action; monitoring a gaze direction with respect to the rendered VR scene to actuate controls of a displayed control panel; mimicking the movements and responses of actual aircraft instruments of the control panel based on the determined hand position and gaze direction; outputting to the student via at least one output device and receiving input via at least one input device; communicating movements of actual aircraft instruments from an avionic communications system; and determining the performance of the aircraft maintenance officer based on the movements of the real aircraft instruments, with the performance including answers to presentations.
2. The method according to claim 1, wherein the step of communicating movements of actual aircraft instruments from an avionic communications system comprises communicating movements of actual aircraft instruments from an avionic communication system.
3. The method according to claim 1, further comprising rendering a set of corrective tasks, wherein each corrective task of the set of corrective tasks corresponds to a substantive task that, based on the aircraft maintenance log data.
4. The system according to claim 1, wherein the VR head set is configured to provide a respective training output video.
5. The system according to claim 1, wherein the aircraft maintenance officer operates a stimulatory gadget which is affixed with IoT based sensor to track movement in a 3D space to determine user input against the displayed control panel.
6. A system for providing training of aircraft maintenance to an aircraft maintenance officer, the system comprising: render, to a VR head set, a first virtual reality scene comprising an interior and one or more control panel components of the aeroplane cockpit within the VR setting that includes a first virtual object corresponding to a first real object at a first real location; monitor a hand position in relation to the virtual reality headset to determine a required action; monitor a gaze direction with respect to the rendered VR scene to actuate controls of a displayed control panel; mimick the movements and responses of actual aircraft instruments of the control panel based on the determined hand position and gaze direction; outputting to the student via at least one output device and receiving input via at least one input device; communicate movements of actual aircraft instruments from an avionic communications system; and determine the performance of the aircraft maintenance officer based on the movements of the real aircraft instruments, with the performance including answers to presentations.
7. The system according to claim 6, wherein the step of communicating movements of actual aircraft instruments from an avionic communications system comprises communicating movements of actual aircraft instruments from an avionic communication system.
8. The system according to claim 6, further comprising rendering a set of corrective tasks, wherein each corrective task of the set of corrective tasks corresponds to a substantive task that, based on the aircraft maintenance log data.
9. The system according to claim 6, wherein the VR head set is configured to provide a respective training output video.
10. The system according to claim 6, wherein the aircraft maintenance officer operates a stimulatory gadget which is affixed with IoT based sensor to track movement in a 3D space to determine user input against the displayed control panel.
Field of the Invention
[0001] The present disclosure is related to a system and method for providing training of aircraft maintenance to an aircraft maintenance officer.
Background
[0002] The background description includes information that may be useful in understanding the present invention. It is not an admission that any of the information provided herein is prior art or relevant to the presently claimed invention, or that any publication specifically or implicitly referenced is prior art.
[0003] The aviation industry is most sophisticated transportation industry and has become essential for the economy. Flight safety and airlines operation have been in focus since aircraft were first invented, as even a slight error in aircraft maintenance may cause serious accidents. Thus, aircraft maintenance is critical to aviation industry all the time. To prevent maintenance errors and to provide safer operations during flight, it is important to train for aviation maintenance and safety.
[0004] Aircraft maintenance training industry have always been in process to continuously improve and produce efficient and effective Aircraft Maintenance Technicians (AMTs). However, cost of training with adequate resources is significantly high and also requires a high level of safety. Apart from this, a variety of engines for various aircraft require even higher costs for training purpose. Hence, restricted availability of hardware and software resources for aircraft training limits training of aircraft maintenance. There are various techniques are disclosed in patent literature to discuss aircraft maintenance. The following are exemplary documents are discussed.
[0005] The WO2007059321A2 (By: Boeing Co) provides a turnkey maintenance of a customer's aircraft fleet is managed by a single management service provider (MSP) controlling integrated maintenance and materials services from a central operations site. The MSP converts data received directly from on-board aircraft systems into information it uses to manage maintenance service providers and parts suppliers. The MSP contracts with and manages maintenance, repair and overhaul organizations (MROs) who perform the maintenance on the customers' aircraft at line and base stations. The MSP either remotely manages part inventories at the customer's site, or manages suppliers who deliver the parts to the MROs. Maintenance planning, scheduling and execution information is exchanged between the MSP, MROs, part suppliers and the customers through a shared data communication network controlled by the MSP. The MSP charges the customer for the maintenance services based on a flat rate per unit of aircraft flying time.
[0006] CN103810231B (By: GE Aviation Systems LLC) provides a maintenance system for a fleet of aircraft and a method of planning maintenance for a fleet of aircraft that includes identifying a maintenance schedule having at least one routine maintenance action for an aircraft to be maintained, generating a non-routine maintenance task schedule comprising non-routine maintenance tasks, and generating a combined schedule comprising a combination of the maintenance schedule and the non-routine maintenance task schedule.
[0007] EP3346345A1 (By: Honeywell International Inc) disclose a maintenance system is provided for an environmental conditioning element of an environmental control system of a vehicle. The maintenance system includes a data acquisition module configured to determine an ambient temperature, an altitude of the vehicle, and a measured ECS compressor temperature; a fouling module coupled to receive the ambient temperature, the altitude, and the measured ECS compressor temperature from the data acquisition module and configured to generate a fouling condition of the environmental conditioning element based on at least the ambient temperature, the altitude, and the measured ECS compressor temperature; and a reporting module coupled to receive the fouling condition from the fouling module and configured to generate a report for a user that includes the fouling condition.
[0008] However, such automatic aircraft maintenance systems are dependent on advance sensor system. However, manual inspection by maintenance personal is highly desirable. Therefore, it becomes critical to find a new tool to improve and replace traditional training of AMTs. All references, including publications, patent applications, and patents, cited herein are hereby incorporated by reference to the same extent as if each reference were individually and specifically indicated to be incorporated by reference and were set forth in its entirety herein.
Summary of the Invention
[0009] Various objects, features, and advantages of the disclosed subject matter can be more fully appreciated with reference to the following detailed description of the disclosed subject matter when considered in connection with the following drawings, in which like reference numerals identify like elements.
[00010] The present disclosure is related to a system and method for providing training of aircraft maintenance to an aircraft maintenance officer.
[00011] Embodiments of the present disclosure may include a virtual avionics maintenance training method for providing training of aircraft maintenance to an aircraft maintenance officer, the method including the steps of rendering, to a VR head set, a first virtual reality scene including an interior and one or more control panel components of the aeroplane cockpit within the VR setting that includes a first virtual object corresponding to a first real object at a first real location.
[00012] Embodiments may also include monitoring a hand position in relation to the virtual reality headset to determine a required action. Embodiments may also include monitoring a gaze direction with respect to the rendered VR scene to actuate controls of a displayed control panel. Embodiments may also include mimicking the movements and responses of actual aircraft instruments of the control panel based on the determined hand position and gaze direction.
[00013] Embodiments may also include outputting to the student via at least one output device and receiving input via at least one input device. Embodiments may also include communicating movements of actual aircraft instruments from an avionic communications system. Embodiments may also include determining the performance of the aircraft maintenance officer based on the movements of the real aircraft instruments, with the performance including answers to presentations.
[00014] In some embodiments, the step of communicating movements of actual aircraft instruments from an avionic communications system may include communicating movements of actual aircraft instruments from an avionic communication system. The method according to may include rendering a set of corrective tasks. In some embodiments, each corrective task of the set of corrective tasks corresponds to a substantive task that, based on the aircraft maintenance log data. In some embodiments, the VR head set may be configured to provide a respective training output video. In some embodiments, the aircraft maintenance officer operates a stimulatory gadget which may be affixed with IoT based sensor to track movement in a 3D space to determine user input against the displayed control panel.
[00015] Embodiments of the present disclosure may also include a system for providing training of aircraft maintenance to an aircraft maintenance officer, the system including render, to a VR head set, a first virtual reality scene including an interior and one or more control panel components of the aeroplane cockpit within the VR setting that includes a first virtual object corresponding to a first real object at a first real location.
[00016] Embodiments may also include monitor a hand position in relation to the virtual reality headset to determine a required action. Embodiments may also include monitor a gaze direction with respect to the rendered VR scene to actuate controls of a displayed control panel. Embodiments may also include mimic the movements and responses of actual aircraft instruments of the control panel based on the determined hand position and gaze direction.
[00017] Embodiments may also include outputting to the student via at least one output device and receiving input via at least one input device. Embodiments may also include communicate movements of actual aircraft instruments from an avionic communications system. Embodiments may also include determine the performance of the aircraft maintenance officer based on the movements of the real aircraft instruments, with the performance including answers to presentations.
[00018] In some embodiments, the step of communicating movements of actual aircraft instruments from an avionic communications system may include communicating movements of actual aircraft instruments from an avionic communication system. In some embodiments, the system according to may include rendering a set of corrective tasks. In some embodiments, each corrective task of the set of corrective tasks corresponds to a substantive task that, based on the aircraft maintenance log data. In some embodiments, the VR head set may be configured to provide a respective training output video. In some embodiments, the aircraft maintenance officer operates a stimulatory gadget which may be affixed with IoT based sensor to track movement in a 3D space to determine user input against the displayed control panel.
Brief Description of the Drawings
[00019] The features and advantages of the present disclosure would be more clearly understood from the following description taken in conjunction with the accompanying drawings in which:
[00020] FIG. 1 is a flowchart illustrating a virtual avionics maintenance training method for providing training of aircraft maintenance to an aircraft maintenance officer, according to some embodiments of the present disclosure.
[00021] FIG. 2 is a block diagram illustrating a system, according to some embodiments of the present disclosure.
Claims
I/We claims:
1. A virtual avionics maintenance training method for providing training of aircraft maintenance to an aircraft maintenance officer, the method comprising the steps of:
rendering, to a VR head set, a first virtual reality scene comprising an interior and one or more control panel components of the aeroplane cockpit within the VR setting that includes a first virtual object corresponding to a first real object at a first real location;
monitoring a hand position in relation to the virtual reality headset to determine a required action;
monitoring a gaze direction with respect to the rendered VR scene to actuate controls of a displayed control panel;
mimicking the movements and responses of actual aircraft instruments of the control panel based on the determined hand position and gaze direction;
outputting to the student via at least one output device and receiving input via at least one input device;
communicating movements of actual aircraft instruments from an avionic communications system; and
determining the performance of the aircraft maintenance officer based on the movements of the real aircraft instruments, with the performance including answers to presentations.
2. The method according to claim 1, wherein the step of communicating movements of actual aircraft instruments from an avionic communications system comprises communicating movements of actual aircraft instruments from an avionic communication system.
3. The method according to claim 1, further comprising rendering a set of corrective tasks, wherein each corrective task of the set of corrective tasks corresponds to a substantive task that, based on the aircraft maintenance log data.
4. The system according to claim 1, wherein the VR head set is configured to provide a respective training output video.
5. The system according to claim 1, wherein the aircraft maintenance officer operates a stimulatory gadget which is affixed with IoT based sensor to track movement in a 3D space to determine user input against the displayed control panel.
6. A system for providing training of aircraft maintenance to an aircraft maintenance officer, the system comprising:
render, to a VR head set, a first virtual reality scene comprising an interior and one or more control panel components of the aeroplane cockpit within the VR setting that includes a first virtual object corresponding to a first real object at a first real location;
monitor a hand position in relation to the virtual reality headset to determine a required action;
monitor a gaze direction with respect to the rendered VR scene to actuate controls of a displayed control panel;
mimick the movements and responses of actual aircraft instruments of the control panel based on the determined hand position and gaze direction;
outputting to the student via at least one output device and receiving input via at least one input device;
communicate movements of actual aircraft instruments from an avionic communications system; and
determine the performance of the aircraft maintenance officer based on the movements of the real aircraft instruments, with the performance including answers to presentations.
7. The system according to claim 6, wherein the step of communicating movements of actual aircraft instruments from an avionic communications system comprises communicating movements of actual aircraft instruments from an avionic communication system.
8. The system according to claim 6, further comprising rendering a set of corrective tasks, wherein each corrective task of the set of corrective tasks corresponds to a substantive task that, based on the aircraft maintenance log data.
9. The system according to claim 6, wherein the VR head set is configured to provide a respective training output video.
10. The system according to claim 6, wherein the aircraft maintenance officer operates a stimulatory gadget which is affixed with IoT based sensor to track movement in a 3D space to determine user input against the displayed control panel.
VIRTUAL AVIONICS MAINTENANCE TRAINING METHOD FOR PROVIDING TRAINING OF AIRCRAFT MAINTENANCE TO AN AIRCRAFT MAINTENANCE OFFICER
Abstract
A virtual avionics maintenance training method according to embodiments of the present disclosure may include the steps of rendering, to a VR headset, a first virtual reality scene including an interior and one or more control panel components of the aeroplane cockpit within the VR setting that includes a first virtual object corresponding to a first real object at a first real location. In certain implementations, the user's hand's location in respect to the VR headset is detected and used to trigger an appropriate response. One such implementation involves using the user's eyes to interact with a displayed control panel rather of pressing buttons. Depending on the user's hand position and look direction, embodiments may additionally simulate the real aircraft instruments of the control panel, moving and reacting as the user intends.
I/We claims:
1. A virtual avionics maintenance training method for providing training of aircraft maintenance to an aircraft maintenance officer, the method comprising the steps of:
rendering, to a VR head set, a first virtual reality scene comprising an interior and one or more control panel components of the aeroplane cockpit within the VR setting that includes a first virtual object corresponding to a first real object at a first real location;
monitoring a hand position in relation to the virtual reality headset to determine a required action;
monitoring a gaze direction with respect to the rendered VR scene to actuate controls of a displayed control panel;
mimicking the movements and responses of actual aircraft instruments of the control panel based on the determined hand position and gaze direction;
outputting to the student via at least one output device and receiving input via at least one input device;
communicating movements of actual aircraft instruments from an avionic communications system; and
determining the performance of the aircraft maintenance officer based on the movements of the real aircraft instruments, with the performance including answers to presentations.
2. The method according to claim 1, wherein the step of communicating movements of actual aircraft instruments from an avionic communications system comprises communicating movements of actual aircraft instruments from an avionic communication system.
3. The method according to claim 1, further comprising rendering a set of corrective tasks, wherein each corrective task of the set of corrective tasks corresponds to a substantive task that, based on the aircraft maintenance log data.
4. The system according to claim 1, wherein the VR head set is configured to provide a respective training output video.
5. The system according to claim 1, wherein the aircraft maintenance officer operates a stimulatory gadget which is affixed with IoT based sensor to track movement in a 3D space to determine user input against the displayed control panel.
6. A system for providing training of aircraft maintenance to an aircraft maintenance officer, the system comprising:
render, to a VR head set, a first virtual reality scene comprising an interior and one or more control panel components of the aeroplane cockpit within the VR setting that includes a first virtual object corresponding to a first real object at a first real location;
monitor a hand position in relation to the virtual reality headset to determine a required action;
monitor a gaze direction with respect to the rendered VR scene to actuate controls of a displayed control panel;
mimick the movements and responses of actual aircraft instruments of the control panel based on the determined hand position and gaze direction;
outputting to the student via at least one output device and receiving input via at least one input device;
communicate movements of actual aircraft instruments from an avionic communications system; and
determine the performance of the aircraft maintenance officer based on the movements of the real aircraft instruments, with the performance including answers to presentations.
7. The system according to claim 6, wherein the step of communicating movements of actual aircraft instruments from an avionic communications system comprises communicating movements of actual aircraft instruments from an avionic communication system.
8. The system according to claim 6, further comprising rendering a set of corrective tasks, wherein each corrective task of the set of corrective tasks corresponds to a substantive task that, based on the aircraft maintenance log data.
9. The system according to claim 6, wherein the VR head set is configured to provide a respective training output video.
10. The system according to claim 6, wherein the aircraft maintenance officer operates a stimulatory gadget which is affixed with IoT based sensor to track movement in a 3D space to determine user input against the displayed control panel.
| # | Name | Date |
|---|---|---|
| 1 | 202311012533-REQUEST FOR EARLY PUBLICATION(FORM-9) [24-02-2023(online)].pdf | 2023-02-24 |
| 2 | 202311012533-POWER OF AUTHORITY [24-02-2023(online)].pdf | 2023-02-24 |
| 3 | 202311012533-FORM-9 [24-02-2023(online)].pdf | 2023-02-24 |
| 4 | 202311012533-FORM FOR SMALL ENTITY(FORM-28) [24-02-2023(online)].pdf | 2023-02-24 |
| 5 | 202311012533-FORM 1 [24-02-2023(online)].pdf | 2023-02-24 |
| 6 | 202311012533-EVIDENCE FOR REGISTRATION UNDER SSI(FORM-28) [24-02-2023(online)].pdf | 2023-02-24 |
| 7 | 202311012533-EVIDENCE FOR REGISTRATION UNDER SSI [24-02-2023(online)].pdf | 2023-02-24 |
| 8 | 202311012533-EDUCATIONAL INSTITUTION(S) [24-02-2023(online)].pdf | 2023-02-24 |
| 9 | 202311012533-DRAWINGS [24-02-2023(online)].pdf | 2023-02-24 |
| 10 | 202311012533-DECLARATION OF INVENTORSHIP (FORM 5) [24-02-2023(online)].pdf | 2023-02-24 |
| 11 | 202311012533-COMPLETE SPECIFICATION [24-02-2023(online)].pdf | 2023-02-24 |