Sign In to Follow Application
View All Documents & Correspondence

System Of Human Following Robot Assistance With Ai

Abstract: A system of Human following robot assistance with AI comprises a plurality of Human Following Robots (1, 2, 3, 4), a plurality of Coordinator (10, 11, 12), a plurality of Gateways (20, 21), Control Room (22), Web App (23), Mobile App (24), Battery Management System (7), Solar Panels (8), Battery (9), Infrared Sensor (30) & Ultrasonic Sensor (23) are used for distance measurement and obstacle detection, LiDAR (22), Bump Sensor (31), Slave Controller (60), Modor Driver 1 (61), M1 (26), M2 (27), M2 (28(, M4 (29), Master Controller (50), LiDAR (51), Display Screen (52), Keyboard (53), Mouse (54) and Camera (55); and Near Field Technology (NFT) is used for close-range tracking; and a control system is for real-time course and speed adjustment; and a hierarchical network architecture with central control, coordinators, and gateways and system also having a rover with modular payload, wireless connectivity, computer vision, and speech recognition; and an artificial intelligence module for decision-making and adaptive learning; and a power system with solar panels and battery management; and a sensor suite including infrared, ultrasonic, LiDAR, and bump sensors.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
06 September 2024
Publication Number
39/2024
Publication Type
INA
Invention Field
ELECTRONICS
Status
Email
Parent Application

Applicants

UTTARANCHAL UNIVERSITY
ARCADIA GRANT, P.O. CHANDANWARI, PREMNAGAR, DEHRADUN - 248007, UTTARAKHAND, INDIA

Inventors

1. PARTH SEMWAL
ANN MARY SCHOOL, DEHRADUN UTTARAKHAND, INDIA
2. AARAV SACHDEVA
ANN MARY SCHOOL, DEHRADUN UTTARAKHAND, INDIA
3. OJAS KUMAR
ANN MARY SCHOOL, DEHRADUN UTTARAKHAND, INDIA
4. RAJESH SINGH
ARCADIA GRANT, P.O. CHANDANWARI, PREMNAGAR, DEHRADUN - 248007, UTTARAKHAND, INDIA
5. ANITA GEHLOT
ARCADIA GRANT, P.O. CHANDANWARI, PREMNAGAR, DEHRADUN - 248007, UTTARAKHAND, INDIA
6. ANKITA JOSHI
ARCADIA GRANT, P.O. CHANDANWARI, PREMNAGAR, DEHRADUN - 248007, UTTARAKHAND, INDIA
7. PALLAVI GUPTA
ANN MARY SCHOOL, DEHRADUN UTTARAKHAND, INDIA

Specification

Description:Field of the Invention
This invention relates to a system of Human following robot assistance with AI.
Background of the Invention
Current security measures have flaws, including insufficient coordination and logistical assistance. To address these difficulties, a human-following robot is being deployed to offer commanding administrators effective autonomous field support. This rover ensures that vital supplies involving documents, ammunition, and communication devices are accessible, consequently strengthening operational effectiveness self-sufficient of the officer's position or mobility. To monitor officers reliably and consistently, the rover utilize modern technologies including Near Field Technology (NFT), ultrasonic sensors, and infrared sensors (IR).
Human-following rover technology facilitates faster and more effective responses to threats by bridging logistical bottlenecks. It monitors and follows the authorities automatically, eliminating inefficiencies caused by equipment maintenance. It enhances decision-making and operational cooperation. The system might benefit from computer vision and voice command capabilities, enabling it to recognize and respond to specific requests and individuals. This optimizes the user experience and adaptability in dynamic settings. Human-following rovers increase the planning and response of security personnel to terrorist threats by overcoming logistical obstacles.
CN215458144U This utility model represents a fully automated B-ultrasonic inspection robot system consisting of a control system, robot, depth camera, and station. The input of the control host is connected to the depth camera, and the robot is connected to its output. The robot has an end effector with an ultrasonic and a force detection device, and it has six or more degrees of freedom. The control host receives data from both devices. With this technology, B-ultrasonic exams can be carried out without the assistance of a trained technician or physician. The intelligence, usability, and efficiency of the robot system are its defining features.
CN113165163A The subject of this invention is a mobile robot with at least one multi-jointed manipulator and a movable base. With the use of a manipulator, the robot can execute a series of actions with a person's limb thanks to the inclusion of multiple telemedicine equipment.
US10265227B2 This patent describes the operation of a robotic helper, together with its software and methods. Included in the helper are a dual-arm robot fixed on a motorized base with two or more motorized wheels under control of a primary control system, a remote mouth controller with three degrees of freedom, and a "sip and puff" mouth controller. This controller sends signals, which a computer system interprets and converts into commands for the dual-arm robot and the base to move.
US20200055195A1 This application offers a robotics control system that includes an imaging device, an output component, a display unit, a remote user interface, and a resultant controller. The system captures surroundings images, manages the robot's end effector, and enables the user to send and receive navigation orders.
None of the prior art indicate above either alone or in combination with one another disclose what the present invention has disclosed. This invention relates to Human following robot assistance with AI.
SUMMARY OF THE INVENTION
This summary is provided to introduce a selection of concepts, in a simplified format, that are further described in the detailed description of the invention.
This summary is neither intended to identify key or essential inventive concepts of the invention and nor is it intended for determining the scope of the invention.
To further clarify advantages and features of the present invention, a more particular description of the invention will be rendered by reference to specific embodiments thereof, which is illustrated in the appended drawings. It is appreciated that these drawings depict only typical embodiments of the invention and are therefore not to be considered limiting of its scope. The invention will be described and explained with additional specificity and detail with the accompanying drawings.
A human-following rover system employs infrared (IR) and ultrasonic sensors to support commanding officers in the field. These technologies promise precise distance measuring, obstacle identification, and supervision of the officer's movements. Near Field Technology (NFT) optimizes the system by offering close-range tracking, enabling the rover to follow the officer even in congested or complex surroundings, maintaining a secure and consistent distance.
A strong control system supports the rover's tracking and navigational abilities. The rover's course and speed can be changed in real time by this system by interpreting data from the infrared and ultrasonic sensors. It is intended to provide fluid and receptive following behaviour by dynamically adapting to changes in the officer's movements and surrounding obstructions. Because its steering and propulsion technologies are tailored to specific terrains, the rover can function well in a variety of settings, including both urban and rugged terrain.
Figure1 shows a hierarchical system in which Human Following Robots (HFRs) connect with a central control centre. Through short-range radio frequency transmission, each HFR—represented by a pink triangle—sends data to designated coordinators, which are illustrated as orange boxes. The information is sent to gateways by these coordinators, who manage long-distance radio transmission. The gates transmit data to a central control room enclosed in a yellow container. The control room is connected to a mobile and web application, enabling operators to track and supervise HFRs, streamline communication between robots and the control center, and handle robot administration online.
The rover is a multi-purpose vehicle that can store ammunition, documentation, and communication devices. Its payload compartment is modular and can be tailored to suit various operations. Its wireless connectivity facilitates real-time data exchange and human control. Its computer vision and speech recognition competencies strengthen its capacity for adaptation. The rover's innovative sensing technology and modular architecture optimize its operational effectiveness.
The rover executes decisions employing AI, analyzing patterns in officer movements and environmental changes. This enables the rover to respond to a variety of situations, including unexpected maneuvers. AI-enhanced computer vision also observes individuals, facilitating rovers and officers coordinate effectively. Continuous learning from operational data enables the system adapt to evolving circumstances and command structures, strengthening its effectiveness over time. This adaptive learning technique promises the rover's dependability and performance in a variety of environments, making it a versatile logistical support tool for contemporary security operations.
Figure 2 below illustrates a network design for a robot system that follows humans, it includes a coordinator and coordination units. The coordinator, a CPU device with XBee and LoRa communication capabilities, facilitates wireless data exchange. It requires a battery power supply for coordinator units and data management storage. The Gateway (numbered 1--[n]), positioned next to the coordinator, it supports Ethernet, LAN, and WiFi, giving users a wider range of connectivity choices. The gateway runs on a battery or power source and has a storage unit, just as the coordinator. Interestingly, LoRa facilitates bidirectional data flow by facilitating coordinator and gateway communication.
The human-following robot architecture is shown in the lower part. Eight solar panels provide electricity for the robot's power system, which consists of a battery under the control of a battery management system. The robot is outfitted with a number of sensors, including thirty infrared sensors, twenty-three ultrasonic sensors, twenty-two LiDAR sensors, and thirty-one bump sensors. These sensors allow the robot to sense its surroundings.
Four motors (designated M1 through M4), two motor drivers, and a slave controller that manages these parts power the robot's movement. The complete functioning of the robot is managed by a master controller, which also provides serial link connection with other internal parts including the keyboard, mouse, LiDAR, camera, and display screen. The robot is able to communicate wirelessly with the coordinator or gateway thanks to the XBee module. In order to allow the robot to follow humans and communicate with the central network for data synchronization and operating instructions, this configuration integrates power management, sensory input, communication, and control to guarantee effective data flow and control within the robot.
The process flow of a human-following rover system is depicted in the figure3, including all initialization and continuous adjustments. The start command starts the procedure by launching the AI system.
The rover employs pre-established navigation procedures to identify its future location, modifying as it travels. The AI analyzes data from sensor inputs and surrounding variables to create an alternative route that taking into consideration the present scenario for both the rover and the individual it is following. The suggested path has been thoroughly validated for security and feasibility. The AI predicts the human's journey based on numerous inputs, and while guiding the person, the rover compares actual movement to the predicted path and analyzes any variations. To maintain the rover and operator in synchronization with the direction, the AI algorithm alters its trajectory and location. It maintains record of the user's position and updates the route as required. This dynamic response promises that the rover follows the user competently while remaining on the most optimal route, allowing the system to adapt to modifications.
BRIEF DESCRIPTION OF THE DRAWINGS
The illustrated embodiments of the subject matter will be understood by reference to the drawings, wherein like parts are designated by like numerals throughout. The following description is intended only by way of example, and simply illustrates certain selected embodiments of devices, systems, and methods that are consistent with the subject matter as claimed herein, wherein:
Figure 1 -Overall Architecture
Figure 2- System architecture
The figures depict embodiments of the present subject matter for the purposes of illustration only. A person skilled in the art will easily recognize from the following description that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles of the disclosure described herein.
DETAILED DESCRIPTION OF THE INVENTION
The detailed description of various exemplary embodiments of the disclosure is described herein with reference to the accompanying drawings. It should be noted that the embodiments are described herein in such details as to clearly communicate the disclosure. However, the amount of details provided herein is not intended to limit the anticipated variations of embodiments; on the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the scope of the present disclosure as defined by the appended claims.
It is also to be understood that various arrangements may be devised that, although not explicitly described or shown herein, embody the principles of the present disclosure. Moreover, all statements herein reciting principles, aspects, and embodiments of the present disclosure, as well as specific examples, are intended to encompass equivalents thereof.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments. As used herein, the singular forms “a",” “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises,” “comprising,” “includes” and/or “including,” when used herein, specify the presence of stated features, integers, steps, operations, elements and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and/or groups thereof.
It should also be noted that in some alternative implementations, the functions/acts noted may occur out of the order noted in the figures. For example, two figures shown in succession may, in fact, be executed concurrently or may sometimes be executed in the reverse order, depending upon the functionality/acts involved.
In addition, the descriptions of "first", "second", “third”, and the like in the present invention are used for the purpose of description only, and are not to be construed as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Thus, features defining "first" and "second" may include at least one of the features, either explicitly or implicitly.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which example embodiments belong. It will be further understood that terms, e.g., those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
A human-following rover system employs infrared (IR) and ultrasonic sensors to support commanding officers in the field. These technologies promise precise distance measuring, obstacle identification, and supervision of the officer's movements. Near Field Technology (NFT) optimizes the system by offering close-range tracking, enabling the rover to follow the officer even in congested or complex surroundings, maintaining a secure and consistent distance.
A strong control system supports the rover's tracking and navigational abilities. The rover's course and speed can be changed in real time by this system by interpreting data from the infrared and ultrasonic sensors. It is intended to provide fluid and receptive following behaviour by dynamically adapting to changes in the officer's movements and surrounding obstructions. Because its steering and propulsion technologies are tailored to specific terrains, the rover can function well in a variety of settings, including both urban and rugged terrain.
Figure1 shows a hierarchical system in which Human Following Robots (HFRs) connect with a central control centre. Through short-range radio frequency transmission, each HFR—represented by a pink triangle—sends data to designated coordinators, which are illustrated as orange boxes. The information is sent to gateways by these coordinators, who manage long-distance radio transmission. The gates transmit data to a central control room enclosed in a yellow container. The control room is connected to a mobile and web application, enabling operators to track and supervise HFRs, streamline communication between robots and the control center, and handle robot administration online.
The rover is a multi-purpose vehicle that can store ammunition, documentation, and communication devices. Its payload compartment is modular and can be tailored to suit various operations. Its wireless connectivity facilitates real-time data exchange and human control. Its computer vision and speech recognition competencies strengthen its capacity for adaptation. The rover's innovative sensing technology and modular architecture optimize its operational effectiveness.
The rover executes decisions employing AI, analyzing patterns in officer movements and environmental changes. This enables the rover to respond to a variety of situations, including unexpected maneuvers. AI-enhanced computer vision also observes individuals, facilitating rovers and officers coordinate effectively. Continuous learning from operational data enables the system adapt to evolving circumstances and command structures, strengthening its effectiveness over time. This adaptive learning technique promises the rover's dependability and performance in a variety of environments, making it a versatile logistical support tool for contemporary security operations.
Figure 2 below illustrates a network design for a robot system that follows humans, it includes a coordinator and coordination units. The coordinator, a CPU device with XBee and LoRa communication capabilities, facilitates wireless data exchange. It requires a battery power supply for coordinator units and data management storage. The Gateway (numbered 1--[n]), positioned next to the coordinator, it supports Ethernet, LAN, and WiFi, giving users a wider range of connectivity choices. The gateway runs on a battery or power source and has a storage unit, just as the coordinator. Interestingly, LoRa facilitates bidirectional data flow by facilitating coordinator and gateway communication.
The human-following robot architecture is shown in the lower part. Eight solar panels provide electricity for the robot's power system, which consists of a battery under the control of a battery management system. The robot is outfitted with a number of sensors, including thirty infrared sensors, twenty-three ultrasonic sensors, twenty-two LiDAR sensors, and thirty-one bump sensors. These sensors allow the robot to sense its surroundings.
Four motors (designated M1 through M4), two motor drivers, and a slave controller that manages these parts power the robot's movement. The complete functioning of the robot is managed by a master controller, which also provides serial link connection with other internal parts including the keyboard, mouse, LiDAR, camera, and display screen. The robot is able to communicate wirelessly with the coordinator or gateway thanks to the XBee module. In order to allow the robot to follow humans and communicate with the central network for data synchronization and operating instructions, this configuration integrates power management, sensory input, communication, and control to guarantee effective data flow and control within the robot.
The process flow of a human-following rover system is depicted in the figure3, including all initialization and continuous adjustments. The start command starts the procedure by launching the AI system.
The rover employs pre-established navigation procedures to identify its future location, modifying as it travels. The AI analyzes data from sensor inputs and surrounding variables to create an alternative route that taking into consideration the present scenario for both the rover and the individual it is following. The suggested path has been thoroughly validated for security and feasibility. The AI predicts the human's journey based on numerous inputs, and while guiding the person, the rover compares actual movement to the predicted path and analyzes any variations. To maintain the rover and operator in synchronization with the direction, the AI algorithm alters its trajectory and location. It maintains record of the user's position and updates the route as required. This dynamic response promises that the rover follows the user competently while remaining on the most optimal route, allowing the system to adapt to modifications.
A system of Human following robot assistance with AI comprises a plurality of Human Following Robots (1, 2, 3, 4), a plurality of Coordinator (10, 11, 12), a plurality of Gateways (20, 21), Control Room (22), Web App (23), Mobile App (24), Battery Management System (7), Solar Panels (8), Battery (9), Infrared Sensor (30) & Ultrasonic Sensor (23) are used for distance measurement and obstacle detection, LiDAR (22), Bump Sensor (31), Slave Controller (60), Modor Driver 1 (61), M1 (26), M2 (27), M2 (28(, M4 (29), Master Controller (50), LiDAR (51), Display Screen (52), Keyboard (53), Mouse (54) and Camera (55); and Near Field Technology (NFT) is used for close-range tracking; and a control system is for real-time course and speed adjustment; and a hierarchical network architecture with central control, coordinators, and gateways and system also having a rover with modular payload, wireless connectivity, computer vision, and speech recognition; and an artificial intelligence module for decision-making and adaptive learning; and a power system with solar panels and battery management; and a sensor suite including infrared, ultrasonic, LiDAR, and bump sensors.
In another embodiment wherein the control system is configured to dynamically adapt the rover's following behavior based on changes in the officer's movements and surrounding obstructions.
In another embodiment the rover is equipped with a modular payload compartment that can be configured for various operations, such as ammunition storage, documentation storage, and communication device storage.
In another embodiment the artificial intelligence module is configured to analyze patterns in officer movements and environmental changes to predict and respond to unexpected maneuvers.
In another embodiment the artificial intelligence module is configured to continuously learn from operational data to adapt to evolving circumstances and command structures.
In another embodiment the hierarchical network architecture includes a central control center, coordinators, and gateways that communicate using short-range radio frequency transmission and long-distance radio transmission.
In another embodiment the rover is equipped with a sensor suite that includes infrared, ultrasonic, LiDAR, and bump sensors to enable the rover to sense its surroundings.
In another embodiment the rover is equipped with a power system that includes solar panels, a battery, and a battery management system to provide power for the rover's operation.
In another embodiment the rover is equipped with a master controller that manages the overall operation of the rover, including serial link communication with internal components and wireless communication with the coordinator or gateway.
ADVANTAGES OF THE INVENTION
Future system advancements, especially voice command and computer vision, could enhance naturalistic assistance in complex surroundings, minimize cognitive pressure, and streamline labor-intensive equipment recoveries. Innovative technologies that incorporate near-field technology, infrared, and ultrasonic sensors enable it to be easier to access resources and maneuver seamlessly.
, Claims:1. A system of Human following robot assistance with AI comprises a plurality of Human Following Robots (1, 2, 3, 4), a plurality of Coordinator (10, 11, 12), a plurality of Gateways (20, 21), Control Room (22), Web App (23), Mobile App (24), Battery Management System (7), Solar Panels (8), Battery (9), Infrared Sensor (30) & Ultrasonic Sensor (23) are used for distance measurement and obstacle detection, LiDAR (22), Bump Sensor (31), Slave Controller (60), Modor Driver 1 (61), M1 (26), M2 (27), M2 (28(, M4 (29), Master Controller (50), LiDAR (51), Display Screen (52), Keyboard (53), Mouse (54) and Camera (55);
Wherein Near Field Technology (NFT) is used for close-range tracking; and a control system is for real-time course and speed adjustment; and a hierarchical network architecture with central control, coordinators, and gateways;
Wherein system also having a rover with modular payload, wireless connectivity, computer vision, and speech recognition; and an artificial intelligence module for decision-making and adaptive learning; and a power system with solar panels and battery management; and a sensor suite including infrared, ultrasonic, LiDAR, and bump sensors.
2. The system as claimed in claim 1, wherein the control system is configured to dynamically adapt the rover's following behavior based on changes in the officer's movements and surrounding obstructions.
3. The system as claimed in claim 1, wherein the rover is equipped with a modular payload compartment that can be configured for various operations, such as ammunition storage, documentation storage, and communication device storage.
4. The system as claimed in claim 1, wherein the artificial intelligence module is configured to analyze patterns in officer movements and environmental changes to predict and respond to unexpected maneuvers.
5. The system as claimed in claim 1, wherein the artificial intelligence module is configured to continuously learn from operational data to adapt to evolving circumstances and command structures.
6. The system as claimed in claim 1, wherein the hierarchical network architecture includes a central control center, coordinators, and gateways that communicate using short-range radio frequency transmission and long-distance radio transmission.
7. The system as claimed in claim 1, wherein the rover is equipped with a sensor suite that includes infrared, ultrasonic, LiDAR, and bump sensors to enable the rover to sense its surroundings.
8. The system as claimed in claim 1, wherein the rover is equipped with a power system that includes solar panels, a battery, and a battery management system to provide power for the rover's operation.
9. The system as claimed in claim 1, wherein the rover is equipped with a master controller that manages the overall operation of the rover,

including serial link communication with internal components and wireless communication with the coordinator or gateway.

Documents

Application Documents

# Name Date
1 202411067426-STATEMENT OF UNDERTAKING (FORM 3) [06-09-2024(online)].pdf 2024-09-06
2 202411067426-REQUEST FOR EARLY PUBLICATION(FORM-9) [06-09-2024(online)].pdf 2024-09-06
3 202411067426-POWER OF AUTHORITY [06-09-2024(online)].pdf 2024-09-06
4 202411067426-FORM-9 [06-09-2024(online)].pdf 2024-09-06
5 202411067426-FORM FOR SMALL ENTITY(FORM-28) [06-09-2024(online)].pdf 2024-09-06
6 202411067426-FORM 1 [06-09-2024(online)].pdf 2024-09-06
7 202411067426-EVIDENCE FOR REGISTRATION UNDER SSI(FORM-28) [06-09-2024(online)].pdf 2024-09-06
8 202411067426-EVIDENCE FOR REGISTRATION UNDER SSI [06-09-2024(online)].pdf 2024-09-06
9 202411067426-EDUCATIONAL INSTITUTION(S) [06-09-2024(online)].pdf 2024-09-06
10 202411067426-DRAWINGS [06-09-2024(online)].pdf 2024-09-06
11 202411067426-DECLARATION OF INVENTORSHIP (FORM 5) [06-09-2024(online)].pdf 2024-09-06
12 202411067426-COMPLETE SPECIFICATION [06-09-2024(online)].pdf 2024-09-06