Abstract: The present disclosure provides a system (100) and method (600) for conducting tele-robotic radiological procedures, comprising: a processor (202) to establish a connection between a user equipment (106) and a robotic system (112) using a network (108); a memory (204) to store images; a processing engine (208) to: integrate the robotic system (112) with the network (108); enable a communication between the medical professional (110) and the robotic arm (114) using the network (108); use a haptic device (130) to control movement of a robotic arm (114); transmit directional inputs of the medical professional (110) to the robotic arm (114); enable the robotic arm (114) to mimic movements of the medical professional (110); and display the images of a patient on the user equipment (106) through the network (108). FIURE 1B
FORM 2
THE PATENTS ACT, 1970 (39 of 1970) THE PATENTS RULES, 2003
COMPLETE SPECIFICATION
(See section 10; rule 13)
TITLE OF THE INVENTION
SYSTEM AND METHOD FOR CONDUCTING TELE-ROBOTIC RADIOLOGICAL PROCEDURES USING ROBOTIC ARM
APPLICANT
JIO PLATFORMS LIMITED
of Office-101, Saffron, Nr. Centre Point, Panchwati 5 Rasta, Ambawadi, Ahmedabad -
380006, Gujarat, India; Nationality : India
The following specification particularly describes
the invention and the manner in which
it is to be performed
RESERVATION OF RIGHTS
[0001] A portion of the disclosure of this patent document contains material,
which is subject to intellectual property rights such as, but are not limited to, copyright, design, trademark, Integrated Circuit (IC) layout design, and/or trade dress protection, belonging to Jio Platforms Limited (JPL) or its affiliates (hereinafter referred as owner). The owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all rights whatsoever. All rights to such intellectual property are fully reserved by the owner.
FIELD OF DISCLOSURE
[0002] The present disclosure relates to a field of telecommunications
technology in a medical field. More precisely, the disclosure relates to a system and method for conducting radiological procedures remotely using advanced telecommunication technologies such as 5G networks.
BACKGROUND OF DISCLOSURE
[0003] The following description of related art is intended to provide
background information pertaining to the field of the disclosure. This section may include certain aspects of the art that may be related to various features of the present disclosure. However, it should be appreciated that this section be used only to enhance the understanding of the reader with respect to the present disclosure, and not as admissions of prior art.
[0004] Radiology is a branch of medicine that uses an imaging technology
for diagnosing and treating diseases. It consists of procedures (exams/tests) such as X-rays, Computed Tomography (CT), Magnetic Resonance Imaging (MRI), nuclear medicine, Positron Emission Tomography (PET), ultrasound, and so forth. However, in some areas, there may be a shortage of radiologists with specialized expertise. Moreover, traditional radiology services may have limited hours of
operation. Also, in traditional radiology, there may be delays in a delivery of radiology reports, especially in remote or rural areas. Further, establishing and maintaining a radiology department with all necessary equipment can be costly. Therefore, to overcome the aforementioned issues, a tele-robotic radiology has been introduced. In a first conventional approach, medical robots such as robotic systems have been used in the radiology for imaging procedures or interventions. Such medical robots have a potential to enhance the field of radiology. While these medical robots offer various advantages; however, they also have some drawbacks and limitations.
[0005] As an example, the robotic systems such as, the da Vinci Surgical
System have been used in the radiology for minimally invasive procedures. However, these systems have limitations as they are expensive to purchase, install, and maintain, making them less accessible to many healthcare facilities. Secondly, surgeons and radiologists need specialized training to effectively operate and utilize capabilities of the robotic systems. The learning curve can be steep, requiring dedicated time and resources for proficiency.
[0006] Further, in another conventional approach, the Universal Robot
UR5e, a robotic arm known for its precision and flexibility, represents a critical component in an automation of tasks including those in the medical field. Control elements such as “Teach Pendant” allow for user-friendly programming and operation of such robotic arms. Moreover, a computing hardware, including Mini-PCs like the AEEON Boxer - 6643-TGU-A2-1010, provides a necessary processing power and interfacing capabilities, while 5G modules such as the Quectel-RM510QGLAA enable a high-speed transmission of data crucial for real-time remote operation. Telecommunication infrastructures for such systems, with services like private network connectivity providing requisite bandwidth and a low latency for seamless data transfer and control signal transmission between a patient and locations of a doctor. Despite the availability of various technologies, it is a significant challenge to integrate these components into a cohesive, reliable, and
user-friendly system that is capable to provide high-quality radiological imaging remotely. Existing solutions often face limitations due to latency, bandwidth constraints, integration complexity, and safety concerns, which can compromise an efficacy and responsiveness of the tele-robotic system.
[0007] Tele-operated or remote-controlled systems allow the radiologists to
control a movement and positioning of imaging devices from a remote location. However, the remote-controlled systems rely on stable and high-bandwidth network connections for real-time transmission of imaging data. Connectivity issues can lead to delays, interruptions, or degraded image quality. The robotic systems used for image-guided interventions, such as robot-assisted biopsies or ablations, have limited degrees of freedom, which can restrict their ability to access certain anatomical regions or perform complex manoeuvres. Robotic interventions may involve complex setup and calibration processes, requiring additional time and resources compared to traditional manual procedures.
[0008] Integrating the robotic systems into existing radiology workflows
and infrastructure can be challenging maneuvers. Compatibility and integration with the existing imaging devices, software, and information systems may require additional hardware or software modifications. Ensuring seamless communication and interoperability between the robotic systems and the existing systems, such as Picture Archiving and Communication Systems (PACS), Electronic Medical Records (EMRs), or Radiology Information Systems (RIS), can be complex. Addressing these drawbacks requires ongoing research and development to improve the capabilities, usability, and affordability of the medical robots in the radiology. Additionally, regulatory frameworks, standardization efforts, and operator training programs are necessary to ensure safe and effective integration of the robotic systems into a clinical practice.
[0009] Thus, there is a need to overcome the above drawbacks and
limitations in the current practices to provide a tele-robotic radiology equipment that not only adheres to all regulatory frameworks and policies, but also reduces
network latencies, is easy to use, and is compatible with the existing medical systems so that the radiologists can easily use the system to assist their own work.
OBJECTS OF THE PRESENT DISCLOSURE
[0010] Some of the objects of the present disclosure, that at least one
embodiment herein satisfy are as listed herein below.
[0011] It is an object of the present disclosure to overcome the drawbacks
and limitations of the existing systems for tele-robotic radiology.
[0012] It is an object of the present disclosure to combine benefits of
telemedicine, radiology, and robotics to enhance a delivery of healthcare services.
[0013] It is an object of the present disclosure to provide a central console
or a control unit to remotely operate and monitor a robotic system and perform examinations on patients located in different geographical locations.
[0014] It is an object of the present disclosure to encompass a physical
robotic system used for performing imaging procedures or interventions including a robotic arm, manipulators, imaging equipment, and any additional sensors necessary for accurate and precise movements.
[0015] It is an object of the present disclosure to ensure high-speed and low-
latency communication, using a 5G network, between a tele-robotic radiology console and a robotic platform, enabling real-time control and transmission of imaging data.
[0016] It is an object of the present disclosure to use a specialized network
or specialized medical data transfer protocols to ensure reliable and secure transmission of imaging data between a console, a robotic platform, and imaging devices.
[0017] It is an object of the present disclosure to implement encryption
algorithms, secure authentication mechanisms, and data access controls to protect patient information and comply with privacy regulations.
[0018] It is an object of the present disclosure to handle the processing and
analysis of medical images received from a robotic platform using image processing algorithms, which may be used to enhance an image quality, remove artifacts, or perform automated measurements.
[0019] It is an object of the present disclosure to provide a system and
method for conducting tele-robotic radiological procedures using a robotic arm.
[0020] It is an object of the present disclosure to enable real-time interaction
and collaboration between a radiologist and other healthcare professionals involved in a tele-robotic radiology procedure.
[0021] It is an object of the present disclosure to provide a dedicated
network slicing that achieves an ultra-reliable Low Latency (uRLLC) connectivity and is beneficial in operating a robot in real-time with less than ~20ms latency.
[0022] It is an object of the present disclosure to provide a 5G network that
ensures that large size images are transferred instantly and securely.
SUMMARY
[0023] In an exemplary embodiment, a system for conducting tele-robotic
radiological procedures using a robotic arm. The system includes: a processor configured to establish a connection between a user equipment of a medical professional and a robotic system by using a network. The system includes a memory coupled to the processor. The memory is configured to store images captured during a radiological procedure. The system includes a processing engine configured to integrate the robotic system located at a first location with the network; enable a real-time communication between the medical professional and the robotic arm of the robotic system by using the network; enable the medical
professional located at a second location to use a haptic device at the user equipment to control a movement of the robotic arm of the robotic system; receive directional inputs of the medical professional by using the haptic device and transmit the directional inputs in form of physical movements to the robotic arm of the robotic system; enable the robotic arm to mimic the movements of the medical professional in real time based on the directional inputs; and display the captured images of a patient on the user equipment in real time through the network.
[0024] In some embodiments, the network is a fifth generation (5G)
network.
[0025] In some embodiments, the haptic device is associated with a Human
Machine Interface (HMI) of the user equipment to enable the medical professional to communicate with virtual environment for conducting the radiological procedure virtually.
[0026] In some embodiments, the processing engine is configured to enable
the medical professional to complete diagnosis in real-time or asynchronously from the images, upon conducting the tele-robotic radiological procedure virtually.
[0027] In some embodiments, the processing engine is configured to
provide haptic feedback to the medical professional in real-time by using the haptic device while manipulating the robotic arm.
[0028] In some embodiments, the processor is configured to verify one or
more components of the system.
[0029] In some embodiments, the processing engine is configured to display
a complete setup of the patient on the user equipment.
[0030] In some embodiments, the processing engine is configured to
manage power supply and actuation mechanism of the robotic arm.
[0031] In some embodiments, the processing engine is configured to
convert control signal from a robotic arm controller into appropriate signal for an actuator movement.
[0032] In some embodiments, the robotic system comprises a 6-degree-of-
freedom positional sensing robotic arm with a radiological probe and a 3 degree of freedom force feedback to provide feedback when pressed against an object.
[0033] In another exemplary embodiment, a method for conducting tele-
robotic radiological procedures using a robotic arm. The method includes: establishing a connection between a user equipment of a medical professional and a robotic system by using a network; integrating the robotic system located at a first location with the network; enabling a real-time communication between the medical professional and the robotic arm of the robotic system by using the network; enabling the medical professional located at a second location to use a haptic device at the user equipment to control a movement of the robotic arm of the robotic system; receiving directional inputs of the medical professional by using the haptic device and transmitting the directional inputs in form of physical movements to the robotic arm of the robotic system; enabling the robotic arm to mimic the movements of the medical professional in real time based on the directional inputs; and displaying the captured images of a patient on the user equipment in real time through the network.
[0034] In some embodiments, the network is a fifth generation (5G)
network.
[0035] In some embodiments, the haptic device is associated with a Human
Machine Interface (HMI) of the user equipment to enable the medical professional to view virtual environment for conducting the radiological procedure virtually.
[0036] In some embodiments, the method includes enabling the medical
professional to complete diagnosis in real-time or asynchronously from the images, upon conducting the tele-robotic radiological procedure virtually.
5 [0037] In some embodiments, the method includes providing haptic
feedback to the medical professional in real-time by using the haptic device while manipulating the robotic arm.
[0038] In some embodiments, the method includes verifying one or more
10 components of a system.
[0039] In some embodiments, the method includes displaying a complete
setup of the patient on the user equipment.
15 [0040] In some embodiments, the method includes managing power supply
and actuation mechanism of the robotic arm.
[0041] In some embodiments, the method includes converting control signal
from a robotic arm controller into appropriate signal for an actuator movement.
20
[0042] In some embodiments, the robotic system comprises a 6-degree-of-
freedom positional sensing robotic arm with a radiological probe and a 3 degree of freedom force feedback to provide feedback when pressed against an object.
25 [0043] In another exemplary embodiment, a user equipment
communicatively coupled to a system, the coupling comprises steps of: establishing a real-time communication link with a robotic arm over a network; transmitting instructions to the robotic arm based on inputs received from a medical professional to perform movements; controlling the movement of the robotic arm remotely using
30 a haptic device; and displaying real-time images of a patient received from the
robotic arm through the network.
9
[0044] In some embodiments, the network is a fifth generation (5G)
network.
[0045] In some embodiments, the haptic device is used with a Human
5 Machine Interface (HMI) of the user equipment to enable the medical professional
to view virtual environment for conducting the radiological procedure virtually.
[0046] In some embodiments, the coupling includes receiving haptic
feedback from the robotic arm, providing tactile sensations to the medical
10 professional.
[0047] The foregoing general description of the illustrative embodiments
and the following detailed description thereof are merely exemplary aspects of the teachings of this disclosure, and are not restrictive. 15
BRIEF DESCRIPTION OF DRAWINGS
[0048] The accompanying drawings, which are incorporated herein, and
constitute a part of this disclosure, illustrate exemplary embodiments of the
20 disclosed methods and systems in which like reference numerals refer to the same
parts throughout the different drawings. Components in the drawings are not necessarily to scale, emphasis instead being placed upon clearly illustrating the principles of the present disclosure. Some drawings may indicate the components using block diagrams and may not represent the internal circuitry of each
25 component. It will be appreciated by those skilled in the art that disclosure of such
drawings includes the disclosure of electrical components, electronic components or circuitry commonly used to implement such components.
[0049] FIG. 1A illustrates an exemplary system for conducting tele-robotic
30 radiological procedures, in accordance with an embodiment of the present
disclosure;
10
[0050] FIG. 1B illustrates a block diagram of components of the system, in
accordance with an embodiment of the present disclosure;
[0051] FIG. 1C illustrates a functional diagram of a robotic arm controller
5 and a controlling method, in accordance with an embodiment of the present
disclosure;
[0052] FIG. 1D illustrates a custom designed radiology equipment probe
gripper, in accordance with an embodiment of the present disclosure; 10
[0053] FIG. 2 illustrates an exemplary block diagram of the system, in
accordance with an embodiment of the present disclosure;
[0054] FIG. 3 illustrates an exemplary flow diagram of a process for
15 conducting tele-robotic radiology, in accordance with an embodiment of the present
disclosure;
[0055] FIGS. 4A and 4B illustrate a use case scenario for conducting the
tele-robotic radiology procedure, in accordance with an embodiment of the present
20 disclosure;
[0056] FIG. 5 illustrates an exemplary block diagram of a computer system
in which or with which embodiments of the present disclosure can be utilized, in accordance with an embodiment of present disclosure; and 25
[0057] FIG. 6 illustrates a flowchart of a method for executing a tele-robotic
radiological procedure utilizing a robotic arm, in accordance with an embodiment of present disclosure.
30 [0058] The foregoing shall be more apparent from the following more
detailed description of the disclosure.
11
LIST OF REFERENCE NUMERALS
100 - System
102 - Patient Side System
104 - Centralized Server 5 106-1, 106-2…106-N - User Equipment
108 - Network
110-1, 110-2…110-N - Users
112 - Robotic System
114 - Robotic Arm 10 116 - Human Machine Interface
118 - Robotic Arm Controller
120 - Haptic Sensor
122 - Haptic Force Controller
124 - Joystick Motor 15 126 - Control Domain
128 - Haptic Force
130 - Haptic Device
132 - Joystick Position
134 - Functional Diagram 20 136 - Admittance Control
138 - Gripper
200 - Block Diagram
202 -Processor(s)
204 - Memory 25 206 - A Plurality of Interfaces
208 - Processing Engine
210 - Database
212 - Communication Module
214 - Motion Capturing Module 30 216 - Output Module
12
300 – Process
400A – Use Case Scenario
400B – Ultrasounds
500 – Computer System
5 510 – External Storage Device
520 – Bus
530 – Main Memory
540 – Read Only Memory
550 – Mass Storage Device
10 560 – Communication Port
570 – Processor 600 – Method
DETAILED DESCRIPTION OF DISCLOSURE
15 [0059] In the following description, for the purposes of explanation,
various specific details are set forth in order to provide a thorough understanding of embodiments of the present disclosure. It will be apparent, however, that embodiments of the present disclosure may be practiced without these specific details. Several features described hereafter can each be used independently of one
20 another or with any combination of other features. An individual feature may not
address all of the problems discussed above or might address only some of the problems discussed above. Some of the problems discussed above might not be fully addressed by any of the features described herein.
25 [0060] The ensuing description provides exemplary embodiments only and
is not intended to limit the scope, applicability, or configuration of the disclosure. Rather, the ensuing description of the exemplary embodiments will provide those skilled in the art with an enabling description for implementing an exemplary embodiment. It should be understood that various changes may be made in the
13
function and arrangement of elements without departing from the spirit and scope of the disclosure as set forth.
[0061] Specific details are given in the following description to provide a
5 thorough understanding of the embodiments. However, it will be understood by one
of ordinary skill in the art that the embodiments may be practiced without these
specific details. For example, circuits, systems, networks, processes, and other
components may be shown as components in block diagram form in order not to
obscure the embodiments in unnecessary detail. In other instances, well-known
10 circuits, processes, algorithms, structures, and techniques may be shown without
unnecessary detail to avoid obscuring the embodiments.
[0062] Also, it is noted that individual embodiments may be described as a
process that is depicted as a flowchart, a flow diagram, a data flow diagram, a
15 structure diagram, or a block diagram. Although a flowchart may describe the
operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be re-arranged. A process is terminated when its operations are completed but could have additional steps not included in a figure. A process may correspond to a method, a function, a
20 procedure, a subroutine, a subprogram, etc. When a process corresponds to a
function, its termination can correspond to a return of the function to the calling function or the main function.
[0063] The word "exemplary" and/or "demonstrative" is used herein to
25 mean serving as an example, instance, or illustration. For the avoidance of doubt,
the subject matter disclosed herein is not limited by such examples. In addition, any
aspect or design described herein as "exemplary" and/or "demonstrative" is not
necessarily to be construed as preferred or advantageous over other aspects or
designs, nor is it meant to preclude equivalent exemplary structures and techniques
30 known to those of ordinary skill in the art. Furthermore, to the extent that the terms
"includes," "has," "contains," and other similar words are used in either the detailed description or the claims, such terms are intended to be inclusive like the term
14
"comprising" as an open transition word without precluding any additional or other elements.
[0064] Reference throughout this specification to "one embodiment" or "an
5 embodiment" or "an instance" or "one instance" means that a particular feature,
structure, or characteristic described in connection with the embodiment is included
in at least one embodiment of the present disclosure. Thus, the appearances of the
phrases "in one embodiment" or "in an embodiment" in various places throughout
this specification are not necessarily all referring to the same embodiment.
10 Furthermore, the particular features, structures, or characteristics may be combined
in any suitable manner in one or more embodiments.
[0065] The terminology used herein is to describe particular embodiments
only and is not intended to be limiting the disclosure. As used herein, the singular
15 forms "a", "an", and "the" are intended to include the plural forms as well, unless
the context indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other
20 features, integers, steps, operations, elements, components, and/or groups thereof.
As used herein, the term “and/or” includes any combinations of one or more of the associated listed items.
[0066] As used herein, an “electronic device”, or a “portable electronic
25 device”, or a “user device” or a “communication device” or a “user equipment” or
a “device” refers to any electrical, electronic, electromechanical, and computing
device. The user device is capable of receiving and/or transmitting one or
parameters, performing functions, communicating with other user devices, and
transmitting data to the other user devices. The user equipment may have a
30 processor, a display, a memory, a battery, and an input-means such as a hard keypad
and/or a soft keypad. The user equipment may be capable of operating on any radio access technology including, but not limited to, IP-enabled communication, Zig
15
Bee, Bluetooth, Bluetooth Low Energy, Near Field Communication, Z-Wave, Wi-
Fi, Wi-Fi direct, etc. For instance, the user equipment may include, but not limited
to, a mobile phone, a smartphone, virtual reality (VR) devices, augmented reality
(AR) devices, a laptop, a general-purpose computer, a desktop, a personal digital
5 assistant, a tablet computer, a mainframe computer, or any other device as may be
obvious to a person skilled in the art for implementation of the features of the present disclosure.
[0067] Further, the user device may also comprise a “processor” or a
10 “processing unit”, wherein the processor refers to any logic circuitry for processing
instructions. The processor may be a general-purpose processor, a special purpose processor, a conventional processor, a digital signal processor, a plurality of microprocessors, one or more microprocessors in association with a Digital Signal Processor (DSP) core, a controller, a microcontroller, Application Specific
15 Integrated Circuits, Field Programmable Gate Array circuits, any other type of
integrated circuits, etc. The processor may perform a signal coding data processing, an input/output processing, and/or any other functionality that enables a working of a system according to the present disclosure. More specifically, the processor is a hardware processor.
20
[0068] As portable electronic devices and wireless technologies continue to
improve and grow in popularity, advancing wireless technologies for data transfer are also expected to evolve and replace older generations of technologies. In the field of wireless data communications, a dynamic advancement of various
25 generations of cellular technology are also seen. The development, in this respect,
has been incremental in the order of second generation (2G), third generation (3G), fourth generation (4G), and now fifth generation (5G), and more such generations are expected to continue in the forthcoming time.
30 [0069] While considerable emphasis has been placed herein on the
components and component parts of the preferred embodiments, it will be
16
appreciated that many embodiments can be made and that many changes can be
made in the preferred embodiments without departing from the principles of the
disclosure. These and other changes in the preferred embodiment as well as other
embodiments of the disclosure will be apparent to those skilled in the art from the
5 disclosure herein, whereby it is to be distinctly understood that the foregoing
descriptive matter is to be interpreted merely as illustrative of the disclosure and not as a limitation.
[0070] Various embodiments throughout the disclosure will be explained in
10 detail with reference to FIGS. 1-6.
[0071] FIG. 1A illustrates an exemplary system (100) for conducting tele-
robotic radiological procedures, in accordance with embodiments of the present disclosure. In an embodiment, the system (100) may be implemented for improving
15 access to diagnostic services in an underserved or remote areas and may facilitate
timely detection, diagnosis, and treatment of various medical conditions. In such embodiment, the medical conditions may be, but not limited to, fractures, tumors, stroke, kidney stones, and so forth. The system (100) may be configured to enable medical professionals (110) to remotely control radiology equipment and perform
20 examinations on patients located in different geographical locations. In such
embodiment, the radiology equipment may be, but not limited to, X-ray machine, Computed Tomography (CT) scanner, Magnetic Resonance Imaging (MRI), ultrasound machines, nuclear medicine cameras, and so forth.
25 [0072] The system (100) may include a patient side system (102), a
centralized server (104), and one or more computing devices/user equipment (106-1, 106-2, … 106-N) (hereinafter collectively referred to as the user equipment (106) and individually referred to as the user equipment (106) in an environment. In an embodiment, the patient side system (102), the centralized server (104), and the
30 user equipment (106) may be connected to each other through a network (108).
17
[0073] In an embodiment, the patient side system (102) may represent a
setup that integrates various components to enable remote medical procedures. The
patient side system (102) may include a robotic system (112) (as shown in FIG.
1B). The robotic system (112) may include various components that may be
5 explained in detail in the FIG. 1B. The robotic system (112) may allow the medical
professional (110) to perform precise and controlled actions on the patient from a remote location.
[0074] In an exemplary embodiment, the centralized server (104) may
10 include, by way of example, but not limited to, one or more of: a stand-alone server,
a server blade, a server rack, a bank of servers, a server farm, a hardware supporting
a part of a cloud service or system, a home server, a hardware running a virtualized
server, one or more processors executing code to function as a server, one or more
machines performing server-side functionality as described herein, at least a portion
15 of any of the above, some combination thereof. In an embodiment, the centralized
server (104) may be connected with a database (210) (as shown in FIG. 2) to receive information from a doctor side and a patient side.
[0075] Referring to the FIG. 1A, each of the user equipment (106) may be
20 associated with one or more users (110-1, 110-2, … 110-N) (collectively referred
as the users (110) and individually referred to as the user (110), herein). In an
embodiment, the user (110) and the medical professional (110) may be used
interchangeably. In an exemplary embodiment, the user equipment (106)
establishes a real-time communication link with a robotic arm (114) (as shown in
25 FIG. 1B) over the network (108). Further, the user equipment (106) also transmits
instructions to the robotic arm (114) based on inputs received from the medical
professional (110) to perform movements. The user equipment (106) also controls
the movement of the robotic arm (114) remotely using a haptic device (130) (as
shown in the FIG. 1B). The user equipment (106) also receives haptic feedback
30 from the robotic arm (114) and provides tactile sensations to the medical
18
professional (110). Further, the user equipment (106) also displays real-time images of a patient received from the robotic arm (114) through the network (108).
[0076] The user equipment (106) may be, but not limited to, personal
5 computers, laptops, tablets, wristwatches, or any custom-built computing device
integrated within a modern diagnostic machine that can connect to the network (108) as an IoT (Internet of Things) device. In an aspect, the user (110) may be, but not limited to, the medical professional (110), an operator assistance, a patient assistant, and so forth. 10
[0077] In an exemplary embodiment, the network (108) may include, but
not limited to, at least a portion of one or more networks having one or more nodes that transmit, receive, forward, generate, buffer, store, route, switch, process, or a combination thereof, etc. one or more messages, packets, signals, waves, voltage or
15 current levels, and so forth. In an exemplary embodiment, the network (108) may
be, but not limited to, a wireless network, a wired network, the internet, an intranet, a public network, a packet-switched network, a circuit-switched network, an ad hoc network, an infrastructure network, a Public-Switched Telephone Network (PSTN), a cable network, a cellular network, a satellite network, a fiber optic network, or a
20 combination thereof. In a preferred exemplary embodiment, the network (108) may
be a private network such as the fifth generation (5G) network.
[0078] FIG. 1B illustrates a block diagram of components of the system
(100), in accordance with an embodiment of the present disclosure. The block
25 diagram is illustrating how various components of the system (100) may interact to
enable a remote operation of a robotic arm (114) of the robotic system (112) for the radiological procedures using the 5G network (108). In an embodiment, the components of the system (100) may be, the user equipment (106) having the Human Machine Interface (HMI) (116), the robotic system (112), a robotic arm
30 controller (118), a haptic sensor (120), a haptic force controller (122), a joystick
motor (124) and a control domain (126). In an embodiment, the 5G network (108)
19
may provide high-speed, low-latency communication infrastructure that enables
seamless communication between the robotic system (112) and the user equipment
(106) of the medical professional (110), allowing for real-time control and
feedback.
5
[0079] As used herein, the HMI (116) may refer to an interface through
which the medical professional (110) may interact with the robotic system (112).
The HMI (116) may enable the medical professional (110) to provide the
instructions for diagnosing and operating the patient remotely. In an aspect, the
10 HMI (116) may be, but not limited to, a touchscreen interface, a control panel, a
joystick, a gesture control, and so forth that may allow the medical professional
(110) to control the robotic arm (114) and a radiological probe.
[0080] In an embodiment, the robotic arm controller (118) may be a device
15 or system that controls a movement and operation of the robotic arm (114). The
robotic arm controller (118) may receive the instructions from the HMI (116) and
translate them into the movements of the robotic arm (114). In an embodiment, the
haptic sensor (120) may detect forces and sensations experienced by the robotic
arm (114) and provide feedback to the haptic force controller (122) to adjust the
20 haptic feedback provided to the medical professional (110). As used herein, the
haptic feedback may refer to a haptic force (128) felt by the medical professional (110) when interacting with the robotic arm (114) through the HMI (116).
[0081] In an embodiment, the haptic force controller (122) may control the
25 haptic feedback provided to the medical professional (110) through the haptic
device (130), ensuring that the medical professional (110) feels the appropriate
forces and sensations while manipulating the robotic arm (114). Further, in an
embodiment, the joystick motor (124) may control movements of the haptic device
(130) such as joystick in response to the instruction of the medical professional
30 (110). In an aspect, the joystick motor (124) may translate the instructions of the
medical professional (110) into physical movements of the joystick. In an aspect, the medical professional (110) may utilize a physical position of the joystick
20
(referred to as a joystick position) (132), to control the movement of the robotic arm (114).
[0082] Further, the control domain (126) may be a network or a system
5 architecture that facilitates communication between the various components of the
robotic system (112), including the HMI (116), the robotic arm controller (118) and the haptic sensor (120).
[0083] In an exemplary embodiment, the HMI (116) may be provided for
10 the medical professional (110) such as, the doctor to interact with the robotic system
(112) and set controls with the haptic force controller (122). Further, the doctor may
use the joystick motor (124) for applying the haptic force (128) with any particular
joystick position (132) depending on the requirement. The joystick may be
connected to the robotic arm controller (118) that operates on the patient, in an
15 embodiment. Therefore, the doctor may operate the robotic system (112) and the
robotic arm controller (118) remotely using the 5G core network (108) to minimize
latency and provide full control to the doctor for administration purposes. In an
embodiment, a camera (not shown) may be provided to capture the real-time images
of the organs of the patient for the medical professional (110) to monitor in real-
20 time.
[0084] In an exemplary embodiment, the system (100) is capable of several
applications such as performing ultrasound remotely over the 5G network (108), a latency < 20 ms, real time operations using 5G uRLLC (less than 25ms), a seamless
25 Machine to Machine (M2M) communication, and a Quality of Service (QoS) for
critical care applications among others. uRLLC stands for Ultra-Reliable and Low-Latency Communications. It is a communication concept and technology defined by 5th generation (5G) wireless network standards. The Tele Ultrasound comprises a robotics set at a patient’s end and a Haptic Setup at a doctor’s end. The data is
30 transferred over a cloud. The robotic system (112) (consists of the robotic arm (114)
21
and some required components enclosed in the provided casing and plus a charging adapter).
[0085] In an exemplary embodiment, on the patient’s side, there is a mini-
5 PC, the 5G network (108) in an in-built module, a webcam, a power, Universal
Standard Bus (USB) cables and High-Definition Multimedia Interface (HDMI) cables for corresponding devices. In the robotic system (112), the controller, a teach pendant, a 48V battery, a battery charger, a trolley and casing, Miniature Circuit Breakers (MCBs) and internal wiring, and a 3D printed gripper (to hold the probe)
10 (138). At the doctor’s side, there is a PC/Laptop (including CPU, monitor, and
mouse), the Haptic device (130) with a USB cable and a power cable, a 5g Connection, the power, the USB and HDMI cables for corresponding devices, a dedicated private stream with on-prem 5G network set (User Plane Function (UPF), a Multi-access Edge Computing (MEC), a Unified Data Management (UDM),
15 gNodeB (gNB), 5G Core Control Plane (5GC CP)) for high throughput and low
latency at the patient’s end.
[0086] In an embodiment, the 5G network (108) with the integrated robotic
system (112) provides ultra-fast data transmission speeds, enabling real-time
20 communication and seamless data exchange between the user equipment (106) of
the medical professional (110) and the robotic arm controller (118). This high-speed connectivity ensures minimal latency, facilitating instantaneous control and feedback during the radiology procedures. The 5G network (108) offers low latency, reducing a delay between commands of the medical professional (110) and
25 a response of the robotic arm (114). This near-real-time interaction enables precise
control of the robotic arm (114), enhancing procedural accuracy and reducing a risk of errors. 5G networks (108) are designed to provide highly reliable connections, minimizing signal disruptions and maintaining stable communication throughout the procedure. This reliability is crucial for the system (100), as any interruptions
30 in the connection could impact the medical professional’s (110) control and
compromise the patient’s safety. The 5G network (108) offers increased bandwidth capacity, allowing for the seamless transmission of large amounts of data in real-
22
time. This is particularly important in radiology, where high-resolution imaging
data, such as the CT scans or ultrasound images, need to be transmitted quickly and
efficiently between the medical professional (110) and the robotic arm (114) with
a reduced latency of less than 20 microseconds.
5
[0087] FIG. 1C illustrates a functional diagram (134) of the robotic arm
controller (118) and a controlling method, in accordance with an embodiment of
the present disclosure. The functional diagram (134) comprises the HMI (116) for
sending instructions to an admittance control (136) and the robotic arm controller
10 (118) for performing specific operations. The robotic arm controller (118) may be
a part of the robotic system (112) that uses the haptic sensor (120) to diagnose or operate on the patient depending on the instruction provided directly from the HMI (116). In an embodiment, various forces depend on control parameters provided in a first place. The haptic sensor (120) is designed to accurately measure the forces
15 applied along different axes, typically in three dimensions (x, y, and z). The haptic
sensor (120) can measure both static forces (constant forces) and dynamic forces
(changing forces over time) and is also capable of measuring torques or rotational
forces around different axes. This is important in applications where both force and
rotational force information is required.
20
[0088] FIG. 1D illustrates a custom-designed radiology equipment probe
gripper (138) in accordance with an embodiment of the present disclosure. In an
embodiment, the gripper (138) in the radiology procedures may be used to securely
hold and manipulate probes or sensors. The gripper (138) may be designed to
25 provide precise control and stability while ensuring safe and accurate positioning
of the probe during imaging or interventional procedures. The gripper (138) may employ a mechanism specifically designed to securely hold and release the probe. This mechanism may involve jaws, clamps, or specialized gripping surfaces that can adapt to different probe sizes and shapes. In an embodiment, the gripper (138)
30 also provides an adjustable grip force to accommodate the different probes or
sensors with varying sizes, weights, and handling requirements, which allows an operator to optimize a grip strength for each specific application. The gripper (138)
23
may be compatible with probes or the sensors used in radiology applications. The
gripper (138) may also be designed to securely hold and manipulate a particular
shape, size, and connection mechanism of the probe. The gripper (138) can also be
developed based on specific requirements and considerations of the radiology
5 procedures and the probes used.
[0089] FIG. 2 illustrates an exemplary block diagram (200) of the system
(100), in accordance with an embodiment of the present disclosure. The system (100) may be capable to perform complex medical procedures remotely with the
10 aid of a robotic technology and high-speed communication networks. The system
(100) includes various modules such as, a processor (202), a memory (204), an interface (206), a processing engine (208) and a database (210). Further, the processing engine (208) includes a communication module (212), a motion capturing module (214) and an output module (216).
15
[0090] The processor (202) may be configured to verify components of the
system (100) to ensure an accuracy of sensor readings and responsiveness of actuator control, thereby establishing a stable connection between the user equipment (106) of the medical professional (110) and the robotic arm (114). The
20 processor (202) forms the brain of the system (100), executes instructions necessary
to carry out tele-robotic operations. Further, in an embodiment of the present invention, the processor (202) may be configured to drive the actuators of the robotic arm (114) by using motor control units. The processor (202) may receive commands from the robotic arm controller (118) and converts the commands into
25 appropriate control signals to drive motors and achieve a desired robotic arm (114)
movement. Algorithms may be used to calculate inverse and forward kinematics of the robotic arm (114), translating desired end effector positions into joint angles and vice versa. They can also consider the dynamics of the robotic arm (114) to ensure smooth and accurate movements. The processor (202) may utilize the
30 feedback from the sensors to implement a closed-loop control. The processor (202)
may continuously compare the desired position of the robotic arm (114) or force
24
with the actual measurements and adjust the control signals accordingly to
minimize errors and achieve precise control. The processor (202) protects both the
robotic arm (114) and the surrounding environment by using software limits,
obstacle detection, and emergency stop features. The processor (202) provides real-
5 time feedback and control over the robotic arm (114), enabling the accurate and
precise movements during the tele-robotic radiology procedures.
[0091] The memory (204) may be coupled to the processor (202) and serves
as a repository for storing the images captured from the camera during the
10 radiological procedures. The processor (202) receives input commands from the
memory (204) and translates the input commands into appropriate control signals
for actuators of the robotic arm (114). The memory (204) allows for quick access
and retrieval of patient data and the images, facilitating real-time analysis and
keeping long-term record.
15
[0092] The interface (206) may include hardware and software components
for displaying information for the medical professional (110) to perform real-time
control and monitoring of the robotic arm (114). The interface (206) may include
receiving and processing the feedback that enables the medical professional (110)
20 to perform movements remotely based on the received feedback. Further, the
interface (206) is translating the inputs of the medical professional (110) into
actions to be executed by the robotic arm (114), ensuring that the robotic arm (114)
replicates the precise movements intended by the medical professional (110).
25 [0093] The processing engine (208) within the system (100) is an epicenter
for facilitating smooth operation and precise control of the robotic arm (114). In an embodiment, the processing engine (208) may also be responsible for managing power supply and actuation mechanisms of the robotic arm controller (118) which may ensure reliable and precise control over the movements of the robotic arm
30 (114). In an example, a power supply component provides a necessary electrical
power to the robotic arm (114) and its associated components. The power supply component includes power distribution units, voltage regulators, and power
25
management systems to ensure stable and reliable power delivery. Further, in an
example, an actuator control component converts the control signals from the
robotic arm controller (118) into appropriate signals for an actuator movement. The
actuator control component includes motor controllers or driver circuits that drive
5 the actuators, such as electric motors, hydraulic systems, or pneumatic systems. The
actuator control component ensures precise and accurate actuation of the robotic arm (114). The actuation mechanisms may physically convert electrical signals into mechanical motion. They can include motors, gears, belts, hydraulics, or pneumatics, depending on the design of the robotic arm (114). These mechanisms
10 provide the necessary force and motion for the joints of the robotic arm (114) and
the end effector. Feedback sensors may be used to monitor the position, velocity, and force of the actuators of the robotic arm (114). Encoders, potentiometers, or other sensors provide feedback on the actuator's performance, enabling closed-loop control and precise positioning. The feedback data is used to ensure accurate and
15 reliable movements of the robotic arm (114). The power component and the
actuator component may provide consistent and reliable power delivery and uninterrupted functioning of the robotic arm (114) during the medical procedures, respectively. The processing engine (208) encompasses various modules that work in concert to deliver a seamless tele-robotic experience.
20
[0094] In an embodiment, the communication module (212) may be
configured to integrate hardware or the robotic system (112) with the network
(108). The communication module (212) may provide a secure and efficient
communication channel that is foundational for conducting telerobotic radiological
25 procedures.
[0095] The communication module (212) may be coupled to the processor
(202), to establish the real-time machine-to-machine (M2M) communication link
between the user equipment (106) of the medical professional (110) and the robotic
30 arm (114) of the robotic system (112) by using the network (108). In other words,
the communication module (212) may be configured to leverage the network (108)
26
with low latency, which is essential in maintaining a continuous and instantaneous exchange of information between the medical professional (110) and the robotic arm (114).
5 [0096] In an embodiment, the communication module (212) may be
configured to facilitate seamless and reliable communication between the medical professional (110) and the robotic arm (114). The communication module (212) may enable transmission of control commands from the medical professional (110) to the robotic arm (114) and the feedback data from the robotic arm (114) to the
10 medical professional (110). In an embodiment, the communication module (212)
may enable the medical professional (110) to use the haptic device (130) at the user equipment (106) to control the movement of the robotic arm (114). In such embodiment, the haptic device (130) may be used with the HMI (116) of the user equipment (106) to enable the medical professional (110) to view the virtual
15 environment for conducting the radiological procedure virtually. In an embodiment,
the feedback may be haptic feedback provided to the medical professional (110) in real time by using the haptic device (130) while manipulating the robotic arm (114).
[0097] The communication module (212) may establish a network
20 connectivity between the user equipment (106) of the medical professional (110)
and the robotic arm controller (118) and handles the transmission of data. The
communication module (212) may utilize wired or wireless communication
technologies depending on the specific system requirements. It ensures an efficient
and reliable transfer of the control commands, sensor data, and other relevant
25 information. The communication module (212) implements communication
protocols to facilitate data exchange. In an example, the communication module
(212) may utilize standard protocols such as, but not limited to, a Transmission
Control Protocol (TCP)/ Internet Protocol (IP) or custom protocols designed
specifically for the tele-robotic radiology system (100). The communication
30 module (212) handles formatting, packaging, and parsing of messages to ensure
accurate and synchronized communication. In the tele-robotic applications,
minimizing latency is crucial to maintaining real-time control and the feedback.
27
The communication module (212) is configured to manage the latency and optimize
the data transmission for low-latency operation. This may involve techniques such
as prioritization of the control commands, data compression, or the use of high¬
speed communication protocols. The communication module (212) may
5 incorporate encryption and security measures to protect data privacy and integrity
and may also include error detection and recovery mechanisms to handle packet loss, network disruptions, or communication errors.
[0098] In an embodiment, the motion capturing module (214) may be
10 configured to receive directional inputs from the medical professional (110) by
using the haptic device (130). The motion-capturing module (214) may be
configured to transmit the directional inputs in the form of movements to the robotic
arm (114) of the robotic system (112) over the network (108). The motion capturing
module (214) may be configured to enable the robotic system (112) to receive the
15 directional inputs and translate into physical movements of the robotic arm (114),
effectively creating an extension of the medical professional’s (110) own movements at a distance.
[0099] Further, in an embodiment, the motion capturing module (214) may
20 be configured to enable the robotic arm (114) to mimic the movements of the
medical professional (110) in real time based on feedback from the haptic device
(130). In such embodiment, the motion capturing module (214) may be configured
to enable the robotic arm (114) to mimic the movements of the medical professional
(110) by using the actuators and the motors of the robotic system (112).
25
[00100] The output module (216) may be configured to display the captured
images and a complete setup of the patient on the user equipment (106) in real time
through the network (108), so that the medical professional (110) may review the
28
images and other feedback from the procedure to perform remote diagnosis and decision making.
[00101] In an embodiment, safety features may also be included in the
5 system (100) to ensure safe operation of the robotic arm (114). The system (100)
includes emergency stop buttons, limit switches, or torque sensors that detect
excessive forces and trigger safety protocols. Safety measures are implemented to
protect the robotic arm (114), the medical professional (110), and the surrounding
environment. Temperature and environmental sensors may be incorporated to
10 monitor ambient conditions during the radiology procedures. The information can
be important for ensuring proper functioning of the robotic arm (114) and stability of sensitive components without exposure to extreme temperatures.
[00102] The database (210) may be integrated with the system (100) to store
15 and manage the information. The database (210) may securely archives the data
which includes patient records, procedural images, and operational logs, ensuring data integrity and availability for future reference and analysis.
[00103] FIG. 3 illustrates an exemplary flow diagram of a process (300) for
20 conducting the tele-robotic radiology, in accordance with an embodiment of the
present disclosure. In an embodiment, the process (300) prepares the tele-robotic
radiology system (100), including the robotic arm (114), imaging equipment, and
the communication infrastructure. The power on the system (100) is turned on and
ensures all the components are functioning properly. The process (300) includes a
25 step of establishing the network connectivity between the user equipment (106) of
the medical professional (110) and the robotic arm (114). The process (300)
includes setting up the user equipment (106) of the medical professional (110) with
a necessary software and the user interface for controlling the robotic arm (114) and
ensuring the medical professional (110) has access to relevant patient data, imaging
30 tools, and controls required for the radiology procedure. In an embodiment, an
administrator may position the patient appropriately for the radiology procedure
29
and can also calibrate and adjust the imaging equipment, such as X-ray detectors or ultrasound transducers, based on the patient’s anatomy and desired imaging views.
[00104] In an embodiment, once the positions are secured, a secure and
5 reliable communication link between the user equipment (106) of the medical
professional (110) and the robotic arm (114) is established. The process (300) includes performing system (100) checks to ensure the proper sensor readings, the actuator control, and the communication. The administrator uses an interface of the robotic arm controller (118) or the haptic device (130) to manipulate the robotic
10 arm (114) remotely. The administrator controls the movements of the robotic arm
(114) and positioning to perform the required radiology procedure, such as positioning the imaging probe, adjusting the field of view, or performing interventional tasks. It collaborates with other medical professionals (110) involved in the procedure, providing them with the necessary information and coordinating
15 actions as needed.
[00105] In an exemplary embodiment, at the patient's end, the process (300)
begins with a step (302) of verifying the power supply and connectivity, followed by a step (304) of powering the robotic system (112) and the camera. It ensures that
20 the robotic arm (114) and its accompanying systems are fully operational and ready
for the procedure. At a doctor's end, the process (300) includes a step (306) of connecting the haptic device (130), followed by a step (308) of allowing the medical professional (110) to log in to a user interface and maneuver the haptic device (130) in response to the captured images. Further, the process (300) includes a step (310)
25 of enabling the operator to press indicators to move the robotic arm (114) in the
desired direction. In an aspect, the robotic arm (114) is equipped with 6 degrees of freedom positional sensing, allowing it to detect position and orientation in space.
[00106] Further, the process (300) includes a step (312) of enabling the
30 medical professional (110), such as the doctor, to move the haptic device (130) in
directions to capture a range of movements based on a live communication feed.
The process (300) also includes a step (314) of enabling the medical professional
30
(110) located at another location to move the haptic device (130) towards an
affected organ of the patient to intuitively move the robotic arm (114) in such
direction. The haptic device (130) provides force feedback to the medical
professional (110), allowing the medical professional (110) to control the robotic
5 arm (114) with precision. The process (300) includes a step (316) of transmitting
sound waves to capture 2D images of the organs when the robotic arm (114) is moved toward the affected organ of the patient. The images are transmitted to the medical professional (110) for analysis. The process (300) includes a step (318) of providing a live transmission of the entire patient setup that may be captured by
10 using the camera to a screen of the medical professional (110) with negligible delay
using the private 5G network (108). The camera may be attached to the robotic arm (114) to continuously monitor the feedback from the sensors of the robotic arm (114) and the imaging equipment and makes necessary adjustments to the movements of the robotic arm (114), positioning, or imaging parameters based on
15 the real-time feedback to ensure accurate and optimal results. The process (300)
includes a step (320) of enabling the medical professional (110) to complete the diagnosis in real-time or asynchronously, upon conducting the procedure virtually.
[00107] FIGS. 4A and 4B illustrate a use case scenario (400A) for conducting
20 the tele-robotic radiology procedure, in accordance with an embodiment of the
present disclosure. Referring to the FIG. 4A, a use case scenario (400A) of a needle
biopsy using the system (100) is disclosed. For example, the needle biopsy is a
minimally invasive procedure used to collect tissue samples from suspicious or
abnormal areas within a body for diagnostic purposes. The administrator needs to
25 prepare the tele-robotic radiology system (100), including the robotic arm (114),
the imaging equipment, and the communication infrastructure. The administrator
can power on the system (100) and ensure all components are functioning properly
and also establish the network connectivity between the user equipment (106) of
the medical professional (110) and the robotic arm (114).
30
31
[00108] The administrator can also set up the user equipment (106) of the
medical professional (110) with the necessary software and the user interface for
controlling the robotic arm (114) and ensure access to the relevant patient data, the
imaging tools, and controls required for the biopsy procedure. The administrator
5 can position the patient appropriately based on a target area for the biopsy and
calibrate or adjust the imaging equipment, such as the ultrasound transducers or CT scanners, to visualize the target area. The system (100) establishes a secure and reliable communication link between the the user equipment (106) of the medical professional (110) and the robotic arm (114) and also performs system (100) checks
10 to ensure the proper sensor readings, the actuator control, and the communication.
The operator uses the interface of the robotic arm controller (118) to remotely manipulate the robotic arm (114) and visualize the target area using the imaging feedback from the sensors of the robotic arm (114) or the imaging equipment. It controls the movements of the robotic arm (114) to position a needle accurately at
15 the target area under real-time imaging guidance.
[00109] In an embodiment, a next step in the needle biopsy is to guide the
robotic arm (114) to position the needle accurately using the imaging feedback. The system (100) activates a needle deployment mechanism to insert the needle into the
20 target area. It also collects the tissue samples using the needle and retract it once
the samples are obtained. There is real-time feedback and adjustment by continuously monitoring the imaging feedback and adjusting the movements of the robotic arm (114) if necessary for optimal needle placement and sample collection. The system (100) also enables collaborating with other medical professionals (110),
25 such as radiologists or pathologists, to ensure the accuracy and adequacy of the
collected tissue samples. For procedure completion and evaluation, the system (100) verifies the completion of the biopsy procedure and also evaluates a quality of the obtained samples and the success of the procedure. Once the radiology procedure is completed, the administrator also needs to ensure the proper
30 positioning of the patient and the system (100) while evaluating the quality of the
obtained images and the success of the procedure. The administrator can safely
32
power off the system (100), disconnect the user equipment (106) of the medical professional (110) from the robotic arm (114), and ensure proper disposal of the collected tissue samples.
5 [00110] As illustrated, in the FIG. 4B, various types of ultrasounds (400B)
covered using the system (100) are disclosed. It includes ultrasounds (400B) of the liver, gall bladder, pancreas, right kidney, spleen and left kidney, and urinary bladder, among others. The system (100) can be easily used to gather the ultrasounds remotely. An ultrasound probe is integrated with the robotic arm (114),
10 allowing it to be maneuvered and positioned accurately under a control of the
medical professional (110). The probe may be equipped with the additional sensors to capture position and orientation information for precise imaging. The ultrasound probe captures the ultrasound images in real-time. The imaging data is processed by the ultrasound system, which generates high-resolution images based on echoes
15 received from the tissues. The captured ultrasound images are compressed and
encoded into a suitable format for transmission over the 5G network (108) which ensures efficient data transfer without compromising the quality of the images. The encoded ultrasound images are transmitted over the 5G network (108) in real-time. The high-speed and low-latency capabilities of 5G network (108) enable seamless
20 and near-instantaneous transfer of the imaging data from the robotic arm (114) to
the administrator console/ interface.
[00111] FIG. 5 illustrates an exemplary block diagram of a computer system
(500) in which or with which embodiments of the present invention can be utilized,
25 in accordance with an embodiment of present disclosure.
[00112] As shown in the FIG. 5, the computer system (500) may include an
external storage device (510), a bus (520), a main memory (530), a read only
memory (540), a mass storage device (550), a communication port (560), and the
30 processor (570). A person skilled in the art will appreciate that computer system
(500) may include more than one processor (570) and the communication ports
33
(560). The processor (570) may include various modules associated with embodiments of the present disclosure.
[00113] In an embodiment, the external storage device (510) may be any
5 device that is commonly known in the art such as, but not limited to, a memory
card, a memory stick, a solid-state drive, a hard disk drive (HDD), and so forth.
[00114] In an embodiment, the bus (520) may be communicatively coupled
with the processor(s) (570) with the other memory, storage, and communication
10 blocks. The bus (520) may be, e.g., a Peripheral Component Interconnect (PCI)/PCI
Extended (PCI-X) bus, a Small Computer System Interface (SCSI), a Universal
Serial Bus (USB) or the like, for connecting expansion cards, drives and other
subsystems as well as other buses, such a front side bus (FSB), which connects the
processor (570) to the computer system (500).
15
[00115] In an embodiment, the main memory (530) may be a Random Access
Memory (RAM), or any other dynamic storage device commonly known in the art.
The Read-only memory (540) may be any static storage device(s) e.g., but not
limited to, a Programmable Read Only Memory (PROM) chips for storing static
20 information e.g., start-up or Basic Input/Output System (BIOS) instructions for the
processor (570).
[00116] In an embodiment, the mass storage device (550) may be any current
or future mass storage solution, which may be used to store information and/or
25 instructions. Exemplary mass storage solutions include, but are not limited to, a
Parallel Advanced Technology Attachment (PATA) or a Serial Advanced Technology Attachment (SATA) hard disk drives or solid-state drives (internal or external, e.g., having Universal Serial Bus (USB) and/or Firewire interfaces), one or more optical discs, Redundant Array of Independent Disks (RAID) storage, e.g.,
30 an array of disks (e.g., SATA arrays).
[00117] Further, the communication port (560) may be any of an RS-232 port
for use with a modem-based dialup connection, a 10/100 Ethernet port, a Gigabit
34
or 10 Gigabit port using copper or fiber, a serial port, a parallel port, or other
existing or future ports. The communication port (560) may be chosen depending
on the network (108), such a Local Area Network (LAN), Wide Area Network
(WAN), or any network to which the computer system (500) connects.
5
[00118] Optionally, operator and administrative interfaces, e.g., a display, a
keyboard, a joystick, and a cursor control device, may also be coupled to the bus
(520) to support a direct operator interaction with the computer system (500). Other
operator and administrative interfaces may be provided through network
10 connections connected through the communication port (560). Components
described above are meant only to exemplify various possibilities. In no way should
the aforementioned exemplary computer system (500) limit the scope of the present
disclosure.
15 [00119] FIG. 6 illustrates a method (600) for executing a tele-robotic
radiological procedure utilizing a robotic arm (114), in accordance with an embodiment of present disclosure.
[00120] Step (602) includes establishing a connection between a user
20 equipment (106) of a medical professional (110) and a robotic system (112) by
using a network (108). The step (602) ensures that sensors and actuators of the robotic arm (114) are functioning accurately, providing a necessary groundwork for intricate tasks that follow.
25 [00121] Step (604) includes integrating the robotic system (112) located at a
first location with the network (108).
[00122] Step (606) includes establishing a real-time machine-to-machine
(M2M) communication link between the medical professional (110) and the robotic
30 arm (114) of the robotic system (112) by using the network (108). The effectiveness
of the M2M communication link is used for real-time execution and responsiveness.
35
[00123] Step (608) includes enabling the medical professional (110) located
at a second location to use a haptic device (130) at the user equipment (106) to control a movement of the robotic arm (114) of the robotic system (112).
5 [00124] Step (610) involves receiving directional inputs of the medical
professional (110) by using the haptic device (130) and transmit the directional inputs in form of movements to the robotic arm (114) of the robotic system (112).
[00125] Step (612) includes enabling the robotic arm (114) to mimic the
10 movements of the medical professional (110) in real time based on feedback
received from the haptic device (130). The step (612) translates the directional
inputs of the medical professional (110) into corresponding movements of the
robotic arm (114), effectively creating an extension of the medical professional’s
(110) own movements at a distance.
15
[00126] Step (614) includes displaying captured images of a patient to the
user equipment (106) in real time through the network (108) to maintain a real-time
nature of the procedure.
20 [00127] In an embodiment, the haptic device (130) is used with a Human
Machine Interface (HMI) (116) of the user equipment (106) to enable the medical professional (110) to view virtual environment for conducting the radiological procedure virtually.
25 [00128] In an embodiment, the network (108) is a fifth generation (5G)
network.
[00129] In an embodiment, the method (600) includes a step of enabling the
medical professional (110) to complete diagnosis in real-time or asynchronously,
30 upon conducting the procedure virtually.
36
[00130] In an embodiment, the method (600) includes a step of providing
haptic feedback to the medical professional (110) in real-time by using the haptic device (130) while manipulating the robotic arm (114).
5 [00131] In an embodiment, the method (600) includes a step of verifying one
or more components of a system (100).
[00132] In an embodiment, the method (600) includes a step of displaying a
complete setup of the patient on the user equipment (106).
10
[00133] In an embodiment, the method (600) includes a step of managing
power supply and actuation mechanism of the robotic arm (114).
[00134] In an embodiment, the method (600) includes a step of converting a
15 control signal from a robotic arm controller (118) into appropriate signal for an
actuator movement.
[00135] In an embodiment, the robotic system (112) comprises a 6-degree-
of-freedom positional sensing robotic arm (114) with a radiological probe and a 3
20 degree of freedom force feedback to provide feedback when pressed against any
object.
[00136] It is to be appreciated by a person skilled in the art that various
embodiments of the present disclosure have been elaborated for a tele-robotic
25 radiology system. However, the teachings of the present disclosure are also
applicable to other types of applications as well, and all such embodiments are well within the scope of the present disclosure. However, the system and method for sign language conversion are also equally implementable in other industries as well, and all such embodiments are well within the scope of the present disclosure
30 without any limitation.
[00137] Moreover, in interpreting the specification, all terms should be
interpreted in the broadest possible manner consistent with the context. In
37
particular, the terms "comprises" and "comprising" should be interpreted as
referring to elements, components, or steps in a non-exclusive manner, indicating
that the referenced elements, components, or steps may be present, or utilized, or
combined with other elements, components, or steps that are not expressly
5 referenced. Where the specification claims refer to at least one of something
selected from the group consisting of A, B, C….and N, the text should be interpreted as requiring only one element from the group, not A plus N, or B plus N, etc.
10 [00138] While considerable emphasis has been placed herein on the preferred
embodiment sit will be appreciated that many embodiments can be made and that many changes can be made in the preferred embodiments without departing from the principles of the disclosure. These and other changes in the preferred embodiments of the disclosure will be apparent to those skilled in the art from the
15 disclosure herein, whereby it is to be distinctly understood that the foregoing
descriptive matter is to be implemented merely as illustrative of the disclosure and not as a limitation.
20 ADVANTAGES OF THE INVENTION
[00139] The proposed invention provides a system for efficiently executing
a tele-robotics radiology system.
[00140] The proposed invention provides a system that allows medical
25 professionals to perform procedures remotely, regardless of their physical location
improving rural access to healthcare and efficient emergency care.
[00141] The proposed invention provides a system that provides precise and
controlled movements, allowing for accurate positioning of instruments and
30 imaging devices.
38
[00142] The proposed invention provides a system that provides easy
accessibility and cost-effectiveness for enhanced user comfort and safety while performing a seamless telemedicine integration.
5 [00143] The proposed invention provides a system that enables real-time
imaging feedback, with a high-speed data transfer and a low latency (<20 ms), during a procedure to visualize the procedure and make immediate adjustments based on feedback, ensuring optimal instrument placement and accurate targeting.
10 [00144] The proposed invention provides a system that offers enhanced
dexterity compared to human hands and an efficient M2M connection, allowing for intricate maneuvers and precise control.
[00145] The proposed invention provides a system that can be especially
15 beneficial in complex radiological procedures where fine manipulation is required
with an integrated QoS for critical operations and remote robotic assistance, leading to improved outcomes and reduced procedural risks.
[00146] The proposed invention provides a system that can help reduce user
20 fatigue during lengthy procedures as a robotic arm controller can assist in
minimizing a physical strain associated with performing repetitive motions or maintaining prolonged positions, allowing administrators to focus on the procedure with reduced physical stress.
25 [00147] The proposed invention provides a system that can incorporate
safety features such as collision detection and force feedback mechanisms to help prevent accidental injuries by alerting an administrator or automatically halting robotic arm's movements when potential risks are detected.
39
WE CLAIM:
1. A system (100) for conducting tele-robotic radiological procedure, wherein
the system (100) comprising:
a processor (202) configured to establish a connection between a user equipment (106) of a medical professional (110) and a robotic system (112) by using a network (108);
a memory (204) coupled to the processor (202), and configured to store images captured during a radiological procedure; and a processing engine (208) configured to:
integrate the robotic system (112) located at a first location with the network (108);
enable a real-time communication between the medical professional (110) and a robotic arm (114) of the robotic system (112) by using the network (108);
enable the medical professional (110) located at a second location to use a haptic device (130) at the user equipment (106) to control a movement of the robotic arm (114) of the robotic system (112);
receive directional inputs of the medical professional (110) by using the haptic device (130) and transmit the directional inputs in form of physical movements to the robotic arm (114) of the robotic system (112);
enable the robotic arm (114) to mimic the movements of the medical professional (110) in real time based on the directional inputs; and
display the captured images of a patient on the user equipment (106) in real time through the network (108).
2. The system (100) as claimed in claim 1, wherein the network (108) is a fifth
generation (5G) network.
3. The system (100) as claimed in claim 1, wherein the haptic device (130) is associated with a Human Machine Interface (HMI) (116) of the user equipment (106) to enable the medical professional (110) to communicate with a virtual environment for conducting the radiological procedure virtually.
4. The system (100) as claimed in claim 3, wherein the processing engine (208) is configured to enable the medical professional (110) to complete diagnosis in real-time or asynchronously, upon conducting the tele-robotic radiological procedure virtually.
5. The system (100) as claimed in claim 1, wherein the processing engine (208) is configured to provide haptic feedback to the medical professional (110) in real-time by using the haptic device (130) while manipulating the robotic arm (114).
6. The system (100) as claimed in claim 1, wherein the processor (202) is configured to verify one or more components of the system (100).
7. The system (100) as claimed in claim 1, wherein the processing engine (208) is configured to display a complete setup of the patient on the user equipment (106).
8. The system (100) as claimed in claim 1, wherein the processing engine (208) is configured to manage power supply and actuation mechanism of the robotic arm (114).
9. The system (100) as claimed in claim 1, wherein the processing engine (208) is configured to convert control signal from a robotic arm controller (118) into appropriate signal for an actuator movement.
10. The system (100) as claimed in claim 1, wherein the robotic system (112) comprises a 6-degree-of-freedom positional sensing robotic arm (114) with
a radiological probe and a 3 degree of freedom force feedback to provide feedback when pressed against an object.
11. A method (600) for conducting tele-robotic radiological procedure using a
robotic arm (114), the method (600) comprising:
establishing a connection between a user equipment (106) of a medical professional (110) and a robotic system (112) by using a network (108);
integrating the robotic system (112) located at a first location with the network (108);
enabling a real-time communication between the medical professional (110) and the robotic arm (114) of the robotic system (112) by using the network (108);
enabling the medical professional (110) located at a second location to use a haptic device (130) at the user equipment (106) to control a movement of the robotic arm (114) of the robotic system (112);
receiving directional inputs of the medical professional (110) by using the haptic device (130) and transmitting the directional inputs in form of physical movements to the robotic arm (114) of the robotic system (112);
enabling the robotic arm (114) to mimic the movements of the medical professional (110) in real time based on the directional inputs; and
displaying captured images of a patient on the user equipment (106) in real time through the network (108).
12. The method (600) as claimed in claim 11, wherein the network (108) is a
fifth generation (5G) network.
13. The method (600) as claimed in claim 11, wherein the haptic device (130) is associated with a Human Machine Interface (HMI) (116) of the user equipment (106) to enable the medical professional (110) to communicate with virtual environment for conducting a radiological procedure virtually.
14. The method (600) as claimed in claim 13, comprising a step of enabling the medical professional (110) to complete diagnosis in real-time or asynchronously, upon conducting the tele-robotic radiological procedure virtually.
15. The method (600) as claimed in claim 11, comprising a step of providing haptic feedback to the medical professional (110) in real-time by using the haptic device (130) while manipulating the robotic arm (114).
16. The method (600) as claimed in claim 11, comprising a step of verifying one or more components of a system (100).
17. The method (600) as claimed in claim 11, comprising a step of displaying a complete setup of the patient on the user equipment (106).
18. The method (600) as claimed in claim 11, comprising a step of managing power supply and actuation mechanism of the robotic arm (114).
19. The method (600) as claimed in claim 11, comprising a step of converting a control signal from a robotic arm controller (118) into appropriate signal for an actuator movement.
20. The method (600) as claimed in claim 11, wherein the robotic system (112) comprises a 6-degree-of-freedom positional sensing robotic arm (114) with a radiological probe and a 3 degree of freedom force feedback to provide feedback when pressed against an object.
21. A user equipment (106) communicatively coupled to a system (100), the
coupling comprises steps of:
establishing a real-time communication link with a robotic arm (114) over a network (108);
transmitting instructions to the robotic arm (114) based on inputs received from a medical professional (110) to perform movements;
controlling a movement of the robotic arm (114) remotely using a haptic device (130); and
displaying real-time images of a patient received from the robotic arm (114) through the network (108).
22. The user equipment (106) as claimed in claim 21, wherein the network (108) is a fifth generation (5G) network.
23. The user equipment (106) as claimed in claim 21, wherein the haptic device (130) is used with a Human Machine Interface (HMI) (116) of the user equipment (106) to enable the medical professional (110) to view virtual environment for conducting a radiological procedure virtually.
24. The user equipment (106) as claimed in claim 21, comprising a step of receiving haptic feedback from the robotic arm (114), providing tactile sensations to the medical professional (110).
| # | Name | Date |
|---|---|---|
| 1 | 202321044549-STATEMENT OF UNDERTAKING (FORM 3) [03-07-2023(online)].pdf | 2023-07-03 |
| 2 | 202321044549-PROVISIONAL SPECIFICATION [03-07-2023(online)].pdf | 2023-07-03 |
| 3 | 202321044549-FORM 1 [03-07-2023(online)].pdf | 2023-07-03 |
| 4 | 202321044549-DRAWINGS [03-07-2023(online)].pdf | 2023-07-03 |
| 5 | 202321044549-DECLARATION OF INVENTORSHIP (FORM 5) [03-07-2023(online)].pdf | 2023-07-03 |
| 6 | 202321044549-FORM-26 [13-09-2023(online)].pdf | 2023-09-13 |
| 7 | 202321044549-FORM-26 [05-03-2024(online)].pdf | 2024-03-05 |
| 8 | 202321044549-FORM 13 [08-03-2024(online)].pdf | 2024-03-08 |
| 9 | 202321044549-AMENDED DOCUMENTS [08-03-2024(online)].pdf | 2024-03-08 |
| 10 | 202321044549-Request Letter-Correspondence [03-06-2024(online)].pdf | 2024-06-03 |
| 11 | 202321044549-Power of Attorney [03-06-2024(online)].pdf | 2024-06-03 |
| 12 | 202321044549-Covering Letter [03-06-2024(online)].pdf | 2024-06-03 |
| 13 | 202321044549-CORRESPONDANCE-WIPO CERTIFICATE-07-06-2024.pdf | 2024-06-07 |
| 14 | 202321044549-ENDORSEMENT BY INVENTORS [10-06-2024(online)].pdf | 2024-06-10 |
| 15 | 202321044549-DRAWING [10-06-2024(online)].pdf | 2024-06-10 |
| 16 | 202321044549-CORRESPONDENCE-OTHERS [10-06-2024(online)].pdf | 2024-06-10 |
| 17 | 202321044549-COMPLETE SPECIFICATION [10-06-2024(online)].pdf | 2024-06-10 |
| 18 | Abstract1.jpg | 2024-07-04 |
| 19 | 202321044549-ORIGINAL UR 6(1A) FORM 26-020724.pdf | 2024-07-05 |
| 20 | 202321044549-FORM-9 [01-10-2024(online)].pdf | 2024-10-01 |
| 21 | 202321044549-FORM 18A [04-10-2024(online)].pdf | 2024-10-04 |
| 22 | 202321044549-FORM 3 [07-11-2024(online)].pdf | 2024-11-07 |
| 23 | 202321044549-Proof of Right [08-02-2025(online)].pdf | 2025-02-08 |
| 24 | 202321044549-FER.pdf | 2025-02-25 |
| 25 | 202321044549-ORIGINAL UR 6(1A) FORM 1-270225.pdf | 2025-03-01 |
| 26 | 202321044549-OTHERS [23-04-2025(online)].pdf | 2025-04-23 |
| 27 | 202321044549-FORM 3 [23-04-2025(online)].pdf | 2025-04-23 |
| 28 | 202321044549-FER_SER_REPLY [23-04-2025(online)].pdf | 2025-04-23 |
| 29 | 202321044549-DRAWING [23-04-2025(online)].pdf | 2025-04-23 |
| 30 | 202321044549-COMPLETE SPECIFICATION [23-04-2025(online)].pdf | 2025-04-23 |
| 1 | 202321044549_SearchStrategyNew_E_202321044549E_14-02-2025.pdf |
| 2 | 202321044549_SearchStrategyAmended_E_tele_robotAE_28-10-2025.pdf |