Abstract: The present disclosure relates to a system (100, 200), includes at least two complementary embedded devices, aggregator(s) and renderer(s)) connected via a constrained network, to facilitate remote access to electronic systems over the said constrained network. Aggregator, through hi-z taps, interfacing module or directly connected to a host and the renderer is connected to a client. The aggregator transfers the data streams, received from the host to the renderer to facilitate remote access. The renderer is connected to client Human machine interface (HMI) device(s) of the to provide actions to control the host. The said actions are then replicated at the host by the system (100, 200). The system (100, 200) does not require cooperation and participation from the host in the remote accessing process, ensuring maintenance and support for both new and older devices. (To be Published with FIG. 1)
DESC:CROSS REFERENCING RELATED APPLICATIONS AND PRIORITY DETAILS
[0001] This application claims the benefit of and priority to Indian Provisional Application No. 202411011580 filed on February 20, 2024.
TECHNICAL FIELD
[0002] The subject matter in general relates to a technique to facilitate remote access to electronic systems. More particularly, the subject matter relates to a technique to facilitate remote access to electronic systems over a constrained network.
BACKGROUND
[0003] Unless otherwise indicated herein, the systems and methods described in this section are not prior art in this application by default and are not admitted to being prior art merely by inclusion in this section. Similarly, a problem mentioned in the background section or associated with the subject matter of the background section should not be assumed to have been previously recognized in the prior art. The subject matter in the background section merely represents different approaches, which in and of themselves may also correspond to implementations of the claimed subject matter.
[0004] Remote access to computers over a network connection is a common practice in many industries and applications. As networks evolved there have been significant improvements in speed, reduced latency, controlled jitter, and minimized losses. These improvements coupled with advancements in image/video compression and host/client software, the approach to remote access has transformed from text-based console remoting to comprehensive Graphical User Interface (GUI) remoting experiences, wherein seamless sharing of video (screens), audio, Human Machine Interface (HMI) devices like mice, and other peripherals such as printers is achieved.
[0005] Conventional technologies that enable remote access on host computers can be broadly classified into Integrated interfaces, Peer-to-Peer(P2P) Software, Centralised Services, and Internet Protocol based Keyboard Video Mouse switches (IP-KVM) implementation. The Integrated Interfaces are integrated in the host hardware and can be reached via a software utility or web browser on a networked client. One such example of integrated interfaces for remote access in the Integrated Platform Management Interface (IPMI).
[0006] P2P software facilitates communication between a network-connected host and a client. In such a setup, the host is equipped with the necessary software to function as a server. Examples of such implementations are Remote Desktop Protocol (RDP), and Virtual Network Computing (VNC). Further, Centralised Services, refer to various internet-based services, where both the host and client utilize the service provider's software application, connecting to the service provider's servers over the internet. The service provider facilitates remote access to the host on the client's end. Examples of such central services are applications such as AnyDesk, and TeamViewer. IP-KVM switches are used to connect to the regular HMI ports of a host computer and allow the same to be redirected to a client computer over a network. IP-KVM uses Internet Protocol (IP) to transport information from one point to another. It converts the signal into packets and distributes them through standard network switches.
[0007] Although these techniques are suitable to facilitate remote access under high bandwidth and decent network connectivity in their respective use cases, they seldom succeed under a constrained network. Existing technologies are effective with good network which have high bandwidth, and low latency, packet drop and jitters in connecting the host to the client. The widespread integration of application-specific host Embedded Systems (ES) in various sectors has introduced new challenges in providing remote support and maintenance. While central support systems facilitated by rapidly advancing networks have addressed many issues in typical scenarios, specific domains such as military, electrical and computer industry, and rural medicine pose unique challenges. These challenges arise from constrained network connectivity, often limited to satellite links, suffering from issues often related to bandwidth and latency problems making remote support a significant hurdle. The existing remote access technologies, in their native form, fail to provide seamless remote access over constrained networks, particularly when GUI is involved.
[0008] In these specialized domains, original equipment manufacturers (OEMs) may intentionally obscure accessibility to the underlying ES/computers within their equipment. The systems, especially Embedded Systems used are proprietary in nature and are neither designed to be interoperable nor open to installation on external software applications. In many cases, deliberate measures are introduced by the Original Equipment Manufacturer (OEM) to discourage the same even through add-on mechanisms. Maintenance and support for older devices present another significant challenge in various sectors. This intentional concealment or absence of agnostic interfaces in domains such as military, remotely located industry such as oil rigs, information technology and security, and rural medicine, undermine conventional methods of remote support over networks, which pose unique challenges in remote access solutions.
[0009] Traditional approaches to remotely access an electronic device/host often require cooperation and participation from the host system, making it challenging to provide effective support for legacy equipment or a non-participative host. Further, these solutions require capable client systems which have complementary processing and software tools, and requisite HMI devices for remotely accessing the host system. Most existing solutions work only for a participative host, which is enabled for remote access and has requisite processing and software tools for supporting remote connection, GUI, compression etc. For instance, in the case of IP-KVM switches, the host is still required to be participative by having certain standardised ports from a short selection of limited standardises ports like Video Graphics Array (VGA), Personal System 2 (PS/2), Universal Serial Bus (USB) and Serial (RS-232).
[0010] Consequently, a concise problem statement emerges: the central and remote supportability and operation of ES/computing elements within military, industrial, information security implementations, rural and medical equipment over constrained networks, such as satellite links, lack effective support and operation, particularly in environments where traditional network support mechanisms may not be applicable or are deliberately restricted.
[0011] In view of the foregoing discussion, there is a need for a technique to effectively overcome the above problems of traditional remote access systems while working seamlessly with the legacy and proprietary systems, non-participative or deliberately restricted systems over constrained networks and addressing other related issues thereof. Accordingly, the present invention essentially provides a solution, comprising an ingenious combination of system and method, to firstly connect to interfaces of ES/computing elements of even a non-participative equipment, and secondly, to provide remote access to the same from a central location, over a constrained network, for the purposes of support, maintenance, operation, monitoring, analysis etc.
SUMMARY OF THE INVENTION
[0012] Accordingly, to fulfil the need for a system to facilitate remote access to electronic systems over constrained networks is provided. The system includes at least two embedded devices, namely, an aggregator and a renderer, to facilitate remote access between at least one host embedded system and at least one client over a constrained network. The host embedded system, in remote access, is a hardware device that allows access to a network. Further, the client, in remote access, is a hardware device that remotely accesses the host embedded system (interchangeably referred to as ‘ES’) via a network. The system disclosed in the present subject matter does not necessitate installation of a common software on both host ES and client hardware. Furthermore, the system does not necessitate the host ES's cooperation and participation in the remote accessing process, ensuring seamless maintenance and support for both new and older devices, and allows for seamless remote access to ES/computers from physically dislocated clients connected over constrained networks.
[0013] Before the subject matter of the present invention is described, it must be understood that the terminology used in the description is for the purpose of describing the versions or embodiments only and is not intended to limit the scope of the present application. This summary is not intended to identify essential features of the subject matter nor is it intended for use in detecting or limiting the scope of the claimed subject matter. The scope of the disclosure shall be determined by the claims in the complete specifications.
[0014] In an embodiment, the invention provides for a system for remote access over a constrained network. The said system comprises at least one host embedded system to be remotely accessed, an aggregator, and a renderer through which the host ES is remotely accessed at the client’s end through client HMI devices.
[0015] According to the invention, the aggregator further comprises multiple modules. One, an electrical interfacing module for enabling a plurality of signal streams from at least one data source of the host embedded system to be electrically interfaced to the aggregator by electrically interfacing. Second, a capturing module for digitally capturing the plurality of signal streams electrically interfaced. Third, an aggregating processor for locally rendering and aggregating the plurality of signal streams digitally captured from the at least one data source. Fourth, a display module comprising at least one display screen, characterized in that the at least one display screen shows the plurality of signal streams, locally rendered and aggregated, in a dynamic window for each of the at least one data source. Fifth, a remoting server module which interacts with a remoting tool to remote the dynamic window aggregated, to a renderer as a plurality of remoted streams.
[0016] In accordance with the invention, the renderer also consisting of several modules comprises a remoting access module to receive the plurality of remoted streams from the aggregator through the remoting tool; a rendering processor to finally render the plurality of remoted streams from the aggregator as a remote session window; and a client interface module to connect the renderer to at least one client. The system further comprises at least one client is at the renderer end, such that, said client further comprises a plurality of client HMI devices through which the at least one host embedded system is remotely accessed.
[0017] According to an embodiment of the invention, the system additionally comprises an interfacing instrument for intermediately interfacing between the at least one host embedded system and the aggregator, such that the electrical interfacing module of the aggregator electrically interfaces with the at least one data source of the host embedded system, via (through) the interfacing instrument.
[0018] According to the invention, a method for remote access over a constrained network is disclosed, said method comprises the steps of electrical interfacing of at least one host embedded system with an electrical interfacing module of an aggregator, wherein the step of electrical interfacing comprises the connecting aggregator with at least one data source of said host embedded system, and tapping into a plurality of signal streams of said at least one data source. The method then comprises the step of digitally capturing the plurality of signal streams of the at least one data source electrically interfaced by the aggregator, wherein said digitally capturing is done by the capturing module of the aggregator. The next step comprises locally rendering and aggregating the plurality of signal streams digitally captured from the said at least one data source, such that, the signal streams from each of the at least one data source, rendered and aggregated, is viewable in a dynamic window on a display module of the aggregator. Thereafter, the method comprises the step of remoting the dynamic window from the aggregator to a renderer, in the form of a plurality of remoted streams, through a remoting tool. The step of remoting to the renderer is preceded by optimizing the remoted steams for remoting over the constrained network. The method thereafter comprises the step of finally rendering the plurality of remoted streams from the aggregator by a rendering processor of the renderer as a remote session window. The final steps comprise the step of interfacing the renderer with at least one client through a client interface module, and the step of remotely accessing the remote session window of the at least one host embedded system on the at least one client through a plurality of client HMI devices.
[0019] In another embodiment, the invention further discloses a method for remote access over a constrained network, wherein the method additionally includes the step of intermediately interfacing between at least one host embedded system and an aggregator by an interfacing instrument, followed by the step of electrical interfacing of the at least one host embedded system with an electrical interfacing module of an aggregator via the interfacing instrument. The steps of intermediately interfacing and electrical interfacing comprise connecting the aggregator with at least one data source of the host embedded system through the interfacing instrument, and tapping into a plurality of signal streams of said at least one source.
[0020] The disclosed system facilitating remote access over a constrained network has the various advantageous functionalities over the conventional art. It is an advantage of the present system that remote access is provided for multiple embedded systems, which can be non-participative, not designed to support remote access and obsolescent or obsolete to run latest software tools for remoting. Accordingly, the system allows for maintenance and support for older legacy devices and to OEM equipment where remoting is done through limited tools/systems often proprietary of the said OEM.
[0021] The present system further provides remote access over constrained networks or amidst poor networking performance, hazardous environment, and environment with lack of physical access. The modularity of the system allows for selective application or in combinations to meet a wide range of requirements. Further, an important facet of the invention is its applicability/utility in heterogenous environments, be it (particularly) diverse hosts, clients, networks and/or use cases. The flexible architecture of the invention is capable of remoting multiple dispersed host ES/computers on to a single client and vice-versa. This can find vivid use in various scenarios, e.g., remote streams of multiple host ES/computers are made accessible on a single client.
[0022] Other objects, features, and advantages of the present invention will become apparent from the following detailed description. It should be however understood that the detailed description and specific examples, while indicating preferred embodiments of the present invention, are given by way of illustration only and various modifications may naturally be performed without deviating from the present invention.
BRIEF DESCRIPTION OF DRAWINGS
[0023] The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate the disclosure by way of examples and are not limited to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The same numbers are used throughout the figures to reference like features and components. Elements illustrated in the figures are not necessarily drawn to scale. Embodiments are described, by way of example only, and with reference to the accompanying figures, in which:
[0024] Figure 1 illustrates a block diagram of a system (100) to facilitate remote access over a constrained network, in accordance with a preferred embodiment of the present invention.
[0025] Figure 1A is a block diagram of the various modules of the aggregator and the renderer in the system (100) with their high-level functional relationship inter se, in accordance with an embodiment of the present disclosure;
[0026] Figure 1B is a block diagram of the various modules of the aggregator and their high-level functional relationship interaction inter se as well as with other components of the system (100), in accordance with an embodiment of the present disclosure;
[0027] Figure 2 illustrates a block diagram of a system (200) to facilitate remote access over a constrained network through an interfacing instrument (202), allowing for bi-way access of the host ES, in accordance with an embodiment of the present invention.
[0028] Figure 3 is a block diagram of a system (100) comprising a plurality of host ES being remotely accessed by a client employing a plurality of aggregators and renderers, in accordance with an embodiment of the present invention.
[0029] Figure 4 is an exemplary implementation (400) of the invention to facilitate remote access over a constrained network using crash cart adapter(s) (402), in accordance with an embodiment of the present disclosure;
[0030] Figure 5 is an exemplary implementation (500) of the invention to facilitate remote access over a constrained network using IP-KVM(s) (502), in accordance with an embodiment of the present disclosure;
[0031] Figure 6 is an exemplary implementation (600) of the invention to facilitate remote access over a constrained network using IMPI(s) (602), in accordance with an embodiment of the present disclosure;
[0032] Figure 7 is an exemplary implementation (700) of the invention to facilitate remote access over a constrained network to remotely use test/measurement instrument(s) (702), in accordance with an embodiment of the present disclosure; and
[0033] Figure 8 is an exemplary depiction (800) of the invention in a military environment, in accordance with an exemplary embodiment of the present disclosure.
[0034] Figure 9 is a flow chart of the comprising the steps followed in a method (900) for remote access over a constrained network, as encompassed by an embodiment of the invention
DETAILED DESCRIPTION
[0035] The following detailed description includes references to the accompanying drawings, which form part of the detailed description. The drawings show illustrations in accordance with example embodiments. These example embodiments are described in enough detail to enable those skilled in the art to practice the present subject matter. However, it will be apparent to one of ordinary skill in the art that the present invention may be practised without these specific details. In other instances, well-known methods, procedures and components have not been described in detail so as not to unnecessarily obscure aspects of the embodiments. The embodiments can be combined, other embodiments can be utilized, or structural and logical changes can be made without departing from the scope of the invention. Further, simply because certain headings or captions are used for a certain disclosure, does not limit the applicability to said heading and may very well be applied to a different part of the description section. The following detailed description is, therefore, not to be taken as a limiting sense. It should be understood that the capabilities of the invention described in the present disclosure and elements described herein and/or shown in the figures may be implemented in various forms of hardware, firmware, software, the non-transitory computer readable medium or combinations thereof.
[0036] Reference throughout the specification to “various embodiments,” “some embodiments,” “one embodiment,” or “an embodiment” or “exemplary embodiment” means that a particular feature, step, or characteristic described in connection with the embodiment is included in at least one embodiment. Thus, appearances of these phrases throughout the specification are not necessarily all referring to the same embodiment.
[0037] The terms “comprise(s)”, “comprising”, “include(s)”, “including”, or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a setup, system or method that comprises a list of components or steps does not include only those components or steps but may include other components or steps not expressly listed or inherent to such setup or system or method. In other words, one or more elements in a system or apparatus proceeded by “comprises… a” does not, without more constraints, preclude the existence of other elements or additional elements in the system or method.
[0038] In the following detailed description of the embodiments of the disclosure, reference is made to the accompanying drawings that form a part hereof, and which are shown by way of illustration-specific embodiments in which the disclosure may be practised. These embodiments are described in sufficient detail to enable those skilled in the art to practice the disclosure, and it is to be understood that other embodiments may be utilized and that changes may be made without departing from the scope of the present disclosure. The following description is, therefore, not to be taken in a limiting sense. Further, while definition and explanations of all terms coined and/or used in describing the present invention have been described in the specification, however, all terms not otherwise specifically described shall be given the meaning most obvious and apparent to a person having ordinary skill in the art.
[0039] As described herein, “embedded systems” or “ES” are purpose computers used in industry, military, consumer goods etc. These are built for a specific purpose, including the hardware, firmware/middleware and software, and continue to be utilised for the same (only).
[0040] The “host” or “host embedded system” or “host ES” means an embedded system or computer system which needs to be accorded seamless remote access.
[0041] The “client” is an ES/computer/device on which the seamless remoting from the host/s is to be accessed. In an embodiment, the client comprises only of client HMI (Human Machine Interface) devices through which the remote host is accessed and my include keyboard, mouse, screen for display etc. to control the host HMI devices remotely.
[0042] As used herein, an “aggregator” is a discrete device implemented on the existing and/or regular ES and/or computer being the host ES by suitable hardware and/or software modifications, with or without add-ons, enabling the host ES to be remoted and accessed at the client-end. It may exist as actual physical entity and/or as a functional block abstracted out of other devices.
[0043] As used herein, a “renderer” is a discrete device complementary to the aggregator, implemented on the client end, by suitable hardware and/or software modifications, with or without add-ons, accessing the host ES and allowing a remote session to be viewed, interacted with and controlled by the client HMI devices locally attached at the client-end.
[0044] As used herein, a “constrained network” means a digital computer data network or a satellite link or an otherwise unsupportive network having limited bandwidth, high round trip time (RTT) latency, high packet loss and high jitter between RTT of packets which does not allow inter-connection between devices especially of audio and video data streams.
[0045] As used herein, a “remoting tool” means a tool/system using a protocol (software) to remotely control another ES/device/computer by transmitting the control of input through HMI devices from the host to the client, relaying HMI data streams from keyboard, mouse, speaker, camera, display etc. over a network, seamlessly working even over constrained network. According to the invention, the remoting tool relays input data streams from the aggregator to the renderer for remote access of the host ES through host HMI devices through channels. Preferred remoting tools, but not limiting in any manner, include VNC, RDP and the like, and variants or modifications thereof. It may be understood that VNC stands for Virtual Network Computing which is an existing is a cross-platform screen sharing system and a remoting tool created to remotely control another computer through input control. And, RDP stands for Remote Desktop Protocol which is another preferred existing remoting tool and is a secure network communication protocol offered by Microsoft, allowing users to execute remote operations on other computers, facilitating secure information exchange between remotely connected machines over an encrypted communication channel.
[0046] As used herein, a “crash cart adapter” connects a laptop to a server or other device. The adapter has KVM cables that connect to the server, a VGA cable that connects to the server's video port, and a USB cable that controls the mouse and keyboard. The adapter also has a USB host cable that connects the laptop to the adapter.
[0047] As used herein, “KVM over IP” is an extension technology that uses Internet Protocol (IP) to transport information from point A to point B, converting the signal into packets and distributing them through standard network switches. “IP KVM”, or “digital KVM”, is a hardware-based solution that allows users to remotely access and control multiple computers using a single keyboard, video monitor, and mouse (KVM). It uses Internet Protocol (IP) to convert signals into packets and distribute them through standard network switches. IP KVM is typically used in data centre environments where multiple servers need to be accessed and controlled. It can be used to remote to a system either through a browser or some other application or applet.
[0048] As used herein, “IPMI” stands for Intelligent Platform Management Interface, and is a set of specifications for hardware-based platform management system which provides management and monitoring capabilities independently of the host system's CPU, firmware, and operating system.
[0049] The invention discloses a system to facilitate remote access over a constrained network, said system comprising at least two complementary embedded devices, an aggregator, at the host end and a renderer, at the client-end, to facilitate remote access of a host ES from the client, irrespective of whether the host ES is participative or compatible, or not. The aggregator receives multiple streams from different conversion hardware devices which is in-turn remoted to the renderer(s) over underlying networks, including constrained ones, for centralised access to the streams/inputs/data sources connected to the aggregator(s). The system disclosed in the present subject matter does not necessitate installation of a common software on both host and client hardware. Furthermore, the system does not necessitate the host's cooperation and participation in the remote accessing process, ensuring seamless maintenance and support for both new and older devices.
[0050] Figure 1 illustrates a block diagram of a system (100) to facilitate remote access over a constrained network, in accordance with a preferred embodiment of the present invention. The system (100) comprises at least two embedded complimentary devices, comprising an aggregator (112) and a renderer (132), connected via a constrained network (130) to facilitate remote access to embedded electronic systems (102, 142) over said constrained network (130). The embedded electronic systems (102, 142) as encompassed by a preferred embodiment comprises at least one host ES (102) to be remotely accessed and at least one client (142) through which the at least one host embedded system (102) is remotely accessed. The aggregator (112) is connected to a host ES (102) and renderer (132) is connected to a client (142).
[0051] In an embodiment of the invention, as disclosed in Figure 1, a plurality of host HMI devices (104) of the host ES (102) are accessed by the complimentary devices (112, 132) and controlled through a plurality of client HMI devices (140) locally associated at the client (142) end. It may be understood that HMI devices, whether associated with the host or at the client end, allows interaction with ES at both ends, for example, but not limited to, mouse, keyboards, touchpads, touchscreens, control panels, dashboard, industrial PC and/or joysticks.
[0052] In yet another embodiment, the renderer is connected to client HMI devices (140), such as a monitor, a keyboard and a mouse, which comprises the entire of client (140/142), configured to control the host system (102). The actions are then carried out at the host ES (102) side from the client HMI devices (140/142). In an embodiment, the host HMI device(s) (104) may include, but not limited to, mouse, keyboards and touchpads. Further, the ports/ interfaces thereof referred to as agnostic interfaces (108) herein may include, but not limited to, PS/2, USB, RS-232 serial, USB-C, HDMI, VGA, mini DVI, audio, optical audio, DVI-I, DVI-d, Type-C, Serial Digital Interface (SDI) and/or thunderbolt.
[0053] Figures 1A and 1B illustrate block diagrams of the various modules of the aggregator and the renderer in the system (100) with their high-level functional relationship inter se, in accordance with different embodiments of the present disclosure. Figure 1A illustrates an embodiment wherein the system (100) for remote access over a constrained network (130) comprises at least one host embedded system (102) to be remotely accessed, such that the access is provided through control over the host HMI devices (104). The system (100) further comprises an aggregator (112) which in turn is made up of a plurality of modules. One module being an electrical interfacing module (114) for enabling a plurality of signal streams from at least one data source of the host embedded system (102) by electrically interfaced with and accessed by the aggregator (112).
[0054] In an embodiment as illustrated by Figure 1B, the electrical interfacing module (114) of the aggregator (112) receives the signal streams from the analogue and digital data sources of the Host ES (102), wherein said data sources may be electrically interfaced to receive the streams directly/intrusively, and/or indirectly/ non-intrusively. The non-intrusive electrical interfacing with the host ES (102) to receive signal steams from host HMI devices (104) is done through at least one high impedance tap (Hi-Z tap) (106). In an embodiment, one or a plurality of Hi-Z taps (106) are positioned between the host embedded system (102) and the plurality of host HMI devices (104), for splitting the signal streams flowing from the host HMI devices (104) to the host embedded system (102). This splitting allows at least a part of the plurality of signal streams being split to be redirected to the aggregator (112) where it gets electrically interfaced and received by the electrical interfacing module (114a). The remaining signal streams flow to the host ES (102) for the routine actions to be carried out without interruptions. As illustrated in Figure 1B, the hi-z tap (106) is connected to the aggregator for redirection of the split signal streams from the host HMI devices. In another embodiment, the electrical interfacing module (114b) receives digital data streams from the analogue and digital interfaces of the host HMI devices (104), via. the hi-z taps (106) connected to the host ES (102) and the aggregator (112) which is thereafter processed to be remotely accessed.
[0055] In another embodiment, hi-z taps may also be termed as “non-intrusive network taps”. Conventionally, non-intrusive network taps are used to ensure complete visibility into network links without compromising network performance or risking costly downtime. Additionally, high impedance taps or devices with high impedance are used to put little load on a signal, so that it does not reduce the signal level that has to be transferred to the aggregator. These hi-z taps are generally used for analog inputs since, in case of analog inputs, the impedance of the input can affect the signal level if it is too low. The hi-z taps may include active/passive splitters which bifurcate a signal stream for inputting the same to the aggregator though a capturing setup of the aggregator. The hi-z taps as disclosed in the present subject matter may be, but not limited to, Video Graphics Array (VGA) splitters.
[0056] In an embodiment of the invention, the electrical interfacing module (114b) of the aggregator (112) electrically interfaces intrusively with a plurality of agnostic interfaces (108) of the at least one host embedded system (102) to access the plurality host HMI devices (104). The said intrusive/ direct access to the plurality of signal streams from each data source, i.e. each of the plurality of agnostic interfaces, involves direct connection of the electrical interfacing module (114b) with the agnostic interfaces (108) such as ports and interfaces of any nature, as used in legacy systems or as used in latest new age ES and interfaces. It may be appreciated that there is no need for complementary interfaces being present at the host ES and the aggregator end.
[0057] An implementation may use intrusive electrical interfacing through agnostic interfaces (108) such as VGA port for display interfacing and PS/2 ports for other HMI connections. However, implementation of the invention can also be done using any other port/interface types like all variants of VGA, HDMI, DisplayPort, Type-C, Serial Digital Interface (SDI), Composite/Component Video etc. for display interfacing; and PS/2, USB, RS-232 serial, AT (5-pin DIN) etc. for other HMI connections. Other ports, like audio, could be interfaced in a similar manner. It may be appreciated that the versatility of the invention permits its various implementations to be incarnated using an alternate port/interface for any of the system embodiments disclosed herein.
[0058] As illustrated in the Figures 1A and 1B, according to an embodiment, once the plurality of signal streams are received through electrical interfacing by the electrical interfacing module (114), the analogue and/or digital signal streams so received from the host ES (102) are then digitally captured through the capturing module (116) of the aggregator (112).
[0059] In an embodiment, the capturing module (116) may comprise a capture hardware unit (118) enabled with software applications for digitally capturing the plurality of signal streams electrically interfaced non-intrusively by the electrical interfacing module (114a). In an embodiment where the signal streams from at least one data source is redirected and electrically interfaced through the at least one high-impedance tap (106), the capture hardware unit (118) captures the indirectly/non-intrusively interfaced signals and converts the said streams in digital format. In an embodiment of the invention, the hi-z tap(s) (106) receives both analogue and digital signals from the host (102) but capture hardware unit (118) captures and converts the same as output comprising digital stream(s) of data to the aggregator (112) using various types of Analog to Digital (AD) or Digital to Digital conversion circuitries.
[0060] According to an embodiment, the capture hardware unit (118) is a capture card, which is a device that converts video signals from a camera's output into a digital format that a computer can recognize. It can also capture audio and convert it into digital signals that can be shared across internet platforms.
[0061] In an embodiment, the capturing module (116) comprises an emulation unit (120) for directly emulating the plurality of host HMI devices (104) electrically interfacing intrusively through the plurality of agnostic interfaces (108) by the aggregator (112). In an embodiment, the signal streams from at least one data source is directly/intrusively interfaced by connecting through a plurality of agnostic interfaces (108), like ports, USBs etc., These stream(s) are transferred from the at least one data source of the host HMI devices (104) to the electrical interfacing module (114b) and then digitally captured by emulation unit (120) which enables reproduction/ emulation of a function or action of the host (102), at the aggregator (112).
[0062] According to an embodiment, the emulation unit (120) is a combination of are programs and devices that allow a computer to mimic the behaviour of another device. Emulation unit can simulate the hardware, operating system, or CPU of a computer environment. It can also simulate the software and hardware configuration of a mobile device or another computer.
[0063] In an embodiment, the capturing unit of the aggregator comprises a software application enabled with the emulation unit and capture hardware unit, as the case may be. The software application is configured to display the captured and converted digital streams, on a display panel of the operating system (OS) running on the aggregator, as one or more dynamic windows, once they are locally rendered and aggregated. The said dynamic windows are then transferred to the renderer using a remote access server via the constrained network.
[0064] The system (100) further discloses an aggregating processor (122) for locally rendering and aggregating the plurality of signal streams interfaced and digitally captured from the at least one data source of the host HMI devices (104). The aggregating processor, in an embodiment, is a modern computer processor or a microprocessor combining the components and function of a central processing unit (CPU) into a single integrated circuit (IC) or a few connected ICs. It integrates the arithmetic, logic and control circuits into a single multipurpose digital circuit capable of performing the steps of rendering and aggregating the captured data streams from the host HMI devices as dynamic display elements i.e. windows of specific applications and consolidating for display as windows.
[0065] The system (100) further comprises a display module (126) comprising at least one display screen, characterized in that the at least one display screen shows the plurality of signal streams, locally rendered and aggregated, in a dynamic window (124) for each of the at least one data source. The data sources may include accessed signal streams from the host through hi-z taps (106) non-intrusively or may include each agnostic interface of the host ES (104) providing intrusive access to one or more of the host HMI devices (104). According to an embodiment of the invention, signal streams from each data source is locally rendered into one dynamic window viewable on the display module of the aggregator, capable to aggregating access into one or more host HMI devices associated with the data source. For illustration, a micro-port (data source) connected with a USB cable may allow access to both keyboard and mouse (two host HMI devices) of the host ES.
[0066] According to yet another embodiment, the system further comprises a remoting server module (128) in the aggregator (112) which is capable of remoting the dynamic window (124) through a remoting tool (302), which had been rendered and aggregated by the aggregating processor (122) such that said remoting is done in the form of a plurality of remoted streams to the renderer (132).
[0067] The system (100) further comprises a renderer (132), complementary to the aggregator (112) comprising multiple modules covering a remoting access module (134), a rendering processor (136) and a client interface module (138). According to an embodiment, the remoting access module (134) is capable of receiving the plurality of remoted streams from the remoting server module (128) of the aggregator (112) through the remoting tool (302). In another embodiment, the remoting server module (128) and the remoting access module (134) may be complimentary allowing remotely sending and receiving the remoted streams of the dynamic windows, carried out through a remoting tool (302), which may be but is not limited to, Remote Desktop Protocol (RDP) and/or Virtual Network Computing (VNC). In yet another embodiment, the remoting tool comprises optimized exiting remoting tools to operate in constrained networks.
[0068] The renderer (132) in the system (100) further comprises a rendering processor (136) for finally rendering the plurality of remoted streams received from the aggregator (112) as a remote session window (137). In an embodiment, the rendering processor is a micro-processor or a modern computer processor combining the components and function of a central processing unit (CPU) into a single integrated circuit (IC) or a few connected ICs. It integrates the arithmetic, logic and control circuits into a single multipurpose digital circuit capable of performing the steps of finally rendering the remoted streams received by the remoting access module (134) through the remoting tool (302).
[0069] In an embodiment, the remote session window/s (137) is viewable on the renderer display (139) of the renderer (132), wherein the said renderer display (139) is preferably an LCD or visually perceivable display panel or screen.
[0070] Further, in yet another embodiment, the remoting tool operates through one or a plurality of remoting connections depending upon the number of aggregators and renderers, and accordingly each remoted window corresponds to the connections/channels of the remoting tool employed.
[0071] The renderer (132) per the system (100) disclosed herein, also comprises a client interface module (138) which allows for connection of the renderer (132) to at least one client (142), intrusively or non-intrusively. Further, according to the invention, the renderer (132) is connected to HMI device(s) of the client (140) wherein the said HMI device(s) (142) are configured to provide actions to control the host ES (102). The said actions are then replicated at the host (102) by the system (100). In another embodiment, the system (100) comprises at least one client (142) is at the renderer end, such that, said client (142) further comprises a plurality of client HMI devices (140) through which the at least one host embedded system (102) is remotely accessed.
[0072] Figure 2 illustrates a block diagram of a system (200) to facilitate remote access over a constrained network (130) through an interfacing instrument (202), allowing for bi-way access of the host ES, in accordance with an embodiment of the present invention. The system (202) comprises the features, components and modules as encompassed by the above disclosed system (100), and is additionally comprised of an interfacing module (202), placed in between the host (102) and the aggregator (112) In an embodiment, the interfacing instrument (202) itself is capable of communicating with the host and used in scenarios where bi-way access is desired, remotely through aggregator (112) as well as through the interfacing module (202). In another embodiment, where the interfacing instrument (202) is a part of the host (102) or is one of few devices permitted to connect to or interface with the host (102), then aggregator (112), instead of connecting or interfacing with the host (112) directly, intermediately connects through the interfacing instrument (202).
[0073] Accordingly, a system (200) encompassed by the invention and illustrated in Figure 2, additionally comprises an interfacing instrument (202) for intermediately interfacing between the at least one host embedded system (102) and an aggregator (112) such that electrical interfacing module (114) of the aggregator (112) enables a plurality of signal streams from at least one data source of the host embedded system (102) to be electrically interfaced to the aggregator (112) through the said interfacing instrument (202).
[0074] In an embodiment of the invention, the system (200) allows for a bi-way access of the host embedded system (102) such that at least one additional session window from the at least one host embedded system (102) is remoted directly by the interfacing instrument (202), whereas the remote session window is routed through the aggregator-renderer based remote access.
[0075] According to an embodiment of the invention, the functions of the various modules of the aggregator and the renderer are carried out by a single or a couple of modules described herein above, and separate reference to modules is not to necessarily be construed as having separate physical components. Illustratively, the microprocessor IC to act as the aggregating processor is capable of providing the functionality of a capturing module for intrusive and non-intrusive interfacing with the host. Such a system is also included in the scope of the present invention. It is a highlight of the invention is that it is modular, and the abovementioned facets and modules can be applied selectively or in other mix-and-match combinations to meet a wide range of requirements. Consequently, the modules, for instance in Figs.1A and B, may be selectively omitted, re-arranged and/or added to obtain application specific functionality in the system (100, 200).
[0076] According to an aspect of the invention, the remote access of the host ES is enabled for accessing a plurality of HMI devices including but not limited to screen/ display of the host, and other HMIs. The screen or the display stream of the host ES/computer is made available on the client through the remote access system encompassed by this invention, including but not limited to access to pre-boot environments like Basic Input Output System (BIOS) screens, hypervisors, text-based consoles, GUI Operating System (OS) and application screens, and any other display which the host may output. Further, the other HMIs of the host can be remotely seen or inspected at the client end, even those requiring low bandwidth and having resilience to latency and jitter. Further, through interfacing instruments of different nature bi-way sharing between the host and client is also possible. The HMI input(s) at the client end through the client HMI devices including but not limited to keyboard, mouse, touch screen etc, is/are applied to the remote host.
[0077] In an embodiment, the constrained network, over which the system (100, 200) facilitates remote access to embedded systems (102, 402), has one or more of the following limitations inter alia limited bandwidth of as low as 128 Kbps, high round trip time (RTT) latency of up to 1000 m-sec, high packet loss of up to 2%, and high jitter between RTT of packets of up to 100 m-sec.
[0078] Figure 3 is a block diagram of a system (100) comprising a plurality of host ES being remotely accessed by a client employing a plurality of aggregators and renderers, in accordance with an embodiment of the present invention. According to Figure 3, multiple analogue/digital data sources may be accessed from a plurality of hosts 1..to n (102(a-n)) by multiple aggregators 1..to n (112(a-n)), and each data source may be displayed as a separate dynamic window (124) at the atleat one display screen of the display module (126) of the OS running on each aggregator (112). The multiple sources can be multiple inputs, intrusive or non-intrusive, from a single host. Further, the multiple sources can be of various formats. Each aggregator is configured to receive inputs of various format. Further, the dynamic windows from the multiple aggregators (112(a-n)) are transferred to multiple renderers (132(a-n)), via remoting tool (302) preferably an optimised RDP/VNC channel or channels/ connections, typically secured by an encrypted tunnel, running on a constrained network (130). The multiple sources from the multiple aggregators (112(a-n)) are viewed as separate remote session windows (137 (a-n)) on a data wall/monitor(s) or display of the client (104), via the multiple renderers. In an embodiment, for each remoting tool channel/connection, a separate remote session window is viewable and accessible.
[0079] In an embodiment, the input to the multiple aggregators (112(a-n)) and the multiple renderers (132(a-n)) comprises use of signal for ensuring nominal jitter and wander tolerances, such as but not limited to a Pulse-per-second (PPS) signal that outputs a high logic level once a second and can be used to discipline the local clock oscillator to a high degree of precision.
THE METHOD
[0080] The method (900 (a and b)) as encompassed by an embodiment of the invention is disclosed by way of a flowchart as illustrated under Figure 9, disclosing the method where the interfacing instrument exists (900b) and that where it is absent (900a).
[0081] According an embodiment, the method (900a) for remote access over a constrained network (130) comprises a plurality of steps, comprising but not limited to the following:
[0082] Step 902a is electrical interfacing of at least one host embedded system (102) with an electrical interfacing module (114) of an aggregator (112), wherein said electrical interfacing (902a) comprises connecting the aggregator (112) with at least one data source of said host embedded system (102), and tapping into a plurality of signal streams of said at least one data source.
[0083] According to the invention, the electrical interfacing may be done non-intrusively and intrusively by the electrical interfacing module (114a, 114b). In an embodiment, the analogue/digital signal stream(s) of a host ES/computer (102) is/are electrically connected to and tapped in to using various types of connectors, cables and electrical interfacing circuits as per the characteristics of the particular signal stream and its host (102). In an embodiment where the electrical interfacing (902) is intrusive, regular connections from the electrical interfacing module (114b) of the aggregator to plurality of agnostic interfaces (108) on the host ES (102) are made, as corresponding local devices would connect to them, to access the plurality of host HMI devices (104).
[0084] In another embodiment, the electrical interfacing (902) is done non-intrusively. In another embodiment, the electrical interfacing (902a) of the plurality of signal streams by the aggregator (112) is done non-intrusively through at least one high-impedance tap (106) positioned between the host embedded system (102) and at least one of a plurality of host HMI devices (104). These are high-impedance non-intrusive taps which “listen” to the signal stream(s) is parallel to their default utilisation on the host ES/computer side. The taps include active/passive splitters which bifurcate a signal stream to two for fulfilling the original purpose and for proving the data streams to the aggregator though the electrical interfacing module (114a).
[0085] Step 904 comprises the step of digitally capturing the plurality of signal streams of the at least one data source electrically interfaced by the aggregator (11), said digitally capturing (904) is done by a capturing module (116) of the aggregator (112).
[0086] In an embodiment, the digitally capturing (904) is done non-intrusively. According to an embodiment, the digitally capturing (904) of the plurality of signal streams, following the electrical interfacing (902a) done non-intrusively, through the at least one high-impedance tap (106), comprises converting into digital format the signal streams captured by the capturing module (116). The non-intrusive digital capturing is done through a capture hardware unit (118) by converting the signal streams in the digital format is achieved using various types of Analog to Digital (AD) or Digital to Digital conversion circuitries which may be implemented using discrete Integrated Circuits (ICs), Field Programmable Gate Arrays (FPGAs), AD converters, microcontrollers etc. These may capture both analogue and digital signals from the host, but output the same digital stream(s) of data.
[0087] In another embodiment, the digitally capturing (904) of the plurality of signal streams, following the electrically interfacing (902a) intrusively by directly connecting to the agnostic interfaces (108), further comprises emulating the at least one of the plurality of host HMI devices (104) by an emulation unit (120) of the aggregator (112). In this step, the pertinent device(s) (104) is/are emulated by the aggregator, which in-turn connect-up and interact with host ES (102).
[0088] Step 906 is the step of locally rendering and aggregating the plurality of signal streams digitally captured from the said at least one data source, such that, the signal streams from each of the at least one data source, rendered and aggregated, is viewable in a dynamic window (124) on a display module (126) of the aggregator (112). According to an embodiment, the digitally captured signal stream(s) is/are locally rendered and aggregated (906) as dynamic display elements, referred to as dynamic windows of specific applications, on the display module (126) of the aggregator (112) at the Operating System (OS) level. The display module (126) then act as consolidated container(s)/placeholder(s) for the rendering of the windows (124).
[0089] In Step 908 comprising remoting, the dynamic windows (124) from the aggregator (112) are remoted as a plurality remoted stream(s) to renderer(s) (132), along with the display elements they hold, using the remoting tool (302) preferably comprising existing remoting technologies like VNC, RDP etc. In an embodiment, the step of remoting (908) is done by the remoting server module (128) of the aggregator and received by the remoting access module (134) of the renderer, through a remoting tool (302).
[0090] In an embodiment, the method includes a step of optimizing (907) such that the step of remoting (908) to the renderer is preceded by optimizing (907) the remoted streams for remote access over the constrained network (130). In an embodiment, the optimizing (907) for remote access over the constrained network (130) comprises adjusting a plurality of parameters of the remoting tool (302) based on the said network (130). In yet another embodiment, the optimizing (907) for remote access over the constrained network (130) comprises compressing the plurality of remoted streams before remoting (908) to the renderer (132). It may be noted that various optimisations under the optimizing step can be undertaken on the remoting tool (VNC in specific) to make it perform acceptably on constrained networks to practically achieve the aforementioned parameters.
[0091] Step 910 is the step of finally rendering (910) the plurality of remoted streams from the aggregator (112) by a rendering processor (136) of the renderer as a remote session window (137). These remoted stream(s) rendered, can be viewed and interacted with remotely, on the renderer.
[0092] Step 912 is the step of interfacing (912) the renderer with at least one client (142) through a client interface module (138). In an embodiment, the client comprises the client the client HMI devices and not a complete electronic system.
[0093] Finally, Step 910 is the step of remotely accessing (914) the remote session window (137) of the at least one host embedded system (102) on the at least one client (142) through a plurality of client HMI devices (140).
[0094] According to another embodiment, the method (900b) for remote access over a constrained network (130) comprises a plurality of steps, comprising but not limited to the following. When it is identified that the system (200) comprises an interfacing instrument (202), the method (900b) begins with Step 901 comprising the step of intermediately interfacing (901) between at least one host embedded system (102) and an aggregator (112) by an interfacing instrument (202). This step is followed by the step of electrical interfacing (902b) of the at least one host embedded system (102) with an electrical interfacing module (114) of an aggregator (112) through the interfacing instrument (202), wherein, said intermediately interfacing (901) and electrical interfacing (902b) comprises connecting the aggregator (112) with at least one data source of the host embedded system (102) through the interfacing instrument, and tapping into a plurality of signal streams of said at least one source.
[0095] In an embodiment the intermediately interfacing (901) of the plurality of signal streams from the at least one host embedded system (102) by the interfacing instrument (202) is done non-intrusively by the at least one high-impedance tap (106) positioned between the host embedded system (102) and at least one of a plurality of host HMI devices (104), such that the signal streams are first received by the interfacing instrument. Thereafter, the step of electrical interfacing (902 b) of the plurality of signal streams is done non-intrusively by the electrical interfacing module (114a) of the aggregator. In another embodiment, the step of electrical interfacing (902b) of the plurality of signal streams is done intrusively by directly connecting the electrical interfacing module(114b) of the aggregator (112) to at least one interface on the interfacing instrument (202), such that the plurality of host HMI devices (104) of the host embedded system (102) is accessed through the interfacing instrument (202).
[0096] The method (900b) further comprises the steps 904 – 914, as disclosed above (method 900a). Although, in an embodiment, the step of remotely accessing (914) through the client HMI devices (104) further includes direct remoting through the interfacing instrument (202) an additional session window of the at least one host embedded system (102) for a bi-way access.
[0097] In yet another embodiment, the method (900a, 900b) includes the steps of scaling of the resolution, the colour bit depth and refresh rates of the dynamic window (124) on the aggregator (112) and the remote session window (137) at the renderer (132) for improved quality of the remote access by the least one client (142). Between aggregating, remoting and rendering, an important activity of scaling the resolution (number of pixels), colour bit-depth (bits per pixel) and refresh rate (frames per unit time) is also undertaken through the interaction of the pertinent function of the respective software tools to ensure that the host is viewable on the client end with clarity and precision.
EXEMPLARY IMPLEMENTIATIONS OF THE INVENTION
[0098] Some of the typical implementations of the invention are brought out below. All the implementations assume that the Aggregator is physically located on the host side (on-site where remote support is needed) and the Renderer on the supporting side (from where remote support will be rendered), and both are connected via a functional computer network. It is pertinent to mention that the essential novel ideas which define the invention are not restricted to these only and can be implemented in various other ways. It is also pertinent to mention that multiple implementations as well as multiple instances can exist within a solution.
[0099] Figures 4 to Figure 8 illustrate various implementations of the invention. All the implementations assume that the aggregator is physically located on or near the host and the renderer on or near the client, and both are connected via a secured network. It is pertinent to mention that the essential novel and inventive aspects which define the invention shall not be restricted to these implementations as these implementations are given by way of illustration only and various modifications may naturally be performed without deviating from the present invention.
[00100] Referring to Figure 4, an exemplary implementation (400) of the invention to facilitate remote access over a constrained network (130) using crash cart adapter (402) is illustrated, in accordance with an embodiment of the present disclosure. A crash cart adapter (402) is connected to the aggregator (112) over USB connection. The crash cart adapter (402) intermediately interfaces with the host (102) on agnostic interfaces like VGA and PS/2 ports (108). Accordingly, the intermediately interfacing (901) is done through use of a USB to PS/2 convertor (404). OEM/customised software application of the crash cart adapter (402) is configured to run on the aggregator (112) to access its features. The said application provides bi-directional interactive access to the host when the client reflects the remote session window as well as the additional session window on the client end (402). In an embodiment, the OEM/customised software application can be replaced by a web interface, as per OEM’s requirement. At the OS level, the display module of the aggregator is remoted on to the renderer (132) using RDP/VNC. Along with the remoted access from renderer, the Crash Cart application window is also accessible by the client, via the renderer, on the data wall/monitor(s)/ display (140a) of the client (142) providing a bi-directional / bi-way interactive remote access to the host through other client HMI modules (140b).
[00101] Now referring to Figure 5, an exemplary implementation (500) of the invention to facilitate remote access over a constrained network (130) using IP-KVM(s) (502) is illustrated, in accordance with an embodiment of the present disclosure. An IP-KVM (502) is an interfacing instrument comprising a hardware-based solution for remote access that converts the signal into packets and distributes them through standard network switches. According to Figure 5, an IP-KVM (502) is connected i.e. electrically interfacing (902b) with the aggregator (112) over an Ethernet connection. The IP-KVM (502) intermediately interfaces (901) with the host (102) on HDMI and USB ports (108). The implementation provides bi-directional / bi-way interactive remote access to the host (102). In an embodiment, the implementation (500) could also be implemented by an OEM using a dedicated software application. At the OS level, the display module of the aggregator is remoted on to the renderer using RDP/VNC connections. Along with the remote session window, the IP-KVM application window is also accessible by the client, via the renderer (132), on the data wall/monitor(s)/display (140a) of the client (140). Further, the other client HMI device(s) (140b) are configured to provide actions to control the host (102). The said actions are then replicated at the host (102).
[00102] Figure 6 illustrates an exemplary implementation (600) of the invention to facilitate remote access over a constrained network (130) using IMPI(s) (602), in accordance with an embodiment of the present disclosure. IPMI (602) is an interfacing instrument that provides monitoring and management capabilities. According to the implementation (600), a built-in IPMI (600) functionality of server/workstation class motherboard is utilised for enabling remote access. Further, server/workstation class motherboard may be equated to the host (102). Such a motherboard is typically used to provide local system repair facility. The IPMI features of the motherboard is connected by intermediately interfacing (901) to the aggregator (112) over an Ethernet connection. The IPMI feature internally interfaces (901) with the host motherboard for access to the HMI and other features (104) like power, monitoring, etc. OEM/customised software application of the IPMI feature is configured to run on the aggregator (112) to access the host electrical interfacing (114). The implementation provides bi-directional interactive remote access to the host.
[00103] In an embodiment, while IP-KVM (502) and IPMI (602) each possess inherent network capabilities, the essence of these implementations of the present invention is to provide a re-direction through the aggregator and a bi-way access.
[00104] Now referring to Figure 7, an exemplary implementation (700) of the invention to facilitate remote access over a constrained network (130) to remotely use test/measurement instrument(s) (702) is illustrated, in accordance with an embodiment of the present disclosure. A test/measurement instrument (702) is connected to the aggregator (112) over PCI Express bus. The test/measurement instrument (702) intermediately interfaces (901) with the host/equipment to measure any type of analogue or digital signal(s) or combinations thereof. OEM/customised software application of the test/measurement instrument (702) is configured to run on the aggregator (112) to access its features. The implementation (700) provides a bi-directional interactive remote access to the measurements and can be used for seamless access to the measurements, including chancing the parameters, settings, etc., of the instrument and host/equipment.
[00105] Figure 8 illustrates an exemplary depiction (800) of the invention in a military environment, in accordance with an exemplary embodiment of the present disclosure. The field setup comprises of an aggregator (112) and a workstation (802). The setup is positioned in close proximity to a system on field (102), that requires remote support. Crew on field (102) uses the workstation (802) to undertake ES related maintenance of the system (102). When the crew requires assistance from base support (142), the aggregator (112) provides remote access to a renderer (132) through a satellite connectivity based (constrained) network (130). The base support (142) can then access and control both the workstation (802) and the host (102), connected to the aggregator (112). Status of any local operation being undertaken by the crew on the host, workstation and/or aggregator is retained between local and remote sessions to cater for breakage in connectivity, characteristic of constrained networks. Graphic user interface (GUI)/text consoles of both the host on field and workstation are accessible on the base support. Additionally, boot, storage, power, reset, etc., of the workstation can be controlled. The base support can simultaneously see and interact with consoles, GUI, interfaces, controls, etc., of multiple remote field deployments to apply the available expertise at multiple such deployments.
[00106] While the foregoing specification illustrates and describes exemplary embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the invention without departing from the essential scope thereof. Therefore, it is intended that the invention not be limited to the particular embodiment disclosed as the best mode contemplated for carrying out this invention, but that the invention will include all embodiments falling within the scope of the appended claims.
,CLAIMS:We claim:
1. A system (100) for remote access over a constrained network (130), said system (100) comprising:
at least one host embedded system (102) to be remotely accessed;
an aggregator (112) further comprising,
an electrical interfacing module (114) for enabling a plurality of signal streams from at least one data source of the host embedded system (102) to be electrically interfaced to the aggregator (112),
a capturing module (116) for digitally capturing the plurality of signal streams electrically interfaced,
an aggregating processor (122) for locally rendering and aggregating the plurality of signal streams digitally captured from the at least one data source,
a display module (126) comprising at least one display screen, characterized in that the at least one display screen shows the plurality of signal streams, locally rendered and aggregated, in a dynamic window (124) for each of the at least one data source;
a remoting server module (128) to remote the dynamic window (124) aggregated as a plurality of remoted streams, through a remoting tool (302) to a renderer (132); and,
the renderer (132) further comprising,
a remoting access module (134) to receive the plurality of remoted streams from the aggregator (112) through the remoting tool (302);
a rendering processor (136) to finally render the plurality of remoted streams from the aggregator (112) as a remote session window (137);
a client interface module (138) to connect the renderer (132) to at least one client (142); and
the at least one client (142) is at the renderer end, such that, said client (142) comprises a plurality of client HMI devices (140) through which the at least one host embedded system (102) is remotely accessed;
2. A system (200) for remote access over a constrained network (130), said system (200) comprising:
at least one host embedded system (102) to be remotely accessed;
an interfacing instrument (202) for intermediately interfacing between the at least one host embedded system (102) and an aggregator (112);
the aggregator (112) further comprising,
an electrical interfacing module (114) for enabling a plurality of signal streams from at least one data source of the host embedded system (102) to be electrically interfaced to the aggregator (112) through the interfacing instrument (202),
a capturing module (116) for digitally capturing the plurality of signal streams electrically interfaced,
an aggregating processor (122) for locally rendering and aggregating the plurality of signal streams digitally captured from the at least one data source,
a display module (126) comprising at least one display screen, characterized in that the at least one display screen shows the plurality of signal streams, locally rendered and aggregated, in a dynamic window (124) for each of the at least one data source;
a remoting server module (128) to remote the dynamic window (124) aggregated as a plurality of remoted streams, through a remoting tool (302) to a renderer (132); and,
the renderer (132) further comprising,
a remoting access module (134) to receive the plurality of remoted streams from the aggregator (112) through the remoting tool (302),
a rendering processor (136) to finally render the plurality of remoted streams from the aggregator (112) as a remote session window (137),
a client interface module (138) to connect the renderer (132) to at least one client (142); and
the at least one client (142) is at the renderer end, such that, said client (142) further comprises a plurality of client HMI devices (140) through which the remote session window (137) of the at least one host embedded system (102) is remotely accessed.
3. The system (100, 200) for remote access as claimed in claim 1 or 2, wherein the system (100, 200) further comprises at least one high-impedance tap (106) for providing access of the plurality of signal streams to the electrical interfacing module (114a) non-intrusively from a plurality of host HMI devices (104).
4. The system (100, 200) for remote access as claimed in claim 3, wherein the at least one high-impedance tap (106) is positioned between the host embedded system (102) and the plurality of host HMI devices (104), for splitting the plurality of signal streams flowing from the host HMI devices (104) to the host embedded system (102), such that at least a part of the plurality of signal streams split is redirected to the aggregator (112) for remote access.
5. The system (100, 200) for remote access as claimed in claim 1 or 2, wherein the electrical interfacing module (114b) of the aggregator (112) electrically interfaces intrusively with a plurality of agnostic interfaces (108) of the at least one host embedded system (102) to access the plurality host HMI devices (104).
6. The system (100, 200) for remote access as claimed in claims 3 or 4, wherein the capturing module (116) of the aggregator (112) comprises a capture hardware unit (118) for capturing the plurality of signal streams electrically interfaced non-intrusively through the at least one high-impedance tap (106) and converting the said streams in digital format.
7. The system (100, 200) for remote access as claimed in claim 5, wherein the capturing module (116) comprises an emulation unit (120) for directly emulating the plurality of host HMI devices (104) electrically interfacing through the plurality of agnostic interfaces (108) by the aggregator (112).
8. The system (100, 200) for remote access as claimed in claim 1 or 2, wherein the atleast one data source provides access to the plurality of signal streams from atleast one of the plurality of host HMI devices (104).
9. The system (100, 200) for remote access as claimed in claims 3 and 8, wherein the atleast one data source provides access by tapping into the plurality of signal streams from atleast one of the plurality of host HMI devices (104) non-intrusively using high-impedance taps (106).
10. The system (100, 200) for remote access as claimed in claims 5 and 8, wherein the atleast one data source provides access to the plurality of signal streams from atleast one of the plurality of host HMI devices (104) intrusively through at least one of the plurality of agnostic interfaces (108) of the host embedded system (102).
11. The system (100, 200) for remote access as claimed in claim 1 or 2, wherein the system (100, 200) comprises a plurality of aggregators (112(a-n)) remotely accessing a plurality of host embedded systems (102(a-n)) through a plurality of client HMI devices (140), such that each of the plurality of aggregators (112(a-n)) are rendered and remotely accessed in one remote session window (137(a-n)).
12. The system (200) for remote access as claimed in claim 2, wherein at least one additional session window from the at least one host embedded system (102) is remoted directly by the interfacing instrument (202) for a bi-way access of the host embedded system (102);
13. A method (900a) for remote access over a constrained network (130), said method (900a) comprising:
electrical interfacing (902a) of at least one host embedded system (102) with an electrical interfacing module (114) of an aggregator (112), wherein said electrical interfacing (902a) comprises connecting the aggregator (112) with at least one data source of said host embedded system (102), and tapping into a plurality of signal streams of said at least one data source;
digitally capturing (904) the plurality of signal streams of the at least one data source electrically interfaced by the aggregator (11), said digitally capturing (904) done by a capturing module (116) of the aggregator (112);
locally rendering and aggregating (906) the plurality of signal streams digitally captured from the said at least one data source, such that, the signal streams from each of the at least one data source, rendered and aggregated, is viewable in a dynamic window (124) on a display module (126) of the aggregator (112);
remoting (908) the dynamic window (124) from the aggregator (112) to a renderer (132), as a plurality of remoted streams, through a remoting tool (302),
finally rendering (910) the plurality of remoted streams from the aggregator (112) by a rendering processor (136) of the renderer as a remote session window (137);
interfacing (912) the renderer with at least one client (142) through a client interface module (138); and
remotely accessing (914) the remote session window (137) of the at least one host embedded system (102) on the at least one client (142) through a plurality of client HMI devices (140).
14. A method (900b) for remote access over a constrained network (130), said method (900b) comprising:
intermediately interfacing (901) between at least one host embedded system (102) and an aggregator (112) by an interfacing instrument (202),
electrical interfacing (902b) of the at least one host embedded system (102) with an electrical interfacing module (114) of an aggregator (112) through the interfacing instrument (202),
wherein, said intermediately interfacing (901) and electrical interfacing (902b) comprises connecting the aggregator (112) with at least one data source of the host embedded system (102) through the interfacing instrument, and tapping into a plurality of signal streams of said at least one source,
digitally capturing (904) the plurality of signal streams of the at least one data source electrically interfaced by the aggregator (11), said digitally capturing (904) done by a capturing module (116) of the aggregator (112);
locally rendering and aggregating (906) the plurality of signal streams digitally captured from the said at least one data source, such that, the signal streams from each of the at least one data source, rendered and aggregated, is viewable in a dynamic window (124) on a display module (126) of the aggregator (112);
remoting (908) the dynamic window (124) from the aggregator (112) to a renderer (132), as a plurality of remoted streams, through a remoting tool (302),
finally rendering (910) the plurality of remoted streams from the aggregator (112) by a rendering processor (136) of the renderer as a remote session window (137);
interfacing (912) the renderer with at least one client (142) through a client interface module (138); and
remotely accessing (914) the remote session window (137) of the at least one host embedded system (102) on the at least one client (142) through a plurality of client HMI devices (140).
15. The method (900a, 900b) for remote access as claimed in claims 13 0r 14, wherein the electrical interfacing (902a, 902b) of the plurality of signal streams by the aggregator (112) is done non-intrusively by the electrical interfacing module (114a) through at least one high-impedance tap (106) positioned between the host embedded system (102) and at least one of a plurality of host HMI devices (104).
16. The method (900b) for remote access as claimed in claim 14, wherein the intermediately interfacing (901) of the plurality of signal streams from the at least one host embedded system (102) by the interfacing instrument (202) is done non-intrusively by the at least one high-impedance tap (106) positioned between the host embedded system (102) and at least one of a plurality of host HMI devices (104).
17. The method (900a, 900b) for remote access as claimed in claim 13, wherein the electrical interfacing (902a, 902b) of the plurality of signal streams is done intrusively by directly connecting the electrical interfacing module (114b) of the aggregator (112) to at least one of the plurality of agnostic interfaces (108) on the at least one host embedded system (102) to access the plurality of host HMI devices (104).
18. The method (900b) for remote access as claimed in claim 14, wherein the electrical interfacing (902b) of the plurality of signal streams is done intrusively by directly connecting the electrical interfacing module(114b) of the aggregator (112) to at least one interface on the interfacing instrument (202), such that the plurality of host HMI devices (104) of the host embedded system (102) is accessed through the interfacing instrument (202).
19. The method (900a, 900b) for remote access as claimed in claims 15 or 16, wherein the digitally capturing (904) of the plurality of signal streams, following the electrical interfacing (902a, 902b) through the at least one high-impedance tap (106), non-intrusively, comprises converting into digital format the signal streams captured by the capturing module (116).
20. The method (900a, 900b) for remote access as claimed in claims 17 or 18, wherein the digitally capturing (904) of the plurality of signal streams, following the electrically interfacing (902a, 902b) intrusively by directly connecting, further comprises emulating the at least one of the plurality of host HMI devices (104) by the aggregator (112).
21. The method (900b) for remote access as claimed in claims 14, wherein said remotely accessing (914) through the client HMI devices (104) further includes direct remoting through the interfacing instrument (202) an additional session window of the at least one host embedded system (102) for a bi-way access.
22. The method (900a, 900b) for remote access as claimed in claims 13 or 14, wherein further the remoting (908) to the renderer is preceded by optimizing (907) the remoted streams for remote access over the constrained network (130).
23. The method (900a, 900b) for remote access as claimed in claim 22, wherein the optimizing (907) for remote access over the constrained network (130) comprises adjusting a plurality of parameters of the remoting tool (302) based on the said network (130).
24. The method (900a, 900b) for remote access as claimed in claim 22, wherein the optimizing (907) for remote access over the constrained network (130) comprises compressing the plurality of remoted streams before remoting (908) to the renderer (132).
25. The method (900a, 900b) for remote access as claimed in claims 13 or 14, wherein said method (900a, 900b) further comprises scaling of the resolution, the colour bit depth and refresh rates of the dynamic window (124) on the aggregator (112) and the remote session window (137) at the renderer (132) for improved quality of the remote access by the least one client (142).
| # | Name | Date |
|---|---|---|
| 1 | 202411011580-STATEMENT OF UNDERTAKING (FORM 3) [20-02-2024(online)].pdf | 2024-02-20 |
| 2 | 202411011580-PROVISIONAL SPECIFICATION [20-02-2024(online)].pdf | 2024-02-20 |
| 3 | 202411011580-FORM FOR SMALL ENTITY(FORM-28) [20-02-2024(online)].pdf | 2024-02-20 |
| 4 | 202411011580-FORM FOR SMALL ENTITY [20-02-2024(online)].pdf | 2024-02-20 |
| 5 | 202411011580-FORM 1 [20-02-2024(online)].pdf | 2024-02-20 |
| 6 | 202411011580-FIGURE OF ABSTRACT [20-02-2024(online)].pdf | 2024-02-20 |
| 7 | 202411011580-EVIDENCE FOR REGISTRATION UNDER SSI(FORM-28) [20-02-2024(online)].pdf | 2024-02-20 |
| 8 | 202411011580-EVIDENCE FOR REGISTRATION UNDER SSI [20-02-2024(online)].pdf | 2024-02-20 |
| 9 | 202411011580-DRAWINGS [20-02-2024(online)].pdf | 2024-02-20 |
| 10 | 202411011580-Proof of Right [08-04-2024(online)].pdf | 2024-04-08 |
| 11 | 202411011580-FORM-26 [08-04-2024(online)].pdf | 2024-04-08 |
| 12 | 202411011580-FORM-26 [05-07-2024(online)].pdf | 2024-07-05 |
| 13 | 202411011580-FORM-5 [19-02-2025(online)].pdf | 2025-02-19 |
| 14 | 202411011580-FORM 3 [19-02-2025(online)].pdf | 2025-02-19 |
| 15 | 202411011580-DRAWING [19-02-2025(online)].pdf | 2025-02-19 |
| 16 | 202411011580-CORRESPONDENCE-OTHERS [19-02-2025(online)].pdf | 2025-02-19 |
| 17 | 202411011580-COMPLETE SPECIFICATION [19-02-2025(online)].pdf | 2025-02-19 |