DESC:TITLE

SYSTEM AND METHOD FOR HIGH-SPEED CAN DATA PARSING ON SERVER SIDE OVER GSM NETWORK IN IOT SYSTEMS
BACKGROUND
TECHNICAL FIELD
[001] The present disclosure relates to a system and method for high-speed CAN data parsing on server side over GSM network in IOT systems, and specifically, the present invention relates to capturing Controller Area Network (CAN) data of CAN bus devices using IOT device and perform data parsing on server side to support high speed data transfer and monitoring of CAN bus devices.
BACKGROUND ART:
[002] A Controller Area Network (CAN bus) is a vehicle bus standard designed to allow microcontrollers and devices to communicate with each other's applications without a host computer. The conventional IOT systems for Controller Area Network (CAN) bus monitoring captures CAN data on edge device. The edge device is any piece of hardware that controls data flow at the boundary between two networks. The edge devices fulfil a variety of roles, depending on what type of device they are, but they essentially serve as network entry or exit points.
[003] Based on required parameters which depends on type of equipment being monitored for CAN data, the IOT performs basic data parsing to construct structured fixed length CAN ID data string as per requirements of CAN bus. This data is sent to the server for further parsing. The CAN data capture, processing and useful string construction causes significant operational power along with memory needs. This limits the frequency at which data can be read from CAN bus systems and provided to server. The scaling of these edge devices to support high frequency data capture and transfer is not practical and cost-effective solution.
[004] Accordingly, there is a need for a system and method for high-speed CAN data parsing on server side over GSM network in IOT systems, which overcomes the drawbacks of the prior art.
OBJECT OF THE INVENTION
[005] An objective of the present invention is to reduce processing load on IOT device.
[006] Another object of the present is to circumvents memory constraints and supports high speed data capture with less than a second frequency from CAN bus.
[007] Another object of the invention is to reduce the processing load on the IoT device by offloading data processing responsibilities to a server, thereby enhancing the overall efficiency and performance of the IoT system.
[008] Yet another object of the invention is to circumvent memory constraints on the edge device by enabling the transmission of very small CAN ID batches to the server, which supports variable batch size CAN data. This approach minimizes the memory requirements on the edge device while maintaining high-speed data capture capabilities.
[009] Yet another object of the invention is to provide a robust and effective method for handling high-speed CAN data on the CAN bus, ensuring that data is captured with a frequency of less than a second. This ensures timely and accurate data collection, which is critical for real-time applications.
[0010] A further object of the invention is to utilize a time series-based dictionary structure to construct the required structured CAN data with granular timestamps. This method optimizes resource utilization and ensures that the data is organized efficiently for subsequent analysis and processing.
[0011] Another object of the invention is to enhance the robustness of IoT systems by providing a more efficient and effective approach to high-speed CAN data handling, thereby improving the reliability and performance of the system in various applications.
SUMMARY
[0012] This summary is not intended to identify essential features of the claimed subject matter nor is it intended for use in limiting the scope of the claimed subject matter.
[0013] In accordance with an embodiment of the present invention, a system and method are provided for capturing and parsing Controller Area Network (CAN) data using an Internet of Things (IoT) device in conjunction with a server. The IoT device is configured to capture raw CAN data from various CAN bus devices and transmit it in variable-size batches to the server. The server then performs data parsing using a time series data pool structure based on CAN ID index, constructing structured CAN data strings with granular timestamps, which are optimized for resource utilization. This system and method aim to reduce the processing load on the IoT device and circumvent memory constraints while supporting high-speed data capture with frequencies less than one second from the CAN bus.
[0014] In accordance with an embodiment of the present invention, the system for monitoring CAN data includes an IoT device and a server. The IoT device is equipped with sensors and interfaces that allow it to capture CAN data from a variety of CAN bus devices, including those used in automation in buildings, elevators, ships, lighting control systems, battery management systems, vehicle CAN systems, and heavy equipment. The IoT device captures CAN data at frequencies less than one second, ensuring real-time or near-real-time data capture. The device is designed to reduce processing load and memory requirements, thereby optimizing performance. The captured CAN data is transmitted in variable-size batches of CAN IDs to the server, which supports variable batch sizes, thus reducing memory requirements on the edge device.
[0015] According to another embodiment, the server plays a critical role in the system by receiving the transmitted CAN IDs from the IoT device. The server is equipped with high-speed data transfer capabilities and performs data parsing using a time series data pool structure based on CAN ID index. This structure allows for efficient handling of variable data chunks transmitted by the IoT device. The server constructs structured CAN data strings with granular timestamps, optimized for resource utilization. This ensures that the data is processed efficiently and made available for further analysis or monitoring. The server's data parsing mechanism is designed to handle high-speed data transfer and monitoring, ensuring the integrity of the data and facilitating detailed analysis.
[0016] In accordance with another embodiment, the system is designed to be compatible with a wide range of CAN bus devices, including those used in different industries such as automotive, industrial automation, and heavy equipment. The modular design of the IoT device and server allows for easy integration into existing CAN bus networks without requiring significant changes to the infrastructure. This compatibility and modularity ensure that the system can be deployed in various environments, enhancing its applicability and utility.
[0017] According to another embodiment, the method for high-speed CAN data parsing involves capturing raw CAN data from CAN bus devices using the IoT device and performing data parsing on the server side. The IoT device captures raw CAN data at frequencies less than one second and transmits this data in variable-size batches of CAN IDs to the server for further processing. The IoT device is designed to operate efficiently, reducing processing load and memory requirements during data capture. On the server side, the received CAN data is parsed using a time series data pool structure based on CAN ID index. This method ensures that data is efficiently processed and prepared for further analysis. The server constructs structured CAN data strings with granular timestamps, optimizing resource utilization and ensuring high-speed data transfer and monitoring.
[0018] In accordance with another embodiment, the method optimizes resource utilization by structuring CAN data strings with granular timestamps. The parsing process on the server ensures that data is handled efficiently, reducing the overall processing time and resource consumption. This optimization is crucial for maintaining high-speed data transfer and monitoring, ensuring that the system can handle the demands of real-time or near-real-time data capture and analysis. The proposed invention thus overcomes the limitations of existing systems, making the IoT system more robust and effective for high-speed CAN data handling for the CAN bus.
[0019] In an implementation a system for monitoring Controller Area Network (CAN) data is disclosed. The system comprises an Internet of Things (IOT) device 104 configured to capture raw CAN data from CAN bus devices and transmit variable size batches of CAN IDs. Further a server 106 configured to receive the transmitted CAN IDs and perform data parsing using a time series data pool structure based on CAN ID index.
[0020] In another implementation A method for high-speed CAN data parsing in an IOT system is disclosed. The method comprises receiving 404 a captured CAN data by an edge device. Parsing 406, the captured CAN data to construct a structured variable-length CAN ID data string. Transmitting 408, the constructed CAN ID data string to a server.
BRIEF DESCRIPTION OF THE DRAWINGS
[0021] The detailed description is described with reference to the accompanying figures.
[0022] Figure 1 and 2 shows block diagrams of a system for system for high-speed CAN data parsing on server side over GSM network in IOT systems
[0023] Figure 3 is a flowchart of a method for high-speed CAN data parsing on server side over GSM network in IOT systems, in accordance with the present invention.
[0024] Figure 4, illustrate another exemplary method in accordance with an exemplary embodiment.
[0025] Figure. 5 is a block diagram that describes a system 500, according to some embodiments of the present disclosure.
[0026] It should be appreciated by those skilled in the art that any block diagrams herein represent conceptual views of illustrative systems embodying the principles of the present invention. Similarly, it will be appreciated that any flowcharts, flow diagrams, and the like represent various processes which may be substantially represented in computer readable medium and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
DETAILED DESCRIPTION OF THE INVENTION
[0027] The embodiments herein provide a method and system for high-speed CAN data parsing on server side over GSM network in IOT systems.
[0028] Throughout this application, with respect to all reasonable derivatives of such terms, and unless otherwise specified (and/or unless the particular context clearly dictates otherwise), each usage of:
“a” or “an” is meant to read as “at least one.”
“the” is meant to be read as “the at least one.”
References in the specification to “one embodiment” or “an embodiment” mean that a particular feature, structure, characteristic, or function described in connection with the embodiment is included in at least one embodiment. The appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment.
[0029] Hereinafter, embodiments will be described in detail. For clarity of the description, known constructions and functions will be omitted.
[0030] Parts of the description may be presented in terms of operations performed by at least one processor, electrical / electronic circuit, a computer system, using terms such as data, state, link, fault, packet, and the like, consistent with the manner commonly employed by those skilled in the art to convey the substance of their work to others skilled in the art. As is well understood by those skilled in the art, these quantities take the form of data stored/transferred in the form of non-transitory, computer-readable electrical, magnetic, or optical signals capable of being stored, transferred, combined, and otherwise manipulated through mechanical and electrical components of the computer system; and the term computer system includes general purpose as well as special purpose data processing machines, switches, and the like, that are standalone, adjunct or embedded. For instance, some embodiments may be implemented by a processing system that executes program instructions so as to cause the processing system to perform operations involved in one or more of the methods described herein. The program instructions may be computer-readable code, such as compiled or non-compiled program logic and/or machine code, stored in a data storage that takes the form of a non-transitory computer-readable medium, such as a magnetic, optical, and/or flash data storage medium. Moreover, such processing system and/or data storage may be implemented using a single computer system or may be distributed across multiple computer systems (e.g., servers) that are communicatively linked through a network to allow the computer systems to operate in a coordinated manner.
[0031] According to an embodiment, the present invention provides a system for high-speed CAN data parsing on server side over GSM network in IOT systems.
[0032] In an implementation according to one of the embodiments of the present invention, the system comprises a first module for capturing Controller Area Network (CAN) data of CAN bus devices using IOT device. In an embodiment, the CAN bus devices include but not limited to devices used automation in buildings, used in elevators, ships, lighting control systems, battery management system, vehicle CAN systems, heavy Equipment, and any equipment having CAN bus.
[0033] The system further comprises a second module for performing data parsing on server side to support high speed data transfer and monitoring of multiple and different types of devices such as devices used automation in buildings, used in elevators, ships, lighting control systems, battery management system, vehicle CAN systems, heavy Equipment, or any equipment having CAN bus.
[0034] The IOT device of the system captures raw CAN data continuously and keeps sending in variable size batches of different CAN IDs. Specifically, the server is capable of handling this variable data chunks using time series data pool structure based on CAN ID index and ensures correct data string construction of parsed data at massive scale for the connected multiple and different types of devices.
[0035] This helps in reduced processing load on IOT device, circumvents memory constraints and supports high speed data capture with less than a second frequency from CAN bus.
[0036] In another aspect, the present invention provides a method for high-speed CAN data parsing on server side over GSM network in IOT systems. At first step, the method comprises for capturing Controller Area Network (CAN) data of CAN bus devices using IOT device. In an embodiment, the CAN bus devices include but not limited to devices used in battery management system, vehicle CAN systems, heavy Equipment, and any equipment having CAN bus.
[0037] In an implementation, the IOT device captures raw CAN data continuously and keeps sending in variable size batches of different CAN IDs. Specifically, the server is configured for handling this variable data chunks from multiple and different types of CAN devices using time series data pool structure based on CAN ID index and ensures correct data string construction of parsed data at massive scale.
[0038] At second step, the method comprises performing data parsing on server side to support high speed data transfer and monitoring of CAN bus devices.
[0039] The method of the present invention helps in reducing resource needs such as CPU, memory on edge device making it cost effective to support granular frequencies of CAN data handling for CAN bus using IOT. Further, the generic capability of capturing CAN data for any type of equipment makes the firmware light weight and robust.
[0040] The present invention relates to a system and method for capturing and parsing Controller Area Network (CAN) data using an Internet of Things (IoT) device in conjunction with a server. The invention aims to reduce the processing load on the IoT device and circumvent memory constraints while supporting high-speed data capture from the CAN bus with a frequency of less than one second. The system leverages a time series-based dictionary structure to construct structured CAN data with granular timestamps, optimizing resource utilization.
[0041] The system comprises an IoT device and a server. The IoT device captures raw CAN data from various CAN bus devices and transmits it in variable-size batches to the server. The server performs data parsing using a time series data pool structure based on CAN ID index, constructing structured CAN data strings with granular timestamps. This approach ensures efficient handling of data and reduces the memory requirements on the IoT device.
[0042] The IoT device is equipped with sensors and interfaces that allow it to capture CAN data from a variety of CAN bus devices. These devices may include those used in battery management systems, vehicle CAN systems, and heavy equipment. The IoT device captures CAN data at frequencies less than one second, ensuring real-time or near-real-time data capture. The device is designed to reduce processing load and memory requirements, optimizing performance.
[0043] The server plays a critical role in the system by receiving the transmitted CAN IDs from the IoT device. The server is equipped with high-speed data transfer capabilities and performs data parsing using a time series data pool structure. This structure is based on CAN ID index, which allows for efficient handling of variable data chunks transmitted by the IoT device. The server constructs structured CAN data strings with granular timestamps, optimized for resource utilization, ensuring that the data is processed efficiently and made available for further analysis or monitoring.
[0044] The server’s data parsing mechanism is designed to handle high-speed data transfer and monitoring. The time series data pool structure allows for accurate and efficient parsing of data based on CAN ID index. This structure ensures the integrity of the data and facilitates the construction of structured CAN data strings with granular timestamps, which are crucial for detailed analysis and monitoring.
[0045] The system is designed to be compatible with a wide range of CAN bus devices, including those used in different industries such as automotive, industrial automation, and heavy equipment. The modular design of the IoT device and server allows for easy integration into existing CAN bus networks without requiring significant changes to the infrastructure.
[0046] The method for high-speed CAN data parsing involves capturing raw CAN data from CAN bus devices using the IoT device and performing data parsing on the server side. The server handles variable data chunks from the IoT device using a time series data pool structure based on CAN ID index.
[0047] The IoT device captures raw CAN data at frequencies less than one second. This data is transmitted in variable size batches of CAN IDs to the server for further processing. The IoT device is designed to operate efficiently, reducing processing load and memory requirements during data capture.
[0048] On the server side, the received CAN data is parsed using a time series data pool structure based on CAN ID index. This method ensures that data is efficiently processed and prepared for further analysis. The server constructs structured CAN data strings with granular timestamps, optimizing resource utilization and ensuring high-speed data transfer and monitoring.
[0049] The method optimizes resource utilization by structuring CAN data strings with granular timestamps. The parsing process on the server ensures that data is handled efficiently, reducing the overall processing time and resource consumption.
[0050] An embodiment of the present invention may include variations where the IoT device is equipped with additional sensors to capture other types of data, such as temperature or pressure, alongside CAN data. Another embodiment may involve the server using machine learning algorithms to predict potential issues based on the parsed CAN data, providing proactive maintenance alerts.
[0051] The invention provides significant benefits by reducing the processing load on the IoT device and circumventing memory constraints. The technical features that enable these advantages include the use of a time series-based dictionary structure for data parsing and the ability to handle variable-size data batches. This results in optimized resource utilization, high-speed data capture, and efficient data processing, making the system robust and effective for high-speed CAN data handling.
[0052] Referring to Figure 1, illustrates a block diagram in accordance with an exemplary embodiment of the present disclosure. In accordance with the exemplary embodiment the system 100 as illustrated comprises a plurality of CAN Bus controller 102 configured to capture CAN data from various sources like BMS, vehicle, and/or heavy equipment. Further each CAN bus controller 102 may be communicably connected to a corresponding IoT device/edge device 104 from a plurality of IoT devices/edge devices 104. The CAN data captured by the each of CAN Bus controller 102 from the various sources is transmitted or sent over a communication means known in the art, to the corresponding IoT device/edge device 104.
[0053] The plurality of IoT device/edge device 104 are further communicably connected over the communication means to a server 106. The server 106, is configured to receive the captured CAN data and further process the data at the server 106. The captured data may be received as a part of strings having unique CAN ID.
[0054] Now referring to Figure 2, illustrates another block diagram in accordance with an exemplary embodiment of the present disclosure. The system 100, as disclosed may be configured to capture the CAN data by the plurality of CAN Bus controller 102 at defined interval configured to capture CAN data from various sources like BMS, vehicle, and/or heavy equipment. The CAN data captured by the each of CAN Bus controller 102 from the various sources is transmitted or sent over the communication means to the corresponding IoT device/edge device 104 within a defined interval.
[0055] Further the server 106, is configured to receive the captured CAN data and further process the data at the server 106. The captured data may be received as a part of strings having unique CAN ID.
[0056] Figure 3, illustrates a method for perform data parsing on server side to support high speed data transfer and monitoring of CAN bus devices. In accordance with the exemplary embodiment, the method 200 comprises capturing CAN Data, from the various sources, using the plurality of CAN Bus controller. Further transferring the captured CAN data to the plurality of IoT devices/edge devices. The captured CAN data along with the unique CAN ID is further sent to the server. The CAN ID may be configured to comprise the captured data along with a string of characters to enable identification of each of the IoT devices/edge devices at the server.
[0057] In accordance with exemplary embodiment, verifying and authenticating the IoT device/edge device by the server upon receiving captured data. Further receiving the CAN ID for the authenticated IoT devices. The CAN ID are processed further to extract the captured data from the CAN ID. The captured CAN data is mapped with existing data in a data pool. The data pool may be configured to consist data collected from the plurality of IoT devices including any historical data. Further selecting latest data from the from the mapped CAN data or the data pool based on the timestamp.
[0058] The selected data in accordance with the exemplary embodiment, is further merged with the existing data pool. The server is further configured to detect and determine if the data pool has reached a defined threshold, and process data. Further the older data may be removed from the data pool.
[0059] Now referring to Figure 4, illustrate another exemplary method in accordance with an exemplary embodiment. The method 400 at 402, the method may include capturing CAN data by a CAN Bus controller. At 404, the method may include receiving the captured CAN data by an edge device. At 406, the method may include parsing the captured CAN data to construct a structured variable-length CAN ID data string. At 408, the method may include transmitting the constructed CAN ID data string to a server. In some embodiments, the CAN Bus controller may be communicably coupled with an apparatus or various sources. In some embodiments, the edge device may be an Internet of Things (IoT)device. In some embodiments, parsing the captured CAN data may be based on predetermined parameters. In some embodiments, the method may include processing the CAN signals after transmitting the CAN ID data string to the server.
[0060] At 410, the method may include identifying and extracting data within the CAN ID. In some embodiments, at 412, the method may include mapping the extracted data from the specific CAN ID with an existing data pool. In some embodiments, the existing data pool may be configured to comprise extracted data previously received from a plurality of CAN IDs.
[0061] At 410 the method may include identifying and extracting data within the CAN ID. In some embodiments, at 412, the method may include mapping the extracted data from the specific CAN ID with an existing data pool. In some embodiments, at 414, the method may include merging data in case the data in the data pool may be not current. In some embodiments, at 416, the method may include checking if the data pool has reached a threshold value.
[0062] Figure. 5 is a block diagram that describes a system 500, according to some embodiments of the present disclosure. In some embodiments, the system 500 may include a CAN Bus controller 510 configured to capture CAN data, an edge device 520 configured to receive the captured CAN data from the CAN Bus controller 510, a server 530 configured to receive a structured variable-length CAN ID data string from the edge device 520, and a data processing module 540 configured to parse the captured CAN data and construct the CAN ID data string.
[0063] In some embodiments, the edge device 520 may be an Internet of Things (IoT)device. In some embodiments, the data processing module 540 may be further configured to identify and extract data within the CAN ID. In some embodiments, the server 530 may include a data pool module configured to map the extracted data with an existing data pool. In some embodiments, the data pool module may be further configured to merge data in case the data in the data pool may be not current. In some embodiments, the data pool module may be further configured to check if the data pool. Reached a threshold value. In some embodiments, the data processing module 540 may be further configured to process the CAN signals after constructing the CAN ID data string.
[0064] In some embodiments, the disclosed techniques can be implemented, at least in part, by computer program instructions encoded on a non-transitory computer-readable storage media in a machine-readable format, or on other non-transitory media or articles of manufacture. Such computing systems (and non-transitory computer-readable program instructions) can be configured according to at least some embodiments presented herein, including the processes shown and described in connection with figures.
[0065] Further, while one or more operations have been described as being performed by or otherwise related to certain modules, devices or entities, the operations may be performed by or otherwise related to any module, device or entity.
[0066] Further, the operations need not be performed in the disclosed order, although in some examples, an order may be preferred. Also, not all functions need to be performed to achieve the desired advantages of the disclosed system and method, and therefore not all functions are required.
,CLAIMS:We Claim

1. A system for monitoring Controller Area Network (CAN)data comprising:
an Internet of Things (IOT) device 104 configured to capture raw CAN data from CAN bus devices and transmit variable size batches of CAN IDs; and
a server 106 configured to receive the transmitted CAN IDs and perform data parsing using a time series data pool structure based on CAN ID index.
2. The system of claim 1, wherein the CAN bus devices include at least one of devices 102 used in automation in buildings, elevators, ships, lighting control systems, battery management systems, vehicle CAN systems, and heavy equipment.
3. The system of claim 1, wherein the server is further configured to construct structured CAN data strings with granular timestamps.
4. The system of claim 3, wherein the structured CAN data strings are optimized for resource utilization.
5. The system of claim 1, wherein the IOT device 104 is configured to capture CAN data at frequencies less than one second.
6. The system of claim 1, wherein the server 106 supports high-speed data transfer and monitoring of the CAN bus devices 102.
7. The system of claim 1, wherein the IOT device 104 is configured to reduce processing load and memory requirements.
8. A method for high-speed CAN data parsing in an IOT system comprising:
capturing raw CAN data from CAN bus devices using an IOT device; and
performing data parsing on a server side, wherein the server is configured to handle variable data chunks from the IOT device using a time series data pool structure based on CAN ID index.
9. The method of claim 8, wherein the server constructs structured CAN data strings with granular timestamps from the parsed data.
10. The method of claim 9, wherein the structured CAN data strings are optimized for resource utilization.
11. The method of claim 8, wherein the capturing of CAN data is performed at frequencies less than one second.
12. The method of claim 8, wherein the server supports high-speed data transfer and monitoring of the CAN bus devices.
13. The method of claim 8, wherein the IOT device reduces processing load and memory requirements during CAN data capture.
14. A method for high-speed CAN data parsing in an IOT system comprising:
receiving 404 a captured CAN data by an edge device;
parsing 406, the captured CAN data to construct a structured variable-length CAN ID data string; and
transmitting 408, the constructed CAN ID data string to a server.
15. The method of claim 14, comprises identifying and extracting 410, data within the CAN ID.
16. The method of claim 14, comprises mapping 412, the extracted data from the specific CAN ID with an existing data pool.
17. The method of claim 14, comprises merging data 414, in case the data in the data pool is not current.
18. The method of claim 14, comprises checking 416, if the data pool has reached a threshold value.
Dated this on 06th day of September, 2024