DESC:
BACKGROUND

[0001] Embodiments of the present disclosure relate generally to a simulation system for testing a device and a method of operating the same, and more particularly to an improved RADAR simulation system.
[0002] Simulation systems are used to imitate operations of various real world tasks or processes, where complex interactions among multiple variables may be described using numerical models, which may be further used to study and analyze the behavior of a device.
[0003] One such simulation system includes a system that simulates an object detection system, which is used to locate objects in a desired operating environment. The object detection systems use various technologies to locate the object such as Radio Detection And Ranging (RADAR), Sound Navigation And Ranging (SONAR), and Light Detection And Ranging (LIDAR). Such object detection systems locate objects from an echo of a signal generated by the object detection systems. Generally, such systems are used in numerous applications to detect objects such as aircrafts, ships, space crafts, submarines, guided missiles, motor vehicles, weather formations, mines, and terrains. However, prior to deployment of such systems for use in the aforementioned applications, the systems are tested using various methods.
[0004] One such testing method includes a simulation method. The simulation method includes a simulation system, which tests the object detection system in multiple situations. However, often the same simulation system may be incapable of testing multiple types of systems at different signal frequencies.
[0005] Furthermore, certain conventional simulation systems include one or more antennae, which are placed in an open environment along with the object detection system under test. Such a configuration leads to generation of undesirable echo in the simulation system that interferes with signals used for testing the object detection system, thus making the simulation system inaccurate and unreliable.
[0006] Moreover, conventional simulation systems receive signals from the object detection system and generate and transmit desired signals representative of signals reflecting off of target objects towards the object detection system in response to the received signals. As conventional simulation systems first receive signals from the object detection system and subsequently process the received signals to get a modified signal that is transmitted back to the object detection system, the object detection process incurs a processing time delay. Such delay in processing limits the use of the conventional simulation systems to only a few test case scenarios. In particular, the delay may preclude use of conventional simulation systems in real-time applications.
[0007] Furthermore, conventional simulation systems may often prove to be incapable of generating complex test scenarios. Consequently, the object detection system needs to be deployed in a final product for complete testing. For example, in automotive applications, a RADAR used for Adaptive Cruise Control (ACC) feature is tested only when a target vehicle is available. Delaying validation of object detection systems such as RADAR systems until the target vehicle becomes available results in additional effort, time, and resources for comprehensive in-target testing and any required redesign.
[0008] Hence, there is a need for an improved simulation system to address the aforementioned issues.

BRIEF DESCRIPTION

[0009] In accordance with one embodiment of the disclosure, a system configured to test a device is provided. The system includes one or more signal generation circuitry configured to generate signals corresponding to at least one selected type and at least one frequency range and to apply one or more determined offsets to the signals. The system also includes a simulation system operatively coupled to the signal generation circuitry and configured to receive at least one log file comprising one or more time-stamped outputs generated by a simulated device under test operating in a simulated test case scenario that is defined in an object dynamics file, one or more selected characteristics of an actual device under test, one or more noise conditions defined for the simulated test case scenario, or combinations thereof, wherein the simulated device under test corresponds to an actual device under test that is configured to transmit and receive the signals. The simulation system is further configured to transmit one or more control signals to at least one selected circuitry from the one or more signal generation circuitry to generate and transmit the signals having the defined noise and the determined offsets to the actual device under test.
[0010] In accordance with another embodiment of the present disclosure, a system to test a device is provided. The system includes one or more signal generation circuitry configured to generate signals corresponding to at least one selected signal type and at least one frequency range, and to apply one or more determined offsets to the signals. The system also includes a test system for testing an actual device under test, wherein the test system is configured to receive object dynamics information corresponding to a simulated test case scenario comprising one or more simulated objects and generate one or more reference outputs corresponding to the actual device under test based on the object dynamics information, wherein the one or more simulated objects comprise at least one simulated device under test corresponding to the actual device under test that is configured to transmit and receive the signals, and at least one simulated target object that comprises the simulated device under test. The system further includes a simulation system operatively coupled to one or more of the test system, and the signal generation circuitry, and configured to receive at least one log file comprising one or more time-stamped outputs generated by the simulated device under test in the simulated test case scenario, one or more selected characteristics of an actual device under test, one or more noise conditions defined for the simulated test case scenario, or combinations thereof. The simulation system is further configured to transmit one or more control signals to at least one selected circuitry from the one or more signal generation circuitry to generate and transmit the signals having the defined noise and the determined offsets to the actual device under test, wherein the test system is further configured to receive one or more outputs generated by the actual device under test, wherein the actual device under test generates the outputs based on the signals received from the selected circuitry and the object dynamics information corresponding to the target object that is received from the test system. The test system is further configured to validate performance of the actual device under test in the simulated test case scenario based on a comparison of the received outputs and the one or more reference outputs.
[0011] In accordance with yet another embodiment of the present disclosure, a method for testing a device is provided. The method includes defining a simulated test case scenario comprising one or more simulated objects, wherein the one or more simulated objects comprise at least one simulated device under test corresponding to an actual device under test that is configured to transmit and receive signals corresponding to a selected frequency range and at least one target object that comprises the simulated device under test. The method also includes generating an object dynamics file based on the defined simulated test case scenario. The method further includes generating at least one log file comprising one or more time-stamped outputs generated by the simulated device under test operating in the simulated test case scenario. The method further includes updating the log file based on the selected characteristics of an actual device under test, the noise conditions defined for the simulated test case scenario, or a combination thereof. The method further includes executing the object dynamics file in a test system and the updated log file in a simulation system, wherein execution of the object dynamics file in the test system and the updated log file in the simulation system are time synchronized. The method further includes determining one or more reference outputs corresponding to the simulated device under test operating in the simulated test case scenario based on the execution of the object dynamics file in the test system. The method further includes generating the signals having the defined noise and one or more determined offsets using one or more selected signal generation circuitry based on the updated log file. The method further includes transmitting the generated signals and at least a portion of the object dynamics information corresponding to the target object to the actual device under test, wherein the object dynamics information is determined based on the execution of the object dynamics file in the test system. The method further includes receiving one or more outputs generated by the actual device under test at the test system, wherein the actual device under test is configured to generate the outputs based on the signals received from the selected circuitry and the selected object dynamics information. The method further includes validating performance of the actual device under test in the simulated test case scenario in the test system based on a comparison of the received outputs and the one or more reference outputs.

BRIEF DESCRIPTION OF DRAWINGS

[0012] FIG. 1 is a block diagrammatic representation of a system for testing a device, in accordance with an embodiment of the present disclosure;
[0013] FIG. 2 a graphical representation of an exemplary chamber including the device under test of FIG. 1, in accordance with an embodiment of the present disclosure;
[0014] FIG. 3 is a block diagrammatic representation of an exemplary architecture of the system of FIG. 1, in accordance with an embodiment of the present disclosure;
[0015] FIG. 4 is a graphical representation of an exemplary arrangement of a plurality of phased array antennae of FIG. 1, in accordance with an embodiment of the present disclosure; and
[0016] FIG. 5 is a flow chart representing an exemplary method for testing a device using the system of FIG. 1, in accordance with an embodiment of the present disclosure.

DETAILED DESCRIPTION

[0017] Embodiments of the present disclosure relate to a system for testing a device and a method of operating the same. Particularly, the embodiments presented herein describe an improved simulation system that allows for simulation of a plurality of complex test scenarios for validating a device under test (DUT) without requiring presence of an actual system in which the DUT is to be deployed. In particular, the simulation system provides a distinctive system configuration and novel simulation protocols to accurately simulate real world signal characteristics experienced by the DUT in real-time to allow for validation of the DUT performance.
[0018] For clarity, embodiments of the present systems and methods are described with reference to an improved RADAR simulation system configured to test a RADAR DUT. However, it may be noted that the embodiments described herein may similarly be used for simulating a SONAR, LIDAR, or any other sensor-based DUT that employs signals of specific frequencies and types for object detection, ranging, and functional feature implementation. The functional features may include specific sets of functions and/or operations associated with the actual system that may be performed based on measurements determined by the DUT to achieve a desired functionality during operation of the actual system. For example, when implementing a desired ACC functionality in a vehicle (actual system), RADAR sensors in the DUT may determine measurements corresponding to the distance, relative velocity, and angle of the actual system with respect to a target vehicle. The DUT may use the determined measurements to control additional systems such as brake and engine subsystems in the actual vehicle and their corresponding functioning to provide ACC functionality, for example, by maintaining a safe distance between the actual vehicle and the target vehicle. The present systems and methods may be used to simulate such functional features of the DUT for validating performance of the DUT in a desired test case scenario. Certain exemplary embodiments of the present systems and methods for efficient validation of a DUT are described in detail with reference to FIGs. 1-5.
[0019] FIG. 1 is a block diagrammatic representation of an exemplary system (100) for simulating a plurality of test scenarios for validating performance of a DUT (102). In one embodiment, the DUT (102) includes a RADAR sensor to be deployed in a target vehicle (not shown in FIG. 1) and configured to provide functional requirements, object detection and ranging functions along with the with the embedded devices which operate and control the RADAR sensor. For example, the DUT (102) may correspond to an electronic control unit (ECU) including a RADAR sensor for implementing functions such as adaptive cruise control (ACC), Blind Spot Monitoring, or forward collision warning (FCW). According to aspects of the present disclosure, the system (100) may be configured to validate performance of the RADAR DUT (102), for example, when executing the previously noted functions. To that end, the system (100) includes a simulation system (104) operatively coupled to a test system (106) via a serial communication link (110) and a real-time processing system (108) via a serial communications link (112) to simulate a desired test environment for validating functioning of the RADAR DUT (102). In certain embodiments, the test system (106) and the real-time processing system (108) form part of the system (100). In certain other embodiments, however, the test system (106) and the real-time processing system (108) may be independent computing devices available with a user that may be operatively coupled to the system (100) when simulating the desired test case scenario for verifying performance of the RADAR DUT (102).
[0020] Typically, different types of RADAR sensors operate using signals of different types and different frequency ranges. Conventional simulation systems typically allow validation of a single type of RADAR sensor. Unlike such conventional simulation systems, the system (100) allows for validation of different types of RADAR sensors that operate using different signal types and frequencies. Accordingly, in certain embodiments, the system (100) includes one or more signal generation circuitry (114) that may be selectively configured to generate signals corresponding to one or more signal types and frequency ranges for simulating a plurality of obstacles having different properties for validating functioning of different types of the RADAR DUT (102). The system (100) further includes one or more antennae (116) operatively coupled to the signal generation circuitry (114) and/or the simulation system (104) and configured to selectively transmit to, and receive signals corresponding to a selected type and frequency range from the RADAR DUT (102). In one embodiment, the antennae (116) are enclosed in a chamber (118) along with the RADAR DUT (102) to provide a controlled environment for testing performance of the RADAR DUT (102).
[0021] FIG. 2 is a schematic representation (200) of the chamber (118) including the actual RADAR DUT (102) and one or more antennae (116) depicting an angle of arrival of an obstacle as interpreted by the RADAR DUT (102). The chamber (118) is used to enclose the RADAR DUT (102), whereas the one or more antennae (116) are configured to transmit and receive the signals generated by the one or more signal generation circuitry (114). Frequently, the signals generated by the RADAR DUT (102) and/or transmitted by the antennae (116) may reflect from the walls of the chamber (118). The RADAR DUT (102) may misinterpret the reflected signals as an obstacle, thus resulting in erroneous object detection and/or distance measurements. Accordingly, the chamber (118) is made of a material such as iron ball paint absorbing, foam absorbing, Jaumann absorbing, split-ring resonator absorbing or carbon nanotube material that is capable of absorbing unwanted radio frequency (RF) signals, while ensuring that only desired signals with selected offsets reaches the RADAR DUT (102) during the testing.
[0022] According to aspects of the present disclosure, the system (100) may be configured to simulate a plurality of complex test case scenarios for validating performance of the RADAR DUT (102) in a test environment. FIG. 3 depicts a block diagram (300) of an exemplary architecture of the test environment for simulating a plurality of test case scenarios for validating performance of the RADAR DUT (102). As shown in FIG. 3, the test system (106) may include a dynamics animation module (302) configured to simulate various aspects of a desired test case scenario based on multi-paradigm mathematical models generated using object dynamics animation software. To that end, the test system (106) may correspond to a computing device including, but not limited to, one or more application-specific processors, graphical processing units, digital signal processors, microcomputers, microcontrollers, Application Specific Integrated Circuits, and/or Field Programmable Gate Arrays.
[0023] Further, the test system (106) may also include one or more input-output devices (not shown) that allow a user to configure various aspects of a desired test scenario that may be simulated based on the multi-paradigm mathematical models. For example, if the target corresponds to an automobile and if the DUT corresponds to a RADAR based ECU like an Adaptive Cruise Control ECU, then the mathematical models may describe various parameters and actions corresponding to a steering wheel, suspension system, vehicle engine system, transmission module, brake module, etc. In particular, the mathematical models may aid in automatically accounting for real-world parameters, such as a real delay caused by a real vehicle when simulating various aspects of the desired test case scenario. For example, when the vehicle is steered to the right side, there will be a delay as change in steering angle requires rotation of certain mechanical parts in the vehicle. The mathematical models will account for this mechanical delay and model the steering module accordingly to generate an accurate virtual simulation of functioning of a real-world steering module. Similarly, the mathematical models may also be used in calculating vehicle speed and simulating driver behavior, automobile engine, etc.
[0024] In an exemplary implementation that involves testing the RADAR DUT (102) for an Advanced Emergency Braking (AEB) ECU, the test system (106) may allow a user to select the actual model or variant of the target vehicle. Additionally, the user may also select a range, angle, and other characteristics of the RADAR DUT (102) to be positioned within the target vehicle. Selection of the actual model results in execution of appropriate sequences of the dynamics animations software by the dynamics animation module (302) to automatically add the appropriate vehicle dynamics in the background during simulation of the desired test case scenario. Further, the dynamics animation module (302) may also simulate the RADAR DUT (102) with desired characteristics positioned at an exact location within the target vehicle as per defined specifications.
[0025] Additionally, the dynamics animation module (302) may simulate other objects participating in the test case scenario such as surrounding vehicles, different types of road, pedestrians, roadside signs, trees, and other related objects. The dynamics animation module (302) may also simulate characteristics associated with the participating objects such as a relative size, a relative position, different vehicle speeds, an angle of approaching the target vehicle, and an overall duration of a scenario to simulate the overall test case scenario. In one embodiment, the dynamics animation module (302) creates the complete target vehicle model along with RADAR DUT (102) model in background once the overall test scenario is simulated. The dynamics animation module (302) stores the models corresponding to the target vehicle dynamics with the simulated RADAR DUT (102), surrounding objects, and the overall test scenario in an object dynamics file.
[0026] Subsequently, the test system (106) executes the simulated test case scenario using the stored mathematical models. Execution of the simulated test case scenario generates RADAR sensor data, for example, including vehicle detected, detected distance from tested vehicle, angle of approach, speed of approaching vehicle, type of vehicle, dimensions of detected vehicle, and timestamp information. The test system (106) stores the RADAR sensor data in a RADAR log file with appropriate time stamp. Thus, configuration of the desired test case scenario in the test system (106) produces the object dynamics file including the complete vehicle dynamics along with the object dynamics information corresponding to other objects participating in the test scenario, and the RADAR log file including RADAR sensor data with corresponding time stamp.
[0027] Once the test case scenario is configured, configuration of the actual RADAR DUT (102) to be used in the target vehicle may be identified. To that end, the test system (106) may transmit the RADAR log file to a RADAR simulation module (304). As previously noted, the RADAR log file includes one or more time-stamped outputs generated by the simulated RADAR DUT (102) operating in the simulated test case scenario that is defined in the object dynamics file. In one embodiment, the operating frequencies of the simulated RADAR DUT (102) may be selected based on the characteristics of the actual RADAR DUT (102) to be used in the target vehicle. Particularly, the RADAR simulation module (304) may select specific frequency ranges to configure the RADAR DUT (102) as a continuous wave RADAR system, a pulsed wave RADAR system, or a frequency modulated continuous wave (FMCW) RADAR system. For example, the RADAR simulation module (304) may select 77 Gigahertz (GHz) or 24 GHz as the center frequency with a sweep bandwidth of 100 Megahertz (MHz) when the RADAR DUT (102) is to be configured to operate in the FMCW mode.
[0028] Typically, characteristics of the RADAR DUT (102) may be identified based on an associated header file. In order to select one or more suitable frequencies associated with the specific type of the RADAR DUT (102), the RADAR simulation module (304) may be configured to include the corresponding header file into the RADAR log file. Alternatively, the RADAR simulation module (304) may be configured to analyze signals generated by the actual RADAR DUT (102). In certain embodiments, the RADAR signals may be acquired by the simulation system (104) and recorded in the RADAR log file. The RADAR log file may subsequently be sent to the test system (106) for analysis by the RADAR simulation module (304).
[0029] In one embodiment, the RADAR simulation module (304) may be configured to process signals generated by the RADAR DUT (102) and extract one or more header files and/or related characteristics from the acquired RADAR signals. For example, the RADAR simulation module (304) may be configured to extract a signal pattern, such as triangular, sine wave, or saw tooth, used by the RADAR DUT (102), and a time delay for transmission and reception of RF waves. The RADAR simulation module (304) may then identify the type of the RADAR DUT (102) based on the extracted characteristics, and add the header files to the RADAR log file, thus aiding in selecting suitable frequencies for simulating operation of the RADAR DUT (102) in the desired test case scenario.
[0030] Additionally, the RADAR simulation module (304) may be configured to add different types of noise values or delay offsets typically present in a real environment corresponding to the desired test case scenario to the RADAR log file. These noise values, for example, may include incorrect or corrupted header waves, incorrect data pertaining to vehicle speed out of range, incorrectly detected vehicle type, and signal level noises caused by vibration in the target vehicle. The noise values may also include, for example, circuit noises related to frequency changes, power variations, incorrectly selected parameters such as incorrectly selecting a saw tooth modulation instead of triangle modulation in case of FMCW. The simulation system (104) may be configured to receive and read the RADAR log file updated with the noise values in order to select suitable configuration information for the simulated RADAR DUT (102), the signal generation circuitry (114), and/or the antennae (116), accordingly.
[0031] Thus, the updated RADAR log file may include all configuration details and RADAR simulation data for accurately simulating the various objects including the RADAR DUT (102) that will be participating in the desired test case scenario. Once updated, the RADAR simulation module (304) may be configured to upload the updated RADAR log file to the simulation system (104), for example, using a serial communication link (120).
[0032] According to certain aspects of the present disclosure, the simulation system (104) employs the signal generation circuitry (114) for generating the RF waves having desired characteristics such as type and frequency defined in the received RADAR log file. For example, the signal generation circuitry (114) may be configured to generate RF signals corresponding to a continuous wave RADAR DUT, a pulsed wave RADAR DUT, or an FMCW DUT. In certain embodiments, the simulation system (104) may selectively operate in a manual mode based on received user input, for example, user selected frequency range, type of RADAR DUT (102) and/or type of waveform. Alternatively, the simulation system (104) may selectively operate in an automatic configuration mode to generate the RF signals with desired characteristics based on characteristics of the actual RADAR DUT (102) defined in the updated RADAR log file. In certain embodiments, the selection of the manual or automatic mode may be based on user input via one or more buttons or a graphical user interface, for example, associated with the simulation system (104) or the test system (106) or based on pre-programmed instructions.
[0033] In one embodiment, the simulation system (104) is configured to select a suitable circuitry from the one or more signal generation circuitry (114) to produce RF signals having the desired type and frequency range. In one embodiment, the signal generation circuitry (114) includes a plurality of circuits capable of generating different types and ranges of signals transmitted or received by different types of the RADAR DUT (102). Alternatively, the simulation system (104) is configured to reconfigure operating parameters of one or more of the signal generation circuitry (114) to produce RF signals having the desired type and frequency range.
[0034] In addition to selecting the suitable signal generation circuitry (114), the simulation system (104) may be configured to activate one or more suitable antennae (116) that are capable of transmitting the RF signals of the selected type and in the selected frequency range. During initial setup of the system (100), the antennae (116) may be activated in the receiving mode to acquire RADAR signals to identify characteristics of the RADAR DUT (102). However, when generating RF signals representative of RADAR signals reflecting off the participating objects in the desired test case scenario, the antennae (116) may be activated in the transmission mode.
[0035] In one embodiment, the simulation system (104) adds the noise values defined in the RADAR log file to the RF signals while testing the RADAR DUT (102). Additionally, the simulation system (104) may apply a determined Doppler frequency shift to the RF signals for emulating a defined obstacle speed when validating an FMCW or a continuous wave RADAR DUT (102). Moreover, the simulation system (104) may apply a determined time shift (delay) to the RF signals for emulating a defined obstacle distance when validating a pulsed (Non Continuous) type of RADAR DUT (102). The RADAR signals, thus generated, include header files comprising the predetermined or user defined RADAR characteristics and defined noise and/or delay.
[0036] Generally, a RADAR system maps the obstacles and identifies the type of obstacles detected by analyzing multiple reflections of RF signals off the obstacles. In order to validate this mapping functionality of the RADAR DUT (102), the simulation system (104) may apply a desired delay in the transmitted RF signals to emulate an obstacle positioned at a determined distance. Additionally, the simulation system (104) may cause generation of RADAR signals indicative of an angle of approach of the obstacle towards the RADAR DUT (102) by controlling an antenna beam pattern.
[0037] In certain embodiments, the simulation system (104) may include a control circuitry (122) for selecting and controlling one or more of the antennae (116) positioned inside the RF absorbing chamber (118) to produce the RF signals according to the obstacle type. To that end, the system (100) may include multiple phased array antennae (116), as shown by means of an exemplary graphical representation (400) in FIG. 4. Specifically, the antennae (116) may be designed to include several small sized phase array antennas that can be selectively configured to direct the antenna beam at various angles towards different directions by applying a determined phase shift. Selective configuration of the antennae (116), thus, aids in simulating RADAR signals representative of different angles of approach and different types of detected obstacles in the simulated test case scenario.
[0038] In certain embodiments, the control circuitry (122) is configured to control a strength of RF signals generated by each of the phase array antennae (116) to simulate a selected angle of approach and the type of the obstacle. In order to allow for individual control, each of the phased array antennae (116) is addressed, for example, with a unique number or label. In an exemplary implementation, the obstacle may correspond to a car that is positioned at a selected distance from the target vehicle housing the RADAR DUT (102) and whose width, height and other mechanical properties are recorded in the RADAR log file. The control circuitry (122) may be configured to provide control signals to one or more of the phased array antennae (116) to produce signals representative of a rough RADAR cross-section of a car with a specific width and height as may be perceived by the RADAR DUT (102) at the selected distance from the target vehicle. Particularly, the phased array antennae (116) may be configured to generate specific signals, which when received and processed by the RADAR DUT (102) allows the RADAR DUT (102) to determine that the detected obstacle type corresponds to a car.
[0039] In addition to simulating the size and shape of the car, a real-time dynamic trajectory of a fixed object such as a roadside sign or a moving object such as another car may also be recreated by appropriate selection of phased array antennae (116) in a particular sequence, linked with time. Furthermore, a distance between the RADAR DUT (102) and the RF antennae (116) in the RF absorbing chamber (118) may varied from a selected minimum range to a selected maximum range to create different beam patterns according to a shape, size and material of the RF absorbing chamber (118).
[0040] In one embodiment, the control circuitry (122) uses the updated RADAR log file to determine a pattern of beam to be created to simulate one or more of the obstacles or objects participating in the desired test case scenario. Specifically, the control circuitry (122) determines a beam pattern that is configured to generate beams with suitable angles such that the RADAR DUT (102) receives the beams and perceives angles of the beams as the reflection angle of signals reflecting off a selected obstacle. Thus, selecting the one or more suitable antennae (116) and modulating the beam pattern created by the selected antennae (116) may allow for creation of virtually any angle of approach of a participating object towards the target vehicle, as shown in FIG. 2.
[0041] According to aspects of the present disclosure, the simulation system (104) may be configured to simulate any number of participating objects as per the specifications of the RADAR DUT (102). Additionally, the simulation system (104) may be configured to vary maximum velocity ranges capable of being simulated with a delay range according to specific characteristics of the RADAR DUT (102). Accurate simulation of the desired test case scenario entails accurately simulating RADAR signals reflecting off the simulated objects and accurate object dynamics of the simulated objects in the desired test case scenario.
[0042] In one embodiment, the real-time processing system (108) is configured to simulate the test case scenario using the object dynamics file for validating performance of the RADAR DUT (102). To that end, the real-time processing system (108) may include one or more processor boards and input-output boards for simulating the values of the RADAR signals in real-time during validation testing of the RADAR DUT (102). For example, in the automotive domain, the RADAR DUT (102) used in an AEB ECU will need to know the vehicle information such as vehicle speed, brake value, steering angle, and gear position in real-time. Typically, a Controller Area Network (CAN) communication system is used in automotive systems for communication of such vehicle information between different DUTs. Accordingly, the real-time processing system (108) may include an input/output (I/O) card (124) such as a CAN card configured to send the vehicle information to the RADAR DUT (102) in real-time during the validation testing. Here, the real-time processing system (108) may be configured to determine the vehicle information by executing the mathematical models along with test scenario information included in the object dynamics file uploaded from the test system (106) to the real-time processing system (108). In certain embodiments, the I/O card (124) may be configured to convert a selected set of object dynamics information from the object dynamics file to CAN messages that may be transmitted to the RADAR DUT (102). The object dynamics file may be used to simulate data for all participating objects as per corresponding timestamp information stored in the RADAR log file using input-output boards in the real-time processing system (108).
[0043] As previously noted, the real-time processing system (108) is time synchronized with the simulation system (104) via the serial communications link (112). Therefore, at the instant of time when the real-time processing system (108) is simulating the object dynamics, for example, at time stamp 10.6854 second, the simulation system (104) will configure the signal generation circuitry (114) and the antennae (116) to transmit an RF signal for 10.6854 second towards the RADAR DUT (102) based on the timestamp information in the RADAR log file uploaded in the simulation system (104). The RADAR DUT (102) may be configured to receive the RF signals over the air from one or more of the antennae (116) and compute, for example, corresponding distance, speed, angle of arrival, obstacle shape, type of obstacle, and values of other functional features associated with one or more of the participating objects in the desired test case scenario. Additionally, the RADAR DUT (102) may be configured to communicate the computed values to an automated test subsystem (126).
[0044] In one embodiment, the automated test subsystem (126) may reside in the real-time processing system (108) and may be configured to receive the computed values from the actual RADAR DUT (102) via the I/O card (124). In another embodiment, however, the automated test subsystem (126) may be an independent computing device communicatively coupled to the RADAR DUT (102), and the test system (106). The real-time processing system (108) may be configured to communicate expected results or golden reference outputs generated by executing the mathematical models to the automated test subsystem (126). As used herein, the terms “golden reference outputs” or “ground truth data” may correspond to output values generated by the simulated RADAR DUT upon execution of the object dynamics file and the test scenario simulations by the real-time processing system (108).
[0045] In one embodiment, the automated test subsystem (126) may further receive the RADAR log file with the test scenario data, which includes the details of simulated object dynamics data at each time stamp. The automated test subsystem (126) compares the computed values received from the actual RADAR DUT (102) with the golden reference outputs and produces pass or fail test reports for each time stamp. For example, at a time stamp of 15.6754 second, if an obstacle is detected by the simulated RADAR DUT at a distance of 45 Meter from the target vehicle at a speed of 50 kilometers per hour (KMPH) with an approaching angle of 10 degrees and the vehicle type is detected as motor cycle as per the object dynamics animation software, these values will be used as the golden reference outputs.
[0046] Further, the computed values, for example, may include a measured distance between the RADAR DUT (102) and one or more objects participating in the simulated test case scenario, a measured angle of approach of the objects, a measured speed of the objects, a measured dimension of the objects, identified types of the objects, and any other selected functional requirement based on the computed values. The automated test subsystem (126) compares the computed values with the golden reference outputs generated by the test system (106) using the object dynamics file to validate performance of the RADAR DUT (102) in the simulated test case scenario. Specifically, the automated test subsystem (126) determines the test case scenario to have “passed” if golden reference outputs match the computed values received from the RADAR DUT (102), else the test scenario is determined to have “failed”.
[0047] In certain embodiments, the automated test subsystem (126) allows for manual verification of CAN messages and signals for the pass or fail assessment. Alternatively, the automated test subsystem (126) uses the real-time output from the execution of object dynamics animation as the golden reference outputs and automatically compares the scenario file including the simulation details such as vehicle speed, brake value, number of obstacles, speed of each obstacle, and CAN signals with golden reference outputs. Once the real-time processing system (108) initiates the test scenario simulation, the automated test subsystem (126) begins receiving and processing the CAN output values to continuously compare the CAN output values with the golden reference outputs and generate detailed pass or fail test results for each simulated test case scenario. The test results with the RADAR log file may be saved in the test system (106) for future analyses. The system (100), thus, provides an efficient means to simulate a plurality of complex test case scenarios and validate functioning of the RADAR DUT (102) in a test environment.
[0001] Further, FIG. 5 illustrates a flow chart (500) depicting an exemplary method for testing a device using the system (100) of FIG. 1. The exemplary method is illustrated as a collection of blocks in a logical flow chart, which represents operations that may be implemented in hardware, software, or a combination thereof. The various operations are depicted in the blocks to illustrate the functions that are performed during various phases of the exemplary method. In the context of software, the blocks represent computer instructions that, when executed by one or more processing subsystems, perform the recited operations. The order in which the exemplary method is described is not intended to be construed as a limitation, and any number of the described blocks may be combined in any order to implement the exemplary method disclosed herein, or an equivalent alternative method. Additionally, certain blocks may be deleted from the exemplary method or augmented by additional blocks with added functionality without departing from the spirit and scope of the subject matter described herein. For discussion purposes, the present method is described with reference to the emotion identification system (100) of FIG. 1.
[0048] The method includes defining a simulated test case scenario comprising one or more simulated objects, wherein the one or more simulated objects comprise at least one simulated device under test corresponding to an actual device under test that is configured to transmit and receive signals corresponding to a selected frequency range and at least one target object that comprises the simulated device under test in step (502).
[0049] In one embodiment, the method further includes simulating a test case scenario based on object dynamics, wherein simulating the test case scenario includes simulating one or more objects based on the corresponding object dynamics, and wherein simulating the one or more objects includes simulating at least one device under test configured to transmit and receive signals corresponding to a selected frequency range In a specific embodiment, the one or more objects are simulated based on a mathematical model corresponding to a behavior of the one or more objects. In a more specific embodiment, the one or more objects comprises one or more vehicles and the one or more vehicles are simulated based on a steering wheel model, a suspension system model, a vehicle engine system model, a gear transmission model, a brake system model, a seating model corresponding to the vehicle.
[0050] The method also includes generating an object dynamics file based on the defined simulated test case scenario in step (504). In a specific embodiment, the object dynamics file includes object dynamics corresponding to the one or more simulated objects in the simulated test case scenario.
[0051] Additionally, the method further includes generating at least one log file comprising one or more time-stamped outputs generated by the simulated device under test operating in the simulated test case scenario in step (506). In an exemplary embodiment, the at least one log file generated based on the simulated test case scenario includes distances between a simulated target vehicle and one or more simulated objects, angle of approach of the one or more simulated objects, speed of the one or more simulated objects, dimensions of the one or more simulated objects, type of the one or more simulated objects, or a combination thereof.
[0052] The method further includes updating the log file based on the selected characteristics of an actual device under test, the noise conditions defined for the simulated test case scenario, or a combination thereof in step (508). In one embodiment, the at least one log file is updated based on one or more selected characteristics of the actual device under test, one or more noise conditions defined for the simulated test case scenario, or a combination thereof. In another embodiment, the updated log file and the object dynamics file are processed in a time-synchronized mode.
[0053] The method further includes executing the object dynamics file in a test system and the updated log file in a simulation system, wherein execution of the object dynamics file in the test system and the updated log file in the simulation system are time synchronized in step (510). The method further includes determining one or more reference outputs corresponding to the simulated device under test operating in the simulated test case scenario based on the execution of the object dynamics file in the test system in step (512).
[0054] The method further includes generating the signals having the defined noise and one or more determined offsets using one or more selected signal generation circuitry (114) based on the updated log file in step (514). In one embodiment, a Doppler shift and a delay is applied to the signals generated by the one or more signal generation circuitry (114). In another embodiment, the signals with offsets corresponding to the selected frequency range are generated by a suitable signal generation circuitry (114) selected from the one or more signal generation circuitry (114). In a specific embodiment, the suitable signal generation circuitry (114) is selected automatically based on the updated log file or the suitable signal generation circuitry (114) is selected based on a user input.
[0055] The method further includes transmitting the generated signals and at least a portion of the object dynamics information corresponding to the target object to the actual device under test, wherein the object dynamics information is determined based on the execution of the object dynamics file in the test system in step (516). In one embodiment, the generated signals are transmitted to the actual device under test using one or more antennae. In a specific embodiment, at least one of the one or more antennae is selectively activated to transmit the signals. In another embodiment, a plurality of echo signals generated by the one or more antennae and the actual device under test are absorbed.
[0056] The method further includes receiving one or more outputs generated by the actual device under test at the test system, wherein the actual device under test is configured to generate the outputs based on the signals received from the selected circuitry and the selected object dynamics information in step (518). The method further includes validating performance of the actual device under test in the simulated test case scenario in the test system based on a comparison of the received outputs and the one or more reference outputs in step (520).
[0057] Embodiments of the present system (100) enable a user to test multiple types of devices at different frequency ranges using the same device testing system, which leads to ease of use and lesser costs. Additionally, the system (100) reduces processing time delays in the simulation system, allowing for validation of performance of the device in real-time. Moreover, the system (100) allows for simulation of complex test scenarios in a laboratory environment, which enables the user to test most of test scenarios without the need of testing the device in a physical environment. Thus, the system (100) reduces cost and efforts involved in comprehensive in-target testing. Furthermore, the system (100) includes a chamber for absorbing echo signals generated by the device under test and antennae, which improves the accuracy and reliability of the validation tests.
[0058] Although specific features of various embodiments of the present system and exemplary methods may be shown in and/or described with respect to some drawings and not in others, this is for convenience only. It is to be understood that the described features, structures, and/or characteristics may be combined and/or used interchangeably in any suitable manner in the various embodiments.
[0059] While various embodiments of the present system and method have been illustrated and described, it will be clear that the present system and method is not limited to these embodiments only. Numerous modifications, changes, variations, substitutions, and equivalents will be apparent to those skilled in the art, without departing from the spirit and scope of the present system and method, as described in the claims.

,CLAIMS:

1. A system (100), comprising:
one or more signal generation circuitry (114) configured to generate one or more signals corresponding to at least one selected type and at least one frequency range, and to apply one or more determined offsets to the signals;
a simulation system (104) operatively coupled to the signal generation circuitry (114) and configured to:
receive at least one log file comprising one or more time-stamped outputs generated by a simulated device under test operating in a simulated test case scenario that is defined in an object dynamics file, one or more selected characteristics of an actual device under test (102), one or more noise conditions defined for the simulated test case scenario, or combinations thereof, wherein the simulated device under test corresponds to the actual device under test (102) that is configured to transmit and receive the signals; and
transmit one or more control signals to at least one selected circuitry from the signal generation circuitry (114) to generate and transmit the signals having the defined noise and the determined offsets to the actual device under test (102).

2. The system (100) as claimed in claim 1, further comprising a test and processing system (106, 108) that is operatively coupled to the simulation system (104) via one or more serial communication links (112, 120), wherein the test and processing system (106, 108) is configured to:
receive the object dynamics file corresponding to the simulated test case scenario with associated timestamps, wherein the object dynamics file comprises object dynamics information corresponding to the simulated device under test and at least one target object that comprises the simulated device under test in the simulated test case scenario;
determine one or more reference outputs corresponding to the simulated device under test operating in the simulated test case scenario, wherein the reference outputs are generated using the object dynamics file;
synchronize an execution of the object dynamics file in the test system with an execution of the log file by the simulation system (104) based on the associated timestamps;
transmit selected object dynamics information corresponding to the target object from the object dynamics file with the associated timestamps to the actual device under test (102);
receive one or more outputs generated by the actual device under test (102) based on the signals received from the selected circuitry (114) and the selected object dynamics information; and
validate performance of the actual device under test (102) in the simulated test case scenario based on a comparison of the received outputs and the one or more reference outputs.

3. The system (100) as claimed in claim 1, further comprising one or more antennae (116) configured to selectively receive and transmit the signals corresponding to the selected type and the frequency range for reception by the actual device under test (102).

4. The system (100) as claimed in claim 3, wherein the simulation system (104) is further configured to select and activate at least one antenna (116) from the one or more antennae (116) for selectively transmitting the signals for reception by the actual device under test (102) based on the log file, the selected object dynamics information, and associated timestamps, or based on user input.

5. The system (100) as claimed in claim 1, wherein the actual device under test (102) comprises one or more of a RADAR device, a SONAR device, and a LIDAR device.

6. The system (100) as claimed in claim 1, wherein the target object comprises a target vehicle that houses the actual device under test (102).

7. The system (100) as claimed in claim 1, further comprising an offset circuitry (306) configured to apply one or more determined offsets to the signals, wherein the offsets correspond to one or more of a selected delay, a Doppler shift, and the defined noise.

8. The system (100) as claimed in claim 1, further comprising a chamber (118) configured to enclose one or more antennae (116) and the actual device under test (102), and absorb a plurality of echo signals generated by the one or more antennae (116) and the actual device under test (102).

9. A system (100), comprising:
one or more signal generation circuitry (114) configured to generate signals corresponding to at least one selected signal type and at least one frequency range, and to apply one or more determined offsets to the signals;
a test and processing system (106, 108) for testing an actual device under test (102), wherein the test and processing system (106, 108) is configured to receive object dynamics information corresponding to a simulated test case scenario comprising one or more simulated objects and generate one or more reference outputs corresponding to the actual device under test based on the object dynamics information, wherein the one or more simulated objects comprise:
at least one simulated device under test corresponding to the actual device under test (102) that is configured to transmit and receive the signals, and
at least one simulated target object that comprises the simulated device under test;
a simulation system (104) operatively coupled to one or more of the test system, and the signal generation circuitry (114), and configured to:
receive at least one log file comprising one or more time-stamped outputs generated by the simulated device under test in the simulated test case scenario, one or more selected characteristics of an actual device under test (102), one or more noise conditions defined for the simulated test case scenario, or combinations thereof;
transmit one or more control signals to at least one selected circuitry selected from the one or more signal generation circuitry (114) to generate and transmit the signals having the defined noise and the determined offsets to the actual device under test (102);
wherein the test system (106) is further configured to:
receive one or more outputs generated by the actual device under test (102), wherein the actual device under test (102) generates the outputs based on the signals received from the selected circuitry (114) and the object dynamics information corresponding to the target object that is received from the test and processing system (106, 108); and
validate performance of the actual device under test (102) in the simulated test case scenario based on a comparison of the received outputs and the one or more reference outputs.

10. The system (100) as claimed in claim 9, the test and processing system (106, 108) further configured to receive the object dynamics file corresponding to the simulated test case scenario with associated timestamps, wherein the object dynamics file comprises object dynamics information corresponding to the simulated device under test and at least one target object that comprises the simulated device under test in the simulated test case scenario.

11. The system (100) as claimed in claim 9, the test system (106) further configured to synchronize an execution of the object dynamics file in the test and processing system (106, 108) with an execution of the log file by the simulation system (104) based on the associated timestamps.

12. The system (100) as claimed in claim 9, the test and processing system (106, 108) further configured to transmit selected object dynamics information corresponding to the target object from the object dynamics file with the associated timestamps to the actual device under test (102).

13. The system (100) as claimed in claim 9, further comprising one or more antennae (116) configured to selectively receive and transmit the signals corresponding to the selected type and the frequency range for reception by the actual device under test (102).

14. The system (100) as claimed in claim 13, wherein the simulation system (104) is further configured to select and activate at least one antenna (116) from the one or more antennae (116) for selectively transmitting the signals for reception by the actual device under test (102) based on the log file, the selected object dynamics information, and associated timestamps, or based on user input.

15. The system (100) as claimed in claim 9, wherein the actual device under test (102) comprises one or more of a RADAR device, a SONAR device, and a LIDAR device.

16. The system (100) as claimed in claim 9, wherein the target object comprises a target vehicle that houses the actual device under test (102).

17. The system (100) as claimed in claim 9, further comprising an offset circuitry (306) configured to apply one or more determined offsets to the signals, wherein the offsets correspond to one or more of a selected delay, a Doppler shift, and the defined noise.

18. The system (100) as claimed in claim 9, further comprising a chamber (118) configured to enclose one or more antennae (116) and the actual device under test (102), and absorb a plurality of echo signals generated by the one or more antennae (116) and the actual device under test (102).

19. A method, comprising:
defining a simulated test case scenario comprising one or more simulated objects, wherein the one or more simulated objects comprise at least one simulated device under test corresponding to an actual device under test (102) that is configured to transmit and receive signals corresponding to a selected frequency range and a selected type and at least one target object that comprises the simulated device under test;
generating an object dynamics file based on the defined simulated test case scenario;
generating at least one log file comprising one or more time-stamped outputs generated by the simulated device under test operating in the simulated test case scenario;
updating the log file based on the selected characteristics of an actual device under test, the noise conditions defined for the simulated test case scenario, or a combination thereof;
executing the object dynamics file in a test and processing system (106, 108) and the updated log file in a simulation system (104), wherein execution of the object dynamics file in the test and processing system (106, 108) and the updated log file in the simulation system (104) are time synchronized;
determining one or more reference outputs corresponding to the simulated device under test operating in the simulated test case scenario based on the execution of the object dynamics file in the test and processing system (106, 108);
generating the signals having the defined noise and one or more determined offsets using one or more selected signal generation circuitry (114) based on the updated log file;
transmitting the generated signals and at least a portion of the object dynamics information corresponding to the target object to the actual device under test (102), wherein the object dynamics information is determined based on the execution of the object dynamics file in the test and processing system (106, 108);
receiving one or more outputs generated by the actual device under test (102) at the test and processing system (106, 108), wherein the actual device under test (102) is configured to generate the outputs based on the signals received from the selected circuitry (114) and the selected object dynamics information; and
validating performance of the actual device under test (102) in the simulated test case scenario in the test and processing system (106, 108) based on a comparison of the received outputs and the one or more reference outputs.

20. The method as claimed in claim 19, further comprising selecting and activating at least one antenna from the one or more antennae (116) for selectively transmitting the signals for reception by the actual device under test (102).

21. The method as claimed in claim 20, selecting and activating at least one antenna (116) from the one or more antenna (116) based on the log file, the selected object dynamics information, and associated timestamps, or based on user input.

22. The method as claimed in claim 19, generating the signals having the defined noise and one or more determined offsets using one or more selected signal generation circuitry (114) based on the updated log file comprising applying one or more determined offsets to the signals, wherein the offsets correspond to one or more of a selected delay, a Doppler shift, and the defined noise.