Abstract: ABSTRACT MACHINE LEARNING FOR A RADAR Techniques of machine learning of a radar are disclosed, where the radar has a plurality of antennas that are arranged on an antenna array. In an example, a method of machine learning includes obtaining a real training sample from a first real target in field of view of the radar, where the real training sample includes a plurality of first real data signals, where each of the first real data signals are obtained from a corresponding antenna from amongst the plurality of antennas. The method further includes deriving a synthetic training sample by manipulating the plurality of first real data signals to simulate a rotation of the first real target about a pre-determined axis of the antenna array. « To be published with Fig. 1»
TECHNICAL FIELD [0001] The present subject matter relates, in general to machine learning, and in particular to machine learning for radars.
BACKGROUND [0002] Object recognition or classification through machine learning is used in a wide variety of fields, such as autonomous vehicles, advanced driver-assistance systems (ADAS) applications like automobile parking assistance, robotics, drone etc, where obstacle or object detection and identification is required. The proper classification or identification of an obstacle or object may be vital for correct decision making such as taking evasive action to avoid collision, braking, overtaking, etc. Since camera based object classification is limited in their operation due to environmental conditions like rain, fog, etc, radar based object classification techniques are generally preferred for reliable operation in all conditions. Typically, for proper prediction of an object's class, machine learning systems need to be trained with a large number of samples. In addition, the training samples should be sufficiently varying so that the machine learning system can be adequately trained for differing input possibilities.
BRIEF DESCRIPTION OF THE DRAWINGS [0003] The following detailed description references the drawings, wherein: [0004] Fig. 1 a schematic representation of a machine learning system for a radar according to an implementation of the present subject matter; [0005] Fig. 2 is an illustration of the generation of the real data signals in an example implementation of the radar;
[0006] Fig. 3 illustrates a rotation achieved using the techniques of the present subject matter
DETAILED DESCRIPTION [0007] The subject matter disclosed herein relates to machine learning for a radar. As mentioned previously, for ensuring a good prediction accuracy from a machine learning system, the training phase of the machine learning system should be conducted with an appropriately large number of training samples. This is in general true for any machine learning technique like support vector machines (SVM) and neural networks. However, more often than not, having a large number of training samples does not guarantee the desired sample variations. As a result, the training samples may have inherent biases within the training samples. In particular, for a machine learning based radar, the training samples may be associated with objects which were available only at certain angles with respect to the radar. To remove this angular bias in the training phase, the training samples for all objects to be classified should be taken at all possible angles. As can be understood, this may not be practically implementable or scalable. However, if the biases are not removed, the machine learning system may have inferior prediction capabilities.
[0008] To this end, the present subject matter describes systems and methods for machine learning for a radar.
[0009] As per an implementation of the present subject matter, a real training sample is obtained for a real target in the field of view of a radar having an antenna array. Antenna arrays typically have a plurality of antennas. The real training sample includes a plurality of real data signals obtained from the corresponding antenna. Synthetic training samples are then derived to simulate a rotation of the real target of the radar by manipulating the real data signals.
[0010] As can be seen, the present subject matter provides a technique to increase the training sample count by generating synthetic samples for training from existing real samples. Moreover, as the synthetic samples are rotated versions of the real samples, the angular biases can also reduced or removed.
[0011] The above described machine learning for a radar is further described with reference to Figs. 1 to 3. It should be noted that the description and figures merely illustrate the principles of the present subject matter along with examples described herein and, should not be construed as a limitation to the present subject matter. It is thus understood that various arrangements may be devised that, although not explicitly described or shown herein, include the principles of the present subject matter. Moreover, all statements herein reciting principles, aspects, and examples of the present subject matter, as well as examples thereof, are intended to encompass equivalents thereof.
[0012] Fig. 1 illustrates a schematic representation of a machine learning system 100 for a radar 102 according to an implementation of the present subject matter. The radar 102 includes an antenna array 106 having a plurality, N, of antennas (not shown in Fig. 1). The radar 102 may be, for example, a Frequency Modulated Continuous Wave (FMCW) Radar or Pulse Doppler Radar. In operation, the radar 102 interacts with a real target 104 in a field of view of the radar 102. The real target 104 may be an object or obstacle, like a car, a bike, a truck, a bicycle, a person etc. In an implementation, the real target 104 may be an object or obstacle for which a sample is to be obtained for training the machine learning system 100 during the training phase. In other implementations, the real target 104 may be an object or obstacle which has to be classified during a prediction phase of the machine learning system 100. Though, the machine learning system 100 is shown in Fig. 1 as separate from the radar 102, in other implementations of the present subject matter, the machine learning system 100 may be integrated with the radar 102 itself.
[0013] In some implementations, the N antennas of antenna array 106 may be positioned equidistant and linearly along a horizontal axis. The antennas transmit Radio Frequency (RF) signals towards the real target 104 and then receive the RF signal which is reflected back by the real target 104. As is generally known, the composition of the reflected RF signal 122 will not only
depend on the reflectivity and structure of the surface of the real target 104 but also on the distance and the direction (angle) of the real target 104 with respect to the-antennas. Each antenna on receiving the reflected RF signal 122, generates an independent real data signal. Each of the real data signals also carry information about the nature, distance and direction of the real target 104.
[0014] Fig. 2 is an illustration of the generation of the real data signals 220 in an example implementation of the radar 102. The radar 102 in Fig. 2 is based on FMCW. The radar 102 interacts with the real target 104, which in this case is a car, and the subsequently generates the real data signals 220. In this implementation, the antenna array 106 of the radar 102 has independent receiver antennas 204-1, 204-2, ..., 204-N but a common transmitter antenna 202. In operation, the real target 104 receives a transmitted RF signal 120 from the transmitter antenna 202. The transmitted RF signal 122 then gets reflected off the surface of the real target 104. The reflected RF signal(s) 122-1, 122-N, ..., 122-N are then received respectively by each of the receiver antennas 204-1, 204-2, ..., 204-N of the antenna array 106. As is generally known for radar signalling, the reflected RF signals 122 are analog in nature. The reflected RF signals 122 may then be digitalized and discretized by the radar's 102 circuitry associated with each receiver antennas 204. As shown in Fig. 2, each receiver antenna 204-1, 204-2, ..., 204-N is associated with a receiver chain which typically includes associated circuitry to process the corresponding received reflected RF signal 122-1,122-N, ..., 122-N. In this example, where the radar 102 is based on FMCW, the associated circuitry is known to include a low noise amplifier (LNA) 210, a mixer 212, a low frequency amplifier (LFA) 214 and an analog to digital converter (ADC) 216. In some implementations, the real data signals 220 may then be taken as the signal that is generated at the ADC 216, i.e. at the end of the receiver chain, for each receiver antenna 204. When taken at the output of the ADCs 216-1, 216-2, ..., 216-N, the corresponding real data signals 220-1, 220-2, ..., 220-N, may each be in the form of a time series data.
Alternatively, the real data signals 220 may be taken as an FFT of the time series data available at the ADCs 216. This may be facilitated by a signal processor 218 of the radar 102. In general, the real data signal 220 may also be the data generated after any kind of processing of the time series data or the FFT of the time series data as long as the real data signals 220 continue conveying information about the nature, range and direction of the real target 104.
[0015] Although the subject matter has been described above in the context of constituent antennas of the antenna array 106 having their own receiver antennas 204 and a common transmitter antenna 202, it will be understood that the subject matter may be extended to antenna arrays where each constituent antenna has their own receiver antenna 204 and transmitter antenna 202.
[0016] Coming back to Fig. 1 and the operation of the machine learning system 100, as per one implementation, the machine learning system 100 includes a training input module 108 and a sample generator module 116. As described earlier, the radar 102 may generate a plurality of real data signals 220. The plurality of real data signals 220 may form a real sample 124. In some implementations, the real sample 124 may be formed by a concatenation of the real data signals in the same order as the ordering of the antennas 204 within the antenna array 106. The real sample 124 may then be obtained by the training input module 108, for example, for the training phase of the machine learning system 100. In this case, the real sample 124 acts as a real training sample. Thereafter, the sample generator module 116 may derive a synthetic training sample by manipulating the real data signals 220 included in the real training sample so as to simulate a rotation of the real target 104. The rotation may be with respect to a pre-determined axis of the antenna array 106. For example, for antenna arrays 106 having antennas 204 positioned linearly, the pre-determined axis may be perpendicular to the horizontal axis of the antenna array 106 along which the constituent antennas 204 Ne. In some implementations, the pre-determined axis may
also pass through the centre of the antenna array 106. [0017] Fig. 3 is an illustration of a rotation achieved using the techniques of the present subject matter. The illustration depicts an implementation of the present subject matter where the antenna array 106 has four antennas 204-1, 204-2, 204-3, 204-4 arranged equidistant linearly and the pre-determined axis 302 is perpendicularto the centre 306 of the antenna array 106. As shown in Fig. 3, the real target 104 makes an angle 01 with the pre-determined axis 302. As mentioned earlier, the sample generator module 116 may simulate the rotation of the real target 104. In some implementations, the rotation may be simulated by a reordering of the real data signals 220 of the real training sample generated for the real target 104. For example, consider that the real data signal 220-1 generated at the first antenna is D1, the real data signal 220-2 generated at the second antenna is D2 and so on. The real training sample for the radar 102 shown in Fig. 3 may then be formed by concatenating the real data signals D1, D2, ..., D4 and represented as a vector (Di, D2, D3, D4). Had the real target 104 been present at an angle -01, indicated as a mirrored target 304 in Fig. 3, with the pre-determined axis 302, the real training sample generated by the radar 102 would have been given by the vector (D4, D3, D2, D1). This results from the symmetry of the real target 104 and the mirrored target 304 about the pre-determined axis 302. Accordingly, the sample generator module 116 may generates a synthetic training sample vector as (D4, D3, D2, D1), which is a reordering of the real training sample (D1, D2, D3, D4), it can therefore be understood to correspond to a mirrored target 304. The mirrored target 304 is a mirror image of the real target 104. Alternatively, the synthetic training sample is a representation of the real target 104 rotated by 20.
[0018] As mentioned earlier, it is not feasible and scalable to arrange for the real target 104 to be physically present at such mirrored positions. However, the sample generator module 116, by a simple reordering of the sequence of real data signals 220, may simulate such rotations. Although
the above subject matter has been explained in the context of Fig. 3 that depicts four antennas 204, it will be understood that the subject matter may be extended to any antenna array 106 having at least two antennas 204. In general, the vector for the real sample may be represented as the vector (Di, D2, D3, ..., DN). The synthetic sample, which gives a simulated data signal corresponding to the mirror image of the real target 104, is then represented by the vector (DN, DN-I, DN-2, ..., D1). For implementations where the number N of antennas 204 is even, the manipulation by the sample generator module 116 may be viewed either as a reversal of the real data signals 220 or as a swapping of real data signal of the 1st antenna with the Nth, the 2nd antenna with the (N-1)th antenna and so on etc. If N is odd, then the only difference is that the data of the middle antenna, i.e. the ((N+1)/2)th antenna, remains un-swapped.
[0019] In some implementations, other degrees of rotation may also be simulated. By effecting different degrees of rotation, a multitude of synthetic training samples with different directions of arrival (DoA) or angles can therefore be generated with the same real training sample. Using such synthetic training samples to train the radar 102 alleviates the angular biases inherent due to the direction of arrival (DoA) of the reflected RF signal 122 during training of the machine learning system 100. [0020] Returning to Fig. 1, in some implementations of the present subject matter, the machine learning system 100 may further include a training module 110. During the training phase, the training module 110 may train the machine learning system 100 with the real training sample 124. The training module 110 may train the machine learning system 100 with the real training samples and the synthetic training samples derived by the sample generator module 116. As is typically understood for machine learning, the training of the machine learning system 100 should be commiserate with the accuracy and efficiency desired from the machine learning system 100. While the mechanisms described in the present subject matter provide a means to generate one or more synthetic training
samples from a real training sample, it should be understood that the training may require a large enough set of real training samples to begin with. Accordingly, the machine learning system 100 may be trained with an adequate number of real training samples 124 and derived synthetic training samples. Using the set of derived synthetic training samples along with the set of real training samples for training will yield accuracies and efficiencies much better than that offered by using just the real training samples because of the reduction or removal in the angular biases inherent in set of the real training samples.
[0021] Following the completion of the training, which may typically happen offline, the machine learning system 100 may then be used for classifying objects in real time. For example, a driverless car system may use the radar to identify objects during overtaking or parking. Accordingly, in some implementations, the machine learning system 100 may further include a prediction input module 112 and a prediction module 114. In operation then, the real target 104 may again be presented to the radar 102. However, the machine learning system 100 performs prediction with the real sample 124 generated in this case. In this implementation, the prediction input module 112 obtains a real prediction sample for the real target 104, instead of the real training sample. The real prediction sample, similar to the real training sample, includes a plurality of real data signals 124. Each of the real data signals are obtained from the corresponding antenna 204 of the antenna array 106. Thereafter, the prediction module 114 may predict a class of the real target 104 using the real prediction sample. Appropriate training modules 110 and prediction module 114 may be used based on the implementation of the machine learning system 100. As mentioned earlier, the machine learning system 100 may be based on SVM, Neural Networks, etc.
[0022] The implementation of the present disclosure proposes a variety of approaches for generating synthetic samples for reducing or removing angular biases in a machine learning system for a radar. These and other
aspects are also described in context of the following embodiments: [0023] Training samples are used for training of machine learning or deep learning algorithms. The said algorithms could be any of supervised type, unsupervised type, semi-supervised type, reinforcement type. Training can be done online or offline. Prediction samples are also used for prediction of the object class.
[0024] Radar can be any of the following types: bistatic radar, mono-static radar, continuous wave radar, frequency modulated continuous wave radar, pulse, radar, doppler radar, mono pulse radar, passive radar, planar array radar, pulse doppler radar, stepped frequency radar, synthetic aperture radar, over the horizon radar, PMCW radar, CDMA radar, OFDMA radar.
[0025] In an example of the present subject matter, the training sample is used for to train and prediction sample is used to predict the class of the object using machine learning or deep learning algorithms like Support Vector Machine, Linear Regression, Logistic Regression, K-Means, Gradiënt Boosting, Nearest Neighbour, Naïve Bayes, Decision Trees, Linear Regression, Random Forest, Neural Networks, Deep Neural Networks, Convolutional Neural Network.
I/We Claim:
1. A machine learning method for a radar having a plurality of antennas,
N, arranged on an antenna array, the method comprising:
obtaining a real training sample from a first real target in field of view of the radar, wherein the real training sample includes a plurality of first real data signals, each of the first real data signals obtained from a corresponding antenna from amongst the plurality of antennas;
deriving a synthetic training sample by manipulating the plurality of first real data signals to simulate a rotation of the first real target about a pre-determined axis of the antenna array.
2. The method as claimed in claim 1, wherein the method comprises training the radar using the synthetic training sample.
3. The method as claimed in claim 2 further comprising training of the radar using the real training sample.
4. The method as claimed in claim 1, wherein the plurality of first real data signals are formed by concatenation of one of:
a time series data generated by each of the plurality of antennas, an FFT of the time series data generated by each of the plurality of
antennas,
data generated after processing the time series data generated by
each of the plurality of antennas, and
data generated after processing the FFT of the time series data
generated by each of the plurality of antennas.
5. The method as claimed in claim 1, wherein the rotation of the first
real target is simulated by reordering the plurality of first real data signals.
6. The method as claimed in claim 1, wherein obtaining the real training sample includes concatenating the first real data signal obtained from each antenna in an order same as the ordering of the plurality of antennas in the antenna array.
7. The method as claimed in claim 6, wherein deriving the synthetic training sample includes concatenating the first real signals obtained from each antenna in an order reverse as the ordering of the plurality of antennas in the antenna array.
8. A machine learning system for a radar, the radar having a plurality of antennas, N, arranged on an antenna array, the system comprising:
a training input module to obtain a real training sample from a first real target in field of view of the radar, wherein the real training sample includes a plurality of first real data signals, each of the first real data signals obtained from a corresponding antenna from amongst the plurality of antennas; and
a sample generator module to derive a synthetic training sample by manipulating the plurality of first real data signals to simulate a rotation of the first real target about a pre-determined axis of the antenna array.
9. The system as claimed in claim 8, further comprising:
a training module to train the radar using the synthetic training sample.
10. The system as claimed in claim 8, the system comprising:
a prediction input module to obtain a real prediction sample from a second real target in field of view of the radar, wherein the real prediction sample comprises a plurality of second real data signals, each of the second
real data signals obtained from a corresponding antenna from amongst the plurality of antennas; and
a prediction module to predict a class of the second real target using the real prediction sample.
11. The system as claimed in claim 8, wherein the training module trains the radar using the real training sample.
12 The system as claimed in claim 8, wherein the plurality of first real data signals are formed by concatenation of one of:
a time series data generated by each of the plurality of antennas,
an FFT of the time series data generated by each of the plurality of antennas,
data generated after processing a time series data generated by each of the plurality of antennas, and
data generated after processing a FFT of a time series data generated by each of the plurality of antennas.
13. The system as claimed in claim 8, wherein the rotation of the first real target is simulated by reordering the plurality of first real data signals.
14. The system as claimed in claim 10, wherein
the rotation of the first real target is simulated by reordering the plurality of first real data signals; and
the rotation of the second real target is simulated by reordering the plurality of second real data signals similar to the reordering of the plurality of first real data signals.
15. The system as claimed in claim 8, wherein to obtain the real training
sample, the training input module concatenates the first real data signal
obtained from each antenna in an order same as the ordering of the plurality of antennas in the antenna array.
16. The system as claimed in claim 15, wherein to derive the synthetic training sample, the sample generator module concatenates the first real data signal obtained from each antenna in an order reverse as the ordering of the plurality of antennas in the antenna array.
| # | Name | Date |
|---|---|---|
| 1 | 201841050106-STATEMENT OF UNDERTAKING (FORM 3) [31-12-2018(online)].pdf | 2018-12-31 |
| 2 | 201841050106-PROVISIONAL SPECIFICATION [31-12-2018(online)].pdf | 2018-12-31 |
| 3 | 201841050106-FORM 1 [31-12-2018(online)].pdf | 2018-12-31 |
| 4 | 201841050106-DRAWINGS [31-12-2018(online)].pdf | 2018-12-31 |
| 5 | 201841050106-Proof of Right (MANDATORY) [16-01-2019(online)].pdf | 2019-01-16 |
| 6 | Correspondence by Agent_Form-1_18-01-2019.pdf | 2019-01-18 |
| 7 | 201841050106-DRAWING [30-12-2019(online)].pdf | 2019-12-30 |
| 8 | 201841050106-CORRESPONDENCE-OTHERS [30-12-2019(online)].pdf | 2019-12-30 |
| 9 | 201841050106-COMPLETE SPECIFICATION [30-12-2019(online)].pdf | 2019-12-30 |
| 10 | 201841050106-Proof of Right (MANDATORY) [31-12-2019(online)].pdf | 2019-12-31 |
| 11 | 201841050106-FORM-8 [31-12-2019(online)].pdf | 2019-12-31 |
| 12 | 201841050106-RELEVANT DOCUMENTS [01-01-2020(online)].pdf | 2020-01-01 |
| 13 | 201841050106-FORM-26 [01-01-2020(online)].pdf | 2020-01-01 |
| 14 | 201841050106-FORM 13 [01-01-2020(online)].pdf | 2020-01-01 |
| 15 | 201841050106-Request Letter-Correspondence [17-01-2020(online)].pdf | 2020-01-17 |
| 16 | 201841050106-Form 1 (Submitted on date of filing) [17-01-2020(online)].pdf | 2020-01-17 |
| 17 | 201841050106-CERTIFIED COPIES TRANSMISSION TO IB [17-01-2020(online)].pdf | 2020-01-17 |
| 18 | 201841050106-Response to office action [24-01-2020(online)].pdf | 2020-01-24 |
| 19 | 201841050106-Form1_Proof of Right_27-01-2020.pdf | 2020-01-27 |
| 20 | 201841050106-Correspondence_27-01-2020.pdf | 2020-01-27 |
| 21 | 201841050106-Affidavit_As Filed_27-01-2020.pdf | 2020-01-27 |
| 22 | 201841050106-PA [23-04-2020(online)].pdf | 2020-04-23 |
| 23 | 201841050106-ASSIGNMENT DOCUMENTS [23-04-2020(online)].pdf | 2020-04-23 |
| 24 | 201841050106-8(i)-Substitution-Change Of Applicant - Form 6 [23-04-2020(online)].pdf | 2020-04-23 |
| 25 | 201841050106-FORM FOR STARTUP [14-12-2022(online)].pdf | 2022-12-14 |
| 26 | 201841050106-FORM 18 [15-12-2022(online)].pdf | 2022-12-15 |