Abstract: This disclosure relates generally to generating synthetic data, and more particularly to method and system for synthesizing three-dimensional (3D) data using generative adversarial networks (GANs). The method may include clustering initial 3D data to identify one or more regions of interest (ROIs), generating an input specific noise data based on the one or more ROIs by an iterative process using Gaussian mixture model, and iteratively synthesizing the 3D data based on the one or more ROIs and the input specific noise data using generative adversarial networks (GANs) to generate final synthesized 3D data. The initial 3D data may represent a given scenario, while the final synthesized 3D data may represent a number of possible scenarios and are affine transforms of the initial 3D data. Figure 2
Claims:WE CLAIM:
1. A system for synthesizing three-dimensional (3D) data representing a plurality of possible scenarios from initial 3D data representing a given scenario, the system comprising:
a data synthesis device comprising of at least one processor and a computer-readable medium storing instruction that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
clustering initial 3D data to identify one or more regions of interest (ROIs), wherein the initial 3D data represent a given scenario;
generating input specific noise data based on the one or more ROIs by an iterative process using Gaussian mixture model; and
iteratively synthesizing 3D data based on the one or more ROIs and the input specific noise data using generative adversarial networks (GANs) to generate final synthesized 3D data, wherein the final synthesized 3D data represent a plurality of possible scenarios and are affine transforms of the initial 3D data.
2. The system of claim 1, wherein the initial 3D data are point cloud data acquired by a light detection and ranging (LiDAR) sensor.
3. The system of claim 1, wherein the initial 3D data are high definition data.
4. The system of claim 3, wherein the operations further comprise down sampling the final synthesized 3D data using one or more voxel grid filters.
5. The system of claim 1, wherein the operations further comprise training an artificial intelligence (AI) model with the final synthesized 3D data.
6. The system of claim 5, wherein the AI model is trained for object classification and localization for use in autonomous navigation application.
7. The system of claim 5, wherein the operations further comprise:
determining Eigen values for the final synthesized 3D data using singular value decomposition; and
computing embedding vector for the final synthesized 3D data based on the Eigen values.
8. The system of claim 1, wherein generating the input specific noise data comprises:
computing multi-variate Gaussian distribution of the one or more ROIs based on a set of feature vectors for the one or more ROIs; and
deriving prior probability for the multi-variate Gaussian distribution of the one or more ROIs based on a set of classes for the one or more ROIs and the set of feature vectors for the one or more ROIs.
9. The system of claim 1, wherein generating the input specific noise data comprises iteratively back-propagating the 3D data to generate updated input specific noise data.
10. A method for synthesizing three-dimensional (3D) data representing a plurality of possible scenarios from initial 3D data representing a given scenario, the method comprising:
clustering, by a data synthesis device, initial 3D data to identify one or more regions of interest (ROIs), wherein the initial 3D data represent a given scenario;
generating, by the data synthesis device, input specific noise data based on the one or more ROIs by an iterative process using Gaussian mixture model; and
iteratively synthesizing, by the data synthesis device, 3D data based on the one or more ROIs and the input specific noise data using generative adversarial networks (GANs) to generate final synthesized 3D data, wherein the final synthesized 3D data represent a plurality of possible scenarios and are affine transforms of the initial 3D data.
11. The method of claim 10, further comprising down sampling the final synthesized 3D data using one or more voxel grid filters when the initial 3D data are high definition data.
12. The method of claim 10, further comprising training an artificial intelligence (AI) model with the final synthesized 3D data, wherein training further comprises:
determining Eigen values for the final synthesized 3D data using singular value decomposition; and
computing embedding vector for the final synthesized 3D data based on the Eigen values.
13. The method of claim 10, wherein generating the input specific noise data comprises:
computing multi-variate Gaussian distribution of the one or more ROIs based on a set of feature vectors for the one or more ROIs; and
deriving prior probability for the multi-variate Gaussian distribution of the one or more ROIs based on a set of classes for the one or more ROIs and the set of feature vectors for the one or more ROIs.
14. The method of claim 10, wherein generating the input specific noise data further comprises iteratively back-propagating the 3D data to generate updated input specific noise data.
Dated this 15th day of February, 2019
SWETHA S.N.
OF K & S PARTNERS
AGENT FOR THE APPLICANT
IN/PA-2123
, Description:Technical Field
This disclosure relates generally to generating synthetic data, and more particularly to method and system for synthesizing three-dimensional (3D) data using generative adversarial networks (GANs).
| # | Name | Date |
|---|---|---|
| 1 | 201941006171-IntimationOfGrant27-09-2024.pdf | 2024-09-27 |
| 1 | 201941006171-PROOF OF ALTERATION [08-01-2025(online)].pdf | 2025-01-08 |
| 1 | 201941006171-STATEMENT OF UNDERTAKING (FORM 3) [16-02-2019(online)].pdf | 2019-02-16 |
| 2 | 201941006171-IntimationOfGrant27-09-2024.pdf | 2024-09-27 |
| 2 | 201941006171-PatentCertificate27-09-2024.pdf | 2024-09-27 |
| 2 | 201941006171-REQUEST FOR EXAMINATION (FORM-18) [16-02-2019(online)].pdf | 2019-02-16 |
| 3 | 201941006171-FER.pdf | 2021-10-17 |
| 3 | 201941006171-PatentCertificate27-09-2024.pdf | 2024-09-27 |
| 3 | 201941006171-POWER OF AUTHORITY [16-02-2019(online)].pdf | 2019-02-16 |
| 4 | 201941006171-FORM 18 [16-02-2019(online)].pdf | 2019-02-16 |
| 4 | 201941006171-FER.pdf | 2021-10-17 |
| 4 | 201941006171-CLAIMS [29-06-2021(online)].pdf | 2021-06-29 |
| 5 | 201941006171-FORM 1 [16-02-2019(online)].pdf | 2019-02-16 |
| 5 | 201941006171-COMPLETE SPECIFICATION [29-06-2021(online)].pdf | 2021-06-29 |
| 5 | 201941006171-CLAIMS [29-06-2021(online)].pdf | 2021-06-29 |
| 6 | 201941006171-DRAWINGS [16-02-2019(online)].pdf | 2019-02-16 |
| 6 | 201941006171-CORRESPONDENCE [29-06-2021(online)].pdf | 2021-06-29 |
| 6 | 201941006171-COMPLETE SPECIFICATION [29-06-2021(online)].pdf | 2021-06-29 |
| 7 | 201941006171-DRAWING [29-06-2021(online)].pdf | 2021-06-29 |
| 7 | 201941006171-DECLARATION OF INVENTORSHIP (FORM 5) [16-02-2019(online)].pdf | 2019-02-16 |
| 7 | 201941006171-CORRESPONDENCE [29-06-2021(online)].pdf | 2021-06-29 |
| 8 | 201941006171-COMPLETE SPECIFICATION [16-02-2019(online)].pdf | 2019-02-16 |
| 8 | 201941006171-DRAWING [29-06-2021(online)].pdf | 2021-06-29 |
| 8 | 201941006171-FER_SER_REPLY [29-06-2021(online)].pdf | 2021-06-29 |
| 9 | 201941006171-FER_SER_REPLY [29-06-2021(online)].pdf | 2021-06-29 |
| 9 | 201941006171-FORM 3 [29-06-2021(online)].pdf | 2021-06-29 |
| 9 | 201941006171-Request Letter-Correspondence [20-02-2019(online)].pdf | 2019-02-20 |
| 10 | 201941006171-FORM 3 [29-06-2021(online)].pdf | 2021-06-29 |
| 10 | 201941006171-Information under section 8(2) [29-06-2021(online)].pdf | 2021-06-29 |
| 10 | 201941006171-Power of Attorney [20-02-2019(online)].pdf | 2019-02-20 |
| 11 | 201941006171-Form 1 (Submitted on date of filing) [20-02-2019(online)].pdf | 2019-02-20 |
| 11 | 201941006171-Information under section 8(2) [29-06-2021(online)].pdf | 2021-06-29 |
| 11 | 201941006171-OTHERS [29-06-2021(online)].pdf | 2021-06-29 |
| 12 | 201941006171-OTHERS [29-06-2021(online)].pdf | 2021-06-29 |
| 12 | 201941006171-PETITION UNDER RULE 137 [29-06-2021(online)].pdf | 2021-06-29 |
| 12 | 201941006171-Proof of Right (MANDATORY) [05-06-2019(online)].pdf | 2019-06-05 |
| 13 | Correspondence by Agent _Proof Of Right_10-06-2019.pdf | 2019-06-10 |
| 13 | 201941006171-PETITION UNDER RULE 137 [29-06-2021(online)].pdf | 2021-06-29 |
| 14 | 201941006171-PETITION UNDER RULE 137 [29-06-2021(online)].pdf | 2021-06-29 |
| 14 | 201941006171-Proof of Right (MANDATORY) [05-06-2019(online)].pdf | 2019-06-05 |
| 14 | Correspondence by Agent _Proof Of Right_10-06-2019.pdf | 2019-06-10 |
| 15 | 201941006171-Form 1 (Submitted on date of filing) [20-02-2019(online)].pdf | 2019-02-20 |
| 15 | 201941006171-OTHERS [29-06-2021(online)].pdf | 2021-06-29 |
| 15 | 201941006171-Proof of Right (MANDATORY) [05-06-2019(online)].pdf | 2019-06-05 |
| 16 | 201941006171-Form 1 (Submitted on date of filing) [20-02-2019(online)].pdf | 2019-02-20 |
| 16 | 201941006171-Information under section 8(2) [29-06-2021(online)].pdf | 2021-06-29 |
| 16 | 201941006171-Power of Attorney [20-02-2019(online)].pdf | 2019-02-20 |
| 17 | 201941006171-Power of Attorney [20-02-2019(online)].pdf | 2019-02-20 |
| 17 | 201941006171-Request Letter-Correspondence [20-02-2019(online)].pdf | 2019-02-20 |
| 17 | 201941006171-FORM 3 [29-06-2021(online)].pdf | 2021-06-29 |
| 18 | 201941006171-FER_SER_REPLY [29-06-2021(online)].pdf | 2021-06-29 |
| 18 | 201941006171-Request Letter-Correspondence [20-02-2019(online)].pdf | 2019-02-20 |
| 18 | 201941006171-COMPLETE SPECIFICATION [16-02-2019(online)].pdf | 2019-02-16 |
| 19 | 201941006171-COMPLETE SPECIFICATION [16-02-2019(online)].pdf | 2019-02-16 |
| 19 | 201941006171-DECLARATION OF INVENTORSHIP (FORM 5) [16-02-2019(online)].pdf | 2019-02-16 |
| 19 | 201941006171-DRAWING [29-06-2021(online)].pdf | 2021-06-29 |
| 20 | 201941006171-CORRESPONDENCE [29-06-2021(online)].pdf | 2021-06-29 |
| 20 | 201941006171-DECLARATION OF INVENTORSHIP (FORM 5) [16-02-2019(online)].pdf | 2019-02-16 |
| 20 | 201941006171-DRAWINGS [16-02-2019(online)].pdf | 2019-02-16 |
| 21 | 201941006171-COMPLETE SPECIFICATION [29-06-2021(online)].pdf | 2021-06-29 |
| 21 | 201941006171-DRAWINGS [16-02-2019(online)].pdf | 2019-02-16 |
| 21 | 201941006171-FORM 1 [16-02-2019(online)].pdf | 2019-02-16 |
| 22 | 201941006171-CLAIMS [29-06-2021(online)].pdf | 2021-06-29 |
| 22 | 201941006171-FORM 1 [16-02-2019(online)].pdf | 2019-02-16 |
| 22 | 201941006171-FORM 18 [16-02-2019(online)].pdf | 2019-02-16 |
| 23 | 201941006171-FER.pdf | 2021-10-17 |
| 23 | 201941006171-FORM 18 [16-02-2019(online)].pdf | 2019-02-16 |
| 23 | 201941006171-POWER OF AUTHORITY [16-02-2019(online)].pdf | 2019-02-16 |
| 24 | 201941006171-PatentCertificate27-09-2024.pdf | 2024-09-27 |
| 24 | 201941006171-POWER OF AUTHORITY [16-02-2019(online)].pdf | 2019-02-16 |
| 24 | 201941006171-REQUEST FOR EXAMINATION (FORM-18) [16-02-2019(online)].pdf | 2019-02-16 |
| 25 | 201941006171-STATEMENT OF UNDERTAKING (FORM 3) [16-02-2019(online)].pdf | 2019-02-16 |
| 25 | 201941006171-REQUEST FOR EXAMINATION (FORM-18) [16-02-2019(online)].pdf | 2019-02-16 |
| 25 | 201941006171-IntimationOfGrant27-09-2024.pdf | 2024-09-27 |
| 26 | 201941006171-STATEMENT OF UNDERTAKING (FORM 3) [16-02-2019(online)].pdf | 2019-02-16 |
| 26 | 201941006171-PROOF OF ALTERATION [08-01-2025(online)].pdf | 2025-01-08 |
| 1 | 2020-12-2813-21-20E_28-12-2020.pdf |