Abstract: Systems and methods for identifying body joint location includes obtaining skeletal data, depth data and red, green, and blue (RGB) data pertaining to a user, obtaining, using input data, an estimate of body joint locations (BJLs) and body segment lengths (BSLs), iteratively identifying, based on the depth data and RGB data, probable correct BJLs in a bounded neighborhood around BJLs that are previously obtained, comparing a body segment length associated with the probable correct BJLs and a reference length, identifying candidate BJLs based on comparison, determining a physical orientation of each body segment by segmenting three dimensional (3D) coordinates of each body segment based on the depth data and performing an analysis on each segmented 3D coordinate. A corrected BJL is identified based on a minimal deviation in direction from the physical orientation of a corresponding body segment along with a feature descriptor of the RGB data and depth data.
Claims:
1. A processor implemented method, comprising:
obtaining, by one or more hardware processors, one or more input data comprising skeletal data, depth data and red, green, and blue (RGB) data pertaining to at least one user at one or more time stamps, wherein said one or more input data comprises three dimensional (3D) coordinates pertaining to one or more skeleton joints;
estimating, using said one or more input data, by said one or more hardware processors, in a first set of frames, one or more body joint locations and a body segment length of one or more body segments connected to corresponding skeleton joints to obtain (i) an estimate of one or more body joint locations and (ii) an estimate of one or more body segment lengths;
iteratively identifying, by said one or more hardware processors, one or more probable correct body joint locations in a bounded neighborhood around said one or more body joint locations that are previously obtained, wherein said one or more probable correct body joint locations are iteratively identified based on said depth data and said RGB data;
performing, by said one or more hardware processors, a comparison of (i) a body segment length associated with each of said one or more probable correct body joint locations and (ii) a reference length;
identifying, by said one or more hardware processors, at least a subset of said one or more probable correct body joint locations as one or more candidate body joint locations based on said comparison;
determining a physical orientation of each body segment pertaining to each of said one or more candidate body joint locations by segmenting one or more 3D coordinates of each body segment based on said depth data and performing an analysis on each segmented 3D coordinate; and
identifying, from said one or more candidate body joint locations, a body joint location based on a minimal deviation in direction from said physical orientation of a corresponding body segment along with a feature descriptor of said RGB data and said depth data, wherein said minimal deviation is based on said depth data, and wherein said minimal deviation is based on one or more actions performed by said user.
2. The processor implemented method of claim 1, wherein identifying, by said one or more hardware processors, at least a subset of said one or more probable correct body joint locations as one or more candidate body joint locations is based on said comparison resulting in a minimal body segment length variation.
3. The processor implemented method of claim 1, wherein a search region is defined for identifying said one or more probable correct body joint locations using a radius equivalent to a displacement of a corresponding skeleton joint.
4. The processor implemented method of claim 1, wherein said estimate of said one or more body segment lengths is based on a Euclidean distance between adjacent skeleton joints.
5. The processor implemented method of claim 1, wherein said reference length is derived based on said estimate of said one or more body segment lengths.
6. A system comprising:
a memory storing instructions;
one or more communication interfaces; and
one or more hardware processors coupled to said memory using said one or more communication interfaces, wherein said one or more hardware processors are configured by said instructions to:
obtain one or more input data comprising skeletal data, depth data and red, green, and blue (RGB) data pertaining to at least one user at one or more time stamps, wherein said one or more input data comprising three dimensional (3D) coordinates pertaining to one or more skeleton joints,
estimate, using said one or more input data, one or more body joint locations and a body segment length of one or more body segments connected to corresponding skeleton joints to obtain (i) an estimate of one or more body joint locations and (ii) an estimate of one or more body segment lengths,
identify one or more probable correct body joint locations in a bounded neighborhood around said one or more body joint locations that are previously obtained, wherein said one or more probable correct body joint locations are iteratively identified based on said depth data and said RGB data,
perform a comparison of (i) a body segment length associated with each of said one or more probable correct body joint locations and (ii) a reference length;
identify at least a subset of said one or more probable correct body joint locations as one or more candidate body joint locations based on said comparison,
determine a physical orientation of each body segment pertaining to each of said one or more candidate body joint locations by segmenting one or more 3D coordinates of each body segment based on said depth data and performing an analysis on each segmented 3D coordinate, and
identify, from said one or more candidate body joint locations, a body joint location based on a minimal deviation in direction from said physical orientation of a corresponding body segment along with a feature descriptor of said RGB data and said depth data, wherein said minimal deviation is based on said depth data, and wherein said minimal deviation is based on one or more actions performed by said user.
7. The system of claim 6, wherein at least a subset of said one or more probable correct body joint locations are identified as one or more candidate body joint locations based on said comparison resulting in a minimal body segment length variation.
8. The system of claim 6, wherein a search region is defined for identifying said one or more probable correct body joint locations based on a radius equivalent to a displacement of a corresponding skeleton joint.
9. The system of claim 6, wherein said estimate of said one or more body segment lengths is based on a Euclidean distance between adjacent skeleton joints.
10. The system of claim 6, wherein said reference length is derived based on said estimate of said one or more estimated body segment lengths.
, Description:As Attached
| # | Name | Date |
|---|---|---|
| 1 | 201621027388-IntimationOfGrant26-06-2023.pdf | 2023-06-26 |
| 1 | Form 5 [10-08-2016(online)].pdf | 2016-08-10 |
| 2 | 201621027388-PatentCertificate26-06-2023.pdf | 2023-06-26 |
| 2 | Form 3 [10-08-2016(online)].pdf | 2016-08-10 |
| 3 | Form 18 [10-08-2016(online)].pdf_120.pdf | 2016-08-10 |
| 3 | 201621027388-FER.pdf | 2021-10-18 |
| 4 | Form 18 [10-08-2016(online)].pdf | 2016-08-10 |
| 4 | 201621027388-CLAIMS [23-04-2021(online)].pdf | 2021-04-23 |
| 5 | Drawing [10-08-2016(online)].pdf | 2016-08-10 |
| 5 | 201621027388-FER_SER_REPLY [23-04-2021(online)].pdf | 2021-04-23 |
| 6 | Description(Complete) [10-08-2016(online)].pdf | 2016-08-10 |
| 6 | 201621027388-OTHERS [23-04-2021(online)].pdf | 2021-04-23 |
| 7 | Other Patent Document [31-08-2016(online)].pdf | 2016-08-31 |
| 7 | 201621027388-FORM 3 [20-04-2021(online)].pdf | 2021-04-20 |
| 8 | Form 26 [02-09-2016(online)].pdf | 2016-09-02 |
| 8 | 201621027388-Information under section 8(2) [20-04-2021(online)].pdf | 2021-04-20 |
| 9 | 201621027388-CORRESPONDENCE(IPO)-(CERTIFIED)-(20-2-2017).pdf | 2018-08-11 |
| 9 | REQUEST FOR CERTIFIED COPY [13-02-2017(online)].pdf | 2017-02-13 |
| 10 | 201621027388-Correspondence--060916.pdf | 2018-08-11 |
| 10 | REQUEST FOR CERTIFIED COPY [03-04-2017(online)].pdf | 2017-04-03 |
| 11 | 201621027388-Correspondence-060916.pdf | 2018-08-11 |
| 11 | Form 3 [06-06-2017(online)].pdf | 2017-06-06 |
| 12 | 201621027388-Form 1-060916.pdf | 2018-08-11 |
| 12 | 201621027388-FORM 3 [19-07-2017(online)].pdf | 2017-07-19 |
| 13 | 201621027388-Power of Attorney-060916.pdf | 2018-08-11 |
| 13 | ABSTRACT1.JPG | 2018-08-11 |
| 14 | 201621027388-Power of Attorney-060916.pdf | 2018-08-11 |
| 14 | ABSTRACT1.JPG | 2018-08-11 |
| 15 | 201621027388-Form 1-060916.pdf | 2018-08-11 |
| 15 | 201621027388-FORM 3 [19-07-2017(online)].pdf | 2017-07-19 |
| 16 | 201621027388-Correspondence-060916.pdf | 2018-08-11 |
| 16 | Form 3 [06-06-2017(online)].pdf | 2017-06-06 |
| 17 | REQUEST FOR CERTIFIED COPY [03-04-2017(online)].pdf | 2017-04-03 |
| 17 | 201621027388-Correspondence--060916.pdf | 2018-08-11 |
| 18 | 201621027388-CORRESPONDENCE(IPO)-(CERTIFIED)-(20-2-2017).pdf | 2018-08-11 |
| 18 | REQUEST FOR CERTIFIED COPY [13-02-2017(online)].pdf | 2017-02-13 |
| 19 | 201621027388-Information under section 8(2) [20-04-2021(online)].pdf | 2021-04-20 |
| 19 | Form 26 [02-09-2016(online)].pdf | 2016-09-02 |
| 20 | 201621027388-FORM 3 [20-04-2021(online)].pdf | 2021-04-20 |
| 20 | Other Patent Document [31-08-2016(online)].pdf | 2016-08-31 |
| 21 | 201621027388-OTHERS [23-04-2021(online)].pdf | 2021-04-23 |
| 21 | Description(Complete) [10-08-2016(online)].pdf | 2016-08-10 |
| 22 | 201621027388-FER_SER_REPLY [23-04-2021(online)].pdf | 2021-04-23 |
| 22 | Drawing [10-08-2016(online)].pdf | 2016-08-10 |
| 23 | 201621027388-CLAIMS [23-04-2021(online)].pdf | 2021-04-23 |
| 23 | Form 18 [10-08-2016(online)].pdf | 2016-08-10 |
| 24 | 201621027388-FER.pdf | 2021-10-18 |
| 24 | Form 18 [10-08-2016(online)].pdf_120.pdf | 2016-08-10 |
| 25 | Form 3 [10-08-2016(online)].pdf | 2016-08-10 |
| 25 | 201621027388-PatentCertificate26-06-2023.pdf | 2023-06-26 |
| 26 | Form 5 [10-08-2016(online)].pdf | 2016-08-10 |
| 26 | 201621027388-IntimationOfGrant26-06-2023.pdf | 2023-06-26 |
| 1 | 2020-11-1816-58-42E_18-11-2020.pdf |