Sign In to Follow Application
View All Documents & Correspondence

Systems And Methods For Identifying Body Joint Locations Based On Sensor Data Analysis

Abstract: Systems and methods for identifying body joint location includes obtaining skeletal data, depth data and red, green, and blue (RGB) data pertaining to a user, obtaining, using input data, an estimate of body joint locations (BJLs) and body segment lengths (BSLs), iteratively identifying, based on the depth data and RGB data, probable correct BJLs in a bounded neighborhood around BJLs that are previously obtained, comparing a body segment length associated with the probable correct BJLs and a reference length, identifying candidate BJLs based on comparison, determining a physical orientation of each body segment by segmenting three dimensional (3D) coordinates of each body segment based on the depth data and performing an analysis on each segmented 3D coordinate. A corrected BJL is identified based on a minimal deviation in direction from the physical orientation of a corresponding body segment along with a feature descriptor of the RGB data and depth data.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
10 August 2016
Publication Number
07/2018
Publication Type
INA
Invention Field
COMPUTER SCIENCE
Status
Email
iprdel@lakshmisri.com
Parent Application
Patent Number
Legal Status
Grant Date
2023-06-26
Renewal Date

Applicants

TATA CONSULTANCY SERVICES LIMITED
Nirmal Building, 9th Floor, Nariman Point, Mumbai, Maharashtra 400021, India

Inventors

1. SINHA, Sanjana
Tata Consultancy Services Limited Building 1B, Ecospace Plot - IIF/12 , New Town, Rajarhat, Kolkata - 700160, West Bengal, India
2. BHOWMICK, Brojeshwar
Tata Consultancy Services Limited Building 1B, Ecospace Plot - IIF/12 , New Town, Rajarhat, Kolkata - 700160, West Bengal, India
3. CHAKRAVARTY, Kingshuk
Tata Consultancy Services Limited Building 1B, Ecospace Plot - IIF/12 , New Town, Rajarhat, Kolkata - 700160, West Bengal, India
4. SINHA, Aniruddha
Tata Consultancy Services Limited Building 1B, Ecospace Plot - IIF/12 , New Town, Rajarhat, Kolkata - 700160, West Bengal, India
5. DAS, Abhijit
122 Afiz Md. Ishaque Road, Writers Para, Haidevpur Kolkata – 82, India

Specification

Claims:
1. A processor implemented method, comprising:
obtaining, by one or more hardware processors, one or more input data comprising skeletal data, depth data and red, green, and blue (RGB) data pertaining to at least one user at one or more time stamps, wherein said one or more input data comprises three dimensional (3D) coordinates pertaining to one or more skeleton joints;
estimating, using said one or more input data, by said one or more hardware processors, in a first set of frames, one or more body joint locations and a body segment length of one or more body segments connected to corresponding skeleton joints to obtain (i) an estimate of one or more body joint locations and (ii) an estimate of one or more body segment lengths;
iteratively identifying, by said one or more hardware processors, one or more probable correct body joint locations in a bounded neighborhood around said one or more body joint locations that are previously obtained, wherein said one or more probable correct body joint locations are iteratively identified based on said depth data and said RGB data;
performing, by said one or more hardware processors, a comparison of (i) a body segment length associated with each of said one or more probable correct body joint locations and (ii) a reference length;
identifying, by said one or more hardware processors, at least a subset of said one or more probable correct body joint locations as one or more candidate body joint locations based on said comparison;
determining a physical orientation of each body segment pertaining to each of said one or more candidate body joint locations by segmenting one or more 3D coordinates of each body segment based on said depth data and performing an analysis on each segmented 3D coordinate; and
identifying, from said one or more candidate body joint locations, a body joint location based on a minimal deviation in direction from said physical orientation of a corresponding body segment along with a feature descriptor of said RGB data and said depth data, wherein said minimal deviation is based on said depth data, and wherein said minimal deviation is based on one or more actions performed by said user.

2. The processor implemented method of claim 1, wherein identifying, by said one or more hardware processors, at least a subset of said one or more probable correct body joint locations as one or more candidate body joint locations is based on said comparison resulting in a minimal body segment length variation.

3. The processor implemented method of claim 1, wherein a search region is defined for identifying said one or more probable correct body joint locations using a radius equivalent to a displacement of a corresponding skeleton joint.

4. The processor implemented method of claim 1, wherein said estimate of said one or more body segment lengths is based on a Euclidean distance between adjacent skeleton joints.

5. The processor implemented method of claim 1, wherein said reference length is derived based on said estimate of said one or more body segment lengths.

6. A system comprising:
a memory storing instructions;
one or more communication interfaces; and
one or more hardware processors coupled to said memory using said one or more communication interfaces, wherein said one or more hardware processors are configured by said instructions to:
obtain one or more input data comprising skeletal data, depth data and red, green, and blue (RGB) data pertaining to at least one user at one or more time stamps, wherein said one or more input data comprising three dimensional (3D) coordinates pertaining to one or more skeleton joints,
estimate, using said one or more input data, one or more body joint locations and a body segment length of one or more body segments connected to corresponding skeleton joints to obtain (i) an estimate of one or more body joint locations and (ii) an estimate of one or more body segment lengths,
identify one or more probable correct body joint locations in a bounded neighborhood around said one or more body joint locations that are previously obtained, wherein said one or more probable correct body joint locations are iteratively identified based on said depth data and said RGB data,
perform a comparison of (i) a body segment length associated with each of said one or more probable correct body joint locations and (ii) a reference length;
identify at least a subset of said one or more probable correct body joint locations as one or more candidate body joint locations based on said comparison,
determine a physical orientation of each body segment pertaining to each of said one or more candidate body joint locations by segmenting one or more 3D coordinates of each body segment based on said depth data and performing an analysis on each segmented 3D coordinate, and
identify, from said one or more candidate body joint locations, a body joint location based on a minimal deviation in direction from said physical orientation of a corresponding body segment along with a feature descriptor of said RGB data and said depth data, wherein said minimal deviation is based on said depth data, and wherein said minimal deviation is based on one or more actions performed by said user.

7. The system of claim 6, wherein at least a subset of said one or more probable correct body joint locations are identified as one or more candidate body joint locations based on said comparison resulting in a minimal body segment length variation.

8. The system of claim 6, wherein a search region is defined for identifying said one or more probable correct body joint locations based on a radius equivalent to a displacement of a corresponding skeleton joint.

9. The system of claim 6, wherein said estimate of said one or more body segment lengths is based on a Euclidean distance between adjacent skeleton joints.

10. The system of claim 6, wherein said reference length is derived based on said estimate of said one or more estimated body segment lengths.
, Description:As Attached

Documents

Application Documents

# Name Date
1 201621027388-IntimationOfGrant26-06-2023.pdf 2023-06-26
1 Form 5 [10-08-2016(online)].pdf 2016-08-10
2 201621027388-PatentCertificate26-06-2023.pdf 2023-06-26
2 Form 3 [10-08-2016(online)].pdf 2016-08-10
3 Form 18 [10-08-2016(online)].pdf_120.pdf 2016-08-10
3 201621027388-FER.pdf 2021-10-18
4 Form 18 [10-08-2016(online)].pdf 2016-08-10
4 201621027388-CLAIMS [23-04-2021(online)].pdf 2021-04-23
5 Drawing [10-08-2016(online)].pdf 2016-08-10
5 201621027388-FER_SER_REPLY [23-04-2021(online)].pdf 2021-04-23
6 Description(Complete) [10-08-2016(online)].pdf 2016-08-10
6 201621027388-OTHERS [23-04-2021(online)].pdf 2021-04-23
7 Other Patent Document [31-08-2016(online)].pdf 2016-08-31
7 201621027388-FORM 3 [20-04-2021(online)].pdf 2021-04-20
8 Form 26 [02-09-2016(online)].pdf 2016-09-02
8 201621027388-Information under section 8(2) [20-04-2021(online)].pdf 2021-04-20
9 201621027388-CORRESPONDENCE(IPO)-(CERTIFIED)-(20-2-2017).pdf 2018-08-11
9 REQUEST FOR CERTIFIED COPY [13-02-2017(online)].pdf 2017-02-13
10 201621027388-Correspondence--060916.pdf 2018-08-11
10 REQUEST FOR CERTIFIED COPY [03-04-2017(online)].pdf 2017-04-03
11 201621027388-Correspondence-060916.pdf 2018-08-11
11 Form 3 [06-06-2017(online)].pdf 2017-06-06
12 201621027388-Form 1-060916.pdf 2018-08-11
12 201621027388-FORM 3 [19-07-2017(online)].pdf 2017-07-19
13 201621027388-Power of Attorney-060916.pdf 2018-08-11
13 ABSTRACT1.JPG 2018-08-11
14 201621027388-Power of Attorney-060916.pdf 2018-08-11
14 ABSTRACT1.JPG 2018-08-11
15 201621027388-Form 1-060916.pdf 2018-08-11
15 201621027388-FORM 3 [19-07-2017(online)].pdf 2017-07-19
16 201621027388-Correspondence-060916.pdf 2018-08-11
16 Form 3 [06-06-2017(online)].pdf 2017-06-06
17 REQUEST FOR CERTIFIED COPY [03-04-2017(online)].pdf 2017-04-03
17 201621027388-Correspondence--060916.pdf 2018-08-11
18 201621027388-CORRESPONDENCE(IPO)-(CERTIFIED)-(20-2-2017).pdf 2018-08-11
18 REQUEST FOR CERTIFIED COPY [13-02-2017(online)].pdf 2017-02-13
19 201621027388-Information under section 8(2) [20-04-2021(online)].pdf 2021-04-20
19 Form 26 [02-09-2016(online)].pdf 2016-09-02
20 201621027388-FORM 3 [20-04-2021(online)].pdf 2021-04-20
20 Other Patent Document [31-08-2016(online)].pdf 2016-08-31
21 201621027388-OTHERS [23-04-2021(online)].pdf 2021-04-23
21 Description(Complete) [10-08-2016(online)].pdf 2016-08-10
22 201621027388-FER_SER_REPLY [23-04-2021(online)].pdf 2021-04-23
22 Drawing [10-08-2016(online)].pdf 2016-08-10
23 201621027388-CLAIMS [23-04-2021(online)].pdf 2021-04-23
23 Form 18 [10-08-2016(online)].pdf 2016-08-10
24 201621027388-FER.pdf 2021-10-18
24 Form 18 [10-08-2016(online)].pdf_120.pdf 2016-08-10
25 Form 3 [10-08-2016(online)].pdf 2016-08-10
25 201621027388-PatentCertificate26-06-2023.pdf 2023-06-26
26 Form 5 [10-08-2016(online)].pdf 2016-08-10
26 201621027388-IntimationOfGrant26-06-2023.pdf 2023-06-26

Search Strategy

1 2020-11-1816-58-42E_18-11-2020.pdf

ERegister / Renewals

3rd: 05 Jul 2023

From 10/08/2018 - To 10/08/2019

4th: 05 Jul 2023

From 10/08/2019 - To 10/08/2020

5th: 05 Jul 2023

From 10/08/2020 - To 10/08/2021

6th: 05 Jul 2023

From 10/08/2021 - To 10/08/2022

7th: 05 Jul 2023

From 10/08/2022 - To 10/08/2023

8th: 05 Jul 2023

From 10/08/2023 - To 10/08/2024

9th: 07 Aug 2024

From 10/08/2024 - To 10/08/2025

10th: 05 Aug 2025

From 10/08/2025 - To 10/08/2026