Sign In to Follow Application
View All Documents & Correspondence

System And Method For Analyzing Videos In Real Time

Abstract: A method and a sports analytics system (SAS) for analyzing a live video broadcast stream (LVBS) of a sporting event are provided. The SAS splits the LVBS into a real time messaging protocol (RTMP) stream and a hypertext transfer protocol live stream (HLS) and analyses the RTMP stream using a phase difference between the RTMP stream and the HLS. The SAS detects persons present in a frame of the RTMP stream using a first set of cues and tracks the detected persons by analyzing preceding frames. The SAS recognizes the tracked persons using a second set of cues, assigns individual weights to each of the second set of cues, and compares the assigned weights of each of the recognized persons with pre-existing data of all players to identify the players in the frame. The SAS transmits the HLS and contextual interactive content of the identified players to a user device. FIG. 1

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
13 February 2020
Publication Number
34/2021
Publication Type
INA
Invention Field
ELECTRONICS
Status
Email
gosakan@unicitaconsulting.com
Parent Application

Applicants

Edisn Media and Tech Solutions Pvt.
143, 10th Cross Rd, Binnamangala, Stage 1, Indiranagar, Bengaluru

Inventors

1. Akshay Chandrasekhar
164, 24th Cross Road, 6th Block Jayanagar, Bangalore, 560070
2. Shivank Gupta
156 1st Floor 2nd Main S.T.BedLayout Koramangala 4th Block, Bangalore, 560034
3. Monish Kumar Keswani
402, Empress, Tycoon's Residency, Barave Road, Kalyan, 421301
4. Arjun Kashyap
#26 Block 13, SBM Colony, Srirampura 2nd Stage, Mysuru, 570023

Specification

We claim:
1. A sports analytics system incorporating a computer server for analyzing a live video broadcast stream of a sporting event, said sport analytics system comprising:
a video demuxer for receiving said live video broadcast stream of said sporting event from a video capture device and splitting said received live broadcast stream into a real time messaging protocol stream and a hypertext transfer protocol live stream;
a non-transitory computer readable storage media for storing computer program instructions defined by modules of said sport analytics system; and
at least one processor communicatively coupled to said non-transitory computer readable storage media, said at least one processor configured to execute said computer program instructions defined by said modules of said sport analytics system, said modules comprising:
an analytics module for analyzing said real time messaging protocol stream within a predetermined time interval, wherein said predetermined time interval corresponds to a phase difference between said real time messaging protocol stream and said hypertext transfer protocol live stream, wherein said analytics module comprises:
a detection module for detecting one or more persons present in a frame of said real time messaging protocol

stream, using one or more cues selected from a first set of cues comprising a facial detection, a head detection, a person detection, and a jersey number detection based on availability of said first set of cues;
a tracking module for tracking said detected persons in said frame, by analyzing one or more preceding frames of said real time messaging protocol stream;
a recognition module for recognizing said tracked persons in said frame using one or more cues selected from a second set of cues comprising a facial recognition, a person recognition, a jersey recognition, a live score feed of said sporting event, and a commentary of said sporting event based on availability of said second set of cues, wherein individual weights are assigned to each of said facial recognition, said person recognition, and said jersey recognition when said facial recognition, said person recognition, and said jersey recognition are performed in said frame;
a comparison module for identifying one or more players in said frame by comparing said assigned weights for each of said recognized persons with pre-existing data of all players; and
a transmission module for transmitting said hypertext transfer protocol live stream and analysis data comprising contextual interactive content of said identified players to a cliënt application provided on a user device by said sports analytics system within said predetermined time interval, wherein said live video

broadcast stream is transformed into an interactive video comprising said contextual interactive content of said identified players.
2. The sports analytics system of claim 1, wherein if any of said facial recognition, said person recognition, and said jersey recognition is unavailable, said recognition module uses one or more of said live score feed and said commentary for said identification of said one or more players in said frame.
3. The sports analytics system of claim 1, wherein said predetermined time interval is less than a frame persistence time of said frame.
4. The sports analytics system of claim 1, wherein said jersey recognition comprises one or more of jersey number classification and team recognition.
5. The sports analytics system of claim 1, wherein said individual weights are determined based on clarity of each person recognized in said frame.
6. The sports analytics system of claim 1, wherein said cliënt application comprises an interaction module for providing user interaction with said interactive video.
7. The sports analytics system of claim 1, wherein said contextual interactive content of said identified players is displayed on said user device without said contextual interactive content of said identified players overlapping existing graphics of said hypertext transfer protocol live stream.
8. The sports analytics system of claim 7, wherein said contextual interactive content of said identified players comprises a dynamic display of one or more of a scorecard, player information, and match statistics, wherein said

contextual interactive content of said identified players is configured to be customized and shared on social media.
9. A method for analyzing a live video broadcast stream of a sporting event, the method employing a sports analytics system comprising at least one processor configured to execute computer program instructions for performing said method, said method comprising:
receiving said live video broadcast stream of said sporting event from a video capturing device, by a video demuxer of said sports analytics system;
splitting said live broadcast stream into a real time messaging protocol stream and a hypertext transfer protocol live stream, by said video demuxer of said sports analytics system;
analyzing said real time messaging protocol stream within a predetermined time interval, wherein said predetermined time interval comprises a phase difference between said real time messaging protocol stream and said hypertext transfer protocol live stream, wherein said analysis comprises:
detecting one or more persons present in a frame of said real time messaging protocol stream, using one or more cues selected from a first set of cues comprising a facial detection, a head detection, a person detection, and a jersey number detection based on availability of said first set of cues;
tracking said detected persons in said frame, by analyzing one or more preceding frames of said real time messaging protocol stream;

recognizing said tracked persons in said frame using one or more cues selected from a second set of cues comprising a facial recognition, a person recognition, a jersey recognition, a live score feed of said sporting event, and a commentary of said sporting event based on availability of said second set of cues, wherein individual weights are assigned to each of said facial recognition, said person recognition, and said jersey recognition when said facial recognition, said person recognition, and said jersey recognition are performed in said frame; and
identifying one or more players in said frame by comparing said assigned weights for each of said recognized persons with pre-existing data of all players; and
transmitting said hypertext transfer protocol live stream and analysis data comprising contextual interactive content of said identified players to a cliënt application provided on a user device by said sports analytics system within said predetermined time interval;
whereby said live video broadcast stream is transformed into an interactive video comprising said contextual interactive content of said identified players and transmitted to said user device.
The method of claim 9, wherein if any of said facial recognition, said person recognition, and said jersey recognition is unavailable, one or more of said live score feed and said commentary is used for said identification of said one or more players in said frame.
The method of claim 9, wherein said predetermined time interval is less than a frame persistence time of said frame.

12. The method of claim 9, wherein said jersey recognition comprises one or more of jersey number classification and team recognition.
13. The method of claim 9, wherein said individual weights are determined based on clarity of each person recognized in said frame.
14. The method of claim 9, wherein a user can interact with one or more of said identified players in said interactive video.
15. The method of claim 9, wherein said contextual interactive content of said identified players is displayed on said user device without said contextual interactive content of said identified players overlapping graphics of said hypertext transfer protocol live stream.
16. The method of claim 15, wherein said contextual interactive content of said identified players comprises a dynamic display of one or more of a scorecard, player information, and match statistics, wherein said contextual interactive content of said identified players is configured to be customized and shared on social media.
17. A non-transitory computer readable storage medium having embodied thereon, computer program codes comprising instructions executable by at least one processor for analyzing a live video broadcast stream of a sporting event, said computer program codes comprising:
a first computer program code for receiving said live video broadcast stream of said sporting event from one or more video capturing devices;

a second computer program code for splitting said live broadcast stream into a real time messaging protocol stream and a hypertext transfer protocol live stream;
a third computer program code for analyzing said real time messaging protocol stream within a predetermined time interval, wherein said predetermined time interval comprises a phase difference between said real time messaging protocol stream and said hypertext transfer protocol live stream;
a fourth computer program code for detecting one or more persons present in a frame of said real time messaging protocol stream, using one or more cues selected from a first set of cues comprising a facial detection, a head detection, a person detection, and a jersey number detection based on availability of said first set of cues;
a fifth computer program code for tracking said detected persons in said frame, by analyzing one or more preceding frames of said real time messaging protocol stream;
a sixth computer program code for recognizing said tracked persons in said frame using one or more cues selected from a second set of cues comprising a facial recognition, a person recognition, a jersey recognition, a live score feed of said sporting event, and a commentary of said sporting event based on availability of said second set of cues, wherein individual weights are assigned to each of said facial recognition, said person recognition, and said jersey recognition when said facial recognition, said person recognition, and said jersey recognition performed in said frame;

a seventh computer program code for identifying one or more players in said frame by comparing said assigned weights for each of said recognized persons with pre-existing data of all players; and
an eighth computer program code for transmitting said hypertext transfer protocol live stream and analysis data comprising contextual interactive content of said identified players to a cliënt application provided on a user device by said sports analytics system within said predetermined time interval.
18. The non-transitory computer readable storage medium of claim 17, wherein if any of said facial recognition, said person recognition, and said jersey recognition is unavailable, one or more of said live score feed and said commentary is used for said identification of said one or more players in said frame.
19. The non-transitory computer readable storage medium of claim 17, wherein said computer program codes further comprise a ninth computer program code for providing user interaction with said interactive video.
20. The non-transitory computer readable storage medium of claim 17, wherein said predetermined time interval is less than a frame persistence time of said frame.
21. The non-transitory computer readable storage medium of claim 17, wherein said jersey recognition comprises one or more of jersey number classification and team recognition.
22. The non-transitory computer readable storage medium of claim 17, wherein said individual weights are determined based on clarity of each person recognized in said frame.

23. The non-transitory computer readable storage medium of claim 17, wherein said contextual interactive content of said identified players is displayed on said user device without said contextual interactive content of said identified players overlapping existing graphics of said hypertext transfer protocol live stream.
24. The non-transitory computer readable storage medium of claim 23, wherein said contextual interactive content of said identified players comprises a dynamic display of one or more of a scorecard, player information, and match statistics, wherein said contextual interactive content of said identified players is configured to be customized and shared on social media.
25. A sports analytics system incorporating a computer server for analyzing a pre-recorded video stream of a sporting event, said sport analytics system comprising:
a non-transitory computer readable storage media for storing computer program instructions defined by modules of said sport analytics system; and
at least one processor communicatively coupled to said non-transitory computer readable storage media, said at least one processor configured to execute said computer program instructions defined by said modules of said sport analytics system, said modules comprising:
an analytics module for analyzing said pre-recorded video stream, wherein said analytics module comprises:
a detection module for detecting one or more persons present in a frame of said pre-recorded video stream,

using one or more cues selected from a first set of cues comprising a facial detection, a head detection, a person detection, and a jersey number detection based on availability of said first set of cues;
a tracking module for tracking said detected persons in said frame, by analyzing one or more preceding frames;
a recognition module for recognizing said tracked persons in said frame using one or more cues selected from a second set of cues comprising a facial recognition, a person recognition, a jersey recognition, a score feed of said sporting event, and a commentary of said sporting event based on availability of said second set of cues, wherein individual weights are assigned to each of said facial recognition, said person recognition, and said jersey recognition when said facial recognition, said person recognition, and said jersey recognition are performed in said frame;
a comparison module for identifying one or more players in said frame by comparing said assigned weights for each of said recognized persons with pre-existing data of all players; and
a transmission module for transmitting said pre-recorded video stream and analysis data comprising contextual interactive content of said identified players to a cliënt application provided on a user device by said sports analytics system, wherein said pre-recorded video stream is transformed into an interactive video

comprising said contextual interactive content of said identified players.
26. A method for analyzing a pre-recorded video stream of a sporting event, the method employing a sports analytics system comprising at least one processor configured to execute computer program instractions for performing said method, said method comprising:
analyzing said pre-recorded video stream, wherein said analysis comprises:
detecting one or more persons present in a frame of said pre-recorded video stream, using one or more cues selected from a first set of cues comprising a facial detection, a head detection, a person detection, and a jersey number detection based on availability of said first set of cues;
tracking said detected persons in said frame, by analyzing one or more preceding frames;
recognizing said tracked persons in said frame using one or more cues selected from a second set of cues comprising a facial recognition, a person recognition, a jersey recognition, a score feed of said sporting event, and a commentary of said sporting event based on availability of said second set of cues, wherein individual weights are assigned to each of said facial recognition, said person recognition, and said jersey recognition when said facial recognition, said person recognition, and said jersey recognition are performed in said frame; and

identifying one or more players in said frame by comparing said assigned weights for each of said recognized persons with pre-existing data of all players; and
transmitting said pre-recorded video stream and analysis data comprising contextual interactive content of said identified players to a cliënt application provided on a user device by said sports analytics system;
whereby said pre-recorded video stream is transformed into an interactive video comprising said contextual interactive content of said identified players and transmitted to said user device.

Documents

Application Documents

# Name Date
1 202041006309-CLAIMS [30-12-2022(online)].pdf 2022-12-30
1 202041006309-STATEMENT OF UNDERTAKING (FORM 3) [13-02-2020(online)].pdf 2020-02-13
1 202041006309-US(14)-ExtendedHearingNotice-(HearingDate-10-03-2025)-1030.pdf 2025-02-04
2 202041006309-COMPLETE SPECIFICATION [30-12-2022(online)].pdf 2022-12-30
2 202041006309-PROOF OF RIGHT [13-02-2020(online)].pdf 2020-02-13
2 202041006309-REQUEST FOR ADJOURNMENT OF HEARING UNDER RULE 129A [31-01-2025(online)].pdf 2025-01-31
3 202041006309-CORRESPONDENCE [30-12-2022(online)].pdf 2022-12-30
3 202041006309-POWER OF AUTHORITY [13-02-2020(online)].pdf 2020-02-13
3 202041006309-US(14)-HearingNotice-(HearingDate-04-02-2025).pdf 2025-01-22
4 202041006309-FORM 1 [13-02-2020(online)].pdf 2020-02-13
4 202041006309-DRAWING [30-12-2022(online)].pdf 2022-12-30
4 202041006309-CLAIMS [30-12-2022(online)].pdf 2022-12-30
5 202041006309-FER_SER_REPLY [30-12-2022(online)].pdf 2022-12-30
5 202041006309-DRAWINGS [13-02-2020(online)].pdf 2020-02-13
5 202041006309-COMPLETE SPECIFICATION [30-12-2022(online)].pdf 2022-12-30
6 202041006309-FORM 3 [30-12-2022(online)].pdf 2022-12-30
6 202041006309-DECLARATION OF INVENTORSHIP (FORM 5) [13-02-2020(online)].pdf 2020-02-13
6 202041006309-CORRESPONDENCE [30-12-2022(online)].pdf 2022-12-30
7 202041006309-OTHERS [30-12-2022(online)].pdf 2022-12-30
7 202041006309-DRAWING [30-12-2022(online)].pdf 2022-12-30
7 202041006309-COMPLETE SPECIFICATION [13-02-2020(online)].pdf 2020-02-13
8 202041006309-FER.pdf 2022-07-01
8 202041006309-FER_SER_REPLY [30-12-2022(online)].pdf 2022-12-30
8 202041006309-REQUEST FOR CERTIFIED COPY [14-02-2020(online)].pdf 2020-02-14
9 202041006309-FORM 18 [14-02-2020(online)].pdf 2020-02-14
9 202041006309-FORM 3 [30-12-2022(online)].pdf 2022-12-30
9 202041006309-Proof of Right [27-10-2021(online)].pdf 2021-10-27
10 202041006309 abstract.jpg 2020-02-19
10 202041006309-FORM 3 [04-10-2021(online)].pdf 2021-10-04
10 202041006309-OTHERS [30-12-2022(online)].pdf 2022-12-30
11 202041006309-Assignment_19-03-2020.pdf 2020-03-19
11 202041006309-FER.pdf 2022-07-01
11 202041006309-Form26_Power of Attorney_27-02-2020.pdf 2020-02-27
12 202041006309-Correspondence_19-03-2020.pdf 2020-03-19
12 202041006309-Form1_(Proof of Right)_27-02-2020.pdf 2020-02-27
12 202041006309-Proof of Right [27-10-2021(online)].pdf 2021-10-27
13 202041006309-Proof of Right [16-03-2020(online)].pdf 2020-03-16
13 202041006309-FORM 3 [04-10-2021(online)].pdf 2021-10-04
13 202041006309-Correspondence_27-02-2020.pdf 2020-02-27
14 202041006309-Assignment_19-03-2020.pdf 2020-03-19
14 202041006309-Response to office action [04-03-2020(online)].pdf 2020-03-04
15 202041006309-Correspondence_19-03-2020.pdf 2020-03-19
15 202041006309-Correspondence_27-02-2020.pdf 2020-02-27
15 202041006309-Proof of Right [16-03-2020(online)].pdf 2020-03-16
16 202041006309-Correspondence_19-03-2020.pdf 2020-03-19
16 202041006309-Form1_(Proof of Right)_27-02-2020.pdf 2020-02-27
16 202041006309-Proof of Right [16-03-2020(online)].pdf 2020-03-16
17 202041006309-Form26_Power of Attorney_27-02-2020.pdf 2020-02-27
17 202041006309-Response to office action [04-03-2020(online)].pdf 2020-03-04
17 202041006309-Assignment_19-03-2020.pdf 2020-03-19
18 202041006309-Correspondence_27-02-2020.pdf 2020-02-27
18 202041006309-FORM 3 [04-10-2021(online)].pdf 2021-10-04
18 202041006309 abstract.jpg 2020-02-19
19 202041006309-FORM 18 [14-02-2020(online)].pdf 2020-02-14
19 202041006309-Form1_(Proof of Right)_27-02-2020.pdf 2020-02-27
19 202041006309-Proof of Right [27-10-2021(online)].pdf 2021-10-27
20 202041006309-FER.pdf 2022-07-01
20 202041006309-Form26_Power of Attorney_27-02-2020.pdf 2020-02-27
20 202041006309-REQUEST FOR CERTIFIED COPY [14-02-2020(online)].pdf 2020-02-14
21 202041006309-OTHERS [30-12-2022(online)].pdf 2022-12-30
21 202041006309-COMPLETE SPECIFICATION [13-02-2020(online)].pdf 2020-02-13
21 202041006309 abstract.jpg 2020-02-19
22 202041006309-DECLARATION OF INVENTORSHIP (FORM 5) [13-02-2020(online)].pdf 2020-02-13
22 202041006309-FORM 18 [14-02-2020(online)].pdf 2020-02-14
22 202041006309-FORM 3 [30-12-2022(online)].pdf 2022-12-30
23 202041006309-DRAWINGS [13-02-2020(online)].pdf 2020-02-13
23 202041006309-REQUEST FOR CERTIFIED COPY [14-02-2020(online)].pdf 2020-02-14
23 202041006309-FER_SER_REPLY [30-12-2022(online)].pdf 2022-12-30
24 202041006309-FORM 1 [13-02-2020(online)].pdf 2020-02-13
24 202041006309-DRAWING [30-12-2022(online)].pdf 2022-12-30
24 202041006309-COMPLETE SPECIFICATION [13-02-2020(online)].pdf 2020-02-13
25 202041006309-POWER OF AUTHORITY [13-02-2020(online)].pdf 2020-02-13
25 202041006309-DECLARATION OF INVENTORSHIP (FORM 5) [13-02-2020(online)].pdf 2020-02-13
25 202041006309-CORRESPONDENCE [30-12-2022(online)].pdf 2022-12-30
26 202041006309-PROOF OF RIGHT [13-02-2020(online)].pdf 2020-02-13
26 202041006309-DRAWINGS [13-02-2020(online)].pdf 2020-02-13
26 202041006309-COMPLETE SPECIFICATION [30-12-2022(online)].pdf 2022-12-30
27 202041006309-STATEMENT OF UNDERTAKING (FORM 3) [13-02-2020(online)].pdf 2020-02-13
27 202041006309-FORM 1 [13-02-2020(online)].pdf 2020-02-13
27 202041006309-CLAIMS [30-12-2022(online)].pdf 2022-12-30
28 202041006309-US(14)-HearingNotice-(HearingDate-04-02-2025).pdf 2025-01-22
28 202041006309-POWER OF AUTHORITY [13-02-2020(online)].pdf 2020-02-13
29 202041006309-REQUEST FOR ADJOURNMENT OF HEARING UNDER RULE 129A [31-01-2025(online)].pdf 2025-01-31
29 202041006309-PROOF OF RIGHT [13-02-2020(online)].pdf 2020-02-13
30 202041006309-US(14)-ExtendedHearingNotice-(HearingDate-10-03-2025)-1030.pdf 2025-02-04
30 202041006309-STATEMENT OF UNDERTAKING (FORM 3) [13-02-2020(online)].pdf 2020-02-13
31 202041006309-REQUEST FOR ADJOURNMENT OF HEARING UNDER RULE 129A [25-09-2025(online)].pdf 2025-09-25

Search Strategy

1 SearchHistoryE_01-07-2022.pdf