Sign In to Follow Application
View All Documents & Correspondence

Method And System For Predicting In Real Time One Or More Potential Threats In Video Surveillance

Abstract: The present disclosure discloses a method and a threat prediction system for predicting one or more potential threats in video surveillance. The threat prediction system receives real-time video feed from video surveillance system and identifies one or more objects in a plurality of frames obtained from video feed. A scene description for each of plurality of frames is generated based on one or more objects and context associated with corresponding frames. One or more real-time actions are determined for scene based on scene description. Based on one or more real-time actions, the threat prediction system predicts one or more potential threats associated with the video feed and alerts user of the one or more potential threats based on the prediction. The present disclosure predicts one or more possible threats which may happen in near future and helps in understanding future damage and raise alerts to take preventive actions to control damage. Fig.1

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
11 March 2019
Publication Number
38/2020
Publication Type
INA
Invention Field
COMPUTER SCIENCE
Status
Email
bangalore@knspartners.com
Parent Application
Patent Number
Legal Status
Grant Date
2023-08-14
Renewal Date

Applicants

WIPRO LIMITED
Doddakannelli, Sarjapur Road, Bangalore, Karnataka, India, Pin Code-560 035.

Inventors

1. GOPICHAND AGNIHOTRAM
A-207, S.K. Aster, Doddathogur Village, Electronics City, Bangalore, Karnataka, India, Pin Code-560 100.
2. MANJUNATH RAMACHANDRA IYER
80, Sadhana, 2nd Main, BSK 3rd Stage, Katriguppe East, Bangalore, Karnataka, India, Pin Code-560 085.

Specification

Claims:
We claim:
1. A method of predicting in real-time one or more potential threats in video surveillance, the method comprising:
receiving, by a threat prediction system (101), a real-time video feed from a video surveillance system (103), wherein the video feed comprises a plurality of frames associated with a scene captured at a location of the video surveillance system (103);
identifying, by the threat prediction system (101), one or more objects in each of the plurality of frames, wherein each of the one or more objects is sequenced with respect to the received plurality of frames;
generating, by the threat prediction system (101), a scene description for each of the plurality of frames based on the one or more objects and context associated with corresponding frames, wherein the scene description comprises sentences describing the scene and gestures, and the context comprises sentences describing the scene along with emotions associated with a user, wherein the user is associated with the one or more objects in the corresponding frames;
determining, by the threat prediction system (101), one or more real-time actions for the scene based on the scene description;
predicting, by the threat prediction system (101), one or more potential threats to the user associated with the video feed based on the one or more real-time actions; and
alerting, by the threat prediction system (101), the user of the one or more potential threats based on the prediction.

2. The method as claimed in claim 1, wherein the one or more objects are identified using a trained object detection model, wherein the object detection model is trained using a plurality of video training feeds using convolution neural network technique.

3. The method as claimed in claim 1, wherein the scene description is generated using a trained scene description model, and wherein the scene description model is trained using a plurality of training objects identified for a plurality of video training feeds.

4. The method as claimed in claim 1, wherein the one or more real-time actions are determined using a trained action prediction model, and wherein the action prediction model is trained using a plurality of actions identified from a plurality of video training feeds.

5. The method as claimed in claim 1, wherein the one or more potential threats are predicted by mapping each of the one or more real-time actions with a plurality of predefined threats using a trained threat prediction model, wherein the threat prediction model is trained using a plurality of training actions.

6. A threat prediction system (101) for predicting in real-time one or more potential threats in video surveillance, comprising:
a processor (115); and
a memory (113) communicatively coupled to the processor (115), wherein the memory (113) stores processor instructions, which, on execution, causes the processor (115) to:
receive a real-time video feed from a video surveillance system (103), wherein the video feed comprises a plurality of frames associated with a scene captured at a location of the video surveillance system (103);
identify one or more objects in each of the plurality of frames, wherein each of the one or more objects is sequenced with respect to the received plurality of frames;
generate a scene description for each of the plurality of frames based on the one or more objects and context associated with corresponding frames, wherein the scene description comprises sentences describing the scene and gestures, and the context comprises sentences describing the scene along with emotions associated with a user, wherein the user is associated with the one or more objects in the corresponding frames;
determine one or more real-time actions for the scene based on the scene description;
predict one or more potential threats to the user associated with the video feed based on the one or more real-time actions; and
alert the user of the one or more potential threats based on the prediction.

7. The threat prediction system (101) as claimed in claim 6, wherein the processor (115) identifies the one or more objects using a trained object detection model, wherein the object detection model is trained using a plurality of video training feeds using convolution neural network technique.

8. The threat prediction system (101) as claimed in claim 6, wherein the processor (115) generates the scene description using a trained scene description model, and wherein the scene description is trained using a plurality of training objects identified for a plurality of video training feeds.

9. The threat prediction system (101) as claimed in claim 6, wherein the processor (115) determines the one or more real-time actions using a trained action prediction model, wherein the action prediction model is trained using a plurality of actions identified from a plurality of video training feeds.

10. The threat prediction system (101) as claimed in claim 6, wherein the processor (115) predicts the one or more potential threats by mapping each of the one or more real-time actions with a plurality of predefined threats using a trained threat prediction model, and wherein the threat prediction model is trained using a plurality of training actions.

Documents

Application Documents

# Name Date
1 201941009418-PROOF OF ALTERATION [15-11-2023(online)].pdf 2023-11-15
1 201941009418-STATEMENT OF UNDERTAKING (FORM 3) [11-03-2019(online)].pdf 2019-03-11
2 201941009418-IntimationOfGrant14-08-2023.pdf 2023-08-14
2 201941009418-REQUEST FOR EXAMINATION (FORM-18) [11-03-2019(online)].pdf 2019-03-11
3 201941009418-POWER OF AUTHORITY [11-03-2019(online)].pdf 2019-03-11
3 201941009418-PatentCertificate14-08-2023.pdf 2023-08-14
4 201941009418-FORM 18 [11-03-2019(online)].pdf 2019-03-11
4 201941009418-FER.pdf 2021-10-17
5 201941009418-FORM 1 [11-03-2019(online)].pdf 2019-03-11
5 201941009418-CLAIMS [06-09-2021(online)].pdf 2021-09-06
6 201941009418-FIGURE OF ABSTRACT [11-03-2019].jpg 2019-03-11
6 201941009418-COMPLETE SPECIFICATION [06-09-2021(online)].pdf 2021-09-06
7 201941009418-DRAWINGS [11-03-2019(online)].pdf 2019-03-11
7 201941009418-CORRESPONDENCE [06-09-2021(online)].pdf 2021-09-06
8 201941009418-DRAWING [06-09-2021(online)].pdf 2021-09-06
8 201941009418-DECLARATION OF INVENTORSHIP (FORM 5) [11-03-2019(online)].pdf 2019-03-11
9 201941009418-COMPLETE SPECIFICATION [11-03-2019(online)].pdf 2019-03-11
9 201941009418-FER_SER_REPLY [06-09-2021(online)].pdf 2021-09-06
10 201941009418-FORM 3 [06-09-2021(online)].pdf 2021-09-06
10 201941009418-Request Letter-Correspondence [13-03-2019(online)].pdf 2019-03-13
11 201941009418-Information under section 8(2) [06-09-2021(online)].pdf 2021-09-06
11 201941009418-Power of Attorney [13-03-2019(online)].pdf 2019-03-13
12 201941009418-Form 1 (Submitted on date of filing) [13-03-2019(online)].pdf 2019-03-13
12 201941009418-OTHERS [06-09-2021(online)].pdf 2021-09-06
13 201941009418-PETITION UNDER RULE 137 [06-09-2021(online)].pdf 2021-09-06
13 201941009418-Proof of Right (MANDATORY) [10-09-2019(online)].pdf 2019-09-10
14 201941009418-RELEVANT DOCUMENTS [06-09-2021(online)].pdf 2021-09-06
14 Correspondence by Agent_Form1_16-09-2019.pdf 2019-09-16
15 201941009418-RELEVANT DOCUMENTS [06-09-2021(online)].pdf 2021-09-06
15 Correspondence by Agent_Form1_16-09-2019.pdf 2019-09-16
16 201941009418-PETITION UNDER RULE 137 [06-09-2021(online)].pdf 2021-09-06
16 201941009418-Proof of Right (MANDATORY) [10-09-2019(online)].pdf 2019-09-10
17 201941009418-OTHERS [06-09-2021(online)].pdf 2021-09-06
17 201941009418-Form 1 (Submitted on date of filing) [13-03-2019(online)].pdf 2019-03-13
18 201941009418-Information under section 8(2) [06-09-2021(online)].pdf 2021-09-06
18 201941009418-Power of Attorney [13-03-2019(online)].pdf 2019-03-13
19 201941009418-FORM 3 [06-09-2021(online)].pdf 2021-09-06
19 201941009418-Request Letter-Correspondence [13-03-2019(online)].pdf 2019-03-13
20 201941009418-COMPLETE SPECIFICATION [11-03-2019(online)].pdf 2019-03-11
20 201941009418-FER_SER_REPLY [06-09-2021(online)].pdf 2021-09-06
21 201941009418-DECLARATION OF INVENTORSHIP (FORM 5) [11-03-2019(online)].pdf 2019-03-11
21 201941009418-DRAWING [06-09-2021(online)].pdf 2021-09-06
22 201941009418-CORRESPONDENCE [06-09-2021(online)].pdf 2021-09-06
22 201941009418-DRAWINGS [11-03-2019(online)].pdf 2019-03-11
23 201941009418-COMPLETE SPECIFICATION [06-09-2021(online)].pdf 2021-09-06
23 201941009418-FIGURE OF ABSTRACT [11-03-2019].jpg 2019-03-11
24 201941009418-CLAIMS [06-09-2021(online)].pdf 2021-09-06
24 201941009418-FORM 1 [11-03-2019(online)].pdf 2019-03-11
25 201941009418-FORM 18 [11-03-2019(online)].pdf 2019-03-11
25 201941009418-FER.pdf 2021-10-17
26 201941009418-POWER OF AUTHORITY [11-03-2019(online)].pdf 2019-03-11
26 201941009418-PatentCertificate14-08-2023.pdf 2023-08-14
27 201941009418-REQUEST FOR EXAMINATION (FORM-18) [11-03-2019(online)].pdf 2019-03-11
27 201941009418-IntimationOfGrant14-08-2023.pdf 2023-08-14
28 201941009418-STATEMENT OF UNDERTAKING (FORM 3) [11-03-2019(online)].pdf 2019-03-11
28 201941009418-PROOF OF ALTERATION [15-11-2023(online)].pdf 2023-11-15

Search Strategy

1 2021-03-0912-42-17E_10-03-2021.pdf

ERegister / Renewals

3rd: 09 Nov 2023

From 11/03/2021 - To 11/03/2022

4th: 09 Nov 2023

From 11/03/2022 - To 11/03/2023

5th: 09 Nov 2023

From 11/03/2023 - To 11/03/2024

6th: 07 Mar 2024

From 11/03/2024 - To 11/03/2025

7th: 07 Mar 2025

From 11/03/2025 - To 11/03/2026