Abstract: The present disclosure discloses a method and a threat prediction system for predicting one or more potential threats in video surveillance. The threat prediction system receives real-time video feed from video surveillance system and identifies one or more objects in a plurality of frames obtained from video feed. A scene description for each of plurality of frames is generated based on one or more objects and context associated with corresponding frames. One or more real-time actions are determined for scene based on scene description. Based on one or more real-time actions, the threat prediction system predicts one or more potential threats associated with the video feed and alerts user of the one or more potential threats based on the prediction. The present disclosure predicts one or more possible threats which may happen in near future and helps in understanding future damage and raise alerts to take preventive actions to control damage. Fig.1
Claims:
We claim:
1. A method of predicting in real-time one or more potential threats in video surveillance, the method comprising:
receiving, by a threat prediction system (101), a real-time video feed from a video surveillance system (103), wherein the video feed comprises a plurality of frames associated with a scene captured at a location of the video surveillance system (103);
identifying, by the threat prediction system (101), one or more objects in each of the plurality of frames, wherein each of the one or more objects is sequenced with respect to the received plurality of frames;
generating, by the threat prediction system (101), a scene description for each of the plurality of frames based on the one or more objects and context associated with corresponding frames, wherein the scene description comprises sentences describing the scene and gestures, and the context comprises sentences describing the scene along with emotions associated with a user, wherein the user is associated with the one or more objects in the corresponding frames;
determining, by the threat prediction system (101), one or more real-time actions for the scene based on the scene description;
predicting, by the threat prediction system (101), one or more potential threats to the user associated with the video feed based on the one or more real-time actions; and
alerting, by the threat prediction system (101), the user of the one or more potential threats based on the prediction.
2. The method as claimed in claim 1, wherein the one or more objects are identified using a trained object detection model, wherein the object detection model is trained using a plurality of video training feeds using convolution neural network technique.
3. The method as claimed in claim 1, wherein the scene description is generated using a trained scene description model, and wherein the scene description model is trained using a plurality of training objects identified for a plurality of video training feeds.
4. The method as claimed in claim 1, wherein the one or more real-time actions are determined using a trained action prediction model, and wherein the action prediction model is trained using a plurality of actions identified from a plurality of video training feeds.
5. The method as claimed in claim 1, wherein the one or more potential threats are predicted by mapping each of the one or more real-time actions with a plurality of predefined threats using a trained threat prediction model, wherein the threat prediction model is trained using a plurality of training actions.
6. A threat prediction system (101) for predicting in real-time one or more potential threats in video surveillance, comprising:
a processor (115); and
a memory (113) communicatively coupled to the processor (115), wherein the memory (113) stores processor instructions, which, on execution, causes the processor (115) to:
receive a real-time video feed from a video surveillance system (103), wherein the video feed comprises a plurality of frames associated with a scene captured at a location of the video surveillance system (103);
identify one or more objects in each of the plurality of frames, wherein each of the one or more objects is sequenced with respect to the received plurality of frames;
generate a scene description for each of the plurality of frames based on the one or more objects and context associated with corresponding frames, wherein the scene description comprises sentences describing the scene and gestures, and the context comprises sentences describing the scene along with emotions associated with a user, wherein the user is associated with the one or more objects in the corresponding frames;
determine one or more real-time actions for the scene based on the scene description;
predict one or more potential threats to the user associated with the video feed based on the one or more real-time actions; and
alert the user of the one or more potential threats based on the prediction.
7. The threat prediction system (101) as claimed in claim 6, wherein the processor (115) identifies the one or more objects using a trained object detection model, wherein the object detection model is trained using a plurality of video training feeds using convolution neural network technique.
8. The threat prediction system (101) as claimed in claim 6, wherein the processor (115) generates the scene description using a trained scene description model, and wherein the scene description is trained using a plurality of training objects identified for a plurality of video training feeds.
9. The threat prediction system (101) as claimed in claim 6, wherein the processor (115) determines the one or more real-time actions using a trained action prediction model, wherein the action prediction model is trained using a plurality of actions identified from a plurality of video training feeds.
10. The threat prediction system (101) as claimed in claim 6, wherein the processor (115) predicts the one or more potential threats by mapping each of the one or more real-time actions with a plurality of predefined threats using a trained threat prediction model, and wherein the threat prediction model is trained using a plurality of training actions.
| # | Name | Date |
|---|---|---|
| 1 | 201941009418-PROOF OF ALTERATION [15-11-2023(online)].pdf | 2023-11-15 |
| 1 | 201941009418-STATEMENT OF UNDERTAKING (FORM 3) [11-03-2019(online)].pdf | 2019-03-11 |
| 2 | 201941009418-IntimationOfGrant14-08-2023.pdf | 2023-08-14 |
| 2 | 201941009418-REQUEST FOR EXAMINATION (FORM-18) [11-03-2019(online)].pdf | 2019-03-11 |
| 3 | 201941009418-POWER OF AUTHORITY [11-03-2019(online)].pdf | 2019-03-11 |
| 3 | 201941009418-PatentCertificate14-08-2023.pdf | 2023-08-14 |
| 4 | 201941009418-FORM 18 [11-03-2019(online)].pdf | 2019-03-11 |
| 4 | 201941009418-FER.pdf | 2021-10-17 |
| 5 | 201941009418-FORM 1 [11-03-2019(online)].pdf | 2019-03-11 |
| 5 | 201941009418-CLAIMS [06-09-2021(online)].pdf | 2021-09-06 |
| 6 | 201941009418-FIGURE OF ABSTRACT [11-03-2019].jpg | 2019-03-11 |
| 6 | 201941009418-COMPLETE SPECIFICATION [06-09-2021(online)].pdf | 2021-09-06 |
| 7 | 201941009418-DRAWINGS [11-03-2019(online)].pdf | 2019-03-11 |
| 7 | 201941009418-CORRESPONDENCE [06-09-2021(online)].pdf | 2021-09-06 |
| 8 | 201941009418-DRAWING [06-09-2021(online)].pdf | 2021-09-06 |
| 8 | 201941009418-DECLARATION OF INVENTORSHIP (FORM 5) [11-03-2019(online)].pdf | 2019-03-11 |
| 9 | 201941009418-COMPLETE SPECIFICATION [11-03-2019(online)].pdf | 2019-03-11 |
| 9 | 201941009418-FER_SER_REPLY [06-09-2021(online)].pdf | 2021-09-06 |
| 10 | 201941009418-FORM 3 [06-09-2021(online)].pdf | 2021-09-06 |
| 10 | 201941009418-Request Letter-Correspondence [13-03-2019(online)].pdf | 2019-03-13 |
| 11 | 201941009418-Information under section 8(2) [06-09-2021(online)].pdf | 2021-09-06 |
| 11 | 201941009418-Power of Attorney [13-03-2019(online)].pdf | 2019-03-13 |
| 12 | 201941009418-Form 1 (Submitted on date of filing) [13-03-2019(online)].pdf | 2019-03-13 |
| 12 | 201941009418-OTHERS [06-09-2021(online)].pdf | 2021-09-06 |
| 13 | 201941009418-PETITION UNDER RULE 137 [06-09-2021(online)].pdf | 2021-09-06 |
| 13 | 201941009418-Proof of Right (MANDATORY) [10-09-2019(online)].pdf | 2019-09-10 |
| 14 | 201941009418-RELEVANT DOCUMENTS [06-09-2021(online)].pdf | 2021-09-06 |
| 14 | Correspondence by Agent_Form1_16-09-2019.pdf | 2019-09-16 |
| 15 | 201941009418-RELEVANT DOCUMENTS [06-09-2021(online)].pdf | 2021-09-06 |
| 15 | Correspondence by Agent_Form1_16-09-2019.pdf | 2019-09-16 |
| 16 | 201941009418-PETITION UNDER RULE 137 [06-09-2021(online)].pdf | 2021-09-06 |
| 16 | 201941009418-Proof of Right (MANDATORY) [10-09-2019(online)].pdf | 2019-09-10 |
| 17 | 201941009418-OTHERS [06-09-2021(online)].pdf | 2021-09-06 |
| 17 | 201941009418-Form 1 (Submitted on date of filing) [13-03-2019(online)].pdf | 2019-03-13 |
| 18 | 201941009418-Information under section 8(2) [06-09-2021(online)].pdf | 2021-09-06 |
| 18 | 201941009418-Power of Attorney [13-03-2019(online)].pdf | 2019-03-13 |
| 19 | 201941009418-FORM 3 [06-09-2021(online)].pdf | 2021-09-06 |
| 19 | 201941009418-Request Letter-Correspondence [13-03-2019(online)].pdf | 2019-03-13 |
| 20 | 201941009418-COMPLETE SPECIFICATION [11-03-2019(online)].pdf | 2019-03-11 |
| 20 | 201941009418-FER_SER_REPLY [06-09-2021(online)].pdf | 2021-09-06 |
| 21 | 201941009418-DECLARATION OF INVENTORSHIP (FORM 5) [11-03-2019(online)].pdf | 2019-03-11 |
| 21 | 201941009418-DRAWING [06-09-2021(online)].pdf | 2021-09-06 |
| 22 | 201941009418-CORRESPONDENCE [06-09-2021(online)].pdf | 2021-09-06 |
| 22 | 201941009418-DRAWINGS [11-03-2019(online)].pdf | 2019-03-11 |
| 23 | 201941009418-COMPLETE SPECIFICATION [06-09-2021(online)].pdf | 2021-09-06 |
| 23 | 201941009418-FIGURE OF ABSTRACT [11-03-2019].jpg | 2019-03-11 |
| 24 | 201941009418-CLAIMS [06-09-2021(online)].pdf | 2021-09-06 |
| 24 | 201941009418-FORM 1 [11-03-2019(online)].pdf | 2019-03-11 |
| 25 | 201941009418-FORM 18 [11-03-2019(online)].pdf | 2019-03-11 |
| 25 | 201941009418-FER.pdf | 2021-10-17 |
| 26 | 201941009418-POWER OF AUTHORITY [11-03-2019(online)].pdf | 2019-03-11 |
| 26 | 201941009418-PatentCertificate14-08-2023.pdf | 2023-08-14 |
| 27 | 201941009418-REQUEST FOR EXAMINATION (FORM-18) [11-03-2019(online)].pdf | 2019-03-11 |
| 27 | 201941009418-IntimationOfGrant14-08-2023.pdf | 2023-08-14 |
| 28 | 201941009418-STATEMENT OF UNDERTAKING (FORM 3) [11-03-2019(online)].pdf | 2019-03-11 |
| 28 | 201941009418-PROOF OF ALTERATION [15-11-2023(online)].pdf | 2023-11-15 |
| 1 | 2021-03-0912-42-17E_10-03-2021.pdf |