Abstract: The invention discloses systems and methods for providing video synopsis. The method includes the steps of estimating an effective adaptive length of a video synopsis based on the interaction relationship between objects determined using an interaction preserving graph or recursive tube-grouping method. Then, the temporal relationship between the groups of mutually interacting tubes, termed as tube sets are determined according to a temporal order matrix. Following the positioning of tube sets in the spatiotemporal representation of video synopsis, the length of the synopsis video is then increased to an extent such that all non-interacting tube sets with incremental temporal orders are filled into the spatiotemporal volume. Further the tube sets are arranged optimally to avoid false collisions using spatiotemporal cube voting or connected links graph construction method. The invention facilitates fast and effective browsing and review of raw video data from massive video storage.
WE CLAIM:
1. A method of performing adaptive shrinkage of video for visualizing moving
objects in a source video comprising the steps of:
estimating an effective adaptive length of a video synopsis;
detecting and segmenting moving objects in the source video into one or
more tubes;
constructing an interaction matrix by identifying a behavioral interaction
between two or more tubes;
grouping mutually interacting tubes into tube sets;
obtaining one or more interacting tube sets;
calculating duration of each tube set;
determining a first length of the output video at an interaction preserving
stage based on an identified longest tube set;
positioning each group of interacting tubes in the synopsis based on a
descending order of tube set length; arranging the tube sets according to a temporal order matrix to update the first length to a second length;
increasing the second length of the synopsis video to a third length to fill non-interacting tube sets having incremental temporal orders into a spatiotemporal volume; and
rearranging the interacting tube sets optimally to avoid false collisions between tube sets.
2. The method of claim 1, wherein identifying a behavioral interaction between two
or more moving tubes is performed using spatial proximity and tube intersection.
3. The method of claim 1, wherein grouping mutually interacting tubes into tube sets is performed using an interaction preserving graph method, recursive tube-grouping approach or both.
4. The method of claim 1, wherein arranging the tube sets according to a temporal order matrix comprises preserving the chronological order in the synopsis.
5. The method of claim 1, wherein rearranging the interacting tube sets comprises spatiotemporal cube voting method, connected links graph construction method or both.
6. A non-transitory computer-readable medium embodying the method as claimed in claim 1.
7. A system to perform adaptive shrinkage of video for visualizing moving objects comprising:
an imaging device (210) configured to generate a source video;
a display device (220); and
a processing unit (230) comprising
a tube extraction module (246) configured to
detect and segment one or more moving objects as tubes in the source video; an interacting tube sets identifier module (252) configured to: compute an interaction matrix for the tubes; and determine two or more mutually interacting tubes; a tube set selector (244) configured to select one or more interacting and non-interacting tube sets; a temporal order preserving module (250) configured to:
compute a temporal relation between tube sets; and
construct a temporal order matrix; a false collision optimization module (242) configured to achieve optimal tube set arrangement; and
a synopsis frame generator module (248) configured to stitch each tube set to a time-lapsed background video to generate a synopsis video.
8. The system of claim 7, wherein the system further comprises a user interface to enable a user to set one or more preferences.
9. The system of claim 7, wherein the interacting tube sets identifier module is configured to determine two or more mutually interacting tubes using interaction preserving graph or recursive tube-grouping method.
10. The system of claim 7, wherein the false collision optimization module is configured to achieve optimal tube set arrangement based on spatiotemporal cube voting or connected links graph method.
11. The system of claim 7, wherein the synopsis frame generator module is configured to stitch each tube based on an optimal tube set placement solution.
| # | Name | Date |
|---|---|---|
| 1 | 201941017061-EDUCATIONAL INSTITUTION(S) [04-01-2023(online)].pdf | 2023-01-04 |
| 1 | 201941017061-FORM 13 [20-03-2025(online)].pdf | 2025-03-20 |
| 1 | 201941017061-STATEMENT OF UNDERTAKING (FORM 3) [29-04-2019(online)].pdf | 2019-04-29 |
| 2 | 201941017061-EVIDENCE FOR REGISTRATION UNDER SSI [04-01-2023(online)].pdf | 2023-01-04 |
| 2 | 201941017061-FORM 1 [29-04-2019(online)].pdf | 2019-04-29 |
| 2 | 201941017061-POA [20-03-2025(online)].pdf | 2025-03-20 |
| 3 | 201941017061-DRAWINGS [29-04-2019(online)].pdf | 2019-04-29 |
| 3 | 201941017061-FORM 13 [04-01-2023(online)].pdf | 2023-01-04 |
| 3 | 201941017061-RELEVANT DOCUMENTS [20-03-2025(online)].pdf | 2025-03-20 |
| 4 | 201941017061-POA [04-01-2023(online)].pdf | 2023-01-04 |
| 4 | 201941017061-EDUCATIONAL INSTITUTION(S) [04-01-2023(online)].pdf | 2023-01-04 |
| 4 | 201941017061-DECLARATION OF INVENTORSHIP (FORM 5) [29-04-2019(online)].pdf | 2019-04-29 |
| 5 | 201941017061-RELEVANT DOCUMENTS [04-01-2023(online)].pdf | 2023-01-04 |
| 5 | 201941017061-EVIDENCE FOR REGISTRATION UNDER SSI [04-01-2023(online)].pdf | 2023-01-04 |
| 5 | 201941017061-COMPLETE SPECIFICATION [29-04-2019(online)].pdf | 2019-04-29 |
| 6 | 201941017061-Proof of Right (MANDATORY) [12-06-2019(online)].pdf | 2019-06-12 |
| 6 | 201941017061-FORM 13 [04-01-2023(online)].pdf | 2023-01-04 |
| 6 | 201941017061-CLAIMS [05-12-2022(online)].pdf | 2022-12-05 |
| 7 | 201941017061-POA [04-01-2023(online)].pdf | 2023-01-04 |
| 7 | 201941017061-FORM 18 [22-06-2021(online)].pdf | 2021-06-22 |
| 7 | 201941017061-FER_SER_REPLY [05-12-2022(online)].pdf | 2022-12-05 |
| 8 | 201941017061-FER.pdf | 2022-06-08 |
| 8 | 201941017061-RELEVANT DOCUMENTS [04-01-2023(online)].pdf | 2023-01-04 |
| 9 | 201941017061-CLAIMS [05-12-2022(online)].pdf | 2022-12-05 |
| 9 | 201941017061-FER_SER_REPLY [05-12-2022(online)].pdf | 2022-12-05 |
| 9 | 201941017061-FORM 18 [22-06-2021(online)].pdf | 2021-06-22 |
| 10 | 201941017061-CLAIMS [05-12-2022(online)].pdf | 2022-12-05 |
| 10 | 201941017061-FER_SER_REPLY [05-12-2022(online)].pdf | 2022-12-05 |
| 10 | 201941017061-Proof of Right (MANDATORY) [12-06-2019(online)].pdf | 2019-06-12 |
| 11 | 201941017061-COMPLETE SPECIFICATION [29-04-2019(online)].pdf | 2019-04-29 |
| 11 | 201941017061-FER.pdf | 2022-06-08 |
| 11 | 201941017061-RELEVANT DOCUMENTS [04-01-2023(online)].pdf | 2023-01-04 |
| 12 | 201941017061-DECLARATION OF INVENTORSHIP (FORM 5) [29-04-2019(online)].pdf | 2019-04-29 |
| 12 | 201941017061-FORM 18 [22-06-2021(online)].pdf | 2021-06-22 |
| 12 | 201941017061-POA [04-01-2023(online)].pdf | 2023-01-04 |
| 13 | 201941017061-DRAWINGS [29-04-2019(online)].pdf | 2019-04-29 |
| 13 | 201941017061-FORM 13 [04-01-2023(online)].pdf | 2023-01-04 |
| 13 | 201941017061-Proof of Right (MANDATORY) [12-06-2019(online)].pdf | 2019-06-12 |
| 14 | 201941017061-COMPLETE SPECIFICATION [29-04-2019(online)].pdf | 2019-04-29 |
| 14 | 201941017061-EVIDENCE FOR REGISTRATION UNDER SSI [04-01-2023(online)].pdf | 2023-01-04 |
| 14 | 201941017061-FORM 1 [29-04-2019(online)].pdf | 2019-04-29 |
| 15 | 201941017061-DECLARATION OF INVENTORSHIP (FORM 5) [29-04-2019(online)].pdf | 2019-04-29 |
| 15 | 201941017061-EDUCATIONAL INSTITUTION(S) [04-01-2023(online)].pdf | 2023-01-04 |
| 15 | 201941017061-STATEMENT OF UNDERTAKING (FORM 3) [29-04-2019(online)].pdf | 2019-04-29 |
| 16 | 201941017061-DRAWINGS [29-04-2019(online)].pdf | 2019-04-29 |
| 16 | 201941017061-RELEVANT DOCUMENTS [20-03-2025(online)].pdf | 2025-03-20 |
| 17 | 201941017061-FORM 1 [29-04-2019(online)].pdf | 2019-04-29 |
| 17 | 201941017061-POA [20-03-2025(online)].pdf | 2025-03-20 |
| 18 | 201941017061-FORM 13 [20-03-2025(online)].pdf | 2025-03-20 |
| 18 | 201941017061-STATEMENT OF UNDERTAKING (FORM 3) [29-04-2019(online)].pdf | 2019-04-29 |
| 19 | 201941017061-OTHERS [07-05-2025(online)].pdf | 2025-05-07 |
| 20 | 201941017061-EDUCATIONAL INSTITUTION(S) [07-05-2025(online)].pdf | 2025-05-07 |
| 21 | 201941017061-FORM-8 [09-05-2025(online)].pdf | 2025-05-09 |
| 22 | 201941017061-PatentCertificate26-05-2025.pdf | 2025-05-26 |
| 23 | 201941017061-IntimationOfGrant26-05-2025.pdf | 2025-05-26 |
| 1 | 201941017061E_30-05-2022.pdf |