Abstract: Abstract An acquisition unit (106) acquires a query feature quantity (30) which is a collection of feature quantities for a query moving image and a feature quantity record (40) which is a collection of feature quantities for a candidate moving image. A similarity map generation unit (107) compares the query feature quantity (30) with the feature quantity record (40), calculates a similarity between the query feature quantity (30) and the feature quantity record (40) for each of frames of the candidate moving image and generates a similarity sequence in which the similarities are chronologically arranged, and generates a similarity map in which the similarity sequences for the respective frames of the candidate moving image are arranged in order of the frames of the candidate moving image. [Figure: 1]
We Claim:
[Claim 1] A moving image processing apparatus comprising:
an acquisition unit to acquire a first feature quantity sequence in which first feature quantities, the first feature quantities being feature quantities generated for respective frames of a first moving image composed of a plurality of frames, are arranged in order of the frames of the first moving image and a second feature quantity sequence in which second feature quantities, the second feature quantities being feature quantities generated for respective frames of a second moving image composed of a plurality of frames larger in number than the plurality of frames of the first moving image, are arranged in order of the frames of the second moving image; and
a similarity map generation unit to compare the first feature quantity sequence
with the second feature quantity sequence while moving a comparison object range of
the second moving image being an object to be compared with the first feature quantity
sequence in the order of the frames of the second moving image, to calculate similarities
between the first feature quantities in the first feature quantity sequence and the second
feature quantities in the second feature quantity sequence within the comparison object
range and generate a similarity sequence in which the similarities are chronologically
arranged, for each of the frames of the second moving image, and to generate a
similarity map in which the similarity sequences for the respective frames of the second
moving image are arranged in the order of the frames of the second moving image.
[Claim 2] The moving image processing apparatus according to claim 1, further
comprising:
a section extraction unit to analyze the similarity map and to extract a corresponding section, the corresponding section being a section of a frame of the second moving image which represents a same motion as or a similar motion to a
motion represented by the first moving image.
[Claim 3] The moving image processing apparatus according to claim 2,
wherein
the section extraction unit
extracts, for each of the frames of the second moving image, an optimum path, the optimum path being a path with a highest integrated similarity value, from among the similarity sequence for the frame and the similarity sequences for frames within a predetermined range subsequent to the frame in the similarity map, and
analyzes the integrated similarity values for the optimum paths for the
respective frames of the second moving image and extracts the corresponding section.
[Claim 4] The moving image processing apparatus according to claim 3,
wherein
the section extraction unit extracts, as a start point of the corresponding section, a frame of the second moving image which corresponds to a local maximum for the integrated similarity values between where the integrated similarity value rises above a lower threshold and where the integrated similarity value falls below an upper threshold in a waveform of the integrated similarity values obtained by plotting the integrated similarity values for the respective optimum paths in the order of the frames of the second moving image.
[Claim 5] The moving image processing apparatus according to claim 3,
wherein
the section extraction unit extracts the optimum path for each of the frames of the second moving image using dynamic programming.
[Claim 6] The moving image processing apparatus according to claim 1,
wherein
the acquisition unit acquires the first feature quantity sequence, in which the
first feature quantities, the first feature quantities being feature quantities based on
deflection angle components of motion vectors extracted from the respective frames of
the first moving image, are arranged in the order of the frames of the first moving image
and the second feature quantity sequence, in which the second feature quantities, the
second feature quantities being feature quantities based on deflection angle components
of motion vectors extracted from the respective frames of the second moving image, are
arranged in the order of the frames of the second moving image.
[Claim 7] A moving image processing apparatus comprising:
a deflection angle calculation unit to calculate a deflection angle component of a motion vector for each of frames included in a moving image; and
a histogram generation unit to generate deflection angle component histogram data for each of the frames using a result of calculating the deflection angle components by the deflection angle calculation unit.
[Claim 8] The moving image processing apparatus according to claim 7, further
comprising:
a smoothing unit to perform, on the deflection angle component histogram data
generated by the histogram generation unit, smoothing using the deflection angle
component histogram data generated for an arbitrary number of preceding consecutive
frames by the histogram generation unit and to generate a feature quantity.
[Claim 9] The moving image processing apparatus according to claim 8,
wherein
the smoothing unit performs the smoothing by applying weights according to time distances between the frame for which the feature quantity is to be generated, and each of the arbitrary number of frames to each of the deflection angle component
histogram data for the arbitrary number of frames.
[Claim 10] A moving image processing method comprising:
by a computer, acquiring a first feature quantity sequence in which first feature quantities, the first feature quantities being feature quantities generated for respective frames of a first moving image composed of a plurality of frames, are arranged in order of the frames of the first moving image and a second feature quantity sequence in which second feature quantities, the second feature quantities being feature quantities generated for respective frames of a second moving image composed of a plurality of frames larger in number than the plurality of frames of the first moving image, are arranged in order of the frames of the second moving image; and
by the computer, comparing the first feature quantity sequence with the second feature quantity sequence while moving a comparison object range of the second moving image being an object to be compared with the first feature quantity sequence in the order of the frames of the second moving image, calculating similarities between the first feature quantities in the first feature quantity sequence and the second feature quantities in the second feature quantity sequence within the comparison object range and generating a similarity sequence in which the similarities are chronologically arranged, for each of the frames of the second moving image, and generating a similarity map in which the similarity sequences for the respective frames of the second
I moving image are arranged in the order of the frames of the second moving image.
[Claim 11] A moving image processing method comprising:
by a computer, calculating a deflection angle component of a motion vector for each of frames included in a moving image; and
by the computer, generating deflection angle component histogram data for
> each of the frames using a result of calculating the deflection angle components.
[Claim 12] A moving image processing program that causes a computer to
execute:
an acquisition process of acquiring a first feature quantity sequence in which first feature quantities, the first feature quantities being feature quantities generated for respective frames of a first moving image composed of a plurality of frames, are arranged in order of the frames of the first moving image and a second feature quantity sequence in which second feature quantities, the second feature quantities being feature quantities generated for respective frames of a second moving image composed of a plurality of frames larger in number than the plurality of frames of the first moving image, are arranged in order of the frames of the second moving image; and
a similarity map generation process of comparing the first feature quantity sequence with the second feature quantity sequence while moving a comparison object range of the second moving image being an object to be compared with the first feature quantity sequence in the order of the frames of the second moving image, calculating similarities between the first feature quantities in the first feature quantity sequence and the second feature quantities in the second feature quantity sequence within the comparison object range and generating a similarity sequence in which the similarities are chronologically arranged, for each of the frames of the second moving image, and generating a similarity map in which the similarity sequences for the respective frames of the second moving image are arranged in the order of the frames of the second moving image.
[Claim 13] A moving image processing program that causes a computer to
execute:
a deflection angle calculation process of calculating a deflection angle component of a motion vector for each of frames included in a moving image; and
a histogram generation process of generating deflection angle component histogram data for each of the frames using a result of calculating the deflection angle components in the deflection angle calculation process.
| # | Name | Date |
|---|---|---|
| 1 | 201847048244.pdf | 2018-12-20 |
| 2 | 201847048244-TRANSLATIOIN OF PRIOIRTY DOCUMENTS ETC. [20-12-2018(online)].pdf | 2018-12-20 |
| 3 | 201847048244-STATEMENT OF UNDERTAKING (FORM 3) [20-12-2018(online)].pdf | 2018-12-20 |
| 4 | 201847048244-REQUEST FOR EXAMINATION (FORM-18) [20-12-2018(online)].pdf | 2018-12-20 |
| 5 | 201847048244-PROOF OF RIGHT [20-12-2018(online)].pdf | 2018-12-20 |
| 6 | 201847048244-POWER OF AUTHORITY [20-12-2018(online)].pdf | 2018-12-20 |
| 7 | 201847048244-FORM 18 [20-12-2018(online)].pdf | 2018-12-20 |
| 8 | 201847048244-FORM 1 [20-12-2018(online)].pdf | 2018-12-20 |
| 9 | 201847048244-DRAWINGS [20-12-2018(online)].pdf | 2018-12-20 |
| 10 | 201847048244-DECLARATION OF INVENTORSHIP (FORM 5) [20-12-2018(online)].pdf | 2018-12-20 |
| 11 | 201847048244-COMPLETE SPECIFICATION [20-12-2018(online)].pdf | 2018-12-20 |
| 12 | 201847048244-CLAIMS UNDER RULE 1 (PROVISIO) OF RULE 20 [20-12-2018(online)].pdf | 2018-12-20 |
| 13 | Correspondence by Agent_Form1_24-12-2018.pdf | 2018-12-24 |
| 14 | 201847048244-RELEVANT DOCUMENTS [26-12-2018(online)].pdf | 2018-12-26 |
| 15 | 201847048244-MARKED COPIES OF AMENDEMENTS [26-12-2018(online)].pdf | 2018-12-26 |
| 16 | 201847048244-FORM 13 [26-12-2018(online)].pdf | 2018-12-26 |
| 17 | 201847048244-AMMENDED DOCUMENTS [26-12-2018(online)].pdf | 2018-12-26 |
| 18 | 201847048244-FORM 3 [21-05-2019(online)].pdf | 2019-05-21 |
| 19 | 201847048244-FORM 3 [11-11-2019(online)].pdf | 2019-11-11 |
| 20 | 201847048244-FORM 3 [11-07-2020(online)].pdf | 2020-07-11 |
| 21 | 201847048244-OTHERS [24-02-2021(online)].pdf | 2021-02-24 |
| 22 | 201847048244-Information under section 8(2) [24-02-2021(online)].pdf | 2021-02-24 |
| 23 | 201847048244-FORM-26 [24-02-2021(online)].pdf | 2021-02-24 |
| 24 | 201847048244-FORM 3 [24-02-2021(online)].pdf | 2021-02-24 |
| 25 | 201847048244-FER_SER_REPLY [24-02-2021(online)].pdf | 2021-02-24 |
| 26 | 201847048244-COMPLETE SPECIFICATION [24-02-2021(online)].pdf | 2021-02-24 |
| 27 | 201847048244-CLAIMS [24-02-2021(online)].pdf | 2021-02-24 |
| 28 | 201847048244-ABSTRACT [24-02-2021(online)].pdf | 2021-02-24 |
| 29 | 201847048244-FORM 3 [04-06-2021(online)].pdf | 2021-06-04 |
| 30 | 201847048244-FER.pdf | 2021-10-17 |
| 31 | 201847048244-US(14)-HearingNotice-(HearingDate-28-02-2024).pdf | 2024-02-01 |
| 32 | 201847048244-Correspondence to notify the Controller [23-02-2024(online)].pdf | 2024-02-23 |
| 1 | search201847048244E_04-12-2020.pdf |