Sign In to Follow Application
View All Documents & Correspondence

Retrieval Device, Control Method, And Program

Abstract: A retrieval device (2000) is able to access a storage region (50) in which a plurality of pieces of object information (100) are stored. The object information (100) includes a feature amount set (104), which is a set of a plurality of feature amounts obtained regarding an object. The retrieval device (2000): acquires a feature amount set to be retrieved (a set (60) to be retrieved); and compares the set (60) to be retrieved and the feature amount set (104) to identify object information (100) having a feature amount set (104) similar to the set (60) to be retrieved. If the feature amount set satisfies a prescribed condition, the retrieval device (2000) uses a portion of the feature amounts in the feature amount set to perform the comparison between the feature amount set and another feature amount set. Furthermore, the retrieval device (2000) outputs output information relating to the identified object information (100).

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
26 November 2021
Publication Number
18/2022
Publication Type
INA
Invention Field
COMPUTER SCIENCE
Status
Email
archana@anandandanand.com
Parent Application

Applicants

NEC CORPORATION
7-1, Shiba 5-chome, Minato-ku, Tokyo 1088001

Inventors

1. YOSHIDA Satoshi
c/o NEC Corporation, 7-1, Shiba 5-chome, Minato-ku, Tokyo 1088001
2. LIU Jianquan
c/o NEC Corporation, 7-1, Shiba 5-chome, Minato-ku, Tokyo 1088001
3. NISHIMURA Shoji
c/o NEC Corporation, 7-1, Shiba 5-chome, Minato-ku, Tokyo 1088001

Specification

[0001]The present invention relates to data retrieval.
[Background Art]
[0002]
Various techniques for facilitating data retrieval have been developed. In data
retrieval, determination of associated data is performed by performing comparison between 10 registered data, and a condition (e.g., a value of a part of data) specified by a retrieval query.
[0003]
Herein, a set may be handled as data being a retrieval target. Patent Document 1 is
cited as a document that discloses a technique relating to comparison between data sets. Patent
Document 1 computes dissimilarity between image sample sequences, based on a ratio between 15 a probability density of a feature value to be extracted from an image sample sequence located
preceding a key frame within a moving image, and a probability density of a feature value to be
extracted from an image sample sequence located succeeding the key frame, and determines
whether a predetermined event occurs within the key frame, based on the computed dissimilarity.
[Related Document] 20 [Patent Document]
[0004]
[Patent document 1] Japanese Patent Application Publication No. 2013-122755
[Summary of Invention]
[Technical Problem] 25 [0005]
The inventors of the present application found a new technique for shortening a time
required for data retrieval, in a case where a data set is handled as a retrieval target. Patent
Document 1 is a document that discloses a technique for detecting occurrence of an event from a
moving image, and does not mention data retrieval. 30 [0006]
The present invention has been made in view of the above problem, and one of objects
of the present invention is to provide a technique for shortening a time required for retrieval of a
data set.
[Solution to Problem]

3
[0007]
A retrieval apparatus according to the present invention is accessible to a storage region
in which a plurality of pieces of object information including a feature value set being a set of a
plurality of feature values acquired regarding an object are stored. 5 The retrieval apparatus includes: 1) a determination unit that acquires a feature value set
being a retrieval target, and determines object information indicating a feature value set similar
to a feature value set being the retrieval target from among the plurality of pieces of object
information by comparing the acquired feature value set with a feature value set indicated in the
object information; and 2) an output unit that outputs output information relating to the 10 determined object information.
In a case where the feature value set satisfies a predetermined condition, the
determination unit performs comparison between the feature value set and another feature value
set by using a part of feature values within the feature value set.
[0008] 15 A control method according to the present invention is executed by a computer. The
computer is accessible to a storage region in which a plurality of pieces of object information
including a feature value set being a set of a plurality of feature values acquired regarding an
object are stored.
The control method includes 1) a determination step of acquiring a feature value set 20 being a retrieval target, and determining object information indicating a feature value set similar
to a feature value set being the retrieval target from among the plurality of pieces of object
information by comparing the acquired feature value set with a feature value set indicated in the
object information; and 2) an output step of outputting output information relating to the
determined object information. 25 The determination step further includes, in a case where the feature value set satisfies a
predetermined condition, performing comparison between the feature value set and another
feature value set by using a feature value of one step within the feature value set.
[0009]
A program according to the present invention causes a computer to execute each of the 30 steps included in the control method according to the present invention.
[Advantageous Effects of Invention]
[0010]
The present invention provides a technique for shortening a time required for retrieval
of a data set.

4
[Brief Description of the Drawings]
[0011]
[Fig. 1] Fig. 1 is a diagram for describing an overview of a retrieval apparatus according
to a present example embodiment. 5 [Fig. 2] Fig. 2 is a diagram illustrating a functional configuration of a retrieval apparatus
according to an example embodiment 1.
[Fig. 3] Fig. 3 is a diagram illustrating a computer for achieving the retrieval apparatus. [Fig. 4] Fig. 4 is a flowchart illustrating a flow of processing to be executed by the
retrieval apparatus according to the example embodiment 1. 10 [Description of Embodiments]
[0012]
Hereinafter, example embodiments according to the present invention are described with
reference to the drawings. Note that, in all the drawings, a similar constituent element has a
similar reference sign, and description thereof is omitted as necessary. In each of the block 15 diagrams, unless otherwise specifically described, each block does not represent a configuration
of a hardware unit, but represents a configuration of a functional unit.
[0013]
[Example Embodiment 1]
20 Fig. 1 is a diagram for describing an overview of a retrieval apparatus 2000 according to
a present example embodiment. Note that, Fig. 1 is an example for facilitating understanding
of the retrieval apparatus 2000, and a function of the retrieval apparatus 2000 is not limited to the
one illustrated in Fig. 1.
[0014] 25 The retrieval apparatus 2000 performs retrieval of information stored in a storage region
50. The storage region 50 is a storage region of a part or the entirety of any storage apparatus.
Further, the storage region 50 may be constituted of a plurality of storage apparatuses.
[0015]
Object information 100 is stored in the storage region 50. The object information 100 30 is information in which an object identifier 102 and a feature value set 104 are associated with
each other. The object identifier 102 is an identifier allocated to an object. The feature value
set 104 is a set of feature values acquired regarding an object to be determined by the associated
object identifier 102. For example, a feature value is an image feature of an object to be
acquired from an image. Note that, any object (e.g., a person, an animal, a vehicle, or the like)

5
can be handled as an object. [0016]
The retrieval apparatus 2000 acquires a feature value set (retrieval target set 60) being a retrieval target, and retrieves object information 100 by the retrieval target set 60. In other 5 words, the retrieval apparatus 2000 determines object information 100 indicating a feature value set 104 similar to the retrieval target set 60 from among a plurality of pieces of object information 100 by comparison of the retrieval targe set 60 with the feature value set 104. [0017]
Herein, in a case where a feature value set satisfies a predetermined condition, the
10 retrieval apparatus 2000 performs comparison with another feature value set by using a part of
feature values within the feature value set. For example, the predetermined condition is that the number of elements in a feature value set is equal to or more than a predetermined number. [0018]
Further, the retrieval apparatus 2000 outputs output information relating to the
15 determined object information 100. For example, output information is the determined object information 100 itself. In addition to the above, for example, output information may be an object identifier 102 indicated by the determined object information 100, or the like. [0019]
20 In the retrieval apparatus 2000 according to the present example embodiment, object information 100 having a feature value set 104 similar to a retrieval target set 60 is determined by comparison between the retrieval target set 60 and the feature value set 104. Thus, for example, it is possible to determine, from among object information 100, object information 100 having a feature value set 104 being estimated to be constituted of a feature value of a same
25 object, regarding an object represented by a feature value included in a retrieval target set 60. [0020]
For example, object information 100 is generated in advance regarding various persons, and registered in the storage region 50. In this case, for example, a feature value set 104 is a set of image features of an associated person. In other words, the storage region 50 can be handled
30 as a database in which image features of various persons are collected. Then, for example, a set of image features of a person being newly acquired from a video of a surveillance camera is used as a retrieval target set 60. Thus, it is possible to determine a person corresponding to a person captured by the surveillance camera from among the persons registered in advance. Specifically, it is possible to achieve various pieces of processing such as authentication of a

6
person, matching with a blacklist, and the like. [0021]
As described above, herein, in a case where a feature value set satisfies a predetermined condition, the retrieval apparatus 2000 performs comparison with another feature value set by 5 using a part of feature values within the feature value set. This enables reducing a time required for comparison between feature value sets. For example, it is assumed that the predetermined condition is that "the number of elements in a feature value set is equal to or more than a predetermined number". In this case, by setting, as a predetermined number, a number sufficient for comparison between feature value sets, it is possible to shorten a time required for
10 comparison between feature values, while performing comparison between feature value sets with high accuracy. [0022]
Hereinafter, further details of the present example embodiment are descried. [0023]
15
Fig. 2 is a diagram illustrating a functional configuration of the retrieval apparatus 2000 according to an example embodiment 1. The retrieval apparatus 2000 includes a determination unit 2020 and an output unit 2040. The retrieval apparatus 2000 is configured to be accessible to the storage region 50. The determination unit 2020 acquires a retrieval target set 60, and
20 determines object information 100 indicating a feature value set 104 similar to the retrieval target set 60 from among a plurality of pieces of object information 100 by performing comparison between the retrieval target set 60 and the feature value set 104. The output unit 2040 outputs output information relating to the determined object information 100. [0024]
25
Each functional configuration unit of the retrieval apparatus 2000 may be achieved by hardware that achieves each functional configuration unit (example: a hard-wired electronic circuit, and the like), or may be achieved by combination of hardware and software (example: combination of an electronic circuit and a program that controls the electronic circuit, and the
30 like). Hereinafter, a case is further described in which each functional configuration unit of the retrieval apparatus 2000 is achieved by combination of hardware and software. [0025]
Fig. 3 is a diagram illustrating a computer 1000 for achieving the retrieval apparatus 2000. The computer 1000 is any computer. For example, the computer 1000 is any computer.

7
For example, the computer 1000 is a stationary type computer such as a server machine and a personal computer (PC). In addition to the above, for example, the computer 1000 may be a portable computer such as a smartphone and a tablet terminal. [0026] 5 The computer 1000 may be a dedicated computer designed for achieving the retrieval apparatus 2000, or may be a general-purpose computer. In a case where the computer 1000 is a general-purpose computer, it is appropriate to cause the computer 1000 to function as the retrieval apparatus 2000 by installing a predetermined program in the computer 1000. [0027]
10 The computer 1000 includes a bus 1020, a processor 1040, a memory 1060, a storage device 1080, an input/output interface 1100, and a network interface 1120. The bus 1020 is a data transmission path along which the processor 1040, the memory 1060, the storage device 1080, the input/output interface 1100, and the network interface 1120 mutually transmit and receive data. However, a method of mutually connecting the processor 1040 and the like is not
15 limited to bus connection. [0028]
The processor 1040 is a variety of processors such as a central processing unit (CPU), a graphics processing unit (GPU), and a field-programmable gate array (FPGA). The memory 1060 is a main storage apparatus to be achieved by using a random access memory (RAM) or the
20 like. The storage device 1080 is an auxiliary storage apparatus to be achieved by using a hard disk, a solid state drive (SSD), a memory card, a read only memory (ROM), or the like. [0029]
The input/output interface 1100 is an interface for connecting the computer 1000 and an input/output device. For example, an input apparatus such as a keyboard, and an output
25 apparatus such as a display apparatus are connected to the input/output interface 1100. [0030]
The network interface 1120 is an interface for connecting the computer 1000 to a network. A method of connecting the network interface 1120 to a network may be wireless connection or may be wired connection.
30 [0031]
The computer 1000 is connected to the storage region 50 via the network interface 1120. However, a method of connecting the computer 1000 to the storage region 50 is not limited to a method via the network interface 1120. For example, the storage region 50 may be connected to the computer 1000 via the input/output interface 1100. Further, the storage region 50 may be

8
provided inside the computer 1000 (e.g., inside the storage device 1080). [0032]
The storage device 1080 stores a program module that achieves each functional configuration unit of the retrieval apparatus 2000. The processor 1040 achieves a function 5 associated with each program module by reading each of these program modules in the memory 1060 and executing each of these program modules. [0033]
Fig. 4 is a flowchart illustrating a flow of processing to be executed by the retrieval
10 apparatus 2000 according to the example embodiment 1. The determination unit 2020 acquires a retrieval target set 60 (S102). The determination unit 2020 determines object information 100 having a feature value set 104 similar to the retrieval target set 60 by performing comparison between the feature value set 104 and the retrieval target set 60 (S104). The output unit 2040 outputs output information relating to the determined object information 100 (S106).
15 [0034]

The determination unit 2020 acquires a retrieval target set 60 (S102). A method of acquiring a retrieval target set 60 by the determination unit 2020 is optional. For example, the retrieval apparatus 2000 transmits the retrieval target set 60 transmitted from another apparatus.
20 For example, the "another apparatus" is a PC, a mobile terminal, or the like (hereinafter, a user terminal) operated by a user of the retrieval apparatus 2000. However, an apparatus that transmits the retrieval target set 60 to the retrieval apparatus 2000 is not limited to a user terminal, but can be any terminal. For example, the retrieval target set 60 may be automatically transmitted to the retrieval apparatus 2000 from an apparatus on which an application for
25 handling a feature value set is operated, as part of processing of the application. [0035]
The determination unit 2020 determines object information 100 having a feature value set 104 similar to the retrieval target set 60 by performing comparison between the retrieval
30 target set 60 and the feature value set 104, and determining the feature value set 104 similar to
the retrieval target set 60 (S104). For example, the determination unit 2020 computes similarity between the retrieval target set 60 and the feature value set 104, and determines the feature value set 104 whose similarity is equal to or more than a predetermined value. Then, the determination unit 2020 determines, as object information 100 having the feature value set 104

9
similar to the retrieval target set 60, object information 100 having the determined feature value
set 104.
[0036]
Note that, in a case where there are a plurality of feature value sets 104 whose similarity 5 to the retrieval target set 60 is equal to or more than a predetermined value, the determination unit 2020 may determine, as a feature value set 104 similar to the retrieval target set 60, all these plurality of feature value sets 104, or may determine only a feature value set 104 whose similarity is largest among all the feature value sets 104. In a case where there is no feature value set 104 whose computed similarity is equal to or more than a predetermined value, object
10 information 100 having the feature value set 104 similar to the retrieval target set 60 is not determined. [0037]
Hereinafter, a method of computing similarity between a retrieval target set 60 and a feature value set 104 is described. For example, the determination unit 2020 computes
15 similarity regarding each of all patterns of a pair to be acquired by extracting a feature value one by one from the retrieval target set 60 and the feature value set 104, and handles, as similarity between the retrieval target set 60 and the feature value set 104, a statistical value (such as an average value) of the computed similarity. It is possible to represent similarity between two feature values, for example, by a value (e.g., a reciprocal of a norm) that increases, as the norm
20 of these feature values in a feature value space decreases. Note that, as the norm, any type of a norm (e.g., an L1 norm and an L2 norm) can be used. [0038]
However, in a case where the feature value set 104 satisfies a predetermined condition, the determination unit 2020 uses, for the above-described comparison, a part of feature values
25 included in the feature value set 104 (i.e., a partial set of the feature value set 104). Hereinafter, a partial set of the feature value set 104 used for comparison is referred to as a partial feature value set. Likewise, in a case where the retrieval target set 60 satisfies a predetermined condition, the determination unit 2020 uses, for the above-described comparison, a part of feature values included in the retrieval target set 60 (i.e., a partial set of the retrieval target set
30 60). Hereinafter, a partial set of the retrieval target set 60 to be used for comparison is referred to as a partial retrieval target set. For example, the above-described predetermined condition is that the number of elements in a set is more than a predetermined number. [0039]
Herein, a partial feature value set may be generated in advance before the retrieval

10
target set 60 is acquired. For example, when a new feature value is added to the feature value set 104, the retrieval apparatus 2000 determines whether the number of elements in the feature value set 104 is equal to or less than a predetermined number. In a case where the number of elements in the feature value set 104 is not equal to or less than the predetermined number, the 5 retrieval apparatus 2000 generates a partial feature value set, as a set in which one feature value is removed from the feature value set 104. This enables keeping the number of elements in the partial feature value set to be equal to or less than the predetermined number. [0040]
In addition to the above, for example, the retrieval apparatus 2000 determines whether
10 the number of elements in the feature value set 104 included in object information 100 is equal to or less than a predetermined number at a time of inserting new object information 100 into the storage region 50. Then, in a case where the number of elements in the feature value set 104 is more than the predetermined number, the retrieval apparatus 2000 generates a partial feature value set constituted of a part of feature values included in the feature value set 104. It is
15 assumed that the number of elements in the partial feature value set is equal to or less than the above-described predetermined number. [0041]
Information representing a partial feature value set may be generated separately from the feature value set 104, or may be generated by including, in the feature value set 104,
20 information relating to the partial feature value set. In the former case, a partial feature value set generated from the feature value set 104 is included in object information 100 having the feature value set 104. In the latter case, for example, a flag indicating whether a feature value included in the feature value set 104 is included in the partial feature value set is set in association with each of feature values. By referring to the flag, the determination unit 2020
25 can recognize a feature value included in the partial feature value set. [0042]
Hereinafter, a method of generating a partial feature value set from a feature value set 20 is described. Note that, it is assumed that an upper limit (the above-described predetermined number) of the number of elements in a partial retrieval set is determined in advance. The same
30 method can also be applied to a method of generating a partial retrieval target set from a retrieval target set 60. [0043] <>
For example, the determination unit 2020 preferentially includes, in a partial feature

11
value set, a feature value, as the feature value approaches a reference position (reference feature value) of the feature value set 104 in a feature value space. For example, the reference position is a center position of the feature value set 104 (average of feature values included in the feature value set 104). 5 [0044]
For example, the determination unit 2020 computes a distance to a feature value (such as an average of feature values included in the feature value set 104) representing a reference position regarding each of feature value sets 104 included in the feature value set 104. Then, the determination unit 2020 preferentially includes, in a partial retrieval set, a feature value, as
10 the distance of the feature value decreases. Specifically, in a case where the number of
elements in a partial feature value set is n, the determination unit 2020 determines n feature values in the ascending order of the computed distance, and generates a partial feature value set constituted of these n feature values. [0045]
15 In addition to the above, for example, in a case where a reference position is a center of a feature value space, it is possible to approximately and preferentially include, in a partial feature value set, a feature value close to the center by generating a partial feature value set as described below. First, the determination unit 2020 computes similarity regarding each of all patterns of pairs of feature values included in the feature value set 104, and sorts out the pairs in
20 an order of similarity. Then, a high score is given to each of the pairs, as the similarity
increases. For example, in a case where the number of pairs included in the feature value set
104 is m, a score (m-i+1) is given to the i-th pair.
[0046]
Further, the determination unit 2020 computes, regarding each of feature values, a total
25 value of scores of all pairs including the feature value. Then, the determination unit 2020
preferentially includes, in the partial feature value set, a feature value having a large total value of the scores. For example, in a case where the number of elements in a partial feature value set is n, the determination unit 2020 generates a partial feature value set constituted of n feature values in the descending order of a total value of scores.
30 [0047]
<>
In this method, as a premise, appropriateness of a feature value is associated with each of the feature values. Therefore, the feature value set 20 and the retrieval target set 60 include information in which a feature value and appropriateness are associated with each other.

12
[0048]
Appropriateness of a feature value indicates how much the feature value is appropriate as information representing a feature of an object. For example, it is assumed that an object is a person, and a feature value is an image feature of a face of the person. In this case, the more 5 the face represented by the feature value faces a front side of a camera, it can be said that the feature value appropriately represents a feature of the face. In view of the above, for example, a value representing a degree by which a face faces a front side of a camera is used as appropriateness of a feature value. In this case, for example, it is possible to determine appropriateness in such a way that appropriateness increases, as an angle decreases based on a
10 premise that an angle of a face when the face faces the front side of the camera is handled as 0
degree, and an angle of the face when the face faces a direction opposite to the camera is handled
as 180 degrees.
[0049]
In addition to the above, for example, it is possible to handle a size of an image of an
15 object, as appropriateness of a feature value. This is because, as a size of an image of an object increases, it is appropriate to extract a feature value of the object. Note that, in a case where a feature value is extracted regarding a part of an object, a size of an image region of a part from which the feature value is extracted is used as appropriateness. For example, in a case where a feature value of a face is extracted, a size of an image region of the face is used as
20 appropriateness. [0050]
Appropriateness associated with a feature value is computed at a time of computing a feature value. In a case where a feature value is an image feature, for example, at a time of extracting a feature value from a captured image, appropriateness of the feature value is
25 computed by analyzing the captured image (e.g., analyzing an angle of a face). [0051]
The determination unit 2020 preferentially includes, in a partial feature value set, a feature value, as associated appropriateness increases among feature values included in the feature value set 104. For example, in a case where the number of elements in a partial feature
30 value set is n, the determination unit 2020 determines n feature values in the descending order of associated accuracy, and generates a partial feature value set constituted of these n feature values. [0052] <>
In this method, as a premise, a state parameter being data representing a state of an

13
object at a time of acquiring a feature value is associated with each of the feature values. The feature value set 104 and the retrieval target set 60 include information in which a feature value and a state parameter are associated with each other. [0053] 5 Various state parameters can be adopted as a state parameter. For example, a state
parameter is a degree (angle from a front side) by which an object faces a front side, clothes of a person, a facial expression of a person, a pose of a person, surrounding brightness, a place, a time, and the like. As a state parameter representing clothes of a person, for example, a color of clothes, a type of clothes, and the like can be adopted. A color of clothes can be represented by
10 a value such as an RGB value that uniquely determines the color, or can be represented by a class such as a blue system or a red system. A type of clothes can be represented, for example, by a class such as a jacket, trousers, or a skirt. A facial expression of a person can be represented, for example, by a class such as laughing, crying, being angry, or being worried. A pose of a person can be represented, for example, by a coordinate within a captured image of a specific
15 part (such as a hand, a leg, or a head) of the person. In addition to the above, for example, a pose of a person can be represented by a class such as standing, sitting, or lying. Note that, an existing technique can be used as a technique for computing a value of the above-described various state parameters regarding a person included in a captured image. [0054]
20 The determination unit 2020 determines a feature value included in a partial feature
value set in such a way that a distribution of state parameters included in the feature value set 20 increases. For example, after including all elements included in the feature value set 104 in a partial feature value set, the determination unit 2020 removes a feature value one by one from the partial feature value set by the below-described method until the number of elements in the
25 partial feature value set becomes equal to a predetermined number. [0055]
First, the determination unit 2020 sorts out pairs of state parameters and feature values included in a partial feature value set in the descending order of the state parameter. Next, the determination unit 2020 computes a difference between these pairs of adjacent state parameters
30 regarding each of the pairs. The determination unit 2020 determines a pair (hereinafter, a smallest pair) of state parameters in which the difference is smallest. A feature value to be removed from the partial feature value set is a feature value associated with either one of the state parameters included in the smallest pair. Hereinafter, state parameters included in a smallest pair are respectively referred to as a candidate 1 and a candidate 2.

14
[0056]
The determination unit 2020 computes a difference between pairs of adjacent state parameters regarding each of a set in which a feature value associated with the candidate 1 is removed from the partial feature value set, and a set in which a feature value associated with the 5 candidate 2 is removed from the partial feature value set. Then, the determination unit 2020 sets, as a new partial feature value set, a set in which a smallest value of the difference is larger between the above-described two sets. Increasing a smallest value of a difference large means increasing a smallest distance between state parameters, therefore, by the above-described setting, it is conceived that a distribution of state parameters can be widened.
10 [0057]
For example, it is assumed that a smallest value of a difference computed regarding a set in which a feature value associated with the candidate 1 is removed is larger than a smallest value of a difference computed regarding a set in which a feature value associated with the candidate 2 is removed. In this case, the set in which the feature value associated with the
15 candidate 1 is removed becomes a new partial feature value set. In other words, the feature value associated with the candidate 1 is removed from the partial feature value set. [0058]
A method of generating a partial feature value set based on a state parameter is not limited to the above-described method. For example, dispersion may be computed regarding a
20 state parameter, and a partial feature value set may be determined in such a way that the
dispersion increases. Specifically, the determination unit 2020 generates all patterns regarding a set in which one feature value is removed from a partial feature value set. For example, in a case where x feature values are included in a partial feature value set, x sets are generated. The determination unit 2020 computes dispersion of state parameters regarding each of these x sets.
25 Then, the determination unit 2020 sets, as a new partial feature value set, a set in which the dispersion is maximum. The determination unit 2020 repeats processing of removing one element from a partial feature value set as described above until the number of elements in the partial feature value set becomes equal to a predetermined number. [0059]
30 <<>Other Methods>>
For example, the determination unit 2020 may generate a partial feature value set by extracting a feature value from the feature value set 104 at random. For example, in a case where the number of elements in a partial feature value set is set to n, the determination unit 2020 extracts n feature values from the feature value set 104 at random, and generates a partial

15
feature value set constituted of the extracted feature values.
[0060]
In addition to the above, for example, the determination unit 2020 may sort out feature
values included in the feature value set 104 in an order of a generation time of the feature value 5 (a generation time of an image or the like from which the feature value is extracted), and
generate a partial feature value set by extracting the sorted feature values at a regular interval
(e.g., extracting every other feature value).
[0061]
10 The output unit 2040 outputs output information relating to object information 100
(object information 100 having the feature value set 104 similar to the retrieval target set 60)
determined by the determination unit 2020 (S106). As output information, it is possible to
include any information relating to object information 100 determined by the output unit 2040.
For example, the output unit 2040 outputs the determined object information 100 itself. In 15 addition to the above, for example, the output unit 2040 outputs an object identifier 104 indicated
in the determined object information 100.
[0062]
In addition to the above, for example, object information 100 may include various
pieces of information representing an object, and these various pieces of information may be 20 included in output information. For example, in a case where an object is a person, any
attribute information such as a name, age, gender of the person is included in object information
100. In this case, the output unit 2040 outputs these attributes by including in output
information.
[0063] 25 Note that, a type of information to be included in output information may be determined
in advance, or may be designated at a time of acquiring the retrieval target set 60. In the latter
case, for example, a retrieval query, in which a type of information (type of an attribute) that a
user of the retrieval apparatus 2000 desires to know regarding the retrieval target set 60 and an
object, is input by the user to the retrieval apparatus 2000. The output unit 2040 includes, in 30 output information, information of the type indicated in the retrieval query among information
indicated in the object information 100 determined by the determination unit 2020. Note that,
an existing technique can be used as a technique for designating information that a user desires
to know by a retrieval query.
[0064]

16
A way of outputting output information is optional. For example, the output unit 2040 causes a display apparatus connected to the retrieval apparatus 2000 to display output information. In addition to the above, for example, the output unit 2040 stores output information in a predetermined storage apparatus. In addition to the above, for example, in a 5 case where the retrieval apparatus 2000 receives the retrieval target set 60 transmitted from another apparatus, the output unit 2040 transmits output information to the another apparatus (response to a retrieval query). Preferably, output information transmitted to another apparatus may be displayed on a display apparatus provided in the another apparatus. Note that, an existing technique can be used as a technique for causing a display apparatus provided in another 10 apparatus to display information transmitted to the another apparatus. [0065]
In the foregoing, example embodiments according to the present invention have been described with reference to the drawings, however, these are examples of the present invention, and combination of the above-described example embodiments, or various configurations other 15 than the above can also be adopted. [0066]
A part or all of the above-described example embodiments may also be described as the following supplementary notes, but is not limited to the following.
1. A retrieval apparatus being accessible to a storage region in which a plurality of pieces
20 of object information including a feature value set being a set of a plurality of feature values
acquired regarding an object are stored, the retrieval apparatus comprising:
a determination unit that acquires a feature value set being a retrieval target, and
determines object information indicating a feature value set similar to a feature value set being
the retrieval target from among the plurality of pieces of object information by comparing the 25 acquired feature value set with a feature value set indicated in the object information; and an output unit that outputs output information relating to the determined object
information, wherein,
in a case where the feature value set satisfies a predetermined condition, the
determination unit performs comparison between the feature value set and another feature value 30 set by using a part of feature values within the feature value set.
2. The retrieval apparatus according to supplementary note 1, wherein
the determination unit preferentially uses a feature value included in the feature value set, for comparison with the another feature value set, as the feature value approaches a reference position of the feature value set in a feature value space.

17
3. The retrieval apparatus according to supplementary note 2, wherein
the determination unit
computes similarity between feature values regarding each of all pairs of
feature values included in the feature value set,
5 allocates a high score to each of the pairs, as similarity increases, and
preferentially uses a feature value, for comparison with the another feature value set, as a total value of scores allocated to each of pairs including the feature value increases.
4. The retrieval apparatus according to supplementary note 1, wherein
10 the feature value set includes appropriateness of the feature value in association with each of the feature values, and
the determination unit preferentially uses a feature value, for comparison with the
another feature value set, as associated appropriateness increases among feature values included
in the feature value set.
15 5. The retrieval apparatus according to supplementary note 4, wherein
the feature value includes a feature of a face of a person extracted from an image, and
appropriateness of the feature value is determined based on an angle of a face of a
person having the feature value in an image from which the feature value is extracted.
6. The retrieval apparatus according to supplementary note 1, wherein
20 the feature value set includes a parameter relating to a state of an object represented by the feature value in association with each of the feature values, and
the determination unit extracts the plurality of feature values from the feature value set
in such a way that dispersion of the parameter included in the feature value set increases, and
uses the extracted feature value for comparison with the another feature value set.
25 7. A control method to be executed by a computer,
the computer being accessible to a storage region in which a plurality of pieces of object information including a feature value set being a set of a plurality of feature values acquired regarding an object are stored.
The control method including: 30 a determination step of acquiring a feature value set being a retrieval target, and
determining object information indicating a feature value set similar to a feature value set being the retrieval target from among the plurality of pieces of object information by comparing the acquired feature value set with a feature value set indicated in the object information;
an output step of outputting output information relating to the determined object

18
information; and,
in the determination step, in a case where the feature value set satisfies a predetermined
condition, performing comparison between the feature value set and another feature value set by
using a feature value of one step within the feature value set.
5 8. The control method according to supplementary note 7, further including:
in the determination step, preferentially using a feature value included in the feature value set, for comparison with the another feature value set, as the feature value approaches a reference position of the feature value set in a feature value space.
9. The control method according to supplementary note 8, further including:
10 in the determination step,
computing similarity between feature values regarding each of all pairs of
feature values included in the feature value set;
allocating a high score to each of the pairs, as similarity increases; and preferentially using a feature value, for comparison with the another feature 15 value set, as a total value of scores allocated to each of pairs including the feature value
increases.
10. The control method according to supplementary note 7, wherein
the feature value set includes appropriateness of the feature value in association with each of the feature values, and 20 the control method further including,
in the determination step, preferentially using a feature value, for comparison with the another feature value set, as associated appropriateness increases among feature values included in the feature value set.
11. The control method according to supplementary note 10, wherein
25 the feature value includes a feature of a face of a person extracted from an image, and appropriateness of the feature value is determined based on an angle of a face of a person having the feature value in an image from which the feature value is extracted.
12. The control method according to supplementary note 7, wherein
the feature value set includes a parameter relating to a state of an object represented by 30 the feature value in association with each of the feature values, and
the control method further including,
in the determination step, extracting the plurality of feature values from the feature value set in such a way that dispersion of the parameter included in the feature value set increases, and using the extracted feature value for comparison with the another feature value

19

5
10
15
20
25

set.
13. A program causing a computer to execute the control method according to any one of
supplementary notes 7 to 12.
[0067]
This application is based upon and claims the benefit of priority from Japanese patent
application No. 2019-098793, filed on May 27, 2019, the disclosure of which is incorporated
herein in its entirety by reference.
[Reference signs List]
[0068]
20 Feature value set
50 Storage region
60 Retrieval target set
100 Object information
102 Object identifier
104 Feature value set
1000 Computer
1020 Bus
1040 Processor
1060 Memory
1080 Storage device
1100 Input/output interface
1120 Network interface
2000 Retrieval apparatus
2020 Determination unit
2040 Output unit

WE CLAIMS

A retrieval apparatus being accessible to a storage region in which a plurality of pieces of object information including a feature value set being a set of a plurality of feature values 5 acquired regarding an object are stored; the retrieval apparatus comprising:
a determination unit that acquires a feature value set being a retrieval target, and determines object information indicating a feature value set similar to a feature value set being the retrieval target from among the plurality of pieces of object information by comparing the acquired feature value set with a feature value set indicated in the object information; and 10 an output unit that outputs output information relating to the determined object information, wherein,
in a case where the feature value set satisfies a predetermined condition, the determination unit performs comparison between the feature value set and another feature value set by using a part of feature values within the feature value set.
15
[Claim 2]
The retrieval apparatus according to claim 1, wherein
the determination unit preferentially uses a feature value included in the feature value set, for comparison with the another feature value set, as the feature value approaches a reference 20 position of the feature value set in a feature value space.
[Claim 3]
The retrieval apparatus according to claim 2, wherein
the determination unit
25 computes similarity between feature values regarding each of all pairs of
feature values included in the feature value set,
allocates a high score to each of the pairs, as similarity increases, and preferentially uses a feature value, for comparison with the another feature value set, as a total value of scores allocated to each of pairs including the feature value 30 increases.
[Claim 4]
The retrieval apparatus according to claim 1, wherein
the feature value set includes appropriateness of the feature value in association with

21
each of the feature values, and
the determination unit preferentially uses a feature value, for comparison with the another feature value set, as associated appropriateness increases among feature values included in the feature value set.
5
[Claim 5]
The retrieval apparatus according to claim 4, wherein
the feature value includes a feature of a face of a person extracted from an image, and appropriateness of the feature value is determined based on an angle of a face of a 10 person having the feature value in an image from which the feature value is extracted.
[Claim 6]
The retrieval apparatus according to claim 1, wherein
the feature value set includes a parameter relating to a state of an object represented by 15 the feature value in association with each of the feature values, and
the determination unit extracts the plurality of feature values from the feature value set in such a way that dispersion of the parameter included in the feature value set increases, and uses the extracted feature value for comparison with the another feature value set.
20 [Claim 7]
A control method to be executed by a computer,
the computer being accessible to a storage region in which a plurality of pieces of object information including a feature value set being a set of a plurality of feature values acquired regarding an object are stored, 25 the control method comprising:
a determination step of acquiring a feature value set being a retrieval target, and determining object information indicating a feature value set similar to a feature value set being the retrieval target from among the plurality of pieces of object information by comparing the acquired feature value set with a feature value set indicated in the object information; 30 an output step of outputting output information relating to the determined object information; and,
in the determination step, in a case where the feature value set satisfies a predetermined condition, performing comparison between the feature value set and another feature value set by using a feature value of one step within the feature value set.

22

[Claim 8]
A program causing a computer to execute the control method according to claim 7.

Documents

Application Documents

# Name Date
1 202117054809.pdf 2021-11-26
2 202117054809-TRANSLATIOIN OF PRIOIRTY DOCUMENTS ETC. [26-11-2021(online)].pdf 2021-11-26
3 202117054809-STATEMENT OF UNDERTAKING (FORM 3) [26-11-2021(online)].pdf 2021-11-26
4 202117054809-REQUEST FOR EXAMINATION (FORM-18) [26-11-2021(online)].pdf 2021-11-26
5 202117054809-PRIORITY DOCUMENTS [26-11-2021(online)].pdf 2021-11-26
6 202117054809-POWER OF AUTHORITY [26-11-2021(online)].pdf 2021-11-26
7 202117054809-NOTIFICATION OF INT. APPLN. NO. & FILING DATE (PCT-RO-105-PCT Pamphlet) [26-11-2021(online)].pdf 2021-11-26
8 202117054809-FORM 18 [26-11-2021(online)].pdf 2021-11-26
9 202117054809-FORM 1 [26-11-2021(online)].pdf 2021-11-26
10 202117054809-DRAWINGS [26-11-2021(online)].pdf 2021-11-26
11 202117054809-DECLARATION OF INVENTORSHIP (FORM 5) [26-11-2021(online)].pdf 2021-11-26
12 202117054809-COMPLETE SPECIFICATION [26-11-2021(online)].pdf 2021-11-26
13 202117054809-RELEVANT DOCUMENTS [02-12-2021(online)].pdf 2021-12-02
14 202117054809-MARKED COPIES OF AMENDEMENTS [02-12-2021(online)].pdf 2021-12-02
15 202117054809-FORM 13 [02-12-2021(online)].pdf 2021-12-02
16 202117054809-AMMENDED DOCUMENTS [02-12-2021(online)].pdf 2021-12-02
17 202117054809-certified copy of translation [13-12-2021(online)].pdf 2021-12-13
18 202117054809-Proof of Right [18-05-2022(online)].pdf 2022-05-18
19 202117054809-FORM 3 [19-05-2022(online)].pdf 2022-05-19
20 202117054809-Others-300522.pdf 2022-06-06
21 202117054809-Correspondence-300522.pdf 2022-06-06
22 202117054809-FER.pdf 2022-07-08
23 202117054809-AbandonedLetter.pdf 2024-02-16

Search Strategy

1 SearchStrategyMatrix202117054809E_07-07-2022.pdf