The present invention relates to an information processing system, an information processing device, an information processing method, and a program, and more particularly to an information processing system, an information processing device, an information processing method, and a program that perform image recognition processing.
Background technology
[0002]
Patent Document 1 describes an example of a walk-through type face image authentication device. The face image recognition device described in Patent Document 1 identifies authentication candidate persons for a plurality of faces (characters) included in a plurality of face area images captured at different time points, and is similar to the authentication candidate person and the face image. The threshold for authentication is determined using an index indicating the degree of degree. The index used here is (1st place hit rate, which is the ratio of frames with the highest similarity). Then, the higher the first hit rate, the lower the authentication threshold. Then, even if there is a frame whose similarity with another person is temporarily increased due to changes in facial expressions, face orientation, etc., the authentication threshold does not decrease if the first-place hit rate is low.
[0003]
Further, the person recognition device described in Patent Document 2 detects the face of a passerby from the first image captured by the first camera and the second image captured by the second camera, respectively. Here, the first camera is installed in a state where it is easily recognized by a passerby, and the second camera is installed in a state where it is difficult for a passerby to recognize it. Then, the passersby are classified based on both detection results, the authentication threshold value used for the face collation processing is adjusted based on the classification result, and the output processing content based on the authentication result is determined.
[0004]
The person determination device and the person search / tracking device described in Patent Document 3 detect a walking state of a person from a person image sequence obtained by a distant frame or a different camera, and include the person in a different image sequence based on the walking state. Determine if the people are the same. This makes it possible to track people. Further, Patent Document 4 describes that the stride length, height, weight, or walking state (step length, pace) of the person to be authenticated is detected, collated with the authentication information, and personal authentication is performed. Patent Document 5 describes a gate management system that performs authentication processing based on the gait (step length, posture, arm swing, etc.) of a person passing through the gate and controls the unlocking and locking of the gate.
Prior art literature
Patent documents
[0005]
Patent Document 1: Japanese Unexamined Patent Publication No. 2013-101551
Patent Document 2: Japanese Unexamined Patent Publication No. 2008-108243
Patent Document 3: International Publication No. 2006/013765
Patent Document 4: Japanese Unexamined Patent Publication No. 2009-104526
Patent Document 5: Japanese Unexamined Patent Publication No. 2018-77552
Outline of the invention
Problems to be solved by the invention
[0006]
The present inventor examined a new method for tracking a person using image processing. That is, an object of the present invention is to provide a new method for tracking a person by using image processing.
Means to solve problems
[0007]
In each aspect of the present invention, the following configurations are adopted in order to solve the above-mentioned problems.
[0008]
The first aspect is related to information processing equipment.
The first information processing device related to the first aspect is
A collation means for collating the first feature information extracted from the person included in the first image with the first registered feature information stored in the storage means.
When the first feature information cannot be extracted from the person, or when the collation results by the collation means do not match, the second feature information extracted from the person is used as the second registered feature information. It has a registration means to be stored in a storage means,
The collating means collates the second feature information extracted from the person included in the second image with the second registered feature information stored in the storage means, thereby performing the second from the second image. Identify the person corresponding to the registered feature information of.
The second information processing device related to the first aspect is
A collation means for collating the first feature information extracted from the person included in the first image with the first registered feature information stored in the storage means.
It has a registration means for storing the second feature information extracted from the person as the second registration feature information in the storage means.
The collating means collates the second feature information extracted from the person included in the second image with the second registered feature information stored in the storage means, thereby registering the second feature from the second image. Identify the person corresponding to the feature information and
The collation means cannot extract the first feature information from the person included in the first image, or the first feature information extracted from the person included in the first image and the said first feature information. When the collation result with the first registered feature information does not match, the first feature information extracted from the person identified from the second image and the first registered feature information stored by the storage means. And match.
[0009]
The second aspect relates to an information processing method executed by at least one computer.
The first information processing method related to the second aspect is
Information processing device
The first feature information extracted from the person included in the first image is collated with the first registered feature information stored in the storage device.
When the first feature information cannot be extracted from the person, or when the collation results do not match, the second feature information extracted from the person is stored in the storage device as the second registered feature information. Let me
By collating the second feature information extracted from the person included in the second image with the second registered feature information stored in the storage device, the second image can be changed to the second registered feature information. Includes identifying the corresponding person.
The second information processing method related to the second aspect is
Information processing device
The first feature information extracted from the person included in the first image is collated with the first registered feature information stored in the storage device.
The second feature information extracted from the person is stored in the storage device as the second registered feature information, and is stored in the storage device.
By collating the second feature information extracted from the person included in the second image with the second registered feature information stored in the storage device, the second image corresponds to the second registered feature information. Identify the person,
When the first feature information cannot be extracted from the person included in the first image, or the first feature information and the first registered feature extracted from the person included in the first image. When the collation result with the information does not match, the first feature information extracted from the person identified from the second image is collated with the first registered feature information stored in the storage device. Including that.
[0010]
As another aspect of the present invention, it may be a program that causes at least one computer to execute the method of the second aspect, or a recording medium that can be read by a computer that records such a program. You may. This recording medium includes a non-temporary tangible medium.
This computer program includes computer program code that causes the computer to execute the information processing method on the information processing device when executed by the computer.
[0011]
It should be noted that any combination of the above components and the conversion of the expression of the present invention between methods, devices, systems, recording media, computer programs, etc. are also effective as aspects of the present invention.
[0012]
Further, the various components of the present invention do not necessarily have to be independent of each other, and a plurality of components are formed as one member, and one component is formed of a plurality of members. It may be that a certain component is a part of another component, a part of a certain component overlaps with a part of another component, and the like.
[0013]
Further, although the method and the computer program of the present invention describe a plurality of procedures in order, the order of description does not limit the order in which the plurality of procedures are executed. Therefore, when implementing the method and computer program of the present invention, the order of the plurality of procedures can be changed within a range that does not hinder the contents.
[0014]
Furthermore, the method of the present invention and the plurality of procedures of the computer program are not limited to being executed at different timings. Therefore, another procedure may occur during the execution of a certain procedure, a part or all of the execution timing of the certain procedure and the execution timing of the other procedure may overlap, and the like.
The invention's effect
[0015]
According to each of the above aspects, it is possible to provide a new method for detecting a person to be noted by using image processing.
A brief description of the drawing
[0016]
The above-mentioned objectives and other objectives, features and advantages will be further clarified by the preferred embodiments described below and the accompanying drawings.
[0017]
FIG. 1 is a functional block diagram showing a logical configuration of an information processing device according to the first embodiment of the present invention.
FIG. 2 is a diagram showing an example of a data structure of a second storage unit of the storage device of FIG.
FIG. 3 is a flowchart showing an example of the operation of the information processing apparatus of FIG.
FIG. 4 is a diagram showing an example of a data structure of a second storage unit of the storage device of the information processing device according to the second embodiment of the present invention.
FIG. 5 is a flowchart showing an example of the procedure after step S125 in FIG. 3 in the operation of the information processing apparatus according to the second embodiment of the present invention.
FIG. 6 is a flowchart showing an example of the procedure after step S135 in FIG. 5 in the operation of the information processing apparatus according to the second embodiment of the present invention.
FIG. 7 is a functional block diagram that logically shows the configuration of the information processing apparatus according to the third embodiment of the present invention.
8 is a diagram for explaining the timing of information output of the output unit of the information processing apparatus of FIG. 7. FIG.
9 is a diagram showing an example of a data structure of a second storage unit of the storage device of FIG. 7. FIG.
FIG. 10 is a flowchart showing an example of the operation of the information processing apparatus according to the fourth embodiment of the present invention.
FIG. 11 is a flowchart showing an example of the operation of the information processing apparatus according to the fifth embodiment of the present invention.
FIG. 12 is a flowchart showing an example of the operation of the information processing apparatus according to the sixth embodiment of the present invention.
FIG. 13 is a diagram showing an example of a configuration of a computer that realizes the information processing apparatus of each embodiment.
[Fig. 14] Fig. 14 is a diagram showing an example of a display screen of a camera image captured in a predetermined area.
FIG. 15 is a diagram showing changes in data registered in the second storage unit of the storage device of the embodiment.
FIG. 16 is a diagram showing an example of another data structure of the second storage unit of the storage device of the embodiment.
[Fig. 17] Fig. 17 is a diagram schematically showing the situation of a place where four cameras are installed along a certain passage.
FIG. 18 is a diagram showing changes in data registered in the second storage unit of the storage device of the embodiment.
Mode for carrying out the invention
[0018]
Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all drawings, similar components are designated by the same reference numerals, and description thereof will be omitted as appropriate.
Further, in each figure of the present specification, the configuration of a part not related to the essence of the present invention is omitted and is not shown.
[0019]
(First Embodiment)
FIG. 1 is a functional block diagram showing a logical configuration of the information processing device 100 according to the embodiment of the present invention. The information processing device 100 tracks a person who is not authenticated by the captured image in a predetermined area.
[0020]
The information processing device 100 includes a collation unit 102 and a registration unit 104. In the example shown in this figure, the information processing device 100 further includes a storage device 110. The storage device 110 includes a first storage unit 111 (for example, a facial feature information database) and a second storage unit 112. The storage device 110 may be realized by a plurality of physical storage media and a plurality of databases. Further, the first storage unit 111 and the second storage unit 112 may be included in physically the same device, or may be included in physically different devices. Further, the first storage unit 111 and the second storage unit 112 may be integrated with the main body of the information processing device 100 or may be separate bodies.
[0021]
Collation The unit 102 collates the first feature information extracted from the person included in the first image 20 with the first registered feature information stored in the storage device 110.
When the registration unit 104 cannot extract the first feature information from the person, or when the collation results by the collation unit 102 do not match, the registration unit 104 uses the second feature information extracted from the person as the second registration feature. It is stored in the storage device 110 as information. In other words, the registration unit 104 registers the second feature information of the person in the storage device 110.
Then, the collating unit 102 collates the second feature information extracted from the person included in the second image 22 with the second registered feature information stored in the storage device 110, so that the second image 22 to the second image 22 to the second Identify the person corresponding to the registered feature information of. Hereinafter, the collation process using the first registered feature information is also referred to as "individual identification process", and the collation process using the second registered feature information is also referred to as "person identification process".
[0022]
The first feature information is feature information that can identify a person, and in the present embodiment, it is referred to as facial feature information, and hereinafter also referred to as facial feature information. Further, the first registered feature information stored in the first storage unit 111 is also hereinafter referred to as face registered feature information. The first feature information may be other biological information such as iris, pinna, vein, fingerprint, gait and the like. In addition, the first storage unit 111 may store a plurality of types of biometric information per person. In this case, the collation unit 102 may perform the collation process by combining a plurality of types of biometric information.
[0023]
The second characteristic information is the characteristic information of a person including an area other than the face, and is also referred to as "human area characteristic information" hereafter. Further, the second registered feature information registered in the second storage unit 112 is also hereinafter referred to as registrant area feature information. The human area characteristic information is characteristic information indicating appearance characteristics such as the back appearance or clothes of a person whose face could not be authenticated by the collating unit 102. Human domain feature information includes height, shoulder width, proportion of body parts, clothing (shape, color, material, etc.), hairstyle (including hair color), ornaments (hat, glasses, accessories, etc.), belongings (bag, umbrella, etc.) , Cane, etc.), etc. Includes information indicating features. Further, the human domain characteristic information may include information such as the likelihood of the characteristic information.
[0024]
Hereinafter, the information processing device 100 will be described in detail.
[0025]
First, the image processed by the information processing device 100 will be described. The first image 20 and the second image 22 may be imaged by the same imaging means, or may be imaged by different imaging means. The image pickup means is a camera including an image pickup element such as a lens and a CCD (Charge Coupled Device) image sensor, and is preferably a network camera such as an IP (Internet Protocol) camera. The network camera has, for example, a wireless LAN (Local Area Network) communication function, and is connected to the information processing device 100 via a communication network, that is, a relay device (not shown) such as a router. These cameras may be so-called surveillance cameras. Then, the imaging means may include a mechanism that follows the movement of a specific person to control the orientation of the camera body or men, zoom control, focus, and the like.
[0026]
The camera and the information processing device 100 may be directly connected, or may be indirectly connected via a communication network or the like as described above. For example, the image data captured by the camera may be directly transmitted to the information processing device 100, and the information processing device 100 may sequentially receive the image data. Further, a storage device (not shown) that can be accessed by both the camera and the information processing device 100 may be provided. In this case, the image data captured by the camera may be stored in the storage device, and the information processing device 100 may read the image data from the storage device and acquire the image data.
[0027]
Here, the image data may be at least one of a still image and a moving image. The data format, file format, file size, image size, image resolution, video frame rate, etc. are not particularly limited, and the specifications, standards, performance, etc. of the camera and information processing device 100, or the processing capacity and accuracy of image analysis. Various types can be adopted depending on the above. Then, at least one frame of this image data becomes at least one of the first image 20 and the second image 22.
[0028]
Further, in the embodiment, "acquisition" means that the own device fetches data or information stored in another device or storage medium (active acquisition), and outputs the data to the own device from the other device. Includes at least one of entering data or information to be performed (passive acquisition). Examples of active acquisition include making a request or inquiry to another device and receiving the reply, and accessing and reading another device or storage medium. In addition, an example of passive acquisition may be receiving information to be delivered (or transmitted, push notification, etc.). Further, the “acquisition” may be to select and acquire the received data or information, or to select and receive the delivered data or information.
[0029]
Further, the timing of transmitting the image from the camera to the information processing device 100 may be, for example, streaming distribution in real time, or images for a predetermined period may be transmitted at predetermined intervals. The timing may be appropriately selected based on the memory capacity, communication capacity, image processing capacity of the camera or the information processing device 100, the communication status between the camera and the information processing device 100, or the like, or may be changed according to a change in the situation. May be done.
[0030]
In the present embodiment, the first image 20 is imaged at the first timing, and the second image 22 is imaged after the first timing.

The scope of the claims
[Claim 1]
A collation means for collating the first feature information extracted from the person included in the first image with the first registered feature information stored in the storage means.
When the first feature information cannot be extracted from the person, or when the collation results by the collation means do not match, the second feature information extracted from the person is used as the second registered feature information. It is equipped with a registration means to be stored in a storage means.
The collating means collates the second feature information extracted from the person included in the second image with the second registered feature information stored in the storage means, thereby performing the second from the second image. An information processing device that identifies the person corresponding to the registered feature information of.
[Claim 2]
In the information processing device according to claim 1,
The collation means collates the first feature information extracted from the person identified from the second image with the first registered feature information stored by the storage means.
Information processing device.
[Claim 3]
A collation means for collating the first feature information extracted from the person included in the first image with the first registered feature information stored in the storage means.
A registration means for storing the second feature information extracted from the person as the second registration feature information in the storage means is provided.
The collating means collates the second feature information extracted from the person included in the second image with the second registered feature information stored in the storage means, thereby registering the second feature from the second image. Identify the person corresponding to the feature information and
The collation means cannot extract the first feature information from the person included in the first image, or the first feature information extracted from the person included in the first image and the said first feature information. When the collation result with the first registered feature information does not match, the first feature information extracted from the person identified from the second image and the first registered feature information stored by the storage means. An information processing device that collates with.
[Claim 4]
In the information processing device according to any one of claims 1 to 3,
The collation means performs a process of identifying a person corresponding to the second registered feature information from the second image, and the first feature information extracted from the identified person and the first registered feature. The process of collating the information is repeated until the collation results match.
Information processing device.
[Claim 5]
In the information processing device according to any one of claims 1 to 4,
When the collation result of the first feature information extracted from the person identified from the second image and the first registered feature information stored in the storage means is in agreement, the storage means is used. An information processing device further comprising a deletion means for deleting the second registered feature information of the person.
[Claim 6]
In the information processing device according to any one of claims 1 to 5,
The second image is an information processing device taken by a camera different from that of the first image.
[Claim 7]
In the information processing device according to any one of claims 1 to 6,
The first image is captured by the first camera among a plurality of cameras installed along the path, and the second image is located behind the first camera in the direction along the path. An information processing device that is imaged by the camera of.
[Claim 8]
In the information processing device according to claim 7,
Among the plurality of second cameras, the first person is identified by the collating means from the second image generated by the second camera installed at the last or a predetermined position in the direction along the path. An information processing device including an output means for outputting information on a second feature information extracted from the person when the collation result with the registered feature information of the above does not match.
[Claim 9]
In the information processing device according to any one of claims 1 to 8.
An information processing device in which the first image is captured at the first timing and the second image is captured after the first timing.
[Claim 10]
In the information processing device according to any one of claims 1 to 9.
The registration means corresponds to the second registered feature information with information indicating the collation result of the first feature information extracted from the person included in the first image and the first registered feature information. Attach and store in the storage means
The collation means includes the first feature information extracted from the person identified from the second image and the storage means when the information indicating the collation result indicates that the collation results do not match. Collate with the first registered feature information stored in Information processing equipment.
[Claim 11]
In the information processing device according to any one of claims 1 to 10.
The registration means stores information indicating that the first feature information could not be extracted from the person included in the first image in the storage means in association with the second registered feature information.
The collation means is extracted from the person identified from the second image when the information indicates that the first feature information could not be extracted from the person included in the first image. An information processing device that collates the first feature information with the first registered feature information stored in the storage means.
[Claim 12]
In the information processing device according to any one of claims 1 to 11.
The registration means stores the second feature information together with the time information in the storage means.
If the first feature information cannot be extracted from the person specified from the second image even if a reference time or more has elapsed from the time indicated by the time information, or the said first feature information specified from the second image. An information processing device further comprising an output means for outputting information regarding the second feature information when the collation result with the first feature information extracted from a person does not match.
[Claim 13]
In the information processing device according to any one of claims 1 to 12,
The collation means is an information processing device that matches the collation results when they match a predetermined number of times or more in the collation process with the first registered feature information or the second registered feature information.
[Claim 14]
In the information processing device according to any one of claims 1 to 13.
The first feature information is facial feature information, and the second feature information is an information processing device that includes a region other than the face.
[Claim 15]
In the information processing device according to any one of claims 1 to 14,
An information processing device further including an output means for outputting information related to the second registered feature information stored in the storage means at a reference timing.
[Claim 16]
A collation means for collating the first feature information extracted from the person included in the first image with the first registered feature information stored in the storage means.
When the first feature information cannot be extracted from the person, or when the collation results by the collation means do not match, the second feature information extracted from the person is used as the second registered feature information. It is equipped with a registration means to be stored in a storage means.
The collating means collates the second feature information extracted from the person included in the second image with the second registered feature information stored in the storage means, and the second image is linked to the second feature information. An information processing system that identifies the person corresponding to the registered feature information of.
[Claim 17]
In the information processing system according to claim 16,
The collation means collates the first feature information extracted from the person identified from the second image with the first registered feature information stored by the storage means.
Information processing system.
[Claim 18]
A collation means for collating the first feature information extracted from the person included in the first image with the first registered feature information stored in the storage means.
A registration means for storing the second feature information extracted from the person as the second registration feature information in the storage means is provided.
The collating means collates the second feature information extracted from the person included in the second image with the second registered feature information stored in the storage means, thereby registering the second feature from the second image. Identify the person corresponding to the feature information and
The collation means cannot extract the first feature information from the person included in the first image, or the first feature information extracted from the person included in the first image and the said first feature information. When the collation result with the first registered feature information does not match, the first feature information extracted from the person identified from the second image and the first registered feature information stored by the storage means. An information processing system that collates with.
[Claim 19]
In the information processing system according to any one of claims 16 to 18.
The collation means performs a process of identifying a person corresponding to the second registered feature information from the second image, and the first feature information extracted from the identified person and the first registered feature. The process of collating the information is repeated until the collation results match.
Information processing system.
[Claim 20]
In the information processing system according to any one of claims 16 to 19,
When the collation result of the first feature information extracted from the person specified from the second image and the first registered feature information stored in the storage means is in agreement, the storage means is used. An information processing system further comprising a deletion means for deleting the second registered feature information of the person.
[Claim 21]
In the information processing system according to any one of claims 16 to 20,
An information processing system in which the second image is taken by a camera different from that of the first image.
[Claim 22]
In the information processing system according to any one of claims 16 to 21,
The first image is captured by the first camera among a plurality of cameras installed along the path, and the second image is located behind the first camera in the direction along the path. An information processing system that is imaged by a camera.
[Claim 23]
In the information processing system according to claim 22,
Among the plurality of second cameras, the first person is identified by the collating means from the second image generated by the second camera installed at the last or a predetermined position in the direction along the path. An information processing system including an output means for outputting information on a second feature information extracted from the person when the collation result with the registered feature information of the above does not match.
[Claim 24]
In the information processing system according to any one of claims 16 to 23,
An information processing system in which the first image is captured at the first timing and the second image is captured after the first timing.
[Claim 25]
In the information processing system according to any one of claims 16 to 24,
The registration means corresponds to the second registered feature information with information indicating the collation result of the first feature information extracted from the person included in the first image and the first registered feature information. Attach and store in the storage means
The collation means includes the first feature information extracted from the person identified from the second image and the storage means when the information indicating the collation result indicates that the collation results do not match. An information processing system that collates with the first registered feature information stored in the information processing system.
[Claim 26]
In the information processing system according to any one of claims 16 to 25,
The registration means stores information indicating that the first feature information could not be extracted from the person included in the first image in the storage means in association with the second registered feature information.
The collation means is extracted from the person identified from the second image when the information indicates that the first feature information could not be extracted from the person included in the first image. An information processing system that collates the first feature information with the first registered feature information stored by the storage means.
[Claim 27]
In the information processing system according to any one of claims 16 to 26,
The registration means stores the second feature information together with the time information in the storage means.
If the first feature information cannot be extracted from the person specified from the second image even if a reference time or more has elapsed from the time indicated by the time information, or the said first feature information specified from the second image. An information processing system further comprising an output means for outputting information on the second feature information when the collation result with the first feature information extracted from a person does not match.
[Claim 28]
In the information processing system according to any one of claims 16 to 27,
The collation means is an information processing system that matches the collation results when they match a predetermined number of times or more in the collation process with the first registered feature information or the second registered feature information.
[Claim 29]
In the information processing system according to any one of claims 16 to 28,
The first feature information is facial feature information, and the second feature information is an information processing system that includes areas other than the face.
[Claim 30]
In the information processing system according to any one of claims 16 to 29,
An information processing system further including an output means for outputting information related to the second registered feature information stored in the storage means at a reference timing.
[Claim 31]
Information processing device
The first feature information extracted from the person included in the first image is collated with the first registered feature information stored in the storage device.
When the first feature information cannot be extracted from the person, or when the collation results do not match, the second feature information extracted from the person is stored in the storage device as the second registered feature information. Let me
By collating the second feature information extracted from the person included in the second image with the second registered feature information stored in the storage device, the second image can be changed to the second registered feature information. An information processing method that identifies the corresponding person.
[Claim 32]
In the information processing method according to claim 31,
The information processing device
The first feature information extracted from the person identified from the second image is collated with the first registered feature information stored in the storage device.
Information processing method.
[Claim 33]
Information processing device
The first feature information extracted from the person included in the first image is collated with the first registered feature information stored in the storage device.
The second feature information extracted from the person is stored in the storage device as the second registered feature information, and is stored in the storage device.
By collating the second feature information extracted from the person included in the second image with the second registered feature information stored in the storage device, the second image corresponds to the second registered feature information. Identify the person,
When the first feature information cannot be extracted from the person included in the first image, or the first feature information and the first registered feature extracted from the person included in the first image. When the collation result with the information does not match, the first feature information extracted from the person specified from the second image is collated with the first registered feature information stored in the storage device. Information processing method.
[Claim 34]
In the information processing method according to any one of claims 31 to 33,
The information processing device
A process of identifying a person corresponding to the second registered feature information from the second image, and collating the first feature information extracted from the identified person with the first registered feature information. The process is repeated until the collation results match.
Information processing method.
[Claim 35]
In the information processing method according to any one of claims 31 to 34,
The information processing device is further
When the collation result of the first feature information extracted from the person specified from the second image and the first registered feature information stored in the storage device is in agreement, the storage device is used. An information processing method for deleting the second registered feature information of the person.
[Claim 36]
In the information processing method according to any one of claims 31 to 35,
The second image is an information processing method in which a camera different from that of the first image is used.
[Claim 37]
In the information processing method according to any one of claims 31 to 36,
The first image is captured by the first camera among a plurality of cameras installed along the path, and the second image is located behind the first camera in the direction along the path. Information processing method that is imaged by the camera of.
[Claim 38]
In the information processing method according to claim 37,
The information processing device
The person identified from the second image generated by the second camera installed at the last or a predetermined position in the direction along the path among the plurality of second cameras. An information processing method for outputting information on a second feature information extracted from the person when the collation result with the first registered feature information of the object does not match.
[Claim 39]
In the information processing method according to any one of claims 31 to 38,
An information processing method in which the first image is captured at the first timing and the second image is captured after the first timing.
[Claim 40]
In the information processing method according to any one of claims 31 to 39,
The information processing device
The storage device associates the information indicating the collation result between the first feature information extracted from the person included in the first image and the first registered feature information with the second registered feature information. To remember
When the information indicating the collation result indicates that the collation results did not match, the first feature information extracted from the person identified from the second image and the first feature information stored in the storage device. An information processing method that collates with the registered feature information of 1.
[Claim 41]
In the information processing method according to any one of claims 31 to 40,
The information processing device
Information indicating that the first feature information could not be extracted from the person included in the first image is stored in the storage device in association with the second registered feature information.
When the information indicates that the first feature information could not be extracted from the person included in the first image, the first feature information extracted from the person identified from the second image. An information processing method for collating the first registered feature information stored in the storage device with the first registered feature information.
[Claim 42]
In the information processing method according to any one of claims 31 to 41,
The information processing device is further
The storage device stores the second feature information together with the time information,
If the first feature information cannot be extracted from the person specified from the second image even if a reference time or more has elapsed from the time indicated by the time information, or the said first feature information specified from the second image. An information processing method for outputting information related to the second feature information when the collation result with the first feature information extracted from a person does not match.
[Claim 43]
In the information processing method according to any one of claims 31 to 42,
The information processing device
An information processing method in which, when the collation process with the first registered feature information or the second registered feature information matches a predetermined number of times or more, the collation results are matched.
[Claim 44]
In the information processing method according to any one of claims 31 to 43,
The first feature information is facial feature information, and the second feature information is an information processing method that includes a region other than the face.
[Claim 45]
In the information processing method according to any one of claims 31 to 44,
The information processing device is further
An information processing method that outputs information related to the second registered feature information stored in the storage device at a reference timing.
[Claim 46]
On the computer
A procedure for collating the first feature information extracted from the person included in the first image with the first registered feature information stored in the storage device.
If the first feature information cannot be extracted from the person, or if the collation results in the collation procedure do not match, the second feature information extracted from the person is used as the second registered feature information. Procedure for storing in the storage device,
By collating the second feature information extracted from the person included in the second image with the second registered feature information stored in the storage device, the second image can be changed to the second registered feature information. A program to execute the procedure for identifying the corresponding person.
[Claim 47]
In the program according to claim 46
On the computer
A program for executing a procedure for collating the first feature information extracted from the person specified from the second image with the first registered feature information stored in the storage device.
[Claim 48]
On the computer
A procedure for collating the first feature information extracted from the person included in the first image with the first registered feature information stored in the storage device.
A procedure for storing the second feature information extracted from the person as the second registered feature information in the storage device,
By collating the second feature information extracted from the person included in the second image with the second registered feature information stored in the storage device, the second image corresponds to the second registered feature information. Procedure for identifying a person,
When the first feature information cannot be extracted from the person included in the first image, or the first feature information and the first registered feature extracted from the person included in the first image. When the collation result with the information does not match, the procedure for collating the first feature information extracted from the person identified from the second image with the first registered feature information stored in the storage device. , A program to execute.
[Claim 49]
In the program according to any one of claims 46 to 48
On the computer
A process of identifying a person corresponding to the second registered feature information from the second image, and collating the first feature information extracted from the identified person with the first registered feature information. A program for executing a procedure of repeating the process until the collation results match.
[Claim 50]
In the program according to any one of claims 46 to 49
On the computer,
When the collation result of the first feature information extracted from the person specified from the second image and the first registered feature information stored in the storage device is in agreement, the storage device is used. A program for executing the procedure for deleting the second registered feature information of the person.
[Claim 51]
In the program according to any one of claims 46 to 50
The second image is a program taken by a camera different from that of the first image.
[Claim 52]
In the program according to any one of claims 46 to 51
The first image is captured by the first camera among a plurality of cameras installed along the path, and the second image is located behind the first camera in the direction along the path. A program that is imaged by a camera.
[Claim 53]
In the program according to claim 52
On the computer
Among the plurality of second cameras, the first registered feature information of the person specified from the second image generated by the second camera installed at the last or a predetermined position in the direction along the path. A program for executing a procedure of outputting information on the second feature information extracted from the person when the collation result with and is inconsistent.
[Claim 54]
In the program according to any one of claims 46 to 53
A program in which the first image is captured at the first timing and the second image is captured after the first timing.
[Claim 55]
In the program according to any one of claims 46 to 54
On the computer
The storage device associates the information indicating the collation result between the first feature information extracted from the person included in the first image and the first registered feature information with the second registered feature information. Procedure to memorize,
When the information indicating the collation result indicates that the collation results did not match, the first feature information extracted from the person identified from the second image and the first feature information stored in the storage device. A program for executing the procedure of collating with the registered feature information of 1.
[Claim 56]
In the program according to any one of claims 46 to 55
On the computer
A procedure for storing information indicating that the first feature information could not be extracted from the person included in the first image in the storage device in association with the second registered feature information.
When the information indicates that the first feature information could not be extracted from the person included in the first image, the first feature information extracted from the person identified from the second image. A program for executing a procedure for collating the first registered feature information stored in the storage device with the first registered feature information.
[Claim 57]
In the program according to any one of claims 46 to 56
On the computer
The procedure for storing the second feature information together with the time information in the storage device,
If the first feature information cannot be extracted from the person specified from the second image even if a reference time or more has elapsed from the time indicated by the time information, or the said first feature information specified from the second image. A program for further executing a procedure for outputting information regarding the second feature information when the collation result with the first feature information extracted from a person does not match.
[Claim 58]
In the program according to any one of claims 46 to 57
On the computer
A program for executing a procedure for matching the collation results when the collation process with the first registered feature information or the second registered feature information matches a predetermined number of times or more.
[Claim 59]
In the program according to any one of claims 46 to 58
The first feature information is facial feature information, and the second feature information is feature information including an area other than the face.
[Claim 60]
In the program according to any one of claims 46 to 59
On the computer
A program for executing a procedure for outputting information related to the second registered feature information stored in the storage device at a reference timing.