Invention title: Gate device, its control method, and program
Technical field
[0001]
The present invention relates to a gate device, a control method thereof, and a program.
Background technology
[0002]
Due to advances in image recognition technology, in recent years, authentication devices that use human face images have been put into practical use when entering and exiting facilities that require security management. And various techniques for improving the recognition accuracy have been proposed.
[0003]
Patent Document 1 describes a gate device that allows only authorized persons to pass through at airports, event venues, and the like. The gate device described in Patent Document 1 has a face recognition device. This face recognition device includes a camera that captures the face image of the person to be authenticated standing at a position facing the device, a display that displays text information and the like that explain the procedure for face recognition to the person, and a camera and a display. It is equipped with a half mirror placed in a covering position and a passport reader that scans the subject's passport. The gate device has a pole-shaped structure. This structure extends upward from the upper surface of the housing (gate body) installed along the path through which the subject passes. In addition, a plurality of LEDs (Light Emitting Diodes) are arranged side by side in the vertical direction as a display device on the side surface of this structure, and the progress of the authentication process in the gate device is determined by the number, order, and colors of the LEDs. It is shown by.
[0004]
The face recognition device described in Patent Document 2 includes a half mirror whose front surface side facing the person to be authenticated is a mirror surface, and a plurality of cameras arranged vertically on the back surface side of the half mirror, and is photographed by the cameras. Authentication processing is performed using the image. Patent Document 2 describes that when this face recognition device is used, the person to be authenticated can visually recognize the half mirror in a natural posture without being aware of the camera on the other side of the half mirror.
Prior art literature
Patent documents
[0005]
Patent Document 1: Japanese Unexamined Patent Publication No. 2019-71126
Patent Document 2: Japanese Unexamined Patent Publication No. 2007-77991
Outline of the invention
Problems to be solved by the invention
[0006]
In order to improve the accuracy of the subject's authentication (for example, face recognition), it is preferable that the subject's face to be imaged faces the camera as much as possible. On the other hand, when a person passes through a passage, the person often faces the direction of travel. Therefore, when authenticating a subject passing through a gate device, it is difficult to capture an image of the subject facing the front.
[0007]
The present invention has been made in view of the above circumstances, and an object of the present invention is to increase the possibility that the subject faces the imaging means when taking a picture for authentication with the gate device. ..
Means to solve problems
[0008]
In each aspect of the present invention, the following configurations are adopted in order to solve the above-mentioned problems.
[0009]
The first aspect is related to the gate device.
The gate device related to the first side is
An imaging means provided on the side of the aisle, in which the imaging direction is oblique to the traveling direction when the person passes through the aisle, and the person entering the aisle is imaged.
A half mirror provided in front of the imaging means in the imaging direction of the imaging means, and
It has a transmission means for transmitting an image captured by the image pickup means to an authentication device.
[0010]
The second aspect relates to a method of controlling a gate device executed by at least one computer.
The control method of the gate device related to the second aspect is
An imaging means provided on the side of the aisle, in which the imaging direction is diagonal to the traveling direction when the person passes through the aisle, and the person entering the aisle is imaged.
A method for controlling a gate device including a half mirror provided in front of the imaging means in the imaging direction of the imaging means.
The gate device is
The image pickup means was used to image a person passing through the passage.
Includes transmitting the image captured by the imaging means to the authentication device.
[0011]
As another aspect of the present invention, it may be a program that causes at least one computer to execute the method of the second aspect, or it is a recording medium that can be read by a computer that records such a program. You may. This recording medium includes a non-temporary tangible medium.
This computer program contains computer program code that causes the computer to implement its control method on the gate device when executed by the computer.
[0012]
It should be noted that any combination of the above components and the conversion of the expression of the present invention between methods, devices, systems, recording media, computer programs, etc. are also effective as aspects of the present invention.
[0013]
Further, the various components of the present invention do not necessarily have to be individually independent, and a plurality of components are formed as one member, and one component is formed of a plurality of members. It may be that a certain component is a part of another component, a part of a certain component overlaps with a part of another component, and the like.
[0014]
Further, although the method and the computer program of the present invention describe a plurality of procedures in order, the order of description does not limit the order in which the plurality of procedures are executed. Therefore, when implementing the method and computer program of the present invention, the order of the plurality of procedures can be changed within a range that does not hinder the contents.
[0015]
Furthermore, the method of the present invention and the plurality of procedures of the computer program are not limited to being executed at different timings. Therefore, another procedure may occur during the execution of a certain procedure, a part or all of the execution timing of the certain procedure and the execution timing of the other procedure may overlap, and the like.
The invention's effect
[0016]
According to each of the above aspects, it is possible to increase the possibility that the subject faces the imaging means when taking a picture for authentication with the gate device.
[0017]
The above-mentioned objectives and other objectives, features and advantages will be further clarified by the preferred embodiments described below and the accompanying drawings below.
A brief description of the drawing
[0018]
FIG. 1 is a diagram showing a functional configuration example of a gate system according to an embodiment.
FIG. 2 is a diagram schematically showing an outline of a gate system according to an embodiment.
FIG. 3 is a plan view of the gate device of the present embodiment as viewed from above.
FIG. 4 is a block diagram illustrating a hardware configuration of a computer that realizes the gate device shown in FIG. 1.
FIG. 5 is a flowchart showing an operation example of the gate device of the present embodiment.
[Fig. 6] Fig. 6 is a front view of the inside of the camera unit with the half mirror removed.
FIG. 7 is a functional block diagram showing a functional configuration example of the gate device of the present embodiment.
FIG. 8 is a flowchart showing an operation example of the gate system of the present embodiment.
FIG. 9 is a functional block diagram showing a logical configuration example of the gate device of the present embodiment.
FIG. 10 is a view showing a side view of the gate device of the present embodiment as viewed from the passage side.
FIG. 11 is a flowchart showing an operation example of the gate system of the present embodiment.
FIG. 12 is a functional block diagram showing a logical configuration example of the gate device of the present embodiment.
[Fig. 13] Fig. 13 is a front view of the inside of the camera unit with the half mirror removed.
FIG. 14 is a front view of a camera unit to which a half mirror is attached.
Embodiment for carrying out the invention
[0019]
Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all drawings, similar components are designated by the same reference numerals, and description thereof will be omitted as appropriate.
[0020]
In the embodiment, "acquisition" means that the own device retrieves data or information stored in another device or storage medium (active acquisition), and is output to the own device from the other device. Includes at least one of entering data or information (passive acquisition). Examples of active acquisition include requesting or inquiring about other devices and receiving the reply, and accessing and reading other devices or storage media. Further, an example of passive acquisition may be receiving information to be delivered (or transmitted, push notification, etc.). Further, "acquisition" may be to select and acquire the received data or information, or to select and receive the delivered data or information.
[0021]
(First Embodiment)

FIG. 1 is a diagram showing a functional configuration example of the gate system 1 according to the embodiment. FIG. 2 is a diagram schematically showing an outline of the gate system 1 according to the embodiment.
The gate system 1 includes a gate device 100 and a face recognition device 50. The gate device 100 includes a housing 14 and a camera unit 20. The gate device 100 functionally includes an image pickup unit 102 and a transmission unit 104.
[0022]
The face recognition device 50 is connected to the gate device 100 via the communication network 3. The face recognition device 50 performs authentication processing of the person by collating the feature amount of the face image of the person registered in advance with the feature amount extracted from the face image acquired by the gate device 100.
[0023]
The face authentication device 50 gates the identification information for identifying the person in the captured image when collating the feature amount of the face image of the person in the captured image with the feature amount of the face image of the person registered in advance. It may be obtained from 100 and collated with the registered feature amount of the person of the identification information. The gate device 100 uses a reading device (not shown) to read identification information that identifies a person from, for example, a boarding pass, a passport, or the like, and the transmitting unit 104 associates the identification information with the image captured by the imaging unit 102 with the face authentication device 50. May be sent to. By doing so, the time required for the authentication process can be shortened, and the processing load of the face recognition device 50 can also be reduced.
[0024]
In the present embodiment, the face authentication device 50 performs the authentication process using the face image of the person, but the authentication process may be performed by another authentication device using the biometric authentication information. The biometric information includes, for example, at least one feature quantity such as an iris, a vein, auricle, a fingerprint, a gait, and a profile (height, shoulder width, height, skeleton, etc.). The authentication device extracts the feature amount of the biometric authentication information from the image captured by the image pickup unit 102 and performs the authentication process.
[0025]
In the face recognition device 50, the authentication process may be repeated until the accuracy of the authentication result becomes equal to or higher than the threshold value using the plurality of images or the plurality of frames transmitted by the transmission unit 104. However, since the image captured when a person is passing through the passage 12 is used for the authentication process, it is preferable to set a limit on the number of times or the time for redoing the authentication process.
[0026]
The gate device 100 of the gate system 1 of the present embodiment is installed, for example, at the boarding gate of an airport or in front of a security checkpoint. It may be installed at the entrance / exit to the space that manages the people who enter / exit. Alternatively, it can be installed as a gate of a payment terminal combined with a payment terminal for cashless payment in a store or the like. Alternatively, it may be installed as an entrance / exit gate of an unmanned store without a clerk.
[0027]

As shown in FIG. 1, the gate device 100 includes an image pickup unit 102, a half mirror 40, and a transmission unit 104. The imaging unit 102 is provided on the side of the passage 12, and images a person who enters the passage 12 with the imaging direction D2 facing diagonally with respect to the traveling direction D1 when the person passes through the passage 12. The half mirror 40 is provided in front of the image pickup unit 102 in the image pickup direction D2 of the image pickup unit 102. The transmission unit 104 transmits the image captured by the image pickup unit 102 to the authentication device (face recognition device 50 in this embodiment).
[0028]
FIG. 3 is a plan view of the gate device 100 as viewed from above. The housing 14 has a predetermined height and extends over a predetermined distance along a passage 12 through which a person passes. Two housings 14 are installed side by side along the aisle 12 at a predetermined distance on both sides of the aisle 12.There is. Preferably the two housings 14 are installed in parallel. A set of housings 14 constitutes one gate device 100 with these two. A plurality of gate devices 100 may be installed side by side at an entrance / exit to a space where entry / exit control of a person is required.
[0029]
As described above, the gate device 100 of the present embodiment is assumed to be installed in a limited space of an existing facility, for example. Therefore, the length of the housing 14 in the passage 12 direction (predetermined distance described above) can be made shorter than that of a general face recognition gate of 2 to 3 meters. The length of the housing 14 in the passage 12 direction is, for example, 1.5 meters, the width of the passage 12 is, for example, 75 to 90 cm, and the distance to the opening / closing flap door 16 is, for example, 96 cm (one and a half steps of the stride of an adult male). Equivalent).
[0030]
The camera unit 20 is installed on the upper part of the housing 14. The upper part of the housing 14 is, for example, the upper surface 14a of the housing 14. However, the camera unit 20 may be above the housing 14, and may not necessarily be the upper surface 14a of the housing 14. It does not have to be integrated with the housing 14, and may be another structure such as a cabinet that holds the camera unit 20 on the upper part of the housing 14.
[0031]
The camera unit 20 accommodating the image pickup unit 102 is provided on the side of the passage 12, and the image pickup direction D2 of the image pickup unit 102 faces the passage 12 diagonally with respect to the traveling direction D1 when a person passes through the passage 12. Image the person entering the area. As a result, the image pickup unit 102 can capture and image a person passing through the passage 12 toward the traveling direction D1 from diagonally forward. Specifically, the angle θ at which the traveling direction D1 (the direction parallel to the side surface 14b on the passage 12 side of the housing 14) and the imaging direction D2 (the optical axis of the camera 5) intersect is 30 ° or more and 60 ° or less. Further, by setting the angle, a person other than the person (authentication target person) passing through the passage 12 toward the traveling direction D1, for example, a person lined up behind the authentication target person to wait for the turn of passing through the gate, etc. are imaged. It is possible to eliminate the reflection in the image.
[0032]
The entrance 12a side of the passage 12 is open. An opening / closing flap door 16 is provided on the exit 12b side of the passage 12 so as to be openable / closable. In the example of this figure, two opening / closing flap doors 16 are provided, and each of them is rotatably installed on the side surface 14b on the passage 12 side of the housing 14 at one end. In another example, one opening / closing flap door 16 may be rotatably installed on the passage 12 side side surface 14b of either housing 14. In this example, the opening / closing flap door 16 is on the outlet 12b side of the housing 14 so that the one end surface 16b of the opening / closing flap door 16 does not protrude from the one end surface 14c on the outlet side of the housing 14 when the opening / closing flap door 16 is opened. It is installed flush with one end surface 14c or inside the one end surface 14c. Instead of the opening / closing flap door 16, a sliding door may be provided on the end surface 14c.
[0033]
A part of the side surface 14b on the passage 12 side of the housing 14 has a convex portion 15 protruding toward the passage 12. The camera unit 20 is installed so that the end portion 22a of the housing 22 of the camera unit 20 on the passage 12 side is located on the convex portion 15 of the housing 14. In other words, the portion of the upper surface 14a of the housing 14 that overlaps with the end portion 22a of the housing 22 of the camera unit 20 projects toward the passage 12. The portion of the housing 14 protruding toward the side surface 14b on the passage 12 side may include, for example, the rotating shaft 17 of the opening / closing flap door 16.
[0034]
By installing the end portion 22a of the camera unit 20 on the convex portion 15, the angle formed by the imaging direction D2 with respect to the traveling direction D1 becomes an acute angle. That is, it is possible to take a picture of a person walking in the passage 12 from a direction closer to the front.
[0035]

FIG. 4 is a block diagram illustrating a hardware configuration of a computer 1000 that realizes the gate device 100 shown in FIG. The computer 1000 includes a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.
[0036]
The bus 1010 is a data transmission path for the processor 1020, the memory 1030, the storage device 1040, the input / output interface 1050, and the network interface 1060 to transmit and receive data to and from each other. However, the method of connecting the processors 1020 and the like to each other is not limited to the bus connection.
[0037]
The processor 1020 is a processor realized by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.
[0038]
The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.
[0039]
The storage device 1040 is an auxiliary storage device realized by an HDD (Hard Disk Drive), an SSD (Solid State Drive), a memory card, a ROM (Read Only Memory), or the like. The storage device 1040 stores a program module that realizes each function of the gate device 100 (for example, an image pickup unit 102, a transmission unit 104, an image pickup control unit 112 described later, an open / close control unit 114, a display control unit 126, and the like). When the processor 1020 reads each of these program modules into the memory 1030 and executes them, each function corresponding to the program module is realized. The storage device 1040 also functions as various storage units.
[0040]
The program module may be recorded on a recording medium. The recording medium for recording the program module includes a medium that can be used by the non-temporary tangible computer 1000, and the program code readable by the computer 1000 (processor 1020) may be embedded in the medium.
[0041]
The input / output interface 1050 is an interface for connecting the computer 1000 and various input / output devices.
[0042]
The network interface 1060 is an interface for connecting the computer 1000 to the communication network 3. The communication network 3 is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). The method of connecting the network interface 1060 to the communication network 3 may be a wireless connection or a wired connection. However, the network interface 1060 may not be used.
[0043]
Then, the computer 1000 is connected to necessary devices (for example, the face recognition device 50, the camera 5, the display 7, and the speaker (not shown)) via the input / output interface 1050 or the network interface 1060.
[0044]

FIG. 5 is a flowchart showing an operation example of the gate device 100 of the present embodiment. First, the imaging unit 102 images a person passing through the passage 12 (step S101). As described above, the half mirror 40 of the camera unit 20 is provided in front of the image pickup unit 102 in the image pickup direction D2 of the image pickup unit 102, and the image pickup unit 102 is used when a person passes through the passage 12. A person who enters the passage 12 with the imaging direction D2 facing diagonally with respect to the traveling direction D1 is imaged. Therefore, the half mirror 40 shows a person who has entered the gate and is passing through the passage 12, and the person can see the image. Therefore, the person naturally looks at himself / herself reflected in the half mirror 40. It will be directed. In that state, the imaging unit 102 can image a person passing through the passage 12. Then, the transmission unit 104 transmits the captured image of the person to the face recognition device 50 (step S103).
[0045]
The timing of starting this flow is, for example, the timing of imaging by the imaging unit 102 described in the embodiment described later.
[0046]
Although not shown in this embodiment, the face authentication device 50 performs an authentication process, the authentication result is returned to the gate device 100, and the gate device 100 controls the opening / closing of the opening / closing flap door 16 based on the authentication result. The opening / closing control of the opening / closing flap door 16 will be described in the second embodiment.
[0047]
As described above, in the present embodiment, the half mirror 40 of the camera unit 20 is provided in front of the image pickup unit 102 in the image pickup direction D2 of the image pickup unit 102, and a person passes through the image pickup unit 102. A person who enters the passage 12 with the imaging direction D2 diagonally facing the traveling direction D1 when passing through 12 is imaged. Therefore, the half mirror 40 shows a person who has entered the gate and is passing through the passage 12, and the person can see the image. Therefore, the person naturally looks at himself / herself reflected in the half mirror 40. It will be directed. As a result, it is possible to increase the possibility that the person to be authenticated faces the image pickup unit 102. In that state, the imaging unit 102 can image a person passing through the passage 12.
[0048]
Therefore, according to the present embodiment, it is possible to capture the face of a person passing through the passage 12 from the front in the image captured by the imaging unit 102. This makes the image quality suitable for the authentication process. Therefore, the authentication accuracy by the face recognition device 50 is improved, the authentication process and the re-shooting of shooting can be reduced, and the time required for authentication can be shortened. Further, even if the length of the traveling direction D1 of the passage 12 of the housing 14 is short, the authentication process can be completed accurately. That is, even when the installation location of the gate device 100 is relatively small, it is possible to maintain the authentication accuracy of the person.
[0049]
(Second Embodiment)
The gate device 100 of the present embodiment is the same as the above embodiment except that the opening / closing flap door 16 of the gate device 100 is controlled to open / close based on the authentication result of the face recognition device 50.

[0050]
FIG. 6 is a front view of the inside of the camera unit 20 from which the half mirror 40 is removed. The camera unit 20 may have a display 7 in the center of the front surface of the housing 22. The display 7 is, for example, a liquid crystal display, an organic EL (Electro-Luminescence) display, or the like. The display 7 is preferably arranged at the height of the line of sight of a person passing through the passage 12. For example, the height to be installed may be determined from the average height of an adult. The camera unit 20 accommodates two cameras 5 provided above and below the display 7 as an image pickup unit 102. The display 7 will be described in the embodiment described later.
[0051]
The camera 5 includes an image sensor such as a lens and a CCD (Charge Coupled Device) image sensor, and is a network camera such as an IP (Internet Protocol) camera, for example. The network camera has, for example, a wireless LAN (Local Area Network) communication function, and is connected to the face recognition device 50 via a relay device (not shown) such as a router of the communication network 3. The camera 5 may be provided with a mechanism for controlling the orientation of the camera body and the lens, zooming, focusing, and the like in accordance with the movement of the person reflected on the half mirror 40.
[0052]
It is preferable that the image generated by the camera 5 is taken in real time and transmitted to the face recognition device 50 by the transmission unit 104. However, the image transmitted by the transmission unit 104 to the face recognition device 50 does not have to be directly transmitted from the camera 5, and may be an image delayed by a predetermined time. The image captured by the camera 5 may be temporarily stored in another storage device, and the face recognition device 50 may read the image from the storage device sequentially or at predetermined intervals. Further, the image transmitted to the face recognition device 50 is preferably a moving image, but may be a frame image at predetermined intervals or a still image.
[0053]
FIG. 7 is a functional block showing a functional configuration example of the gate device 100 of the present embodiment.It is a figure. The gate device 100 includes an open / close control unit 114 and a gate drive unit 116 in addition to the image pickup unit 102 and the transmission unit 104 of the gate device 100 of the above embodiment of FIG.
[0054]
The image pickup unit 102 has two cameras 5 and an image pickup control unit 112. The image pickup control unit 112 causes the camera 5 to capture a person image, acquires the image of the person captured by the camera 5, and delivers it to the transmission unit 104.
[0055]
The open / close control unit 114 controls the open / close of the open / close flap door 16 based on the authentication result of the face recognition device 50, for example. However, the opening / closing condition of the opening / closing flap door 16 may be other than the authentication result of the face recognition device 50. The opening / closing condition may be, for example, acceptance of an opening / closing operation by a person in an emergency. The opening / closing control unit 114 may perform forced opening control or forced closing control of the opening / closing flap door 16 according to a person's opening / closing operation.
[0056]
The opening / closing flap door 16 has a case where the normal position is the open position and a case where the normal position is the closed position. When the normal position is the open position, when the face recognition by the human face recognition device 50 is successful, the open / close control unit 114 does not control the open / close of the open / close flap door 16 and is in the open position so that the person can pass through the passage 12. Will remain. If the face recognition fails, the open / close control unit 114 controls the open / close so that a person cannot pass through the passage 12, and the open / close flap door 16 is changed from the open position to the closed position.
[0057]
When the normal position is the closed position, if the face authentication is successful, the open / close control unit 114 controls the open / close so that a person can pass through the passage 12, and the open / close flap door 16 is changed from the closed position to the open position. If the face recognition fails, the open / close control unit 114 does not control the open / close of the open / close flap door 16 and remains in the closed position so that a person cannot pass through the passage 12.
[0058]
FIG. 8 is a flowchart showing an operation example of the gate system 1 of the present embodiment. FIG. 8 starts when the image transmitted from the gate device 100 is received in step S103 of FIG. 5 of the above embodiment.
[0059]
When the face recognition device 50 receives an image, it performs an authentication process (step S501). Then, when the authentication result by the face recognition device 50 is successful (YES in step S503), the open / close control unit 114 instructs the gate drive unit 116 to open the open / close flap door 16 (step S505). If face recognition by the face recognition device 50 fails (NO in step S503), step S505 is bypassed and the open / close flap door 16 remains closed. It should be noted that various processes after the authentication process fails in step S503 can be considered, and the process is not limited to this. For example, a notification may be output to the nearest staff member, or only recording may be performed, and the opening / closing flap door 16 may be opened to pass through the gate.
[0060]
According to the present embodiment, the same effect as that of the above embodiment can be obtained, and the opening / closing control of the opening / closing flap door 16 can be performed based on the authentication result by the face recognition device 50. As described above, since the opening / closing flap door 16 can be controlled to open / close by using the authentication result with high authentication accuracy by the face recognition device 50, the residence time in the gate of a passing person due to erroneous recognition can be reduced, and the residence time around the gate can be reduced. It reduces congestion and improves security.
[0061]
(Third Embodiment)

FIG. 9 is a functional block diagram showing a logical configuration example of the gate device 100 of the present embodiment. The gate device 100 of the present embodiment is the same as any one of the above embodiments except that it has a configuration for detecting the entry of a person into the passage 12. In the example of this figure, the gate device 100 further includes a detection unit 122 in addition to the configuration of the gate device 100 of FIG. However, the detection unit 122 may be combined with the configuration of the gate device 100 of FIG.
[0062]
The detection unit 122 is provided in the housing 14 and detects the entry of a person into the passage 12. The image pickup unit 102 operates at a timing based on the detection result of the detection unit 122.
[0063]

FIG. 10 shows a side view of the gate device 100 of the present embodiment as viewed from the passage 12 side. The detection unit 122 includes at least one motion sensor 18a and at least one approach sensor 18b. A plurality of motion sensors 18a are provided in the upper region 14e of the passage 12 side side surface 14b of the housing 14. In this example, 10 motion sensors 18a are arranged in the region 14e at substantially equal intervals.
[0064]
The motion sensor 18a is, for example, a light source reflection method such as infrared rays, a microwave method, or the like, and detects the presence of a person. The type and installation position of the motion sensor 18a and the number of installations are not limited thereto. In this example, the motion sensor 18a is a transmission type infrared sensor. Similarly, they are installed in the upper region 14e of the passage 12 side side surface 14b of the other housing 14 facing each other at positions facing the motion sensor 18a of the one housing 14. One motion sensor 18a transmits infrared rays, and the other motion sensor 18a receives infrared rays.
[0065]
By using the plurality of motion sensors 18a, the detection unit 122 can identify the position where the person exists in the traveling direction in the passage 12. The motion sensor 18a can detect the entry or tailgating of a person into the passage 12. However, the motion sensor 18a may be other than the infrared sensor. For example, it may be a sensor that detects the load transfer of a person by a piezoelectric element installed on the floor surface of the passing passage 12. Further, a plurality of motion sensors may be combined.
[0066]
Further, the approach sensor 18b of the detection unit 122 detects the entry of a person into the passage 12. As the approach sensor 18b, for example, a reflection type infrared sensor can be used. The detection range of the infrared sensor is the range shown by the broken line in the figure, and is set so as to extend from the length L1 in the traveling direction of the passage 12 of the housing 14 to the front side 14d of the housing 14 by a predetermined distance L2. Is preferable. That is, it is possible to detect a person who is located in front of the housing 14 by a distance L2. For example, the predetermined distance L2 is 30 cm to 60 cm. The detection range of the approach sensor 18b may be appropriately set according to the installation location of the gate device 100. For example, when many people pass through the gate device, if the detection range is widened, even the next person in line will be detected. Therefore, the distance L2 is set short.
[0067]
The image pickup control unit 112 controls the image pickup timing of the image pickup unit 102 based on the detection results of the approach sensor 18b and the plurality of motion sensors 18a. Specifically, the imaging timing by the imaging unit 102 is exemplified below, but is not limited thereto.
(A1) Based on the detection results of the plurality of motion sensors 18a, the position of the person in the passage 12 is specified, and the person is imaged when the person is present at a position suitable for the image pickup position by the image pickup unit 102.
(A2) When the approach sensor 18b detects the entry of a person into the detection range of the approach sensor 18b, the image pickup unit 102 starts imaging, and based on the detection results of the plurality of motion sensors 18a, the image pickup unit 102 in the passage 12. The position of the person is specified, and an image frame when the person is present at a position suitable for the image pickup position by the image pickup unit 102 is selected from the captured images.
However, even in the case of (a1), the image pickup unit 102 may constantly perform image pickup, and the image pickup unit 102 may perform an image pickup of a person in the passage 12 based on the detection results of the plurality of motion sensors 18a. The position may be specified, and an image frame when a person is present at a position suitable for the image pickup position by the image pickup unit 102 may be selected.
[0068]
If the detection range of the approach sensor 18b is set to extend beyond the housing 14 and a person existing in front of the housing 14 can be detected, before the person enters the passage 12. Imaging can be started. This makes it possible to perform face recognition without actively stopping the person to be authenticated in front of the image pickup unit 102. In addition, for example, when performing a security check using face recognition at a security checkpoint at an airport, it is assumed that there is a limit to the equipment installation space at the existing airport. By extending the detection range of the approach sensor 18b to the area on the front side of the passage of the housing 14, it is possible to detect a person before entering the gate device 10, so that the space of the gate device 10 is saved (that is, L1 is shortened). ) Is possible.
[0069]
It should be noted that, for example, a camera icon or a photographed face image of the person to be authenticated can be displayed on the display 7 at the timing of starting imaging. As a result, the person to be authenticated can recognize that he / she is being photographed.
[0070]

FIG. 11 is a flowchart showing an operation example of the gate system 1 of the present embodiment. An operation example according to the image pickup timing of the above (a1) is shown in FIG. 11 (a), and an operation example according to the image pickup timing of the above (a2) is shown in FIG. 11 (b).
[0071]
First, an operation example based on the imaging timing of the above (a1) will be described with reference to FIG. 11 (a). The detection unit 122 identifies the position of a person in the passage 12 based on the detection results of the plurality of motion sensors 18a, and detects that the person is present at a position suitable for the image pickup position by the image pickup unit 102 (step). S201). When the detection unit 122 detects a person, the image pickup unit 102 captures a person (step S203). Then, the captured image is transmitted to the face recognition device 50 by the transmission unit 104 (not shown), and the face recognition device 50 performs an authentication process based on the received captured image (step S205).
[0072]
Next, an operation example based on the imaging timing of the above (a2) will be described with reference to FIG. 11 (b). The detection unit 122 detects the entry of a person into the gate device based on the detection result of the approach sensor 18b (step S211). The image pickup unit 102 starts shooting when the detection unit 122 detects a person (step S213).
[0073]
Then, when a person advances through the passage 12, the detection unit 122 identifies the position of the person in the passage 12 based on the detection results of the plurality of motion sensors 18a, and makes the position suitable for the image pickup position by the image pickup unit 102. Detects the presence of a person (step S215). When the detection unit 122 detects that a person is present at the imaging position, the transmission unit 104 receives a frame at the timing when it is detected that the person is present at the imaging position from the images (frames) captured by the imaging unit 102. Is selected and transmitted to the face recognition device 50 (step S217). Then, the face recognition device 50 performs an authentication process based on the received captured image (step S205).
[0074]
As described above, according to the present embodiment, the same effect as that of the first embodiment is obtained, and the image pickup timing of the image pickup unit 102 is controlled according to the result of detecting the entry of a person into the gate. It becomes possible to image a person who exists at a position where an captured image suitable for the authentication process can be obtained. Therefore, an image with high authentication accuracy can be captured, and the authentication accuracy by the face recognition device 50 can be improved. Therefore, it is possible to reduce the residence time in the gate of a passing person due to erroneous recognition, alleviate the congestion around the gate, and improve the security.
[0075]
(Fourth Embodiment)

FIG. 12 is a functional block diagram showing a logical configuration example of the gate device 100 of the present embodiment. The gate device 100 of the present embodiment is the same as that of the third embodiment except that it has a light emitting means that emits light at a timing based on the detection result of the detection unit 122 of the third embodiment. However, the gate device 100 of the present embodiment may be combined with a configuration in which the detection unit 122 is added to the configuration of the first embodiment.
[0076]
The gate device 100 is located at least a part around the half mirror 40, and further includes a light emitting unit 124 that emits light at a timing based on the detection result of the detection unit 122.
[0077]
FIG. 13 is a front view of the inside of the camera unit 20 from which the half mirror 40 is removed. In addition to the camera unit 20 of FIG. 6, a plurality of LEDs (Light Emitting Diodes) 30 are further arranged at corresponding positions around the half mirror 40.
[0078]
The light emitting unit 124 controls lighting, extinguishing, or blinking of the LED 30. Or the LED is different In the case of a configuration that emits a certain color, the color to be emitted may be controlled. In the example of FIG. 13, a plurality of LEDs are arranged side by side on both side edges of the half mirror 40. The light emitting unit 124 preferably emits light toward at least the passage 12 side.
[0079]
The light emission of the LEDs 30 arranged around the half mirror 40 can first direct the line of sight of the person to be authenticated to the half mirror 40 (that is, the imaging unit 102). Secondly, the light emission of the LED 30 can efficiently illuminate the image pickup target area such as the face of a person existing in the passage 12, so that the quality of the captured image can be improved. Depending on the installation location of the gate device 100, even when the face of a person is backlit, the face of the person can be illuminated with light, so that the quality of the captured image can be improved. That is, the authentication accuracy using the image can be improved.
[0080] [0080]
The light emitting unit 124 can control the lighting of the LED 30 according to the above purpose. For example, when the purpose is to direct the line of sight of the person to be authenticated to the half mirror 40, the light emitting unit 124 blinks the LED 30 when the approach sensor 18b of the detection unit 122 detects the entry of the person. , Control to move the lighting positions of a plurality of LEDs. As a result, there is a high possibility that a person who has entered the gate will look at the half mirror 40, and there is a high possibility that an image suitable for the authentication process will be obtained.
[0081]
Further, for the purpose of shining light on the image pickup target area, the light emitting unit 124 determines the position in the passage 12 where a person exists in the traveling direction based on the detection result of the motion sensor 18a of the detection unit 122. The LED 30 may be made to emit light when a person is present at a position suitable for the image pickup position by the image pickup unit 102, that is, at the above-mentioned shooting timing. As a result, even when the face of the person in the gate is not exposed to the light, the face of the person can be irradiated with the light, so that the quality of the captured image can be improved. In addition to the above timing, the LED 30 can be made to emit light when the face size and the eye-to-eye distance of the person to be authenticated satisfy the predetermined criteria in the image captured by the imaging unit 102.
[0082]
Further, the gate device 100 of the present embodiment has a display control unit 126. As described above, a display 7 is provided on the back surface of the half mirror 40. The display control unit 126 controls the screen display on the display 7.
[0083]
FIG. 14 is a front view of the camera unit 20 to which the half mirror 40 is attached.
A half mirror 40 is provided on one side of the camera unit 20. The half mirror 40 is installed with the mirror surface facing the outside of the camera unit 20. A mirror film is not formed in the region inside the broken line 40a corresponding to the front surface of the lens of the camera 5 provided inside the camera unit 20.
[0084]
Specifically, the transmittance of the half mirror 40 is 100% in the region inside the broken line 40a, 30 to 10% in the other regions, and more preferably 20%. As a result, the image of the person existing in front of the camera unit 20 is reflected on the half mirror 40, so that the person existing in front of the camera unit 20 can see his / her own image reflected on the half mirror 40. Further, the image displayed on the display 7 installed on the back surface of the half mirror 40 can also be seen by a person existing in front of the camera unit 20 through the half mirror 40.
[0085]
The display control unit 126 displays on the display 7 a message 70 that guides the line of sight of a person passing through the gate toward the half mirror 40 (camera 5), ​​for example, "Do you want to display face recognition?". Let me.
[0086]
According to the present embodiment, when the configuration is similar to that of at least one of the above-described embodiments, the same effect as that of the corresponding embodiment is obtained, and further, the detection of detecting the entry of a person into the passage 12 is performed. Since the imaging timing of the imaging unit 102 and the light emitting timing of the light emitting unit 124 are controlled based on the detection result of the unit 122, the quality of the captured image used for the authentication process can be improved.
[0087]
Further, since the display 7 can be displayed so that the line of sight of the person passing by is directed to the half mirror 40 (imaging unit 102), the face of the person can be imaged from the front. As a result, an image with high authentication accuracy can be captured, and the authentication accuracy by the face recognition device 50 can be improved. Therefore, it is possible to reduce the residence time in the gate of a passing person due to erroneous recognition, alleviate the congestion around the gate, and improve the security.
[0088]
Although the embodiments of the present invention have been described above with reference to the drawings, these are examples of the present invention, and various configurations other than the above can be adopted.
For example, in the above-described embodiment, the gate device having the housing 14 on both sides of the passage 12 has been described, but the gate device 10 having the housing 14 on one side of the passage 12 can also be used.
[0089]
Although the invention of the present application has been described above with reference to the embodiments and examples, the invention of the present application is not limited to the above embodiments and examples. Various changes that can be understood by those skilled in the art can be made within the scope of the present invention in terms of the configuration and details of the present invention.
In the present invention, when information about a user is acquired and used, this shall be done legally.
[0090]
A part or all of the above embodiment may be described as in the following appendix, but is not limited to the following.
1. 1. An imaging means provided on the side of the aisle, in which the imaging direction is diagonal to the traveling direction when the person passes through the aisle, and the person entering the aisle is imaged.
A half mirror provided in front of the imaging means in the imaging direction of the imaging means, and
A gate device including a transmission means for transmitting an image captured by the image pickup means to an authentication device.
2. 2. 1. In the gate device described in
The housing provided on the side of the passage and
Further provided with a detection means provided in the housing to detect the entry of a person into the passage,
The image pickup means is a gate device that operates at a timing based on the detection result of the detection means.
3. 3. 2. In the gate device described in
A gate device that is located at least a part around the half mirror and further includes a light emitting means that emits light at the timing based on the detection result of the detecting means.
4. 2. Or 3. In the gate device described in
The image pickup means is a gate device installed on the upper part of the housing.
5. 4. In the gate device described in
A gate device that accommodates the imaging means and further includes a second housing having the half mirror on one surface.
6. 5. In the gate device described in
A part of the side surface of the housing on the aisle side protrudes toward the aisle side.
The end of the second housing on the passage side is a gate device located at the protruding portion of the housing.
7. 6. In the gate device described in
The protruding part of the housing is a gate device with a built-in flapper rotation axis.
8. 6. Or 7. In the gate device described in
A gate device further provided with a display means provided on the back surface of the half mirror.
9. 8. In the gate device described in
A gate device with a transmittance of 20% or more for the half mirror.
10. 1. From 9. In the gate device according to any one of
A gate device in which the film of the half mirror is not formed in front of the lens of the imaging means.
[0091]
11. An imaging means provided on the side of the aisle, in which the imaging direction is diagonal to the traveling direction when the person passes through the aisle, and the person entering the aisle is imaged.
A method for controlling a gate device including a half mirror provided in front of the imaging means in the imaging direction of the imaging means.
The gate device is
The image pickup means was used to image a person passing through the passage.
A control method for transmitting an image captured by the imaging means to an authentication device.
12. 11. In the control method described in
The gate device provided with a housing provided on the side of the passage
Using the detection means provided in the housing, the entry of a person into the passage was detected.
A control method in which the image pickup means is operated at a timing based on the detection result of the invasion of the person.
13. 12. In the control method described in
The gate device is
A control method in which a light emitting means located at least a part around the half mirror is made to emit light at the timing based on the detection result.
14. 12. Or 13. In the control method described in
The image pickup means is a control method installed on the upper part of the housing.
15. 14. In the control method described in
A control method in which the gate device accommodates the imaging means and further includes a second housing having the half mirror on one surface.
16. 15. In the control method described in
A part of the side surface of the housing on the aisle side protrudes toward the aisle side.
A control method in which the end portion of the second housing on the passage side is located at the protruding portion on the housing.
17. 16. In the control method described in
The protruding part of the housing has a built-in flapper rotation axis, a control method.
18. 16. Or 17. In the control method described in
The gate device is a control method further comprising a display means provided on the back surface of the half mirror.
19. 18. In the control method described in
A control method in which the transmittance of the half mirror is 20% or more.
20. 11. From 19. In the control method described in any one of
A control method in which the film of the half mirror is not formed in front of the lens of the imaging means.
[0092]
21. An imaging means provided on the side of the aisle, in which the imaging direction is diagonal to the traveling direction when the person passes through the aisle, and the person entering the aisle is imaged.
A computer that realizes a gate device including a half mirror provided in front of the imaging means in the imaging direction of the imaging means.
Procedure for imaging a person passing through the passage by the imaging means,
A program for executing a procedure of transmitting an image captured by the imaging means to an authentication device.
22. 21. In the program described in
The gate device is
The housing provided on the side of the passage and
Further provided with a detection means provided in the housing to detect the entry of a person into the passage,
Procedure for detecting the entry of a person into the passage using the detection means,
A program for causing a computer to execute a procedure for causing the image pickup means to operate at a timing based on the detection result of the detection means.
23. 22. In the program described in
The gate device is
Further equipped with light emitting means located at least a part around the half mirror,
A program for causing a computer to execute a procedure for causing the light emitting means to emit light at the timing based on the detection result of the detecting means.
24. 22. Or 23. In the program described in
The imaging means is a program installed on the upper part of the housing.
25. 24. In the program described in
The gate device is a program that accommodates the imaging means and further includes a second housing having the half mirror on one surface.
26. 25. In the program described in
A part of the side surface of the housing on the aisle side protrudes toward the aisle side.
A program in which the end of the second housing on the aisle side is located at the protruding portion on the housing.
27. 26. In the program described in
The protruding part of the housing is a program that incorporates the rotation axis of the flapper.
28. 26. Or 27. In the program described in
The gate device is a program further comprising a display means provided on the back surface of the half mirror.
29. 28. In the program described in
A program in which the transmittance of the half mirror is 20% or more.
30.21. From 29. In the program described in any one of
A program in which the film of the half mirror is not formed in front of the lens of the imaging means.
The scope of the claims
[Claim 1]
An imaging means provided on the side of the aisle, in which the imaging direction is diagonal to the traveling direction when the person passes through the aisle, and the person entering the aisle is imaged.
A half mirror provided in front of the imaging means in the imaging direction of the imaging means, and
A gate device including a transmission means for transmitting an image captured by the image pickup means to an authentication device.
[Claim 2]
In the gate device according to claim 1,
The housing provided on the side of the passage and
Further provided with a detection means provided in the housing to detect the entry of a person into the passage,
The image pickup means is a gate device that operates at a timing based on the detection result of the detection means.
[Claim 3]
In the gate device according to claim 2,
A gate device that is located at least a part around the half mirror and further includes a light emitting means that emits light at the timing based on the detection result of the detecting means.
[Claim 4]
In the gate device according to claim 2 or 3,
The image pickup means is a gate device installed on the upper part of the housing.
[Claim 5]
In the gate device according to claim 4,
A gate device that accommodates the imaging means and further includes a second housing having the half mirror on one surface.
[Claim 6]
In the gate device according to claim 5,
A part of the side surface of the housing on the aisle side protrudes toward the aisle side.
The end of the second housing on the passage side is a gate device located at the protruding portion of the housing.
[Claim 7]
In the gate device according to claim 6,
The protruding part of the housing is a gate device with a built-in flapper rotation axis.
[Claim 8]
In the gate device according to claim 6 or 7.
A gate device further provided with a display means provided on the back surface of the half mirror.
[Claim 9]
In the gate device according to claim 8,
A gate device with a transmittance of 20% or more for the half mirror.
[Claim 10]
In the gate device according to any one of claims 1 to 9,
A gate device in which the film of the half mirror is not formed in front of the lens of the imaging means.
[Claim 11]
An imaging means provided on the side of the aisle, in which the imaging direction is diagonal to the traveling direction when the person passes through the aisle, and the person entering the aisle is imaged.
A method for controlling a gate device including a half mirror provided in front of the imaging means in the imaging direction of the imaging means.
The gate device is
The image pickup means was used to image a person passing through the passage.
A control method for transmitting an image captured by the imaging means to an authentication device.
[Claim 12]
In the control method according to claim 11,
The gate device provided with a housing provided on the side of the passage
Using the detection means provided in the housing, the entry of a person into the passage was detected.
A control method in which the image pickup means is operated at a timing based on the detection result of the invasion of the person.
[Claim 13]
In the control method according to claim 12,
The gate device is
A control method in which a light emitting means located at least a part around the half mirror is made to emit light at the timing based on the detection result.
[Claim 14]
In the control method according to claim 12 or 13,
The image pickup means is a control method installed on the upper part of the housing.
[Claim 15]
In the control method according to claim 14,
A control method in which the gate device accommodates the imaging means and further includes a second housing having the half mirror on one surface.
[Claim 16]
In the control method according to claim 15,
A part of the side surface of the housing on the aisle side protrudes toward the aisle side.
A control method in which the end portion of the second housing on the passage side is located at the protruding portion on the housing.
[Claim 17]
In the control method according to claim 16,
The protruding part of the housing has a built-in flapper rotation axis, a control method.
[Claim 18]
In the control method according to claim 16 or 17,
The gate device is a control method further comprising a display means provided on the back surface of the half mirror.
[Claim 19]
In the control method according to claim 18,
A control method in which the transmittance of the half mirror is 20% or more.
[Claim 20]
In the control method according to any one of claims 11 to 19,
A control method in which the film of the half mirror is not formed in front of the lens of the imaging means.
[Claim 21]
An imaging means provided on the side of the aisle, in which the imaging direction is diagonal to the traveling direction when the person passes through the aisle, and the person entering the aisle is imaged.
A computer that realizes a gate device including a half mirror provided in front of the imaging means in the imaging direction of the imaging means.
Procedure for imaging a person passing through the passage by the imaging means,
A program for executing a procedure of transmitting an image captured by the imaging means to an authentication device.
[Claim 22]
In the program according to claim 21,
The gate device is
The housing provided on the side of the passage and
Further provided with a detection means provided in the housing to detect the entry of a person into the passage,
Procedure for detecting the entry of a person into the passage using the detection means,
A program for causing a computer to execute a procedure for causing the image pickup means to operate at a timing based on the detection result of the detection means.
[Claim 23]
In the program according to claim 22,
The gate device is
Further equipped with light emitting means located at least a part around the half mirror,
A program for causing a computer to execute a procedure for causing the light emitting means to emit light at the timing based on the detection result of the detecting means.
[Claim 24]
In the program according to claim 22 or 23
The imaging means is a program installed on the upper part of the housing.
[Claim 25]
In the program according to claim 24
The gate device is a program that accommodates the imaging means and further includes a second housing having the half mirror on one surface.
[Claim 26]
In the program according to claim 25
A part of the side surface of the housing on the aisle side protrudes toward the aisle side.
A program in which the end of the second housing on the aisle side is located at the protruding portion on the housing.
[Claim 27]
In the program according to claim 26
The protruding part of the housing is a program that incorporates the rotation axis of the flapper.
[Claim 28]
In the program according to claim 26 or 27
The gate device is a program further comprising a display means provided on the back surface of the half mirror.
[Claim 29]
In the program according to claim 28
A program in which the transmittance of the half mirror is 20% or more.
[Claim 30]
In the program according to any one of claims 21 to 29,
A program in which the film of the half mirror is not formed in front of the lens of the imaging means.