Title of invention: Face authentication device, its control method and program, and face authentication gate device, its control method and program
Technical field
[0001]
The present invention relates to a face authentication device, its control method and program, and a face authentication gate device, its control method and program.
Background technology
[0002]
With advances in image recognition technology, in recent years, there has been progress in the practical use of authentication devices that use facial images of people when entering and exiting facilities that require security management, and various technologies have been proposed to improve the recognition accuracy. ing.
[0003]
Patent document 1 describes a backlight scene judgment based on the brightness of the face and the surrounding environment, strobe control, LED (Light Emitting Diode) lighting control, camera parameter control, and camera parameter control based on the scene judgment result. It is described that image correction is performed.
[0004]
Patent Document 2 describes selecting a pedestrian's face suitable for authentication by controlling camera parameters based on surrounding environment information at a gate through which a moving person passes.
prior art documents
patent literature
[0005]
Patent Document 1: JP-A-2008-35480
Patent document 2: JP-A-2007-148988
SUMMARY OF THE INVENTION
Problems to be Solved by the Invention
[0006]
In the above patent document, camera parameters are set based on the surrounding environment in order to improve face recognition performance. When trying to adapt to the surrounding environment by setting the parameters of the camera in this way, depending on the camera, it may take time to control the parameters, for example, to change the shutter speed or aperture relative to the speed of a person walking.
[0007]
The purpose of the present invention is to improve authentication accuracy by capturing a face image suitable for face authentication with a camera.
Means to solve problems
[0008]
Each aspect of the present invention employs the following configurations in order to solve the above-described problems.
[0009]
The first aspect relates to face authentication devices.
　The face authentication device according to the first aspect is
an image generating means for capturing a person and generating a first image;
a control means for controlling illumination and causing the image generating means to photograph the person again to generate a second image when the first image does not meet the criteria for face matching;
and face authentication means for performing face authentication using the first image or the second image.
[0010]
A second aspect relates to a method of controlling a face authentication device executed by at least one computer.
　The control method of the face authentication device according to the second aspect is
"The face authentication device
Take a picture of a person to generate the first image,
　When the first image does not meet the criteria for face matching, controlling the lighting and photographing the person again to generate a second image,
including performing face authentication using the first image or the second image.
[0011]
The third aspect relates to the face authentication gate device.
A face authentication gate device according to a third aspect performs face authentication using a first image or a second image generated by photographing a person passing through a gate by the face authentication device according to the first aspect. Gate opening/closing control means for controlling opening/closing of the gate through which the person passes by using the result.
[0012]
A fourth aspect relates to a method of controlling a face authentication gate device executed by at least one computer.
　The control method of the face authentication gate device according to the fourth aspect is
using a result of face authentication performed by the face authentication gate device using a first image or a second image generated by photographing a person passing through the gate with the face authentication device of the first side, controlling the opening and closing of the gate through which the person passes;
[0013]
In addition, as another aspect of the present invention, it may be a program that causes at least one computer to execute the method of the second aspect or the fourth aspect, or a computer-readable program recording such a program. Any recording medium may be used. This recording medium includes a non-transitory tangible medium.
This computer program includes computer program code that, when executed by a computer, causes the computer to implement the control method on the face authentication device or face authentication gate device.
[0014]
It should be noted that any combination of the above constituent elements, and any conversion of the expression of the present invention between methods, devices, systems, recording media, computer programs, etc. are also effective as embodiments of the present invention.
[0015]
In addition, the various constituent elements of the present invention do not necessarily have to exist independently of each other. A component may be part of another component, a part of a component may overlap a part of another component, and the like.
[0016]
In addition, although a plurality of procedures are described in order in the method and computer program of the present invention, the order of description does not limit the order of execution of the plurality of procedures. Therefore, when implementing the method and computer program of the present invention, the order of the plurality of procedures can be changed within a range that does not interfere with the content.
[0017]
Furthermore, the multiple procedures of the method and computer program of the present invention are not limited to being executed at different timings. Therefore, the occurrence of another procedure during the execution of a certain procedure, or the overlap of some or all of the execution timing of one procedure with the execution timing of another procedure, and the like are acceptable.
Effect of the invention
[0018]
According to the present invention, a face image suitable for face authentication can be captured by a camera to improve authentication accuracy.
Brief description of the drawing
[0019]
The above-mentioned objects, as well as other objects, features and advantages, will become further apparent from the preferred embodiments described below and the accompanying drawings below.
[0020]
1 is a diagram showing a conceptual configuration example of a face authentication gate system according to an embodiment; FIG.
2 is a top plan view of the face authentication gate system; FIG.
3 is a front view showing an example of a camera unit; FIG.
4 is a diagram showing a functional configuration example of the face authentication device according to the embodiment; FIG.
5 is a block diagram illustrating the hardware configuration of a computer that implements the face authentication device according to the embodiment; FIG.
6 is a flowchart showing an operation example of the face authentication device according to the embodiment; FIG.
7 is a diagram showing a functional configuration example of the face authentication gate device according to the embodiment; FIG.
8 is a flow chart showing an operation example of the gate opening/closing control section of the face authentication gate device according to the embodiment; [0027]FIG.
9 is a diagram showing a functional configuration example of the face authentication gate device according to the embodiment; FIG.
10 is a diagram for explaining a method of controlling the LED illumination section of the face authentication gate device according to the embodiment; FIG.
11 is a diagram for explaining a method of controlling the LED illumination section of the face authentication gate device according to the embodiment; FIG.
12 is a diagram showing a conceptual configuration example of the face authentication gate system according to the embodiment; FIG.
MODE FOR CARRYING OUT THE INVENTION
[0021]
Embodiments of the present invention will be described below with reference to the drawings. In addition, in all the drawings, the same constituent elements are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.
[0022]
In the embodiment, "acquisition" means that the own device goes to get data or information stored in another device or storage medium (active acquisition), and that the device is output from another device Including at least one of entering data or information (passive acquisition). Examples of active acquisition include requesting or interrogating other devices and receiving their replies, and accessing and reading other devices or storage media. Also, examples of passive acquisition include receiving information that is distributed (or sent, pushed, etc.). Furthermore, "acquisition" may be selecting and acquiring received data or information, or selecting and receiving distributed data or information.
[0023]
(First embodiment)

FIG. 1 is a diagram showing a conceptual configuration example of a face authentication gate system 1 according to an embodiment.
The face authentication gate system 1 includes a face authentication device 10 (not shown in FIG. 1), a housing 14, and a camera unit 20.
[0024]
The face authentication device 10 performs authentication processing of a person by matching the feature amount of the pre-registered person's face image with the feature amount extracted from the face image. However, the person authentication processing performed by the face authentication device 10 may be performed by matching using iris feature amounts other than face matching using facial feature amounts. Information on at least one of the features of a person's face and iris is linked to the user's identification information, for example, by registering in advance for use of this system (or, for example, an existing system such as an airport boarding procedure system). are registered in a database (not shown) or the like. Alternatively, the feature amount of at least one of the face and iris of a person included in a blacklist, whitelist, or the like may be registered in the database.
[0025]
The face authentication device 10 is implemented by a computer as described later, but the face authentication processing function may be implemented by a computer separate from the face authentication device 10, such as a cloud server. In that case, the face authentication device 10 functions as an image processing device (not shown). A computer that implements the face authentication device 10 or the image processing device may be included in the housing of the camera unit 20 or may be separate from the camera unit 20 .
[0026]
The face authentication device 10 (including the housing 14 and the camera unit 20) of the face authentication gate system 1 of this embodiment is installed, for example, at an airport boarding gate. It may be installed at an entrance/exit to a room for managing people who enter/exit. Alternatively, it can be installed as a gate for a payment terminal for cashless payment and a combination payment terminal in a store or the like. Alternatively, it may be installed as an entrance/exit gate of an unmanned store. In addition, the face authentication device 10 can be applied to a case where the light environment changes due to a change in the light environment depending on the installation location of the face authentication device 10 or a change in the outside light depending on the time zone.
[0027]
FIG. 2 is a plan view of the face authentication gate system 1 viewed from above. The enclosure 14 has a predetermined height and extends a predetermined distance along the passageway 12 in which people pass. Two housings 14 are arranged side by side along the passage 12 on both sides of the passage 12 with a predetermined gap therebetween. Preferably the two housings 14 are installed in parallel.
[0028]
The entrance 12a side of the passage 12 is open. An opening/closing flap door 16 is provided on the exit 12b side of the passage 12 so as to be able to be opened and closed. In the example of this figure, two open/close flap doors 16 are provided, each rotatably mounted at one end to the housing 14 . In another example, one open/close flap door 16 may be rotatably installed on one end side of one of the housings 14 . In this example, when the flap door 16 is opened, the opening/closing flap door 16 is designed so that the one end surface 16a and 16b of the opening/closing flap door 16 does not protrude from the one end surface 14a of the housing 14 on the exit side. It is installed flush with the one end face 14a on the 12b side or inside the one end face 14a.
[0029]
The opening/closing control of the opening/closing flap door 16 is performed according to the authentication result of the face authentication device 10, for example. The opening/closing flap door 16 has a case where the normal position is the open position and a case where the normal position is the closed position. When the normal position is the open position, when the person's face authentication device 10 succeeds in face authentication, the open/close flap door 16 is not controlled to open and close, and remains in the open position so that the person can pass through the passage 12.例文帳に追加When face authentication fails, opening/closing control is performed so that a person cannot pass through the passage 12, and the opening/closing flap door 16 is changed from the open position to the closed position.
[0030]
When the normal position is the closed position, if face authentication is successful, opening/closing control is performed so that a person can pass through the passage 12, and the opening/closing flap door 16 is changed from the closed position to the open position. facial recognition If the opening/closing flap door 16 fails, the opening/closing flap door 16 is not controlled and remains in the closed position so that a person cannot pass through the passage 12.例文帳に追加
[0031]
3 is a front view showing an example of the camera unit 20. FIG.
A display section 7 and cameras 5 above and below the display section 7 are provided on the front surface of the camera unit 20 . Furthermore, on both sides of the display section 7 and the camera 5, LED illumination sections 26 are arranged extending in the height direction of the camera unit 20, respectively. In this example, the two LED lighting units 26 are arranged in parallel. As will be described later, the LED illumination unit 26 is composed of a plurality of LCDs (Liquid Crystal Displays), and the control unit 104 can control the LEDs that are lit and the illuminance of the LEDs.
[0032]
The camera 5 includes a lens and an imaging device such as a CCD (Charge Coupled Device) image sensor. Camera 5 may have, for example, a wireless LAN (Local Area Network) communication function, and may be connected to face authentication device 10 via a relay device (not shown) such as a router of a communication network. However, the camera 5 may be wired to the face authentication device 10 . The camera 5 may include a mechanism for controlling the orientation of the camera body and lens, zoom control, focusing, etc., following the movement of the person to be imaged. The display unit 7 is, for example, a liquid crystal display, an organic EL (Electro-Luminescence) display, or the like.
[0033]
The image generated by the camera 5 is preferably captured in real time and transmitted to the face authentication device 10. However, the image transmitted to the face authentication device 10 may not be directly transmitted from the camera 5, and may be an image delayed by a predetermined time. Images captured by the camera 5 may be temporarily stored in another storage device, and the face authentication device 10 may read the images from the storage device sequentially or at predetermined intervals. Further, the image to be transmitted to the face authentication device 10 is preferably a moving image, but may be a frame image at predetermined intervals, or may be a still image.
[0034]

FIG. 4 is a diagram showing a functional configuration example of the face authentication device 10 according to this embodiment.
The face authentication device 10 includes an image generation unit 102, a control unit 104, and a face authentication unit 52.
The image generating unit 102 captures a person and generates a first image. The image generation unit 102 uses the camera 5 to photograph the face of a person passing through the passage 12 and the gate to generate a first image. The control unit 104 controls the LED lighting unit 26 when the first image does not meet the criteria for face matching. Furthermore, the control unit 104 causes the image generation unit 102 to photograph the person again to generate a second image. The face authentication unit 52 performs face authentication using the first image or the second image.
[0035]

FIG. 5 is a block diagram illustrating the hardware configuration of the computer 1000 that implements the face authentication device 10. As shown in FIG.
Computer 1000 has bus 1010 , processor 1020 , memory 1030 , storage device 1040 , input/output interface 1050 and network interface 1060 .
[0036]
The bus 1010 is a data transmission path for the processor 1020, the memory 1030, the storage device 1040, the input/output interface 1050, and the network interface 1060 to exchange data with each other. However, the method of connecting processors 1020 and the like to each other is not limited to bus connection.
[0037]
The processor 1020 is a processor realized by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.
[0038]
The memory 1030 is a main memory implemented by a RAM (Random Access Memory) or the like.
[0039]
The storage device 1040 is an auxiliary storage device realized by a HDD (Hard Disk Drive), SSD (Solid State Drive), memory card, ROM (Read Only Memory), or the like. The storage device 1040 stores each function of the face authentication device 10 (for example, the image generation unit 102, the control unit 104, the face authentication unit 52, as well as the face authentication processing unit 106, the gate opening/closing control unit 108, and the face authentication processing unit 106 of the face authentication gate device 100 described later. A program module for realizing the determination unit 110 etc.) is stored. Each function corresponding to the program module is realized by the processor 1020 reading each program module into the memory 1030 and executing it. The storage device 1040 also functions as various storage units.
[0040]
The input/output interface 1050 is an interface for connecting the face authentication device 10 and various input/output devices (eg, the display unit 7, the camera 5, the LED lighting unit 26, etc.).
[0041]
The network interface 1060 is an interface for connecting the face authentication device 10 to other devices on the communication network 3. However, network interface 1060 may not be used.
[0042]

FIG. 6 is a flowchart showing an operation example of the face authentication device 10 of this embodiment.
First, the image generation unit 102 uses the camera 5 to photograph a person walking along the passage 12 to pass through the gate and generates a first image (step S101). As shown in FIG. 2, an entrance sensor 18 is provided on the entrance side 12a of the housing 14. As shown in FIG. The entry sensor 18 is, for example, an infrared sensor. This flow may be started when the entrance sensor 18 detects that a person has entered the passage 12 . However, the camera 5 may take pictures all the time, or may take pictures at necessary timings.
[0043]
Next, the control unit 104 determines whether the first image generated in step S101 satisfies the criteria for face matching by the face authentication unit 52 (step S103). Here, the reference for face matching is a condition for judging whether or not the color information of a person's face detected from the first image by the face authentication unit 52 can perform face matching with high reliability. be.
[0044]
The face color information may be the luminance value of pixels belonging to the image area of ​​the entire face or part of the face. When a brightness histogram is drawn for all pixels belonging to the face image area, if more than a certain number of pixels are concentrated at the highest brightness value, the face is too bright (overexposed) and is not suitable for matching. It may be determined that the image is an image (that is, it is determined that the image does not meet the criteria for face matching). Alternatively, if more than a certain number of pixels are concentrated at the lowest luminance value, the face is too dark (that is, the image area of ​​the face is blackened out) and is judged to be unsuitable for matching (that is, the image is a face). It may be determined that the collation criteria are not met).
[0045]
Alternatively, the ratio of the average luminance value of the pixels belonging to the left half of the face to the average luminance value of the pixels belonging to the right half of the face (or the average luminance value of the pixels belonging to the right half of the face to the average luminance value of the pixels belonging to the left half of the face) value ratio) is larger than a predetermined value, the image is determined to be unsuitable for matching because one side is too bright or too dark (oblique light). is not satisfied).
[0046]
Furthermore, when it is determined that the first image does not meet the criteria for face matching (NO in step S103), the control unit 104 controls the LED illumination unit 26 (step S105). Then, the control unit 104 causes the image generation unit 102 to photograph the person again to generate a second image (step S107). On the other hand, when the control unit 104 determines that the first image satisfies the criteria for face matching (YES in step S103), steps S105 to S107 are bypassed.
[0047]
Then, the face authentication unit 52 executes face authentication processing using the first image or the second image (step S109). Here, when it is determined that the first image satisfies the criteria (YES in step S103), the face authentication unit 52 uses the first image for face authentication processing. On the other hand, when it is determined that the first image does not meet the criteria (NO in step S103), the face authentication unit 52 uses the second image generated in step S107 for face authentication processing. The face authentication unit 52 detects a person's face from the first image or the second image, specifies the feature amount of the person's face, and performs face authentication.
[0048]
According to this embodiment, when the control unit 104 determines that the first image does not meet the criteria for face matching, the LED lighting unit 26 is controlled so as to meet the criteria for face matching. . After that, the person can be photographed again to generate a second image, and face authentication can be performed by the face authentication unit 52 .
[0049]
When introducing a gate for face recognition, especially in existing facilities, the environment where the camera is installed may not be suitable for shooting because it was not originally intended for shooting. For example, there are cases where the lighting environment is inappropriate, such as a dark place, backlight, oblique light, etc., such as a place facing a window or an inappropriate lighting position. Therefore, it is sometimes difficult to acquire a face image suitable for face image authentication. In that case, the accuracy of face recognition is degraded.
[0050]
According to the configuration of this embodiment, instead of performing face authentication using the first image that does not meet the criteria for face matching, shooting is performed after controlling the illumination so that the criteria for face matching are met. Since face authentication processing can be performed using the obtained second image, face authentication processing can be performed using an image suitable for face authentication processing. Therefore, recognition accuracy is improved. It is also possible to cope with changes in the light environment due to changes in the light environment depending on the installation location and changes in the outside light depending on the time zone as described above.
[0051]
(Second embodiment)
FIG. 7 is a diagram showing a functional configuration example of the face authentication gate device 100 of this embodiment. The face authentication gate device 100 of this embodiment is the same as the above embodiment except that it has a configuration for controlling the opening and closing of the gate based on the result of face authentication. Each function of the face authentication gate device 100 of this embodiment is also implemented by the computer 1000 shown in FIG.
[0052]
As shown in FIG. 12, in this embodiment, the face authentication unit 52 is a face authentication device 50 separate from the face authentication gate device 100, and operates on a cloud server connected via the communication network 3, for example. It may be the face authentication device 50 that
[0053]
The face authentication gate device 100 of FIG. 7 has the same image generation unit 102 and control unit 104 as the face authentication device 10 of FIG. have
[0054]
The image generating unit 102 captures a person passing through the gate and generates a first image or a second image. The face authentication processing unit 106 causes the face authentication device 50 to perform face authentication using the first image or the second image instead of the face authentication unit 52 of the above embodiment. The gate opening/closing control unit 108 controls opening/closing of a gate (opening/closing flap door 16) through which a person passes using the result of face authentication by the face authentication device 50. FIG.
[0055]
FIG. 8 is a flow chart showing an operation example of the gate opening/closing control unit 108 of this embodiment. After the face authentication processing is performed by the face authentication device 50 in step S109, the gate opening/closing control unit 108 determines whether or not the face authentication is successful based on the face authentication result (step S201). If face authentication is successful (YES in step S201), the gate opening/closing control unit 108 opens the opening/closing flap door 16 by controlling it to the open position (step S203). On the other hand, if face authentication fails (NO in step S201), step S203 is bypassed and the process ends. That is, the opening/closing flap door 16 remains in the closed position.
[0056]
In this example, the opening/closing flap door 16 is in the normally closed position. If the opening/closing flap door 16 is in the normally open position, the face authentication is successful in step S201.During this period, the opening/closing flap door 16 remains in the open position. If face authentication fails in step S201, the gate opening/closing control unit 108 controls the opening/closing flap door 16 to the closed position to close the gate.
[0057]
As described above, according to the present embodiment, gate opening/closing control can be performed by the gate opening/closing control unit 108 based on the result of highly accurate face authentication. Therefore, the probability of failure in authentication as a result of performing face authentication using a face image that is not suitable for face authentication is reduced. Since face recognition can be performed using a face image suitable for face recognition, the probability of being stranded at a gate is reduced due to the reduction in the number of times of authentication failure, and it becomes possible to pass through the gate smoothly, thereby alleviating congestion. Furthermore, if verification by a staff member is required when authentication fails, the number of verifications by the staff member is reduced, leading to a reduction in personnel costs.
[0058]
(Third embodiment)
FIG. 9 is a diagram showing a functional configuration example of the face authentication gate device 100 of this embodiment. The face authentication gate device 100 of the present embodiment is at least the same as the above first and second embodiments, except that it has a configuration that controls the LED lighting unit 26 based on the surrounding environment at the timing of photographing the person to be authenticated. Same as one. The face authentication gate device 100 of FIG. 9 has the same configuration as the face authentication gate device 100 of the second embodiment of FIG. However, the determination unit 110 of this embodiment can also be combined with the configuration of the face authentication device 10 of FIG.
[0059]
FIG. 10 is a diagram for explaining the control method of the LED lighting section 26 of this embodiment.
The LED lighting section 26 has a plurality of light sources (for example, LEDs) arranged in the height direction h. The control unit 104 controls the intensity of at least some of the plurality of light sources according to the position 30 of the person's face.
[0060]
The LED illumination unit 26 has a light source physically or electrically divided into a plurality of parts 28 in the vertical direction, and these parts 28 can be individually controlled.
In the example of FIG. 10, the LED lighting section 26 is controlled by dividing it into, for example, three portions 28a, 28b, and 28c. The part of the LED lighting unit 26 located at the position of the face of the person to be authenticated is specified and lit. In the example of FIG. 10, the lit portions 28 are indicated by solid lines and the unlit portions 28 are indicated by dashed lines. However, in FIG. 10, only one of the two LED illumination units 26 on both sides of the display unit 7 in FIG. 3 is shown. For example, in the example of FIG. 10A, the control unit 104 controls the LED lighting unit 26 of the portion 28b corresponding to the face position 30 of the person to be authenticated to light up. In the example of FIG. 10B, the control unit 104 controls the LED illumination units 26 of the portions 28a and 28b corresponding to the face position 30 of the person to be authenticated to light up.
[0061]
In the example of FIG. 10(a), only the portion 28a of the LED lighting section 26 corresponds to the position 30 of the person's face. When the facial positions 30 of the two are straddled, both the two portions 28a and 28b of the LED illumination portion 26 are illuminated. Various methods of determining the position 30 of the person's face and the portion 28 to control lighting are conceivable, and are exemplified below, but are not limited to these.
[0062]
For example, at least the portion 28 of the LED illumination unit 26 at the height of the eyes of the person whose face has been detected is selected as a target to be lit. Furthermore, when the height of the human eye falls within a range (10% of the top and 10% of the bottom) outside the range of 80% from the center of the portion 28 in the vertical direction of the LED illumination unit 26, the Other portions 28 adjacent to the range may also be selected for illumination.
[0063]
Alternatively, the intensity may be adjusted according to the distance between the face of the person to be authenticated and the LED illumination unit 26 . For example, the closer the face of the person to be authenticated is to the LED illumination unit 26, the more the face becomes overexposed, the brighter the eyes are, the more squinting and the more blinking (closed eyes are inappropriate for face matching). , the intensity of the LED lighting section 26 may be lowered. Further, the farther the face of the person to be authenticated is from the LED illumination unit 26, the more difficult it is for the light to reach the LED illumination unit 26, so the intensity of the LED illumination unit 26 may be increased.
[0064]
Furthermore, the face authentication processing unit 106 acquires the color information of the person's face and the color information of the surrounding environment from the face authentication device 50. Then, the control unit 104 controls the LED lighting unit 26 using the obtained color information of the person's face and the color information of the surrounding environment.
[0065]
In this embodiment, the camera 5 is used to capture the person to be recognized and its surroundings (for example, the background and both sides of the person) so that color information about the person's face and color information about the surrounding environment can be acquired from the face authentication device 50 . The angle of view is adjusted so that the space of ) is included. Alternatively, as another example, the control unit 104 may determine the light environment based on observation values ​​of an illuminometer (not shown) installed inside and around the gate in addition to the color information. good.
[0066]
The determining unit 110 determines the following light environment based on the difference between the obtained color information of the person's face and the color information of the surrounding environment.
(a1) If the brightness of the face is equal to or higher than a certain value and the difference in brightness between the face and the surrounding environment is small, the light environment is assumed to be front light.
(a2) If the brightness of the face is less than a certain value and the difference in brightness between the face and the surrounding environment is small, the light environment is set as a dark place.
(a3) If the brightness of the face is less than a certain value and the difference in brightness between the face and the surrounding environment is large, the light environment is backlit.
(a4) If only part of the luminance of the face is high and the luminance difference between the face and the surrounding environment is small, the light environment is oblique light.
The control unit 104 controls the intensity of the LED illumination unit 26 based on the determination result of the determination unit 110.
[0067]
The control unit 104 controls the intensity of the LED lighting unit 26 as follows, for example, based on the determination result of the determination unit 110 .
(b1) If the lighting environment is front lighting, all the lights are turned off.
(b2) If the light environment is dark, the lighting is turned on and the intensity of the lighting is set so that the brightness of the face is equal to or higher than a certain value.
(b3) If the light environment is backlit, the lighting is turned on and the intensity of the lighting is set so that the brightness of the face is equal to or higher than a certain value.
(b4) If the light environment is oblique light, the lighting is turned on, and the intensity of the lighting is set so that the brightness of the face is equal to or higher than a predetermined value.
[0068]
Here, the setting of the intensity of the LED lighting unit 26 will be described.
The optimum LED value for the luminance difference between the face and the surrounding environment when the LED is off is registered in advance in a storage device (not shown). The intensity of each LED of the LED lighting section 26 can be set based on the registered optimum value of the LED. Alternatively, after changing the intensity of the LED by a specified amount, the camera 5 may be used to photograph again, and if the face color information of the generated face image is not appropriate, the intensity of the LED may be changed again. You may optimize by repeating these processes.
[0069]
Also, an upper limit value may be set so that the intensity of the LED is set within a range that can withstand visual observation and that does not cause overexposure to the face.
As for the oblique light, only some of the plurality of LEDs in the LED illumination section 26 may be lit in order to brighten the dark part of the face.
[0070]
When the surrounding light environment exceeds the limit that can be corrected by the LEDs, the control unit 104 instructs to lower the curtains and blinds around the face authentication gate device 100 and turn on the ceiling light, etc., or a mechanism that automatically controls. may be provided. Alternatively, the control unit 104 may implement parameters of the camera 5 (exposure control, etc.) as well.
[0071]
According to this embodiment, the same effect as the above embodiment can be obtained.
[0072]
Although the embodiments of the present invention have been described above with reference to the drawings, these are examples of the present invention, and various configurations other than those described above can be adopted.
[0073]
For example, on both sides of the display section 7 and the camera 5 in FIG. In addition to this configuration, the LED lighting section 26 may be arranged so as to surround at least one of the display section 7 and the camera 5 . Alternatively, a plurality of light source groups in which a plurality of light sources are arranged in the horizontal direction may be arranged at intervals in the height direction. For example, the light source groups may be arranged above and below each camera 5, respectively.
[0074]
A camera 5 may be provided on the outer frame of the display unit 7, as shown in FIG. In this example, the LED lighting section 26 is arranged around the display section 7 in which the camera 5 is provided on the outer frame. A tablet terminal equipped with a camera 5 may be used as the display unit 7, for example.
[0075]
Furthermore, in FIG. 10, the light irradiation position is controlled by turning on or off each part of the LED lighting unit 26 arranged in the height direction. In another example, as shown in FIG. 11, the camera unit 20 or the camera 5 and the light source (the LEDs arranged around the camera 5) may be controlled to move up and down. For example, the face authentication device 50 moves so as to follow the height of the camera unit 20 or the camera 5 and the light source (LEDs arranged around the camera 5) in accordance with the position of the face of the person to be authenticated. A movement control unit 60 for controlling may be further provided. FIG. 11 shows an example in which the position of the camera 5 is moved to a height h1 (FIG. 11(a)) and a height h2 (FIG. 11(b)).
[0076]
Furthermore, the control by partially turning on/off the LED lighting unit 26 described in FIG. 10 may be combined with the intensity control of the LED lighting unit 26 in the third embodiment. For example, the LED lighting unit 26 may perform control to brighten or darken the brightness of at least a part of the light source or the entire light source.
[0077]
Furthermore, a half mirror may be provided on the front surface of the camera unit 20 at a position that covers the display section 7 and the camera 5 . However, the half mirror may be configured to cover at least a part of the display unit 7 and the front surface (person side) of the camera 5 . In this configuration, the figure of the person facing the camera unit 20 is reflected in the half-mirror, so that the person naturally tends to look at his/her own image reflected in the mirror. , and the camera 5 can photograph the face of the person through the half mirror. Also, the screen displayed on the display unit 7 can be shown to the person through a half mirror.
[0078]
Although the present invention has been described with reference to the embodiments and examples, the present invention is not limited to the above embodiments and examples. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.
In addition, when acquiring and using information about users in the present invention, this shall be done lawfully.
[0079]
Some or all of the above embodiments can also be described as the following additional remarks, but are not limited to the following.
1. an image generating means for capturing a person and generating a first image;
a control means for controlling illumination and causing the image generating means to photograph the person again to generate a second image when the first image does not meet the criteria for face matching;
a face authentication means for performing face authentication using the first image or the second image;
A face authentication device with
2. 1. In the face authentication device described in
The face authentication means detects the face of the person from the first image or the second image, specifies the feature amount of the person's face, and performs the face authentication,
The face authentication device, wherein the criterion is that the feature amount of the person's face detected from the first image can be specified in the face authentication means.
3. 1. or 2. In the face authentication device described in
The lighting has multiple light sources arranged in the height direction,
The face authentication device, wherein the control means controls the intensity of at least part of the plurality of light sources according to the position of the person's face.
4. 1. to 3. In the face authentication device according to any one of
The face authentication means acquires the color information of the person's face and the color information of the surrounding environment,
A face authentication device, wherein the control means controls the lighting using the obtained color information of the person's face and the color information of the surrounding environment.
5. 4. In the face authentication device described in
of the obtained face color information of the person and the surrounding environment Further comprising determination means for determining the light environment based on the difference from the color information,
The determination means
　　When the brightness of the face is equal to or higher than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be front light,
　　When the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be a dark place,
　　If the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is large, the light environment is backlit,
When only part of the brightness of the face is high and the brightness difference between the face and the surrounding environment is small, the light environment is oblique light,
A face authentication device, wherein the control means controls the intensity of the illumination based on the determination result of the determination means.
6. 5. In the face authentication device described in
The control means determines that the determination result is
When the light environment is the front light, all the lights are turned off,
When the light environment is the dark place, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the backlight, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the oblique light, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value and is uniform,
"Face authentication device."
[0080]
7. "The face authentication device
Take a picture of a person to generate the first image,
　When the first image does not meet the criteria for face matching, controlling the lighting and photographing the person again to generate a second image,
　Performing face authentication using the first image or the second image,
A control method for a face authentication device.
8. 7. In the control method of the face authentication device according to
　The face authentication device
Detecting the person's face from the first image or the second image, specifying the feature amount of the person's face, and performing the face authentication,
A control method for a face authentication device, wherein the criterion is that the feature amount of the person's face detected from the first image can be specified when performing the face authentication.
9. 7. or 8. In the control method of the face authentication device according to
The lighting has multiple light sources arranged in the height direction,
　The face authentication device
A control method for a face authentication device, which controls the intensity of at least part of the plurality of light sources according to the position of the person's face.
10. 7. to 9. In the control method of the face authentication device according to any one of
　The face authentication device
　Acquire the color information of the person's face and the color information of the surrounding environment,
A control method for a face authentication device that controls the lighting using the obtained color information of the person's face and the color information of the surrounding environment.
11. 10. In the control method of the face authentication device according to
　The face authentication device further
Based on the difference between the obtained color information of the person's face and the color information of the surrounding environment, determine the light environment,
In the above judgment,
　　When the brightness of the face is equal to or higher than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be front light,
　　When the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be a dark place,
　　If the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is large, the light environment is backlit,
When only part of the brightness of the face is high and the brightness difference between the face and the surrounding environment is small, the light environment is oblique light,
A control method for a face authentication device, which controls the intensity of the illumination based on the result of the determination.
12. 11. In the control method of the face authentication device according to
　The face authentication device
　The result of the above judgment is
When the light environment is the front light, all the lights are turned off,
When the light environment is the dark place, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the backlight, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the oblique light, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value and is uniform,
　How to control the face authentication device.
[0081]
13. on the computer,
a procedure for photographing a person to generate the first image,
A procedure for controlling the lighting and photographing the person again to generate a second image when the first image does not meet the criteria for face matching,
A program for executing a procedure for performing face authentication using the first image or the second image.
14. 13. In the program described in
causing a computer to execute a procedure for detecting the person's face from the first image or the second image, specifying the feature amount of the person's face, and performing the face authentication,
The program, wherein the criterion is that the feature amount of the person's face detected from the first image can be specified when performing the face authentication.
15. 13. or 14. In the program described in
The lighting has multiple light sources arranged in the height direction,
A program for causing a computer to execute a procedure for controlling the intensity of at least part of the plurality of light sources according to the position of the person's face.
16. 13. to 15. In the program according to any one of
　Procedures for acquiring the color information of the person's face and the color information of the surrounding environment,
A program for causing a computer to execute a procedure for controlling the lighting using the acquired color information of the person's face and the color information of the surrounding environment.
17. 16. In the program described in
moreover,
A procedure for judging the light environment based on the difference between the obtained color information of the person's face and the color information of the surrounding environment,
The procedure for making the above judgment is
When the luminance of the face is equal to or higher than a certain value and the difference in luminance between the face and the surrounding environment is small, the light environment is set to front lighting,
　　　When the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is small, a step of setting the light environment to a dark place,
When the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is large, a step of setting the light environment to backlight,
If only part of the brightness of the face is high and the brightness difference between the face and the surrounding environment is small, the light environment is oblique light,
A program for causing a computer to execute a procedure for controlling the intensity of the lighting based on the result of the determination.
18. 17. In the program described in
　The result of the above judgment is
　　If the light environment is the front light, the procedure to turn off all the lights,
When the light environment is the dark place, a procedure of turning on the lighting and setting the intensity of the lighting so that the brightness of the face is equal to or higher than the constant value,
A step of turning on the lighting when the light environment is the backlight, and setting the intensity of the lighting so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the oblique light, a procedure for turning on the illumination and setting the intensity of the illumination so that the brightness of the face is equal to or higher than the predetermined value and is uniform is provided to a computer. program to run.
[0082]
19. "Face recognition device and
Equipped with an image processing device,
The image processing device
an image generating means for capturing a person and generating a first image;
a control means for controlling illumination and causing the image generating means to photograph the person again to generate a second image when the first image does not meet the criteria for face matching;
A face authentication system comprising face authentication processing means for causing the face authentication device to perform face authentication using the first image or the second image.
20. 19. In the face authentication system described in
The face authentication processing means of the image processing device detects the face of the person from the first image or the second image, specifies the feature amount of the face of the person, and performs the face authentication on the face authentication device. let it happen,
The face authentication system, wherein the criterion is that the feature amount of the person's face detected from the first image can be specified in the face authentication device.
21. 19. or 20. In the face authentication system described in
The lighting has multiple light sources arranged in the height direction,
A face authentication system, wherein the control means of the image processing device controls the intensity of at least part of the plurality of light sources according to the position of the person's face.
22. 19. to 21. In the face authentication system according to any one of
　From the face authentication device, obtain the color information of the person's face and the color information of the surrounding environment,
A face authentication system, wherein the control means of the image processing device controls the lighting using the obtained color information of the person's face and the color information of the surrounding environment.
23. 22. In the face authentication system described in
The image processing device
further comprising determination means for determining the light environment based on the difference between the obtained color information of the person's face and the color information of the surrounding environment,
The determination means of the image processing device is
　　When the brightness of the face is equal to or higher than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be front light,
　　When the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be a dark place,
　　If the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is large, the light environment is backlit,
When only part of the brightness of the face is high and the brightness difference between the face and the surrounding environment is small, the light environment is oblique light,
A face authentication system, wherein the control means of the image processing device controls the intensity of the illumination based on the determination result of the determination means of the image processing device.
24. 23. In the face authentication system described in
The control means of the image processing device determines that the determination result is
When the light environment is the front light, all the lights are turned off,
When the light environment is the dark place, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the backlight, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the oblique light, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value and is uniform,
"Face authentication system."
[0083]
25. 1. to 6. The face authentication device according to any one of 1 above performs face authentication using a first image or a second image generated by photographing a person passing through a gate, and the person passes through using the face authentication result. A face authentication gate device comprising gate opening/closing control means for controlling opening/closing of the gate.
26. an image generating means for capturing a person and generating a first image;
a control means for controlling illumination and causing the image generating means to photograph the person again to generate a second image when the first image does not meet the criteria for face matching;
a face authentication means for performing face authentication using the first image or the second image;
gate opening/closing control means for controlling the opening/closing of the gate through which the person passes, using the result of the face authentication by the face authentication means;
A face authentication gate device comprising a
27. 26. In the face authentication gate device according to
The face authentication means detects the face of the person from the first image or the second image, specifies the feature amount of the person's face, and performs the face authentication,
The face authentication gate device, wherein the criterion is that the feature amount of the person's face detected from the first image can be specified in the face authentication means.
28. 26. or 27. In the face authentication gate device according to
The lighting has multiple light sources arranged in the height direction,
A face authentication gate device, wherein the control means controls the intensity of at least part of the plurality of light sources according to the position of the person's face.
29. 26. to 28. In the face authentication gate device according to any one of
The face authentication means acquires the color information of the person's face and the color information of the surrounding environment,
A face authentication gate device, wherein the control means controls the lighting using the obtained color information of the person's face and the color information of the surrounding environment.
30. 29. In the face authentication gate device according to
further comprising determination means for determining the light environment based on the difference between the obtained color information of the person's face and the color information of the surrounding environment,
The determination means
　　When the brightness of the face is equal to or higher than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be front light,
　　When the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be a dark place,
　　If the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is large, the light environment is backlit,
When only part of the brightness of the face is high and the brightness difference between the face and the surrounding environment is small, the light environment is oblique light,
A face authentication gate device, wherein the control means controls the intensity of the illumination based on the determination result of the determination means.
31. 30. In the face authentication gate device according to
The control means determines that the determination result is
When the light environment is the front light, all the lights are turned off,
When the light environment is the dark place, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the backlight, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the oblique light, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value and is uniform,
"Face authentication gate device."
[0084]
32. "The face authentication gate device
1. to 6. The face authentication device according to any one of 1 above performs face authentication using a first image or a second image generated by photographing a person passing through a gate, and the person passes through using the face authentication result. A control method for a face authentication gate device, which controls opening and closing of the gate.
33. "The face authentication gate device
Take a picture of a person to generate the first image,
　When the first image does not meet the criteria for face matching, controlling the lighting and photographing the person again to generate a second image,
　Perform face authentication using the first image or the second image,
　using the result of the face recognition to control the opening and closing of the gate through which the person passes,
A control method for a face authentication gate device.
34. 33. In the control method of the face authentication gate device according to
　The face authentication gate device
Detecting the person's face from the first image or the second image, specifying the feature amount of the person's face, and performing the face authentication,
A control method for a face authentication gate device, wherein the criterion is that the feature amount of the person's face detected from the first image can be specified when performing the face authentication.
35. 33. or 34. In the control method of the face authentication gate device according to
The lighting has multiple light sources arranged in the height direction,
　The face authentication gate device
A control method for a face authentication gate device, which controls the intensity of at least part of the plurality of light sources according to the position of the person's face.
36. 33. to 35. In the control method of the face authentication gate device according to any one of
　The face authentication gate device
　Acquire the color information of the person's face and the color information of the surrounding environment,
A control method for a face authentication gate device, wherein the lighting is controlled using the obtained color information of the person's face and the color information of the surrounding environment.
37. 36. In the control method of the face authentication gate device according to
　The face authentication gate device further
Based on the difference between the obtained color information of the person's face and the color information of the surrounding environment, determine the light environment,
In the above judgment,
　　When the brightness of the face is equal to or higher than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be front light,
　　When the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be a dark place,
　　If the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is large, the light environment is backlit,
When only part of the brightness of the face is high and the brightness difference between the face and the surrounding environment is small, the light environment is oblique light,
A control method for a face authentication gate device, which controls the intensity of the illumination based on the result of the determination.
38. 37. In the control method of the face authentication gate device according to
　The face authentication gate device
　The result of the above judgment is
When the light environment is the front light, all the lights are turned off,
When the light environment is the dark place, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the backlight, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the oblique light, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value and is uniform,
　How to control the face authentication gate device.
[0085]
39. on the computer,
1. to 6. The face authentication device according to any one of 1 above performs face authentication using a first image or a second image generated by photographing a person passing through a gate, and the person passes through using the face authentication result. A program for executing a procedure for controlling the opening and closing of the gate.
40. on the computer,
a procedure for photographing a person to generate the first image,
A procedure for controlling the lighting and photographing the person again to generate a second image when the first image does not meet the criteria for face matching,
a procedure for performing face authentication using the first image or the second image,
A program for executing a procedure for controlling the opening and closing of the gate through which the person passes, using the result of the face recognition.
41. 40. In the program described in
causing a computer to execute a procedure for detecting the person's face from the first image or the second image, specifying the feature amount of the person's face, and performing the face authentication,
The program, wherein the criterion is that the feature amount of the person's face detected from the first image can be specified when performing the face authentication.
42. 40. or 41. In the program described in
The lighting has multiple light sources arranged in the height direction,
A program for causing a computer to execute a procedure for controlling the intensity of at least part of the plurality of light sources according to the position of the person's face.
43. 40. to 42. In the program according to any one of
　Procedures for acquiring the color information of the person's face and the color information of the surrounding environment,
A program for causing a computer to execute a procedure for controlling the lighting using the acquired color information of the person's face and the color information of the surrounding environment.
44. 43. In the program described in
moreover,
A procedure for judging the light environment based on the difference between the obtained color information of the person's face and the color information of the surrounding environment,
The procedure for making the above judgment is
When the luminance of the face is equal to or higher than a certain value and the difference in luminance between the face and the surrounding environment is small, the light environment is set to front lighting,
　　　When the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is small, a step of setting the light environment to a dark place,
When the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is large, a step of setting the light environment to backlight,
If only part of the brightness of the face is high and the brightness difference between the face and the surrounding environment is small, the light environment is oblique light,
A program for causing a computer to execute a procedure for controlling the intensity of the lighting based on the result of the determination.
45. 44. In the program described in
　The result of the above judgment is
　　If the light environment is the front light, the procedure to turn off all the lights,
When the light environment is the dark place, a procedure of turning on the lighting and setting the intensity of the lighting so that the brightness of the face is equal to or higher than the constant value,
A step of turning on the lighting when the light environment is the backlight, and setting the intensity of the lighting so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the oblique light, a procedure for turning on the illumination and setting the intensity of the illumination so that the brightness of the face is equal to or higher than the predetermined value and is uniform is provided to a computer. program to run.
[0086]
46. "Face recognition device and
Equipped with a face authentication gate device,
　The face authentication gate device
an image generating means for capturing a person and generating a first image;
a control means for controlling illumination and causing the image generating means to photograph the person again to generate a second image when the first image does not meet the criteria for face matching;
face authentication processing means for causing the face authentication device to perform face authentication using the first image or the second image;
Using the face authentication result of performing the face authentication using the first image or the second image generated by photographing the person passing through the gate with the face authentication device, the gate through which the person passes and gate opening/closing control means for controlling opening/closing.
47. 46. In the face authentication system described in
The face authentication processing means of the face authentication gate device detects the face of the person from the first image or the second image, specifies the feature amount of the person's face, and sends the face authentication to the face authentication device. to do
The face authentication system, wherein the criterion is that the feature amount of the person's face detected from the first image can be specified in the face authentication device.
48. 46. or 47. In the face authentication system described in
The lighting has multiple light sources arranged in the height direction,
A face authentication system, wherein the control means of the face authentication gate device controls the intensity of at least part of the plurality of light sources according to the position of the person's face.
49. 46. to 48. In the face authentication system according to any one of
　From the face authentication device, obtain the color information of the person's face and the color information of the surrounding environment,
A face authentication system, wherein the control means of the face authentication gate device controls the lighting using the obtained color information of the person's face and the color information of the surrounding environment.
50. 49. In the face authentication system described in
　The face authentication gate device
further comprising determination means for determining the light environment based on the difference between the obtained color information of the person's face and the color information of the surrounding environment,
The determination means of the face authentication gate device is
　　When the brightness of the face is equal to or higher than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be front light,
　　When the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be a dark place,
　　If the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is large, the light environment is backlit,
When only part of the brightness of the face is high and the brightness difference between the face and the surrounding environment is small, the light environment is oblique light,
A face authentication system, wherein the control means of the face authentication gate device controls the intensity of the illumination based on the determination result of the determination means of the face authentication gate device.
51. 50. In the face authentication system described in
　The control means of the face authentication gate device determines that the determination result is
When the light environment is the front light, all the lights are turned off,
When the light environment is the dark place, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the backlight, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the oblique light, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value and is uniform,
"Face authentication system."
The scope of the claims
[Claim 1]
an image generating means for capturing a person and generating a first image;
a control means for controlling illumination and causing the image generating means to photograph the person again to generate a second image when the first image does not meet the criteria for face matching;
a face authentication means for performing face authentication using the first image or the second image;
A face authentication device with
[Claim 2]
In the face authentication device according to claim 1,
The face authentication means detects the face of the person from the first image or the second image, specifies the feature amount of the person's face, and performs the face authentication,
The face authentication device, wherein the criterion is that the feature amount of the person's face detected from the first image can be specified in the face authentication means.
[Claim 3]
In the face authentication device according to claim 1 or 2,
The lighting has multiple light sources arranged in the height direction,
The face authentication device, wherein the control means controls the intensity of at least part of the plurality of light sources according to the position of the person's face.
[Claim 4]
　In the face authentication device according to any one of claims 1 to 3,
The face authentication means acquires the color information of the person's face and the color information of the surrounding environment,
A face authentication device, wherein the control means controls the lighting using the obtained color information of the person's face and the color information of the surrounding environment.
[Claim 5]
In the face authentication device according to claim 4,
further comprising determination means for determining the light environment based on the difference between the obtained color information of the person's face and the color information of the surrounding environment,
The determination means
　　When the brightness of the face is equal to or higher than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be front light,
　　When the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be a dark place,
　　If the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is large, the light environment is backlit,
When only part of the brightness of the face is high and the brightness difference between the face and the surrounding environment is small, the light environment is oblique light,
A face authentication device, wherein the control means controls the intensity of the illumination based on the determination result of the determination means.
[Claim 6]
In the face authentication device according to claim 5,
The control means determines that the determination result is
When the light environment is the front light, all the lights are turned off,
When the light environment is the dark place, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the backlight, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the oblique light, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value and is uniform,
"Face authentication device."
[Claim 7]
"The face authentication device
Take a picture of a person to generate the first image,
　When the first image does not meet the criteria for face matching, controlling the lighting and photographing the person again to generate a second image,
　Performing face authentication using the first image or the second image,
A control method for a face authentication device.
[Claim 8]
In the control method of the face authentication device according to claim 7,
　The face authentication device
Detecting the person's face from the first image or the second image, specifying the feature amount of the person's face, and performing the face authentication,
A control method for a face authentication device, wherein the criterion is that the feature amount of the person's face detected from the first image can be specified when performing the face authentication.
[Claim 9]
In the face authentication device control method according to claim 7 or 8,
The lighting has multiple light sources arranged in the height direction,
　The face authentication device
A control method for a face authentication device, which controls the intensity of at least part of the plurality of light sources according to the position of the person's face.
[Claim 10]
　In the control method of the face authentication device according to any one of claims 7 to 9,
　The face authentication device
　Acquire the color information of the person's face and the color information of the surrounding environment,
A control method for a face authentication device that controls the lighting using the obtained color information of the person's face and the color information of the surrounding environment.
[Claim 11]
In the face authentication device control method according to claim 10,
　The face authentication device further
Based on the difference between the obtained color information of the person's face and the color information of the surrounding environment, determine the light environment,
In the above judgment,
　　When the brightness of the face is equal to or higher than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be front light,
　　When the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be a dark place,
　　If the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is large, the light environment is backlit,
When only part of the brightness of the face is high and the brightness difference between the face and the surrounding environment is small, the light environment is oblique light,
A control method for a face authentication device, which controls the intensity of the illumination based on the result of the determination.
[Claim 12]
In the face authentication device control method according to claim 11,
　The face authentication device
　The result of the above judgment is
When the light environment is the front light, all the lights are turned off,
When the light environment is the dark place, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the backlight, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the oblique light, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value and is uniform,
　How to control the face authentication device.
[Claim 13]
on the computer,
a procedure for photographing a person to generate the first image,
A procedure for controlling the lighting and photographing the person again to generate a second image when the first image does not meet the criteria for face matching,
A program for executing a procedure for performing face authentication using the first image or the second image.
[Claim 14]
In the program according to claim 13,
causing a computer to execute a procedure for detecting the person's face from the first image or the second image, specifying the feature amount of the person's face, and performing the face authentication,
The program, wherein the criterion is that the feature amount of the person's face detected from the first image can be specified when performing the face authentication.
[Claim 15]
In the program according to claim 13 or 14,
The lighting has multiple light sources arranged in the height direction,
A program for causing a computer to execute a procedure for controlling the intensity of at least part of the plurality of light sources according to the position of the person's face.
[Claim 16]
　In the program according to any one of claims 13 to 15,
　Procedures for acquiring the color information of the person's face and the color information of the surrounding environment,
A program for causing a computer to execute a procedure for controlling the lighting using the acquired color information of the person's face and the color information of the surrounding environment.
[Claim 17]
In the program according to claim 16,
moreover,
A procedure for judging the light environment based on the difference between the obtained color information of the person's face and the color information of the surrounding environment,
The procedure for making the above judgment is
When the luminance of the face is equal to or higher than a certain value and the difference in luminance between the face and the surrounding environment is small, the light environment is set to front lighting,
　　　When the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is small, a step of setting the light environment to a dark place,
When the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is large, a step of setting the light environment to backlight,
If only part of the brightness of the face is high and the brightness difference between the face and the surrounding environment is small, the light environment is oblique light,
A program for causing a computer to execute a procedure for controlling the intensity of the lighting based on the result of the determination.
[Claim 18]
In the program according to claim 17,
　The result of the above judgment is
　　If the light environment is the front light, the procedure to turn off all the lights,
When the light environment is the dark place, a procedure of turning on the lighting and setting the intensity of the lighting so that the brightness of the face is equal to or higher than the constant value,
A step of turning on the lighting when the light environment is the backlight, and setting the intensity of the lighting so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the oblique light, a procedure for turning on the illumination and setting the intensity of the illumination so that the brightness of the face is equal to or higher than the predetermined value and is uniform is provided to a computer. program to run.
[Claim 19]
"Face recognition device and
Equipped with an image processing device,
The image processing device
an image generating means for capturing a person and generating a first image;
a control means for controlling illumination and causing the image generating means to photograph the person again to generate a second image when the first image does not meet the criteria for face matching;
A face authentication system comprising face authentication processing means for causing the face authentication device to perform face authentication using the first image or the second image.
[Claim 20]
In the face authentication system according to claim 19,
The face authentication processing means of the image processing device detects the face of the person from the first image or the second image, specifies the feature amount of the face of the person, and performs the face authentication on the face authentication device. let it happen,
The face authentication system, wherein the criterion is that the feature amount of the person's face detected from the first image can be specified in the face authentication device.
[Claim 21]
In the face authentication system according to claim 19 or 20,
The lighting has multiple light sources arranged in the height direction,
A face authentication system, wherein the control means of the image processing device controls the intensity of at least part of the plurality of light sources according to the position of the person's face.
[Claim 22]
　In the face authentication system according to any one of claims 19 to 21,
　From the face authentication device, obtain the color information of the person's face and the color information of the surrounding environment,
A face authentication system, wherein the control means of the image processing device controls the lighting using the obtained color information of the person's face and the color information of the surrounding environment.
[Claim 23]
In the face authentication system according to claim 22,
The image processing device
further comprising determination means for determining the light environment based on the difference between the obtained color information of the person's face and the color information of the surrounding environment,
The determination means of the image processing device is
　　When the brightness of the face is equal to or higher than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be front light,
　　When the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is small, the light environment is assumed to be a dark place,
　　If the brightness of the face is less than a certain value and the brightness difference between the face and the surrounding environment is large, the light environment is backlit,
When only part of the brightness of the face is high and the brightness difference between the face and the surrounding environment is small, the light environment is oblique light,
A face authentication system, wherein the control means of the image processing device controls the intensity of the illumination based on the determination result of the determination means of the image processing device.
[Claim 24]
In the face authentication system according to claim 23,
The control means of the image processing device determines that the determination result is
When the light environment is the front light, all the lights are turned off,
When the light environment is the dark place, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the backlight, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value,
When the light environment is the oblique light, the illumination is turned on, and the intensity of the illumination is set so that the brightness of the face is equal to or higher than the constant value and is uniform,
"Face authentication system."
[Claim 25]
Using the result of face authentication performed by the face authentication device according to any one of claims 1 to 6 using a first image or a second image generated by photographing a person passing through a gate 1. A face authentication gate device comprising gate opening/closing control means for controlling opening/closing of said gate through which said person passes.
[Claim 26]
"The face authentication gate device
Using the first image or the second image generated by the face authentication device according to any one of claims 1 to 6 photographing a person passing through the gate A control method for a face authentication gate device, wherein the opening and closing of the gate through which the person passes is controlled using a face authentication result of face authentication.
[Claim 27]
on the computer,
Using the result of face authentication performed by the face authentication device according to any one of claims 1 to 6 using a first image or a second image generated by photographing a person passing through a gate , a procedure for controlling the opening and closing of the gate through which the person passes.
[Claim 28]
"Face recognition device and
Equipped with a face authentication gate device,
　The face authentication gate device
an image generating means for capturing a person and generating a first image;
a control means for controlling illumination and causing the image generating means to photograph the person again to generate a second image when the first image does not meet the criteria for face matching;
face authentication processing means for causing the face authentication device to perform face authentication using the first image or the second image;
Using the face authentication result of performing the face authentication using the first image or the second image generated by photographing the person passing through the gate with the face authentication device, the gate through which the person passes and gate opening/closing control means for controlling opening/closing.