[0001]The present disclosure relates to a photographing apparatus, a photographing
method, and a storage medium having a program stored therein.
10 BACKGROUND ART
[0002]
A technology for improving authentication efficiency when performing facial
authentication by generating light, sounds, or the like towards a walking photographic
subject to make the photographic subject face a camera installation position is disclosed
15 in Patent Document 1.
CITATION LIST
Patent Literature
[0003]
20 [Patent Document 1]
Japanese Unexamined Patent Application, First Publication No. 2010-086350
SUMMARY OF THE INVENTION
Problems to be solved by the Invention
25 [0004]
2
However, with the technology described in Patent Document 1, there is a
problem in that an image suitable for facial authentication sometimes cannot be
photographed due to the distance from the camera to the photographic subject or the
brightness of the surroundings.
5 [0005]
Therefore, an example of an objective of the present invention is to provide a
photographing apparatus, a photographing method, and a storage medium having a
program stored therein, which solve the above-mentioned problem.
10 Means for Solving the Problems
[0006]
According to a first aspect of the present invention, a photographing apparatus
includes a camera; a light-emitting device provided in the vicinity of the camera; a
human sensor that detects a photographic subject; first light emission control means for
15 controlling light emission of the light-emitting device in accordance with a first mode
when the photographic subject is detected; detection means for detecting that a
photograph-taking timing has arrived when an interocular distance of the photographic
subject in an image generated by the camera in accordance with the first mode becomes
at least a prescribed distance; and second light emission control means for controlling
20 light emission of the light-emitting device, at the photograph-taking timing, in
accordance with a second mode in which a light emission intensity is higher than in the
first mode.
[0007]
According to a second aspect of the present invention, a photographing method
25 includes controlling light emission of a light-emitting device provided in the vicinity of a
3
camera in accordance with a first mode when a photographic subject is detected by a
human sensor; detecting that a photograph-taking timing has arrived when an interocular
distance of the photographic subject in an image generated by the camera in accordance
with the first mode becomes at least a prescribed distance; and controlling light emission
of the light-emitting device, at the photograph-taking timing, in accordance 5 with a second
mode in which a light emission intensity is higher than in the first mode.
[0008]
According to a third aspect of the present invention, a program stored in a
storage medium causes a computer in a photographing apparatus to execute processes.
10 The processes includes controlling light emission of a light-emitting device provided in
the vicinity of a camera in accordance with a first mode when a photographic subject is
detected by a human sensor; detecting that a photograph-taking timing has arrived when
an interocular distance of the photographic subject in an image generated by the camera
in accordance with the first mode becomes at least a prescribed distance; and controlling
15 light emission of the light-emitting device, at the photograph-taking timing, in
accordance with a second mode in which a light emission intensity is higher than in the
first mode.
Advantageous Effects of Invention
20 [0009]
According to the present disclosure, an image that is suitable for facial
authentication of a photographic subject who is advancing towards a camera can be
photographed.
25 BRIEF DESCRIPTION OF THE DRAWINGS
4
[0010]
FIG. 1 is a perspective view illustrating the outer appearance of a photographing
apparatus according to the present embodiment.
FIG. 2 is a block diagram indicating the structure of the photographing apparatus
according to the present 5 embodiment.
FIG. 3 is a functional configuration diagram of the photographing apparatus
according to the present embodiment.
FIG. 4 is a hardware configuration diagram of a control apparatus and a facial
authentication apparatus according to the present embodiment.
10 FIG. 5 is a diagram indicating the processing flow in the photographing
apparatus according to the present embodiment.
FIG. 6 is a diagram indicating the minimum configuration of the photographing
apparatus according to the present embodiment.
15 EXAMPLE EMBODIMENT
[0011]
Hereinafter, a photographing apparatus according to an embodiment of the
present disclosure will be explained with reference to the drawings.
FIG. 1 is a perspective view illustrating the outer appearance of a photographing
20 apparatus according to the present embodiment.
The photographing apparatus 100 is, for example, an apparatus incorporated into
an entry/exit management system or the like for managing the entry and exit of people by
facial authentication. The photographing apparatus 100 takes photographs of people who
are entering or exiting a site. The photographing apparatus 100 is installed, for example,
25 at a position at which photographs of the faces of entering or exiting people can be taken
5
at an entrance/exit to a building, a property, or the like.
[0012]
As illustrated in FIG. 1, the photographing apparatus 100 is configured so as to
include a human sensor 3, a light-emitting device 4, a camera 5, slope LEDs
(Light-Emitting Diodes) 6, 5 and a display 7.
The human sensor 3 detects a photographic subject in front of the photographing
apparatus 100 by means of, for example, an infrared sensor or the like. The area in front
of the photographing apparatus 100 is the direction in which the camera takes
photographs.
10 The camera 5 takes a photograph of the photographic subject in front of the
photographing apparatus 100.
The light-emitting device 4 is provided in the vicinity of the camera 5. For
example, the light-emitting device 4 is composed of a plurality of light-emitting bodies
(for example, LEDs) that are installed in a ring along the circumferential direction around
15 a lens of the camera 5. The light-emitting device 4 serves the function of drawing the
photographic subject's attention towards the camera 5 and the function of a flash for the
camera 5.
The slope LEDs 6 are one or a plurality of light-emitting bodies installed on
each of left and right slopes on the photographing apparatus 100. The slope LEDs 6
20 provide notification of the results of facial authentication.
The display 7 is a display apparatus such as a liquid crystal display or an organic
EL (Electro-Luminescence) display. The display 7 displays an image taken by the camera
5.
[0013]
25 FIG. 2 is a block diagram indicating the structure of the photographing
6
apparatus.
The photographing apparatus 100 is provided with at least a control apparatus 1,
a facial authentication apparatus 2, the human sensor 3, the light-emitting device 4, the
camera 5, the slope LEDs 6, and the display 7.
5 [0014]
The facial authentication apparatus 2 is a facial authentication engine that
performs facial authentication by collating a facial photograph image of the photographic
subject, taken by the camera 5 at a photograph-taking timing, with pre-stored facial
photograph images of registrants. The registrants are, for example, people who are
10 authorized to enter or exit a site.
[0015]
FIG. 3 is a functional configuration diagram of the control apparatus.
The control apparatus 1 controls the light emission of the light-emitting device 4
and the slope LEDs 6. The control apparatus 1 starts when a power source is connected,
15 and executes a pre-stored photographing program. As a result thereof, the control
apparatus 1 is provided with at least a first light emission control unit 11, a detection unit
12, a second light emission control unit 13, a photography control unit 14, a display
control unit 15, and a notification unit 16.
[0016]
20 When a photographic subject is detected, the first light emission control unit 11
controls the light emission of the light-emitting device 4 in accordance with a first mode
for drawing the photographic subject's attention towards the camera 5. For example, the
first mode involves blinking blue light.
The detection unit 12 detects that a photograph-taking timing has arrived when
25 the interocular distance of the photographic subject in an image generated by the camera
7
5 in accordance with the first mode becomes at least a prescribed distance.
The second light emission control unit 13 controls the light emission of the
light-emitting device 4, at the photograph-taking timing, in accordance with a second
mode in which the light emission intensity is higher than in the first mode. For example,
the second mode, for functioning as a flash for the camera 5, involves 5 emitting white
light at a brightness higher than that in the first mode.
[0017]
The photography control unit 14 acquires an image taken by the camera 5 at the
photograph-taking timing for use in facial authentication, and outputs the acquired image
10 to the facial authentication apparatus 2.
The display control unit 15 controls a display on the display 7.
The notification unit 16 controls the light emission of the slope LEDs 6 to
provide notification of authentication results of the facial authentication in the facial
authentication apparatus 2.
15 [0018]
FIG. 4 is a hardware configuration diagram of the control apparatus and the
facial authentication apparatus.
As indicated by the drawing, the control apparatus 1 (facial authentication
apparatus 2) is a computer provided with hardware such as a CPU (Central Processing
20 Unit) 101 (201), a ROM (Read-Only Memory) 102 (202), a RAM (Random Access
Memory) 103 (203), a high-capacity storage apparatus 104 (204), and a communication
module 105 (205).
[0019]
FIG. 5 is a diagram indicating the processing flow in the photographing
25 apparatus.
8
Next, the processing flow in the photographing apparatus will be explained in
order.
First, the first light emission control unit 11 in the photographing apparatus 100
determines whether or not the human sensor 3 has detected a photographic subject (step
S101). If the human sensor 3 has not detected a photographic subject 5 (step S101; No),
then the first light emission control unit 11 repeats the process in step S101.
On the other hand, if the human sensor 3 has detected a photographic subject
(step S101; Yes), then the first light emission control unit 11 makes the light-emitting
device 4 blink blue light (light emission is controlled under the first mode) (step S102).
10 As a result thereof, the photographic subject's attention can be drawn towards the camera
5 so that the facial orientation or the line of sight of the photographic subject is directed
towards the camera 5. The photography control unit 14 instructs the camera 5 to take a
photograph during light emission control in accordance with the first mode. The
photography control unit 14 may instruct the camera 5 to take photographs multiple
15 times. As a result thereof, one or more sets of image data including images of the
photographic subject in a state in which the photographic subject's attention is drawn
towards the camera 5 can be generated. In other words, image data of the photographic
subject in a state facing directly towards the camera 5 can be acquired.
[0020]
20 Next, if an image photographed and generated by the camera 5 in accordance
with the first mode includes portions that can be recognized to be both irises of the
photographic subject, then the detection unit 12 determines that the facial orientation of
the photographic subject is directly towards the camera 5. The detection unit 12
computes the interocular distance of the photographic subject in the image including the
25 portions that can be recognized to be both irises. The interocular distance is the distance
9
between the left iris and the right iris. The detection unit 12 determines whether or not
the interocular distance in the image has become at least a prescribed distance (step
S103).
If the interocular distance in the image photographed by the camera 5 has
become at least the prescribed distance, then the following assumptions 5 can be made: the
photographic subject is facing directly towards the camera 5; the photographic subject is
advancing towards the camera 5; and the distance from the camera 5 to the photographic
subject is a distance (for example, 60 cm to 120 cm, etc.) suitable for photographing an
image (facial photograph) to be used for performing facial authentication. The detection
10 unit 12 can estimate the distance from the camera 5 to the photographic subject
corresponding to the interocular distance in the image based, for example, on statistical
information regarding interocular distances or the like. Therefore, the detection unit 12
can estimate the distance from the camera 5 to the photographic subject when the
interocular distance has become at least the prescribed distance. The detection unit 12
15 determines that the distance from the photographic subject to the apparatus has become a
distance suitable for taking a photograph when the interocular distance becomes at least
the prescribed distance. Thus, if the interocular distance has become at least the
prescribed distance (step S103; Yes), then the detection unit 12 detects that the
photograph-taking timing has arrived.
20 On the other hand, if the interocular distance has not become at least the
prescribed distance (step S103; Yes), then the detection unit 12 repeats the process in step
S103.
[0021]
The second light emission control unit 13 makes the light-emitting device 4
25 function as a flash for the camera 5, at the photograph-taking timing, by emitting white
10
light having a brightness greater than in the first mode (light emission is controlled under
the second mode in which the light emission intensity is higher than in the first mode)
(step S104). As a result thereof, the photographic subject's face can be brightly lit to take
a facial photograph suitable for facial authentication. The photography control unit 14
acquires a facial photograph image of the photographic subject taken 5 by the camera 5 at
the photograph-taking timing for use in facial authentication (step S105). In other words,
the photography control unit 14 instructs the camera 5 to take a photograph when light
emission is controlled in accordance with the second mode at the photograph-taking
timing. As a result thereof, image data taken in a state in which the light emission
10 intensity is high and in which the photographic subject is positioned within a prescribed
distance range from the camera 5 and is facing directly towards the camera 5 can be
acquired. The photography control unit 14 acquires the generated image data. The display
control unit 15 displays, on the display 7, the facial photograph image that has been
photographed and generated at the photograph-taking timing by the camera 5 (step
15 S106).
[0022]
The photography control unit 14 outputs the acquired facial photograph image
(image data including a facial image) to the facial authentication apparatus 2. The facial
authentication apparatus 2 executes a facial authentication process for verifying that the
20 photographic target is a registrant by collating the input image with pre-stored facial
photograph images of registrants (step S107). In other words, the facial authentication
apparatus 2 determines whether or not the photographic subject is the same person as a
registrant by collating the image data including the facial image of the photographic
subject with the pre-stored image data including the facial images of registrants.
25 [0023]
11
The facial authentication apparatus 2 outputs the authentication result to the
control apparatus 1. The authentication result is "OK" if the photographic subject is a
registrant and is "Failed" if the photographic subject is not a registrant. The notification
unit 16 in the control apparatus 1 determines whether or not the authentication result
input from the facial authentication apparatus 2 is "OK" or "Failed" 5 (step S108).
If the authentication result is "OK", then the notification unit 16 makes the slope
LEDs 6 emit green light (step S109). As a result thereof, the photographic subject can be
notified that the authentication result is "OK". Thereafter, the process ends. On the other
hand, if the authentication result is "Failed", then the notification unit 16 makes the slope
10 LEDs 6 emit red light (step S110). As a result thereof, the photographic subject can be
notified that the authentication result is "Failed". Thereafter, the process ends.
[0024]
In the above-described process, the notification unit 16 may provide notification
of the authentication results by outputting the authentication results in audio form from a
15 speaker (not illustrated).
Additionally, in the above-described process, the first light emission control unit
11 draws the photographic subject's attention towards the camera 5 by making the
light-emitting device 4 blink blue light. However, the light emission mode is not limited
thereto. Other light emission modes may be used as long as they are able to draw the
20 photographic subject's attention towards the camera 5.
Additionally, in the above-described process, the detection unit 12 detects that
the photograph-taking timing has arrived when the interocular distance becomes at least a
prescribed distance. However, in addition thereto, it can be determined that the
photograph-taking timing has arrived when the photographic subject's line of sight is
25 oriented directly towards the camera 5.
12
[0025]
According to the above-described process, the photographic subject's face can
be brightly lit and photographed when the photographic subject's face is oriented directly
towards the camera 5 and the distance from the photographic subject to the camera 5 has
become a prescribed distance. Thus, an image that is suitable for facial 5 authentication of
the photographic subject who is advancing towards the camera 5 can be photographed.
An image that is suitable for facial authentication is a facial photograph image of a
prescribed size, in which the photographic subject's face is brightly captured, without
shadows, and with the face or the line of sight oriented directly towards the camera 5.
10 [0026]
Additionally, according to the above-described process, when the first light
emission control unit 11 has detected a photographic subject, the light-emitting device 4
controls light emission in the first mode. For this reason, the photographic subject's
attention can be directed towards the camera 5, and the orientation of the face or the
15 orientation of the line of sight of the photographic subject can be directed towards the
camera 5.
Although a method, for example, in which an arrow pointing towards the camera
5 is displayed on the display 7 or the like to draw the photographic subject's attention
towards the camera 5 might be contemplated, in this case, the photographic subject often
20 does not notice or is late to notice the arrow. Additionally, in this case, the photographic
subject first looks at the arrow and then looks at the camera 5. Thus, some time passes
before the photographic subject's attention is turned towards the camera 5, and this time
causes a delay in facial authentication.
In contrast therewith, with the above-described photographing apparatus 100,
25 the light-emitting device 4, which is provided near the camera 5, is illuminated. For this
13
reason, the photographic subject can more easily notice the camera 5 in comparison with
an arrow, and the photographic subject's attention can immediately be drawn to the
camera 5.
[0027]
Additionally, according to the above-described process, the 5 detection unit 12
detects that the photograph-taking timing has arrived when the interocular distance of the
photographic subject becomes at least the prescribed distance based on the distance from
the photographic subject to the apparatus. For this reason, a time at which the
photographic subject's face is oriented directly towards the camera 5 and the distance
10 from the photographic subject to the photographing apparatus 100 has become a distance
suitable for photographing an image to be used for facial authentication can be identified
as the photograph-taking timing. Furthermore, people other than those advancing towards
the photographing apparatus 100, such as people crossing in front of the photographing
apparatus 100, can be excluded from the facial authentication targets.
15 [0028]
Additionally, according to the above-described process, the second light
emission control unit 13 controls the light emission of the light-emitting device 4, at the
photograph-taking timing, in accordance with a second mode in which the light emission
intensity is higher than in the first mode. For this reason, the photographic subject's face
20 can be brightly lit to take a facial photograph image suitable for facial authentication.
[0029]
Additionally, according to the above-described process, the light-emitting device
4 for directing the photographic subject's attention towards the camera 5 also functions as
a flash. For this reason, there is no need to install a separate light-emitting device for use
25 as a flash, and the cost can be reduced. In other words, the drawing of the photographic
14
subject's attention and the construction of an illuminated environment suitable for facial
authentication can be realized with a single light-emitting device 4 being used in a
sequence.
[0030]
While an embodiment of the present disclosure has been described 5 above, this
disclosure is not limited to the above-described embodiment, and various modifications
may be made within a scope not departing from the spirit of the present disclosure.
[0031]
For example, in the above-described embodiment, a case in which the
10 light-emitting device 4 is composed of a plurality of light-emitting bodies that are
installed in a ring along the circumferential direction around a lens of the camera 5 was
explained. However, the structure is not limited thereto. The light-emitting device 4 need
only be installed in the vicinity of the camera 5, and for example, may be composed of a
plurality of light-emitting bodies installed in a square around the lens of the camera.
15 Additionally, the light-emitting device 4 may be composed of a single light-emitting
body.
[0032]
FIG. 6 is a diagram indicating the minimum configuration of the photographing
apparatus.
20 The photographing apparatus 100 need only be provided with at least a camera 5,
a light-emitting device 4, a human sensor 3, a first light emission control unit 11, a
detection unit 12, and a second light emission control unit 13.
The light-emitting device 4 is provided in the vicinity of the camera 5.
The human sensor 3 detects a photographic subject.
25 The first light emission control unit 11 controls the light emission of the
15
light-emitting device 4 in accordance with a first mode when the photographic subject is
detected.
The detection unit 12 detects that a photograph-taking timing has arrived when
an interocular distance of the photographic subject in an image generated by the camera 5
in accordance with the first mode becomes at least a prescribed 5 distance.
The second light emission control unit 13 controls the light emission of the
light-emitting device 4, at the photograph-taking timing, in accordance with a second
mode in which the light emission intensity is higher than in the first mode.
[0033]
10 The control apparatus 1 and the facial authentication apparatus 2 described
above have computer systems contained therein. Furthermore, the steps in the
above-described process are stored in a computer-readable recording medium in the form
of a program, and the above-described process is performed by a computer reading out
and executing this program. In this case, the computer-readable recording medium refers
15 to a magnetic disc, a magneto-optic disc, a CD-ROM, a DVD-ROM, a semiconductor
memory device, or the like. Additionally, this computer program may be transmitted to a
computer by means of a communication line and the computer that has received this
transmission may execute said program.
[0034]
20 Additionally, the above-mentioned program may be for realizing a portion of the
aforementioned functions. Furthermore, the program may be in the form of a so-called
difference file (difference program) that can realize the aforementioned functions by
being combined with a program that is already recorded in a computer system.
[0035]
25 The present application claims the benefit of priority based on Japanese Patent
16
Application No. 2019-041795, filed March 7, 2019, the entire disclosure of which is
incorporated herein by reference.
INDUSTRIAL APPLICABILITY
5 [0036]
According to the present disclosure, an image that is suitable for facial
authentication of a photographic subject who is advancing towards a camera can be
photographed.
10 [Reference Signs List]
[0037]
100 Photographing apparatus
1 Control apparatus
11 First light emission control unit
15 12 Detection unit
13 Second light emission control unit
14 Photography control unit
15 Display control unit
16 Notification unit
20 2 Facial authentication apparatus
3 Human sensor
4 Light-emitting device
5 Camera
6 Slope LED
25 7 Display

CLAIMS

1. A photographing apparatus comprising:
a camera;
a light-emitting device provided in 5 the vicinity of the camera;
a human sensor that detects a photographic subject;
first light emission control means for controlling light emission of the
light-emitting device in accordance with a first mode when the photographic subject is
detected;
10 detection means for detecting that a photograph-taking timing has arrived when
an interocular distance of the photographic subject in an image generated by the camera
in accordance with the first mode becomes at least a prescribed distance; and
second light emission control means for controlling light emission of the
light-emitting device, at the photograph-taking timing, in accordance with a second mode
15 in which a light emission intensity is higher than in the first mode.
2. The photographing apparatus according to claim 1, further comprising
photography control means for acquiring an image photographed and generated
by the camera at the photograph-taking timing for use in facial authentication.
20
3. The photographing apparatus according to claim 1 or claim 2, wherein
the second light emission control means controls light emission of the
light-emitting device in accordance with the second mode for functioning as a flash for
the camera.
25
4. The photographing apparatus according to any one of claims 1 to 3, wherein
the first light emission control means controls light emission of the
light-emitting device in accordance with the first mode for drawing the photographic
subject's attention towards the camera.
5
5. The photographing apparatus according to any one of claims 1 to 4, wherein
the light-emitting device includes a plurality of light-emitting bodies installed in
a ring around a lens of the camera.
10 6. The photographing apparatus according to any one of claims 1 to 5, wherein
the detection means determines that a distance from the photographic subject to
the photographing apparatus has become suitable for taking a photograph when the
interocular distance of the photographic subject in the image becomes at least the
prescribed distance.
15
7. A photographing method comprising:
controlling light emission of a light-emitting device provided in the vicinity of a
camera in accordance with a first mode when a photographic subject is detected by a
human sensor;
20 detecting that a photograph-taking timing has arrived when an interocular
distance of the photographic subject in an image generated by the camera in accordance
with the first mode becomes at least a prescribed distance; and
controlling light emission of the light-emitting device, at the photograph-taking
timing, in accordance with a second mode in which a light emission intensity is higher
25 than in the first mode.
8. A storage medium storing a program that causes a computer in a photographing
apparatus to execute processes, the processes comprising:
controlling light emission of a light-emitting device provided in the vicinity of a
camera in accordance with a first mode when a 5 photographic subject is detected by a
human sensor;
detecting that a photograph-taking timing has arrived when an interocular
distance of the photographic subject in an image generated by the camera in accordance
with the first mode becomes at least a prescribed distance; and
10 controlling light emission of the light-emitting device, at the photograph-taking
timing, in accordance with a second mode in which a light emission intensity is higher
than in the first mode.