SP344602XX00
1/49
IMAGING DEVICE, IMAGING METHOD, PROGRAM, IMAGING SYSTEM,
AND ATTACHMENT DEVICE
BACKGROUND
5 [0001]
The present technology relates to an imaging device, an imaging method, a
program, an imaging system, and an attachment device, and enables easy obtainment
of a good skin image.
[0002]
10 Conventionally, in the beauty industry and the like, an imaging device is
used to capture skin, and a skin condition is analyzed based on the obtained skin
image. For example, in JP H6-105826A, skin is captured while lighting is provided
in a plurality of directions in sequence, and a three-dimensional shape of the surface
of skin is restored from obtained image signals, so that more accurate features of the
15 skin surface shape are extracted to conduct an analysis.
SUMMARY
[0004]
When the analysis of a skin condition and the like are conducted, it is not
20 possible to accurately conduct the analysis unless a clear skin image is used.
However, in an imaging device used for readily and readily checking a skin condition
and the like in a storefront and the like, the imaging device generally has a fixed
focus, or it is necessary for a skilled clerk and the like to manually set the focus.
For this reason, it is difficult for a general user to photograph a skin image suitable
25 for analysis.
[0005]
Thus, the present technology is directed to provide an imaging device, an
imaging method, a program, an imaging system, and an attachment device capable of
readily obtaining a good skin image.
30 [0006]
According to a first embodiment of the present disclosure, there is provided
SP344602XX00
2/49
an imaging device including a lighting unit whose lighting directions to a subject are
able to be switched, and a control unit that performs focus adjustment on the subject
for every lighting directions to calculate evaluation values in accordance with focus
states, and determines a direction in which a focus state becomes best as a lighting
5 direction based on the evaluation values to capture the subject.
[0007]
According to the embodiment, a lighting unit may be configured so that its
lighting directions to a subject are able to be switched. For example, the lighting
unit switches the lighting directions by emitting illumination light from different
10 positions in a circumferential direction with respect to an optical axis of an imaging
optical system. The lighting unit may switch irradiation angles of the illumination
light. The lighting unit may provide lighting using a light source having an
emission wavelength suitable for an analysis process performed using a captured
image of the subject. Further, the lighting unit may switch the lighting directions by
15 switching light sources emitting illumination light, or controlling passage of
illumination light emitted from a light source using a shutter.
[0008]
A control unit may perform focus adjustment on the subject for every
lighting directions to calculate evaluation values in accordance with focus states, and
20 may determine a direction in which a focus state becomes best as a lighting direction
based on the evaluation values to capture the subject. The control unit may thin out
the lighting directions in the circumferential direction, perform focus adjustment on
the subject for every lighting directions after thinning out to calculate evaluation
values in accordance with focus states, and calculate evaluation values of the
25 thinned-out lighting directions from the calculated evaluation values. Or, the
control unit may group the lighting directions in the circumferential direction, and
perform focus adjustment on the subject for every lighting directions in one group to
calculate evaluation values in accordance with focus states. Note that the control
unit may include lighting directions crossing at right angles in the one group.
30 Further, the control unit may move a focus position by a predetermined distance with
respect to a focus adjustment position at which the focus state becomes best based on
SP344602XX00
3/49
the evaluation values.
[0009]
According to a second embodiment of the present disclosure, there is
provided an imaging method including providing lighting to a subject in a manner
5 that lighting directions are able to be switched, and performing focus adjustment on
the subject for every lighting directions to calculate evaluation values in accordance
with focus states, and determining a direction in which a focus state becomes best as
a lighting direction based on the evaluation values to capture the subject.
[0010]
10 According to a third embodiment of the present disclosure, there is provided
a program causing a computer to control operation of an imaging device having a
lighting unit whose lighting directions to a subject are able to be switched, and to
carry out a procedure of performing focus adjustment on the subject for every
lighting directions to calculate evaluation values in accordance with focus states, and
15 determining a direction in which a focus state becomes best as a lighting direction
based on the evaluation values to capture the subject.
[0011]
In addition, a program according to the present technology is a program
capable of being provided via a recording medium or a communication medium
20 providing various programs and codes, for example, to a general purpose computer
executable of these in a computer-readable format, for example, a recording medium
such as an optical disk, a magnetic disk and a semiconductor memory, or a
communication medium such as a network. Such a program realizes a computer
performing processes according to the program, provided in a computer-readable
25 format.
[0012]
According to a fourth embodiment of the present disclosure, there is
provided an imaging system including an imaging device that generates a captured
image of a subject, and an analysis device that analyzes the subject using the
30 captured image. The imaging device may be configured to use a light source
suitable for analyzing the subject, and include a lighting unit whose lighting
SP344602XX00
4/49
directions to the subject are able to be switched, and a control unit that performs
focus adjustment on the subject for every lighting directions to calculate evaluation
values in accordance with focus states, and determines a direction in which a focus
state becomes best as a lighting direction based on the evaluation values to capture
5 the subject.
[0013]
According to a fifth embodiment of the present disclosure, there is provided
an attachment device including a lighting unit whose lighting directions to a subject
are able to be switched. The lighting unit may switch lighting directions according
10 to an instruction from an external device, or automatically switches lighting
directions and outputs information indicating a lighting direction to the external
device.
[0014]
According to a sixth embodiment of the present disclosure, there is provided
15 an imaging device including a reference pattern unit that is installed in a manner that
a reference pattern used in adjustment for capturing a subject is included in an
imaging angle of view, and a control unit that captures the subject after adjustment
for capturing the subject using the reference pattern.
[0015]
20 According to a seventh embodiment of the present disclosure, there is
provided an attachment device including a reference pattern unit that is installed in a
manner that a reference pattern used in adjustment for capturing a subject is included
in an imaging angle of view.
[0016]
25 According to this technology, since lighting directions to a subject can be
switched, focus adjustment is performed on a subject for every lighting directions to
calculate evaluation values in accordance with focus states, and a direction in which
a focus state becomes best is determined as a lighting direction based on the
evaluation values to capture the subject. For this reason, lighting is provided in an
30 optimal direction to perform focus adjustment, and it becomes possible to readily
obtain a skin image whose focus state is good.
SP344602XX00
5/49
BRIEF DESCRIPTION OF THE DRAWINGS
[0017]
FIG 1 is a diagram showing an example of a configuration of a skin
5 condition analysis system;
FIG 2 is a diagram showing examples of a connection state between an
imaging device, an analysis device, and a display device;
FIG 3 is a diagram schematically showing an outer appearance of an
imaging device;
10 FIG 4 is a diagram showing examples of light sources installed in an
attachment device;
FIG 5 is a diagram schematically showing an internal configuration of an
imaging device;
FIG. 6 is a diagram showing an example of another configuration of light
15 sources;
FIG 7 is a diagram illustrating a case in which a plurality of lighting
modules are installed;
FIG. 8 is a diagram showing an example of a configuration of a case in
which a lighting direction is changed by controlling passage of illumination light;
20 FIG. 9 is a diagram showing examples of a relationship between a condition
of a skin surface and an irradiation angle of illumination light with respect to the skin
surface;
FIG. 10 is a diagram showing an example of a configuration of an
attachment device when an output position of illumination light and a lighting
25 direction are changed;
FIG. 11 is a diagram showing an example of a case in which illumination
light is emitted from an external light source to a skin surface;
FIG. 12 is a diagram showing a case in which an indication display unit that
indicates a lighting direction is installed;
30 FIG. 13 is a block diagram showing a functional configuration of an imaging
device;
SP344602XX00
6/49
FIG. 14 is a flowchart illustrating operation of an imaging device;
FIG 15 is a flowchart illustrating operation of an imaging device when light
sources are thinned out and caused to emit light;
FIG. 16 is a diagram illustrating operation of an imaging device when light
5 sources are thinned out and caused to emit light;
FIG. 17 is a flowchart illustrating operation of an imaging device when a
lighting direction is set within an adjustment range of 0 to 180 degrees;
FIG 18 is a diagram illustrating operation of an imaging device when a
lighting direction is set within an adjustment range of 0 to 180 degrees;
10 FIG 19 is a diagram illustrating operation of an imaging device when an
adjustment range of a lighting direction is further reduced;
FIG. 20 is a diagram showing a case in which 20 light sources have been
divided into two groups often consecutive light sources;
FIG 21 is a diagram showing a case in which 20 light sources have been
15 divided into four groups of five consecutive light sources;
FIG. 22 is a diagram showing examples of images captured in the case of
changing a lighting direction;
FIG. 23 is a diagram showing an example of a light source installed in an
attachment device;
20 FIG. 24 is a diagram schematically showing an internal configuration of an
imaging device;
FIG. 25 is a diagram showing an example of a case in which a light source
and a light guide path are combined;
FIG. 26 is a diagram showing an example of a case in which a light source
25 and a light guide path are combined;
FIG. 27 is a diagram showing an example of a case in which there are body
hairs and the like;
FIG. 28 is a diagram showing a case in which information is acquired by
focusing on the inside of skin;
30 FIG 29 is a diagram showing an example of a configuration of an analysis
device;
SP344602XX00
7/49
FIG 30 is a block diagram showing examples of functional configurations
of an epidermis image processing unit and an epidermis pattern detection unit;
FIG 31 is a block diagram showing an example of a functional
configuration of an acquired element analysis unit;
5 FIG 32 is a diagram schematically showing an internal configuration of an
imaging device;
FIG. 33 is a diagram showing an example of a reference pattern;
FIG. 34 is a diagram showing a modified example of a reference pattern;
FIG. 35 is a diagram showing a modified example of a reference pattern;
10 FIG 36 is a diagram showing a modified example of a reference pattern;
FIG. 37 is a diagram showing a modified example of a reference pattern;
FIG. 38 is a diagram showing a case in which a reference pattern is formed
on a flexible member;
FIG. 39 is a flowchart illustrating operation of an imaging device;
15 FIG 40 is a flowchart illustrating operation of a correction process;
FIG. 41 is a diagram showing a case in which a reference pattern has a thick
thickness;
FIG. 42 is a diagram showing a case in which information is acquired by
focusing on the inside of a subject; and
20 FIG. 43 is a diagram showing a configuration that connects a camera cone
with an attachment device through an elastic body.
DETAILED DESCRIPTION OF THE EMBODIMENT(S)
[0000]
25 Hereinafter, preferred embodiments of the present technology will be
described in detail with reference to the appended drawings. Note that, in this
specification and the appended drawings, structural elements that have substantially
the same function and structure are denoted with the same reference numerals, and
repeated explanation of these structural elements is omitted.
30 [0018]
Hereinafter, modes for carrying out will be described. Description will be
SP344602XX00
8/49
made in the following order.
1. Regarding Skin Analysis System
2. First Embodiment
2-1. Regarding Imaging Device
5 2-1 -1. Configuration of Imaging Device
2-1-2. Operation of Imaging Device
2-1-3. Another Configuration of Attachment Device
2-1-4. Focus Operation of Imaging Device
2-2. Regarding Analysis Device
10 2-3. Regarding Display Device
3. Second Embodiment
3-1. Configuration of Imaging Device
3-2. Operation of Imaging Device
3-3. Another Configuration of Attachment Device
15 3-4. Regarding Image Processing Device and Display Device
[0019]
<1. Regarding Skin Analysis System>
FIG. 1 shows an example of a configuration of a skin condition analysis
system. A skin condition analysis system 10 has a configuration including an
20 imaging device 20, an analysis device 40, and a display device 60. The imaging
device 20 switches lighting directions to perform focus adjustment for every
directions, thereby determining an optimal focus position. Also, the imaging device
20 outputs an image signal of a skin image obtained by carrying out photography at
the determined optimal focus position to the analysis device 40. The analysis
25 device 40 performs analysis of a skin condition and the like based on the image
signal of the skin image supplied from the imaging device 20, generates a display
signal indicating the analysis results, and outputs the display signal to the display
device 60. The display device 60 performs image display based on the display
signal supplied from the analysis device 40, thereby displaying the analysis results of
30 the skin condition and the like on a screen.
[0020]
SP344602XX00
9/49
FIG. 2 shows examples of a connection state between the imaging device 20,
the analysis device 40, and the display device 60. For example, as shown in FIG
2(A), the imaging device 20 and the analysis device 40, and the analysis device 40
and the display device 60 are connected through wired transmission paths. Also, as
5 shown in FIG 2(B), the imaging device 20 and the analysis device 40, and the
analysis device 40 and the display device 60 may be configured to be connected
through wireless transmission paths. Furthermore, as shown in FIG. 2(C), the
imaging device 20 and the analysis device 40 may be integrally configured.
Although not shown in the drawing, the analysis device 40 and the display device 60
10 may be integrally configured, or the imaging device 20, the analysis device 40 and
the display device 60 may be integrally configured.
[0021]
<2. First Embodiment>
[2-1. Regarding Imaging Device]
15 [2-1 -1. Configuration of Imaging Device]
The imaging device 20 is configured so that it is possible to switch lighting
directions and capture skin. FIG. 3 schematically shows an outer appearance of the
imaging device 20. Here, FIG 3(A) is a front view of the imaging device 20, and
FIG. 3(B) is a side view of the imaging device 20. On the front end of a camera
20 cone 21 of the imaging device 20, an attachment device 71 is installed. The
attachment device 71 may be integrally configured with the camera cone 21, or may
be configured to be attachable to and detachable irom the camera cone 21.
[0022]
The attachment device 71 has a lighting unit whose lighting directions to a
25 subject can be switched. For example, on the front end of the attachment device 71,
a plurality of light sources 711 (for example, LED (Light Emitting Diode) 1 to LEDn)
constituting the lighting unit are arranged in a ring shape as shown in FIG. 4, and are
configured so that a lighting direction to a skin surface which is a subject can be
changed by switching light sources that are caused to emit light. A wavelength
30 band of a light source may be a visible region (400 to 700 nm), and an image sensor
that will be described later may be a general image sensor that has spectral sensitivity
SP344602XX00
10/49
in the visible region, for example, an image sensor that employs a filter of three
primary colors of RGB.
[0023]
FIG. 5 schematically shows an internal configuration of the imaging device
5 20. In the camera cone 21, an imaging optical system 22 and an image sensor 25
are installed.
[0024]
Although FIG 4 shows a case in which a lighting unit is configured by
arranging a plurality of light sources toward a subject side in a ring shape on the
10 front end side of a camera cone, the lighting unit is not limited to the configuration
shown in FIG. 4. Next, an example of another configuration of the lighting unit will
be shown.
[0025]
FIG. 6 shows a case in which illumination light emission positions and the
15 plurality of light sources 711 are each coupled with optical fibers 712, and light
emitted from the light sources 711 is output from the illumination light emission
positions to a skin surface through the optical fibers 712. Also, FIG. 6 shows a case
in which four light sources are installed. As describe above, by guiding
illumination light from a light source using a light guide path such as an optical fiber,
20 limitations of the size of the light sources 711 and the like are reduced, and it is
possible to increase the degree of freedom in designing an attachment device.
[0026]
FIG. 7 shows an example of a case in which a plurality of lighting modules
are installed, and lighting directions to a skin surface are switched by switching
25 modules that emit illumination light. As shown in FIG 7(A), a light source 713a
and a light guide plate 713b are installed in a case of a lighting module 713, and the
light source 713a is installed at an end of the light guide plate 713b. A diffusion
plate 713c is installed in an illumination light emission surface of the case, and a
reflection plate 713d is installed in the other surface side.
30 [0027]
Light emitted from the light source 713a is directly incident on the light
SP344602XX00
11/49
guide plate 713b, or is reflected by the reflection plate 713d and incident on the light
guide plate 713b. The light incident on the light guide plate 713b is reflected by the
reflection plate 713d and incident again on the light guide plate 713b. Light emitted
from an illumination light emission surface of the light guide plate 713b is difiused
5 by the difiusion plate 713c and emitted from the lighting module 713.
[0028]
FIG. 7(B) shows an example of the attachment device 71 in which a
plurality of lighting modules 713 are installed. Illumination light emission surfaces
of the plurality of lighting modules 713 used in the attachment device 71 are attached
10 toward the direction of a skin surface. FIG. 7(B) shows an example of a case in
which four lighting modules are employed.
[0029]
As describe above, using the plurality of lighting modules 713, lighting
modules 713 that emit illumination light are switched, and thereby a lighting
15 direction to a skin surface can be changed.
[0030]
Although, in the configuration described above, an example of a case in
which a lighting direction to a skin surface is changed by switching light sources that
emit illumination light has been shown, a change of a lighting direction is not limited
20 to a switch of light sources but may be accomplished through another method. For
example, passage of illumination light emitted from a light source may be controlled
by a shutter, and thereby lighting directions may be switched.
[0031]
FIG 8 shows an example of a configuration of a case in which a lighting
25 direction is changed by controlling passage of illumination light. As shown in FIG
8(A), the attachment device 71 has a ring light 714 and a shutter 715 having a ring
shape. The ring light 714 emits illumination light toward the direction of a skin
surface. The shutter 715 is installed on an illumination light emission side of the
ring light 714. The shutter 715 is configured using, for example, liquid crystal
30 elements, and configured to be able to control passage of illumination light for each
of a plurality of divided regions. In the attachment device 71 configured in this way.
SP344602XX00
12/49
a lighting direction is changed by moving a region (open shutter region) which
enables illumination light to be passed as shown in FIG. 8(B).
[0032]
As described above, the attachment device 71 switches light sources that are
5 turned on or open shutter regions, that is, emits illumination light from a different
position in a circumferential direction with reference to an optical axis of an imaging
optical system, thereby switching lighting directions.
[0033]
Here, when a level difference of a skin surface is small, it is possible to
10 accurately detect depressions of the skin surface (wrinkles and the like) by
controlling a lighting direction. However, when a level difference of a skin surface
is large, there is a concern about a portion in which it is not possible to detect
depressions of the skin surface even by controlling a lighting direction.
[0034]
15 FIG. 9 shows examples of a relationship between a condition of a skin
surface and an irradiation angle of illumination light with respect to the skin surface.
For example, FIG. 9(A) shows a case in which a level difference of a skin surface is
small, and an irradiation angle of illumination light is large (when an output position
of illumination light is high), and FIG. 9(B) shows a case in which a level difference
20 of a skin surface is small, and an irradiation angle of illumination light is small
(when an output position of illumination light is low). Also, FIG. 9(C) shows a case
in which a level difference of a skin surface is large, and an irradiation angle of
illumination light is large, and FIG 9(D) shows a case in which a level difference of
a skin surface is large, and an irradiation angle of illumination light is small.
25 [0035]
As shown in FIGS. 9(A) and 9(B), when a level difference of a skin surface
is small, a shadow (indicated by an arrow) is generated in a depressed portion of the
skin surface, so that the depression of the skin surface can be accurately detected
regardless of an irradiation angle of illumination light. As shown in FIG 9(C), even
30 if a level difference of a skin surface is large, when an irradiation angle of
illumination light is large, a shadow (indicated by an arrow) is generated in a
SP344602XX00
13/49
depressed portion of the skin surface, so that the depression of the skin surface can
be accurately detected. However, as shown in FIG 9(D), when a level difference of
a skin surface is large, and an irradiation angle of illumination light is small, a
depressed portion of the skin surface is hidden in a shadow (indicated by an arrow),
5 and there is a concern that the depression of the skin surface becomes unable to be
accurately detected. Thus, by enabling a switch of irradiation angles of illumination
light, a change of a lighting direction may be enabled.
[0036]
FIG. 10 shows an example of a configuration of the attachment device 71
10 when an output position and a lighting direction of illumination light are changed.
Here, FIG. 10 shows a configuration in which an irradiation angle of illumination
light can be changed in two stages, and a lighting direction can be changed with four
directions.
[0037]
15 The attachment device 71 has optical fibers 716-1 to 716-4 that output
illumination light at first output positions, and optical fibers 717-1 to 717-4 that
output illumination light at second output positions that are farther from a skin
surface than the first output positions. On an opposite surface side of an
illumination light emission surface of the optical fibers 716-1 to 716-4, a light source
20 719 is installed with a shutter 718 interposed therebetween. Also, on an opposite
surface side of an illumination light emission surface of the optical fibers 717-1 to
717-4, a light source 721 is installed with a shutter 720 interposed therebetween.
The attachment device 71 configured in this way outputs illumination light fi-om, for
example, the light source 719 toward the shutter 718. The shutter 718 controls
25 incidence of the illumination light emitted from the light source 719 to the optical
fibers 716-1 to 716-4 to decrease an irradiation-angle of the illumination light,
thereby switching lighting directions. Also, illumination light is output from the
light source 721 toward the shutter 720. The shutter 720 controls incidence of the
illumination light emitted from the light source 721 to the optical fibers 717-1 to
30 717-4 to increase an irradiation angle of the illumination light, thereby switching
lighting directions. In this way, even when a level difference of a skin surface is
SP344602XX00
14/49
large, it becomes possible to detect depressions of the skin surface. Also, by
causing illumination light from a light source to be incident on respective optical
fibers through a shutter that employs liquid crystals and the like, it becomes possible
to concentrate switch portions of lighting to one spot. Accordingly, the shutter can
5 be downsized. Also, it is possible to reduce a region and the like necessary for a
control line for controlling operation of the shutter. Although FIG. 10 shows an
example of a configuration in which optical fibers are employed, light sources may
be installed at positions in illumination light emission surfaces of optical fibers, and
an irradiation angle and a lighting direction of illumination light may be changed by
10 switching light sources that output the illumination light.
[0038]
In the imaging device 20, a transparent attachment component 81 may be
installed on the front end of the camera cone 21, and as shown in FIG 11,
illumination light may be emitted from an external light source 91 to a skin surface.
15 Also, as shown in FIG. 12, an indication display unit 82 that indicates a lighting
direction may be installed on the attachment component 81 so as to be capable of
determinng a direction from which illumination light is emitted, and illumination
light may be emitted from a direction indicated by the indication display unit 82 to a
skin surface.
20 [0039]
FIG 13 is a block diagram showing a fiinctional configuration of the
imaging device 20. The imaging device 20 has an imaging optical system 22, an
imaging optical system drive unit 23, the image sensor 25, a signal processing unit
26, a control unit 31, a memory unit 32, and the attachment device 71.
25 [0040]
The imaging optical system 22 is configured using a focus lens, a zoom lens,
or the like, and forms an optical image of a subject on an imaging surface of the
image sensor 25 in a desired size.
[0041]
30 The imaging optical system drive unit 23 drives a focus lens or a zoom lens
of the imaging optical system 22 based on a control signal from the control unit 31.
SP344602XX00
15/49
[0042]
The image sensor 25 is configured using an imaging element such as a
CMOS (Complementary Metal Oxide Semiconductor), a CCD (Charge Coupled
Device), or the like. The image sensor 25 performs light source conversion,
5 generates an image signal in accordance with the optical image of the subject, and
outputs the image signal to the signal processing unit 26.
[0043]
The signal processing unit 26 performs a variety of camera signal processes,
for example, adjustment of brightness, color, or the like, a process for improving
10 picture quality, and the like, on the image signal supplied from the image sensor 25,
and outputs the processed image signal to the analysis device 40.
[0044]
The control unit 31 controls operation of the image sensor 25 or the signal
processing unit 26 and the attachment device 71, and generates an image signal of a
15 skin image. In generation of the image signal of the skin image, the control unit 31
performs focus adjustment on a skin surface that is a subject for every lighting
directions, and calculates evaluation values in accordance with focus states. The
control unit 31 determines a direction in which a focus state becomes best as a
lighting direction based on the calculated evaluation values to capture the subject.
20 [0045]
The memory unit 32 stores information necessary for performing operation
control of the imaging device 20 and the like. For example, the evaluation values
for every lighting directions calculated by the control unit 31 are stored, so that the
control unit 31 can capture in the optimal focus state based on the stored evaluation
25 values.
[0046]
The attachment device 71 performs a switch of lighting directions and the
like according to an instruction from the control unit 31 of the imaging device 20 so
that capturing can be performed in the optimal focus state or the like. Also, the
30 attachment device 71 may be a configuration that automatically switches lighting
directions and outputs information indicating a lighting direction to the control unit
SP344602XX00
16/49
31 of the imaging device 20.
[0047]
[2-1-2. Operation of Imaging Device]
Next, operation of an imaging device will be described. FIG 14 is a
5 flowchart illustrating operation of an imaging device. In step STl, the imaging
device 20 performs initial setup. The imaging device 20 sets a parameter "i"
indicating a light source that will be turned on as, for example, "i = 1," and the
process proceeds to step ST2.
[0048]
10 In step ST2, the imaging device 20 turns on an i* light source of the
attachment device 71, and the process proceeds to step ST3.
[0049]
In step STB, the imaging device 20 performs focus adjustment. The
imaging device 20 performs focus adjustment based on a captured image generated
15 by an image sensor. Also, the imaging device 20 calculates an evaluation value
indicating a focus state, and the process proceeds to step ST4. The evaluation value
may be information that changes according to the focus state. For example, when
focus adjustment is performed using a contrast method, the imaging device 20
calculates a difference in brightness level with an adjacent pixel for each pixel of a
20 captured image as represented in equation (1), and uses the sum of absolute values of
the differences in brightness level calculated for every pixels as an evaluation value
Fv. In equation (1), "I(x,y)" represents a pixel value (brightness level) at a pixel
position (x,y). Also, a plurality of evaluation regions may be set in the captured
image, as represented in equation (2), the sum of absolute values of differences in
25 brightness level with adjacent pixels may be calculated in each evaluation region,
and the sums calculated for every regions may be summed up to be set as an
evaluation value. In equation (2), "Bi" represents an i* region, and "I(x,y)"
represents a pixel value (brightness level) at a pixel position (x,y) in the i'*' region Bi.
For example, when focus adjustment is performed using a phase difference method,
30 it is preferable for the imaging device 20 to use a phase difference of an optical
image formed on a focus sensor of the phase difference method as an evaluation
SP344602XX00
17/49
value. In addition, the imaging device 20 may extract high frequency components
of a predetermined band from the captured image, and use the sum of absolute values
of the extracted high frequency components as an evaluation value.
Fv = 2;(|l(x - l,y) - I(x, y)| + |l(x,y - 1) - I(x,y)|) ..-(i)
x,y
F^= 2 2(|l(x -l,y)-I(x,y)| + |l(x,y-l)-I(x,y)|) .-.(2)
i x,yGB,
5 [0050]
In step ST4, the imaging device 20 determines whether adjustment has been
performed on all light sources. For example, when n light sources having different
lighting directions are installed, the imaging device 20 determines that adjustment
has been performed on all the light sources in the case of i = n, and the process
10 proceeds to step ST6. In the case of i < n, the imaging device 20 determines that
adjustment has not been performed on all the light sources, and the process proceeds
to step ST5.
[0051]
In step ST5, the imaging device 20 performs an arithmetic operation of "i =
15 i + 1" to update the parameter i, and the process returns to step ST2.
[0052]
In step ST6, the imaging device 20 determines optimal focus. Based on
the evaluation values calculated for every lighting directions, the imaging device 20
determines a lighting direction in which a focus state becomes best, and the process
20 proceeds to step ST7.
[0053]
In step ST7, the imaging device 20 carries out photography. The imaging
device 20 provides lighting in the lighting direction determined in step ST6 and
performs an imaging operation, thereby acquiring an image signal of a skin image.
25 [0054]
By performing such a process, the imaging device 20 can readily obtain a
SP344602XX00
18/49
good skin image. In addition, when the attachment device 71 automatically
switches lighting directions, the imaging device 20 can determine a lighting direction
in which a focus state becomes best by associating information indicating a lighting
direction with an evaluation value.
5 [0055]
Operation of FIG. 14 illustrates a case in which n light sources are caused to
emit light in sequence, but if n light sources are caused to emit light in sequence, the
time necessary for determining optimal focus lengthens when there are many light
sources. Thus, the imaging device 20 thins out lighting directions in a
10 circumferential direction, for example, thins out and turns on light sources disposed
in a ring shape, and performs focus adjustment on a subject for each lighting
direction after thinning out, thereby calculating an evaluation value in accordance
with a focus state. Also, evaluation values of the thinned-out lighting directions,
that is, light sources that have not emitted light, are calculated by interpolation. In
15 this way, evaluation values for every lighting directions are calculated, so that a
lighting direction in which a focus state becomes best can be determined from the
calculated evaluation values in a short time.
[0056]
FIG 15 is a flowchart illustrating operation of an imaging device when light
20 sources are thinned out and caused to emit light. FIG 15 shows an example of a
case in which the number of light sources is "24," and a thinning-out interval is "2."
In step STII, the imaging device 20 performs initial setup. The imaging device 20
sets a parameter "i" indicating a light source that will be turned on as, for example, "i
= 1," and the process proceeds to step ST12.
25 [0057]
In step ST 12, the imaging device 20 turns on an i* light source of the
attachment device 71, and the process proceeds to step STI3.
[0058]
In step ST13, the imaging device 20 performs focus adjustment. The
30 imaging device 20 performs focus adjustment based on a captured image generated
by an image sensor. Also, the imaging device 20 calculates an evaluation value
SP344602XX00
19/49
indicating a focus state, and the process proceeds to step ST14.
[0059]
In step ST14, the imaging device 20 determines whether adjustment has
been performed on all light sources that emit light. When it is determined that
5 adjustment has been performed on all the light sources emitting light, the process of
the imaging device 20 proceeds to step ST 16. When there remains a light source on
which adjustment has not been finished among all the light sources emitting light, the
process proceeds to step ST15.
[0060]
10 In step ST 15, the imaging device 20 performs an arithmetic operation of "i
= i + 3" to update the parameter i, and the process returns to step ST12.
[0061]
In step ST 16, the imaging device 20 calculates evaluation values of thinnedout
light sources that have not emitted light. The imaging device 20 calculates the
15 evaluation values of the thinning-target light sources that have not emitted light due
to the thinning-out from evaluation values of light sources that have emitted light by
interpolation, for example, spline interpolation or the like.
[0062]
In step ST 17, the imaging device 20 detects an optimal evaluation value.
20 The imaging device 20 detects an evaluation value at which a focus state becomes
best as the optimal evaluation value, and the process proceeds to step STI8.
[0063]
In step ST 18, the imaging device 20 provides lighting using an optimal light
source. The imaging device 20 provides lighting using a light source corresponding
25 to the optimal evaluation value, and the process proceeds to step STI9.
[0064]
In step ST 19, the imaging device 20 performs focus adjustment. The
imaging device 20 performs focus adjustment in a state of lighting performed in step
ST 18, and the process proceeds to step ST20.
30 [0065]
In step ST20, the imaging device 20 carries out photography. The imaging
SP344602XX00
20/49
device 20 performs an imaging operation in the state of the lighting provided in step
ST18 and a focus state adjusted in step ST19, thereby acquiring an image signal of a
skin image.
[0066]
5 When such operation is performed, as shown in FIG 16(A), light sources
indicated by black circles are determined as thinning-target light sources, and light
sources indicated by white circles are used in sequence to provide lighting, so that
evaluation values (white circles) are calculated as shown in, for example, FIG. 16(B).
In addition, evaluation values (black circles) of the other light sources are calculated
10 by interpolation or the like. Furthermore, based on the evaluation values for every
light sources, a light source by which a focus state becomes best, for example, a fifth
light source whose evaluation value becomes the largest (light source indicated by a
number in a circle), is used as a light source for lighting used in capturing to capture.
[0067]
15 As a method of preventing lengthening of the time necessary until
determining optimal focus, an adjustment range of a lighting direction may be
reduced.
[0068]
FIG 17 is a flowchart illustrating operation of an imaging device when a
20 lighting direction is set within an adjustment range of 0 to 180 degrees. For
example, FIG. 17 shows a case in which the number of light sources is "24," and first
to 12* light sources are selected in sequence and used for lighting. In step ST31,
the imaging device 20 performs initial setup. The imaging device 20 sets a
parameter "i" indicating a light source that will be turned on as, for example, "i = 1,"
25 and the process proceeds to step ST32
[0069]
In step ST32, the imaging device 20 turns on an i light source of the
attachment device 71, and the process proceeds to step ST33.
[0070]
30 In step ST33, the imaging device 20 performs focus adjustment. The
imaging device 20 performs focus adjustment based on a captured image generated
SP344602XX00
21/49
by an image sensor. Also, the imaging device 20 calculates an evaluation value
indicating a focus state, and the process proceeds to step ST34.
[0071]
In step ST34, the imaging device 20 determines whether adjustment has
5 been performed on all light sources that emit light. When it is determined that
adjustment has been performed on all the light sources emitting light, that is, when i
= 12, the process of the imaging device 20 proceeds to step ST36. When
adjustment on all the light sources emitting light has not been finished, the process
proceeds to step STB 5.
10 [0072]
In step ST35, the imaging device 20 performs an arithmetic operation of "i
= i + 1" to update the parameter i, and the process returns to step ST32.
[0073]
In step ST36, the imaging device 20 detects an optimal evaluation value.
15 The imaging device 20 detects an evaluation value at which a focus state becomes
best as the optimal evaluation value, and the process proceeds to step ST37.
[0074]
In step ST37, the imaging device 20 provides lighting using an optimal light
source. The imaging device 20 provides lighting using a light source corresponding
20 to the optimal evaluation value, and the process proceeds to step ST38.
[0075]
In step ST38, the imaging device 20 performs focus adjustment. The
imaging device 20 performs focus adjustment in a state of the lighting provided in
step ST37, and the process proceeds to step ST39.
25 [0076]
In step ST39, the imaging device 20 captures. The imaging device 20
performs an imaging operation in the state of the lighting provided in step ST37 and
a focus state adjusted in step ST38, thereby acquiring an image signal of a skin
image.
30 [0077]
When such operation is performed, as shown in FIG 18(A), lighting is
SP344602XX00
22/49
provided using only light sources indicated by white circles in sequence, and
evaluation values are calculated as shown in, for example, FIG 18(B). Based on
the evaluation values for every light sources, a light source by which a focus state
becomes best, for example, a fifth light source whose evaluation value becomes the
5 largest (light source indicated by a number in a circle), is used as a light source for
lighting used in capturing to capture.
[0078]
In addition, when only the light sources indicated by the white circles are
used in sequence to provide lighting as shown in FIG. 19, an adjustment range of a
10 lighting direction can be further reduced to capture. In this case, in step ST34 of
FIG. 17, the process may be performed to proceed to step ST36 when i = 6.
[0079]
Furthermore, even when n light sources are grouped, and light sources
caused to emit light are switched in group units, it is possible to prevent lengthening
15 of the time necessary until determining optimal focus.
[0080]
FIG. 20 shows an example of a case in which 20 light sources have been
divided into two groups of ten consecutive light sources, and FIG. 21 shows an
example of a case in which 20 light sources have been divided into four groups of
20 five consecutive light sources.
[0081]
When n light sources are caused to emit light in sequence, the imaging
device 20 is not limited to a case of sequentially causing the n light sources to emit
light in group units, but may cause all the light sources to emit light, calculate
25 evaluation values, and determine optimal focus in consideration of the calculated
evaluation values as well.
[0082]
FIG 22 shows examples of images captured in the case of changing a
lighting direction. FIG. 22(A) shows an example of an image of a case in which
30 lighting is provided in a perpendicular direction to a groove direction of wrinkles,
FIG. 22(B) shows an example of the image of a case in which lighting is provided in
SP344602XX00
23/49
a parallel direction to the groove direction of wrinkles, and FIG. 22(C) shows an
example of an image of a case in which lighting is provided in all directions. Also,
FIG. 22(D) shows examples of evaluation values of a case in which 24 light sources
are switched and turned on in sequence. If wrinkles are noticed, an evaluation
5 value becomes large when lighting is provided in a direction crossing the wrinkles at
right angles, and thus there are two peaks when a lighting direction is moved by 360
degrees. Accordingly, when an evaluation value calculated from, for example, the
image shown in FIG. 22(A) is determined as an evaluation value of a lighting
direction in which a focus state becomes best, lighting is provided in the
10 perpendicular direction to the groove direction of the wrinkles, and the focus
adjustment is performed to capture. Also, FIGS. 22(E) to 22(G) show captured
images of skin in which wrinkles are not noticed. FIG 22(E) corresponds to the
same lighting direction as that of FIG. 22(A), and FIGS. 22(F) and 22(G) correspond
to the same lighting direction as that of FIGS. 22(B) and 22(C). If a shape of a skin
15 bump of skin in which wrinkles are not noticed is, for example, a quadrilateral shape,
there are four peaks as shown in FIG. 22(H) when a lighting direction is moved by
360 degrees.
[0083]
When lighting is provided in a perpendicular direction to a groove direction
20 of wrinkles, for example, an evaluation value becomes large, and when lighting is
provided in a parallel direction to the groove direction of the wrinkles, an evaluation
value becomes small. Thus, when perpendicular lighting directions are included in
one group in the grouping described above, it becomes possible to determine a
lighting direction in which a focus state becomes good in one group.
25 [0084]
[2-1-3. Another Configuration of Attachment Device]
Next, another configuration of an attachment device will be described. In
the other configuration, a light source having an emission wavelength suitable for
analysis is used as a light source or an external light source of the attachment device
30 71. For example, when an outer appearance such as texture, wrinkles, or the like of
skin, is analyzed, a visible white LED (Light Emitting Diode) is used as a light
SP344602XX00
24/49
source. When the state of melanin is analyzed, a visible red LED and a near
infrared LED are used. When sebum filling pores is measured, a near ultraviolet
LED is used. In addition, in order to separately capture surficial reflection light and
internal reflection light, a polarizing fiher may be installed in a light source. FIG
5 23 and FIG. 24 correspond to FIG. 4 and FIG. 5 respectively, and show an example of
a case in which white LEDs 711a, a visible red LED 711b, a near infrared LED 711c,
and a near ultraviolet LED 711 d are used as the plurality of light sources 711. Also,
an example of a case is shown in which a white LED 711a-l in which a polarizing
filter of a predetermined polarizing plane is installed and a white LED 711a-2 in
10 which a polarizing filter having, for example, a polarizing plane perpendicular to a
predetermined polarizing plane is installed are installed. When a light source in
which a polarizing filter is installed is used, a polarizing filter 24 is installed on an
optical path to the image sensor 25 in the imaging device 20, and subject light in a
desired polarization state is incident on the image sensor 25 through the imaging
15 optical system 22.
[0085]
The attachment device 71 may be configured by combining light sources
and light guide paths. FIGS. 25 and 26 show examples of a case in which light
sources and light guide paths are combined. For example, illumination light output
20 from a white LED 711a-l is irradiated on a subject (skin surface) through a light
guide path 751. On an inclined illumination light output surface of the light guide
path 751, a polarizing filter 761 is installed. Also, illumination light output from a
white LED 711a-2 is irradiated on the subject (skin surface) through a light guide
path 752. On an inclined illumination light output surface of the light guide path
25 752, a polarizing filter 762 is installed. Polarizing planes of the polarizing filter 761
and the polarizing filter 762 are made to cross at right angles. Furthermore,
illumination light emitted from the visible red LED 711b, the near infrared LED 711c,
and the near ultraviolet LED 71 Id is irradiated on the subject (skin surface) through a
light guide path 753. Although not shown in the drawings, when no polarizing
30 filter is used, the illumination light output from the white LEDs 711a may be
irradiated on the subject (skin surface) through the light guide path 753.
SP344602XX00
25/49
[0086]
As described above, when light sources having different emission
wavelengths or polarizing filters are used, the imaging device 20 selects light sources
suitable for analysis, turns on the selected light sources in sequence, determines a
5 lighting direction in which a focus state becomes best as described above, and
captures in a determined lighting state. In this way, the imaging device 20 can
generate an optimal captured image according to analysis content. When focus
states are different due to emission wavelengths of light sources, focus adjustment
may be performed using the amount of adjustment calculated in advance according
10 to the emission wavelengths of the light sources. Also, focus adjustment may be
performed using the light sources used in analysis.
[0087]
[2-1-4. Focus Operation of Imaging Device]
The imaging device 20 has an autofocus function such as the contrast
15 method, the phase difference method, or the like. When such an autofocus fijnction
is used, it is assumed that there are a plurality of distances at which evaluation values
become high. For example, if there are body hairs and the like as shown in FIG. 27
when a skin surface is captured, an evaluation value becomes high due to distance up
to the body hairs as well as distance up to the skin surface. In such a case, it is
20 assumed a case that the body hairs are in focus, but the skin surface is out of focus.
[0088]
Accordingly, the imaging device 20 moves a focus position by a
predetermined distance with respect to a focus adjustment position at which a focus
state becomes best based on the evaluation values. For example, when there are a
25 plurality of distances at which evaluation values become high, assuming that the
shortest distance of the plurality of distances as a body hair part, focus adjustment
may be performed to bring a position apart from the shortest distance by a distance
da (the space between the body hairs and the skin surface) into focus, so that the
surface of the subject comes into focus. Also, the imaging device 20 may use a lens
30 that has the depth of field focused within a range of the distance da so that both of
the body hairs and the skin surface are included in a focusing range. Furthermore,
SP344602XX00
26/49
by moving the focus position by the distance da, it is possible to focus on the inside
of skin as shown in FIG. 28 as well as the skin surface and acquire information.
[0089]
[2-2. Regarding Analysis Device]
5 FIG. 29 shows an example of a configuration of an analysis device. The
analysis device 40 captures an analysis target, for example, the skin of an evaluatee,
and evaluates a texture state or the like of the skin based on an image (hereinafter
referred to as epidermis image) obtained as the results. Also, the analysis device 40
segments the epidermis image (region segmentation), and evaluates the texture state
10 of the skin based on the results.
[0090]
The analysis device 40 is configured to include an epidermis image
processing unit 41, an epidermis pattern detection unit 42, an acquired element
analysis unit 43, and a texture evaluation unit 44.
15 [0091]
The epidermis image processing unit 41 performs a predetermined image
process such as correction, noise removal, or the like on the epidermis image, and
supplies the epidermis image after the image process to the epidermis pattern
detection unit 42 and the acquired element analysis unit 43.
20 [0092]
The epidermis pattern detection unit 42 detects a pattern of an epidermis
(hereinafter referred to as an epidermis pattern) in the epidermis image formed on the
epidermis by skin bumps or skin grooves, and supplies the detection results
(hereinafter referred to as the epidermis pattern detection results) to the acquired
25 element analysis unit 43.
[0093]
The acquired element analysis unit 43 analyzes an acquired element among
elements indicating the texture state of the skin based on the epidermis image after
the image process and the epidermis pattern detection results. The acquired element
30 analysis unit 43 supplies the analysis results to the texture evaluation unit 44.
[0094]
SP344602XX00
27/49
The texture evaluation unit 44 evaluates the texture state of the skin based
on the analysis results of the acquired element analysis unit 43, and outputs the
evaluation results to the display device 60.
[0095]
5 FIG. 30 is a block diagram showing examples of fiinctional configurations
of the epidermis image processing unit 41 and the epidermis pattern detection unit 42.
[0096]
The epidermis image processing unit 41 is configured to include an image
correction unit 411, a single channel extracfion unit 412, and a noise removal unit
10 413. The epidermis pattern detection unit 42 is configured to include a binarization
unit 421 and a labeling process unit 422.
[0097]
The image correction unit 411 performs shading correction, correction of
lens distortion, excision of the central region of the epidermis image, and the like on
15 the epidermis image. Also, the image correction unit 411 downsizes the image after
correction so as to cut down processing cost. The image correction unit 411
supplies the epidermis image after correction to the single channel extraction unit
412.
[0098]
20 The single channel extraction unit 412 extracts signal components of a
predetermined channel, for example, a B (Blue) channel, fi"om the corrected
epidermis image, and supplies an epidermis image (hereinafter referred to as a single
channel epidermis image) including the extracted signal components to the noise
removal unit 413.
25 [0099]
The noise removal unit 413 removes noise of the single channel epidermis
image. The noise removal unit 413 applies an edge-preserving smoothing filter to
the single channel epidermis image so as to remove random noise or texture
components of skin bumps and skin grooves. Also, the noise removal unit 413
30 applies an isolated point removing fiher to the single channel epidermis image so as
to remove a high-brightness region or mirror surface reflection components
SP344602XX00
28/49
influenced by, for example, sweat glands. The noise removal unit 413 supplies the
single channel epidermis image after noise removal (hereinafter referred to as a
noise-removed epidermis image) to the binarization unit 421 and the labeling process
unit 422 of the epidermis pattern detection unit 42.
5 [0100]
The binarization unit 421 performs a binarization process on the noiseremoved
epidermis image. Assuming that, under the uniform light source, a bright
region of the epidermis image is a skin bump present on the front, and a dark region
is a skin groove present in the inside, the binarization unit 421 binarizes the noise-
10 removed epidermis image so as to segment skin bumps and skin grooves. The
binarization unit 421 supplies the obtained binarization image (hereinafter referred to
as a binarized epidermis image) to the labeling process unit 422.
[0101]
The labeling process unit 422 performs labeling on the binarized epidermis
15 image. The labeling process unit 422 detects a region surrounded by the outermost
white outline as one region, and ignores black regions or regions surrounded by
white outlines in the detected region. In this way, a label is given to the detected
region. For this reason, for example, regions that become dark due to depressions
inside skin bumps and the like are ignored, so that the skin bumps can be accurately
20 detected. The region to which the label is given by a labeling process will be
referred to as a labeling region below.
[0102]
Considering that, in the skin of common people, a space between skin
grooves is 0.25 to 0.5 mm, and many skin bumps have a triangular or quadrilateral
25 shape, an area of a skin bump may be about 0.031 to 0.25 square millimeters. Thus,
the labeling process unit 422 calculates an appropriate range of the size of a skin
bump in the epidermis image. Among detected labeling regions, the labeling
process unit 422 detects regions having sizes within the obtained appropriate range
as skin bump regions.
30 [0103]
The labeling process unit 422 counts the number of detected skin bump
SP344602XX00
29/49
regions as a skin bump number. The labeling process unit 422 supplies the
epidermis pattern detection results indicating the detection results of the skin bump
regions and the skin bump number to the acquired element analysis unit 43.
[0104]
5 FIG 31 is a block diagram showing an example of a functional
configuration of the acquired element analysis unit 43. The acquired element
analysis unit 43 is configured to include an epidermal size distribution analysis unit
431, epidermal shape distribution analysis units 432 and 433, and an epidermal
directivity analysis unit 434.
10 [0105]
The epidermal size distribution analysis unit 431 analyzes the distribution of
sizes of epidermis patterns. The epidermal size distribution analysis unit 431
analyzes the distribution of sizes of skin bump regions, and calculates an epidermal
size distribution evaluation value representing the uniformity of the sizes of the skin
15 bump regions. The epidermal size distribution analysis unit 431 supplies the
calculated epidermal size distribution evaluation value to the texture evaluation unit
44.
[0106]
The epidermal shape distribution analysis unit 432 analyzes the distribution
20 of shapes of epidermis patterns. The epidermal shape distribution analysis unit 432
analyzes the distribution of shapes of the skin bump regions, and calculates an
epidermal shape distribution evaluation value representing the uniformity of the
shapes of the skin bump regions. The epidermal shape distribution analysis unit
432 supplies the calculated epidermal shape distribution evaluation value to the
25 texture evaluation unit 44.
[0107]
The epidermal shape distribution analysis unit 433 analyzes the distribution
of shapes of the epidermis patterns from a point of view different from that of the
epidermal shape distribution analysis unit 432. The epidermal shape distribution
30 analysis unit 433 compares each of the skin bump regions with predetermined
reference shapes, and obtains epidermal shape distribution information indicating a
SP344602XX00
30/49
ratio of skin bump regions having shapes close to the respective reference shapes.
The epidermal shape distribution analysis unit 433 supplies the obtained epidermal
shape distribution information to the texture evaluation unit 44.
[0108]
5 The epidermal directivity analysis unit 434 analyzes the directivity of the
epidermis patterns. The epidermal directivity analysis unit 434 analyzes the
distribution of edge directions of the skin bump regions, and calculates an epidermal
directivity evaluation value representing the uniformity of the distribution of edge
directions of the skin bump regions. The epidermal directivity analysis unit 434
10 supplies the calculated epidermal directivity evaluation value to the texture
evaluation unit 44.
[0109]
In addition, the sizes, the shapes, and the edge directions of the skin bumps
change in an acquired manner depending on aging, health, skin care, and the like.
15 Accordingly, the epidermal size distribution evaluation value, the epidermal shape
distribution evaluation value, the epidermal shape distribution information, and the
epidermal directivity evaluation value become indexes for evaluating acquired
properties of the texture state of the skin.
[0110]
20 The texture evaluation unit 44 calculates a texture evaluation value. From
the epidermal size distribution evaluation value, the epidermal shape distribution
evaluation value, and the epidermal directivity evaluation value, the texture
evaluation unit 44 calculates a texture evaluation value that changes according to the
uniformity of sizes of the skin bumps, the uniformity of shapes of the skin bumps,
25 and the uniformity of the distribution of directions of the skin bumps. The
uniformity of sizes of the skin bumps, the uniformity of shapes of the skin bumps,
and the uniformity of the distribution of directions of the skin bumps change in an
acquired manner depending on aging, health, care, and the like. Accordingly, the
texture evaluation value becomes an index for evaluating the uniformity of the skin
30 texture that changes in an acquired manner. In addition to the uniformity of texture,
a texture evaluation value may be calculated to indicate a ratio of skin bumps having
SP344602XX00
31/49
an ideal shape. The texture evaluation unit 44 outputs the evaluation results of the
state of the skin texture to the display device 60.
[0111]
[2-3. Regarding Display Device]
5 The display device 60 displays the evaluation results of the texture state of
the skin on the screen. For example, as shown in FIG 2, the display device 60
separately shows the fineness of texture, the condition of texture (the uniformity of
sizes of the skin bumps, the uniformity of shapes of the skin bumps, the uniformity
of the distribution of directions of the skin bumps, and the like), freckles, wrinkles,
10 and the like in a radar chart.
[0112]
In this way, the evaluatee becomes able to instantly know his or her own
skin condition. Also, by displaying a skin image based on which a texture state is
evaluated, or skin images that have been photographed before and after emission
15 wavelengths of a light source are switched, it becomes possible to check not only the
evaluation results but also a skin condition, a freckle condition, or the like.
[0113]
As described above, in the first embodiment, a state in which, for example,
the contrast of a captured image becomes highest is created by switching lighting
20 directions, and focus is set in the state, so that a focus state can be adjusted to an
optimal focus state. In other words, it becomes possible to set the focus based on
wrinkles and the like of a skin surface. Accordingly, even without preparing a
specific pattern and the like that become references, focus adjustment can be
accurately performed.
25 [0114]
<3. Second Embodiment>
When an image having low contrast is taken as in a case of taking a close-up
image of skin, it is difficult to set the focus, and thus JP 2005-070300A discloses
installing a pattern for autofocus on a fulcrum and performing focus control based on
30 the pattern. However, in this technology, it is neither possible to acquire accurate
color data nor to measure a reflectance. Also, JP 2002-345760A discloses making
SP344602XX00
32/49
correction with a cap for correcting spectral reflectance put on and performing
measurement without the cap. In this technology, an annoying operation that is
putting on and taking off of the cap is necessary, and it is not possible to readily
make correction.
5 [0115]
Thus, in the following second embodiment, description will be made
regarding a case of installing a reference pattern in an attachment device, enabling
the focus to be set even in a low contrast state as in a close-up image of skin, and
acquiring a good skin image. Also, using a region that becomes a reference of
10 reflectance, automatic reflectance correction is allowed to be performed.
[0116]
In the second embodiment, the imaging device 20 controls a zoom lens so
that a focus adjustment pattern to be described later comes in the field of vision, and
a sufficient region to perform focus control is shown, and then controls the focus so
15 that the focus adjustment pattern comes into focus. Also, when no spectral
reflectance correction pattern is shown in the field of vision, the imaging device 20
controls the zoom lens in a focus state as is so that a spectral reflectance correction
pattern comes in the field of vision, and turns on respective light sources to
photograph the pattern for correction and make correction of reflectance.
20 Furthermore, the imaging device 20 controls the zoom lens in a focus state as is so
that a subject region comes in the whole field of vision, and then turns on light
sources having respective emission wavelengths to photograph the subject region and
acquire image signals of a captured image at the respective wavelengths. Using the
acquired image signals, the analysis device 40 performs analysis processes of the
25 texture, color, and the like of skin. The display device 60 presents the analysis
results.
[0117]
[3-1. Configuration of Imaging Device]
In the imaging device 20 of the second embodiment, as shown in FIG 32, a
30 reference pattern unit 730 in a ring shape is disposed on the front end of the
attachment device 71. On the inner side of the reference pattern unit 730, a
SP344602XX00
33/49
reference pattern for performing focus adjustment, reflectance correction, or the like
is installed.
[0118]
FIG. 33 shows an example of a reference pattern. For example, a pattern
5 for focus adjustment and a reflectance correction pattern are installed as reference
patterns. In addition, a pattern for checking a subject size is installed so as to
determine the size of a subject.
[0119]
A focus adjustment pattern 731 is configured with an edge of high contrast
10 and the like. The focus adjustment pattern 731 includes a low spatial frequency
pattern so that the pattern can be found in an image even if the image is out of focus.
In addition, the focus adjustment pattern 731 includes a high spatial frequency
pattern so as to set the focus with high accuracy. Furthermore, the focus adjustment
pattern 731 may use a pattern drawn with ink that can be photographed using all light
15 sources in use, or patterns drawn with separate inks for every wavelength bands of
light sources.
[0120]
A pattern for reflectance correction is configured with a material that has a
high reflectance in a wavelength band in which measurement is performed.
20 Correction may be made using a material that has a high reflectance in an overall
wavelength range in which measurement is performed, and a wavelength band may
be configured to be divided into, for example, an ultraviolet light region, a visible
light region, an infrared light region, and the like. For example, in FIG 33,
reflectance correction patterns 732, 733 and 734 are installed. The reflectance
25 correction pattern 732 is a reference pattern for correcting a reflectance when visible
light is used. The reflectance correction pattern 733 is a reference pattern for
correcting a reflectance when near infrared light is used. The reflectance correction
pattern 734 is a reference pattern for correcting a reflectance when ultraviolet light is
used.
30 [0121]
A pattern 735 for checking a subject size is configured as a scale pattern for
SP344602XX00
34/49
checking a subject size. The pattern 735 is used as a reference for visually checking
a subject size or measuring size by image processing.
[0122]
FIGS. 34 to 37 show modified examples of a reference pattern. FIG. 34
5 shows an example of a case in which not only reference patterns for focus adjustment
and reflectance correction but also a color adjustment pattern 736 (for example, a
pattern of red R, green G and blue B) have been installed. By preparing the color
adjustment pattern 736 in this way, it becomes possible to readily adjust a captured
image with correct colors.
10 [0123]
FIG. 35 shows an example of a case in which reference patterns are placed
on wires installed in a cross shape. In this way, an imaging region of a subject can
be widened in comparison with FIG. 33 or FIG. 34. In other words, in the case
shown in FIG. 33 or FIG. 34, a subject is hidden by a portion having a ring shape in
15 which reference patterns are installed. However, when reference patterns are placed
on wires installed in a cross shape, a portion in which a subject is hidden can be
reduced.
[0124]
FIG. 36 shows an example of a case in which the pattern 735 for checking a
20 subject size is enabled to display a plurality colors (for example, a pattern of red R,
green G and blue B). In this way, when the pattern 735 for checking a subject size
is enabled to display a plurality of colors, it is possible to readily adjust a captured
image with correct colors using the pattern 735 for checking a subject size.
[0125]
25 FIG. 37 shows an example of a case in which the focus adjustment pattern
731 is configured by drawing a high-contrast line along the boundary between a
subject region and a reference pattern region.
[0126]
Furthermore, in the reference pattern unit 730, reference patterns may be
30 formed on a solid material such as metal, plastic, or the like, and as shown in FIG 38,
reference patterns may be formed on a flexible member, for example, a sheet, a film,
SP344602XX00
35/49
or the like. When reference patterns are formed on a flexible member, as shown in
FIG. 38(B), the reference patterns can closely contact with a subject (skin).
[0127]
The imaging device 20 has the imaging optical system 22 that can capture a
5 measurement target in a sufficient size at an angle of view at which it is possible to
capture reference patterns and a subject region, and the image sensor 25 having a
number of pixels capable of capturing with a sufficient resolution. For example,
when the imaging optical system 22 having a magnification of about 50 times is used,
it is preferred that the image sensor 25 have about 1,300,000 pixels. Also, when a
10 zoom function is included in the imaging optical system 22, a wide angle is used to
capture reference patterns, and a telescopic side is used to capture a subject, so that a
subject can be measured more minutely. When a fixed focus optical system is
included, it is preferable to design and set an angle of view and the like of the
imaging optical system in advance so that reference patterns and a subject region are
15 sufficiently shown in the field of vision.
[0128]
[3-2. Operation of Imaging Device]
FIG. 39 is a flowchart illustrating operation of an imaging device. In step
ST51, the imaging device 20 performs initial setup. The imaging device 20 sets a
20 parameter "i" indicating a light source that will be turned on as, for example, "i = 1."
Also, the imaging device 20 sets a parameter " j " indicating a light source that will be
turned on to correct a reflectance as, for example, "j = I," and the process proceeds
to step ST52.
[0129]
25 In step ST52, the imaging device 20 performs zoom adjustment for focus
control. The imaging device 20 controls the imaging optical system 22 so that the
focus adjustment pattern 731 comes in the field of vision, and a sufficient region to
perform focus control is shown, and the process proceeds to step ST53.
[0130]
30 In step ST53, the imaging device 20 turns on a light source i, and the
process proceeds to step ST54.
SP344602XX00
36/49
[0131]
In step ST54, the imaging device 20 performs focus adjustment. Based on
a captured image generated by an image sensor, the imaging device 20 performs
focus adjustment. Also, the imaging device 20 calculates evaluation values
5 indicating focus states, and the process proceeds to step ST55.
[0132]
In step ST55, the imaging device 20 determines whether adjustment has
been performed on all light sources. For example, when n light sources having
different lighting directions are installed, the imaging device 20 determines that
10 adjustment has been performed on all the light sources in the case of i = n, and the
process proceeds to step . In the case of i < n, the imaging device 20 determines
that adjustment of all the light sources has not been finished, and the process
proceeds to step ST56
[0133]
15 In step ST56, the imaging device 20 performs an arithmetic operation of "i
= i + 1" to update the parameter i, and the process returns to step ST53.
[0134]
In step , the imaging device 20 determines optimal focus. Based on the
evaluation values calculated according to the respective lighting directions, the
20 imaging device 20 determines a lighting direction in which a focus state becomes
best, and the process proceeds to step ST58.
[0135]
In step ST58, the imaging device 20 performs zoom adjustment for
reflectance correction. The imaging device 20 controls the imaging optical system
25 22 so that the reflectance correction patterns 732 to 734 and the like come in the field
of vision, and the process proceeds to step ST59.
[0136]
In step ST59, the imaging device 20 turns on a light source j , and the
process proceeds to step ST60.
30 [0137]
In step ST60, the imaging device 20 performs reflectance correction.
SP344602XX00
37/49
When the light source j is a white LED that is a light source for correcting a visible
light reflectance, the imaging device 20 performs configuration using imaging results
of a pattern for correcting a visible light reflectance. For example, when a pixel
value of a captured image of a white region is higher than a predetermined level, the
5 imaging device 20 reduces the quantity of light and captures again. When a pixel
value of a captured image of the pattern for correcting a visible light reflectance is in
a predetermined level range, the imaging device 20 stores the pixel value and a light
emission control value of this time. When a white region is captured, but it is not
possible to obtain a captured image of desired brightness even with the maximum
10 quantity of light, the imaging device 20 increases a gain of the image sensor 25 to
obtain a captured image of the desired brightness, and stores the gain of this time.
Also the imaging device 20 performs reflectance correction using other light sources
and patterns for reflectance correction. Furthermore, the imaging device 20 may
obtain a black offset value from a captured image of a black region, store the black
15 offset value, subtract the black offset value from a pixel value of the captured image,
and use the calculated value in the subsequent process.
[0138]
FIG. 40 illustrates an example of operation of a correction process using a
white region and a black region. In step ST71, the imaging device 20 turns on light
20 sources at a predetermined brightness. The imaging device 20 turns on, for
example, white LEDs at the predetermined brightness, and the process proceeds to
step ST72.
[0139]
In step ST72, the imaging device 20 acquires pixel values of a white region.
25 The imaging device 20 acquires pixel values of respective pixels in the white region
of a pattern for correcting a visible light reflectance, and the process proceeds to step
ST73.
[0140]
In step ST73, the imaging device 20 calculates the sum of the pixel values.
30 The imaging device 20 calculates the sum (SI) of the pixel values acquired in step
ST72, and the process proceeds to step ST73.
SP344602XX00
38/49
[0141]
In step ST74, the imaging device 20 determines whether the sum (SI) of the
pixel values is larger than a threshold value (Thl). The process of the imaging
device 20 proceeds to step ST75 when the sum (SI) of the pixel values is larger than
5 the threshold value (Thl), and the process proceeds to step ST76 when the sum (SI)
of the pixel values is equal to or smaller than the threshold value (Thl).
[0142]
In step ST75, the imaging device 20 lowers the brightness of the light
sources. Since the brightness of a captured image of the white region is higher than
10 a predetermined level, the imaging device 20 lowers the brightness of the white
LEDs, and the process returns to step ST72.
[0143]
In step ST76, the imaging device 20 determines whether the sum (SI) of the
pixel values is smaller than a threshold value (Th2). The process of the imaging
15 device 20 proceeds to step ST77 when the sum (SI) of the pixel values is smaller
than the threshold value (Th2), and the process proceeds to step ST78 when the sum
(SI) of the pixel values is equal to or greater than the threshold value (Th2).
[0144]
In step ST77, the imaging device 20 increases a gain of an image sensor.
20 Since the brightness of the captured image of the white region is darker than a
predetermined level, the imaging device 20 increases the gain of the image sensor 25,
and the process proceeds back to step ST72.
[0145]
In step ST78, the imaging device 20 turns on light sources, and the process
25 proceeds to step ST79.
[0146]
In step ST79, the imaging device 20 acquires pixels values of a black region.
The imaging device 20 acquires pixel values of respective pixels in the black region
of a pattern for correcting a visible light reflectance, and the process proceeds to step
30 ST80.
[0147]
SP344602XX00
39/49
In step ST80, the imaging device 20 stores a black offset value. The
imaging device 20 sets a black offset value from the pixel values of the respective
pixels of the black region acquired in step ST79. For example, the imaging device
20 stores an average of the pixel values of the respective pixels in the black region as
5 a black offset value. In this way, the imaging device 20 performs reflectance
correction.
[0148]
In step ST6I of FIG. 39, the imaging device 20 determines whether
adjustment has been performed on all the light sources. For example, when q light
10 sources having different wavelengths are installed so as to perform a plurality of
types of correction, the imaging device 20 determines that adjustment has been
performed on all the light sources in the case of i = q, and the process proceeds to
step ST63. In the case of i < q, the imaging device 20 determines that adjustment
has not been performed on all the light sources, and the process proceeds to step
15 ST62.
[0149]
In step ST62, the imaging device 20 performs an arithmetic operation of "j
= j + 1" to update the parameter j , and the process returns to step ST59.
[0150]
20 In step ST63, the imaging device 20 performs zoom adjustment for
capturing. The imaging device 20 controls the imaging optical system 22 so that
the whole field of vision is filled with a subject region as an optimal focus state, and
the process proceeds to step ST64.
[0151]
25 In step ST64, the imaging device 20 controls lighting up of a light source.
The imaging device 20 selects a light source used in capturing, controls the quantity
of emitted light based on a lighting-up control value for the selected light source, and
the process proceeds to step ST65.
[0152]
30 In step ST65, the imaging device 20 carries out photography. The imaging
device 20 performs an imaging operation to acquire an image signal of a skin image.
SP344602XX00
40/49
and the process proceeds to step ST66.
[0153]
In step ST66, the imaging device 20 determines whether selection of a light
source has been finished. The process of imaging device 20 proceeds to step ST67
5 when the capturing in which a light source having a desired wavelength is used has
not been finished, and finishes the capturing when the capturing in which a light
source having the desired wavelength is used has been finished, that is, selection of a
light source has been finished.
[0154]
10 In step ST67, the imaging device 20 switches light sources. Among light
sources of the desired wavelength, the imaging device 20 selects a light source that
has not yet been used in the capturing, and the process returns to step ST64.
[0155]
When such a process is performed, in an optimal focus state, it is possible to
15 readily obtain not only a captured image for which white light has been used as
illumination light but also a captured image of a case in which near infrared light,
ultraviolet light, or the like has been used as illumination light. Also, without
putting on and taking off a cap for reflectance correction, it is possible to
automatically correct reflectance.
20 [0156]
[3-3. Another Configuration of Attachment Device]
When a reference pattern has a thick thickness as shown in FIG 41, there is
a distance db between a pattern surface and a subject surface. Thus, there may be a
case in which the pattern is in focus, but the subject surface is out of focus. By
25 using a lens that has the depth of field in which both of the pattern surface and the
subject surface are included, or adjusting focus as much as the pattern thickness
(already known), it is preferable to focus on the subject surface. As shown in FIG.
42, by setting a lens or adjusting focus in the same way, it is also possible to focus on
the inside of a subject as well as a surface of the subject and acquire information.
30 As shown in FIG. 43, when the camera cone 21 and the attachment device 71 are
configured to be connected through an elastic body 85, it is possible to adjust a force
SP344602XX00
41/49
that presses the imaging device 20 against skin upon capturing of a skin image to be
in a predetermined range. In this case, the distance between the imaging optical
system 22 and a subject (for example, a skin surface) may change, but it becomes
possible to correctly focus on the subject by using a pattern for focus control.
5 [0157]
[3-4. Regarding Image Processing Device and Display Device]
As described above, using light sources having different wavelengths, an
image signal of a captured image is generated in the imaging device 20. Also, by
correcting reflectance, an image signal of the captured image is generated.
10 Accordingly, an image processing device may perform skin analysis not only based
on an image signal of the captured image for which a white light source has been
used but also based on an image signal of the captured image for which a light source
having a different wavelength has been used.
[0158]
15 The analysis device 40 performs texture analysis using an image signal of
the captured image that has been captured using a visible ray light source as
described in, for example, the first embodiment. Also, the analysis device 40
conducts analysis of melanin using an image signal of a captured image that has been
captured using, for example, a red light source or a near infrared light source.
20 When a pixel value of a captured image that has been captured using a red light
source is "Ired," and a pixel value of a captured image that has been captured using a
near infrared light source is "IIR," an index of the amount of melanin (melanin index
"MI") is calculated for each pixel based on equation (3).
500
MT = - ^ (logl iR - log! red )+ 500 • • • (3)
25 [0159]
In addition, an average value of a central region (for example, a region of 64
X 64 pixels) of each of the images may be obtained, and the respective average
SP344602XX00
42/49
values may be used as "IIR" and "Ired" to calculate a melanin index of the images,
[0160]
Furthermore, it is also possible to analyze a skin condition using an
evaluation value obtained by irradiating light in a plurality of directions so as to
5 determine focus. For example, as described with reference to FIG. 22, an evaluation
value becomes large when light is irradiated in a direction crossing wrinkles at right
angles, and thus there are two peaks when a lighting direction is moved by 360
degrees. Meanwhile, if a shape of a skin bump of a portion in which wrinkles are
not noticed is, for example, a quadrilateral shape, there are four peaks when a
10 lighting direction is moved by 360 degrees. Based on this, a case in which there are
two peaks may be determined as a state in which there are wrinkles, and rugosity
may be determined based on a level of an evaluation value.
[0161]
The display device 60 presents analysis results of the analysis device 40 to a
15 user. For example, analysis results of texture or melanin are displayed as a graph,
or a captured image displayed to be overlaid with a region of a high melanin index is
presented to the user.
[0162]
As described above, according to the second embodiment, it is possible to
20 set the focus based on a reference pattern, and thus it becomes possible to
appropriately and automatically set the focus even in a low contrast state such as a
case of close-up imaging of skin, and the like. As a result, it is possible to improve
the accuracy in measurement of fine texture of a skin surface and the like. In
addition, correction of a reflectance can be automatically performed even without
25 using a tool for reflectance correction, and thus inconvenience of correction for a
user disappears. Furthermore, correction can be also automatically made at every
skin measurement, and thus color measurement, spectral measurement, and the like
become possible with higher accuracy.
[0163]
30 Incidentally, a series of the processes described in the present specification
can be executed by hardware, software, or a combination of both. The software can
SP344602XX00
43/49
execute the processes by installing a program recording a processing sequence into a
memory in a computer integrated with dedicated hardware, or by installing the
program in a general purpose computer executable of various processes.
[0164]
5 For example, the program can previously be recorded in a hard disk drive,
ROM (Read Only Memory) or the like as a recording medium. Or the program can
temporarily or permanently be stored (recorded) in a removable medium such as a
flexible disk, CD-ROM (Compact Disc Read Only Memory), MO (Magneto optical)
disk, DVD (Digital Versatile Disc), magnetic disk, semiconductor memory card.
10 Such a removable recording medium can be provided as so-called packaged software.
[0165]
Moreover, the program not only be installed in the computer form the
removable recording medium but also may be installed by wireless or wired
transferring into the computer via a network such as a LAN (Local Area Network)
15 and the Internet from download sites. The computer can undergo installation of the
received program, which is transferred like that, into the recording medium such as
the mounted hard disk drive.
[0166]
It should be understood by those skilled in the art that various modifications,
20 combinations, sub-combinations and alterations may occur depending on design
requirements and other factors insofar as they are within the scope of the appended
claims or the equivalents thereof
[0167]
Additionally, the present technology may also be configured as below.
25 (1) An imaging device including:
a lighting unit whose lighting directions to a subject are able to be switched;
and
a control unit that performs focus adjustment on the subject for every
lighting directions to calculate evaluation values in accordance with focus states, and
30 determines a direction in which a focus state becomes best as a lighting direction
based on the evaluation values to capture the subject.
SP344602XX00
44/49
(2) The imaging device according to (1),
wherein the lighting unit switches the lighting directions by emitting
illumination light from different positions in a circumferential direction with respect
to an optical axis of an imaging optical system.
5 (3) The imaging device according to (2),
wherein the lighting unit switches irradiation angles of the illumination light.
(4) The imaging device according to (2) or (3),
wherein the control unit thins out the lighting directions in the
circumferential direction, performs focus adjustment on the subject for every lighting
10 directions after thinning out to calculate evaluation values in accordance with focus
states, and calculates evaluation values of the thinned-out lighting directions from the
calculated evaluation values.
(5) The imaging device according to any one of (2) to (4),
wherein the control unit groups the lighting directions in the circumferential
15 direction, and performs focus adjustment on the subject for every lighting directions
in one group to calculate evaluation values in accordance with focus states.
(6) The imaging device according to (5),
wherein the control unit includes lighting directions crossing at right angles
in the one group.
20 (7) The imaging device according to any one of (1) to (6),
wherein the lighting unit provides lighting using a light source having an
emission wavelength suitable for an analysis process performed using a captured
image of the subject.
(8) The imaging device according to any one of (1) to (7),
25 wherein the lighting unit switches the lighting directions by switching light
sources emitting illumination light, or controlling passage of illumination light
emitted from a light source using a shutter.
(9) The imaging device according to any one of (1) to (8),
wherein the control unit moves a focus position by a predetermined distance
30 with respect to a focus adjustment position at which the focus state becomes best
based on the evaluation values.
SP344602XX00
45/49
[0168]
In an imaging device, an imaging method, a program, an imaging system,
and an attachment device of this technology, lighting directions of a subject can be
switched. Thus, focus adjustment on a subject is performed for every lighting
5 directions to calculate evaluation values in accordance with focus states, and a
direction in which a focus state becomes best is determined as a lighting direction
based on the evaluation values to capture the subject. For this reason, lighting is
provided in an optimal direction to perform focus adjustment, and it becomes
possible to readily obtain a skin image whose focus state is good. Accordingly, the
10 imaging device, the imaging method, the program, the imaging system, and the
attachment device are suitable for a system that captures a skin image or carries out
skin analysis used in the beauty industry and the like.
[0000]
The present disclosure contains subject matter related to that disclosed in
15 Japanese Priority Patent Application JP 2012-073536 filed in the Japan Patent Ofiice
on March 28, 2012, the entire content of which is hereby incorporated by reference.

SP344602XX00
46/49
What is claimed is:
1. An imaging device comprising:
a lighting unit whose lighting directions to a subject are able to be switched;
and
5 a control unit that performs focus adjustment on the subject for every
lighting directions to calculate evaluation values in accordance with focus states, and
determines a direction in which a focus state becomes best as a lighting direction
based on the evaluation values to capture the subject.
10 2. The imaging device according to claim 1,
wherein the lighting unit switches the lighting directions by emitting
illumination light from different positions in a circumferential direction with respect
to an optical axis of an imaging optical system.
15 3. The imaging device according to claim 2,
wherein the lighting unit switches irradiation angles of the illumination light.
4. The imaging device according to claim 2,
wherein the control unit thins out the lighting directions in the
20 circumferential direction, performs focus adjustment on the subject for every lighting
directions after thinning out to calculate evaluation values in accordance with focus
states, and calculates evaluation values of the thinned-out lighting directions from the
calculated evaluation values.
25 5. The imaging device according to claim 2,
wherein the control unit groups the lighting directions in the circumferential
direction, and performs focus adjustment on the subject for every lighting directions
in one group to calculate evaluation values in accordance with focus states.
30 6. The imaging device according to claim 5,
wherein the control unit includes lighting directions crossing at right angles
SP344602XX00
47/49
in the one group.
7. The imaging device according to claim 1,
wherein the lighting unit provides lighting using a light source having an
5 emission wavelength suitable for an analysis process performed using a captured
image of the subject.
8. The imaging device according to claim 1,
wherein the lighting unit switches the lighting directions by switching light
10 sources emitting illumination light, or controlling passage of illumination light
emitted from a light source using a shutter.
9. The imaging device according to claim 1,
wherein the control unit moves a focus position by a predetermined distance
15 with respect to a focus adjustment position at which the focus state becomes best
based on the evaluation values.
10. An imaging method comprising:
providing lighting to a subject in a manner that lighting directions are able
20 to be switched; and
performing focus adjustment on the subject for every lighting directions to
calculate evaluation values in accordance with focus states, and determining a
direction in which a focus state becomes best as a lighting direction based on the
evaluation values to capture the subject.
25
11. A program causing a computer to control operation of an imaging device having a
lighting unit whose lighting directions to a subject are able to be switched, and
to carry out a procedure of performing focus adjustment on the subject for
every lighting directions to calculate evaluation values in accordance with focus
30 states, and determining a direction in which a focus state becomes best as a lighting
direction based on the evaluation values to capture the subject.
SP344602XX00 I
48/49 •
12. An imaging system comprising: H
an imaging device that generates a captured image of a subject; and H
an analysis device that analyzes the subject using the captured image, I
5 wherein the imaging device includes •
a lighting unit whose lighting directions to the subject are able to be H
switched, and I
a control unit that performs focus adjustment on the subject for every H
lighting directions to calculate evaluation values in accordance with focus states, and I
10 determines a direction in which a focus state becomes best as a lighting direction •
based on the evaluation values to capture the subject. •
13. An attachment device comprising: •
a lighting unit whose lighting directions to a subject are able to be switched, I
15 wherein the lighting unit switches lighting directions according to an I
instruction from an external device, or automatically switches lighting directions and I
outputs information indicating a lighting direction to the external device. I
14. An imaging device comprising: I
20 a reference pattern unit that is installed in a manner that a reference pattern I
used in adjustment for capturing a subject is included in an imaging angle of view; I
a control unit that captures the subject after adjustment for capturing the I
subject using the reference pattern. I
15. An attachment device comprising: I
a reference pattern unit that is installed in a manner that a reference pattern I
used in adjustment for capturing a subject is included in an imaging angle of view. ,