Sign In to Follow Application
View All Documents & Correspondence

Electronic Device

Abstract: This electronic device is provided with: a transparent panel unit in which a plurality of transparent light-emitting elements are arranged; and an imaging unit arranged below some area of the transparent panel unit, for imaging an object in contact with or close to some area of the transparent panel unit.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
13 August 2020
Publication Number
40/2020
Publication Type
INA
Invention Field
COMPUTER SCIENCE
Status
Email
ipo@knspartners.com
Parent Application

Applicants

SONY CORPORATION
1-7-1, Konan, Minato-ku, Tokyo 1080075

Inventors

1. KOBAYASHI, Naoko
c/o SONY CORPORATION, 1-7-1, Konan, Minato-ku, Tokyo 1080075
2. KAMADA, Yasunori
c/o SONY CORPORATION, 1-7-1, Konan, Minato-ku, Tokyo 1080075
3. SHIGEI, Hiroyuki
c/o SONY CORPORATION, 1-7-1, Konan, Minato-ku, Tokyo 1080075
4. AMANO, Toru
c/o SONY CORPORATION, 1-7-1, Konan, Minato-ku, Tokyo 1080075
5. TAKEUCHI, Futoshi
c/o SONY CORPORATION, 1-7-1, Konan, Minato-ku, Tokyo 1080075
6. ENOKIDO, Toshio
c/o SONY CORPORATION, 1-7-1, Konan, Minato-ku, Tokyo 1080075
7. SATO, Yusuke
c/o SONY CORPORATION, 1-7-1, Konan, Minato-ku, Tokyo 1080075

Specification

FORM 2
THE PATENTS ACT, 1970
(39 of 1970)
&
THE PATENTS RULES, 2003
COMPLETE SPECIFICATION
(See section 10, rule 13)
“ELECTRONIC DEVICE”
SONY CORPORATION, of 1-7-1, Konan, Minato-ku, Tokyo
108-0075, Japan
The following specification particularly describes the invention and the manner in which it is to
be performed.
DESCRIPTION
Title of the Invention:
ELECTRONIC DEVICE
Technical Field
[0001] The present disclosure relates to an electronic device having an imaging
function.
Background Art
[0002] A device for performing individual authentication using biological
information, which is information unique to a living body, has been developed (see PTL
1). Example of a device that performs biometric authentication includes a fingerprint
sensor device that performs fingerprint authentication by imaging a surface of a finger.
In contrast, a wristband-type small electronic device, for example, has recently been
developed.
Citation List
Patent Literature
[0003] PTL 1: Japanese Unexamined Patent Application Publication No.
2017-196319
Summary of the Invention
[0004] It is desirable to implement, in a small electronic device, a plurality of
functions such as a displaying function and an imaging function, but in some cases, it is
difficult to implement desired functions due to a limited surface area. Further, in a
case where a fingerprint authentication function is to be implemented, it may be difficult,
in a small electronic device, for a fingerprint sensor device to bring a finger to an
2
optimal position.
[0005] It is desirable to provide an electronic device that is able to achieve a
plurality of functions in a compact size.
[0006] An electronic device according to an embodiment of the present disclosure
includes a transparent panel section in which a plurality of transparent light-emitting
elements is disposed, and an imaging section that is disposed under a partial region of
the transparent panel section, and images, via the transparent panel section, an object
which is in contact with or in proximity to the partial region of the transparent panel
section.
[0007] In the electronic device according to an embodiment of the present
disclosure, the object which is in contact with or in proximity to the partial region of the
transparent panel section is imaged by the imaging section disposed under the partial
region of the transparent panel section.
Brief Description of Drawings
[0008] [FIG. 1] FIG. 1 is a schematic external view of a configuration example of
an electronic device according to a first embodiment of the present disclosure.
[FIG. 2] FIG. 2 is an explanatory diagram illustrating a display example of a
transparent panel section included in the electronic device according to the first
embodiment.
[FIG. 3] FIG. 3 is a configuration diagram illustrating a main structure of the
electronic device according to the first embodiment.
[FIG. 4] FIG. 4 is a cross-sectional view of the main structure of the electronic device
according to the first embodiment.
[FIG. 5] FIG. 5 is an exploded perspective view of a detailed configuration example
of an imaging section included in the electronic device according to the first
3
embodiment.
[FIG. 6] FIG. 6 is a cross-sectional view of an example of regions to be imaged by
microlenses included in the electronic device according to the first embodiment.
[FIG. 7] FIG. 7 is a plan view of an example of a relationship between a structure of
the transparent panel section included in the electronic device according to the first
embodiment and disposition positions of the microlenses of the transparent panel
section.
[FIG. 8] FIG. 8 is a schematic plan view of object images formed on an imaging
element of the imaging section included in the electronic device according to the first
embodiment.
[FIG. 9] FIG. 9 is an explanatory diagram illustrating an example of a captured image
obtained by the imaging section included in the electronic device according to the first
embodiment and a post-compositing process image based on the captured image.
[FIG. 10] FIG. 10 is a plan view of a first modification example of a structure of the
transparent panel section included in the electronic device according to the first
embodiment and disposition positions of the microlenses of the transparent panel
section.
[FIG. 11] FIG. 11 is a plan view of a second modification example of a relationship
between a structure of the transparent panel section included in the electronic device
according to the first embodiment and disposition positions of the microlenses of the
transparent panel section, and of an example of a light emitting state of the transparent
panel section at a time of imaging.
[FIG. 12] FIG. 12 is a plan view of a third modification example of a relationship
between a structure of the transparent panel section included in the electronic device
according to the first embodiment and disposition positions of the microlenses of the
4
transparent panel section, and of an example of a light emitting state of the transparent
panel section at a time of imaging.
[FIG. 13] FIG. 13 is a plan view of an example of a wiring structure of the transparent
panel section included in the electronic device according to the first embodiment.
[FIG. 14] FIG. 14 is a plan view of an implementation example of a touch sensor
function using wiring lines of the transparent panel section included in the electronic
device of the first embodiment.
[FIG. 15] FIG. 15 is a block diagram illustrating a configuration example of a control
system of the electronic device of the first embodiment.
[FIG. 16] FIG. 16 is an explanatory diagram illustrating an outline of determination
thresholds of touch states in the electronic device according to the first embodiment.
[FIG. 17] FIG. 17 is a flowchart illustrating an outline of a process of calculating a
determination threshold of a touch state in the electronic device according to the first
embodiment.
[FIG. 18] FIG. 18 is an explanatory diagram illustrating an example of an operation of
a user on a touch sensor in the electronic device according to the first embodiment.
[FIG. 19] FIG. 19 is a characteristic diagram illustrating a first example of change in
values of capacitance with time detected by the touch sensor in the electronic device
according to the first embodiment.
[FIG. 20] FIG. 20 is a characteristic diagram illustrating a second example of change
in values of capacitance with time detected by the touch sensor in the electronic device
according to the first embodiment.
[FIG. 21] FIG. 21 is a flowchart illustrating an outline of a process of correcting a
working interval of the touch sensor in the electronic device according to the first
embodiment.
5
[FIG. 22] FIG. 22 is an explanatory diagram illustrating an example of a database
related to an operation speed of the user in the electronic device according to the first
embodiment.
[FIG. 23] FIG. 23 is a configuration diagram illustrating a main structure of an
electronic device according to a second embodiment.
[FIG. 24] FIG. 24 is a cross-sectional view of the main structure of the electronic
device according to the second embodiment.
[FIG. 25] FIG. 25 is a configuration diagram illustrating a main structure of an
electronic device according to a third embodiment.
Modes for Carrying Out the Invention
[0009] In the following, some embodiments of the present disclosure are described
in detail with reference to the drawings. It is to be noted that description is given in
the following order.
[0010]
1. First Embodiment (FIGs. 1 to 22)
1.1 Outline of Electronic Device
1.2 Calibration of Touch Sensor
1.2.1 Configuration Example of Control System of Electronic Device
1.2.2 Calibration of Determination Threshold in Touch State
1.2.3 Calibration of Working Interval of Touch Sensor
1.3 Effects
2. Second Embodiment (FIGs. 23 and 24)
3. Third Embodiment (FIG. 25)
4. Other Embodiments
[1. First Embodiment (FIGs. 1 to 22)]
6
[1.1 Outline of Electronic Device]
[0011] Although an electronic device according to technology of the present
disclosure is applicable to various types of information terminals and the like, an
example will be given in which the technology of the present disclosure is applied to a
wristband-type electronic device as one example in the present embodiment.
[Overall Configuration of Electronic Device 1]
[0012] FIG. 1 schematically illustrates a configuration example of an electronic
device 1 according to a first embodiment of the present disclosure.
[0013] The electronic device 1 includes a wristband body 2 having a ring shape, a
transparent panel section 10 and an imaging section 20 provided on a portion of the
wristband body 2, and a cover glass 3 provided on an upper surface of the transparent
panel section 10. The cover glass 3 and a panel section-valid region 11 of the
transparent panel section 10 may each be transparent as a whole.
[0014] The transparent panel section 10 includes a plurality of transparent
light-emitting elements 16 arranged in a matrix as illustrated in FIG. 7, which will be
described later, a plurality of wiring lines for light-emitting elements coupled to the
respective plurality of transparent light-emitting elements 16, and a lattice-shaped
structural member 70 that separates the plurality of transparent light-emitting elements
16 from each other. The transparent light-emitting element 16 includes, for example, a
transparent organic EL (Electro Luminescence) element (transparent OLED (Organic
Light Emitting Diode)). Alternatively, the transparent light-emitting element 16 may
also be a quantum dot light-emitting element.
[0015] The transparent panel section 10 has a function as a display panel for
displaying an image on the panel section-valid region 11 using light emitted by the
plurality of transparent light-emitting elements 16. Further, the transparent panel
7
section 10 has a function as a touch sensor for detecting a touch state of an object such
as a finger or the like on the basis of a value of capacitance between the plurality of
wiring lines for light-emitting elements, for example.
[0016] The imaging section 20 is disposed under a partial region of the transparent
panel section 10. The imaging section 20 has a function of imaging, via the
transparent panel section 10, an object which is in contact with or in proximity to the
partial region of the transparent panel section 10. The object to be imaged by the
imaging section 20 may be, for example, a portion of a living body. The imaging
section 20 may have a function of a biometric authentication device that performs
biometric authentication on a part of a living body on the basis of a captured image of
the part of the living body obtained by imaging the part of the living body. The
function as the biometric authentication device of the imaging section 20 enables a
configuration of a fingerprint sensor, for example,
[0017] FIG. 2 illustrates a display example of the transparent panel section 10
included in the electronic device 1.
The transparent panel section 10 includes, for example, the panel section-valid
region 11 that displays various types of information as illustrated in FIG. 2. The
various types of information display may be various shapes and various types of text
information. For example, as illustrated in FIG. 2, the transparent panel section 10
displays a message indicating performing "personal authentication" in a case where the
imaging section 20 is used as a fingerprint sensor, information promoting placing of a
finger at a position corresponding to the imaging section 20, and the like.
[Main Structure of Electronic Device 1]
[0018] FIGs. 3 and 4 each illustrate a main structure of the electronic device 1.
FIG. 3 illustrates a structure of the transparent panel section 10 and a vicinity thereof
8
when the electronic device 1 is viewed from upper side (side of an object to be imaged).
FIG. 4 corresponds to a cross-section taken along a line A-A in FIGs. 1 and 3. FIG. 5
illustrates a detailed configuration example of the imaging section 20.
[0019] As illustrated in FIGs. 3 and 4, the transparent panel section 10 includes the
panel section-valid region 11, a panel section-outer frame 12, and a panel driver 13.
The electronic device 1 further includes a touch determination section 14 and a light
emission controller 15 coupled to the transparent panel section 10.
[0020] In the panel section-valid region 11, as illustrated in FIG. 7 to be described
later, a plurality of transparent light-emitting elements 16 is arranged in a matrix.
[0021] The touch determination section 14 determines, in a case where the
transparent panel section 10 is used as a touch sensor, a state of a touch. The light
emission controller 15 controls light emission of the plurality of transparent
light-emitting elements 16 via the panel driver 13.
[0022] As illustrated in FIGs. 3 and 4, the imaging section 20 includes a microlens
array module 21, an imaging section-outer frame 22, an imaging element 30, and a
substrate 31. The microlens array module 21 is disposed within the panel section-valid
region 11 of the transparent panel section 10 as viewed from the upper side. The
electronic device 1 further includes an imaging processor 32 coupled to the imaging
element 30 and an authentication processor 33 coupled to the imaging processor 32.
[0023] The imaging element 30 includes, for example, a CMOS (Complementary
Metal Oxide Semiconductor) sensor. The imaging element 30 is disposed on the
substrate 31.
[0024] The imaging processor 32 performs predetermined image processing on a
captured image obtained by the imaging element 30. The authentication processor 33
performs biometric authentication on the basis of the captured image that has been
9
subjected to the image processing by the imaging processor 32. The authentication
processor 33 performs, for example, in a case where the imaging section 20 is used as a
fingerprint sensor, a process of fingerprint authentication. The authentication
processor 33 authenticates a fingerprint pattern, for example, as the process of the
fingerprint authentication. When the fingerprint pattern is to be authenticated, for
example, minutiae (ridge ending and bifurcation of a fingerprint) may be used as feature
amounts of the fingerprint. Further, the authentication processor 33 may authenticate
feature amounts of sweat glands or veins instead of the fingerprint as the biometric
authentication. In addition, authentication may be performed by combining two or
more feature amounts among the feature amounts of the fingerprint, the sweat glands,
and the veins.
[0025] As illustrated in FIGs. 4 and 5, the microlens array module 21 is disposed
between the imaging element 30 and the panel section-valid region 11 of the transparent
panel section 10. The microlens array module 21 includes, in order from the upper
side, a cover glass-and-light guide plate 60, a microlens array 50, and a light guide plate
40.
[0026] As illustrated in FIG. 5, the microlens array 50 includes a plurality of
microlenses 51 arranged in a matrix. The microlens array 50 collects object light from
an object such as a finger or the like toward the imaging element 30 by each of the
plurality of microlenses 51.
[0027] The cover glass-and-light guide plate 60 serves to protect a surface of the
microlens array 50. The cover glass-and-light guide plate 60 has a function of
bringing the object light transmitted through the panel section-valid region 11 of the
transparent panel section 10 to each of the plurality of microlenses 51. The cover
glass-and-light guide plate 60 has a plurality of light guide paths each provided at
10
corresponding one of positions of the plurality of microlenses 51.
[0028] As illustrated in FIGs. 4 and 5, the light guide plate 40 has a plurality of
light guide paths 41. The plurality of light guide paths 41 is each provided at
corresponding one of the positions of the plurality of microlenses 51, and brings the
light collected by each of the plurality of microlenses 51 to the imaging element 30.
[0029] FIG. 6 illustrates an example of regions to be imaged by the microlenses 51
of the imaging section 20. FIG. 7 illustrates an exmaple of a relationship between a
structure of the transparent panel section 10 and disposition positions of the microlenses
51 of the imaging section 20. FIG. 8 schematically illustrates object images 34 formed
on the imaging element 30 of the imaging section 20. FIG. 9 illustrates an example of
a captured image 35 by obtained by the imaging section 20 and a post-compositing
process image 36 based on the captured image 35.
[0030] As illustrated in FIG. 7, the transparent panel section 10 includes the
plurality of wiring lines for light-emitting elements coupled to the respective plurality of
transparent light-emitting elements 16 arranged in a matrix, and the lattice-shaped
structural member 70 that separates the plurality of transparent light-emitting elements
16 from each other. In the imaging section 20, it is preferable that the plurality of
microlenses 51 be disposed to cause the plurality of microlenses 51 not to overlap with
the lattice-shaped structural member 70 as viewed from the upper side (object side), to
cause the lattice-shaped structural member 70 not to be shown in the captured image.
The plurality of microlenses 51 may be disposed to cause an arrangement pitch p2 of
the plurality of microlenses 51 to be substantially the same as an arrangement pitch p1
of the plurality of transparent light-emitting elements 16.
[0031] As illustrated in FIG. 8, a plurality of image portions corresponding to the
arrangement pitch p2 of the plurality of microlenses 51 is formed as object images 34
11
on the imaging element 30 of the imaging section 20. Consequently, as illustrated in
FIG. 9, a plurality of partial images is formed as the captured image 35. In the
imaging processor 32, as illustrated in FIG. 9, the plurality of partial image in the
captured image 35 is subjected to a compositing process to generate the
post-compositing process image 36. This generates a whole image of the object.
[0032] The imaging section 20 is preferably configured in a manner that imaging
regions (light-capturing areas) of adjacent plurality of microlenses 51 with respect to the
object (a finger 90) to be imaged are partially overlapped, as illustrated in FIG. 6.
Thus, the plurality of partial images whose peripheral portions partially overlap each
other is formed as the captured image 35; therefore, in a case where the compositing
process is performed as illustrated in FIG. 9, it is possible to generate a seamless whole
image without conspicuous seams.
[0033] FIG. 10 illustrates a first modification example of a structure of the
transparent panel section 10 and disposition positions of the microlenses 51 of the
imaging section 20.
[0034] As illustrated in FIG. 7, it is preferable that the plurality of microlenses 51
be disposed so as not to overlap with the lattice-shaped structural member 70 as viewed
from the upper side (object side), to cause the lattice-shaped structural member 70 not to
be shown in the captured image. However, due to positional deviation or the like in
manufacturing, the microlenses 51 may overlap with the lattice-shaped structural
member 70 as viewed from the upper side (object side) as illustrated in FIG. 10, and the
lattice-shaped structural member 70 may be shown in the captured image. In such a
case, it is desirable to perform image processing to cause the image of the lattice-shaped
structural member 70 to be erased by the imaging processor 32. This makes it possible
to increase an accuracy of the biometric authentication performed by the authentication
12
processor 33. However, the process of the biometric authentication may also be
performed on the basis of the captured image in which the image of the lattice-shaped
structural member 70 remains to be shown, without performing the image processing of
erasing the image of the lattice-shaped structural member 70. In this case, it is
possible to increase the accuracy of the biometric authentication by performing the
process of the biometric authentication using a statistical method on the captured image
in which the lattice-shaped structural member 70 remains to be shown, for example.
In such a case, data to be used for the process of the statistical biometric authentication
may be acquired from a database or the like stored in an external server or the like.
[Illumination at Time of Imaging]
[0035] When imaging by the imaging section 20 is performed, the transparent panel
section 10 may be caused to emit light to be used as illumination light for imaging. In
a case where the transparent light-emitting elements 16 and the microlenses 51 are
disposed as illustrated in FIG. 7 as viewed from the object side (upper side), the
transparent panel section 10 causes a transparent light-emitting element 16 disposed at a
position different from at least a position at which a microlens 16 to be used for the
imaging is disposed, as viewed from the object side, among the plurality of transparent
light-emitting elements 16 disposed in a partial region corresponding to the imaging
section 20, to emit light for illumination, when the imaging by the imaging section 20 is
performed.
[0036] FIG. 11 illustrates a second modification example of a relationship between
a structure of the transparent panel section 10 and disposition positions of the
microlenses 51 of the imaging section 20. Further, FIG. 11 illustrates an example of a
light emitting state of the transparent panel section 11 at a time of imaging.
[0037] The plurality of microlenses 51 may be disposed to cause the arrangement
13
pitch p2 of the plurality of microlenses 51 to be greater than the arrangement pitch p1 of
the plurality of transparent light-emitting elements 16. In FIG. 11, the plurality of
microlenses 51 is disposed to cause the arrangement pitch p2 to be twice the
arrangement pitch p1 of the plurality of transparent light-emitting elements 16.
However, the plurality of microlenses 51 is disposed to cause the arrangement pitch p2
to be an integral multiple of two or more of the arrangement pitch p1 of the plurality of
transparent light-emitting elements 16. In this case, when the imaging is performed by
the imaging section 20, the transparent panel section 10 may cause a transparent
light-emitting element 16 disposed at a position different from at least a position at
which a microlens 16 to be used for the imaging is disposed, as viewed from the object
side, among the plurality of transparent light-emitting elements 16 disposed in the
partial region corresponding to the imaging section 20, to emit light for illumination.
[0038] FIG. 12 shows a third modification example of the relation between the
structure of transparent panel section 10 and disposition position of microlenses 51 of
imaging section 20. FIG. 12 is a third modification example of a relationship between
a configuration of the transparent panel section 10 and disposition positions of the
microlenses 51 of the imaging section 20. Further, FIG. 12 illustrates an example of a
light emitting state of the transparent panel section 11 at a time of imaging.
[0039] As illustrated in FIG. 12, in the transparent panel section 10, a transparent
light-emitting element 17 having a segmented structure for illumination may be
disposed at an outside of a region in which the plurality of microlenses 16 is disposed,
as viewed from the object side. In this case, when the imaging is performed by the
imaging section 20, the transparent panel section 10 may cause a transparent
light-emitting element 17 having the segmented structure for illumination disposed at a
position different from at least a position at which a microlens 16 to be used for the
14
imaging is disposed among the plurality of transparent light-emitting elements 16 to
emit light.
[Configuration Example of Touch Sensor]
[0040] FIG. 13 illustrates an example of a wiring structure of the transparent panel
section 10. FIG. 14 illustrates an implementation example of a touch sensor function
using wiring lines of the transparent panel section 10.
[0041] As illustrated in FIG. 13, the transparent panel section 10 includes, as the
plurality of wiring lines for light-emitting elements, a plurality of common lines 71 to
which a common drive signal is supplied and a plurality of segment lines 72 to which an
individual drive signal is supplied.
[0042] The plurality of common lines 71 extends in a first direction and is arranged
in a second direction that intersects the first direction. The plurality of common lines
71 is coupled to the respective plurality of transparent light-emitting elements 16 in the
first direction. It is to be noted that, in FIG. 13, the first direction is a horizontal
direction (a direction parallel to a left/right direction and an X direction), and the second
direction is a vertical direction (a direction parallel to a top/bottom direction and a Y
direction).
[0043] The plurality of segment lines 72 extends in the second direction and is
arranged in the first direction. The plurality of segment lines 72 is coupled to the
respective plurality of transparent light-emitting elements 16 in the second direction.
One end or the other end of the plurality of segment lines 72 is pulled out so as to
alternately extend to the upper right side or the lower right side in the horizontal
direction.
[0044] In such a wiring structure, for example, the plurality of segment lines 72
may be divided approximately into halves of left and right portions, and a first electrode
15
section (PAD1) may be coupled to one end side of each of the plurality of segment lines
72 included in the left half portion. In addition, a second electrode section (PAD2)
may be coupled to one end side of each of the plurality of common lines 71 included in
the right half potion.
[0045] Further, for example, the plurality of common lines 71 may be divided
approximately into halves of top and bottom portions, and a third electrode section
(PAD3) may be coupled to one end side of each of the plurality of common lines 71
included in the top half portion. In addition, a fourth electrode section (PAD4) may be
coupled to one end side of each of the plurality of common lines 71 included in the
bottom half portion.
[0046] Thus, as illustrated in FIG. 14, it is possible to form two sensor regions in
the horizontal direction and two sensor regions in the vertical direction, a total of four
sensor regions (four channels) in the top, bottom, left, and right. That is, it is possible
to form: a sensor region of the first electrode section (PAD1) and the third electrode
section (PAD3); a sensor region of the first electrode section (PAD1) and the fourth
electrode section (PAD4); a sensor region of the second electrode section (PAD2) and
the third electrode section (PAD3); and a sensor region of the second electrode section
(PAD2) and the fourth electrode section (PAD4).
[0047] The common line 71 corresponds to a specific example of a "first wiring
line" according to the present disclosure. The segment line 72 corresponds to a
specific example of a "second wiring line" according to the present disclosure. The
touch determination section 14 is able to determine a state of touch in the transparent
panel section 10 on the basis of a value of capacitance between at least one wiring line
out of the plurality of first wiring lines and at least one wiring line out of the plurality of
second wiring lines. For example, in the example of FIG. 14, it is possible to
16
determine the state of the touch in the top left sensor region out of the four sensor
regions of top, bottom, left, and right, on the basis of a value of capacitance between the
plurality of segment lines 72 corresponding to the first electrode section (PAD1) and the
plurality of common lines 71 corresponding to the third electrode section (PAD3).
[0048] It is to be noted that the number into which the sensor region is to be divided
is not limited to four, and may be three or less, or five or more. Further, the direction
in which the sensor region is divided is not limited to two directions, and may be only
one direction. For example, as illustrated in FIG. 18, which will be described later, it
may have a structure such that there are four sensor regions (four channels) in the
horizontal direction. Further, the case where the plurality of common lines 71 and the
plurality of segment lines 72 both serve as the wiring lines for light-emitting elements
and the wiring lines for touch detection has been described as an example in the above
explanation; however, the plurality of common lines 71 and the plurality of segment
lines 72 may be provided as the wiring lines for touch detection different from the
wiring lines for the light-emitting elements. In this case, the plurality of wiring lines
for light-emitting elements and the plurality of wiring lines for touch detection may be
provided inside a single transparent panel section 10, or the transparent panel section 10
may have a structure in which a panel for light emission (for display) including the
plurality of wiring lines for light-emitting elements and a panel for touch detection
including the plurality of wiring lines for touch detection are stacked.
[1.2 Calibration of Touch Sensor]
[0049] Next, calibration of a touch sensor (the transparent panel section 10) in the
electronic device 1 will be described. In a case where the transparent panel section 10
is used as a touch sensor, it is desirable to perform calibration (correction) of a
determination threshold of a touch state and calibration of a working interval of the
17
touch sensor in order to provide good sensing.
[1.2.1 Configuration Example of Control System of Electronic Device]
[0050] FIG. 15 is a configuration example of a control system of the electronic
device 1 for performing calibration of the touch sensor.
[0051] The electronic device 1 includes the transparent panel section 10 serving as
the touch sensor, the imaging section 20 serving as the fingerprint sensor, a CPU
(Central Processing Unit) 110, a storage 113, and a communication section 114.
[0052] The CPU 110 has a function as a controller 111 and a function as a
determination section 112. However, the function as the controller 111 and the
function as the determination section 112 may be achieved as a program (software) to
be executed by the CPU 110, or may be achieved as functions built in at least one of the
transparent panel section 10 and the imaging section 20.
[0053] Further, the CPU 110 may have the functions of the touch determination
section 14 and the light emission controller 15 described above (FIG. 3), and the
functions of the imaging processor 32 and the authentication processor 33. The
determination section 112 may include the function of the touch determination section
14.
[0054] The communication section 114 performs data communication to and from
the server 115 via a wireless or wired network.
[0055] Hereinafter, a method of controlling a control parameter of touch detection
will be described using the configuration of the control system illustrated in FIG. 15.
The control parameter of touch detection includes, for example, a determination
threshold of a touch state and a working interval of the touch sensor. Hereinafter, as
examples of control parameters, methods of achieving calibration of the determination
threshold of the touch state and calibration of the working interval of the touch sensor
18
will be described.
[1.2.2 Calibration of Determination Threshold in Touch State]
[0056] First, a description will be given of a method of performing the calibration
of the determination threshold of the touch state by using the function as the fingerprint
sensor of the imaging section 20.
[0057] As for capacitance measured by the touch sensor, a larger value is measured
as an area being in contact is larger when touched. In addition, capacitance measured
by the touch sensor may vary depending on a person who performs touching or an
environment. Appropriate correction (calibration) is necessary to accurately determine
the touch state without such human variations or environmental variations.
[0058] FIG. 16 illustrates an outline of determination thresholds of touch states in
the electronic device 1. FIG. 16 illustrates how thresholds for determining touch states
are decided by combining the fingerprint sensor and the touch sensor. The upper part
of FIG. 16 illustrates a relationship between capacitance (vertical axis) measured by the
touch sensor and a distance (horizontal axis) between a finger 90 and a sensor surface
91 of the touch sensor. The lower part of FIG. 16 illustrates shot images of the
fingerprint sensor corresponding to the distances between the finger 90 and the sensor
surface 91 of the touch sensor.
[0059] As illustrated in FIG. 16, it is possible to decide the thresholds of the value
of capacitance for determining a presence or absence of the touch (threshold A) and an
intensity of the touch (threshold B) on the basis of the relationship between the size
(area) of the fingerprint image shot by the fingerprint sensor and the value of
capacitance measured by the touch sensor.
[0060] In the configuration of the control system illustrated in FIG. 15, the
determination section 112 determines the state of the touch in the touch sensor on the
19
basis of at least one determination threshold. Further, the determination section 112
determines, as the state of the touch, at least the presence or absence of the touch and
the intensity of the touch.
[0061] The controller 111 has a function as a determination threshold calculation
section that calculates at least one determination threshold on the basis of the value of
capacitance in the touch sensor and a captured image of an object imaged by the
imaging section 20 (the fingerprint image shot by the fingerprint sensor). The
determination threshold calculation section calculates, as the at least one determination
threshold, at least a first determination threshold (threshold A in FIG. 16) to be used for
the determination of the presence or absence of the touch, and a second determination
threshold (threshold B in FIG. 16) to be used for the determination of the intensity of
the touch.
[0062] It is to be noted that a part or all of the functions of the controller 111 and
the determination section 112 for performing calibration of the determination threshold
of the touch state may be achieved as functions built in at least one of the transparent
panel section 10 and the imaging section 20.
[0063] Parameter information such as the calculated determination threshold may
be stored in the storage 113 or may be stored in the server 120 by the communication
section 114.
[0064] FIG. 17 illustrates an outline of a process of calculating a determination
threshold of a touch state in the electronic device 1.
[0065] In the electronic device 1, a value of capacitance is acquired by the touch
sensor (step S101), and at the same time, a fingerprint image is shot by the fingerprint
sensor (step S102).
[0066] Next, the electronic device 1 determines a pattern of the shot image (step
20
S103). Thus, the state of the touch is estimated from an image size of the finger 90
that has been shot. For example, in a case where the electronic device 1 determines
that the pattern is "no fingerprint image" in step S103, the electronic device 1
determines that the state is no touch (step S104). In a case where the electronic device
1 determines that the pattern is "fingerprint image: small" in step S103, the electronic
device 1 determines that the state is a light touch (step S105). Further, in a case where
the electronic device 1 determines that the pattern is "fingerprint image size: large" in
step S103, the electronic device 1 determines that the state is a strong touch (step S106).
[0067] Next, the electronic device 1 determines whether data necessary for deciding
the determination threshold of the touch state has been acquired (step S107). If the
electronic device 1 determines that the necessary data has not been acquired (step S107:
N), the electronic device 1 returns to step S101.
[0068] If the electronic device 1 determines that the necessary data has been
acquired by repeating the process of acquiring the necessary data as described above
(step S107: Y), the electronic device 1 then calculates the determination threshold of the
touch state on the basis of the data of the relationship between the value of capacitance
of the touch sensor and the state of the touch (step S108), and ends the process.
[0069] It is possible to achieve the process of deciding the determination threshold
of the touch state described above, for example, by continuously and repeatedly
acquiring the relationship between the distance between the finger 90 and the touch
sensor and the value of capacitance of the touch sensor in a course of bringing the finger
90 close to the touch sensor when the user performs the fingerprint authentication.
[1.2.3 Calibration of Working Interval of Touch Sensor]
[0070] Here, a description will be given of a method of performing the calibration
of the working interval of the touch sensor using the function as the fingerprint sensor
21
of the imaging section 20.
[0071] In a touch sensor operation, a moving speed of the finger 90 and a time
period of being in contact when performing touching are different for each user. In
particular, a fast operation causes missing of data if the working interval of touch
detection is long, resulting in a malfunction.
[0072] First, a description will be given of a state in which missing of data occurs.
Here, it is assumed that the touch sensor has four sensor channels, ch1, ch2, ch3, and
ch4.
[0073] FIG. 18 illustrates an example of an operation of the user on the touch
sensor in the electronic device 1. FIG. 19 illustrates a first example of change in
values of capacitance with time detected by the touch sensor in the electronic device 1.
FIG. 20 illustrates a second example of change in values of capacitance with time
detected by the touch sensor in the electronic device 1.
[0074] As illustrated in FIG. 18, suppose that the finger 90 is slid laterally on the
touch sensor of 4 channels. FIGs. 19 and 20 each illustrate an example of change in
values of capacitance with time detected by the touch sensor at this time. FIG. 19 is a
graph where the working interval of the touch sensor is 8 msec, and it can be confirmed
that the peaks of the values of capacitance in the respective channels sequentially appear
as the finger 90 is moved.
[0075] In contrast, FIG. 20 is a graph where the working interval of the touch
sensor is 30 msec. In the case where the working interval is 30 msec, the peak of the
sensor channel ch3 is not confirmed. This occurs because the working interval of the
touch sensor is long and a temporal resolution is low, and thereby causing missing of
data when the finger 90 passes through the sensor channel ch3.
[0076] It is possible to prevent the missing of data by reducing the working interval
22
of the touch sensor, but power consumption is increased. Therefore, it is desirable to
set an optimal working interval for the operation speed so as not to cause the missing of
data.
[0077] The following describes a method of, by combining the fingerprint sensor
and the touch sensor, identifying a user by the fingerprint sensor and determining the
optimal working interval of the touch sensor on the basis of an operation history
(statistical data of the operation speeds) of the user.
[0078] In the configuration of the control system illustrated in FIG. 15, the
controller 111 controls the working interval of touch detection in the touch sensor on
the basis of a result of authentication performed by the authentication processor 33 (FIG.
3).
[0079] The controller 111 acquires a statistic of an operation speed of the touch of
the user authenticated by the authentication processor 33 (FIG. 3), on the basis of a
database related to the operation speed in which a plurality of users to be subjected to
the biometric authentication by the authentication processor 33 are associated with
statistics of operation speeds of touches in the touch sensor by the respective plurality of
users. The controller 111 calculates a working interval of touch detection optimized
for the authenticated user on the basis of the acquired statistic of the operation speed of
the touch.
[0080] Parameter data for each user including the operation speed and the database
related to the operation speed may be stored in the storage 113 or acquired from the
server 120 by the communication section 114.
[0081] It is to be noted that a part or all of the functions of the controller 111 for
performing calibration of the working interval of the touch sensor may be achieved as
functions built in at least one of the transparent panel section 10 and the imaging section
23
20.
[0082] FIG. 21 illustrates an outline of a process of correcting a working interval of
the touch sensor in the electronic device 1.
[0083] First, the electronic device 1 performs fingerprint authentication (step S201)
and identifies a fingerprint pattern of a user (step S202). Next, the electronic device 1
reads out and acquires from the database a statistic related to the operation speed
corresponding to the identified fingerprint pattern (steps S203, S204, and S205). It is
to be noted that, although FIG. 21 illustrates an operation example in a case where the
fingerprint pattern is selected from three patterns A, B, and C for the sake of
explanation, the number of fingerprint patterns to be selected is not limited to three, and
may be any number. Next, the electronic device 1 calculates the optimal working
interval of the touch sensor for the user on the basis of the acquired statistic (step S206).
Thereafter, the electronic device 1 changes the working interval of the touch sensor to
the calculated value and ends the process (step S207).
[0084] FIG. 22 illustrates an example of a database of statistics related to operation
speeds of users in the electronic device 1 created from operation histories of the users.
FIG. 22 includes, as examples of operation speed parameters for calculating the working
interval of the touch sensor, a sliding speed indicating a speed at which the finger 90 is
moved laterally, and a touching speed indicating a speed at which the finger 90 is
touched and released.
[0085] It is to be noted that, although FIG. 22 illustrates an example in the case
where the fingerprint patterns are three patterns A, B, and C, the number of fingerprint
patterns registered in the database is not limited to three, and may be any number.
[1.3 Effects]
[0086] As described above, according to the present embodiment, the imaging
24
section 20 that images, via the transparent panel section 10, the object (the finger 90)
which is in contact with or in proximity to the partial region of the transparent panel
section 10 is disposed under the partial region of the transparent panel section 10;
therefore, it is possible to achieve a plurality of functions in a compact size. For
example, the display function and the touch sensor function may be achieved by the
transparent panel section 10, and the imaging function for fingerprint authentication
may be achieved by the imaging section 20.
[0087] It is to be noted that effects described in this description is merely
illustrative and not limitative, and other effects may be achieved. The same applies to
the following effects of other embodiments.
[2. Second Embodiment]
[0088] Next, an electronic device according to a second embodiment of the present
disclosure will be described. It is to be noted that in the following description, the
same reference numerals are given to substantially the same components as those of the
electronic device according to the first embodiment, and description thereof will be
omitted as appropriate.
[0089] FIGs. 23 and 24 each illustrate a main structure of an electronic device 1A
according to the second embodiment of the present disclosure. FIG. 23 illustrates a
structure of the transparent panel section 10 and a vicinity thereof when the electronic
device 1A is viewed from the upper side (the side of an object to be imaged). FIG. 24
corresponds to a cross-section taken along a line A-A in FIG. 23.
[0090] In the first embodiment, the example (refer to FIGs. 11 and 12) has been
given in which the transparent panel section 10 is partially caused to emit light to be
used as the illumination light for imaging when imaging is performed by the imaging
section 20; however, as illustrated in FIGs. 23 and 24, an illumination light source 80
25
for imaging may be separately provided.
[0091] The illumination light source 80 may be, for example, an LED (Light
Emitting Diode). The illumination light source 80 is disposed at an outside of a partial
region (a region corresponding to the imaging section 20) of the transparent panel
section 10. The illumination light source 80 may be disposed on at least one side
surface of the cover glass 3 provided on the upper side of the transparent panel section
10, for example. Thus, the light from the illumination light source 80 may be brought
to the imaging section 20 by the cover glass 3. In the configuration example of each of
FIGs. 23 and 24, the illumination light sources 80 are respectively disposed on two
opposite sides of the cover glass 3. Thus, when imaging is performed by the imaging
section 20, the illumination light may be emitted by the illumination light sources 80.
Alternatively, the illumination light source 80 and the partial light emission by the
transparent panel section 10 may be used in combination.
[0092] The rest of the configuration, operation, and effects may be substantially the
same as those of the electronic device 1 according to the first embodiment.
[3. Third Embodiment]
[0093] Next, an electronic device according to a third embodiment of the present
disclosure will be described. It is to be noted that in the following description, the
same reference numerals are given to substantially the same components as those of the
electronic device according to the first or second embodiment, and description thereof
will be omitted as appropriate.
[0094] FIG. 25 illustrates a main structure of an electronic device 1B according to
the third embodiment of the present disclosure. FIG. 25 illustrates a structure of the
transparent panel section 10 and a vicinity thereof when the electronic device 1B is
viewed from the upper side (the side of an object to be imaged).
26
[0095] The panel section-valid region 11 of the transparent panel section 10 is
transparent as a whole; therefore, underlying structures of the panel section-valid region
11 may be visible when the transparent panel section 10 is not emitting light. For this
reason, a design material 18 may be disposed under the transparent panel section 10 as
illustrated in FIG. 25. The design material 18 may have a wood-grain pattern or any
pattern, for example. As a result, it is possible to improve a design property.
[0096] As illustrated in FIG. 25, the design material 18 is desirably disposed under
a region different from the partial region of the transparent panel section 10 (the region
corresponding to the imaging section 20) as viewed from the upper side, so as not to
affect the imaging of the object performed by the imaging section 20. Further, the
design material 18 is desirably disposed under at least a region corresponding to the
panel section-valid region 11 other than the region corresponding to the imaging section
20 as viewed from the upper side.
[0097] The rest of the configuration, operation, and effects may be substantially the
same as those of the electronic device 1 according to the first embodiment.
[4. Other Embodiments]
[0098] Techniques according to the present disclosure are not limited to the
descriptions of the above embodiments, and various modifications may be made.
[0099] For example, the present disclosure may have the following configurations.
According to the present technology having the following configuration, the
imaging section that images, via the transparent panel section, the object which is in
contact with or in proximity to the partial region of the transparent panel section is
disposed under the partial region of the transparent panel section; therefore, it is
possible to achieve a plurality of functions in a compact size. For example, the display
function and the touch sensor function may be achieved by the transparent panel section,
27
and the imaging function for fingerprint authentication may be achieved by the imaging
section.
[0100]
(1)
An electronic device including:
a transparent panel section in which a plurality of transparent light-emitting
elements is disposed; and
an imaging section that is disposed under a partial region of the transparent panel
section, and images, via the transparent panel section, an object which is in contact with
or in proximity to the partial region of the transparent panel section.
(2)
The electronic device according to (1), in which the imaging section includes
an imaging element, and
a microlens array in which a plurality of microlenses is disposed, the microlens
array collecting light from the object toward the imaging element by each of the
plurality of microlenses.
(3)
The electronic device according to (2), in which the imaging section further
includes a light guide plate which includes a plurality of light guide paths respectively
corresponding to the plurality of microlenses, the light guide plate bringing the light
collected by each of the plurality of microlenses to the imaging element by each of the
plurality of light guide paths.
(4)
The electronic device according to (2) or (3), in which
the transparent panel section includes a lattice-shaped structural member that
28
separates the plurality of transparent light-emitting elements from each other, and
the plurality of microlenses is disposed to cause the plurality of microlenses not to
overlap with the lattice-shaped structural member as viewed from side of the object.
(5)
The electronic device according to any one of (2) to (4), in which
the plurality of microlenses is disposed to cause an arrangement pitch of the
plurality of microlenses to be the same as an arrangement pitch of the plurality of
transparent light-emitting elements, and,
when imaging is performed by the imaging section, the transparent panel section
causes a transparent light-emitting element to emit light, the transparent light-emitting
element being included in the plurality of transparent light-emitting elements disposed
in the partial region and being disposed at a position different from at least a position at
which a microlens to be used for the imaging is disposed, as viewed from the side of the
object.
(6)
The electronic device according to any one of (2) to (4), in which the plurality of
microlenses is disposed to cause an arrangement pitch of the plurality of microlenses to
be an integral multiple of two or more of an arrangement pitch of the plurality of
transparent light-emitting elements.
(7)
The electronic device according to any one of (2) to (4), in which, when imaging is
performed by the imaging section, the transparent panel section causes a transparent
light-emitting element to emit light, the transparent light-emitting element being
included in the plurality of transparent light-emitting elements, and being disposed at an
outside of a region in which the plurality of microlenses is disposed and at a position
29
different from at least a position at which a microlens to be used for the imaging is
disposed among the plurality of microlenses, as viewed from the side of the object.
(8)
The electronic device according to any one of (1) to (4), further including
an illumination light source that is disposed at an outside of the partial region of
the transparent panel section, and emits illumination light when imaging is performed
by the imaging section.
(9)
The electronic device according to any one of (1) to (8), in which
the object is a portion of a living body, and
the electronic device further includes an authentication processor that performs
biometric authentication on the portion of the living body on a basis of a captured image
of the portion of the living body obtained by imaging performed by the imaging section.
(10)
The electronic device according to (9), in which
the portion of the living body is a finger, and
the authentication processor performs fingerprint authentication as the biometric
authentication.
(11)
The electronic device according to any one of (1) to (10), in which the transparent
panel section
includes, out of a plurality of wiring lines for light-emitting elements coupled to
the respective plurality of transparent light-emitting elements and a plurality of wiring
lines for touch detection provided separately from the plurality of wiring lines for
light-emitting elements, at least the plurality of wiring lines for light-emitting elements,
30
and
has a display function to display an image using light emitted by the plurality of
transparent light-emitting elements and a touch sensor function based on a value of
capacitance between the plurality of wiring lines for light-emitting elements or a value
of capacitance between the plurality of wiring lines for touch detection.
(12)
The electronic device according to (11), further including
a determination section the determines a state of a touch in the transparent panel
section, in which
the transparent panel section includes, as the plurality of wiring lines for
light-emitting elements or the plurality of wiring lines for touch detection,
a plurality of first wiring lines that extends in a first direction, is arranged in a
second direction that intersects the first direction, and is coupled to the respective
plurality of transparent light-emitting elements in the first direction, and
a plurality of second wiring lines that extends in the second direction, is
arranged in the first direction, and is coupled to the respective plurality of transparent
light-emitting elements in the second direction, and
the determination section determines the state of the touch in the transparent panel
section on a basis of a value of capacitance between at least one wiring line out of the
plurality of first wiring lines and at least one wiring line out of the plurality of second
wiring lines.
(13)
The electronic device according to (12), in which the determination section
determines the state of the touch in the transparent panel section on a basis of at least
one determination threshold.
31
(14)
The electronic device according to (13), further including
a determination threshold calculation section that calculates the at least one
determination threshold on a basis of the value of capacitance and a captured image of
the object imaged by the imaging section.
(15)
The electronic device according to (14), in which
the determination section determines, as the state of the touch, at least a presence
or absence of the touch and an intensity of the touch, and
the determination threshold calculation section calculates, as the at least one
determination threshold, at least a first determination threshold to be used for the
determination of the presence or absence of the touch, and a second determination
threshold to be used for the determination of the intensity of the touch.
(16)
The electronic device according to (9) or (10), in which
the transparent panel section
includes, out of a plurality of wiring lines for light-emitting elements coupled
to the respective plurality of transparent light-emitting elements and a plurality of
wiring lines for touch detection provided separately from the plurality of wiring lines
for light-emitting elements, at least the plurality of wiring lines for light-emitting
elements, and
has a display function to display an image using light emitted by the plurality
of transparent light-emitting elements and a touch sensor function based on a value of
capacitance between the plurality of wiring lines for light-emitting elements or a value
of capacitance between the plurality of wiring lines for touch detection, and
32
the electronic device further includes a controller that controls a control parameter
of touch detection in the transparent panel section on a basis of a result of authentication
performed by the authentication processor.
(17)
The electronic device according to (16), in which the controller acquires a statistic
of an operation speed of a touch of a user authenticated by the authentication processor,
on a basis of a database related to the operation speed in which a plurality of users to be
subjected to the biometric authentication by the authentication processor are associated
with statistics of operation speeds of touches in the transparent panel section by the
respective plurality of users, and calculates, as the control parameter, a working interval
of touch detection optimized for the authenticated user on a basis of the acquired
statistic of the operation speed of the touch.
(18)
The electronic device according to (17), further including
a storage that stores the database related to the operation speed.
(19)
The electronic device according to any one of (1) to (19), further including
a design material that is disposed under a region different from the partial region of
the transparent panel section.
(20)
The electronic device according to any one of (1) to (19), in which the transparent
light-emitting element includes a transparent organic EL element or a quantum dot
light-emitting element.
[0101] This application claims the benefit of Japanese Priority Patent Application
JP2018-033776 filed with the Japan Patent Office on February 27, 2018, the entire
33
contents of which are incorporated herein by reference.
[0102] It should be understood by those skilled in the art that various modifications,
combinations, sub-combinations, and alterations may occur depending on design
requirements and other factors insofar as they are within the scope of the appended
claims or the equivalents thereof.
34
CLAIMS
[Claim 1]
An electronic device comprising:
a transparent panel section in which a plurality of transparent light-emitting
elements is disposed; and
an imaging section that is disposed under a partial region of the transparent panel
section, and images, via the transparent panel section, an object which is in contact with
or in proximity to the partial region of the transparent panel section.
[Claim 2]
The electronic device according to claim 1, wherein the imaging section includes
an imaging element, and
a microlens array in which a plurality of microlenses is disposed, the microlens
array collecting light from the object toward the imaging element by each of the
plurality of microlenses.
[Claim 3]
The electronic device according to claim 2, wherein the imaging section further
includes a light guide plate which includes a plurality of light guide paths respectively
corresponding to the plurality of microlenses, the light guide plate bringing the light
collected by each of the plurality of microlenses to the imaging element by each of the
plurality of light guide paths.
[Claim 4]
35
The electronic device according to claim 2, wherein
the transparent panel section includes a lattice-shaped structural member that
separates the plurality of transparent light-emitting elements from each other, and
the plurality of microlenses is disposed to cause the plurality of microlenses not to
overlap with the lattice-shaped structural member as viewed from side of the object.
[Claim 5]
The electronic device according to claim 2, wherein
the plurality of microlenses is disposed to cause an arrangement pitch of the
plurality of microlenses to be the same as an arrangement pitch of the plurality of
transparent light-emitting elements, and,
when imaging is performed by the imaging section, the transparent panel section
causes a transparent light-emitting element to emit light, the transparent light-emitting
element being included in the plurality of transparent light-emitting elements disposed
in the partial region and being disposed at a position different from at least a position at
which a microlens to be used for the imaging is disposed, as viewed from the side of the
object.
[Claim 6]
The electronic device according to claim 2, wherein the plurality of microlenses is
disposed to cause an arrangement pitch of the plurality of microlenses to be an integral
multiple of two or more of an arrangement pitch of the plurality of transparent
light-emitting elements.
[Claim 7]
36
The electronic device according to claim 2, wherein, when imaging is performed
by the imaging section, the transparent panel section causes a transparent light-emitting
element to emit light, the transparent light-emitting element being included in the
plurality of transparent light-emitting elements, and being disposed at an outside of a
region in which the plurality of microlenses is disposed and at a position different from
at least a position at which a microlens to be used for the imaging is disposed among the
plurality of microlenses, as viewed from the side of the object.
[Claim 8]
The electronic device according to claim 1, further comprising
an illumination light source that is disposed at an outside of the partial region of
the transparent panel section, and emits illumination light when imaging is performed
by the imaging section.
[Claim 9]
The electronic device according to claim 1, wherein
the object is a portion of a living body, and
the electronic device further comprises an authentication processor that performs
biometric authentication on the portion of the living body on a basis of a captured image
of the portion of the living body obtained by imaging performed by the imaging section.
[Claim 10]
The electronic device according to claim 9, wherein
the portion of the living body is a finger, and
the authentication processor performs fingerprint authentication as the biometric
37
authentication.
[Claim 11]
The electronic device according to claim 1, wherein the transparent panel section
includes, out of a plurality of wiring lines for light-emitting elements coupled to
the respective plurality of transparent light-emitting elements and a plurality of wiring
lines for touch detection provided separately from the plurality of wiring lines for
light-emitting elements, at least the plurality of wiring lines for light-emitting elements,
and
has a display function to display an image using light emitted by the plurality of
transparent light-emitting elements and a touch sensor function based on a value of
capacitance between the plurality of wiring lines for light-emitting elements or a value
of capacitance between the plurality of wiring lines for touch detection.
[Claim 12]
The electronic device according to claim 11, further comprising
a determination section the determines a state of a touch in the transparent panel
section, wherein
the transparent panel section includes, as the plurality of wiring lines for
light-emitting elements or the plurality of wiring lines for touch detection,
a plurality of first wiring lines that extends in a first direction, is arranged in a
second direction that intersects the first direction, and is coupled to the respective
plurality of transparent light-emitting elements in the first direction, and
a plurality of second wiring lines that extends in the second direction, is
arranged in the first direction, and is coupled to the respective plurality of transparent
38
light-emitting elements in the second direction, and
the determination section determines the state of the touch in the transparent panel
section on a basis of a value of capacitance between at least one wiring line out of the
plurality of first wiring lines and at least one wiring line out of the plurality of second
wiring lines.
[Claim 13]
The electronic device according to claim 12, wherein the determination section
determines the state of the touch in the transparent panel section on a basis of at least
one determination threshold.
[Claim 14]
The electronic device according to claim 13, further comprising
a determination threshold calculation section that calculates the at least one
determination threshold on a basis of the value of capacitance and a captured image of
the object imaged by the imaging section.
[Claim 15]
The electronic device according to claim 14, wherein
the determination section determines, as the state of the touch, at least a presence
or absence of the touch and an intensity of the touch, and
the determination threshold calculation section calculates, as the at least one
determination threshold, at least a first determination threshold to be used for the
determination of the presence or absence of the touch, and a second determination
threshold to be used for the determination of the intensity of the touch.
39
[Claim 16]
The electronic device according to claim 9, wherein
the transparent panel section
includes, out of a plurality of wiring lines for light-emitting elements coupled
to the respective plurality of transparent light-emitting elements and a plurality of
wiring lines for touch detection provided separately from the plurality of wiring lines
for light-emitting elements, at least the plurality of wiring lines for light-emitting
elements, and
has a display function to display an image using light emitted by the plurality
of transparent light-emitting elements and a touch sensor function based on a value of
capacitance between the plurality of wiring lines for light-emitting elements or a value
of capacitance between the plurality of wiring lines for touch detection, and
the electronic device further comprises a controller that controls a control
parameter of touch detection in the transparent panel section on a basis of a result of
authentication performed by the authentication processor.
[Claim 17]
The electronic device according to claim 16, wherein the controller acquires a
statistic of an operation speed of a touch of a user authenticated by the authentication
processor, on a basis of a database related to the operation speed in which a plurality of
users to be subjected to the biometric authentication by the authentication processor are
associated with statistics of operation speeds of touches in the transparent panel section
by the respective plurality of users, and calculates, as the control parameter, a working
interval of touch detection optimized for the authenticated user on a basis of the
40
acquired statistic of the operation speed of the touch.
[Claim 18]
The electronic device according to claim 17, further comprising
a storage that stores the database related to the operation speed.
[Claim 19]
The electronic device according to claim 1, further comprising
a design material that is disposed under a region different from the partial region of
the transparent panel section.
[Claim 20]
The electronic device according to claim 1, wherein the transparent light-emitting
element includes a transparent organic EL element or a quantum dot light-emitting
element.

Documents

Application Documents

# Name Date
1 202027034756.pdf 2020-08-13
2 202027034756-STATEMENT OF UNDERTAKING (FORM 3) [13-08-2020(online)].pdf 2020-08-13
3 202027034756-PRIORITY DOCUMENTS [13-08-2020(online)].pdf 2020-08-13
4 202027034756-POWER OF AUTHORITY [13-08-2020(online)].pdf 2020-08-13
5 202027034756-FORM 1 [13-08-2020(online)].pdf 2020-08-13
6 202027034756-DRAWINGS [13-08-2020(online)].pdf 2020-08-13
7 202027034756-DECLARATION OF INVENTORSHIP (FORM 5) [13-08-2020(online)].pdf 2020-08-13
8 202027034756-COMPLETE SPECIFICATION [13-08-2020(online)].pdf 2020-08-13
9 202027034756-Proof of Right [29-12-2020(online)].pdf 2020-12-29
10 202027034756-FORM 3 [10-06-2021(online)].pdf 2021-06-10
11 Abstract.jpg 2021-10-19
12 202027034756-FORM 18 [06-01-2022(online)].pdf 2022-01-06
13 202027034756-FER.pdf 2022-05-17
14 202027034756-OTHERS [17-11-2022(online)].pdf 2022-11-17
15 202027034756-FER_SER_REPLY [17-11-2022(online)].pdf 2022-11-17
16 202027034756-COMPLETE SPECIFICATION [17-11-2022(online)].pdf 2022-11-17
17 202027034756-CLAIMS [17-11-2022(online)].pdf 2022-11-17
18 202027034756-US(14)-HearingNotice-(HearingDate-06-08-2025).pdf 2025-05-23
19 202027034756-Correspondence to notify the Controller [05-08-2025(online)].pdf 2025-08-05

Search Strategy

1 SearchHistoryE_13-05-2022.pdf