Sign In to Follow Application
View All Documents & Correspondence

Information Processing Device, Information Processing Method, And Recording Medium

Abstract: INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND STORAGE MEDIUM An information processing apparatus according to the present invention includes: an acquisition unit that acquires biometric information on a user in a procedure area where the user is able to select a first scheme involving use of biometric authentication in a procedure or a second scheme not involving use of the biometric authentication in the procedure; a matching unit that matches the biometric information with registered biometric information on a registrant allowed to use the first scheme and determines whether or not the user is the registrant; and a guidance unit that, when it is determined by the matching unit that the user is the registrant, guides the user for a procedure place corresponding to the first scheme and, when it is determined that the user is not the registrant, generates guidance information about a way to a procedure place corresponding to the second scheme.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
27 September 2022
Publication Number
28/2023
Publication Type
INA
Invention Field
COMPUTER SCIENCE
Status
Email
Parent Application

Applicants

NEC CORPORATION
7-1, Shiba 5-chome, Minato-ku, Tokyo 1088001

Inventors

1. KAWASE, Nobuaki
c/o NEC Corporation, 7-1, Shiba 5-chome, Minato-ku, Tokyo 1088001

Specification

[Technical Field]
[0001]
The present invention relates to an information
processing apparatus, an information processing method,
and a storage medium.
[Background Art]
[0002]
Patent Literature 1 discloses a ticketless
boarding system to perform procedures on a passenger by
using biometric authentication at a plurality of check
points (a check-in lobby, a security inspection site, a
boarding gate, and the like). Further, Patent
Literature 2 discloses a cardless payment system to
perform a payment process on a customer for an item by
using biometric authentication at a cash register of a
shop.
[Citation List]
[Patent Literature]
[0003]
PTL 1: Japanese Patent Application Laid-Open No.
2007-79656
PTL 2: Japanese Patent Application Laid-Open No.
2016-126749
[Summary of Invention]
[Technical Problem]
[0004]
As illustrated in Patent Literature 1 and Patent
Literature 2, procedures involving use of biometric
authentication have been automated in various fields.
In currently provided procedure areas, users may often
perform a procedure after selecting one of an automated
lane where biometric authentication is used to perform
the procedure and a manned lane where a staff member is
3
deployed. In a procedure area where a procedural scheme
involving use of biometric authentication or a
procedural scheme involving use of an authentication
method other than biometric authentication can be
selected, however, if a user makes a mistake in selection
of the procedural scheme, the throughput in the procedure
area will be reduced.
[0005]
Accordingly, in view of the problem described above,
the present invention intends to provide an information
processing apparatus, an information processing method,
and a storage medium that can improve the throughput in
a procedure area where a procedural scheme involving use
of biometric authentication or a procedural scheme
involving use of an authentication method other than
biometric authentication can be selected.
[Solution to Problem]
[0006]
According to one example aspect of the present
invention, provided is an information processing
apparatus including: an acquisition unit that acquires
biometric information on a user in a procedure area where
the user is able to select a first scheme involving use
of biometric authentication in a procedure or a second
scheme not involving use of the biometric authentication
in the procedure; a matching unit that matches the
biometric information with registered biometric
information on a registrant, the registrant being
allowed to use the first scheme, and determines whether
or not the user is the registrant; and a guidance unit
that, when it is determined by the matching unit that
the user is the registrant, guides the user for a
procedure place corresponding to the first scheme and,
when it is determined that the user is not the registrant,
generates guidance information about a way to a procedure
place corresponding to the second scheme.
[0007]
4
According to another example aspect of the present
invention, provided is an information processing method
comprising: acquiring biometric information on a user in
a procedure area where the user is able to select a first
scheme involving use of biometric authentication in a
procedure or a second scheme not involving use of the
biometric authentication in the procedure; matching the
biometric information with registered biometric
information on a registrant, the registrant being
allowed to use the first scheme, and determining whether
or not the user is the registrant; and when it is
determined that the user is the registrant, guiding the
user for a procedure place corresponding to the first
scheme and, when it is determined that the user is not
the registrant, guiding the user about a procedure place
corresponding to the second scheme.
[0008]
According to yet another example aspect of the
present invention, provided is a storage medium storing
a program that causes a computer to perform: acquiring
biometric information on a user in a procedure area where
the user is able to select a first scheme involving use
of biometric authentication in a procedure or a second
scheme not involving use of the biometric authentication
in the procedure; matching the biometric information
with registered biometric information on a registrant,
the registrant being allowed to use the first scheme,
and determining whether or not the user is the
registrant; and when it is determined that the user is
the registrant, guiding the user for a procedure place
corresponding to the first scheme and, when it is
determined that the user is not the registrant, guiding
the user about a procedure place corresponding to the
second scheme.
[Advantageous Effects of Invention]
[0009]
According to the present invention, it is possible
5
to provide an information processing apparatus, an
information processing method, and a storage medium that
can improve the throughput in a procedure area where a
procedural scheme involving use of biometric
authentication or a procedural scheme involving use of
an authentication method other than biometric
authentication can be selected.
[Brief Description of Drawings]
[0010]
[Fig. 1]
Fig. 1 is a schematic diagram illustrating an
example of an overall configuration of an information
processing system according to a first example
embodiment.
[Fig. 2]
Fig. 2 is a diagram illustrating an example of
information stored in a boarding reservation information
DB according to the first example embodiment.
[Fig. 3]
Fig. 3 is a diagram illustrating an example of
information stored in a user information DB according to
the first example embodiment.
[Fig. 4]
Fig. 4 is a diagram illustrating an example of
information stored in a passage history information DB
according to the first example embodiment.
[Fig. 5]
Fig. 5 is a block diagram illustrating an example
of a hardware configuration of a management server
according to the first example embodiment.
[Fig. 6]
Fig. 6 is a block diagram illustrating an example
of a hardware configuration of a signage terminal
according to the first example embodiment.
[Fig. 7]
Fig. 7 is a layout diagram illustrating an example
of an installation place of a signage terminal in a
6
security inspection site according to the first example
embodiment.
[Fig. 8]
Fig. 8 is a sequence chart illustrating an example
of a process between the management server and the
signage terminal in the information processing system
according to the first example embodiment.
[Fig. 9]
Fig. 9 is a diagram illustrating an example of a
screen displayed on the signage terminal according to
the first example embodiment.
[Fig. 10]
Fig. 10 is a diagram illustrating an example of a
screen displayed on the signage terminal according to
the first example embodiment.
[Fig. 11]
Fig. 11 is a diagram illustrating an example of a
screen displayed on the signage terminal according to
the first example embodiment.
[Fig. 12]
Fig. 12 is a sequence chart illustrating an example
of a process between the management server and an
operation terminal in the information processing system
according to the first example embodiment.
[Fig. 13]
Fig. 13 is a diagram illustrating an example of a
screen displayed on the operation terminal according to
the first example embodiment.
[Fig. 14]
Fig. 14 is a diagram illustrating an example of a
screen displayed on the operation terminal according to
the first example embodiment.
[Fig. 15]
Fig. 15 is a function block diagram of an
information processing apparatus according to a second
example embodiment.
[Description of Embodiments]
7
[0011]
Exemplary example embodiments of the present
invention will be described below with reference to the
drawings. Throughout the drawings, the same elements or
corresponding elements are labeled with the same
references, and the description thereof may be omitted
or simplified.
[First Example Embodiment]
[0012]
Fig. 1 is a schematic diagram illustrating an
example of the overall configuration of an information
processing system 1 according to the present example
embodiment. The information processing system 1
according to the present example embodiment is a computer
system that supports a series of procedures performed in
a first country and a second country, respectively, for
a user (passenger) U who is scheduled to depart the first
country from an airport DA in the first country by an
aircraft and travel to the second country, for example.
The information processing system 1 is operated by a
public institution such as an immigration control bureau
or a trustee entrusted with the operation from such an
institution, for example. Note that, although only the
apparatuses in the first country are illustrated for
simplified illustration, the same can apply to
procedures in the second country.
[0013]
As illustrated in Fig. 1, the information
processing system 1 includes a management server 10, a
check-in terminal 20, an automatic baggage check-in
machine 30, a security inspection apparatus 40, an
automated gate apparatus 50, a boarding gate apparatus
60, operation terminals 42, 52, signage terminals 70,
and cameras 80. The management server 10 and other
apparatuses are connected to each other via a network
NW. The network NW is formed of a local area network
(LAN), a wide area network (WAN), a mobile communication
8
network, or the like. The connection scheme may be a
wireless scheme without being limited to a wired scheme.
[0014]
The management server 10 is an information
processing apparatus that manages various inspection
procedures when the user U enters or departs the country.
The management server 10 is installed in a facility of
an airport company, an airline company, or the like
operating the airport DA, for example. Note that the
management server 10 is not necessarily required to be
a single server and may be configured as a group of
servers including a plurality of servers. For example,
a server responsible for some of the functions of the
management server 10 may be installed in the first
country, and another server responsible for the
remaining functions of the management server 10 may be
installed in the second country.
[0015]
As illustrated in Fig. 1, the management server 10
includes a storage unit 11, an information acquisition
unit 12, a database management unit 13, a matching unit
14, a guidance unit 15, and an add-up unit 16.
[0016]
The storage unit 11 stores information used in each
unit of the management server 10. The storage unit 11
includes a boarding reservation information DB 11a, the
user information DB 11b, and the passage history
information DB 11c, for example.
[0017]
The boarding reservation information DB 11a is a
database that aggregates and stores boarding reservation
information transmitted from reservation systems (not
illustrated) of the airline companies, respectively.
[0018]
Fig. 2 is a diagram illustrating an example of
information stored in the boarding reservation
information DB 11a. The boarding reservation
9
information DB 11a has data items of a reservation number,
a flight number, an airline code, a passenger name, a
departure place, a destination, a flight date, a seat
number, a nationality, a passport number, a family name,
a first name, a date of birth, and a sexuality. Note
that these data items are examples, and other data items
may be further included. The reservation number is an
identifier that uniquely identifies boarding reservation
information. The airline code is an identifier that
uniquely identifies an airline company.
[0019]
The user information DB 11b is a database that
stores information on the user U who has completed a
check-in procedure.
[0020]
Fig. 3 is a diagram illustrating an example of
information stored in the user information DB 11b. The
user information DB 11b has data items of a user ID, a
registered face image, a feature amount, a passenger
name, a reservation number, a departure place, a
destination, a flight date, an airline code, a flight
number, a seat number, a nationality, a passport number,
a family name, a first name, a date of birth, a sexuality,
and procedure status (P1) to procedure status (P5). Note
that these data items are examples, and other data items
may be further included.
[0021]
The user ID is an identifier that uniquely
identifies the user U. In the present example embodiment,
the user ID is issued provided that a result of matching
between a face image obtained by capturing the user U
having a passport in a check-in procedure and a passport
face image read from the passport is that the matching
is successful. In the present example embodiment, the
expression “matching is successful” means that a
matching score indicating a similarity between biometric
information on the user U and registered biometric
10
information on a registrant is greater than or equal to
a predetermined threshold. Further, the expression
“matching is unsuccessful” means that a matching score
is less than the predetermined threshold.
[0022]
The registered face image is a face image
registered for the user U. In the present example
embodiment, the registered face image is registered
during a check-in procedure. The registered face image
may be registered in a procedure operation that is first
performed out of a series of procedure operations
performed when departing a country. It is preferable
that a registered face image be registered based on
consent from the user U and then deleted at a
predetermined time. The feature amount is a value
extracted from biometric information (registered face
image).
[0023]
The registered face image in the present example
embodiment is registered, in the same manner as the user
ID, provided that a result of matching between a face
image obtained by capturing the user U having a passport
in the first procedure operation (check-in procedure)
and a passport face image read from the passport is that
the matching is successful.
[0024]
Further, as the registered face image, a face image
captured in the first procedure operation at the place
is used. The reason therefor is that a face image
captured in the first procedure operation is newer than
a passport face image and that the quality (appearance)
is closer to an image captured in a subsequent
authentication process than the passport face image.
Instead of a target face image (captured face image),
however, a passport face image may be set as a registered
face image (registered biometric information).
[0025]
11
The management server 10 matches face images
(biometric information) captured at the automatic
baggage check-in machine 30, the security inspection
apparatus 40, the automated gate apparatus 50, the
boarding gate apparatus 60, and the signage terminal 70
with registered face images stored in the user
information DB 11b, respectively, and thereby performs
identity verification as to whether or not the user U is
a person who possesses an appropriate boarding thicket.
The details will be described later.
[0026]
Note that, although the term of biometric
information in the present example embodiment means a
face image and a feature amount extracted from the face
image, biometric information is not limited to a face
image and a face feature amount. That is, biometric
authentication may be performed by using an iris image,
a fingerprint image, a palmprint image, an auricle image,
or the like as the biometric information on the user U.
[0027]
The user information illustrated in Fig. 3 includes
boarding reservation information illustrated in Fig. 2.
The boarding reservation information on the user U is
acquired from a passport and a recording medium such as
a boarding ticket or the like during a check-in procedure
and registered in the user information DB 11b on a user
ID basis. The user information DB 11b and the boarding
reservation information DB 11a are associated with each
other by an airline code and a reservation number.
[0028]
The passage history information DB 11c is a
database that stores a passage history of the user U at
the places (check points) for the series of procedural
operations performed in departure from the country.
[0029]
Fig. 4 is a diagram illustrating an example of
information stored in the passage history information DB
12
11c. The passage history information DB 11c has data
items of a user ID, a passage time, a device name, an
operation system type, a passage touch point, and a
procedural scheme. The passage time is a timestamp when
the user U passed by a touch point. The device name is
a machine name of an operation terminal used in a
procedure at a touch point. The operation system type
is a type of an operation system to which an operation
terminal belongs.
[0030]
The procedural scheme is a scheme of a procedure
selected by the user U at each touch point. The
procedural scheme may be, for example, a face
authentication scheme, a face-to-face scheme, a selfservice
form, a web form, or the like, and a procedural
scheme that can be selected differs in accordance with
a touch point. The user information DB 11b and the
passage history information DB 11c are associated with
each other by a user ID.
[0031]
The information acquisition unit 12 acquires
information from the apparatuses at respective touch
points P1 to P5. The database management unit 13
performs a registration process, an update process, and
a search process on the database of the storage unit 11.
[0032]
The matching unit 14 performs a process of matching
between biometric information on the user U acquired by
the signage terminal 70 and registered biometric
information registered in the user information DB 11b
and outputs the matching result thereof.
[0033]
The guidance unit 15 guides the user U for a
procedure place corresponding to a first scheme
(biometric authentication scheme) if it is determined by
the matching unit 14 that the user U is a registrant,
and the guidance unit 15 generates guidance information
13
about a way to a procedure place corresponding to a
second scheme (authentication scheme other than
biometric authentication) if it is determined that the
user U is not a registrant. In the present example
embodiment, hereafter, the procedure place where a
procedure is automatically performed by using face
authentication (biometric authentication) is referred to
as a face authentication lane, and a place where a
procedure is performed in a face-to-face scheme with a
staff member S is referred to as a manned lane.
[0034]
In the first scheme, a procedure is automatically
performed based on a result of a process of matching
between new biometric information on a user acquired at
a procedure place and registered biometric information.
Further, in the second scheme, the procedure is performed
based on a medium carried by the user U in a state where
the user U and the staff member S face each other. As a
medium, a passport, a boarding ticket, or the like may
be used.
[0035]
The add-up unit 16 adds up and outputs each of the
number of users who have completed a procedure by using
the first scheme in the procedure area and the number of
users who have completed the procedure by using the
second scheme.
[0036]
The check-in terminal 20 is installed in a checkin
lobby or a check-in counter within the airport DA of
the first country (departure country). Hereafter, a
procedure area where the check-in terminal 20 is
installed is referred to as “touch point P1”. The checkin
terminal 20 is a self-service terminal used by the
user U to operate it by himself/herself to perform a
check-in procedure (boarding procedure). After
completion of a check-in procedure at the touch point
P1, the user U moves to a baggage check-in place or a
14
security inspection site.
[0037]
The automatic baggage check-in machine 30 is
installed in a region adjacent to a baggage check-in
counter or a region near the check-in terminal 20 within
the airport DA. Hereafter, a procedure area where the
automatic baggage check-in machine 30 is installed is
referred to as “touch point P2”. The automatic baggage
check-in machine 30 is a self-service terminal used by
the user U to operate it by himself/herself to perform
a procedure of checking in baggage that is not carried
in or is not allowed to be carried in a passenger cabin.
After completion of a baggage check-in procedure, the
user U moves to the security inspection site. In a case
of the user U having no baggage to check in, the
procedure at the touch point P2 is omitted.
[0038]
The security inspection apparatus 40 is installed
in a security inspection site within the airport DA
(hereafter, referred to as “touch point P3”). The term
“security inspection apparatus” in the present example
embodiment is used as a meaning including all of a metal
detector that checks whether or not the user U is wearing
a metal object that can be a dangerous article by using
a metal detector, an X-ray inspection apparatus that
uses X-ray to check whether or not there is a dangerous
article in carry-on baggage or the like, a passage
control apparatus that determines whether or not to
permit passage of the user U at the entrance or exit of
the security inspection site, or the like. After
completion of a security inspection procedure performed
by the security inspection apparatus 40 at the touch
point P3, the user U moves to the departure inspection
site. The operation terminal 42 is installed at a manned
counter in the security inspection site. The staff
member S uses the operation terminal 42 in order to
perform a security inspection procedure on the user U.
15
[0039]
Further, procedure places (inspection places) in
the security inspection site are provided to a plurality
of lanes, respectively. The user U selects a lane out
of the plurality of lanes and is subjected to inspection.
At the entrance of each lane, an identity verification
procedure on the user U is performed before body search
and baggage inspection.
[0040]
The automated gate apparatus 50 is installed in
the departure inspection site within the airport DA
(hereafter, referred to as “touch point P4”). The
automated gate apparatus 50 is an apparatus that
automatically performs a departure inspection procedure
for the user U. After completion of the departure
inspection procedure at the touch point P4, the user U
moves to a departure area where duty-free shops or
boarding gates are provided. The operation terminal 52
is installed at a manned counter in the departure
inspection site. The staff member S uses the operation
terminal 52 in order to perform a departure inspection
procedure on the user U.
[0041]
The boarding gate apparatus 60 is installed for
each boarding gate in the departure area (hereafter,
referred to as “touch point P5”). The boarding gate
apparatus 60 is a passage control apparatus that confirms
that the user U is a passenger of an aircraft that is
available for boarding through the boarding gate. After
completion of the identity verification procedure at the
touch point P5, the user U boards the aircraft and
departs the country to the second country.
[0042]
Each operation terminal 42, 52 is a terminal used
by the staff member S of an airline company or an airport
facility for operation at each touch point. Each
operation terminal 42, 52 is a personal computer, a
16
tablet terminal, a smartphone, or the like, for example.
Note that, although only the operation terminals 42, 52
at the touch points P3, P4 are depicted for simplified
illustration in the present example embodiment, such
operation terminals may be installed similarly at other
touch points.
[0043]
The signage terminals 70 are installed at the
security inspection site (touch point P3) and the
departure inspection site (touch point P4). Each
signage terminal 70 is a display terminal that displays
information to guide the user U for a procedure place on
a screen in accordance with display control from the
management server 10. The signage terminal 70
sequentially transmits, to the management server 10, a
face image in which the user U standing in front of the
terminal is captured and thereby requests the management
server 10 for one-to-N matching between the face image
of the user U and the registered face images stored in
the user information DB 11b.
[0044]
Each camera 80 is a digital camera, for example,
and is installed at respective touch points P1 to P5.
For example, the camera 80 is attached to a ceiling, a
wall, a pillar, or the like so that the camera 80 can
capture the face or the entire body of the user U. The
type of the camera 80 may be stationary or movable. The
camera 80 sequentially transmits captured images to the
management server 10. The management server 10 can use
captured images for the purpose of face authentication
of the user U, monitoring within the airport DA, or the
like.
[0045]
Fig. 5 is a block diagram illustrating an example
of the hardware configuration of the management server
10. As illustrated in Fig. 5, the management server 10
includes a central processing unit (CPU) 101, a random
17
access memory (RAM) 102, a read only memory (ROM) 103,
a storage 104, a communication interface (I/F) 105, a
display device 106, and an input device 107 as a computer
that performs calculation, control, and storage.
Respective devices are connected to each other via a bus,
a wiring, a drive device, or the like.
[0046]
The CPU 101 is a processor having functions of
performing a predetermined operation in accordance with
a program stored in the ROM 103 or the storage 104 and
controlling each unit of the management server 10. The
RAM 102 is formed of a volatile storage medium and
provides a temporary memory area required for the
operation of the CPU 101.
[0047]
The ROM 103 is formed of a nonvolatile storage
medium and stores necessary information such as a program
used for the operation of the management server 10. The
storage 104 is formed of a nonvolatile storage medium
and stores a program used for operating the management
server 10 and data. The storage 104 is formed of a hard
disk drive (HDD) or a solid state drive (SSD), for
example.
[0048]
The communication I/F 105 is a communication
interface based on a specification such as Ethernet
(registered trademark), Wi-Fi (registered trademark), 4G,
or the like and is a module used for communicating with
another device.
[0049]
The display device 106 is a liquid crystal display,
an organic light emitting diode (OLED) display, or the
like used for displaying a moving image, a still image,
a text, or the like and is used for presenting
information to the user.
[0050]
The input device 107 is a keyboard, a pointing
18
device, a button, or the like and accepts a user
operation. The display device 106 and the input device
107 may be integrally formed as a touch panel.
[0051]
Fig. 6 is a block diagram illustrating an example
of a hardware configuration of the signage terminal 70.
The signage terminal 70 has a CPU 701, a RAM 702, a ROM
703, a storage 704, a communication I/F 705, a display
device 706, an input device 707, and a biometric
information acquisition device 708.
[0052]
The biometric information acquisition device 708
is a device that acquires a face image of the user U as
biometric information on the user U. The biometric
information acquisition device 708 is a digital camera
that captures a face of the user U standing in front of
the signage terminal 70, for example, and captures the
face of the user U and acquires the face image thereof.
[0053]
Note that the hardware configuration illustrated
in Fig. 5 and Fig. 6 is an example, a device other than
the above may be added, or some of the devices may not
be provided. Further, some of the devices may be
replaced with another device having substantially the
same function. Further, some function in the present
example embodiment may be provided by another device via
the network NW, or the functions in the present example
embodiment may be distributed to a plurality of devices
and implemented therein. In such a way, the hardware
configuration illustrated in Fig. 5 and Fig. 6 can be
changed as appropriate.
[0054]
Fig. 7 is a layout diagram illustrating an example
of an installation place of the signage terminal 70 in
the security inspection site. In this example, a case
where the signage terminal 70 is installed within a
passage of the security inspection site (touch point P3)
19
between a face authentication lane L1 and a face-to-face
lane L2 provided with a manned counter is illustrated.
The face authentication lane L1 is a procedure place
corresponding to the face authentication scheme (first
scheme). The face authentication lane L1 includes an
automated lane involving use of face authentication.
The face-to-face lane L2 is a procedure place
corresponding to an authentication scheme other than
face authentication (second scheme).
[0055]
The user U selects one of the face authentication
lane L1 and the face-to-face lane L2 and is subjected to
security inspection. At the entrance of the face
authentication lane L1 and the face-to-face lane L2, an
identity verification procedure is performed on the user
U. The identity verification is performed through face
authentication in a case of the face authentication lane
L1 or performed when the user U presents a medium such
as a passport to the staff member S in a case of the
face-to-face lane L2. After completion of the identity
verification, body search and baggage inspection are
performed on the user U.
[0056]
When the user U is identified through biometric
matching in the management server 10, the signage
terminal 70 displays a screen that guides the user U to
the face authentication lane L1. In contrast, when the
user U is not identified through biometric matching in
the management server 10, the signage terminal 70
displays a screen that guides the user U to the face-toface
lane L2.
[0057]
Next, the operation of the information processing
system 1 in the present example embodiment will be
described with reference to the drawings.
[Guidance of User for Procedure Place]
[0058]
20
Fig. 8 is a sequence chart illustrating an example
of a process between the management server 10 and the
signage terminal 70 in the information processing system
1. This process is performed when the user U enters the
procedure area. In Fig. 8, a case where the user U
enters the security inspection site is described as an
example.
[0059]
First, the signage terminal 70 continuously and
periodically captures images of an area in front of the
apparatus by using the biometric information acquisition
device 708 and determines whether or not a face of the
user U is detected in the captured image (step S101).
The signage terminal 70 stands by until a face of the
user U is detected in the image by the biometric
information acquisition device 708 (step S101, NO).
[0060]
If the signage terminal 70 determines that a face
of the user U is detected by the biometric information
acquisition device 708 (step S101, YES), the signage
terminal 70 captures an image of the face of the user U
and acquires a face image of the user U as a target face
image (step S102).
[0061]
Next, the signage terminal 70 transmits the target
face image of the user U captured by the biometric
information acquisition device 708 to the management
server 10 via the network NW together with a matching
request (step S103). Accordingly, the signage terminal
70 requests the management server 10 to match the target
face image of the user U captured by the biometric
information acquisition device 708 with a plurality of
registered face images registered in the user
information DB 11b of the management server 10 in a oneto-
N manner.
[0062]
Next, in response to receiving the target face
21
image and the matching request from the signage terminal
70, the management server 10 matches the target face
image with the plurality of registered face images
registered in the user information DB 11b in a one-to-N
manner (step S104).
[0063]
Next, the management server 10 determines whether
or not a result of matching between the target face image
and the registered face image is that the matching is
successful (step S105). That is, the management server
10 determines whether or not there is a registered face
image of a registrant who is authenticated as the same
person as the user.
[0064]
Herein, if the management server 10 determines that
the result of the matching between the target face image
and the registered face image is that the matching is
successful (step S105, YES), the process proceeds to
step S106.
[0065]
In contrast, if the management server 10 determines
that the result of the matching between the target face
image and the registered face image is that the matching
is unsuccessful (step S105, NO), the process proceeds to
step S107.
[0066]
In step S106, the management server 10 transmits
guidance information about a way to the face
authentication lane to the signage terminal 70.
[0067]
On the other hand, in step S107, the management
server 10 transmits guidance information about a way to
the face-to-face lane to the signage terminal 70.
[0068]
In step S108, in response to receiving the guidance
information from the management server 10, the signage
terminal 70 displays this in the screen on the display
22
device 706 and ends the process.
[0069]
Fig. 9 to Fig. 11 are diagrams illustrating
examples of the screen displayed on the signage terminal
70. In Fig. 9, the screen displays a face image of the
user U1, a message to guide the user U1 to the face
authentication lane (“Your face image is already
registered in the authentication system. Please move to
the face authentication lane and complete the security
inspection procedure.”), and an arrow A1 indicating the
direction of the face authentication lane.
[0070]
The message of Fig. 9 is displayed when a result
of matching between the face image of the user U1
captured at the signage terminal 70 and a registered
face image of a registrant registered in the user
information DB 11b is that the matching is successful
(that is, when the management server 10 determines that
the user U1 is a registrant).
[0071]
In Fig. 10, the screen displays a face image of
the user U2, a message to guide the user U2 to the faceto-
face lane with the staff member S (“Your face image
is not registered in the authentication system. Please
move to the face-to-face lane and complete the security
inspection procedure.”), and an arrow A2 indicating the
direction of the face-to-face lane.
[0072]
The message of Fig. 10 is displayed when a result
of matching between the face image of the user U2
captured at the signage terminal 70 and a registered
face image of a registrant registered in the user
information DB 11b is that the matching is unsuccessful
(that is, when the management server 10 determines that
the user U2 is not a registrant).
[0073]
Further, when a face image is detected from a
23
captured image in which a procedure area is captured,
the management server 10 (the guidance unit 15) may
generate a screen to superimpose and displays the
guidance information on the detected region of the face
image in the captured image.
[0074]
In Fig. 11, a plurality of users U3 to U6 are
included in the screen, and arrows A3 to A6 indicating
procedure places for respective persons are superimposed
and displayed on detected regions of respective face
images of the users U3 to U6. In the case of Fig. 10
and Fig. 11, the guidance information is output for each
user U. In contrast, in the case of Fig. 11, there is
an advantage that the guidance information can be
provided to a plurality of persons at the same time.
[Inquiry Process about Procedure Status]
[0075]
Fig. 12 is a sequence chart illustrating an example
of the process between the management server 10 and the
operation terminal 42 in the information processing
system 1. This process is performed when the staff
member S inquiries about the procedure status of each
user U in the airport. Although a case of using the
operation terminal 42 will be described as an example in
Fig. 12, the same applies to a case of the operation
terminal 52 and other operation terminals (not
illustrated).
[0076]
First, the operation terminal 42 determines
whether or not an inquiry about the procedure status of
the user U is requested from the staff member S (step
S201). Herein, if the operation terminal 42 determines
that an inquiry about the procedure status is requested
(step S201, YES), the process proceeds to step S202.
[0077]
In contrast, if the operation terminal 42
determines that no inquiry about the procedure status is
24
requested (step S201, NO), the standby state is
maintained.
[0078]
In step S202, the operation terminal 42 acquires
inquiry conditions based on an input operation performed
by the staff member S. Next, the operation terminal 42
transmits the inquiry request to the management server
10 (step S203).
[0079]
Next, in response to receiving the inquiry request
from the operation terminal 42, the management server 10
determines whether or not the inquiry request is an
inquiry for a list form (step S204). Herein, if the
management server 10 determines that the inquiry request
is an inquiry for a list form (step S204, YES), the
process proceeds to step S205.
[0080]
In contrast, if the management server 10 determines
that the inquiry request is not an inquiry for a list
form (step S204, NO), the process proceeds to step S207.
[0081]
In step S205, the management server 10 searches
the user information DB 11b and the passage history
information DB 11c. In accordance with the search, the
management server 10 combines user information with
passage history information on a user ID basis and
generates screen data for a procedure status list screen
representing the procedure status of each user U in a
list form (step S206). The process then proceeds to
step S210.
[0082]
In step S207, the boarding reservation information
DB 11a is searched. In accordance with the search, the
management server 10 can acquire the number of pieces of
boarding reservation information for the day.
[0083]
Next, the management server 10 searches the user
25
information DB 11b and the passage history information
DB 11c to add up the total number of users U who have
completed procedures at respective touch points and add
up the number of users U for each procedural scheme (step
S208).
[0084]
Next, the management server 10 generates screen
data of an inquiry screen sorted by the touch point (step
S209). The process then proceeds to step S210.
[0085]
In step S210, the management server 10 transmits
the screen data generated in step S206 or step S209 to
the operation terminal 42.
[0086]
Then, in response to receiving the screen data from
the management server 10, the operation terminal 42
displays an inquiry screen based on the screen data (step
S211) and ends the process.
[0087]
Fig. 13 and Fig. 14 are diagrams illustrating
examples of screens displayed on the operation terminal
42. Fig. 13 illustrates a procedure status list screen
that displays, in a list form, user information acquired
from the user information DB 11b and passage history
information and procedural schemes sorted by the touch
point acquired from the passage history information DB
11c. For example, the user U whose user ID is 10101 is
a person whose face image is already registered, and
this user U has completed the check-in procedure (P1),
the baggage check-in procedure (P2), the security
inspection procedure (P3), the departure inspection
procedure (P4), and the boarding on an aircraft (P5) by
using the automatic way and the face authentication.
[0088]
Further, the user U whose user ID is 10102 is a
person whose face image is not registered, and this user
U has completed the check-in procedure (P1) with the
26
check-in terminal 20 in the automatic way and completed
the baggage check-in procedure (P2) and the security
inspection procedure (P3) in a face-to-face form at a
counter or the like with the staff member S.
[0089]
Further, the user U whose user ID is 10103 is a
person whose face image is already registered and the
user U has completed the check-in procedure (P1) and the
baggage check-in procedure (P2) by using the automatic
way and face authentication. However, this user U (user
ID: 10103) has completed the security inspection
procedure (P3) in a face-to-face form. In such a way,
according to the screen illustrated in Fig. 13, it is
possible to easily recognize the progress status of
procedures of the user U and the procedural scheme at
each touch point.
[0090]
Fig. 14 illustrates an inquiry screen sorted by
the touch point that adds up and displays each of the
number of persons who have not yet completed the
procedure, the number of persons who have completed
procedure, and the number of persons who have used each
procedural scheme in the procedure at each touch point.
For example, for the security inspection procedure, 30
persons out of the persons who completed the check-in
procedure have not yet completed the security inspection
procedure. Further, it is illustrated that 60 out of
100 persons who completed the security inspection
procedure have used the face authentication scheme, and
the remaining 40 persons have used the face-to-face
scheme.
[0091]
As described above, the information processing
system 1 (the management server 10) of the present
example embodiment matches a face image (biometric
information) acquired from the user U with a plurality
of registered face images (registered biometric
27
information) registered in the user information DB 11b
and, based on the matching result, guides the user U for
a procedure place corresponding to the first scheme
(biometric authentication scheme) or the second scheme
(face-to-face scheme). Accordingly, it is possible to
suppress a reduction in the throughput in a procedure
area where a procedural scheme of face authentication or
a procedural scheme other than face authentication can
be selected.
[Second Example Embodiment]
[0092]
Fig. 15 is a function block diagram of the
information processing apparatus 100 in the present
example embodiment. The information processing
apparatus 100 includes an acquisition unit 100A, a
matching unit 100B, and a guidance unit 100C. The
acquisition unit 100A acquires biometric information on
a user in a procedure area where the user is able to
select a first scheme involving use of biometric
authentication in a procedure or a second scheme not
involving use of biometric authentication in the
procedure. The matching unit 100B matches the biometric
information with registered biometric information on a
registrant who is allowed to use the first scheme, and
the matching unit 100B then determines whether or not
the user is a registrant. When it is determined by the
matching unit 100B that the user is the registrant, the
guidance unit 100C guides the user for a procedure place
corresponding to the first scheme, and when it is
determined that the user is not the registrant, the
guidance unit 100C generates guidance information about
a way to a procedure place corresponding to the second
scheme.
[0093]
According to the present example embodiment, the
information processing apparatus 100 that can improve
the throughput in a procedure area where a procedural
28
scheme involving use of biometric authentication or a
procedural scheme involving use of an authentication
method other than biometric authentication can be
selected is provided.
[Modified Example Embodiment]
[0094]
The present invention is not limited to the example
embodiments described above and can be changed as
appropriate within the scope not departing from the
spirit of the present invention. For example, an example
in which a part of the configuration of any of the
example embodiments is added to another example
embodiment or an example in which a part of the
configuration of any of the example embodiments is
replaced with a part of the configurations of another
example embodiment is also one of the example embodiments
of the present invention.
[0095]
Further, the configuration of the present
invention can be applied not only to international
flights but also to domestic flights. In a case of a
domestic flight, it is possible to omit not only a
departure inspection procedure but also a one-to-one
process of matching between a passport face image and a
captured face image. In such a case, a face image
captured at purchase of a boarding ticket can be
registered as the registered biometric image, for
example.
[0096]
Although the security inspection procedure at
departure from a country has been described as an example
in the above example embodiments, the procedure area to
which the present invention can be applied is not limited
to the security inspection site. For example, in a case
of an airport facility, the present invention can also
be applied to a procedure area such as a departure
inspection site, an immigration site, a custom
29
inspection site, or the like.
[0097]
Further, the configuration of the present
invention can be applied to procedures other than those
performed in an airport. Specific examples of such
procedures include a payment procedure performed on a
user U who purchases an item in a shop or a user U who
receives a service. When a face-authenticating type
cash register corresponding to face authentication and
a manned cash register with the staff member S are
provided in a shop and the user U is able to select which
cash register to use, the same advantageous effect as
above is achieved. That is, the configuration of the
present invention can be applied to any procedure area
where the user U is able to select the first scheme
involving use of biometric authentication in a procedure
or the second scheme not involving use of biometric
authentication in the procedure.
[0098]
The management server 10 (the guidance unit 15)
may guide a user to a procedure place corresponding to
attribute information on the user U associated with
registered biometric information. For example, this is
effective when there is a priority lane for performing
an inspection procedure with priority on the user U whose
attribute information satisfies a particular condition.
Specifically, when the user information DB 11b includes
attribute information such as a membership category of
an airline company (standard member / VIP member, or the
like), the presence or absence of an accompanying person
needing support of the user U, or the like, the user U
may be guided to the priority lane based on the attribute
information on the user U acquired by face authentication.
[0099]
Further, although the configuration in which the
management server 10 guides the user U to an appropriate
lane in the procedure place when the user U is standing
30
in front of the signage terminal 70 has been described
in the above example embodiments, the example embodiment
may be configured to be able to guide the user U at a
terminal other than the signage terminal 70 connected to
the management server 10.
[0100]
For example, the example embodiment may be
configured such that, when the user U operates a KIOSK
terminal installed in an airport, a face image (biometric
information) of the user U is captured by the KIOSK
terminal and transmitted to the management server 10,
and it is determined on the management server 10 side
whether or not the face image is already registered. If
the management server 10 determines that the face image
of the user U is already registered in the user
information DB 11b, the user U is guided on the KIOSK
terminal for the procedure place at each touch point.
Further, if the management server 10 determines that the
face image of the user U is not registered in the user
information DB 11b, the user U is urged on the KIOSK
terminal to perform registration to the face
authentication system. Then, in response to
registration of the user face of the user U to the user
information DB 11b of the management server 10, the KIOSK
terminal guides the user U for the procedure place based
on control from the management server 10.
[0101]
Further, the camera 80 illustrated in Fig. 1 may
be provided to the apparatus at respective touch points
P1 to P5 (the check-in terminal 20, the automatic baggage
check-in machine 30, the security inspection apparatus
40, the automated gate apparatus 50, the boarding gate
apparatus 60).
[0102]
Further, the data items displayed in the inquiry
screen sorted by the touch point illustrated in Fig. 14
are examples and are not limited thereto. For example,
31
the number of users (passengers) U who, even after having
registered the face image in the check-in procedure,
have carried out the procedure in the face-to-face scheme
instead of the face authentication scheme in the
subsequent procedure may be further displayed.
Accordingly, the number of users U who have registered
their face images and the number of users U who have
actually selected the face authentication scheme can be
recognized for each touch point.

we claim.
[Claim 1]
An information processing apparatus comprising:
an acquisition unit that acquires biometric
information on a user in a procedure area where the user
is able to select a first scheme involving use of
biometric authentication in a procedure or a second
scheme not involving use of the biometric authentication
in the procedure;
a matching unit that matches the biometric
information with registered biometric information on a
registrant, the registrant being allowed to use the first
scheme, and determines whether or not the user is the
registrant; and
a guidance unit that, when it is determined by the
matching unit that the user is the registrant, guides
the user for a procedure place corresponding to the first
scheme and, when it is determined that the user is not
the registrant, generates guidance information about a
way to a procedure place corresponding to the second
scheme.
[Claim 2]
The information processing apparatus according to
claim 1, wherein the biometric information is a face
image.
[Claim 3]
The information processing apparatus according to
claim 1 or 2, wherein in the first scheme, the procedure
is automatically performed based on a result of a process
of matching between new biometric information on the
user acquired at the procedure place and the registered
biometric information.
[Claim 4]
The information processing apparatus according to
any one of claims 1 to 3, wherein in the second scheme,
the procedure is performed based on a medium carried by
the user in a state where the user and a staff member
38
face each other.
[Claim 5]
The information processing apparatus according to
any one of claims 1 to 4, wherein the guidance unit
causes a display terminal to display the guidance
information.
[Claim 6]
The information processing apparatus according to
claim 2, wherein when the face image is detected from a
captured image in which the procedure area is captured,
the guidance unit generates a screen that superimposes
and displays the guidance information on a detected
region of the face image in the captured image.
[Claim 7]
The information processing apparatus according to
any one of claims 1 to 6 further comprising an add-up
unit that adds up and outputs each of the number of users
who completed the procedure by using the first scheme
and the number of users who completed the procedure by
using the second scheme in the procedure area.
[Claim 8]
The information processing apparatus according to
any one of claims 1 to 7, wherein the guidance unit
guides the user to the procedure place corresponding to
attribute information on the user associated with the
registered biometric information.
[Claim 9]
The information processing apparatus according to
any one of claims 1 to 8, wherein the procedure includes
an inspection procedure performed on the user during
travel in an airport.
[Claim 10]
The information processing apparatus according to
claim 9, wherein the inspection procedure includes at
least one of a security inspection procedure, a departure
inspection procedure, an immigration procedure, and a
custom inspection procedure.
39
[Claim 11]
The information processing apparatus according to
any one of claims 1 to 10, wherein the procedure includes
a payment procedure performed on the user who purchases
an item in a shop or the user who receives a service.
[Claim 12]
An information processing method comprising:
acquiring biometric information on a user in a
procedure area where the user is able to select a first
scheme involving use of biometric authentication in a
procedure or a second scheme not involving use of the
biometric authentication in the procedure;
matching the biometric information with registered
biometric information on a registrant, the registrant
being allowed to use the first scheme, and determining
whether or not the user is the registrant; and
when it is determined that the user is the
registrant, guiding the user for a procedure place
corresponding to the first scheme and, when it is
determined that the user is not the registrant, guiding
the user about a procedure place corresponding to the
second scheme.
[Claim 13]
A storage medium storing a program that causes a
computer to perform:
acquiring biometric information on a user in a
procedure area where the user is able to select a first
scheme involving use of biometric authentication in a
procedure or a second scheme not involving use of the
biometric authentication in the procedure;
matching the biometric information with registered
biometric information on a registrant, the registrant
being allowed to use the first scheme, and determining
whether or not the user is the registrant; and
when it is determined that the user is the
registrant, guiding the user for a procedure place
corresponding to the first scheme and, when it is
40
determined that the user is not the registrant, guiding
the user about a procedure place corresponding to the
second scheme.

Documents

Application Documents

# Name Date
1 202217055380.pdf 2022-09-27
2 202217055380-TRANSLATIOIN OF PRIOIRTY DOCUMENTS ETC. [27-09-2022(online)].pdf 2022-09-27
3 202217055380-STATEMENT OF UNDERTAKING (FORM 3) [27-09-2022(online)].pdf 2022-09-27
4 202217055380-REQUEST FOR EXAMINATION (FORM-18) [27-09-2022(online)].pdf 2022-09-27
5 202217055380-PROOF OF RIGHT [27-09-2022(online)].pdf 2022-09-27
6 202217055380-POWER OF AUTHORITY [27-09-2022(online)].pdf 2022-09-27
7 202217055380-NOTIFICATION OF INT. APPLN. NO. & FILING DATE (PCT-RO-105-PCT Pamphlet) [27-09-2022(online)].pdf 2022-09-27
8 202217055380-FORM 18 [27-09-2022(online)].pdf 2022-09-27
9 202217055380-FORM 1 [27-09-2022(online)].pdf 2022-09-27
10 202217055380-DRAWINGS [27-09-2022(online)].pdf 2022-09-27
11 202217055380-DECLARATION OF INVENTORSHIP (FORM 5) [27-09-2022(online)].pdf 2022-09-27
12 202217055380-DECLARATION OF INVENTORSHIP (FORM 5) [27-09-2022(online)]-1.pdf 2022-09-27
13 202217055380-COMPLETE SPECIFICATION [27-09-2022(online)].pdf 2022-09-27
14 202217055380-MARKED COPIES OF AMENDEMENTS [03-10-2022(online)].pdf 2022-10-03
15 202217055380-FORM 13 [03-10-2022(online)].pdf 2022-10-03
16 202217055380-AMMENDED DOCUMENTS [03-10-2022(online)].pdf 2022-10-03
17 202217055380-Others-031122.pdf 2022-11-17
18 202217055380-Others-031122-1.pdf 2022-11-17
19 202217055380-Correspondence-031122.pdf 2022-11-17
20 202217055380-FORM 3 [12-12-2022(online)].pdf 2022-12-12
21 202217055380-FER.pdf 2025-02-19
22 202217055380-FORM 3 [07-04-2025(online)].pdf 2025-04-07
23 202217055380-FORM 3 [07-04-2025(online)]-1.pdf 2025-04-07
24 202217055380-FORM-26 [04-08-2025(online)].pdf 2025-08-04
25 202217055380-OTHERS [08-08-2025(online)].pdf 2025-08-08
26 202217055380-Information under section 8(2) [08-08-2025(online)].pdf 2025-08-08
27 202217055380-Information under section 8(2) [08-08-2025(online)]-1.pdf 2025-08-08
28 202217055380-FER_SER_REPLY [08-08-2025(online)].pdf 2025-08-08
29 202217055380-COMPLETE SPECIFICATION [08-08-2025(online)].pdf 2025-08-08
30 202217055380-CLAIMS [08-08-2025(online)].pdf 2025-08-08
31 202217055380-ABSTRACT [08-08-2025(online)].pdf 2025-08-08
32 202217055380-GPA-070825.pdf 2025-08-12
33 202217055380-Correspondence-070825.pdf 2025-08-12

Search Strategy

1 5380E_05-03-2024.pdf