Title of the invention: Information processing apparatus, information processing method and recording medium
Technical field
[0001]
The present invention relates to an information processing apparatus, an information processing method and a recording medium.
Background technology
[0002]
Patent Document 1 describes a device having a wheelchair passenger detection function. The device described in Patent Document 1 identifies a passenger's face area based on an image captured by a television camera, detects a position on the image, and if the passenger gets on a wheelchair from the position of the face area. Estimate the area on the image where the wheelchair is likely to be present. Further, the device described in Patent Document 1 investigates the estimated area where the wheelchair exists and determines whether or not the wheelchair exists.
Prior art literature
Patent documents
[0003]
Patent Document 1: International Publication No. 02/056251
Patent Document 2: Japanese Unexamined Patent Publication No. 2010-238179
Outline of the invention
Problems to be solved by the invention
[0004]
The device described in Patent Document 1 needs to perform image processing in order to estimate the wheelchair presence area from the position on the image of the face area and determine the presence or absence of the wheelchair. Therefore, with the device described in Patent Document 1, it is difficult to efficiently and accurately find a candidate who may be a person requiring support such as a wheelchair user.
[0005]
Therefore, in view of the above-mentioned problems, it is an object of the present invention to provide an information processing device, an information processing method, and a recording medium capable of efficiently finding a candidate for a person requiring support with high accuracy.
Means to solve the problem
[0006]
According to one aspect of the present invention, the acquisition unit that acquires height information regarding the height of the shooting position of the shooting device that shot the image in which the user's face is detected, and the use based on the height information. Provided is an information processing apparatus having a determination unit for determining whether or not a person is a candidate for a person requiring support who may be a person requiring support.
[0007]
According to another aspect of the present invention, height information regarding the height of the shooting position of the shooting device that shot the image in which the user's face is detected is acquired, and based on the height information, the user can obtain the height information. An information processing method for determining whether or not a person is a candidate for a person requiring support who may be a person requiring support is provided.
[0008]
According to still another aspect of the present invention, the computer acquires height information regarding the height of the shooting position of the shooting device that shot the image in which the user's face is detected, and based on the height information, the above-mentioned A recording medium in which a program for executing a determination as to whether or not a user is a candidate for a support-requiring person who may be a support-requiring person is provided.
Effect of the invention
[0009]
According to the present invention, it is possible to efficiently find a candidate for a person requiring support with high accuracy.
A brief description of the drawing
[0010]
FIG. 1 is a block diagram showing an overall configuration example of an information processing system according to the first embodiment.
FIG. 2 is a diagram showing an example of information stored in the token ID information database according to the first embodiment.
FIG. 3 is a diagram showing an example of information stored in the passage history information database according to the first embodiment.
FIG. 4 is a diagram showing an example of information stored in the business information database according to the first embodiment.
FIG. 5 is a diagram showing an example of information stored in the staff terminal information database according to the first embodiment.
FIG. 6 is a diagram showing an example of information stored in the support-requiring candidate information database according to the first embodiment.
FIG. 7 is a block diagram showing an example of a hardware configuration of a management server according to the first embodiment.
FIG. 8 is a block diagram showing an example of a hardware configuration of a check-in terminal according to the first embodiment.
FIG. 9 is a diagram showing an example of a photographing device of a check-in terminal according to the first embodiment.
FIG. 10 is a diagram showing another example of the photographing apparatus of the check-in terminal according to the first embodiment.
FIG. 11 is a block diagram showing an example of a hardware configuration of a staff terminal according to the first embodiment.
FIG. 12 is a block diagram showing an example of a hardware configuration of an automatic baggage deposit machine according to the first embodiment.
FIG. 13 is a block diagram showing an example of a hardware configuration of a security inspection device according to the first embodiment.
FIG. 14 is a block diagram showing an example of a hardware configuration of an automated gate device according to a first embodiment.
FIG. 15 is a block diagram showing an example of a hardware configuration of a boarding gate device according to a first embodiment.
FIG. 16 is a sequence diagram (No. 1) showing an example of processing of a check-in terminal and a management server in the first embodiment.
FIG. 17 is a flowchart showing an example of a person-requiring person-related process of a management server according to the first embodiment.
FIG. 18 is a flowchart showing an example of processing of a staff terminal in the first embodiment.
FIG. 19 is a diagram showing an example of a screen displayed on a staff terminal according to the first embodiment.
FIG. 20 is a sequence diagram (No. 2) showing an example of processing of a check-in terminal and a management server in the first embodiment.
FIG. 21 is a diagram showing an example of a screen displayed on a check-in terminal according to the first embodiment.
FIG. 22 is a sequence diagram showing an example of processing of an automatic baggage deposit machine and a management server according to the first embodiment.
FIG. 23 is a sequence diagram showing an example of processing of a security inspection device and a management server according to the first embodiment.
FIG. 24 is a sequence diagram showing an example of processing of an automated gate device and a management server according to the first embodiment.
FIG. 25 is a sequence diagram showing an example of processing of a boarding gate device and a management server in the first embodiment.
FIG. 26 is a block diagram showing an overall configuration example of the information processing system according to the second embodiment.
FIG. 27 is a block diagram showing an example of a hardware configuration of an automatic ticket vending machine according to a second embodiment.
FIG. 28 is a block diagram showing an example of a hardware configuration of a POS terminal according to a second embodiment.
FIG. 29 is a sequence diagram (No. 1) showing an example of processing of an automatic ticket vending machine and a management server in the second embodiment.
FIG. 30 is a sequence diagram (No. 2) showing an example of processing of an automatic ticket vending machine and a management server in the second embodiment.
FIG. 31 is a diagram showing an example of a screen displayed on the automatic ticket vending machine according to the second embodiment.
FIG. 32 is a sequence diagram showing an example of processing of a POS terminal and a management server in the second embodiment.
FIG. 33 is a block diagram showing an overall configuration example of the information processing apparatus according to the third embodiment.
[Fig. 34] Fig. 34 is a block diagram showing an overall configuration example of an information processing system in a modified embodiment.
Embodiment for carrying out the invention
[0011]
Hereinafter, an exemplary embodiment of the present invention will be described with reference to the drawings. Similar elements or corresponding elements may be designated by the same reference numerals in the drawings, and the description thereof may be omitted or simplified.
[0012]
[First Embodiment]
FIG. 1 is a block diagram showing an overall configuration example of the information processing system 1 in the present embodiment. The information processing system 1 is a computer system that supports a series of examination procedures for a user (traveler) U who departs from an airport A in a first country to a second country by air. The information processing system 1 is operated by, for example, a public institution such as an immigration control bureau or a trustee entrusted with the business by the institution.
[0013]
Further, the information processing system 1 of the present embodiment detects and discovers a person who may be a person requiring support from the user U, and notifies the staff S of an alarm indicating the detection. A person requiring support is a person who needs the support of another person in an act, for example, a wheelchair user who uses a wheelchair, a child, or the like. The age range of the child to be treated as a person requiring support can be set to a predetermined age range according to the procedure contents such as 12 years old or younger, 15 years old or younger, and the like. Further, the clerk S is a person who is engaged in or involved in the business of the management bureau, the airline company, the airport, etc., and is, for example, the staff of the management bureau, the staff of the airline company, the staff of the airport company, and the like. In the following, a person who may be a person requiring support will be appropriately referred to as a candidate for a person requiring support. In addition, a person who does not require support, that is, a person who does not need the support of another person in the act, is appropriately referred to as a person who does not need support.
[0014]
In the information processing system 1 of the present embodiment, a check-in terminal 20, a staff terminal 25, an automatic baggage deposit machine 30, a security inspection device 40, an automated gate device 50, and a boarding gate device 60 are provided for a common management server 10. Each is connected via the network NW. The security inspection device 40, the automated gate device 50, and the boarding gate device 60 are installed in the security area SA1 indicated by a broken line. The clerk terminal 25 is carried and used by the clerk S, or is installed in a predetermined place and used by the clerk S. The network NW is composed of a LAN (Local Area Network) including the premises communication network of Airport A, a WAN (Wide Area Network), a mobile communication network, and the like. The connection method is not limited to the wired method and may be a wireless method. Note that FIG. 1 illustrates only the terminal device (business terminal) used for the procedure at the time of departure at the airport A for convenience of explanation.
[0015]
The management server 10 is an information processing device that manages operations related to examination procedures at the time of entry and departure of user U. Further, the management server 10 manages the work related to the examination procedure, detects the candidate requiring support, and further notifies the alarm indicating the detection of the candidate requiring support. The management server 10 is installed in a facility such as an airport company or an airline company that operates the airport A, for example. Further, the management server 10 may be a cloud server instead of a server installed in a facility where business is actually performed. The management server 10 does not have to be a single server, and may be configured as a server group including a plurality of servers. Further, as shown in FIG. 1, the examination procedure at the time of departure at Airport A is sequentially carried out at five touch points P1 to P5. Hereinafter, the relationship between each device and the touch points P1 to P5 will be described. In this embodiment, a case where a candidate for a person requiring support is detected using a face image taken by the check-in terminal 20 installed at the touch point P1 will be described. However, even if the face images taken by the automatic baggage deposit machine 30, the security inspection device 40, the automated gate device 50, and the boarding gate device 60 installed at the other touch points P2 to P5 are used, the person requiring support is similarly required. Candidates can be detected.
[0016]
The check-in terminal 20 is installed in the check-in lobby (hereinafter referred to as "touch point P1") in the airport A. The check-in terminal 20 is a self-terminal for the user U to perform the check-in procedure by himself / herself. The check-in procedure is a procedure for registering information for identifying a user U who is scheduled to board an aircraft. When the user U completes the procedure at the touch point P1, the user U moves to the baggage counter or the security checkpoint.
[0017]
The clerk terminal 25 is an information processing terminal used by the clerk S in charge of a predetermined operation in the airport A. The clerk terminal 25 is, for example, a portable terminal carried and used by the clerk S. Further, the staff terminal 25 may be, for example, a stationary terminal installed in a counter, an office, or the like and used by the staff S.
[0018]
The automatic baggage deposit machine 30 is installed at the baggage counter in Airport A (hereinafter referred to as "touch point P2"). The automatic baggage deposit machine 30 is a self-terminal for the user U to operate by himself / herself to perform a procedure (baggage deposit procedure) for depositing baggage that is not brought into the aircraft. When the user U completes the procedure at the touch point P2, the user U moves to the security checkpoint. If the user U does not check in his / her baggage, the procedure at the touch point P2 is omitted.
[0019]
The security inspection device 40 is installed at the security inspection site (hereinafter referred to as "touch point P3") in the airport A. The security inspection device 40 is a device that confirms whether or not the user U is wearing metals that can be dangerous substances by using a metal detector. In addition to the metal detector, the security inspection device 40 uses X-rays to check the presence or absence of dangerous objects in carry-on baggage and the like.It also includes an X-ray inspection device for confirmation. The user U who has completed the check-in procedure and the automatic baggage check-in procedure undergoes the security inspection procedure by the security inspection device 40 at the security inspection site. When the user U completes the procedure at the touch point P3, he / she moves to the immigration checkpoint.
[0020]
The automated gate device 50 is installed at the immigration checkpoint (hereinafter referred to as "touch point P4") in Airport A. The automated gate device 50 is a device that automatically performs the departure examination procedure of the user U. When the user U completes the procedure at the touch point P4, he / she moves to the departure area where the tax exemption shop and the boarding gate are provided.
[0021]
The boarding gate device 60 is a traffic control device installed for each boarding gate in the departure area (hereinafter referred to as "touch point P5"). The boarding gate device 60 confirms that the user U is a passenger of an aircraft that can board from the boarding gate. When the user U completes the procedure at the touch point P5, he / she boarded the aircraft and departed from the country.
[0022]
Further, as shown in FIG. 1, the management server 10 has a token ID information DB 11, a passage history information DB 12, a business information DB 13, a staff terminal information DB 14, and a supporter candidate information DB 15. The database of the management server 10 is not limited to these databases.
[0023]
FIG. 2 is a diagram showing an example of information stored in the token ID information DB 11. The token ID information DB 11 has a token ID, a group ID, a feature amount, a registered face image, a token issuance time, a token issuance device name, an invalid flag, and an invalidation time as data items. The token ID is an identifier that uniquely identifies the ID information. In the present embodiment, the token ID is temporarily issued on condition that the collation result of the passport face image read from the passport at the touch point P1 and the face image of the user U holding the passport match. To. Then, when the user U completes the procedure at the touch point P5 (boarding gate), the token ID is invalidated. That is, the token ID is a one-time ID having a valid period (life cycle).
[0024]
The group ID is an identifier for grouping ID information. The feature amount is a value extracted from biological information. The registered face image is a face image registered for the user U. The phrase of the biological information in the present embodiment means the facial image and the feature amount extracted from the facial image, but the biological information is not limited to the facial image and the facial feature amount. That is, biometric authentication may be performed using a fingerprint image, a palm print image, an ear canal image, an iris image, or the like as the biometric information of the user U.
[0025]
The token issuance time is the time when the management server 10 issues the token ID. The token issuing device name is the device name of the acquisition source of the registered face image that triggered the issuance of the token ID. The invalid flag is flag information indicating whether or not the token ID is currently valid. When the token ID is issued, the invalid flag becomes a value of "1" indicating a valid state of the token ID. Further, the invalidity flag is updated to a value of "0" indicating an invalid state of the token ID when a predetermined condition is satisfied. The invalidation time is the time stamp when the invalidation flag is invalidated.
[0026]
FIG. 3 is a diagram showing an example of information stored in the passage history information DB 12. The passage history information DB 12 includes a passage history ID, a token ID, a passage time, a device name, a business system type, and a passage touch point as data items. The passage history ID is an identifier that uniquely identifies the passage history information. The transit time is a time stamp when the touch point is passed. The device name is the machine name of the business terminal used for the procedure at the touch point. The business system type is the type of the business system to which the business terminal belongs. Passing touchpoint is the name of the touchpoint that has passed. By extracting the passage history information for each token ID, the management server 10 can grasp to which touch point the user U has completed the procedure.
[0027]
FIG. 4 is a diagram showing an example of information stored in the business information DB 13. The business information DB 13 includes a token ID, a passenger name, a reservation number, a departure place, a destination, an airline code, a flight number, a service date, a seat number, a nationality, a passport number, a surname, a first name, a date of birth, and a gender. , Support required person flag, support required person type are set as data items. In this way, the business information DB 13 stores business information related to a predetermined business for each token ID. In the present embodiment, the “predetermined work” means the procedure work performed at the touch points P1 to P5, respectively.
[0028]
The reservation number is an identifier that uniquely identifies the reservation information of the boarding pass. The airline code is an identifier that uniquely identifies the airline. Information such as passenger name, reservation number, departure place, destination, airline code, flight number, date of operation, seat number, nationality, passport number, surname, first name, date of birth, gender, etc. is the passport and boarding. A passport number or reservation number can be obtained as a key from a medium such as a ticket or a database (not shown) that manages reservation information.
[0029]
The support-requiring person flag is flag information indicating whether or not the user U is a support-requiring person. The support-requiring person flag is set to a value of "1" indicating that the user U is a support-requiring person when it is confirmed that the support-requiring person is required. Further, the support-requiring person flag is set to a value of "0" indicating that the support-requiring person is a support-unnecessary person when it is confirmed that the support-requiring person is a support-unnecessary person. The type of person requiring support is a specific type of person requiring support such as a wheelchair user or a child when the user U is a person requiring support.
[0030]
FIG. 5 is a diagram showing an example of information stored in the staff terminal information DB 14. The clerk terminal information DB 14 has a terminal ID, a clerk ID, and a current position as data items. The terminal ID is an identifier that uniquely identifies the staff terminal 25. The clerk ID is an identifier that uniquely identifies the clerk S who uses the clerk terminal 25. The current position is the current position of the clerk terminal 25 that is periodically or irregularly transmitted from the clerk terminal 25 to the management server 10 and registered when the clerk terminal 25 is a mobile terminal, and the clerk terminal 25 is a stationary terminal. If is, it is the location of the pre-registered installation location. The management server 10 can specify the current positions of a plurality of staff terminals 25 at the airport A by referring to the current positions of the staff terminal information DB 14.
[0031]
FIG. 6 is a diagram showing an example of information stored in the support-requiring candidate information DB 15. The support-required candidate information DB 15 has a candidate ID, a face image, a feature amount, a terminal ID, and a detection time as data items. The candidate ID is an identifier that uniquely identifies a candidate for a person requiring support. The face image is a face image of a candidate who needs support. The feature amount is a value extracted from the face image. The terminal ID is an identifier that uniquely identifies each device such as the check-in terminal 20 that has detected the face image of the candidate requiring support. The detection time is the time when the face image of the candidate requiring support is detected. When the management server 10 detects a support-requiring candidate, the management server 10 registers the support-requiring candidate information in the support-requiring candidate information DB 15 until it is confirmed by the staff S whether or not the support-requiring candidate is a support-requiring person.
[0032]
Subsequently, a hardware configuration example of each device constituting the information processing system 1 will be described with reference to FIGS. 7 to 15. Note that the devices having the same name but different codes in FIGS. 7 to 15 have the same functions, and therefore detailed description thereof will be omitted in the subsequent drawings.
[0033]
FIG. 7 is a block diagram showing an example of the hardware configuration of the management server 10. As shown in the figure, the management server 10 has a CPU (Central Processing Unit) 101, a RAM (Random Access Memory) 102, a storage device 103, and a communication I / F 104. Each device is connected to the bus line 105.
[0034]
The CPU 101 is a processor having a function of performing a predetermined operation according to a program stored in the storage device 103 and controlling each part of the management server 10. In the management server 10, the CPU 101 functions as an acquisition unit, a registration unit, a issuing unit, a control unit, a collation unit, a determination unit, a notification unit, and an output unit. The RAM 102 is composed of a volatile storage medium and provides a temporary memory area necessary for the operation of the CPU 101.
[0035]
The storage device 103 is composed of a storage medium such as a non-volatile memory and a hard disk drive, and functions as a storage unit. The storage device 103 stores a program executed by the CPU 101, data referred to by the CPU 101 when the program is executed, and the like. In the present embodiment, the token ID information DB 11 and the like correspond to the storage unit.
[0036]
The communication I / F 104 is a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), and 4G, and is a module for communicating with the check-in terminal 20 and the like.
[0037]
FIG. 8 is a block diagram showing an example of the hardware configuration of the check-in terminal 20. As shown in the figure, the check-in terminal 20 includes a CPU 201, a RAM 202, a storage device 203, a communication I / F 204, an input device 206, a display device 207, a medium reading device 208, and a photographing device 209. Each device is connected to bus line 205.
[0038]
The input device 206 is, for example, a pointing device such as a touch panel, a keyboard, or the like. In the check-in terminal 20 of the present embodiment, the display device 207 and the input device 206 are integrally formed as a touch panel. The display device 207 is a liquid crystal display device, an OLED (Organic Light Emitting Diode) display device, or the like, and is used for displaying moving images, still images, characters, and the like.
[0039]
The medium reading device 208 is a device that reads the passport and ticket medium of the user U and acquires the information recorded in the passport and the ticket. Examples of the ticket medium include a paper ticket, a mobile terminal that displays a copy of the e-ticket, and the like. The medium reader 208 is composed of, for example, a code reader, an image scanner, a non-contact IC (Integrated Circuit) reader, an OCR (Optical Character Reader) device, and the like, and acquires information from various media held over the reader.
[0040]
The photographing device 209 is a device that acquires a face image of the user U as biometric information of the user U. The photographing device 209 includes a first photographing device 209a and a second photographing device 209b having different heights from the floor surface to the installation position. The first photographing device 209a and the second photographing device 209b are, for example, digital cameras for photographing the face of the user U located in front of the check-in terminal 20, and the face of the user U is photographed and the face thereof is photographed. Get an image. As for the height, the height from a certain reference position to the installation position may be used instead of the height from the floor surface to the installation position.
[0041]
FIG. 9 is a diagram showing an example of the photographing device 209 of the check-in terminal 20. As shown in the figure, the first photographing device 209a is installed at a position lower than that of the second photographing device 209b. The first photographing device 209a and the second photographing device 209b have different photographing ranges in the vertical direction within a predetermined distance in front of the check-in terminal 20. That is, within a predetermined distance in front of the check-in terminal 20, the shooting range H1 in the vertical direction of the first shooting device 209a is lower than the shooting range H2 in the vertical direction of the second shooting device 209b (for example, the floor). The height from the surface to the lower end of the photographing range H1 is lower than the height from the floor surface to the lower end of the photographing range H2).
[0042]
The shooting range H1 of the first shooting device 209a is set to a predetermined height or less so that the faces of the wheelchair user Uw and the child Uc of a predetermined height or less can be photographed by the first shooting device 209a among the users U. Has been done. The shooting range H1 is set as appropriate.However, it is set based on factors such as the average sitting height when using a wheelchair and the average height of a child in a predetermined age range to be treated as a person requiring support.
[0043]
On the other hand, the shooting range H2 of the second shooting device 209b is set at a position higher than a predetermined height so that the face of an adult Ua exceeding a predetermined height can be shot by the second shooting device 209b among the user U. ing. In addition, there may be an overlapping portion between the photographing range H1 and the photographing range H2.
[0044]
The check-in terminal 20 acquires height information. The height information is information regarding the height of the shooting position of the shooting device. For example, depending on whether the face image of the user U was taken by the first photographing device 209a or the second photographing device 209b, the first photographing device 209a or the second photographing device which photographed the face image of the user U was taken. Specific numerical information indicating the height of the installation position of 209b is acquired as height information. Acquiring the identification information of the photographing device is also included in acquiring the height information.
[0045]
The photographing device 209 is not limited to the one including the first photographing device 209a and the second photographing device 209b. FIG. 10 is a diagram showing another example of the photographing device 209 of the check-in terminal 20. As shown in the figure, the photographing device 209 may be composed of a single photographing device 209c that can be moved up and down. The photographing device 209c can be moved up and down to change the height. By changing the height of the photographing device 209c, it is possible to change the photographing range H3 in the vertical direction up and down within a predetermined distance in front of the check-in terminal 20. In this case, height information based on the position (shooting position) of the photographing device 209c after movement can be acquired. Further, when the initial position of the photographing apparatus 209c is determined, acquiring the amount of movement from the initial position is also included in acquiring the height information.
[0046]
The photographing device 209c can set the photographing range H3 to a predetermined height or less so that the faces of the wheelchair user Uw and the child Uc of a predetermined height or less can be photographed among the users U. Further, the photographing device 209c can set the photographing range H3 higher than a predetermined height so that the face of an adult Ua exceeding a predetermined height can be photographed among the user U. The photographing device 209c can photograph the face of the user U by appropriately changing the photographing range H3.
[0047]
FIG. 11 is a block diagram showing an example of the hardware configuration of the staff terminal 25. As shown in the figure, the staff terminal 25 has a CPU 251 and a RAM 252, a storage device 253, a communication I / F 254, an input device 256, a display device 257, a position sensor 258, and a magnetic sensor 259. Each device is connected to a bus line 255.
[0048]
The position sensor 258 uses GNSS (Global Navigation Satellite System) to determine the current position of the staff terminal 25. As a result, the position sensor 258 acquires the position information indicating the current position of the staff terminal 25. The GNSS is not particularly limited, and examples thereof include GPS (Global Positioning System), GRONASS (Global Navigation Satellite System), Galileo, and compass.
[0049]
The magnetic sensor 259 detects the geomagnetism at the current position of the staff terminal 25 and acquires geomagnetic information. The magnetic sensor 259 is not particularly limited, but detects geomagnetism by using, for example, a Hall element, a magnetic resistance element, a magnetic impedance element, or the like. In addition to the position information acquired by the position sensor 258, the clerk terminal 25 can acquire the position information indicating the current position of the clerk terminal 25 indoors based on the geomagnetic information acquired by the magnetic sensor 259.
[0050]
Further, in addition to the position information by the magnetic sensor 259, the staff terminal 25 can acquire the position information indicating the current position of the staff terminal 25 indoors by, for example, Wi-Fi positioning, beacon positioning, or the like.
[0051]
FIG. 12 is a block diagram showing an example of the hardware configuration of the automatic baggage deposit machine 30. As shown in the figure, the automatic baggage deposit machine 30 includes a CPU 301, a RAM 302, a storage device 303, a communication I / F 304, an input device 306, a display device 307, a medium reading device 308, a photographing device 309, a baggage transport device 310, and a baggage transport device 310. It has an output device 311. Each device is connected to bus line 305.
[0052]
When the identity verification of the user U is successful, the baggage carrier 310 transports the baggage to the aircraft on which the user U is boarding. The baggage transport device 310 transports the baggage attached to the baggage tag placed in the receiving unit by the user U toward the cargo handling.
[0053]
The output device 311 is a device that outputs a baggage tag attached to checked baggage. In addition, the output device 311 outputs a baggage redemption certificate necessary for baggage redemption after arriving at the destination. The baggage tag and baggage redemption certificate are associated with at least either passport information or boarding information.
[0054]
FIG. 13 is a block diagram showing an example of the hardware configuration of the security inspection device 40. As shown in the figure, the security inspection device 40 includes a CPU 401, a RAM 402, a storage device 403, a communication I / F 404, an input device 406, a display device 407, a medium reading device 408, a photographing device 409, and a metal detection gate 410. is doing. Each device is connected to a bus line 405.
[0055]
The metal detection gate 410 is a gate-type metal detector, and detects the metals worn by the user U passing through the metal detection gate 410.
[0056]
FIG. 14 is a block diagram showing an example of the hardware configuration of the automated gate device 50. The automated gate device 50 includes a CPU 501, a RAM 502, a storage device 503, a communication I / F 504, an input device 506, a display device 507, a medium reading device 508, a photographing device 509, and a gate 511. Each device is connected to bus line 505. The automated gate device 50 located at the immigration checkpoint has the same hardware configuration as the automated gate device 50 located at the immigration checkpoint.
[0057]
When the user U succeeds in confirming the identity of the user U in the automated gate device 50 and the user U passes the immigration examination, the gate 511 is controlled by the CPU 501 to block the passage of the user U during standby. It shifts to the open state that allows the passage of user U. The method of the gate 511 is not particularly limited, and is, for example, a flapper gate that opens and closes a flapper provided from one side or both sides of the passage, a turn style gate in which three bars rotate, and the like.
[0058]
FIG. 15 is a block diagram showing an example of the hardware configuration of the boarding gate device 60. As shown in the figure, the boarding gate device 60 includes a CPU 601, a RAM 602, a storage device 603, a communication I / F 604, an input device 606, a display device 607, a photographing device 609, and a gate 611. Each device is connected to bus line 605.
[0059]
Subsequently, the operation of each device in the information processing system 1 in the present embodiment will be described with reference to FIGS. 16 to 25.
[0060]
[Check-in procedure]
16 and 20 are sequence diagrams showing an example of processing of the check-in terminal 20 and the management server 10. This process is executed every time the user U performs the check-in procedure using the check-in terminal 20.
[0061]
As shown in FIG. 16, the check-in terminal 20 constantly or periodically shoots in front of the check-in terminal 20 by the first shooting device 209a and the second shooting device 209b, and the check-in terminal 20 is recorded in the shot image. It is determined whether or not the face of the user U located in front is detected (step S11). The check-in terminal 20 waits until the face of the user U is detected in the image by the first photographing device 209a or the second photographing device 209b (step S11, NO).
[0062]
When the check-in terminal 20 determines that the face of the user U is detected by the first photographing device 209a or the second photographing device 209b (step S11, YES), the check-in terminal 20 detects the face of the first photographing device 209a or the second photographing device. The face of the user U is photographed by 209b. As a result, the check-in terminal 20 acquires the face image of the user U as the target face image (step S12).
[0063]
Next, the check-in terminal 20 transmits the target face image captured by the first imaging device 209a or the second imaging device 209b to the management server 10 together with the height information via the network NW (step S13). Here, the height information is information on the height of the installation position of the imaging device that captured the target face image, specifically, the first imaging device 209a installed at a low position or the second image installed at a high position. This is information indicating that the photographing device 209b has photographed the target face image. When a single photographing device 209c that can be moved up and down is used, the height information is information indicating, for example, the photographing height of the photographing device 209c when the face of the user U is photographed. Further, when transmitting the target face image, the check-in terminal 20 also transmits the terminal ID, which is an identifier that uniquely identifies the check-in terminal 20, to the management server 10. The management server 10 can specify the position of the check-in terminal 20 based on the terminal ID of the check-in terminal 20.
[0064]
When the management server 10 receives the target face image and height information from the check-in terminal 20, it executes a support-requiring-related process for detecting a support-requiring candidate (step S14). FIG. 17 is a flowchart showing an example of the support-required person-related processing of the management server 10. FIG. 18 is a flowchart showing an example of the processing of the staff terminal 25 related to the processing related to the person requiring support.
[0065]
As shown in FIG. 17, in the management server 10, the shooting height of the shooting device that shot the user U from which the target face image was acquired is equal to or less than a predetermined height based on the height information received from the check-in terminal 20. (Step S1401). When the height information indicates that the first photographing device 209a has photographed the target face image, the management server 10 determines that the photographing height is equal to or less than a predetermined height. On the other hand, when the height information indicates that the second photographing device 209b has photographed the target face image, the management server 10 determines that the photographing height is not equal to or less than a predetermined height. When a single photographing device 209c that can be moved up and down is used, the management server 10 determines whether or not the photographing height of the photographing device 209c when photographing the face of the user U is equal to or less than a predetermined height. Can be determined.
[0066]
When the management server 10 determines that the shooting height is not equal to or less than a predetermined height (step S1401, NO), the management server 10 ends the support-required person-related processing.
[0067]
On the other hand, when the management server 10 determines that the shooting height is equal to or less than a predetermined height (step S1401, YES), the user U who has shot the target face image is confirmed by the staff member S as described later. It is determined whether or not the person does not need support (step S1402). The management server 10 collates the target face image received from the check-in terminal 20 with a plurality of registered face images registered in the token ID information DB 11 on a one-to-N basis when determining whether or not the person is a support-free person. .. The registered face image to be collated is limited to the image associated with the token ID whose invalid flag value is "1" (valid). When the management server 10 finds the registered face image of the matching match as a result of the matching, the management server 10 refers to the supporter flag in the business information of the business information DB 13 using the token ID associated with the registered face image as a key. When the referenced person requiring support flag is "0" (person who does not need support), the management server 10 determines that the user U is a person who does not need support. On the other hand, when the management server 10 does not find the registered face image of the matching match, or when the support-required person flag is "1" (support-required person).If there is, it is determined that the user U is not a support unnecessary person.
[0068]
When the management server 10 determines that the user U is a support-unnecessary person (step S1402, YES), the management server 10 ends the support-requiring person-related processing.
[0069]
On the other hand, when the management server 10 determines that the user U is not a support-requiring person (step S1402, NO), it is assumed that the user U is detected as a support-requiring candidate, and the support-requiring candidate information is obtained as a support-requiring person. Register in the candidate information DB 15 (step S1403). The support-requiring candidate information is information about a user detected as a support-requiring candidate. The management server 10 registers, for each candidate ID, the target face image, the feature amount, the terminal ID of the check-in terminal 20, the detection time of the target face image, and the like as the support-requiring candidate information in the support-requiring candidate information DB 15. See FIG. 6). In this embodiment, even for the user U whose support-requiring flag is "1", which is confirmed by the staff S to be a support-requiring person, an alarm is notified to the staff S again as a support-requiring candidate. It will be.
[0070]
Next, the management server 10 notifies the staff terminal 25 of an alarm indicating that a candidate requiring support has been detected via the network NW (step S1404). The alarm can include, for example, the position of the check-in terminal 20 in which the candidate for support is detected, the terminal ID, and the like. Based on the current position of each staff terminal 25 registered in the staff terminal information DB 14, the management server 10 sets the staff terminal 25 of the notification destination to notify the alarm to the position of the check-in terminal 20 in which the candidate for support is detected. It may be limited to one or more staff terminals 25 having a predetermined positional relationship. For example, the management server 10 can limit the staff terminal 25 for notifying the alarm to the staff terminal 25 located within a predetermined distance range from the position of the check-in terminal 20 in which the candidate for support is detected. Further, for example, the management server 10 limits the staff terminal 25 for notifying the alarm to the staff terminal 25 located at a position where the check-in terminal 20 in which the candidate for support is detected can be seen or at a position where the check-in terminal 20 can be seen if the candidate is slightly moved. You can also. In this way, the management server 10 can notify a specific staff terminal 25 among the plurality of staff terminals 25 of the alarm.
[0071]
On the other hand, as shown in FIG. 18, the staff terminal 25 determines whether or not an alarm indicating that a candidate for a person requiring support has been detected has been notified from the management server 10 (step S1501), until the alarm is notified. Wait (step S1501, NO).
[0072]
When the staff terminal 25 determines that the alarm has been notified from the management server 10 (step S1501, YES), the staff terminal 25 displays a screen for notifying the alarm on the display device 257 (step S1502). In addition, the staff terminal 25 can output an alarm by a message voice or a sound effect from a voice output device (not shown) in place of or together with the display of the screen for notifying the alarm to the display device 257.
[0073]
FIG. 19 is a diagram showing an example of an alarm notification screen for notifying an alarm displayed on the display device 257 of the staff terminal 25. As shown in the figure, the staff terminal 25 displays the premises map 2571 of the airport A on the alarm notification screen. Further, the staff terminal 25 displays a detection position mark 2772 indicating the position of the check-in terminal 20 in which the candidate for support is detected and a current position mark 2573 indicating the current position of the staff terminal 25 on the premises map 2571.
[0074]
Further, the staff terminal 25 has a confirmation button 2574 for inputting that the staff S is confirming whether or not the support-requiring candidate is a support-requiring person on the alarm notification screen, and the staff S confirms the confirmation. Display the confirmation complete button 2575 for inputting the completion. Further, the staff terminal 25 displays a button group 2576 for inputting support-related information on the alarm notification screen. The button group 2576 is a radio button for inputting whether the candidate for a person requiring support is a person requiring support or a person requiring support, the type of wheelchair, a child, etc. in the case of a person requiring support as support-related information. Includes selection buttons such as check buttons.
[0075]
Upon seeing the alarm notification screen displayed on the clerk terminal 25, the clerk S may press the checking button 2574 and input that the clerk S is confirming whether or not the support-requiring candidate is a support-requiring person. can. The person in charge S who is checking can input support-related information by checking the selection button of the button group 2576. Further, the staff member S who has completed the confirmation can press the confirmation completion button 2575 to input that the confirmation has been completed.
[0076]
As shown in FIG. 18, the clerk terminal 25 displaying the alarm notification screen is input by the clerk S that the clerk S is confirming whether or not the support-requiring candidate is the support-requiring person. Wait (step S1503, NO).
[0077]
When the clerk terminal 25 determines that it is input that the clerk S is checking (step S1503, YES), the clerk terminal 25 transmits the checking information indicating that the clerk S is checking to the management server 10 via the network NW. (Step S1504).
[0078]
Next, the staff terminal 25 accepts the input of support-related information by the staff S (step S1505).
[0079]
The clerk terminal 25 waits for the clerk S to input that the clerk S has completed confirmation of whether or not the supporter candidate is a supporter (step S1506, NO).
[0080] [0080]
When the clerk terminal 25 determines that it is input that the clerk S has completed the confirmation (step S1506, YES), the clerk terminal 25 transmits the confirmation completion information indicating that the clerk S has completed the confirmation to the management server 10 via the network NW. (Step S1507). The staff terminal 25 transmits the support-related information input by the staff S together with the confirmation completion information to the management server 10 via the network NW. The support-related information indicates whether the candidate for a person requiring support is a person requiring support or a person who does not need support, and the type of wheelchair, child, etc. when the candidate is a person requiring support.
[0081]
In this way, to the management server 10 that has notified the staff terminal 25 of the alarm, the confirmation information and the confirmation completion information are transmitted according to the confirmation status of the supporter candidate by the staff S.
[0082]
As shown in FIG. 17, the management server 10 that has notified the staff terminal 25 of the alarm determines whether or not the confirmation information has been received from the staff terminal 25 (step S1405). When the management server 10 determines that the confirmation information has not been received (step S1405, NO), it further determines whether or not a predetermined time has elapsed from the notification of the alarm (step S1406). When the management server 10 determines that the predetermined time has not elapsed (step S1406, NO), the management server 10 proceeds to step S1405 and continues to wait for the confirmation information to be received. When the management server 10 determines that the predetermined time has elapsed (step S1406, YES), the management server 10 proceeds to step S1404 and notifies the staff terminal 25 of the alarm again.
[0083]
In the notification of the alarm again, the management server 10 can expand the range of the staff terminal 25 for notifying the alarm. For example, the management server 10 can notify the alarm to the staff terminal 25 located within a wider range than the distance range of the staff terminal 25 that previously notified the alarm.
[0084]
On the other hand, when the management server 10 determines that the confirmation information has been received (step S1405, YES), the management server 10 instructs the staff terminal 25 who has notified the alarm to stop the alarm via the network NW (step S1407). The staff terminal 25 instructed to stop the alarm stops displaying the alarm on the display device 257 and stops the alarm.
[0085]
The management server 10 instructed to stop the alarm subsequently determines whether or not the confirmation completion information has been received from the staff terminal 25 (step S1408). When the management server 10 determines that the confirmation completion information has not been received (step S1408, NO), it further determines whether or not a predetermined time has elapsed from the instruction to stop the alarm (step S1409). When the management server 10 determines that the predetermined time has not elapsed (step S1409, NO), the management server 10 proceeds to step S1408 and continues to wait for confirmation completion information to be received. When the management server 10 determines that the predetermined time has elapsed (step S1409, YES), the management server 10 proceeds to step S1404 and notifies the staff terminal 25 of the alarm again.
[0086]
In the notification of the alarm again here, the management server 10 expands the range of the staff terminal 25 for notifying the alarm, as in the notification of the alarm again when the predetermined time has elapsed in step S1406. Can be done.
[0087]
On the other hand, when the management server 10 determines that the confirmation completion information has been received (step S1408, YES), it determines whether or not the support-requiring candidate is a support-requiring person based on the support-related information transmitted together with the confirmation completion information. Determination (step S1410).
[0088]
When the management server 10 determines that it is not a support-requiring person (step S1410, NO), it deletes the support-requiring candidate information registered in the support-requiring candidate information DB 15 for the support-requiring candidate (step S1412).
[0089]
On the other hand, when the management server 10 determines that the person needs support (step S1410, YES), the management server 10 acquires and temporarily stores the support-related information (step S1411). The management server 10 can temporarily store support-related information in the RAM 102, the storage device 103, and the like. When registering the business information described later in the business information DB 13, the management server 10 can register the support-requiring person flag and the support-requiring person type in the business information based on the support-related information temporarily stored.
[0090]
Next, the management server 10 deletes the support-requiring candidate information registered in the support-requiring candidate information DB 15 for the support-requiring candidate (step S1412).
[0091]
In this way, in the present embodiment, the support-requiring candidate is detected based on the shooting height of the photographing device that has captured the target face image of the user U, and in response to the notification of the alarm indicating the detection of the support-requiring candidate to the staff terminal 25. Then, the person in charge S confirms whether or not the candidate for a person requiring support is a person requiring support. In the present embodiment, since the candidate for a person requiring support is detected and found based on the shooting height of the photographing device without requiring complicated image processing, the candidate for a person requiring support is found with high accuracy and efficiency. Can be done.
[0092]
In the above, the case of notifying the clerk terminal 25 used by the clerk S of the alarm has been described, but the terminal to which the clerk S is notified is not limited to this. For example, the management server 10 issues an alarm to the signage terminal installed in the vicinity of or in the vicinity of the check-in terminal 20 where the candidate requiring support is detected, such as guidance display, advertisement display, etc., in the same manner as in the case of the staff terminal 25. You can also notify. As a result, even a staff member who does not have a terminal can notice the alarm. Further, for example, the management server 10 can notify the user terminal, which is a mobile terminal carried and used by the user U detected as a candidate for a person requiring support, of an alarm. In this case, the management server 10 can specify the user terminal carried by the support-requiring candidate to be notified of the alarm, for example, based on the position information transmitted from the application executed on the user terminal. .. When notifying the signage terminal or the user terminal of an alarm for the user U, information including guidance information (for example, information indicating the position of a wheelchair slope) can be notified as the alarm. Thereby, the support of the user U can be promoted. The type and amount of information to be notified to the user U can be appropriately changed according to the user U.
[0093]
The user U, who has been confirmed to be a support-requiring person, can subsequently perform the check-in procedure at the check-in terminal 20 while receiving the support according to the required degree by the staff member S. In addition, for the user U who is confirmed to be a support-requiring person, the support-requiring person flag indicating that the support-requiring person is set is set.As part of the business information, it will be carried over to the subsequent procedures such as baggage check-in procedure, security inspection procedure, departure examination procedure and boarding procedure. Therefore, in the subsequent procedure, the support-requiring person can be easily identified from the user U based on the support-requiring person flag, and the specified support-requiring person can be supported by the staff member S. ..
[0094]
As shown in FIG. 20, the check-in terminal 20 determines whether or not the passport of the user U is held over the reading unit (not shown) of the medium reading device 208 (step S101), and waits until the passport is held over. (Step S101, NO).
[0095]
Next, when the check-in terminal 20 determines that the passport is held over the reading unit of the medium reader 208 (step S101, YES), the check-in terminal 20 acquires the passport information of the user U from the held passport (step S102). The acquired passport information includes the passport face image of the user U, identity verification information, the passport number, information on the country where the passport is issued, and the like.
[0096]
Next, the check-in terminal 20 determines whether or not the ticket medium of the user U is held over the reading unit of the medium reading device 208 (step S103), and waits until the ticket medium is held over (step S103). , NO).
[0097]
Next, when the check-in terminal 20 determines that the ticket medium is held over the reading unit of the medium reading device 208 (step S103, YES), the check-in terminal 20 acquires the boarding information of the user U from the held ticket medium (step S103, YES). Step S104). At this time, the medium reader 208 uses the ticket medium to provide the boarding information (last name, first name, airline code, flight name, boarding date, departure place (boarding airport), destination (arrival airport), and seat number of the user U from the ticket medium. , Boarding time, arrival time, etc.) can be obtained.
[0098]
Next, the check-in terminal 20 photographs the face of the user U by the photographing device 209, and acquires the face image as the target face image (step S105). It is preferable to display a screen for obtaining the consent of the user U before taking the face image. Further, since the check-in terminal 20 acquires the target face image of the user U by the first photographing device 209a or the second photographing device 209b in step S12, the photographing in step S105 can be omitted.
[0099]
FIG. 21 is a diagram showing an example of a screen displayed on the check-in terminal 20. Here, we will explain about taking a face image ("If you register your face image, you can easily perform the following procedures until departure by face authentication.") And take a face image. A button is displayed to select whether or not to do it.
[0100]
Next, the check-in terminal 20 transmits the captured target face image, passport information, and boarding information to the management server 10 (step S106).

The scope of the claims
[Claim 1]
The acquisition unit that acquires height information regarding the height of the shooting position of the shooting device that shot the image in which the user's face was detected, and
Based on the height information, a determination unit that determines whether or not the user is a candidate for a person requiring support who may be a person requiring support.
Information processing device with.
[Claim 2]
The information processing device according to claim 1, wherein the determination unit determines that the user is a candidate for a person requiring support when the height of the shooting position of the shooting device is equal to or less than a predetermined height.
[Claim 3]
The photographing device includes a first photographing device and a second photographing device installed at a position higher than that of the first photographing device.
The information processing device according to claim 2, wherein the determination unit determines that the user is a candidate for a person requiring support when the image is taken by the first shooting device.
[Claim 4]
The shooting device can be moved up and down to change its height.
The information processing device according to claim 2, wherein the determination unit determines that the user is a candidate for a person requiring support when the photographing device captures the image at the height equal to or lower than the predetermined height. ..
[Claim 5]
Any one of claims 1 to 4 having a notification unit for notifying the notification destination of an alarm indicating that the support-requiring candidate has been detected when the user is determined to be the support-requiring candidate. The information processing device described in the section.
[Claim 6]
The information processing device according to claim 5, wherein the notification unit notifies the alarm to the notification destination having a predetermined positional relationship with the position where the support-requiring candidate is detected.
[Claim 7]
The information processing device according to claim 6, wherein the notification unit notifies the alarm to the notification destination located within a predetermined distance range from the position where the supporter candidate is detected.
[Claim 8]
The information processing device according to any one of claims 5 to 7, wherein the notification destination is a staff terminal used by a staff member, a signage terminal, or a user terminal used by the user.
[Claim 9]
13. Information processing equipment.
[Claim 10]
The information processing device according to any one of claims 1 to 9, which has a registration unit for registering information about the user when it is determined that the user is a candidate for a person requiring support.
[Claim 11]
The information processing device according to claim 10, wherein when the registration unit receives information indicating that the confirmation of whether or not the support-requiring candidate is the support-requiring person has been completed, the information regarding the user is deleted.
[Claim 12]
It has a issuing department that issues an identifier that associates the registered biometric information of the user with business information related to a predetermined business.
The information processing device according to any one of claims 1 to 11, wherein the business information includes information indicating whether or not the user is the person requiring support.
[Claim 13]
The information processing device according to any one of claims 1 to 12, wherein the person requiring support is a wheelchair user or a child in a predetermined age range.
[Claim 14]
Acquire height information regarding the height of the shooting position of the shooting device that shot the image in which the user's face was detected,
An information processing method for determining whether or not the user is a candidate for a supporter who may be a supporter based on the height information.
[Claim 15]
On the computer
Acquire height information regarding the height of the shooting position of the shooting device that shot the image in which the user's face was detected,
Based on the height information, it is determined whether or not the user is a candidate for a person requiring support who may be a person requiring support.
A recording medium on which a program for executing things is recorded.