Title of Invention: Processing Device, Processing Method and Program
Technical field
[0001]
The present invention relates to a processing device, a processing method and a program.
Background technology
[0002]
According to Patent Document 1, based on the mutual positional relationship of persons detected from a moving image, it is determined that a group of persons whose relative distance is below a threshold for a longer period of time than the threshold belongs to a group performing the same action. Disclosed is a technique for determining that a person who is not acting alone is acting alone. Patent Literature 2 discloses a technique for detecting whether or not a moving object detected from an image is acting alone.
prior art documents
patent literature
[0003]
Patent Document 1: JP-A-2006-92396
Patent document 2: JP 2015-176198
SUMMARY OF THE INVENTION
Problems to be Solved by the Invention
[0004]
Under certain circumstances, group activities may be recommended, for example, when visiting countries or regions where security is not good. However, there is a possibility that a person who leaves the group due to some trouble or the like and acts alone unintentionally, or a person who intentionally leaves the group and acts alone. A technique for detecting a person who has left the group and has acted alone in this way is desired. The techniques of Patent Literatures 1 and 2 simply detect a person acting alone, and do not detect a person leaving the group and acting alone.
[0005]
An object of the present invention is to provide a technique for detecting a person who has left the group and has acted alone.
Means to solve problems
[0006]
According to the present invention,
Acquisition means for acquiring images generated by the camera,
　Extraction means for extracting a person who is acting alone from the image, and
a judgment means for judging whether the person acting alone belongs to any of the groups based on group information in which the feature amount of the appearance of the person acting in a group is registered;
an output means for outputting notification information when it is determined that the person acting alone belongs to one of the groups;
A processing apparatus is provided having:
[0007]
Also, according to the present invention,
"The computer
　　Obtain the image generated by the camera,
　　From the image, extract a person who is acting alone,
　　Based on the group information in which the features of the appearance of the person acting in a group are registered, it is determined whether the person acting alone belongs to any of the groups,
A processing method is provided for outputting notification information when it is determined that the person acting alone belongs to one of the groups.
[0008]
Also, according to the present invention,
the computer,
　　Acquisition means for acquiring the image generated by the camera,
　　Extraction means for extracting a person acting alone from the image,
　　Determination means for determining whether the person acting alone belongs to any of the groups based on the group information in which the feature amount of the appearance of the person acting in a group is registered;
　　When it is determined that the person acting alone belongs to one of the groups, an output means for outputting notification information,
A program is provided to act as a
Effect of the invention
[0009]
According to the present invention, a technique for detecting a person who has left the group and has acted alone is realized.
Brief description of the drawing
[0010]
The above-mentioned objects, as well as other objects, features and advantages, will become more apparent with the preferred embodiments described below and the accompanying drawings below.
[0011]
1 is a diagram showing an example of a hardware configuration of a processing device according to an embodiment; FIG.
2 is an example of a functional block diagram of a processing device according to the present embodiment; FIG.
3 is a diagram schematically showing an example of information processed by the processing device of the present embodiment; FIG.
4 is a diagram schematically showing an example of information processed by the processing device of the present embodiment; FIG.
5 is a flow chart showing an example of the processing flow of the processing device of the present embodiment; FIG.
6 is an example of a functional block diagram of a processing device of the present embodiment; FIG.
7 is a flow chart showing an example of the processing flow of the processing device of the present embodiment; FIG.
8 is a diagram schematically showing an example of information processed by the processing device of the present embodiment; FIG.
9 is a diagram schematically showing an example of information processed by the processing device of the present embodiment; FIG.
10 is an example of a functional block diagram of a processing device of the present embodiment; FIG.
11 is a flow chart showing an example of the processing flow of the processing device of the present embodiment; FIG.
MODE FOR CARRYING OUT THE INVENTION
[0012]

First, an outline of the processing device of this embodiment will be described. When acquiring the image generated by the camera, the processing device extracts a person acting alone (a person acting alone) from the image. When a person acting alone is extracted from the image, the processing device determines whether the person acting alone belongs to any group based on group information in which the feature amount of the appearance of the person acting in a group is registered for each group. . Then, when it is determined that the individual acting alone belongs to any group, the processing device outputs notification information.
[0013]
According to such a processing device, it is possible to detect a person who has left the group and acted alone.
[0014]
Next, the configuration of the processing device will be explained in detail. First, an example of the hardware configuration of the processing device will be described.
[0015]
Each functional unit of the processing device includes a CPU (Central Processing Unit) of any computer, a memory, a program loaded into the memory, a storage unit such as a hard disk that stores the program (stored in advance from the stage of shipping the device) In addition to programs, it can also store programs downloaded from storage media such as CDs (Compact Discs) and servers on the Internet), and can be realized by any combination of hardware and software centered on the interface for network connection. . It should be understood by those skilled in the art that there are various modifications to the implementation method and apparatus.
[0016]
FIG. 1 is a block diagram illustrating the hardware configuration of the processing device. As shown in FIG. 1, the processing device has a processor 1A, a memory 2A, an input/output interface 3A, a peripheral circuit 4A and a bus 5A. The peripheral circuit 4A includes various modules. The processing device may not have the peripheral circuit 4A. The processing device may be composed of a plurality of physically and/or logically separated devices, or may be composed of a single device that is physically and/or logically integrated. When the processing device is composed of a plurality of physically and/or logically separated devices, each of the plurality of devices can have the above hardware configuration.
[0017]
The bus 5A is a data transmission path for mutually transmitting and receiving data between the processor 1A, the memory 2A, the peripheral circuit 4A and the input/output interface 3A. The processor 1A is, for example, an arithmetic processing device such as a CPU or a GPU (Graphics Processing Unit). The memory 2A is, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory). The input/output interface 3A includes an interface for acquiring information from an input device, an external device, an external server, an external sensor, a camera, etc., an interface for outputting information to an output device, an external device, an external server, etc. . Input devices are, for example, keyboards, mice, microphones, physical buttons, touch panels, and the like. The output device is, for example, a display, speaker, printer, mailer, or the like. The processor 1A can issue commands to each module and perform calculations based on the calculation results thereof.
[0018]
An example of a functional block diagram of the processing device 10 is shown in FIG. As illustrated, the processing device 10 has an acquisition unit 11 , an extraction unit 12 , a determination unit 13 , an output unit 14 and a storage unit 15 . Note that the processing device 10 may not have the storage unit 15 . In this case, an external device configured to be communicable with the processing device 10 includes the storage unit 15 .
[0019]
The acquisition unit 11 acquires the image generated by the camera. The camera may capture moving images, or may capture still images at predetermined timings (eg, every second, every five seconds, etc.). A camera photographs a predetermined area. The predetermined area is, for example, an area where group activities are recommended, and specific examples include an area with poor security, an area with bad topography where accidents are likely to occur, and an area where roads are complicated and it is easy to get lost. It is not limited to these.
[0020]
The camera may be installed (fixed) in a predetermined area. In addition, the camera may be mounted on a mobile body that moves on land, and may shoot while moving in a predetermined area. In addition, the camera may be mounted on a flying moving body and photographed while moving over a predetermined area.
[0021]
In this specification, "acquisition" means "acquisition of data stored in another device or storage medium by one's own device based on user input or program instructions (active acquisition), for example, receiving by requesting or querying another device, accessing and reading from another device or storage medium, and the like. In addition, "acquisition" means "inputting data output from another device to the own device (passive acquisition)" based on user input or based on program instructions, for example, distribution (or , sending, push notifications, etc.). In addition, "acquisition" means selecting and acquiring from the received data or information, and "editing data (converting to text, rearranging data, extracting some data, changing file format, etc.) such as to generate new data and acquire the new data".
[0022]
The extraction unit 12 extracts a person who is acting alone (a person acting alone) from the image. For example, the extraction unit 12 may determine that two persons whose distance to each other is less than the first threshold for a duration of a reference time or longer are persons who are performing a group action together. Then, the extracting unit 12 may extract, from among the persons extracted from the image, a person whose image does not include a person acting in a group together as a person acting alone. In addition, the extracting unit 12 may extract, from among the persons extracted from the image, a person for whom no persons acting in a group together exist in the image for a predetermined time or longer as a person acting alone. good. Means for extracting a person from an image and means for estimating the actual distance between two points in an image are widely known, so description thereof will be omitted here. Further, the processing for extracting a person acting alone illustrated here is merely an example, and the extraction unit 12 may use other techniques to extract a person acting alone.
[0023]
The determination unit 13 determines to which group the single-acting person extracted by the extraction unit 12 belongs, based on the group information in which the feature amount of the appearance of the person acting in a group is registered. The group information may be information in which the feature amount of the appearance of people who act in a group is registered for each group.
[0024]
An example of group information is schematically shown in FIG. In the illustrated example, group identification information for mutually identifying a plurality of groups and information on each member (person) belonging to each group are associated with each other. Each member's information is a face image, face feature amount, and the like. Instead of the face image, an image of the whole body (including the face part) may be adopted. Then, instead of the face feature amount, the whole body feature amount (face, physique, clothes, etc.) may be employed. Note that the group information may not include part of the illustrated information, or may include other information. The storage unit 15 stores such group information.
[0025]
The judgment unit 13 determines that the feature amount of the appearance of each of the plurality of persons included in the group information matches the feature amount of the appearance of the single person extracted from the image (similarity is the threshold above), it is determined that the single-acting person belongs to a group. On the other hand, if there is no appearance feature quantity of each of the plurality of persons included in the group information that matches the appearance feature quantity of the single person extracted from the image (similarity is equal to or higher than the threshold), It is determined that the action person is not a person belonging to the group.
[0026]
The output unit 14 outputs notification information when it is determined that the single-acting person belongs to any group. The output notification information is accumulated in the storage unit 15, for example. FIG. 4 schematically shows an example of notification information. The illustrated notification information includes information indicating a person acting alone (image (image acquired by the acquisition unit 11), group identification information, etc.), information indicating the location where the person acted alone (location where the image was taken), and information indicating the person acting alone (image captured). and the date and time of the action (date and time when the image was taken). Note that the notification information may not include part of the illustrated information, or may include other information.
[0027]
Next, an example of the processing flow of the processing device 10 will be described using the flowchart of FIG.
[0028]
When the acquisition unit 11 acquires an image (S10), the extraction unit 12 extracts a person from the image (S11). Then, the extraction unit 12 designates one of the extracted persons as a target person (S12).
[0029]
Next, the extraction unit 12 determines whether a person whose distance from the target person is less than the first threshold exists in the image (S13). If it does not exist (No in S13), the extraction unit 12 determines that the target person is acting alone, and extracts the target person as a single-acting person (S16).
[0030]
On the other hand, if a person whose distance from the target person is less than the first threshold exists in the image (Yes in S13), the extraction unit 12 determines that the distance between the person and the target person is less than the first threshold. is longer than the reference time (S14).
[0031]
In the relationship with any one of the persons whose distance from the target person is less than the first threshold, if the duration time satisfies the relationship of the reference time or more (Yes in S14), the extraction unit 12 determines that the target person is It is determined that the animal is not acting alone (S15). After that, the process proceeds to S19.
[0032]
On the other hand, if the relationship with all of the persons whose distance from the target person is less than the first threshold does not satisfy the relationship that the duration is equal to or greater than the reference time (No in S14), the extraction unit 12 It is determined that the target person is acting alone, and the target person is extracted as a single-acting person (S16).
[0033]
After S16, the determination unit 13 determines to which group the target person extracted as a single-acting person belongs based on the group information shown in FIG. 3 (S17). Then, when it is determined that it belongs to the group (Yes in S17), the output unit 14 outputs notification information (S18). After that, the process proceeds to S19. The output notification information is stored, for example, in the storage unit 15 (see FIG. 4).
[0034]
On the other hand, if it is determined that the user does not belong to the group (No in S17), proceed to S19.
[0035]
In S19, the extraction unit 12 determines whether there is a person who is not designated as a target person among the persons extracted in S11. If it exists (Yes in S19), return to S12 and perform the same processing. On the other hand, if it does not exist (No in S19) and there is no input to end the process (No in S20), the process returns to S10 and the same process is performed.
[0036]
As described above, when the processing device 10 of the present embodiment extracts a person acting alone (a person acting alone) from an image, the pre-stored "features of appearance of persons Based on "group information in which the amount is registered for each group", it is determined whether the extracted single action person belongs to any group. Then, when it is determined that the single-acting person belongs to any group, the notification information is output. According to such a processing device 10, it is possible to detect a person who has left the group and has acted alone.
[0037]
In addition, when the processing device 10 detects a person who has left the group and has acted alone, the processing device 10 can accumulate notification information regarding the person who has acted alone, as shown in FIG. Therefore, when any one of the solitary persons is involved in some kind of trouble, it is possible to search for the person's footsteps based on the accumulated report information.
[0038]

The processing device 10 of this embodiment has a function of automatically generating group information based on the analysis result of the image acquired by the acquisition unit 11 and storing it in the storage unit 15 . FIG. 6 shows an example of a functional block diagram of the processing device 10. As shown in FIG. The processing device 10 of this embodiment differs from the processing device 10 of the first embodiment in that it has a group information generation unit 16 .
[0039]
The group information generation unit 16 associates the feature amount of the appearance of each of the two persons whose duration of the state in which the distance between them is less than the first threshold is equal to or longer than the reference time to the same group (group identification information). and register it in the group information.
[0040]
FIG. 3 schematically shows an example of group information generated by the group information generation unit 16 of this embodiment. In the case of this embodiment, only information that can be acquired from the image acquired by the acquisition unit 11 is registered in the group information as information of each member. In the illustrated example, face images, face feature amounts, and the like are registered as information of each member. Instead of the face image, an image of the whole body (including the face part) may be adopted. Then, instead of the face feature amount, the whole body feature amount (face, physique, clothes, etc.) may be employed. Note that the group information may not include part of the illustrated information, or may include other information. The storage unit 15 stores such group information.
[0041]
Next, an example of the processing flow of the processing device 10 of this embodiment will be described using the flowchart of FIG.
[0042]
When the acquisition unit 11 acquires an image (S30), the extraction unit 12 extracts a person from the image (S31). Then, the extraction unit 12 designates one of the extracted persons as a target person (S32).
[0043]
Next, the extraction unit 12 determines whether a person whose distance from the target person is less than the first threshold exists in the image (S33). If it does not exist (No in S33), the extraction unit 12 determines that the target person is acting alone, and extracts the target person as a single-acting person (S37).
[0044]
On the other hand, if a person whose distance from the target person is less than the first threshold exists in the image (Yes in S33), the extraction unit 12 determines that the distance between the person and the target person is less than the first threshold. is longer than the reference time (S34).
[0045]
In the relationship with any one of the persons whose distance from the target person is less than the first threshold, if the duration satisfies the relationship of the reference time or more (Yes in S34), the extraction unit 12 determines that the target person is It is determined that the animal is not acting alone (S35).
[0046]
After that, the group information generation unit 16 performs group information update processing (S36). Specifically, the group information generating unit 16 generates the "characteristic amount of the appearance of the target person" and the "appearance is registered in the group information in association with the same group identification information.
[0047]
If not registered, the group information generation unit 16 determines that the "appearance feature amount of the target person" and "the duration of the state in which the distance to the target person is less than the first threshold is greater than or equal to the reference time". "Feature amount of person's appearance" is linked to the same group identification information and registered in the group information. On the other hand, if registered, the group information generator 16 does not update the group information. After S36, the processing device 10 proceeds to S40.
[0048]
On the other hand, if the relationship with all of the persons whose distance from the target person is less than the first threshold does not satisfy the relationship that the duration is equal to or greater than the reference time (No in S34), the extraction unit 12 It is determined that the target person is acting alone, and the target person is extracted as a single-acting person (S37).
[0049]
After S37, the determination unit 13 determines to which group the target person extracted as a single-acting person belongs based on the group information shown in FIG. 3 (S38). Then, when it is determined that it belongs to the group (Yes in S38), the output unit 14 outputs notification information (S39). After that, the process proceeds to S40. The output notification information is stored, for example, in the storage unit 15 (see FIG. 4).
[0050]
On the other hand, if it is determined that the user does not belong to the group (No in S38), proceed to S40.
[0051]
In S40, the extraction unit 12 determines whether there is a person who is not designated as a target person among the persons extracted in S31. If it exists (Yes in S40), return to S42 and perform the same processing. On the other hand, if it does not exist (No in S40) and there is no input to end the process (No in S41), the process returns to S30 and the same process is performed.
[0052]
Other configurations of the processing device 10 are the same as in the first embodiment.
[0053]
As described above, according to the processing apparatus 10 of the present embodiment, the same effects as those of the processing apparatus 10 of the first embodiment are realized.
[0054]
Further, according to the processing device 10 of the present embodiment, group information can be automatically generated without user's work (pre-registration, etc.). Therefore, it is expected that the number of targets that can be detected as a person who has left the group and acted alone will increase, and the detection rate of a person who has left the group and acted alone will increase.
[0055]

The processing device 10 of this embodiment has a function of generating group information and storing it in the storage unit 15 . FIG. 6 shows an example of a functional block diagram of the processing device 10. As shown in FIG. The processing device 10 of this embodiment differs from the processing device 10 of the first embodiment in that it has a group information generation unit 16 .
[0056]
The group information generation unit 16 generates group information and stores it in the storage unit 15. The group information generator 16 of this embodiment generates group information for each group based on user input. For example, an application dedicated to the service may be installed in a terminal device (smartphone, tablet terminal, smartwatch, mobile phone, personal computer, etc.) of a person who receives the service of the processing device 10 . Through the application, the user can create a group, register various information (name, contact information, image (face image, etc.), etc.) of members belonging to the created group, register emergency contact information, etc. you can go Alternatively, the registration may be performed from a web page related to the service of the processing device 10 .
[0057]
FIG. 8 schematically shows an example of group information generated by the group information generation unit 16 of this embodiment. In the illustrated example, group identification information for mutually identifying a plurality of groups, emergency contact information for each group, and information for each member belonging to each group are associated with each other. The information of each member includes name, contact information, facial image, facial feature amount, and the like. Instead of the face image, an image of the whole body (including the face part) may be adopted. Then, instead of the face feature amount, the whole body feature amount (face, physique, clothes, etc.) may be employed. Note that the group information may not include part of the illustrated information, or may include other information. The storage unit 15 stores such group information.
[0058]
FIG. 9 schematically shows an example of notification information output by the output unit 14 of this embodiment. As shown in the figure, the notification information of this embodiment can include the name and the like of the person acting alone.
[0059]
Other configurations of the processing device 10 are the same as in the first and second embodiments.
[0060]
As described above, according to the processing apparatus 10 of the present embodiment, the same effects as those of the processing apparatuses 10 of the first and second embodiments are realized.
[0061]
Also, according to the processing device 10 of the present embodiment, the user can create a group with relatively simple work and act together as a group. A person can be registered in group information. If the registration of group information is troublesome, fewer users will use the services of the processing device 10 . Naturally, when not using the service (when not registered in the group information), the person will not be detected as a person who left the group and acted alone. Therefore, if the number of users using the service of the processing device 10 is small, the detection rate of a person who leaves the group and acts alone will be low.
[0062]
According to the processing device 10 of the present embodiment, which can register group information with relatively simple work, it is expected that the number of users will increase, and as a result, the detection rate of a person who leaves the group and acts alone will increase. be done.
[0063]

The processing device 10 of this embodiment has a function of transmitting notification information output by the output unit 14 to an external device. FIG. 10 shows an example of a functional block diagram of the processing device 10. As shown in FIG. The processing device 10 of this embodiment differs from the processing devices 10 of the first to third embodiments in that it has a transmission unit 17 . Note that the processing device 10 may further include a group information generator 16 .
[0064]
The transmission unit 17 transmits the notification information output by the output unit 14 to the external device. For example, the transmission unit 17 may transmit the notification information to an emergency contact associated with the group to which the solo action person belongs. In this case, as shown in FIG. 8, in the group information of this embodiment, emergency contacts are registered in association with each group.
[0065]
For example, an e-mail address may be registered as an emergency contact. Then, the transmitting unit 17 may transmit an e-mail containing the notification information to the e-mail address registered as the emergency contact.
[0066]
In addition, an application dedicated to the service may be installed on the terminal device (smartphone, tablet terminal, smartwatch, mobile phone, personal computer, etc.) of the person who receives the service of the processing device 10. User identification information for the service may be registered as an emergency contact. Then, the transmitting unit 17 may transmit the notification information to the terminal device of the user identified by the user identification information registered as the emergency contact. For example, push notification may be used, or notification information may be browsed from a predetermined menu of the application.
[0067]
In addition, the transmission unit 17 may transmit notification information to devices such as police, security companies, and travel agencies through wired and/or wireless communication. The address of the transmission destination is stored in advance in the storage unit 15, and the transmission unit 17 transmits the notification information with the address as the destination.
[0068]
Other configurations of the processing device 10 are the same as those of the first to third embodiments.
[0069]
As described above, according to the processing apparatus 10 of the present embodiment, the same effects as those of the processing apparatuses 10 of the first to third embodiments are realized.
[0070]
In addition, when the processing device 10 detects a person who has left the group and is acting alone, the processing device 10 can transmit notification information regarding the person acting alone to the external device.
[0071]
For example, the processing device 10 can transmit the notification information to the emergency contacts of the group to which the single person belongs. Therefore, the person registered as the emergency contact of the group can quickly grasp the fact that the member of the group is acting alone. Then, depending on the location information and date/time information included in the report information, the person can be searched for, and appropriate measures can be quickly taken, such as asking for help from the police, a security company, a travel agency, or the like.
[0072]
In addition, the processing device 10 can transmit notification information to devices such as police, security companies, and travel agencies. Therefore, the police, security companies, travel agencies, etc. can quickly grasp the fact that a person who is recommended to act in a group is acting alone. Then, by relying on the position information and date/time information included in the report information, it is possible to quickly take appropriate measures such as searching for the person and protecting the person.
[0073]

The processing device 10 of this embodiment differs from those of the first to fourth embodiments in the details of the processing for extracting a person acting alone. An example of a functional block diagram of the processing device 10 of this embodiment is the same as that of the processing device 10 of the first to fourth embodiments.
[0074]
The extraction unit 12 selects an area where there is no person for whom the distance from the target person is less than the first threshold for a reference time or longer, and where the distance from the target person is less than the second threshold. If there is no other person in the group to which the person belongs, it is determined that the target person is acting alone. The first threshold is less than the second threshold.
[0075]
Note that the extraction unit 12 extracts an area in which there is no person for whom the distance from the target person is less than the first threshold for the reference time or longer, and the distance from the target person is less than the second threshold. If there is no other person in the group to which the target person belongs to for a predetermined time or longer, it may be determined that the target person is acting alone. The first threshold is less than the second threshold.
[0076]
Next, an example of the processing flow of the processing device 10 of this embodiment will be described using the flowchart of FIG. In the flow of processing, the group information generation unit 16 generates group information by the means described in the fourth embodiment, but in the present embodiment, the group information generation means is not limited to this.
[0077]
When the acquisition unit 11 acquires an image (S50), the extraction unit 12 extracts a person from the image (S51). Then, the extraction unit 12 designates one of the extracted persons as a target person (S52).
[0078]
Next, the extraction unit 12 determines whether a person whose distance from the target person is less than the first threshold exists in the image (S53). If it does not exist (No in S53), the extraction unit 12 determines whether there is another member of the group to which the target person belongs in an area smaller than the second threshold from the target person (S57). If there is no other member (No in S57), the extraction unit 12 determines that the target person is acting alone, and extracts the target person as a single-acting person (S59).
[0079]
On the other hand, if there are other members (Yes in S57), the extraction unit 12 determines that the target person is not acting alone (S58). Then, the process proceeds to S62.
[0080]
Further, when a person whose distance from the target person is less than the first threshold exists in the image (Yes in S53), the extraction unit 12 determines that the distance between the person and the target person is less than the first threshold. is longer than the reference time (S54).
[0081]
If the relationship with any of the persons whose distance from the target person is less than the first threshold satisfies the relationship that the duration time is equal to or longer than the reference time (Yes in S54), the extraction unit 12 determines that the target person is It is determined that it is not acting alone (S55).
[0082]
After that, the group information generation unit 16 updates the group information (S56). Specifically, the group information generating unit 16 generates the "characteristic amount of the appearance of the target person" and the "appearance is registered in the group information in association with the same group identification information.
[0083]
If not registered, the group information generation unit 16 determines that the "appearance feature amount of the target person" and "the duration of the state in which the distance to the target person is less than the first threshold is greater than or equal to the reference time". "Feature amount of person's appearance" is linked to the same group identification information and registered in the group information. On the other hand, if registered, the group information generator 16 does not update the group information. After S36, the processing device 10 proceeds to S62.
[0084]
On the other hand, if the relationship with all of the persons whose distance from the target person is less than the first threshold does not satisfy the relationship that the duration is equal to or longer than the reference time (No in S54), the processing device 10 proceeds to S57. move on. The processing flow of S57, S58, and S59 is as described above, so the description here is omitted.
[0085]
After S59, the determination unit 13 determines to which group the target person extracted as the single-acting person belongs based on the group information shown in FIG. 3 (S60). Then, when it is determined that it belongs to the group (Yes in S60), the output unit 14 outputs notification information (S61). After that, the process proceeds to S62. The output notification information is stored, for example, in the storage unit 15 (see FIG. 4).
[0086]
On the other hand, if it is determined that the user does not belong to the group (No in S60), proceed to S62.
[0087]
In S62, the extraction unit 12 determines whether there is a person who is not designated as a target person among the persons extracted in S51. If it exists (Yes in S62), return to S52 and perform the same processing. On the other hand, if it does not exist (No in S62) and there is no input to end the process (No in S63), the process returns to S50 and the same process is performed.
[0088]
Other configurations of the processing device 10 are the same as in the first to fourth embodiments.
[0089]
As described above, according to the processing apparatus 10 of the present embodiment, the same effects as those of the processing apparatuses 10 of the first to fourth embodiments are realized. Further, according to the processing device 10 of the present embodiment, it is possible to extract a single person by using group information. Specifically, it is possible to check whether there are other members belonging to the same group around the target person, and to determine whether the target person is a single-acting person or not according to the result. Therefore, the accuracy of extracting a single person is improved.
[0090]
Further, in the processing device 10 of the present embodiment, the threshold of the distance between each other (first threshold) for determining that the members are members of the same group, and the distance between the members for determining whether or not they are acting alone. can be different from the threshold (second threshold). Specifically, the first threshold is made smaller than the second threshold.
[0091]
If the first threshold is too large, there is a risk that unrelated people will be judged as members of the same group and registered in the group information. Therefore, in order to accurately detect members of the same group, it is necessary to reduce the first threshold to some extent. On the other hand, even members of the same group rarely maintain a relationship in which the distance to each other is always equal to or less than the first threshold, and there are cases where they temporarily separate from each other and act separately. In order to avoid erroneously judging a person who is temporarily acting a little apart from other members as a person acting alone, it is necessary to increase the second threshold to some extent.
[0092]
In spite of such a situation, if the first threshold and the second threshold are set to the same value, the accuracy of detecting members of the same group and the accuracy of detecting a single person who is separated from the group will be low. turn into. According to the processing device 10 of the present embodiment in which the first threshold and the second threshold are different and the first threshold is smaller than the second threshold, the members of the same group are detected with high accuracy, and the group It is possible to accurately detect a single-acting person who is away from the target.
[0093]

The processing device 10 of the present embodiment has a function of determining whether or not output of notification information is necessary when detecting an individual acting alone who has left the group, and outputting notification information when it is determined that it is necessary. An example of a functional block diagram of the processing device 10 of this embodiment is the same as that of the processing device 10 of the first to fifth embodiments.
[0094]
As shown in FIG. 8, in the group information of this embodiment, the personal contact information of each person belonging to the group is registered. Then, when it is determined that the single-acting person extracted from the image belongs to any group, the output unit 14 stores the single-acting person in the contact information of one of the groups to which the single-acting person belongs. A question is sent asking whether or not they have strayed, and an answer is received as to whether they have strayed or not. The destination of the question may be a person acting alone or another person.
[0095]
For example, an e-mail address may be registered as a personal contact. Then, the output unit 14 outputs the personal contact information The above question may be sent to the e-mail address registered as a destination. In addition, the e-mail may include the URL of the web page for reply. And the output part 14 may receive the answer of a question from the said web page.
[0096]
In addition, an application dedicated to the service may be installed on the terminal device (smartphone, tablet terminal, smartwatch, mobile phone, personal computer, etc.) of the person who receives the service of the processing device 10. User identification information for the service may be registered as a personal contact. Then, the output unit 14 may transmit the question to the terminal device of the user identified by the user identification information registered as the personal contact information, and receive the answer to the question from the page of the application.
[0097]
Then, the output unit 14 outputs the notification information when the received answer indicates that the answer is wrong, and does not output the notification information when the received answer does not indicate that the answer is wrong.
[0098]
Other configurations of the processing device 10 are the same as those of the first to fifth embodiments.
[0099]
As described above, according to the processing apparatus 10 of the present embodiment, the same effects as those of the processing apparatuses 10 of the first to fifth embodiments are realized. Further, according to the processing device 10 of the present embodiment, when a single-acting person who has left a group is detected, an inquiry is made to the person of the group to which the single-acting person belongs to whether or not the single-acting person has left the group. Notification information can be output in this case.
[0100]
Even if a person belongs to a group, for some reason, with the consent of another person, there may be cases where he or she acts apart from another person. If the notification information is output even in such a case, the reliability of the output notification information may be lowered. According to the processing device 10 of the present embodiment, it is possible to output the notification information when it is really necessary to output the notification information, so the reliability of the output notification information is increased.
[0101]

The processing device 10 of the present embodiment has a function of determining whether or not output of notification information is necessary when detecting an individual acting alone who has left the group, and outputting notification information when it is determined that it is necessary. An example of a functional block diagram of the processing device 10 of this embodiment is the same as that of the processing device 10 of the first to sixth embodiments.
[0102]
The output unit 14 outputs notification information when the behavior of the single action person satisfies the notification conditions. The notification condition is "to correspond to a predetermined behavior". The predetermined behavior is a typical behavior performed by a person who has become separated from the group, such as, but not limited to, looking around.
[0103]
The behavior of looking around can be detected, for example, based on the facial movements of a person acting alone. As an example, the output unit 14 continuously moves up, down, left, and right for a first predetermined time (eg, 1 minute) without stopping the face of the single action person for a second predetermined time (eg, 3 seconds) or longer. If so, it can be determined that they are looking around.
[0104]
Other configurations of the processing device 10 are the same as those of the first to sixth embodiments.
[0105]
As described above, according to the processing apparatus 10 of the present embodiment, the same effects as those of the processing apparatuses 10 of the first to sixth embodiments are realized. Further, according to the processing device 10 of the present embodiment, when detecting a solitary person who has left the group, it is determined whether or not the solitary person has left the group based on the behavior of the solitary person. Notification information can be output in this case.
[0106]
Even if a person belongs to a group, for some reason, with the consent of another person, there may be cases where he or she acts apart from another person. If the notification information is output even in such a case, the reliability of the output notification information may be lowered. According to the processing device 10 of the present embodiment, it is possible to output the notification information when it is really necessary to output the notification information, so the reliability of the output notification information is increased.
[0107]

A modified example that can be applied to all embodiments will be described. Based on the content of the image acquired by the acquisition unit 11 and the time zone in which the image was generated, the extraction unit 12 determines whether the image is an image of a predetermined area (for example, an area where group activities are recommended). You can judge. Then, if the extraction unit 12 determines that the image is the image of the predetermined area, the extracting unit 12 performs the process of extracting the single action person, and if it determines that the image is not the image of the predetermined area, the extraction unit 12 It is not necessary to perform processing for extracting a person.
[0108]
　If the camera is mounted on a mobile object, the camera may shoot not only in areas where group activities are recommended, but also in other areas. In addition, there are areas that are relatively safe during the day and do not correspond to areas where group activities are recommended, but are areas where security is poor at night and correspond to areas where group activities are recommended. Regardless of such circumstances, if all images generated by the camera are to be processed, the processing load on the processing device 10 will increase. According to the modification, only images that need to be processed can be processed, so the processing load on the processing device 10 can be reduced.
[0109]
Although the present invention has been described with reference to the embodiments (and examples), the present invention is not limited to the above-described embodiments (and examples). Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.
[0110]
Some or all of the above embodiments can also be described as the following additional remarks, but are not limited to the following.
1. Acquisition means for acquiring images generated by the camera,
　Extraction means for extracting a person who is acting alone from the image, and
a judgment means for judging whether the person acting alone belongs to any of the groups based on group information in which the feature amount of the appearance of the person acting in a group is registered;
an output means for outputting notification information when it is determined that the person acting alone belongs to one of the groups;
A processing device having
2. Generating group information for registering in the group information by associating with the same group the feature values ​​of the appearance of each of two persons whose duration time is equal to or greater than a reference time while the distance between them is less than a first threshold is linked to the same group. 2. The processing apparatus according to claim 1, further comprising means.
3. The extraction means extracts an area in which there is no person whose distance from the target person is less than the first threshold for a reference time or longer, and where the distance from the target person is less than the second threshold. If there is no other person in the group to which the target person belongs to, it is determined that the target person is acting alone,
2. The processing device according to 2, wherein the first threshold is smaller than the second threshold.
4. 4. The processing device according to any one of 1 to 3, wherein the notification information includes information indicating the person acting alone and information indicating the position where the person acted alone.
5. 4. The processing device according to any one of 1 to 4, further comprising a storage unit for storing the notification information output by the output means.
6.　Emergency contact information is registered in the group information,
6. The processing device according to any one of 1 to 5, further comprising transmission means for transmitting the notification information output by the output means to the emergency contact associated with the group to which the single person belongs.
7.　In the group information, the personal contact information of each person belonging to the group is registered,
　The output means
　　A question is sent to the personal contact of any person in the group to which the individual acts alone to inquire whether or not the individual acts alone, and
　　Receiving an answer as to whether or not they were separated,
　　The processing device according to any one of 1 to 6, which outputs the notification information when the answer indicates that the answer is incorrect.
8. 7. The processing device according to any one of 1 to 7, wherein the output means outputs the notification information when the behavior of the single action person satisfies notification conditions.
9. "The computer
　　Obtain the image generated by the camera,
　　From the image, extract a person who is acting alone,
　　Based on the group information in which the features of the appearance of the person acting in a group are registered, it is determined whether the person acting alone belongs to any of the groups,
A processing method for outputting notification information when it is determined that the person acting alone belongs to one of the groups.
10. the computer,
　　Acquisition means for acquiring the image generated by the camera,
　　Extraction means for extracting a person acting alone from the image,
　　Determination means for determining whether the person acting alone belongs to any of the groups based on the group information in which the feature amount of the appearance of the person acting in a group is registered;
　　When it is determined that the person acting alone belongs to one of the groups, an output means for outputting notification information,
A program that acts as a
The scope of the claims
[Claim 1]
Acquisition means for acquiring images generated by the camera,
　Extraction means for extracting a person who is acting alone from the image, and
a judgment means for judging whether the person acting alone belongs to any of the groups based on group information in which the feature amount of the appearance of the person acting in a group is registered;
an output means for outputting notification information when it is determined that the person acting alone belongs to one of the groups;
A processing device having
[Claim 2]
Generating group information for registering in the group information by associating with the same group the feature values ​​of the appearance of each of two persons whose duration time is equal to or greater than a reference time while the distance between them is less than a first threshold is linked to the same group. 2. The processing apparatus of claim 1, further comprising means.
[Claim 3]
The extraction means extracts an area in which there is no person whose distance from the target person is less than the first threshold for a reference time or longer, and where the distance from the target person is less than the second threshold. If there is no other person in the group to which the target person belongs to, it is determined that the target person is acting alone,
The processing device according to claim 2, wherein the first threshold is smaller than the second threshold.
[Claim 4]
The processing device according to any one of claims 1 to 3, wherein the notification information includes information indicating the person acting alone and information indicating the position where the person acted alone.
[Claim 5]
The processing apparatus according to any one of claims 1 to 4, further comprising a storage unit for storing the notification information output by the output means.
[Claim 6]
　Emergency contact information is registered in the group information,
6. The processing device according to any one of claims 1 to 5, further comprising transmission means for transmitting the notification information output by the output means to the emergency contact associated with the group to which the single person belongs.
[Claim 7]
　In the group information, the personal contact information of each person belonging to the group is registered,
　The output means
　　A question is sent to the personal contact of any person in the group to which the individual acts alone to inquire whether or not the individual acts alone, and
　　Receiving an answer as to whether or not they were separated,
　　The processing device according to any one of claims 1 to 6, wherein the notification information is output when the answer indicates that the answer is incorrect.
[Claim 8]
The processing device according to any one of claims 1 to 7, wherein the output means outputs the notification information when the behavior of the single action person satisfies notification conditions.
[Claim 9]
"The computer
　　Obtain the image generated by the camera,
　　From the image, extract a person who is acting alone,
　　Based on the group information in which the features of the appearance of the person acting in a group are registered, it is determined whether the person acting alone belongs to any of the groups,
A processing method for outputting notification information when it is determined that the person acting alone belongs to one of the groups.
[Claim 10]
the computer,
　　Acquisition means for acquiring the image generated by the camera,
　　From the above image, a single line that is a person acting alone extraction means for extracting a moving person;
　　Determination means for determining whether the person acting alone belongs to any of the groups based on the group information in which the feature amount of the appearance of the person acting in a group is registered;
　　When it is determined that the person acting alone belongs to one of the groups, an output means for outputting notification information,
A program that acts as a