Title of Invention: Processing Device, Processing Method and Program
Technical field
[0001]
The present invention relates to a processing device, a processing method and a program.
Background technology
[0002]
A notification device may be installed on the road or in the street that will notify the police when the button is pressed.
[0003]
Patent Document 1 discloses a self-supporting crime prevention light that allows a caller to make a call with the police via an intercom when an emergency situation such as an incident or accident occurs. Further, Patent Document 1 discloses transmitting a voice message to a person near the security light in order to prevent the notification device from being pushed down by mischief or erroneous operation.
prior art documents
patent literature
[0004]
Patent Document 1: JP-A-2007-72541
SUMMARY OF THE INVENTION
Problems to be Solved by the Invention
[0005]
The technology disclosed in Patent Literature 1 only warns about mischief or erroneous operation by voice. If the reporting device is pressed down by mischief or an erroneous operation, the call processing with the police will be performed. Responding to reports due to pranks or erroneous operations imposes a heavy burden on the respondent (police).
[0006]
An object of the present invention is to reduce the frequency of reports due to pranks and erroneous operations.
Means to solve problems
[0007]
According to the present invention,
a detection means for detecting that the notification device has been operated;
acquisition means for acquiring at least one of the image generated by the camera and the sound collected by the microphone when it is detected that the reporting device has been operated;
means for determining whether at least one of the image and the sound satisfies the reporting conditions;
an output means for outputting notification information indicating that the notification device has been operated when it is determined that the notification conditions are satisfied;
A processing apparatus is provided having:
[0008]
Also, according to the present invention,
"The computer
　　Detecting that the reporting device has been operated,
　　When it is detected that the reporting device has been operated, at least one of the image generated by the camera and the sound collected by the microphone is acquired,
　　Determine whether at least one of the image and the sound satisfies the reporting conditions,
A processing method is provided for outputting notification information indicating that the notification device has been operated when it is determined that the notification conditions are satisfied.
[0009]
Also, according to the present invention,
the computer,
　　detection means for detecting that the notification device has been operated,
Acquisition means for acquiring at least one of the image generated by the camera and the sound collected by the microphone when it is detected that the reporting device has been operated,
　　Determining means for determining whether at least one of the image and the sound satisfies the reporting conditions,
Output means for outputting report information indicating that the report device has been operated when it is determined that the report conditions are met,
A program is provided to act as a
Effect of the invention
[0010]
According to the present invention, the frequency of reports due to pranks and erroneous operations is reduced.
Brief description of the drawing
[0011]
The above-mentioned objects, as well as other objects, features and advantages, will become more apparent with the preferred embodiments described below and the accompanying drawings below.
[0012]
1 is a diagram for explaining an overview of a processing apparatus according to an embodiment; FIG.
2 is a diagram showing an example of a hardware configuration of a processing device according to the embodiment; FIG.
3 is an example of a functional block diagram of a processing device of the present embodiment; FIG.
4 is a flow chart showing an example of the processing flow of the processing device of the present embodiment; FIG.
5 is a flow chart showing an example of the processing flow of the processing device of the present embodiment; FIG.
6 is a flow chart showing an example of the processing flow of the processing device of the present embodiment; FIG.
7 is a flow chart showing an example of the processing flow of the processing device of the present embodiment; FIG.
8 is a flow chart showing an example of the processing flow of the processing device of the present embodiment; FIG.
9 is a flowchart showing an example of the processing flow of the processing device of the present embodiment; FIG.
MODE FOR CARRYING OUT THE INVENTION
[0013]

First, the outline of the processing device 10 of the present embodiment will be described using FIG. As shown in the figure, the notification device 1 is installed at an arbitrary position such as a street, a street, a public facility, or the like. A data collection device 2 equipped with at least one of a camera and a microphone is installed around the reporting device 1 . The camera is installed so as to photograph the surroundings of the reporting device 1. - 特許庁A microphone is installed so as to collect sounds around the reporting device 1 . The reporting device 1 and the processing device 10 are connected by wire and/or wirelessly so as to be able to communicate with each other. Also, the data collection device 2 and the processing device 10 are connected by wire and/or wirelessly so as to be able to communicate with each other.
[0014]
When the processing device 10 detects that the notification device 1 has been operated based on the signal from the notification device 1, the data (at least one of the image data and the voice data) generated by the data collection device 2 satisfies a predetermined notification condition. or judge. When the processing device 10 determines that the reporting conditions are satisfied, the processing device 10 transmits reporting information indicating that the reporting device 1 has been operated to the reporting destination device 3 . The destination device 3 and the processing device 10 are connected by wire and/or wirelessly so as to be able to communicate with each other. The destination device 3 may be, for example, a device of the police, a device of a security company, or a device managed by another person.
[0015]
In this way, when the reporting device 1 is operated, the processing device 10 determines whether or not reporting is necessary based on the data generated by the data collecting device 2, that is, whether it is mischief or erroneous operation, etc., and determines that reporting is necessary. can be notified when According to such a processing device 10, the frequency of reporting due to mischief or erroneous operation is reduced.
[0016]
Next, the configuration of the processing device 10 will be described in detail. First, an example of the hardware configuration of the processing device 10 will be described.
[0017]
Each functional unit of the processing device 10 includes a CPU (Central Processing Unit) of any computer, a memory, a program loaded into the memory, a storage unit such as a hard disk for storing the program (stored in advance from the stage of shipping the device). It can also store programs downloaded from storage media such as CDs (Compact Discs) and servers on the Internet, etc.), and is realized by any combination of hardware and software centered on the interface for network connection. be. It should be understood by those skilled in the art that there are various modifications to the implementation method and apparatus.
[0018]
FIG. 2 is a block diagram illustrating the hardware configuration of the processing device 10. As shown in FIG. As shown in FIG. 2, the processing device 10 has a processor 1A, a memory 2A, an input/output interface 3A, a peripheral circuit 4A and a bus 5A. The peripheral circuit 4A includes various modules. The processing device 10 may not have the peripheral circuit 4A. Note that the processing device 10 may be composed of a plurality of devices that are physically and/or logically separated, or may be composed of one device that is physically and/or logically integrated. When the processing device 10 is composed of a plurality of physically and/or logically separated devices, each of the plurality of devices can have the above hardware configuration.
[0019]
The bus 5A is a data transmission path for mutually transmitting and receiving data between the processor 1A, the memory 2A, the peripheral circuit 4A and the input/output interface 3A. The processor 1A is, for example, an arithmetic processing device such as a CPU or a GPU (Graphics Processing Unit). The memory 2A is, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory). The input/output interface 3A includes an interface for acquiring information from an input device, an external device, an external server, an external sensor, a camera, etc., an interface for outputting information to an output device, an external device, an external server, etc. . Input devices are, for example, keyboards, mice, microphones, physical buttons, touch panels, and the like. The output device is, for example, a display, speaker, printer, mailer, or the like. The processor 1A can issue commands to each module and perform calculations based on the calculation results thereof.
[0020]
An example of a functional block diagram of the processing device 10 is shown in FIG. As illustrated, the processing device 10 has a detection unit 11 , an acquisition unit 12 , a determination unit 13 and an output unit 14 .
[0021]
The detection unit 11 detects that the notification device 1 has been operated. The reporting device 1 is installed at an arbitrary position such as a street, a street, or a public facility. When the reporting device 1 is operated in an emergency, the fact is reported to the police or the like. For example, the reporting device 1 may have a button. Then, the operation to be performed in an emergency may be pressing of the button. In addition, the reporting device 1 may be provided with other input devices such as a touch panel, mouse, and keyboard. The operation to be performed in an emergency may be a predetermined input operation via these input devices. However, it is preferable that the operation performed in an emergency be simple and easy, such as pressing a button.
[0022]
Upon receiving a predetermined operation (eg, pressing a button, etc.), the reporting device 1 notifies the processing device 10 accordingly. Based on the signal received from the notification device 1, the detection unit 11 detects that the notification device 1 has been operated.
[0023]
Note that the reporting device 1 and the processing device 10 may have a many-to-one relationship or a one-to-one relationship.
[0024]
The acquisition unit 12 acquires the data generated by the data collection device 2 when it is detected that the notification device 1 has been operated. The data collection device 2 includes at least one of a camera and a microphone. The data generated by such a data collection device 2 includes at least one of images and sounds.
[0025]
The camera is installed so as to photograph the surroundings of the reporting device 1. For example, the camera is installed in such a position and orientation that the person who operates the reporting device 1 and the people around the person who operates the reporting device 1 can be photographed. A microphone is installed so as to collect sounds around the reporting device 1 . For example, the microphone is located at a position where it can collect the utterances of the person who operates the notification device 1, the utterances of people around the person who operates the notification device 1, and the sounds generated by the actions of these people. and orientation.
[0026]
The data generated by the data collection device 2 is stored in the storage device in the data collection device 2, in the storage device in the processing device 10, and in the storage devices in other devices configured to be able to communicate with the data collection device 2. At least one is accumulated. Then, when it is detected that the notification device 1 has been operated, the acquisition unit 12 acquires a predetermined part of data from the data accumulated as described above.
[0027]
For example, the acquisition unit 12 acquires data generated by the data collection device 2 from the start timing before the operation timing at which the reporting device 1 is operated to the end timing after the operation timing. That is, the acquiring unit 12 acquires data before and after the operation timing. The start timing is t1 seconds before the operation timing. The end timing is t2 seconds later than the operation timing. Note that t1 and t2 may be the same value or may be different values.
[0028]
In addition, the acquisition unit 12 may acquire data generated by the data collection device 2 from the operation timing when the reporting device 1 is operated to the end timing after the operation timing. That is, the acquisition unit 12 may acquire data after the operation timing. The end timing is t2 seconds later than the operation timing.
[0029]
In addition, the acquisition unit 12 may acquire data generated by the data collection device 2 between the start timing before the operation timing at which the reporting device 1 is operated and the operation timing. That is, the acquisition unit 12 may acquire data before the operation timing. The start timing is t1 seconds before the operation timing.
[0030 ]
In this specification, "acquisition" means "acquisition of data stored in another device or storage medium by one's own device based on user input or program instructions (active acquisition), for example, receiving by requesting or querying another device, accessing and reading from another device or storage medium, and the like. In addition, "acquisition" means "inputting data output from another device to the own device (passive acquisition)" based on user input or based on program instructions, for example, distribution (or , sending, push notifications, etc.). In addition, "acquisition" means selecting and acquiring from the received data or information, and "editing data (converting to text, rearranging data, extracting some data, changing file format, etc.) such as to generate new data and acquire the new data".
[0031]
The determination unit 13 determines whether the data (at least one of the image and the sound) acquired by the acquisition unit 12 satisfies the reporting conditions.
[0032]
First, an example of the process of determining whether the reporting conditions are satisfied based on the image will be explained. First, the determination unit 13 extracts at least one of the person who operated the notification device 1 and the person around the person who operated the notification device 1 from the image acquired by the acquisition unit 12 as an analysis target. For example, the determination unit 13 may extract, as the person who operated the reporting device 1, a person who came into contact with the reporting device 1 at the timing when the reporting device 1 was operated (such as a person who touched the reporting device 1 with a hand). Then, the determination unit 13 selects "a person within a predetermined distance from the person who operated the reporting device 1", "another person within a predetermined distance from the reporting device 1", or "another person in the image". may be extracted as a person around the person who operated the reporting device 1 . “Other person” is a person other than the person who operated the reporting device 1 . Means for extracting a person from an image and means for estimating the actual distance between two points in an image are widely known, so description thereof will be omitted here.
[0033]
Then, the determination unit 13 determines whether or not the notification condition is satisfied based on at least one of the behavior and facial expression of the person extracted as the analysis target. In the present embodiment, the determination unit 13 determines that the reporting condition is satisfied when at least one of the behavior and facial expression of the person extracted as the analysis target corresponds to the predefined behavior and facial expression that require reporting.
[0034]
For example, the behavior of a person who operates the reporting device 1 that requires reporting is exemplified by ``worrying about the surroundings'', ``restless'', and the like. The detection of the behavior of worrying about the state of the surroundings may be performed, for example, based on the movement of the face. As an example, when the direction of the face is constantly changing up, down, left, or right without remaining still for a predetermined time or longer, it may be determined that the person is concerned about the surroundings. Detection of restless behavior may also be detected based on body movements, for example. As an example, if a part of the body is constantly moving without being stationary for a specified period of time and the speed of change (calculated based on the distance traveled by the moving part within a specified period of time) is above a standard level, calmness is indicated. It may be determined that there is no
[0035]
In addition, the expression of the person who operates the reporting device 1 that requires reporting is fear or the like.
[0036]
Also, the behavior and facial expression required to be reported by a person around the person who operated the reporting device 1 may be the same as the behavior and facial expression required to be reported by the person who operated the reporting device 1. This is based on the assumption that persons around the person who operated the reporting device 1 are friends of the person who operated the reporting device 1, and are involved in some kind of trouble like the person who operated the reporting device 1. It is what I did.
[0037]
It should be noted that there is a possibility that people around the person who operated the reporting device 1 are trying to harm the person who operated the reporting device 1. Therefore, the behaviors and facial expressions of people around the person who operated the reporting device 1 that need to be reported may be the behaviors and facial expressions that such people tend to take.
[0038]
For example, behaviors that require reporting by people around the person who operated the reporting device 1 include "looking intently at the person who operated the reporting device 1 without looking away" and "hitting or kicking things in the vicinity". , ``Open your mouth wide to say something and threaten''. The behavior of staring at the person who has operated the reporting device 1 without looking away may be detected based on the movement of the face, for example. As an example, if the person who operated the reporting device 1 is always facing the direction of the face for a predetermined time or more, it is determined that the person who operated the reporting device 1 is staring without looking away. good too. Also, the behavior of hitting or kicking an object in the vicinity may be detected based on the movement of the body, for example. As an example, a part of the body (arm or leg) moves and touches a surrounding object, and the speed of that part of the body (calculated based on the moving distance of the moving part within a predetermined time, etc.) exceeds the standard level. , it may be determined that the player has hit or kicked an object in the vicinity. Detecting a threatening behavior by opening the mouth wide to say something may be detected based on, for example, the direction of the face or the movement of the mouth. As an example, when the mouth moves while the person who has operated the reporting device 1 is facing the person, and there is a moment when the mouth opens wider than the reference level during the movement, the person opens the mouth wide and says something. may be judged to be intimidating.
[0039]
In addition, facial expressions required to be reported by people around the person who operated the reporting device 1 are anger and the like.
[0040]
Note that the behaviors that require notification and the detection method thereof described above are only examples, and are not limited to these. Also, since means for determining facial expressions by image analysis are widely known, description thereof will be omitted here.
[0041]
As another example, the determination unit 13 may determine that the reporting condition is met when a person who is in the vicinity of the person who operates the reporting device 1 is listed in a blacklist of dangerous people prepared in advance. In the blacklist, the appearance feature amount (face feature amount, etc.) of the dangerous person may be registered. Then, the determination unit 13 may determine whether or not a person in the vicinity of the person who operated the reporting device 1 is on the blacklist based on the feature amount.
[0042]
Next, an example of the process of determining whether the reporting conditions are satisfied based on the voice will be explained. The determination unit 13 determines that the notification condition is satisfied when the voice includes a predefined voice that requires reporting. The voice that needs to be reported may be a scream, an angry voice, or the like, or may be a predetermined utterance content. Predetermined utterances may be uttered by the victim such as "stop" or "forgive", or may be uttered by the perpetrator such as "wait" or "not forgive". It may be one with Means for detecting screams, yelling, and the like from speech and means for identifying the content of utterances contained in speech are widely known, so descriptions thereof will be omitted here.
[0043]
In addition, the voice that needs to be reported may be the voice of a person on a blacklist of dangerous people prepared in advance. That is, the determination unit 13 may determine that the report condition is satisfied when the voice includes the voice of a person listed in the dangerous person blacklist. The voiceprint of the voice of the dangerous person may be registered in the blacklist. Based on the voiceprint, the determining unit 13 may determine whether or not the voice includes the voice of a person on the blacklist.
[0044]
When it is determined that the reporting conditions are met, the output unit 14 outputs reporting information indicating that the reporting device 1 has been operated. Specifically, the output unit 14 transmits the report information to the predetermined report destination device 3 . The destination device 3 may be, for example, a device of the police, a device of a security company, or a device managed by another person. Note that the output unit 14 may include data (at least one of an image and a sound) acquired by the acquisition unit 12, information indicating the installation position of the operated reporting device 1, and the like in the report information.
[0045]
Next, an example of the processing flow of the processing device 10 will be described using the flowcharts of FIGS. 4 to 7. FIG.
[0046]
The flowchart in FIG. 4 shows the overall flow from detection of operation of the notification device 1 to output of notification information.
[0047]
When the detection unit 11 detects that the notification device 1 has been operated based on the signal from the notification device 1 (Yes in S10), the acquisition unit 12 collects data (at least one of images and voices) generated by the data collection device 2. (S11). For example, the acquisition unit 12 collects data generated by the data collection device 2 from the start timing before the operation timing at which the notification device 1 is operated to the end timing after the operation timing, that is, the data before and after the operation timing. to get
[0048]
After that, the determination unit 13 determines whether the data acquired by the acquisition unit 12 in S11 satisfies a predetermined notification condition (S12). Then, when it is determined that the report condition is satisfied (Yes in S13), the output unit 14 transmits report information indicating that the report device 1 has been operated to the report destination device 3 (S14). On the other hand, if it is determined that the report condition is not satisfied (No in S13), the output unit 14 does not transmit the report information to the report destination device 3. FIG. The output unit 14 may include data (at least one of an image and a sound) acquired by the acquisition unit 12, information indicating the installation position of the operated reporting device 1, and the like in the report information.
[0049]
Although not shown, the destination device 3 that has received the report information sends information indicating the operated reporting device 1 and You may send a request to rush there. This request may include at least one of an image captured around the operated reporting device 1 and a sound collected around the operated reporting device 1 . Then, the reporting destination device 3 may receive a response from the terminal as to whether or not it is possible to rush to the operated reporting device 1 . In this case, the destination device 3 manages the location information of each terminal of a plurality of persons (police officers, security guards, etc.), and based on the management information, identifies a person near the operated reporting device 1. can be specified.
[0050]
FIG. 5 shows an example of the processing flow of S12 in FIG. In this example, the acquisition unit 12 acquires both the image and the voice in S11, and the determination unit 13 determines whether the report condition is satisfied based on both the image and the voice.
[0051]
If the image satisfies the notification conditions (Yes in S20), the determination unit 13 determines that the notification conditions are satisfied (S22).
[0052]
Also, if the image does not satisfy the reporting conditions (No in S20) but the voice satisfies the reporting conditions (Yes in S21), the determination unit 13 determines that the reporting conditions are satisfied (S22).
[0053]
Then, if the image does not satisfy the reporting conditions (No in S20) and the voice does not satisfy the reporting conditions (No in S21), the determination unit 13 determines that the reporting conditions are not satisfied (S23).
[0054]
FIG. 6 shows an example of the flow of processing for judging whether the reporting conditions are satisfied based on the image. In this example, the determination unit 13 determines whether the report condition is satisfied based on both the behavior and facial expression of the person to be analyzed.
[0055]
The determination unit 13 extracts at least one of the person who operated the notification device 1 and the people around the person who operated the notification device 1 from the image as an analysis target (S30). If at least one of the behavior and facial expression of the person to be analyzed corresponds to the predefined behavior and facial expression that require notification (Yes in S31), the determination unit 13 determines that the reporting condition is satisfied (S32). On the other hand, if neither the behavior nor the facial expression of the person to be analyzed corresponds to the predefined behavior and facial expression that require reporting (No in S31), the determination unit 13 determines that the reporting condition is not satisfied (S33 ).
[0056]
FIG. 7 shows an example of the flow of processing for determining whether the reporting conditions are met based on voice. If the voice includes a predefined voice that requires notification (Yes in S40), the determination unit 13 determines that the notification condition is satisfied (S41). On the other hand, if the voice does not contain the predefined voice that needs to be reported (S 40 No), it is determined that the reporting conditions are not satisfied (S42).
[0057]
When the notification device 1 is operated, the processing device 10 of the present embodiment described above determines whether or not notification is necessary based on the data generated by the data collection device 2, that is, whether it is a mischief or an erroneous operation. You can report when you do. According to such a processing device 10, the frequency of reporting due to mischief or erroneous operation is reduced.
[0058]
In addition, the processing device 10 can determine whether it is a mischief or an erroneous operation based on the behavior and facial expressions of at least one of the person who operated the reporting device 1 and the people around him. Specifically, the processing device 10 can determine whether the person's behavior or facial expression is a mischief or an erroneous operation based on whether or not a report is required. According to such a processing device 10, mischief and erroneous operation can be detected with high accuracy.
[0059]
In addition, the processing device 10 can determine whether or not it is a mischief or an erroneous operation based on the content of statements made by the person who operated the reporting device 1 and at least one of the people in the surroundings, and the voice generated by the actions of those people. can be done. Specifically, the processing device 10 can determine whether or not it is a mischief or an erroneous operation based on whether or not the voice includes a voice that requires notification. According to such a processing device 10, mischief and erroneous operation can be detected with high accuracy.
[0060]
In addition, the processing device 10 can determine whether it is a mischief or an erroneous operation based on not only the image and sound after the operation timing when the notification device 1 is operated, but also the image and sound before the operation timing. According to such a processing device 10, mischief and erroneous operation can be detected with high accuracy.
[0061]

The determination unit 13 of the present embodiment determines whether or not the reporting condition is met based on whether at least one of the behavior and facial expression of the person extracted as the analysis target corresponds to the predefined behavior and facial expression that do not require reporting. . The determination unit 13 determines that the reporting condition is not satisfied when the behavior and expression correspond to those that do not require reporting.
[0062]
For example, behaviors that do not require notification of a person who operates the notification device 1 are "laughing", "smiling", "yawning", "not paying attention to surroundings", and "calmness". There is", etc. are exemplified.
[0063]
In addition, the facial expressions of the person who operated the reporting device 1 that do not require reporting are smile, joy, peace, calmness, and the like.
[0064]
In addition, the behavior and facial expressions of people around the person who operated the reporting device 1 are the same as the behavior and facial expressions of the person who operated the reporting device 1. This is based on the assumption that the people around the person who operated the reporting device 1 are friends of the person who operated the reporting device 1, and that the person who operated the reporting device 1 is playing mischief with the person who operated the reporting device 1. is.
[0065]
As another example, if the person who operated the reporting device 1 or any of the people around him is on a blacklist of repeat mischievous offenders prepared in advance, the determination unit 13 sets the reporting conditions. You may decide that you are not satisfied. In the blacklist, the appearance feature amount (face feature amount, etc.) of the recurring mischievous offender may be registered. Then, the determination unit 13 may determine whether or not the person who operated the reporting device 1 and the people around it are on the blacklist based on the feature amount.
[0066]
In addition, the determination unit 13 can determine that the reporting condition is not satisfied when a predefined voice that does not require reporting is included in the voice. The voice that does not need to be reported may be a laughter or the like, or may be a predetermined utterance content. Predetermined utterances may be things that may be said by the person doing the mischief, such as "Don't do it", "I don't know", "Hurry up", or "I made a mistake", " It may be something that a person who made an erroneous operation may say, such as "I'm sorry" or "What should I do?".
[0067]
In addition, the voice that does not need to be reported may be the voice of a person on the blacklist of habitual mischief offenders prepared in advance. In other words, the determination unit 13 may determine that the report condition is not satisfied when the voice includes the voice of a person on the blacklist of repeat mischievous offenders. The voiceprint of the voice of a repeat prankster may be registered in the blacklist. Based on the voiceprint, the determining unit 13 may determine whether or not the voice includes the voice of a person on the blacklist.
[0068]
Next, an example of the processing flow of the processing device 10 will be described. FIG. 8 shows an example of the flow of processing for judging whether or not reporting conditions are met based on an image. In this example, the determination unit 13 determines whether the report condition is satisfied based on both the behavior and facial expression of the person to be analyzed.
[0069]
The determination unit 13 extracts at least one of the person who operated the reporting device 1 and the people around the person who operated the reporting device 1 from the image as an analysis target (S50). If at least one of the behavior and facial expression of the person to be analyzed corresponds to the predefined behavior and facial expression that do not require reporting (Yes in S51), the determination unit 13 determines that the reporting condition is not satisfied (S53). On the other hand, when none of the behavior and facial expression of the person to be analyzed corresponds to the predefined behavior and facial expression that do not require reporting (No in S51), the determination unit 13 determines that the reporting conditions are satisfied (S52). .
[0070]
FIG. 9 shows an example of the flow of processing for judging whether the reporting conditions are satisfied based on the voice. If the voice includes a predefined voice that requires notification (Yes in S60), the determination unit 13 determines that the notification condition is not satisfied (S62). On the other hand, if the voice does not include a predefined voice that does not require reporting (No in S60), it is determined that the reporting condition is satisfied (S61).
[0071]
Other configurations of the processing device 10 are the same as in the first embodiment.
[0072]
According to the processing device 10 of this embodiment, the same effects as those of the first embodiment are realized. In addition, the processing device 10 can determine whether or not the behavior or facial expression of at least one of the person who operated the reporting device 1 and the people in the surroundings is a mischief or an erroneous operation based on whether or not reporting is unnecessary. can be done. According to such a processing device 10, mischief and erroneous operation can be detected with high accuracy.
[0073]
In addition, the processing device 10 determines whether or not the speech content of at least one of the person who operated the reporting device 1 and the people around him or the voice generated by the actions of those people includes voice that does not need to be reported. Based on this, it is possible to judge whether it is a mischief or an erroneous operation. According to such a processing device 10, mischief and erroneous operation can be detected with high accuracy.
[0074]

Here, a modified example of the processing device 10 applicable to the first and second embodiments will be described. The processing device 10 of the first and second embodiments transmits report information to the report destination device 3 according to the operation of the reporting device 1 . As a modification, the processing device 10 may have a function of transmitting report information to the report destination device 3 without operating the reporting device 1 . Specifically, the processing device 10 may constantly monitor the data generated by the data collection device 2 and perform a process of detecting an abnormality. Then, when the processing device 10 detects an abnormality in the data generated by the data collection device 2 , the processing device 10 may transmit report information to the report destination device 3 .
[0075]
The content detected as an abnormality by the processing device 10 may be, for example, a person running toward the reporting device 1 . This can be detected based on the image. In addition, the processing device 10 may detect a scream, an angry voice, or the like from the sound as an anomaly. In addition, the processing device 10 may detect violent behavior such as hitting or kicking based on the image.
[0076]
For example, there may be a person who comes close to the reporting device 1 to operate the reporting device 1, but is interrupted and cannot operate the reporting device 1. According to the processing device 10 that can make a report based on the situation around the reporting device 1 without operating the reporting device 1, it is possible to help people who have fallen into such a situation.
[0077]
Although the present invention has been described with reference to the embodiments (and examples), the present invention is not limited to the above-described embodiments (and examples). Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.
[0078]
Some or all of the above embodiments can also be described as the following additional remarks, but are not limited to the following.
1. a detection means for detecting that the notification device has been operated;
acquisition means for acquiring at least one of the image generated by the camera and the sound collected by the microphone when it is detected that the reporting device has been operated;
means for determining whether at least one of the image and the sound satisfies the reporting conditions;
an output means for outputting notification information indicating that the notification device has been operated when it is determined that the notification conditions are satisfied;
A processing device having
2. The acquisition means acquires at least the image generated by the camera and the sound collected by the microphone between the start timing before the operation timing at which the notification device is operated and the end timing after the operation timing. 2. The processing device according to 1, which obtains one.
3. The processing device according to 1 or 2, wherein the camera captures the surroundings of the reporting device, and the microphone collects sounds around the reporting device.
4. The judgment means
Extract the person who operated the notification device from the image as an analysis target,
　　The processing device according to any one of 1 to 3, which determines whether the notification condition is satisfied based on the behavior of the person extracted as the analysis target.
5. The judgment means
　　From the image, extract the person who is around the person who operated the notification device as an analysis target,
　　The processing device according to any one of 1 to 4, which determines whether the notification condition is satisfied based on at least one of the behavior and facial expression of the person extracted as the analysis target.
6. 6. The judging means according to 4 or 5, for judging that the reporting condition is satisfied when at least one of the behavior and the facial expression of the person extracted as the analysis object corresponds to the predefined behavior and facial expression that require reporting. processing equipment.
7. 6. The method according to 4 or 5, wherein the determining means determines that the reporting condition is not satisfied when at least one of the behavior and facial expression of the person extracted as the analysis target corresponds to a predefined behavior and facial expression that do not require reporting. processing equipment.
8. The judgment means
　　The processing device according to any one of 1 to 7, which determines that the reporting condition is satisfied when the voice includes a predefined voice that requires reporting.
9. The judgment means
　　The processing device according to any one of 1 to 7, which determines that the reporting condition is not satisfied when the voice includes a predefined voice that does not require reporting.
10. "The computer
　　Detecting that the reporting device has been operated,
　　When it is detected that the reporting device has been operated, at least one of the image generated by the camera and the sound collected by the microphone is acquired,
　　Determine whether at least one of the image and the sound satisfies the reporting conditions,
A processing method for outputting notification information indicating that the notification device has been operated when it is determined that the notification conditions are satisfied.
11. the computer,
　　detection means for detecting that the notification device has been operated,
Acquisition means for acquiring at least one of the image generated by the camera and the sound collected by the microphone when it is detected that the reporting device has been operated,
　　Determining means for determining whether at least one of the image and the sound satisfies the reporting conditions,
Output means for outputting report information indicating that the report device has been operated when it is determined that the report conditions are met,
A program that acts as a
The scope of the claims
[Claim 1]
a detection means for detecting that the notification device has been operated;
acquisition means for acquiring at least one of the image generated by the camera and the sound collected by the microphone when it is detected that the reporting device has been operated;
　At least one of the image and the sound meets the reporting conditions a judgment means for judging whether
an output means for outputting notification information indicating that the notification device has been operated when it is determined that the notification conditions are satisfied;
A processing device having
[Claim 2]
The acquisition means acquires at least the image generated by the camera and the sound collected by the microphone between the start timing before the operation timing at which the notification device is operated and the end timing after the operation timing. 2. A processing apparatus according to claim 1, wherein one is obtained.
[Claim 3]
The processing device according to claim 1 or 2, wherein the camera captures images around the reporting device, and the microphone collects sounds around the reporting device.
[Claim 4]
The judgment means
Extract the person who operated the notification device from the image as an analysis target,
The processing device according to any one of claims 1 to 3, wherein it is determined whether the reporting condition is satisfied based on the behavior of the person extracted as the analysis target.
[Claim 5]
The judgment means
　　From the image, extract the person who is around the person who operated the notification device as an analysis target,
The processing device according to any one of claims 1 to 4, wherein it is determined whether the notification condition is satisfied based on at least one of the behavior and facial expression of the person extracted as the analysis target.
[Claim 6]
6. The determining means according to claim 4 or 5, wherein when at least one of the behavior and facial expression of the person extracted as the analysis target corresponds to a predefined behavior and facial expression that require reporting, the determination means determines that the reporting condition is satisfied. Processing equipment as described.
[Claim 7]
6. When at least one of the behavior and facial expression of the person extracted as the analysis target corresponds to a predefined behavior and facial expression that do not require reporting, the determination means determines that the reporting condition is not satisfied. The processing device according to .
[Claim 8]
The judgment means
　　The processing device according to any one of claims 1 to 7, wherein when the voice includes a predefined voice that requires reporting, it is determined that the reporting condition is satisfied.
[Claim 9]
"The computer
　　Detecting that the reporting device has been operated,
　　When it is detected that the reporting device has been operated, at least one of the image generated by the camera and the sound collected by the microphone is acquired,
　　Determine whether at least one of the image and the sound satisfies the reporting conditions,
A processing method for outputting notification information indicating that the notification device has been operated when it is determined that the notification conditions are satisfied.
[Claim 10]
the computer,
　　detection means for detecting that the notification device has been operated,
Acquisition means for acquiring at least one of the image generated by the camera and the sound collected by the microphone when it is detected that the reporting device has been operated,
　　Determining means for determining whether at least one of the image and the sound satisfies the reporting conditions,
Output means for outputting report information indicating that the report device has been operated when it is determined that the report conditions are met,
A program that acts as a