Specification
Title of Invention: Processing Device, Processing Method and Program
Technical field
[0001]
The present invention relates to a processing device, a processing method and a program.
Background technology
[0002]
Patent Document 1 discloses a crime prevention operation mode for preventing a woman from being tracked by other users when the situation in the elevator satisfies a predetermined condition such as "one woman + man". discloses an elevator controller that switches to In the security operation mode, the elevator controller prompts each user to enter a destination floor. Then, when the woman and other users arrive at the destination floor entered, the elevator control device first announces that only the woman gets off, and when it is confirmed that the woman has gotten off, the door is closed once, and then Control the door to reopen to let other passengers off.
prior art documents
patent literature
[0003]
Patent Document 1: International Publication No. 2017/104071
SUMMARY OF THE INVENTION
Problems to be Solved by the Invention
[0004]
The technology disclosed in Patent Document 1 is a technology for suppressing criminal behavior after getting off an elevator, and does not suppress criminal behavior inside an elevator. SUMMARY OF THE INVENTION An object of the present invention is to provide a technique for suppressing criminal acts in transportation means such as buses, trains, and taxis.
Means to solve problems
[0005]
According to the present invention,
Acquisition means for acquiring a photographed image of the means of transportation,
an image analysis means for calculating, based on the photographed image, the number of people in the means of transportation whose attributes satisfy the first criteria, and the number of persons to be compared;
a calculation means for calculating the ratio of the number of people who satisfy the first criterion to the number of people to be compared;
an output means for outputting warning information when the ratio satisfies warning conditions;
A processing apparatus is provided having:
[0006]
Also, according to the present invention,
"The computer
Acquire a photographed image of the means of transportation,
Based on the captured image, calculate the number of people whose attributes satisfy the first criteria among the people in the transportation means and the number of people to be compared,
　　Calculate the ratio of the number of people who meet the first criteria to the number of people to be compared,
A processing method is provided for outputting warning information when the ratio satisfies warning conditions.
[0007]
Also, according to the present invention,
the computer,
　　Acquisition means for acquiring a photographed image of the means of transportation,
Image analysis means for calculating, based on the photographed image, the number of people in the means of transportation whose attributes satisfy the first criteria, and the number of people to be compared;
Calculation means for calculating the ratio of the number of people who satisfy the first criterion to the number of people to be compared,
　　An output means for outputting warning information when the ratio satisfies a warning condition,
A program is provided to act as a
Effect of the invention
[0008]
　According to the present invention, a technique for suppressing criminal acts in means of transportation such as buses, trains, and taxis is realized.
Brief description of the drawing
[0009]
The above-mentioned objects, as well as other objects, features and advantages, will become more apparent with the preferred embodiments described below and the accompanying drawings below.
[0010]
1 is a diagram for explaining an overview of a processing apparatus according to an embodiment; FIG.
2 is a diagram showing an example of a hardware configuration of a processing device according to the embodiment; FIG.
3 is an example of a functional block diagram of a processing device of the present embodiment; FIG.
4 is a diagram schematically showing an example of information processed by the processing device of the present embodiment; FIG.
5 is a diagram schematically showing an example of information processed by the processing device of the present embodiment; FIG.
6 is a diagram schematically showing an example of information output by an external device according to the embodiment; FIG.
7 is a diagram schematically showing an example of information output by an external device according to the embodiment; FIG.
8 is a flow chart showing an example of the processing flow of the processing device of the present embodiment; FIG.
9 is a diagram for explaining the outline of the processing device of the present embodiment; FIG.
10 is a diagram for explaining the outline of the processing device of the present embodiment; FIG.
11 is a diagram for explaining the outline of the processing device of the present embodiment; FIG.
12 is a flow chart showing an example of the processing flow of the processing device of the present embodiment; FIG.
MODE FOR CARRYING OUT THE INVENTION
[0011]

First, using FIG. 1, the outline of the processing device 10 of the present embodiment will be described. The processing device 10 is mounted on a moving means 100 . The moving means 100 has a function of accommodating and moving people. Examples of such means of transportation 100 include, but are not limited to, buses, trains, taxis, ships, airplanes, and the like. While the transportation means 100 is moving, the person accommodated in the transportation means 100 is confined inside and it becomes difficult to escape to the outside. Inside such transportation means 100, there is a possibility that criminal acts are likely to occur due to biased attributes of people present in the transportation means. In particular, criminal acts are likely to occur in the means of transportation 100 where the ratio of people with attributes who can be targets of criminal acts is small.
[0012]
Therefore, when the processing device 10 acquires a photographed image of the transportation means 100, the processing device 10 calculates the number of persons whose attributes satisfy the first criteria among the persons in the transportation means 100 and the number of persons to be compared based on the photographed image. calculate. A person who meets the first criterion is a potential victim of criminal activity. The number of people to be compared is the number of people to be compared with the number of people who satisfy the first criterion. are exemplified.
[0013]
Then, the processing device 10 transmits warning information to the external device 30 when the ratio of the number of people who satisfy the first criterion to the number of people to be compared satisfies the warning condition. The external device 30 can manage the status of each means of transportation 100 based on the warning information received from the processing device 10 . Note that the processing device 10 and the external device 30 can communicate with each other via a communication network such as the Internet.
[0014]
Next, the configuration of the processing device 10 will be described in detail. First, an example of the hardware configuration of the processing device 10 will be described.
[0015]
Each functional unit of the processing device 10 includes a CPU (Central Processing Unit) of any computer, a memory, a program loaded into the memory, a storage unit such as a hard disk for storing the program (stored in advance from the stage of shipping the device). It can also store programs downloaded from storage media such as CDs (Compact Discs) and servers on the Internet, etc.), and is realized by any combination of hardware and software centered on the interface for network connection. be. It should be understood by those skilled in the art that there are various modifications to the implementation method and apparatus.
[0016]
FIG. 2 is a block diagram illustrating the hardware configuration of the processing device 10. As shown in FIG. As shown in FIG. 2, the processing device 10 has a processor 1A, a memory 2A, an input/output interface 3A, a peripheral circuit 4A and a bus 5A. The peripheral circuit 4A includes various modules. The processing device 10 may not have the peripheral circuit 4A. Note that the processing device 10 may be composed of a plurality of devices that are physically and/or logically separated, or may be composed of one device that is physically and/or logically integrated. When the processing device 10 is composed of a plurality of physically and/or logically separated devices, each of the plurality of devices can have the above hardware configuration.
[0017]
The bus 5A is a data transmission path for mutually transmitting and receiving data between the processor 1A, the memory 2A, the peripheral circuit 4A and the input/output interface 3A. The processor 1A is, for example, an arithmetic processing device such as a CPU or a GPU (Graphics Processing Unit). The memory 2A is, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory). The input/output interface 3A includes an interface for acquiring information from an input device, an external device, an external server, an external sensor, a camera, etc., an interface for outputting information to an output device, an external device, an external server, etc. . Input devices are, for example, keyboards, mice, microphones, physical buttons, touch panels, and the like. The output device is, for example, a display, speaker, printer, mailer, or the like. The processor 1A can issue commands to each module and perform calculations based on the calculation results thereof.
[0018]
An example of a functional block diagram of the processing device 10 is shown in FIG. As illustrated, the processing device 10 has an acquisition unit 11 , an image analysis unit 12 , a calculation unit 13 and an output unit 14 .
[0019]
The acquisition unit 11 acquires a photographed image of the transportation means 100 . The photographed image may be an image of the inside of the transportation means 100, an image of the vicinity of the entrance of the transportation means 100, or other images.
[0020]
For example, a camera installed in the moving means 100 may generate such a captured image. The camera installed in the moving means 100 may shoot moving images all the time, or may shoot still images or moving images for a certain period of time at a predetermined timing. The predetermined timing includes, but is not limited to, a timing at which the situation of the person in the transportation means 100 may change, such as the timing when the door of the transportation means 100 is opened or the timing when the transportation means 100 stops. For example, the camera may receive a notification from an ECU (Electronic Control Unit) mounted on the transportation means 100 that the door of the transportation means 100 has been opened or that the transportation means 100 has stopped. may be detected. Alternatively, a photographed image of the transportation means 100 may be generated by a camera (surveillance camera or the like) installed on a road or the like. The acquisition unit 11 communicates with the camera as described above by any wired and/or wireless communication means, and acquires a captured image generated by the camera.
[0021]
The image analysis unit 12 calculates, based on the captured image acquired by the acquisition unit 11, the number of people in the transportation means 100 whose attributes satisfy the first criteria and the number of people to be compared.
[0022]
A person who meets the first criterion is, for example, a person who can become a victim of a criminal act. A first criterion is defined based on at least one of the attributes extracted from the image, such as gender, age, facial features, height, belongings, clothing, situation. A person who satisfies the first criterion may be a person who can become a victim of crime, so it can be set according to the crime situation in the area. For example, in areas where "women" are often victims of crime, the first criterion may be "women". Further, for example, in areas where "men" are often victims of crime, "male" may be used as the first criterion.
[0023]
Other examples include “children (e.g., estimated age is X years old or younger),” “elderly people (e.g., estimated age is Y years old or older, etc.),” “girls (e.g., estimated age is X years old or younger). female, etc.),” “boys (e.g., men with an estimated age of X or younger, etc.,” “tourists (e.g., people with suitcases, etc.),” “single behavior (no one within a predetermined distance, etc.)” etc. are exemplified.
[0024]
The number of people to be compared is the number of people to be compared with the number of people who satisfy the first criterion. , or the number of people in the means of transportation 100 whose attribute satisfies the second criteria. A person who meets the second criterion may be a person other than a person who meets the first criterion, ie, a person who may be the victim of a criminal act.
[0025]
Also, depending on the crime situation in the area, the number of people who satisfy the second criteria may be the number of people who satisfy predetermined attributes. For example, in areas where there are many crimes committed by women, the second criterion may be “women,” and in areas where there are many crimes committed by men, “men” may be used as the second criterion.Alternatively, in areas where there are many crimes committed by children, a person (for example, a person whose estimated age is Z years old or younger) may be used.
[0026]
The second criterion is a person who possesses a dangerous object (for example, a long metal rod, etc.) or a person whose face is covered (for example, a person wearing a mask, etc.). There may be.
[0027]
In addition, not limited to the above, other characteristics that have the characteristics of being a perpetrator of criminal acts may be used as the second criterion.
[0028]
The second criterion is determined based on at least one attribute extracted from the image, such as gender, age, facial features, height, belongings, clothing, and situation.
[0029]
Here, an example of processing for calculating the number of people who satisfy the first criteria and the number of people to be compared will be described.
[0030]
For example, when the image analysis unit 12 extracts a person from the photographed image of the inside of the transportation means 100, the image analysis unit 12 estimates the attributes based on the appearance features (facial features, height, clothes, etc.) of each person in the image. . Then, based on the estimation result, the image analysis unit 12 calculates the number of persons who satisfy the first criteria and the number of persons for comparison included in the captured image. Any technique can be adopted as means for estimating the attributes from the appearance features in the image.
[0031]
Note that when the entire interior of the transportation means 100 is captured by a single camera, the image analysis unit 12 determines whether or not the person in the transportation means 100 who satisfies the first criteria based on the analysis result of the captured image generated by the camera. The number of people and the number of people to be compared can be calculated. On the other hand, when the entire interior of the transportation means 100 is captured by a plurality of cameras, the image analysis unit 12 integrates the analysis results of the captured images generated by the respective cameras, and satisfies the first criteria in the transportation means 100. The number of people and the number of people to be compared can be calculated. For example, by summing the number of people who meet the first criteria and the number of people included in the captured images generated by each camera and the number of people to be compared, the number of people who meet the first criteria in the transportation means 100, and The number of people to be compared can be calculated. In this case, based on the characteristics of the appearance of each person, a person who appears redundantly in a plurality of photographed images generated by a plurality of cameras is specified, and by subtracting that portion from the above-mentioned summed value, the same person It is possible to suppress the inconvenience of counting duplicates.
[0032]
On the other hand, when processing a photographed image photographed near the entrance of the transportation means 100, the following processing is exemplified. First, when the image analysis unit 12 extracts a person from the photographed image taken near the entrance of the transportation means 100, the image analysis unit 12 estimates the attribute based on the appearance feature (facial feature, height, clothes, etc.) of each person in the image. can do. Thereby, the image analysis unit 12 can estimate the attributes of each person getting into the transportation means 100 and the attributes of each person getting off the transportation means 100 . Then, the image analysis unit 12 can manage the number of persons who satisfy the first criterion and the number of persons to be compared based on the estimation result.
[0033]
For example, the image analysis unit 12 manages information as shown in FIG. The information shown in FIG. 4 indicates the number of people and the number of passengers (an example of the number of people to be compared) in the transportation means 100 at the present time that satisfy the first criterion. Then, the image analysis unit 12 updates the information based on the analysis result of the captured image. Specifically, when the image analysis unit 12 detects a person who satisfies the first criterion to board the transportation means 100, the number of persons who satisfies the first criterion of the information shown in FIG. 4 and the number of passengers are incremented by one. . When the image analysis unit 12 detects a person who satisfies the first criterion to get off the transportation means 100, the image analysis unit 12 counts down by one the number of persons who satisfy the first criterion and the number of passengers in the information shown in FIG. Further, when the image analysis unit 12 detects a passenger other than a person who satisfies the first criteria for boarding the transportation means 100, the image analysis unit 12 counts up only the number of passengers in the information shown in FIG. Further, when the image analysis unit 12 detects a passenger other than the person who satisfies the first criteria getting off the transportation means 100, the image analysis unit 12 counts down by one only the number of passengers in the information shown in FIG.
[0034]
Returning to FIG. 3, the calculation unit 13 calculates the ratio of the number of people who satisfy the first criterion to the number of people to be compared. For example, in the example of FIG. 4, the calculator 13 calculates "0.2".
[0035]
The output unit 14 outputs warning information when the ratio calculated by the calculation unit 13 satisfies the warning condition. A warning condition is that the ratio is less than or equal to the reference value. The reference value is a predetermined value and stored in the storage device of the processing device 10 .
[0036]
Note that the reference value may be determined for each situation, such as for each time period or each area. For example, the reference value for a time zone in which criminal activity is likely to occur, such as nighttime (after 20:00), may be higher than the reference value for other time zones. Also, the reference value when the transportation means 100 exists in a crime-prone area may be larger than the reference value when the transportation means 100 exists in other areas. Then, when determining whether the ratio satisfies the warning condition, the output unit 14 acquires material information (time, current position of the moving means 100, etc.) for specifying the situation at that time, and is specified by the material information. Based on a reference value corresponding to the situation, it may be determined whether the ratio satisfies the warning condition.
[0037]
The output unit 14 transmits warning information to the external device 30 . The external device 30 is at least one of a control center device that manages the plurality of means of transportation 100 and a police device.
[0038]
The warning information includes at least one of information identifying the transportation means 100, information indicating the location of the transportation means 100, the number of people who meet the first criteria, the number of people to be compared, and the ratio. The information indicating the position of the moving means 100 may be periodically notified from the processing device 10 to the external device 30 separately from the warning information. As a means for the processing device 10 to acquire the position information of the transportation means 100, there is a means using a GPS (global positioning system) provided in the transportation means 100, or an external positioning system generated by a camera provided in the transportation means 100. Examples include means for estimating from an image including scenery, and means for estimating from the installation position of the camera in the case where the above analysis is performed by acquiring a photographed image generated by a camera installed on the road, etc., but these is not limited to
[0039]
The external device 30 can manage the status of each means of transportation 100 based on various information received from each of the processing devices 10 mounted on each of the plurality of means of transportation 100 . FIG. 5 schematically shows an example of information managed by the external device 30. As shown in FIG. In the illustrated information, transportation identification information, warning presence/absence status, warning details, position information, and driver information are linked to each other. Note that other information may be linked and managed.
[0040]
The transportation means identification information is information for identifying the plurality of transportation means 100 from each other.
[0041]
The warning presence/absence state is information indicating whether or not the warning condition is satisfied.
[0042]
The warning details are information indicating the details of the warning content indicated by the received warning information (the number of people who meet the first criteria, the number of people to be compared, the ratio, etc.). Although the details will be described in the following embodiments, the image analysis unit 12 of the processing device 10 detects other situations in which a criminal act may occur (a presence in the mobile device 100, a blacklisted person in the transportation means 100, etc.) can be detected. In this case, the warning information output by the output unit 14 may include information indicating other detected situations. In the example of FIG. 5, the warning details indicate the other situation detected (cluster present).
[0043]
The location information is information indicating the current location of each means of transportation 100 . For example, it can be represented by latitude and longitude information.
[0044]
The driver information is information about the driver of each means of transportation 100. A database containing information about each driver (name, age, years of experience, etc.) is generated in advance. When information indicating the driver of each means of transportation 100 is input to the external device 30 by arbitrary means, the external device 30 extracts the information on the driver from the database and, as shown in FIG. The information indicating the status of the means 100 is registered.
[0045]
The external device 30 may have means for outputting the information shown in FIG. 5 to the user via an output device such as a display, a projection device, a printer, or a mailer. For example, the external device 30 may output information indicating the status of each of the plurality of means of transportation 100 as shown in FIG.
[0046]
In addition, as shown in FIG. 6, the external device 30 may display a list of information indicating the status of the transportation means 100 that satisfies the warning conditions. As illustrated, the list may display the above-described warning details, location information, driver information, and the like. In order to make it easier for the user to grasp the location information, the location information may be converted into a place name such as "XX area" and displayed instead of the latitude and longitude information.
[0047]
In addition, the external device 30 may calculate the display priority based on the warning details, the position information, the driver information, etc., and display a list in descending order of the display priority. For example, the display priority of transportation means 100 existing in a pre-designated dangerous area is increased, or the display priority of transportation means 100 with a lower ratio of the number of people who satisfy the first criterion to the number of people to be compared is increased. or increase the display priority of the transportation means 100 with a smaller number of people among the transportation means 100 with one or more people who satisfy the first criteria, or the transportation means 100 with fewer years of experience of the driver , transportation means 100 driven by drivers on a pre-created blacklist, or any other situation where criminal activity may occur is detected. It is exemplified to raise the display priority of the moving means 100 that is on.
[0048]
As another example, the external device 30 may output information obtained by mapping the position of the transportation means 100 and the warning status on a map as shown in FIG. 7 via an output device. In the figure, the positions of the moving means 100 are indicated by circle marks displayed on the map. Information (“M1176” etc.) for identifying each means of transportation 100 and a warning presence/absence state are shown in association with each circle mark. Then, the means of transportation 100 that satisfies the warning condition is highlighted. It should be noted that the external device 30 may display warning details and driver information corresponding to the transportation means 100 on the screen when an input specifying one transportation means 100 is received on the screen.
[0049]
Next, an example of the processing flow of the processing device 10 will be described using the flowchart of FIG.
[0050]
When the acquisition unit 11 acquires a new captured image, the flow of FIG. 8 is executed. First, the image analysis unit 12 analyzes the newly acquired photographed image, and calculates the number of persons who satisfy the first criteria in the photographed image and the number of passengers (an example of the number of persons to be compared) (S11 ). Then, the image analysis unit 12 calculates the number of people and the number of passengers who satisfy the first criteria in the transportation means 100 based on the calculation result of S11 (S12).

The scope of the claims

[Claim 1]
Acquisition means for acquiring a photographed image of the means of transportation,
an image analysis means for calculating, based on the photographed image, the number of people in the means of transportation whose attributes satisfy the first criteria, and the number of persons to be compared;
a calculation means for calculating the ratio of the number of people who satisfy the first criterion to the number of people to be compared;
an output means for outputting warning information when the ratio satisfies warning conditions;
A processing device having
[Claim 2]
　The processing apparatus according to claim 1, wherein the first criterion is determined based on features of the appearance of a person in the transportation means.
[Claim 3]
The number of people to be compared is the number of passengers on the means of transportation, the number of people in the means of transportation, or the number of people in the means of transportation whose attributes satisfy the second criteria,
The processing apparatus according to claim 1 or 2, wherein the second criterion is determined based on features of the appearance of a person in the transportation means.
[Claim 4]
The processing device according to any one of claims 1 to 3, wherein the output means outputs warning information when the number of people who satisfy the first criterion satisfies warning conditions.
[Claim 5]
5. The processing device according to any one of claims 1 to 4, wherein said output means transmits said warning information to an external device that is at least one of a device of a management center that manages said transportation means and a device of police. .
[Claim 6]
The processing device according to any one of claims 1 to 5, wherein the output means outputs the warning information to an output device that provides information to a person present in the moving means.
[Claim 7]
The warning information includes at least one of information identifying the means of transportation, information indicating the position of the means of transportation, the number of people who meet the first criteria, the number of people to be compared, and the ratio. 7. The processing apparatus according to any one of 1 to 6.
[Claim 8]
The image analysis means, based on the photographed image, analyzes the relationship between the driver and the passengers of the transportation means, the mutual relationship between the plurality of passengers of the transportation means, and the transportation by one person who satisfies the first criterion. inferring at least one of whether a vehicle is on board and whether a blacklisted person is present in the vehicle;
The processing apparatus according to any one of claims 1 to 7, wherein, when the estimation result satisfies a predetermined condition, the output means includes in the warning information that the estimation result satisfies the predetermined condition.
[Claim 9]
"The computer
Acquire a photographed image of the means of transportation,
Based on the captured image, calculate the number of people whose attributes satisfy the first criteria among the people in the transportation means and the number of people to be compared,
　　Calculate the ratio of the number of people who meet the first criteria to the number of people to be compared,
A processing method for outputting warning information when the ratio satisfies warning conditions.
[Claim 10]
the computer,
　　Acquisition means for acquiring a photographed image of the means of transportation,
Image analysis means for calculating, based on the photographed image, the number of people in the means of transportation whose attributes satisfy the first criteria, and the number of people to be compared;
Calculation means for calculating the ratio of the number of people who satisfy the first criterion to the number of people to be compared,
　　An output means for outputting warning information when the ratio satisfies a warning condition,
A program that acts as a drawing