Abstract: A monitoring device (100) comprises a detection unit (102) which processes a captured image of road surroundings and detects that the relative distances to persons and vehicles included in the image are in a state of being at or below a reference value, and an output unit (104) which uses attributes of a person detected as being in the aforementioned state to select a type of information to be output and outputs the selected type of information.
The present invention relates to a monitoring system, a monitoring device, a monitoring method, and a program.
Background technology
[0002]
In recent years, surveillance cameras have been installed throughout the city and are being used for crime prevention. In Patent Document 1, security camera images are analyzed to detect an act of intrusion into a parking lot, etc., and an immediate warning and judgment image are displayed on a display device in a monitoring room where a security guard is present, or on a security guard's screen. , a video surveillance system that simultaneously transmits to cell phones and the like owned by related parties.
prior art documents
patent literature
[0003]
Patent Document 1: JP-A-2007-195130
SUMMARY OF THE INVENTION
Problems to be Solved by the Invention
[0004]
However, the above document does not disclose technology for detecting criminal acts committed against pedestrians and cars, such as kidnapping and car burglary.
[0005]
SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a technique for detecting a situation in which a criminal act against a pedestrian or a vehicle may occur. .
Means to solve problems
[0006]
Each aspect of the present invention employs the following configurations in order to solve the above-described problems.
[0007]
The first aspect concerns the monitoring system.
The monitoring system related to the first aspect is
Multiple cameras that capture images around the road,
Equipped with a monitoring device that monitors images captured by multiple cameras,
The monitoring device
a detection means that processes an image of the road surroundings and detects that the relative distance between a person and a vehicle included in the image is below a reference value;
and an output means for outputting the type of information to be output selected using the attribute of the person detected to be in the state.
[0008]
The second aspect relates to monitoring equipment.
The monitoring device related to the second aspect is
Detecting means for processing an image captured around a road and detecting that the relative distance between a person and a vehicle included in the image is below a reference value;
and an output means for outputting the type of information to be output selected using the attribute of the person detected to be in the state.
[0009]
A third aspect relates to a monitoring method executed by at least one computer.
The monitoring method related to the third aspect is
"The monitoring device
Processing the image taken around the road, detecting that the relative distance between the person and the vehicle included in the image is below the reference value,
outputting the type of information to be output selected using the attributes of the person detected to be in the state.
[0010]
As another aspect of the present invention, it may be a program that causes at least one computer to execute the method of the third aspect, or a computer-readable recording medium recording such a program. may This recording medium includes a non-transitory tangible medium.
This computer program includes computer program code which, when executed by a computer, causes the computer to implement the monitoring method on the monitoring device.
[0011]
It should be noted that any combination of the above constituent elements, and any conversion of the expression of the present invention between methods, devices, systems, recording media, computer programs, etc. are also effective as embodiments of the present invention.
[0012]
In addition, the various constituent elements of the present invention do not necessarily have to exist independently of each other. A component may be part of another component, a part of a component may overlap a part of another component, and the like.
[0013]
In addition, although a plurality of procedures are described in order in the method and computer program of the present invention, the order of description does not limit the order of execution of the plurality of procedures. Therefore, when implementing the method and computer program of the present invention, the order of the plurality of procedures can be changed within a range that does not interfere with the content.
[0014]
Furthermore, the multiple procedures of the method and computer program of the present invention are not limited to being executed at different timings. Therefore, the occurrence of another procedure during the execution of a certain procedure, or the overlap of some or all of the execution timing of one procedure with the execution timing of another procedure, and the like are acceptable.
The invention's effect
[0015]
According to each of the above aspects, it is possible to provide technology for detecting a situation in which a criminal act committed against a pedestrian may occur.
Brief description of the drawing
[0016]
1 is a diagram schematically showing an overview of a monitoring system according to an embodiment; FIG.
2 is a functional block diagram showing a logical configuration example of the monitoring device of FIG. 1; FIG.
3 is a block diagram illustrating the hardware configuration of a computer that implements the monitoring device and the image processing device of the monitoring system shown in FIG. 1;
4 is a flow chart showing an operation example of the monitoring device of the present embodiment; FIG.
5 is a functional block diagram showing a logical configuration example of a monitoring system; FIG.
6 is a flow chart showing an example of the operation of the monitoring system; FIG.
7 is a flow chart showing an example of the operation of the monitoring system; FIG.
8 is a functional block diagram showing a logical configuration example of a monitoring system; FIG.
9 is a flow chart showing an example of the operation of the monitoring system; FIG.
10 is a flow chart showing an example of the operation of the monitoring system; FIG.
11 is a functional block diagram showing a logical configuration example of a monitoring system; FIG.
12 is a flow chart showing an example of the operation of the monitoring device; FIG.
13 is a flow chart showing an example of the operation of the monitoring system; FIG.
14 is a flow chart showing an example of the operation of the monitoring system; FIG.
15 is a functional block diagram showing a logical configuration example of a monitoring system; FIG.
16 is a flow chart showing an example of the operation of the monitoring system; FIG.
17 is a flow chart showing an example of the operation of the monitoring system; FIG.
18 is a diagram for explaining the positional relationship between a car and a person in the case of kidnapping; FIG.
19 is a flow chart showing an example of the operation of the monitoring system; FIG.
20] A diagram for explaining the positional relationship between a car and a person in the case of car break-in. [FIG.
21 is a flow chart showing an example of the operation of the monitoring system; FIG.
MODE FOR CARRYING OUT THE INVENTION
[0017]
Embodiments of the present invention will be described below with reference to the drawings. In addition, in all the drawings, the same constituent elements are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.
[0018]
In the embodiment, "acquisition" means that the own device goes to get data or information stored in another device or storage medium (active acquisition), and that the device is output from another device Including at least one of entering data or information (passive acquisition). Examples of active acquisition include requesting or interrogating other devices and receiving their replies, and accessing and reading other devices or storage media. Also, examples of passive acquisition include receiving information that is distributed (or sent, pushed, etc.). Furthermore, "acquisition" may be selecting and acquiring received data or information, or selecting and receiving distributed data or information.
[0019]
(First embodiment)
FIG. 1 is a diagram schematically showing an overview of a monitoring system 1 according to an embodiment. In the monitoring system 1, an image processing device 200 processes an image captured by a monitoring camera 5 installed in the city, recognizes a vehicle 10 and a person 20, and uses the processing result of the image processing device 200 to generate a monitoring device. A system 100 detects criminal acts such as kidnapping and car break-ins.
[0020]
The monitoring system 1 includes a monitoring device 100, an image processing device 200, and at least one monitoring camera 5. The monitoring camera 5 may be one specialized for the monitoring system 1, or may be a previously installed camera, for example.
[0021]
The monitoring camera 5 takes a picture of the place to be monitored and generates an image. The monitoring camera 5 includes a lens and an imaging device such as a CCD (Charge Coupled Device) image sensor. The monitoring camera 5 may include a mechanism for controlling the orientation of the camera body and lens, zoom control, focusing, etc., following the movement of a person entering the angle of view.
[0022]
The surveillance camera 5 captures a range including at least a road through which the car 10 can pass. For example, the monitoring camera 5 captures an image of a range including roads wider than the vehicle 10 . In addition, the monitoring camera 5 may photograph a range including a sidewalk on which the person 20 passes and a roadway on which the car 10 passes. However, the monitoring camera 5 is not limited to the road, and may capture a place where the car 10 and the person 20 can enter, such as a parking lot. Note that the surveillance camera 5 may shoot the moving person 20 or may shoot the stationary person 20 . The surveillance camera 5 may shoot the moving car 10 or the stationary car 10 .
[0023]
Surveillance cameras 5 cover areas where crimes are likely to occur, such as areas shaded by structures such as shrubbery, fences, and buildings, areas with little traffic, and areas where crimes have occurred repeatedly in the past. You can take pictures.
[0024]
The images generated by the monitoring camera 5 are preferably transmitted to the monitoring device 100 in real time. However, the image transmitted to the monitoring device 100 does not have to be transmitted immediately from the monitoring camera 5, and may be an image delayed by a predetermined time. Images generated by the monitoring camera 5 may be temporarily stored in another storage device, and the monitoring device 100 may read the images from the storage device sequentially or at predetermined intervals. Further, the images transmitted to the monitoring device 100 are preferably moving images, but may be frame images at predetermined intervals or may be still images.
[0025]
The connection method between the monitoring camera 5 and the monitoring device 100 may be wireless or wired. In the case of wireless connection, it is assumed that the monitoring camera 5 and the monitoring device 100 each have a wireless communication function. The monitoring camera 5 may be, for example, a network camera such as an IP (Internet Protocol) camera.
[0026]
FIG. 2 is a functional block diagram showing a logical configuration example of the monitoring device 100 of FIG. The monitoring device 100 includes a detection section 102 and an output section 104 . The detection unit 102 detects that the relative distance between the person 20 and the vehicle 10 included in the image is equal to or less than a reference value (hereinafter also referred to as an approaching state). The output unit 104 outputs the type of information to be output selected using the attribute of the person 20 detected to be in the approaching state.
[0027]
A state in which the relative distance between the person 20 and the vehicle 10 is equal to or less than the reference value is a state in which the distance between the person 20 and the vehicle 10 is equal to or less than the reference value. The state in which the relative distance between the person 20 and the vehicle 10 is equal to or less than the reference value means that at least one of the person 20 and the vehicle 10 moves and the relative distance gradually decreases to the reference value or less. It may be in a state of approaching together. The detection unit 102 may detect a state in which the person 20 moves and approaches the car 10 , or may detect a state in which the car 10 moves and approaches the person 20 . The detection unit 102 may detect a state in which the person 20 and the car 10 are moving together and the car 10 is approaching the moving person 20 from behind. The detection unit 102 may detect a state in which the car 10 is approaching the moving person 20 from the front.
[0028]
For example, the image processing device 200 detects the positions of characteristic portions of each of the person 20 and the vehicle 10 specified in the images in a plurality of time-series images with respect to changes in the relative distance between the person 20 and the vehicle 10. , the direction of movement of the person 20 and the vehicle 10 and the relative distance between the person 20 and the vehicle 10 can be estimated from changes in the position and relative positional relationship between the person 20 and the vehicle 10 . Based on the processing result of the image processing device 200, the detection unit 102 detects a state in which the relative distance between the person 20 and the vehicle 10 included in the image is equal to or less than a reference value.
More about this source textSource text required for additional translation information
Send feedback
Side panels
History
Saved
Contribute
5,000 character limit. Use the arrows to translate more.To detect.
[0029]
The attributes of the person 20 are determined based on at least one of the attributes extracted from the image, such as gender, age, facial features, height, belongings, clothing, and circumstances.
[0030]
The type of information to be output is, for example, information related to the type of crime, such as fear of kidnapping or car break-in. The output destination and output method may differ according to the type of information to be output.
[0031]
Various output destinations are conceivable, but for example, it may be a monitor screen for monitoring of a display device in a monitoring center, a terminal (not shown) carried by a security guard or the like, or a police It may be a monitor screen for monitoring of a display device (not shown) of the station. The output method includes at least one of display on a monitor screen, transmission of e-mail, and output of voice or alarm sound from a speaker (not shown). At least one of the e-mail address to which the e-mail is to be sent, the IP address of the mobile terminal, and the mobile phone number may be registered in advance.
[0032]
The output content may be output together with information indicating the type of information in which the image of the monitoring camera 5 that is the notification target is selected. In the case of a monitoring center, the image of the monitoring camera 5 to be notified may be highlighted from the state in which the images of the plurality of monitoring cameras 5 are displayed in a multi-display manner. For example, from the multi-display, only the image of the monitoring camera 5 that is the notification target may be displayed on a single screen or enlarged. Alternatively, the frame of the corresponding screen in the multi-display may be emphasized, or the image to be emphasized may be superimposed.
[0033]
In addition to the images captured by the monitoring camera 5, still images captured by the monitoring camera 5, images indicating the type of output information (icon, animation, etc.), character information indicating the type of output information, and information reporting the occurrence of a crime are also included. may be displayed. Alternatively, an alarm sound corresponding to the type of output information or a voice indicating the type of output information may be output from the speaker of the monitoring center.
[0034]
FIG. 3 is a block diagram illustrating the hardware configuration of a computer 1000 that implements the monitoring device 100 and the image processing device 200 of the monitoring system 1 shown in FIG.
[0035]
Computer 1000 has bus 1010 , processor 1020 , memory 1030 , storage device 1040 , input/output interface 1050 and network interface 1060 .
[0036]
The bus 1010 is a data transmission path for the processor 1020, the memory 1030, the storage device 1040, the input/output interface 1050, and the network interface 1060 to exchange data with each other. However, the method of connecting processors 1020 and the like to each other is not limited to bus connection.
[0037]
The processor 1020 is a processor realized by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.
[0038]
The memory 1030 is a main memory implemented by a RAM (Random Access Memory) or the like.
[0039]
The storage device 1040 is an auxiliary storage device realized by a HDD (Hard Disk Drive), SSD (Solid State Drive), memory card, ROM (Read Only Memory), or the like. The storage device 1040 stores program modules that implement each function of the monitoring device 100 of the monitoring system 1 (for example, the detection unit 102, the output unit 104, etc.). Each function corresponding to the program module is realized by the processor 1020 reading each program module into the memory 1030 and executing it. The storage device 1040 also functions as a storage unit that stores various information used by the monitoring device 100 .
[0040]
The program module may be recorded on a recording medium. The recording medium for recording the program module includes a non-transitory tangible medium usable by the computer 1000, and the program code readable by the computer 1000 (processor 1020) may be embedded in the medium.
[0041]
The input/output interface 1050 is an interface for connecting the computer 1000 and various input/output devices.
[0042]
The network interface 1060 is an interface for connecting the computer 1000 to the communication network 3. This communication network 3 is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). A method for connecting the network interface 1060 to the communication network 3 may be a wireless connection or a wired connection. However, network interface 1060 may not be used.
[0043]
Then, the computer 1000 is connected to necessary devices (for example, the surveillance camera 5, display (not shown), speakers (not shown), etc.) via the input/output interface 1050 or the network interface 1060.
[0044]
The monitoring system 1 is implemented by a combination of the monitoring device 100 and the image processing device 200, and thus is implemented by a plurality of computers 1000 configuring each of them. The monitoring device 100 is, for example, a server computer. The image processing device 200 may be a device separate from the monitoring device 100, a device included inside the monitoring device 100, or a combination thereof.
[0045]
Each component of the monitoring device 100 of this embodiment in FIG. 2 is implemented by any combination of the hardware and software of the computer 1000 in FIG. It should be understood by those skilled in the art that there are various modifications to the implementation method and apparatus. The functional block diagram showing the monitoring apparatus 100 of each embodiment shows blocks in units of logical functions, not in units of hardware.
[0046]
FIG. 4 is a flowchart showing an operation example of the monitoring device 100 of this embodiment. The detection unit 102 detects that the relative distance between the person 20 and the vehicle 10 included in the image is equal to or less than a reference value based on the processing result of the image of the road surroundings (step S103), and the output unit 104 , the type of information selected by using the attributes of the person is output (step S107).
[0047]
According to this embodiment, the detection unit 102 detects the person 20 and the car 10 that are approaching each other, and the output unit 104 outputs information selected based on the attributes of the person 20 . As a result, it is possible to detect a situation in which a criminal act against a pedestrian or a vehicle, such as kidnapping or car break-in, may occur, using the image of the surveillance camera 5 capturing the surroundings of the road. can.
[0048]
(Second embodiment)
FIG. 5 is a functional block diagram showing a logical configuration example of the monitoring system of FIG. In the first embodiment, the image processing device 200 is provided separately from the monitoring device 100, but in the present embodiment, the monitoring device 100 also has the functions of the image processing device 200. FIG. Needless to say, the monitoring device 100 and the image processing device 200 may be different hardware or the same hardware.
[0049]
The monitoring system 1 includes a monitoring device 100, a storage device 300, and a monitoring camera 5.
The monitoring device 100 outputs information used for monitoring based on the image generated by the monitoring camera 5.
The storage device 300 stores data necessary for image processing. For example, it stores information about the feature amount for identifying the car 10 or the person 20 and information about the feature amount used for determining the attribute of the person.
The monitoring device 100 includes an acquisition unit 120 , an object identification unit 122 , a position identification unit 124 , an attribute identification unit 126 , a detection unit 102 , a selection unit 128 and an output unit 104 .
[0050]
The acquisition unit 120 acquires the image generated by the surveillance camera 5.
The object identifying unit 122 identifies an object by performing image processing on the image acquired by the acquiring unit 120 . The object identification unit 122 recognizes and identifies the person 20 and the car 10 .
The position specifying unit 124 specifies the positions of the person 20 and the car 10 specified by the object specifying unit 122 by image processing.
The attribute identifying unit 126 identifies attributes of the person 20 identified by the object identifying unit 122 by image processing. The attribute identification unit 126 identifies whether the person 20 has the first attribute or the second attribute.
[0051]
The first attribute is an attribute with a high probability of becoming a victim of crime. For example, the first attribute is "female", "male", "child (for example, estimated age is X years old or younger)", "old man (eg, estimated age is Y years old or older)", "girl (for example, women whose estimated age is X years old or younger, etc.),” “boys (e.g., men whose estimated age is X years old or younger, etc.),” “tourists (e.g., people with suitcases, etc.),” “single action (predetermined distance The first attribute is defined based on the features extracted from the image, such as gender, age, facial features, height, belongings, clothes, situation, etc. (However, X and Y are integers)
[0052]
A second attribute is an attribute that is different from the first attribute. The second attribute is an attribute that has characteristics of being a perpetrator of a criminal act, or an attribute other than a person having the first attribute, that is, an attribute other than an attribute that is highly likely to become a victim of a criminal act.
[0053]
For example, the second attribute is a person possessing a dangerous object (for example, possessing a long metal rod, etc.) or a person covering the face (for example, a person wearing a mask, etc.). There may be. Similarly to the first attribute, the second attribute is also determined based on the features extracted from the image, such as gender, age, facial features, height, belongings, clothing, and situation.
[0054]
It should be noted that it is possible to set according to the crime situation in the region, as long as the person who satisfies the first attribute has a high possibility of becoming a crime victim. For example, in areas where "men" are often victims of crime, the first attribute may be "male", and in areas where "women" are often victims of crime, the first attribute may be "male". The attribute may be "female".
[0055]
The detection unit 102 acquires the attributes of the person 20 identified by the object identification unit 122 and the positions of the person 20 and the car 10 .
The detection unit 102 determines based on the position of each pair of the person 20 and the car 10 included in the image whether or not the relative distance is below a reference value, that is, whether they are in an approaching state.
When the detection unit 102 detects the person 20 and the car 10 that are approaching each other, the selection unit 128 acquires the attributes of the person 20 that is approaching them. The selection unit 128 selects the type of information to be output using the detected attributes of the person 20 .
The output unit 104 outputs the type of information selected by the selection unit 128 .
[0056]
FIG. 6 is a flowchart showing an operation example of the monitoring system 1 of this embodiment.
The monitoring device 100 acquires the image captured by the monitoring camera 5 and performs image processing (step S101). Specifically, the object identifying unit 122 recognizes and identifies the person 20 and the vehicle 10 from the acquired image. The position specifying unit 124 then specifies the positions of the person 20 and the vehicle 10 specified by the object specifying unit 122 .
Next, the detection unit 102 detects that the relative distance between the person 20 and the car 10 included in the image is equal to or less than a reference value (step S103).
[0057]
If the relative distance between the person 20 and the car 10 included in the image is equal to or less than the reference value (YES in step S103), the attribute identification unit 126 identifies the attribute of the person 20 identified by the object identification unit 122 (step S104). The attribute identification unit 126 performs image processing on the person 20 included in the image and identifies whether the person has the first attribute or the second attribute.
However, the specific timing of the attribute of the person 20 is before the detecting unit 102 detects the approaching state of the person 20 and the car 10.
we claims
[Claim 1]
a detection means that processes an image of the road surroundings and detects that the relative distance between a person and a vehicle included in the image is below a reference value;
and output means for outputting the type of information to be output selected using the attribute of the person detected to be in the state.
[Claim 2]
In the monitoring device according to claim 1,
Acquisition means for acquiring the image captured around the road generated by a camera;
an object identifying means for recognizing and identifying a person and a vehicle by performing image processing on the image obtained by the obtaining means;
position specifying means for specifying the positions of the person and the vehicle specified by the object specifying means by performing the image processing;
an attribute specifying means for specifying an attribute of the person specified by the position specifying means by performing the image processing;
selection means for selecting the type of information to be output using the specified attribute for the detected person when the detection means detects a person and a vehicle in the state,
A monitoring device, wherein the output means outputs the type of information selected by the selection means.
[Claim 3]
In the monitoring device according to claim 1 or 2,
Acquisition means for acquiring the image captured around the road generated by a camera;
an object identifying means for recognizing and identifying a person and a vehicle by performing image processing on the image obtained by the obtaining means;
position specifying means for specifying the positions of the person and the vehicle specified by the object specifying means by performing the image processing;
moving speed estimating means for estimating the moving speed of the vehicle identified by the position identifying means from changes in the position of the vehicle;
selecting means for selecting the type of information to be output using the moving speed of the vehicle estimated by the moving speed estimating means,
A monitoring device, wherein the output means outputs the type of information selected by the selection means.
[Claim 4]
In the monitoring device according to any one of claims 1 to 3,
Acquisition means for acquiring the image captured around the road generated by a camera;
an object identifying means for recognizing and identifying a person and a vehicle by performing image processing on the image obtained by the obtaining means;
position specifying means for specifying the positions of the person and the vehicle specified by the object specifying means by performing the image processing;
a number-of-persons identification means for identifying the number of persons identified by the object identification means and determining whether the identified persons are acting alone;
a selection means for selecting the type of information to be output, selected according to the determination result of the number of people identification means,
A monitoring device, wherein the output means outputs the type of information selected by the selection means.
[Claim 5]
In the monitoring device according to claim 3 or claim 4 citing claim 3,
When the detecting means determines that the vehicle detected to be in the state is in a stationary state from the moving speed estimated by the moving speed estimating means, there is further a person entering or exiting the vehicle. and detect
The selection means selects the type of information to be output by further using the detection result of the entry and exit of the person by the detection means,
A monitoring device, wherein the output means outputs the type of information selected by the selection means.
[Claim 6]
In the monitoring device according to any one of claims 1 to 5,
The detection means is a monitoring device that performs the process using an image from a specific camera among a plurality of cameras that capture images of the road surroundings.
[Claim 7]
Multiple cameras that capture images around the road,
Equipped with a monitoring device that monitors images captured by multiple cameras,
The monitoring device
a detection means that processes an image of the road surroundings and detects that the relative distance between a person and a vehicle included in the image is below a reference value;
and output means for outputting the type of information to be output selected using the attributes of the person detected to be in the state.
[Claim 8]
In the monitoring system according to claim 7,
The monitoring device
Acquisition means for acquiring the image captured around the road generated by a camera;
an object identifying means for recognizing and identifying a person and a vehicle by performing image processing on the image obtained by the obtaining means;
position specifying means for specifying the positions of the person and the vehicle specified by the object specifying means by performing the image processing;
an attribute specifying means for specifying an attribute of the person specified by the position specifying means by performing the image processing;
selection means for selecting the type of information to be output using the specified attribute for the detected person when the detection means detects a person and a vehicle in the state,
A monitoring system, wherein the output means of the monitoring device outputs the type of information selected by the selection means.
[Claim 9]
In the monitoring system according to claim 7 or 8,
The monitoring device
Acquisition means for acquiring the image captured around the road generated by a camera;
an object identifying means for recognizing and identifying a person and a vehicle by performing image processing on the image obtained by the obtaining means;
position specifying means for specifying the positions of the person and the vehicle specified by the object specifying means by performing the image processing;
moving speed estimating means for estimating the moving speed of the vehicle identified by the position identifying means from changes in the position of the vehicle;
selecting means for selecting the type of information to be output using the moving speed of the vehicle estimated by the moving speed estimating means,
A monitoring system, wherein the output means of the monitoring device outputs the type of information selected by the selection means.
[Claim 10]
In the monitoring system according to any one of claims 7 to 9,
Capturing the image of the surroundings of the road generated by the camera
More about this source textSource text required for additional translation information
Send feedback
Side panels
History
Saved
Contribute
5,000 character limit. Use the arrows to translate more.an acquisition means to obtain;
an object identifying means for recognizing and identifying a person and a vehicle by performing image processing on the image obtained by the obtaining means;
position specifying means for specifying the positions of the person and the vehicle specified by the object specifying means by performing the image processing;
a number-of-persons identification means for identifying the number of persons identified by the object identification means and determining whether the identified persons are acting alone;
a selection means for selecting the type of information to be output, selected according to the determination result of the number of people identification means,
A monitoring system, wherein the output means of the monitoring device outputs the type of information selected by the selection means.
[Claim 11]
In the monitoring system according to claim 9 or claim 10 citing claim 9,
When the detecting means of the monitoring device determines that the vehicle detected as being in the state is in a stationary state from the moving speed estimated by the moving speed estimating means, detects whether there is an entry or exit of the
The selection means of the monitoring device selects the type of information to be output by further using the detection result of the entry and exit of the person by the detection means,
A monitoring system, wherein the output means of the monitoring device outputs the type of information selected by the selection means.
[Claim 12]
In the monitoring system according to any one of claims 7 to 10,
A monitoring system in which the detection means of the monitoring device performs the processing using an image from a specific camera among a plurality of cameras that capture images of the road.
[Claim 13]
"The monitoring device
Processing the image taken around the road, detecting that the relative distance between the person and the vehicle included in the image is below the reference value,
A monitoring method for outputting the type of information to be output selected using the attributes of the person detected to be in the state.
[Claim 14]
In the monitoring method according to claim 13,
"The monitoring device
Acquire the image of the road surroundings generated by the camera,
By performing image processing on the acquired images, people and vehicles are recognized and identified,
By performing the image processing for the specified person and the car, the position is specified,
By performing the image processing for the specified person, attributes are specified,
When detecting a person and a vehicle in the above state, for the detected person, using the specified attribute, select the type of information to be output,
A monitoring method that outputs the selected type of information.
[Claim 15]
In the monitoring method according to claim 13 or 14,
the monitoring device
Acquire the image of the road surroundings generated by the camera,
By performing image processing on the acquired images, people and vehicles are recognized and identified,
The position of the specified person and the car is specified by performing the image processing,
For the identified car, estimate the movement speed from the change in the position of the car,
Using the estimated moving speed of the car, select the type of information to be output,
A monitoring method that outputs the selected type of information.
[Claim 16]
In the monitoring method according to any one of claims 13 to 15,
the monitoring device
Acquire the image of the road surroundings generated by the camera,
By performing image processing on the acquired images, people and vehicles are recognized and identified,
The position of the specified person and the car is specified by performing the image processing,
Identify the number of people identified above, determine whether the identified person is acting alone,
Select the type of information to be output, selected according to the result of the determination,
A monitoring method that outputs the selected type of information.
[Claim 17]
In the monitoring method according to claim 15 and claim 16 citing claim 15,
the monitoring device
When it is determined that the vehicle detected as being in the above state is in a stationary state from the estimated moving speed, it is further detected whether there is a person entering or exiting the vehicle,
Furthermore, by using the result of detection of the entry and exit of the person, the type of information to be output is selected,
A monitoring method that outputs the selected type of information.
[Claim 18]
In the monitoring method according to any one of claims 13 to 17,
the monitoring device
A monitoring method in which the above process is performed using an image from a specific camera among a plurality of cameras that capture images of the road surroundings.
[Claim 19]
on the computer,
A procedure for processing an image captured around the road and detecting that the relative distance between a person and a vehicle included in the image is below a reference value,
A program for executing a procedure for outputting the type of information to be output selected using the attributes of the person detected to be in the state.
[Claim 20]
In the program according to claim 19,
A procedure for acquiring the image captured by the camera around the road,
A procedure for recognizing and identifying people and vehicles by performing image processing on the images acquired in the acquisition procedure,
A procedure for identifying the position of the person and the vehicle identified in the procedure for identifying the person and the vehicle by performing the image processing,
A procedure for identifying attributes by performing the image processing for the person identified in the position identifying procedure,
A procedure for selecting the type of information to be output using the specified attribute for the detected person when detecting a person and a vehicle in the above state in the detecting procedure,
A program for causing a computer to execute the procedure for outputting the type of information selected in the selecting procedure.
[Claim 21]
In the program according to claim 19 or 20,
A procedure for acquiring the image captured by the camera around the road,
A procedure for recognizing and identifying people and vehicles by performing image processing on the images acquired in the acquisition procedure,
A procedure for identifying the positions of the person and the vehicle identified in the procedure for identifying the person and the vehicle by performing the image processing,
A procedure for estimating the movement speed of the vehicle identified in the position identification procedure from changes in the position of the vehicle,
A procedure for selecting the type of information to be output using the moving speed of the vehicle estimated in the procedure for estimating the moving speed,
A program for causing a computer to execute the procedure for outputting the type of information selected in the selection procedure.
[Claim 22]
In the program according to any one of claims 19 to 21,
A procedure for acquiring the image captured by the camera around the road,
A procedure for recognizing and identifying people and vehicles by performing image processing on the images acquired in the acquisition procedure,
A procedure for identifying the positions of the person and the vehicle identified in the procedure for identifying the person and the vehicle by performing the image processing,
A procedure for identifying the number of people identified in the procedure for identifying the person and the vehicle, and determining whether the identified person is acting alone,
a procedure for selecting the type of information to be output, selected according to the result of the determination;
A program for causing a computer to execute the procedure for outputting the type of information selected in the selecting procedure.
[Claim 23]
In the program according to claim 21 or claim 22 citing claim 21,
When it is determined that the vehicle detected to be in the state is in a stationary state from the moving speed estimated in the moving speed estimation procedure, it is further detected whether a person enters or exits the vehicle. ,
Furthermore, by using the result of detection of the entry and exit of the person, the type of information to be output is selected,
A program for causing a computer to execute the procedure for outputting the selected type of information.
[Claim 24]
In the program according to any one of claims 19 to 23,
A program for causing a computer to execute the procedure for performing the above processing using the image of a specific camera among the plurality of cameras that capture images of the road surroundings.
| # | Name | Date |
|---|---|---|
| 1 | 202217041622.pdf | 2022-07-20 |
| 2 | 202217041622-TRANSLATIOIN OF PRIOIRTY DOCUMENTS ETC. [20-07-2022(online)].pdf | 2022-07-20 |
| 3 | 202217041622-STATEMENT OF UNDERTAKING (FORM 3) [20-07-2022(online)].pdf | 2022-07-20 |
| 4 | 202217041622-REQUEST FOR EXAMINATION (FORM-18) [20-07-2022(online)].pdf | 2022-07-20 |
| 5 | 202217041622-PRIORITY DOCUMENTS [20-07-2022(online)].pdf | 2022-07-20 |
| 6 | 202217041622-POWER OF AUTHORITY [20-07-2022(online)].pdf | 2022-07-20 |
| 7 | 202217041622-NOTIFICATION OF INT. APPLN. NO. & FILING DATE (PCT-RO-105-PCT Pamphlet) [20-07-2022(online)].pdf | 2022-07-20 |
| 8 | 202217041622-FORM 18 [20-07-2022(online)].pdf | 2022-07-20 |
| 9 | 202217041622-FORM 1 [20-07-2022(online)].pdf | 2022-07-20 |
| 10 | 202217041622-DRAWINGS [20-07-2022(online)].pdf | 2022-07-20 |
| 11 | 202217041622-DECLARATION OF INVENTORSHIP (FORM 5) [20-07-2022(online)].pdf | 2022-07-20 |
| 12 | 202217041622-COMPLETE SPECIFICATION [20-07-2022(online)].pdf | 2022-07-20 |
| 13 | 202217041622-CLAIMS UNDER RULE 1 (PROVISIO) OF RULE 20 [20-07-2022(online)].pdf | 2022-07-20 |
| 14 | 202217041622-MARKED COPIES OF AMENDEMENTS [03-10-2022(online)].pdf | 2022-10-03 |
| 15 | 202217041622-FORM 13 [03-10-2022(online)].pdf | 2022-10-03 |
| 16 | 202217041622-AMMENDED DOCUMENTS [03-10-2022(online)].pdf | 2022-10-03 |
| 17 | 202217041622-Proof of Right [28-12-2022(online)].pdf | 2022-12-28 |
| 18 | 202217041622-FORM 3 [28-12-2022(online)].pdf | 2022-12-28 |
| 19 | 202217041622-FER.pdf | 2023-04-19 |
| 20 | 202217041622-Others-080523.pdf | 2023-06-21 |
| 21 | 202217041622-Correspondence-080523.pdf | 2023-06-21 |
| 22 | 202217041622-OTHERS [29-09-2023(online)].pdf | 2023-09-29 |
| 23 | 202217041622-Information under section 8(2) [29-09-2023(online)].pdf | 2023-09-29 |
| 24 | 202217041622-FORM 3 [29-09-2023(online)].pdf | 2023-09-29 |
| 25 | 202217041622-FER_SER_REPLY [29-09-2023(online)].pdf | 2023-09-29 |
| 26 | 202217041622-COMPLETE SPECIFICATION [29-09-2023(online)].pdf | 2023-09-29 |
| 27 | 202217041622-CLAIMS [29-09-2023(online)].pdf | 2023-09-29 |
| 28 | 202217041622-ABSTRACT [29-09-2023(online)].pdf | 2023-09-29 |
| 29 | 202217041622-PatentCertificate31-10-2025.pdf | 2025-10-31 |
| 30 | 202217041622-IntimationOfGrant31-10-2025.pdf | 2025-10-31 |
| 1 | SS202217041622E_18-04-2023.pdf |