Title of Invention: Display System, Display Processing Device, Display Processing Method, and Program
Technical field
[0001]
The present invention relates to a display system, a display processing device, a display processing method, and a program.
Background technology
[0002]
In recent years, more and more surveillance cameras have been installed in towns, and there is a demand for methods to improve crime deterrence using security cameras.
[0003]
As a method of using surveillance cameras, Patent Document 1 describes an evacuation guidance support device that effectively utilizes image processing technology to monitor the entry of people into dangerous areas and determine evacuation routes. Further, Patent Literature 2 describes a technique for displaying disaster prevention information broadcasted by one-segment broadcasting on a large display installed in a city or the like.
prior art documents
patent literature
[0004]
Patent Document 1: JP-A-7-296068
Patent document 2: JP 2011-29754 A
SUMMARY OF THE INVENTION
Problems to be Solved by the Invention
[0005]
The above document describes technology for monitoring entry into a dangerous area when a disaster has already occurred, and for displaying captured images of the location where the disaster has occurred on a large display. As a result, it is possible to avoid approaching dangerous places where disasters have occurred, and to avoid dangerous places and evacuate.
[0006]
However, none of the above disclose technology to deter criminal acts.
[0007]
The present invention has been made in view of the above circumstances, and its purpose is to provide a technique for monitoring back alleys with little traffic and suppressing the occurrence of crimes.
Means to solve problems
[0008]
Each aspect of the present invention employs the following configurations in order to solve the above-described problems.
[0009]
The first aspect relates to the display system.
The display system related to the first aspect is
the display means installed on the first road,
and imaging means for imaging a second road narrower than the first road,
The display means acquires and displays the image generated by the imaging means or display data using the image.
[0010]
The second aspect relates to the display processing device.
The display processing device according to the second aspect is
It has display control means for obtaining an image generated by an imaging means for imaging a second road narrower than the first road on which the display is installed, or display data using the image, and for displaying it on the display.
[0011]
A third aspect relates to a display processing method executed by at least one computer.
The display processing method related to the third aspect is
The display processing device
Acquire an image generated by an imaging means that captures a second road narrower than the first road on which the display is installed, or display data using the image,
including displaying on the display.
[0012]
As another aspect of the present invention, it may be a program that causes at least one computer to execute the method of the third aspect, or a computer-readable recording medium recording such a program. may This recording medium includes a non-transitory tangible medium.
This computer program includes computer program code that, when executed by a computer, causes the computer to implement the display processing method on the display processing device.
[0013]
It should be noted that any combination of the above constituent elements, and any conversion of the expression of the present invention between methods, devices, systems, recording media, computer programs, etc. are also effective as embodiments of the present invention.
[0014]
In addition, the various constituent elements of the present invention do not necessarily have to exist independently of each other. A component may be part of another component, a part of a component may overlap a part of another component, and the like.
[0015]
In addition, although a plurality of procedures are described in order in the method and computer program of the present invention, the order of description does not limit the order of execution of the plurality of procedures. Therefore, when implementing the method and computer program of the present invention, the order of the plurality of procedures can be changed within a range that does not interfere with the content.
[0016]
Furthermore, the multiple procedures of the method and computer program of the present invention are not limited to being executed at different timings. Therefore, the occurrence of another procedure during the execution of a certain procedure, or the overlap of some or all of the execution timing of one procedure with the execution timing of another procedure, and the like are acceptable.
Effect of the invention
[0017]
According to each of the above aspects, it is possible to provide a technique for suppressing the occurrence of crimes by monitoring back alleys with little traffic.
Brief description of the drawing
[0018]
The above-mentioned objects, as well as other objects, features and advantages, will become further apparent from the preferred embodiments described below and the accompanying drawings below.
[0019]
1 is a diagram schematically showing an overview of a display system according to an embodiment; FIG.
2 is a diagram showing another example of a second road; FIG.
3 is a functional block diagram showing a logical configuration example of a display system; FIG.
4 is a block diagram exemplifying the hardware configuration of a computer that implements the imaging unit and the display unit of the display system shown in FIG. 1;
5 is a flow chart showing an operation example of the display system of the present embodiment; FIG.
6 is a diagram schematically showing a configuration example of a display system; FIG.
7 is a functional block diagram showing a logical configuration example of the display processing device of the present embodiment; FIG.
8 is a flowchart showing an operation example of the display system; FIG.
9 is a functional block diagram showing a logical configuration example of the display processing device of the present embodiment; FIG.
10 is a flowchart showing an operation example of the display system; FIG.
11 is a functional block diagram showing a logical configuration example of the display processing device of the present embodiment; FIG.
12 is a diagram schematically showing an arrangement example of displays and cameras installed on a second road to be monitored by the display system; FIG.
13 is a flowchart showing an operation example of the display system; FIG.
14 is a diagram showing an example of the data structure of camera information and image information; FIG.
15 is a diagram showing an example of a display screen of a display; FIG.
16 is a flow chart showing an operation example of the display system; FIG.
17 is a diagram showing a configuration example of a display system of another embodiment; FIG.
18 is a diagram showing a configuration example of a display system including an image processing device; FIG.
MODE FOR CARRYING OUT THE INVENTION
[0020]
Embodiments of the present invention will be described below with reference to the drawings. In addition, in all the drawings, the same constituent elements are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.
[0021]
In the embodiment, "acquisition" means that the own device goes to get data or information stored in another device or storage medium (active acquisition), and that the device is output from another device Including at least one of entering data or information (passive acquisition). Examples of active acquisition include requesting or interrogating other devices and receiving their replies, and accessing and reading other devices or storage media. Also, examples of passive acquisition include receiving information that is distributed (or sent, pushed, etc.). Furthermore, "acquisition" may be selecting and acquiring received data or information, or selecting and receiving distributed data or information.
[0022]
(First embodiment)

FIG. 1 is a diagram schematically showing an overview of the display system 1 according to the embodiment. In the figures below, roads are indicated by dashed lines. The display system 1 of the present embodiment captures an image of the second road R2 with the surveillance camera C1 in a place where there is a main street (first road R1) and an alley (second road R2) narrower than the first road R1. It is displayed on the display D1 installed on the road R1. The display system 1 displays a captured image of a back alley with few people on a display D1 installed in a busy main street, so that people who come and go on the main street can see the back alley. can be monitored naturally.
[0023]
FIG. 2 is a diagram showing another example of the second road R2. In the example of FIG. 2(a), the second road R2 crosses the first road R1. In the example of FIG. 2A, there is one camera C1, but in another example, a camera may also be installed on the second road R2 on the opposite side of the intersection with the first road R1. In the example of FIG. 2(b), the second road R2 is connected to the first road R1 via another third road R3.
[0024]
In other words, in the example of FIG. 2(a), the imaging unit 102 images the second road R2 intersecting the first road R1. In the example of FIG. 2B, the imaging unit 102 images the second road R2 connected to the first road R1 via the third road R3. As described above, the second road R2 on which the camera C1 is installed can take various forms, and is not limited to these examples.
[0025]

FIG. 3 is a functional block diagram showing a logical configuration example of the display system 1. As shown in FIG. The display system 1 includes an imaging section 102 and a display section 104 .
The imaging unit 102 images the second road R2, which is narrower than the first road R1.
The display unit 104 is installed on the first road R1 and acquires and displays an image generated by the imaging unit 102 or display data using the image.
[0026]
The imaging unit 102 is, for example, a surveillance camera C1. The camera C1 may be one specialized for the display system 1, or may be, for example, a surveillance camera installed on the second road R2 from before. The camera C1 includes a lens and an imaging device such as a CCD (Charge Coupled Device) image sensor.
[0027]
The camera C1 may be provided with a mechanism for controlling the orientation of the camera body and lens, zoom control, focusing, etc., following the movement of a person entering the angle of view. The camera C1 is installed with the lens facing at least in the direction of photographing the second road R2 from the entrance.
[0028]
The image generated by the camera C1 is preferably captured in real time and transmitted to the display D1. However, the image transmitted to the display D1 may not be transmitted directly from the camera C1, and may be an image delayed by a predetermined time. Images captured by the camera C1 may be temporarily stored in another storage device, and the display D1 may read them out from the storage device sequentially or at predetermined intervals. Further, the image to be transmitted to the display D1 is preferably a moving image, but may be a frame image at predetermined intervals, or may be a still image.
[0029]
The display unit 104 is, for example, a display D1 such as a liquid crystal display or an organic EL display. Alternatively, it may be a building or structure standing along the second road R2 using projection mapping technology, or a projection device that displays an image in space. The display D1 may be one specialized for the display system 1, or, for example, a display for displaying content such as advertisements and notification information that has been installed on the second road R2 may be used. good.
[0030]
The installation location of the display D1 is not particularly limited as long as it can be seen by people passing through the first road R1. For example, the display D1 may be installed on a post provided in the median strip of the first road R1 or in the median strip between the sidewalk and the first road R1. Alternatively, the display D1 may be mounted on the sidewalk side wall of a structure built along the first road R1 or in a shop window.
[0031]
The display D1 is arranged so that the screen is substantially parallel to the traffic direction of the first road R1 and the screen faces the sidewalk side, that is, the screen of the display D1 is viewed from a person walking along the first road R1. It is preferably installed so that it can be seen. In Figure 1, one turtle Although camera C1 and one display D1 are shown, multiple cameras and multiple displays may be provided.
[0032]
In this embodiment, the camera C1 and the display D1 are directly connected. An image captured by the camera C1 is directly displayed on the display D1. However, the camera C1 and the display D1 may be connected via a repeater (not shown). Alternatively, as will be described later in the embodiment, it may be connected via a network via a management device in the center.
[0033]
The connection method between the camera C1 and the display D1 may be wireless or wired. In the case of wireless connection, it is assumed that the camera C1 and the display D1 each have a wireless communication function. The camera C1 may be, for example, a network camera such as an IP (Internet Protocol) camera.
[0034]
Furthermore, the image displayed on the display D1 may be display data using an image generated by the camera C1. The display data is, for example, character information, symbols, images, and animations that indicate the situation in the captured image, or character information, symbols, images, and animations that indicate necessary measures based on the situation estimated from the captured image. There may be.
[0035]
The situation shown in the captured image includes, for example, a situation in which a crime has occurred, a pickpocket or snatch, an assault or fight, a terror attack, the direction in which a criminal escapes, an important person, a wanted person, The presence of missing persons, lost children, wanderers, vagrants, etc. For example, as shown in FIG. 18, the display processing device 100, which will be described later, can use the image processing device 120 to analyze an image generated by the imaging unit 102 (camera C1) and estimate the situation. The necessary measures based on the situation estimated from the captured image include notifying the police and security guards, requesting the dispatch of ambulances and fire engines, and providing evacuation guidance. The image processing device 120 may be included in the display processing device 100 of an embodiment described later, or may be a separate device from the display processing device 100 .
[0036]
Furthermore, the camera C1 may have a microphone (not shown) for inputting sound together with the image. The display D1 may have a speaker (not shown) that outputs audio. Audio input by the microphone of the camera C1 may be output from the speaker of the display D1. Furthermore, from the speaker of the display D1, audio information and warning sounds indicating the situation shown in the captured image, or audio information and warning sounds indicating necessary measures from the situation estimated from the captured image may be output. .
[0037]

FIG. 4 is a block diagram illustrating the hardware configuration of a computer 1000 that implements the imaging unit 102 and the display unit 104 of the display system 1 shown in FIG. 1, respectively. Furthermore, the computer 1000 also implements a display processing apparatus 100 to be described later.
[0038]
Computer 1000 has bus 1010 , processor 1020 , memory 1030 , storage device 1040 , input/output interface 1050 and network interface 1060 .
[0039]
The bus 1010 is a data transmission path for the processor 1020, the memory 1030, the storage device 1040, the input/output interface 1050, and the network interface 1060 to exchange data with each other. However, the method of connecting processors 1020 and the like to each other is not limited to bus connection.
[0040]
The processor 1020 is a processor realized by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.
[0041]
The memory 1030 is a main memory implemented by a RAM (Random Access Memory) or the like.
[0042]
The storage device 1040 is an auxiliary storage device realized by a HDD (Hard Disk Drive), SSD (Solid State Drive), memory card, ROM (Read Only Memory), or the like. The storage device 1040 is a program that realizes each function of the display system 1 (for example, the imaging unit 102, the display unit 104, the display control unit 106 of the display processing device 100 described later, the specifying unit 108, the estimating unit 112, the determining unit 114, etc.). remember the module. Each function corresponding to the program module is realized by the processor 1020 reading each program module into the memory 1030 and executing it. The storage device 1040 also functions as a storage unit that stores various information used by the display processing device 100 .
[0043]
The program module may be recorded on a recording medium. The recording medium for recording the program module includes a non-transitory tangible medium usable by the computer 1000, and the program code readable by the computer 1000 (processor 1020) may be embedded in the medium.
[0044]
The input/output interface 1050 is an interface for connecting the computer 1000 and various input/output devices.
[0045]
A network interface 1060 is an interface for connecting the computer 1000 to a communication network. This communication network is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). A method for connecting the network interface 1060 to the communication network may be a wireless connection or a wired connection. However, network interface 1060 may not be used.
[0046]
Then, the computer 1000 is connected to necessary devices (eg, camera C1, display D1, speaker, microphone, recording device, image processing device 120, etc.) via the input/output interface 1050 or network interface 1060.
[0047]

FIG. 5 is a flowchart showing an operation example of the display system 1 of this embodiment. First, the image capturing unit 102 uses the camera C1 to capture an image of the second road R2, which is narrower than the first road R1, and generates an image (step S101). Then, the display unit 104 acquires and displays an image or display data using the image (step S103).
[0048]
According to this embodiment, the imaging unit 102 captures the second road R2 narrower than the first road R1 to generate an image, and the display unit 104 acquires and displays the image or display data using the image. , the situation of the second road R2 can be shown to the person on the first road R1. That is, by displaying an image of a back alley with few pedestrians on the display D1 installed on the main street, the person on the main street can see the image of the back alley. you can get
[0049]
By displaying the image of the back alley on the main street, it has the effect of deterring crime in the back alley. In addition, even if a crime occurs, it can be detected immediately, and it becomes possible to deal with it promptly and appropriately. Furthermore, if the image can be recorded, it can be used later as a clue or evidence to confirm or verify the situation of the crime, or to identify the criminal.
[0050]
(Second embodiment)
The display system 1 of this embodiment is the same as the above embodiment except that it has a configuration for controlling the timing of displaying the captured image on the display D1.
[0051]

FIG. 6 is a diagram schematically showing a configuration example of the display system 1. As shown in FIG. The display system 1 includes a display processing device 100 . FIG. 7 is a functional block diagram showing a logical configuration example of the display processing device 100 of this embodiment. As described above, the display processing device 100 is realized by the computer 1000. FIG.
[0052]
The imaging unit 102 includes a first camera C11 installed at the entrance of the second road R2 and a second camera C12 installed in the middle of the second road R2. Then, the display control unit 106 processes the image of the first camera C11, and causes the display unit 104 to display the image of the second camera C12 when it detects that a person has entered the second road R2.
[0053]
In the first embodiment, the imaging unit 102 was the camera C1, and the display unit 104 was the display D1. Therefore, the image of the imaging unit 102 (camera C1) is directly displayed on the display unit 104 (display D1). That is, the imaging unit 102 (camera C1) and the display unit 104 (display D1) actively perform imaging of the second road R2, transmission/reception of the captured image, and display of the image.
[0054]
In this embodiment, the imaging unit 102 may have a function of causing at least one camera C1 to capture an image of the second road R2 and a function of acquiring the captured image from the camera C1. The display control unit 106 acquires an image captured by the camera C1 from the image capturing unit 102 and displays it on the display unit 104 (display D1). In other words, the camera C1 may be controlled by the imaging unit 102 and the display D1 may be controlled by the display control unit 106 to operate passively.
[0055]
The second camera C12 is installed in the middle of the second road R2 and images the second road R2. The first camera C11 always photographs the entrance of the second road R2. The image of the first camera C11 may not be displayed on the display D1. The image of the first camera C11 is used at least for detecting the entry of a person onto the second road R2. When there is no person on the second road R2, the second camera C12 may stop photographing or may photograph the second road R2.
[0056]
The imaging range of the first camera C11 is the entrance of the second road R2. An image captured by the first camera C11 is transmitted to the image processing device 120 in FIG. 18, for example. The image processing device 120 detects a person present in the image, identifies the movement direction of the detected person with respect to the second road R2, and detects the entry of the person into the second road R2.
[0057]
In this embodiment, the image of the second camera C12 is not displayed on the display D1 until the presence of a person is detected on the second road R2. Contents such as other images such as advertisements and notification information may be displayed on the display D1.
[0058]
The display control unit 106 starts shooting if the second camera C12 has stopped shooting when it is detected that a person has entered the second road R2. Then, the display control unit 106 displays the image of the second camera C12 on the display D1.
[0059]

FIG. 8 is a flowchart showing an operation example of the display system 1. FIG. This figure includes the same steps S101 and S103 as the flowchart of FIG. 5, and further includes steps S111 to S117 before step S101. However, in step S103 of FIG. 5, the display unit 104 (the display D1 installed on the first road R1) mainly displays the image. This figure differs in that an image is displayed on the display D1 installed on the first road R1 by the display control unit 106 .
[0060]
First, the imaging unit 102 causes the first camera C11 to capture an image of the second road R2 to generate an image (step S111). The imaging of the second road R2 by the first camera C11 may be performed all the time, or may be performed at least for a predetermined period of time. Further, the display control unit 106 causes the display D1 to display a predetermined image (step S113). The predetermined image is not particularly limited, but includes images other than the captured image of the second road R2, and may be, for example, various contents such as advertisement video and notification information. However, the screen of the display D1 may be turned off without displaying a predetermined image on the display D1.
[0061]
Then, the display control unit 106 acquires the image of the first camera C11, causes the image processing device 120 of FIG. 18 to process the image, and uses the processing result to determine whether or not a person has entered the second road R2 (step S115). . Then, the display control unit 106 detects the entry of a person onto the second road R2.(YES in step S117), the process proceeds to step S101.
[0062]
Then, the imaging unit 102 causes the second camera C12 to capture an image of the second road R2 to generate an image (step S101). Then, the display control unit 106 acquires the image of the second camera C12 and causes the display D1 to display the image or display data using the image (step S103). On the other hand, if the entry of a person onto the second road R2 is not detected (NO in step S117), the process returns to step S111, where the second road R2 is photographed by the first camera C11 and a predetermined image is displayed on the display D1 in step S113. Display continues.
[0063]
Furthermore, the timing of stopping the display of the image of the second road R2 by the second camera C12 on the display D1 is not particularly limited, but is exemplified below. A plurality of the following conditions (a1) to (a4) may be combined.
(a1) When the exit of a person who has entered from the second road R2 is detected by processing the captured image of the first camera C11
(a2) When the image captured by the second camera C12 is processed and the presence of a person on the second road R2 is no longer detected
(a3) After a predetermined time has passed since the second camera C12 started shooting
(a4) When the preset stop time has passed
[0064]
After stopping the display of the image of the second road R2 by the second camera C12 on the display D1, the display control unit 106 causes the display D1 to display a predetermined image. However, the screen of the display D1 may be turned off without displaying the predetermined image on the display D1.
[0065]
According to this embodiment, by processing the image of the first camera C11 provided at the entrance of the second road R2, it is detected that a person has entered the second road R2. Sometimes the image captured by the second camera C12 can be displayed on the display D1. As a result, the captured image of the second road R2 is displayed on the display D1 when a person enters the second road R2. can be displayed. Therefore, the captured image of the second road R2 can be displayed on the display D1 installed in the city on which contents such as advertisements are displayed only when monitoring is necessary.
[0066]
(Third embodiment)

FIG. 9 is a functional block diagram showing a logical configuration example of the display processing device 100 of this embodiment. The display system 1 of the present embodiment is the same as the above embodiment except for the conditions for displaying the image of the second camera C12 on the display D1.
[0067]
The display processing device 100 further includes a specifying unit 108 in addition to the configuration of the display processing device 100 in FIG. The specifying unit 108 processes the image of the first camera C11 and specifies the attribute of the person. Then, the display control unit 106 displays the image of the second camera C12 on the display D1 when the attribute satisfies the criteria.
[0068]
The attributes of a person specified by the specifying unit 108 are, for example, gender and age group. Criteria are, for example, gender as female and total age as child (for example, under 10 years old).
Alternatively, the feature amount of a specific person may be registered in advance, and the specific person may be detected from the captured image using the image processing device 120 of FIG. Specific persons may include, for example, any of fugitive, pursued, and wanted persons, and persons of interest, such as dignitaries, and the like.
[0069]

FIG. 10 is a flowchart showing an operation example of the display system 1. FIG. This figure includes the same step S101 as the flowchart of FIG. 5, the same steps S103, S111 and S113 as the flowchart of FIG. 8, and further includes steps S121 and S123 between steps S113 and S101.
[0070]
First, the imaging unit 102 causes the first camera C11 to capture an image of the second road R2 to generate an image (step S111). The display control unit 106 causes the display D1 to display a predetermined image (step S113). Then, the identification unit 108 acquires the image of the first camera C11, causes the image processing device 120 in FIG. 18 to process the image, and identifies the attribute of the person in the image using the processing result (step S121). Then, the display control unit 106 determines whether the attribute satisfies a predetermined criterion, for example, whether it is female or child (step S123). If the criteria are met (YES in step S123), the process proceeds to step S101.
[0071]
Then, the imaging unit 102 causes the second camera C12 to capture an image of the second road R2 to generate an image (step S101). Then, the display control unit 106 acquires the image of the second camera C12 and causes the display D1 to display the image or display data using the image (step S103). On the other hand, if the attribute does not satisfy the predetermined criteria (NO in step S123), the process returns to step S111, where the second road R2 is photographed by the first camera C11 and a predetermined image is displayed on the display D1 in step S113. Display continues.
[0072]
The timing of stopping the display of the image of the second road R2 by the second camera C12 on the display D1 is the same as in the above embodiment. After stopping the display of the image of the second road R2 by the second camera C12 on the display D1, the display control unit 106 causes the display D1 to display a predetermined image. However, the screen of the display D1 may be turned off without displaying the predetermined image on the display D1.
[0073]
According to this embodiment, when the attributes of a person who has entered the second road R2 meet the criteria, the camera image can be displayed on the display. can be displayed on the main street, and people on the main street can be watched. It can be expected that the degree of attention to the image will be increased by displaying it in a specific case, compared to the case of displaying it all the time.
[0074]
(Fourth embodiment)
FIG. 11 is a functional block diagram showing a logical configuration example of the display processing device 100 of this embodiment. FIG. 12 is a diagram schematically showing an arrangement example of the display D1 and the camera C1 installed on the second road R2 to be monitored by the display system 1. As shown in FIG. The display processing device 100 of this embodiment is the same as the display processing device 100 of the above embodiment shown in FIG. 7 except that it displays a plurality of captured images of the second road R2 on one display D1. The display processing device 100 of this embodiment has a configuration similar to that of the display processing device 100 of the above-described embodiment shown in FIG. However, the estimating unit 112 and the determining unit 114 of this embodiment can also be combined with the configuration of the display processing device 100 of other embodiments other than the embodiment of FIG. 7 within a range that is consistent.
[0075]
As shown in FIG. 12, one display unit 104 (display D1) is associated with a plurality of second roads, in this example, the second road R21 and the second road R22. The imaging unit 102 includes a plurality of cameras respectively installed at the entrance and exit of the second road R2. C41 and camera C42.
[0076]
Like the display system 1 in FIG. 6, in this embodiment also, each doorway is provided with a first camera for detecting the entry of a person and a second camera for capturing an image of a second road. and These two cameras are shown as one set in FIG. 12 with one reference numeral. For example, the camera C31 includes a first camera C11 and a second camera C12.
[0077]

The estimation unit 112 estimates the number of people staying on each second road by processing images from a plurality of cameras. The determining unit 114 uses the estimated number of people to determine which road image to display on the display D1.
[0078]
The display D1 displays images from at least one camera. The screen of the display D1 may be divided to display images from a plurality of cameras. The display D1 may switch and sequentially display images from a plurality of cameras at predetermined time intervals.
[0079]
As described above, the image used by the estimation unit 112 to estimate the number of people is the captured image of the first camera C11 installed at each position. The image displayed on the display D1 uses the captured image of the second camera C12 installed at each position.
[0080]

FIG. 13 is a flowchart showing an operation example of the display system 1. FIG. This figure includes the same step S103 as the flowchart of FIG. 8, and further includes steps S131 to S135 before step S103.
[0081]
First, the imaging unit 102 acquires images from the cameras C31, C32, C41, and C42 at the entrances and exits of the second roads R21 and R22 in association with each road (step S131). Here, captured images of the first camera C11 installed at each position are acquired.
[0082]
FIG. 14 is a diagram showing an example of the data structure of camera information and image information. 14A shows camera information 130, and FIG. 14B shows image information 132. FIG. These pieces of information are stored in storage device 1040 of computer 1000 .
[0083]
Identification information is predetermined for each of the plurality of second roads. In the camera information 130, the road identification information of the second road is associated with the identification information of the camera installed on the second road and the installation position information. The installation position information may simply be information indicating whether it is the entrance or exit of the second road, or may be information indicating an absolute position such as longitude and latitude. Alternatively, it may be information indicating an address, a name of an installation location such as a building name, a facility name, an intersection name, etc., or, if installed on a utility pole, identification information assigned to the utility pole. may be
[0084]
In the image information 132, image data captured by each camera is associated with the image capturing date and time and camera identification information. As for the image captured by each camera, the identification information for identifying each camera may be, for example, an IP (Internet Protocol) address assigned to each camera. The image information 132 may hold, as image data, a file name including a path indicating the location where the image data file is temporarily or non-temporarily stored, or at least the file name. The entity of the image data file may be stored in a predetermined storage location. Date and time information may be omitted if the image data itself holds the date and time information.
[0085]
Returning to FIG. 13, the estimation unit 112 acquires images of the first cameras C11 installed at a plurality of positions, causes the image processing device 120 in FIG. The number of people who are doing this is estimated (step S133). Specifically, the image processing device 120 is caused to recognize an image of a person passing through the entrance of the second road. The simplest method is to detect the entry and exit of a person at each doorway, increment the number counter when an intruder is detected, and decrement the number counter when an exiter is detected. Alternatively, the number of visitors and the number of visitors may be counted for each entrance/exit of the second road, and the difference may be calculated to be the number of people staying on the second road.
[0086]
In another method, first, a person entering the second road is image-recognized by the image processing device 120, and the person's feature amount is registered in the visitor list as a visitor. At this time, the number counter may be incremented. Then, the image processing device 120 is made to recognize the image of the person who left the second road, and it is determined whether or not the feature amount is registered as a visitor. delete from At this time, the number counter may be decremented. Alternatively, the number of people may be obtained by counting the number of persons registered in the visitor list.
[0087]
If the exiting person is not included in the entry list, nothing will be done. Alternatively, as an unknown person entering, the feature amount, the date and time of leaving, the identification information of the imaging camera, etc. may be recorded.
[0088]
Then, the determination unit 114 uses the number of people estimated in step S133 to determine which road image to display on the display D1 (step S135). Then, the display control unit 106 displays the limited image on the display D1 (step S103).
[0089]
Various image display methods are conceivable, and are not limited to the following examples.
(b1) The screen of the display D1 is divided into a plurality of areas, and images captured by a plurality of cameras or display data are displayed in respective areas.
(b2) Captured images or display data from a plurality of cameras are sequentially displayed on the entire screen of the display D1, each divided area of ​​the screen, and at least a partial area of ​​the screen of the display D1 for a predetermined period of time.
(b3) When a specific condition is met, display the captured image or display data that satisfies the condition as a pop-up screen on at least a partial area of ​​the screen of the display D1.
(b4) The display time of each image or display data is fixed or changed according to conditions.
(b5) The images displayed on each screen or area are selected and displayed according to the conditions by selecting and switching between images captured by the camera or display data and other images such as advertisements and notification information.
(b6) When a specific condition is satisfied, an image captured by a specific camera or display data is emphasized and displayed.
(b7) Giving priority to the cameras and displaying them in descending order of priority or extending the display time.
(b8) Randomly display images captured by a plurality of cameras.
[0090]
Various methods are conceivable for determining the priority of images to be displayed, and examples are given below, but are not limited to these.
(c1) If the number of people staying on the second road is larger than the predetermined number, the priority is lowered.
(c2) If the number of people staying on the second road is one, lower the priority.
(c3) If the number of people staying on the second road is within the standard range (for example, 2 to 3 people), raise the priority.
[0091]
The priority may be indicated, for example, in a ratio of 0 to 1. The priority indicates the degree of priority for displaying the captured image of the camera on the display D1. In other words, the image captured by the camera shows that the crime rate is increasing. Here, the higher the numerical value of the priority, the higher the priority, that is, the higher the crime rate. However, the priority may be 0 to 100, or may be indicated by a predetermined level such as low, medium, high, or 1 to 5.
[0092]
Images captured by cameras having a priority level equal to or higher than a threshold may be preferentially displayed, displayed in order of priority, or displayed for a longer time as the priority is higher. An image captured by a camera having a priority lower than the threshold may not be displayed.
[0093]
FIG. 15 is a diagram showing an example of the display screen of the display D1. FIG. 15A shows an example in which the screen 150 is divided into four areas, and images captured by four cameras are displayed in each area. Information 152 indicating the shooting location of the image may be displayed in each area together with the captured image.
[0094]
FIG. 15(b) displays an image of the camera whose priority exceeds the threshold in a partial area 160 of the screen 150 of the display D1, and displays an image other than the captured image of the camera in the other area 154, such as an advertisement. shows an example in which a content image of is displayed. The area 160 may further display character information, an image 162, or the like indicating a message calling attention. Alternatively, the frame of the area 160 may be emphasized or blinked, or an animation may be superimposed to display a more alert call.
[0095]
According to this embodiment, images captured by a plurality of cameras can be selected according to the priority of the cameras and displayed on the display D1. can be displayed preferentially on the display D1. Therefore, more effective suppression of crime can be expected.
[0096]
Although the embodiments of the present invention have been described above with reference to the drawings, these are examples of the present invention, and various configurations other than those described above can be adopted.
For example, the condition for displaying the image generated by the imaging unit 102 on the display D1 may be a specific time, the ambient brightness being equal to or less than a reference value, and the like. The display control unit 106 displays the image captured by the imaging unit 102 on the display D1 when a predetermined condition is satisfied.
[0097]
The display processing device 100 may further include a time acquisition unit (not shown) that acquires the current time. The time acquisition unit may acquire the current time from a clock (not shown) of the computer 1000 or from an NTP (Network Time Protocol) server via a communication network.
[0098]
The time to display may be set in advance. Also, the time to be displayed may be changed by the administrator's operation. For example, the time from evening to dawn may be set. A time period when the second road R2 is less crowded, a time period when the second road R2 is more crowded but security is bad, etc. may be specified. Moreover, the display on the display D1 may be stopped during the time when the first road R1 is less crowded. In other words, the display unit 104 displays the image during a time period other than the time period when the traffic on the first road R1 is low.
[0099]
The ambient brightness can be estimated by processing the image generated by the imaging unit 102 . When the estimated ambient brightness is dark, that is, when it is below the standard, the image of the imaging unit 102 is displayed on the display D1. Alternatively, the ambient brightness may be acquired from information measured by the camera C1 during shooting.
[0100]
An example in which these conditions are combined with the above embodiment will be described. FIG. 16 is a flowchart showing an operation example of the display system 1. FIG. The flowchart of FIG. 16 includes steps S111, S113, and S103 of the flowchart of FIG. 8, and further includes steps S141 to S145.
[0101]
First, the imaging unit 102 causes the first camera C11 to capture an image of the second road R2 to generate an image (step S111). The display control unit 106 causes the display D1 to display a predetermined image (step S113). Then, the display control unit 106 determines whether or not the display timing is reached for each camera (step S141). This determination condition is, for example, when the attributes of a person entering the second road R2 meet a standard (female or child, etc.), when a specific time comes, when the surrounding brightness falls below a standard, is at least one of
[0102]
Then, when it is the display timing (YES in step S141) and when there are a plurality of cameras at the display timing (YES in step S143), the display control unit 106 selects the camera with the highest priority. (step S145), and displayed on the display D1 (step S103).
[0103]
If it is not at the display timing (NO in step S141), the process returns to step S111. If there is only one camera at the display timing (NO in step S143), the display control unit 106 bypasses step S145 and causes the image captured by the camera to be displayed on the display D1 (step S103).
[0104]
In the above embodiment, the configuration in which the camera and display are directly connected has been described. In other embodiments, the cameras and displays may be connected via a management device 200, such as a surveillance center. FIG. 17 is a diagram showing a configuration example of the display system 1 of another embodiment. The display system 1 includes a plurality of cameras C1, a display D1, and a management device 200. The management device 200 is connected to a plurality of cameras C1 and displays D1 via a communication network 3 such as the Internet. The display processing device 100 described in the above embodiments may be included in the management device 200 .
[0105]
FIG. 18 is a diagram showing a configuration example of the display system 1 including the image processing device 120. As shown in FIG. In this example, the display system 1 includes a display D1, at least one camera C1, a display processing device 100, and an image processing device 120. Each device is connected to each other via a communication network 3 .
[0106]
According to this configuration, the image processing device 120 performs image processing on an image captured by the camera C1 to detect the entry of a person onto the second road R2, specify the attributes of the person who has entered, and It is possible to obtain feature values.
[0107]
In the above embodiment, the display system 1 has a configuration including one display D1, but is not limited to this and may include a plurality of displays.
[0108]
For example, when the occurrence of a crime is detected, the direction of movement of the person to be tracked is specified, and the image of the camera capturing the person is displayed on the display in the direction of movement. A method of detecting the occurrence of a crime can be detected by image processing by the image processing device 120 . Alternatively, a predetermined alarm system may be interlocked to obtain information on the location where the crime occurred, and the camera and display may be identified from the location information.
[0109]
In this example, the display control unit 106 preferably causes the display to display an image captured by a camera that captures the location of the crime and the location of the person to be tracked.
[0110]
Although the present invention has been described with reference to the embodiments and examples, the present invention is not limited to the above embodiments and examples. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.
In addition, when acquiring and using information about users in the present invention, this shall be done lawfully.
[0111]
Some or all of the above embodiments can also be described as the following additional remarks, but are not limited to the following.
1. the display means installed on the first road,
and imaging means for imaging a second road that is narrower than the first road,
A display system in which the display means acquires and displays an image generated by the imaging means or display data using the image.
2. 1. In the display system described in
A display system in which the imaging means captures an image of the second road that intersects with the first road.
3. 1. or 2. In the display system described in
The display system, wherein the imaging means captures an image of the second road connected to the first road via a third road.
4. 1. to 3. In the display system according to any one of
The imaging means
　　The first camera installed at the entrance of the second road,
including a second camera installed in the middle of the second road,
A display system further comprising display control means for processing an image of the first camera and displaying an image of the second camera on the display means when an intrusion of a person on the second road is detected.
5. 4. In the display system described in
further comprising identification means for processing the image of the first camera and identifying a person's attributes,
A display system, wherein the display control means causes the display means to display the image of the second camera when the attribute satisfies the criteria.
6. 1. to 5. In the display system according to any one of
A display system in which the display control means causes the display means to display the image at a specific time.
7. 1. to 6. In the display system according to any one of
A display system in which the display control means causes the display means to display the image when the ambient brightness is below a standard.
8. 1. to 7. In the display system according to any one of
A plurality of said second roads are linked to one said display means,
　The imaging means is the entrance of the second road and Including multiple cameras each installed at the exit,
an estimation means for estimating the number of people staying on each of the second roads by processing the images of the plurality of cameras;
a determination means for determining which road image to display on the display means using the estimated number of people.
[0112]
9. A display process comprising display control means for obtaining an image generated by an imaging means for imaging a second road narrower than the first road on which the display is installed, or display data using the image, and for displaying the display on the display. Device.
10. 9. In the display processing device according to
A display processing device, wherein the imaging means captures an image of the second road that intersects with the first road.
11. 9. or 10. In the display processing device according to
The display processing device, wherein the imaging means captures an image of the second road connected to the first road via a third road.
12. 9. to 11. In the display processing device according to any one of
The imaging means
　　The first camera installed at the entrance of the second road,
including a second camera installed in the middle of the second road,
　The display control means
A display processing device that processes the image of the first camera and further displays the image of the second camera on the display means when an intrusion of a person on the second road is detected.
13. 12. In the display processing device according to
further comprising identification means for processing the image of the first camera and identifying a person's attributes,
A display processing device, wherein the display control means causes the display means to display the image of the second camera when the attribute satisfies the criteria.
14. 9. to 13. In the display processing device according to any one of
A display processing device in which the display control means causes the display means to display the image at a specific time.
15. 9. to 14. In the display processing device according to any one of
A display processing device in which the display control means causes the display means to display the image when the ambient brightness is below a reference level.
16. 9. to 15. In the display processing device according to any one of
A plurality of said second roads are linked to one said display means,
The imaging means includes a plurality of cameras installed at the entrance and exit of the second road,
an estimation means for estimating the number of people staying on each of the second roads by processing the images of the plurality of cameras;
and determining means for determining which road image to display on the display means using the estimated number of people.
[0113]
17. The display processing device
Acquire an image generated by an imaging means that captures a second road narrower than the first road on which the display is installed, or display data using the image,
A display processing method to be displayed on the display.
18. 17. In the display processing method described in
The display processing method, wherein the imaging means captures an image of the second road intersecting the first road.
19. 17. or 18. In the display processing method described in
The display processing method, wherein the imaging means images the second road connected to the first road via a third road.
20. 17. to 19. In the display processing method according to any one of
The imaging means
　　The first camera installed at the entrance of the second road,
including a second camera installed in the middle of the second road,
　The display processing device
A display processing method for processing the image of the first camera, and further displaying the image of the second camera on the display means when an intrusion of a person on the second road is detected.
21. 20. In the display processing method described in
　The display processing device
　Process the image of the first camera, identify the attributes of the person,
A display processing method for displaying the image of the second camera on the display means when the attribute satisfies the criteria.
22. 17. to 21. In the display processing method according to any one of
　The display processing device
A display processing method for displaying the image on the display means at a specific time.
23. 17. to 22. In the display processing method according to any one of
　The display processing device
A display processing method for displaying the image on the display means when the ambient brightness is below a standard.
24. 17. to 23. In the display processing method according to any one of
A plurality of said second roads are linked to one said display means,
The imaging means includes a plurality of cameras installed at the entrance and exit of the second road,
　The display processing device
　By processing the images of the plurality of cameras, estimate the number of people staying on each of the second roads,
A display processing method for determining which road image to display on the display means using the estimated number of people.
[0114]
25. on the computer,
A procedure for acquiring an image generated by an image capturing means that captures an image of a second road narrower than the first road on which the display is installed, or display data using the image,
A program for executing the procedure for displaying on the display.
26. 25. In the program described in
A program for causing a computer to execute a procedure for causing the imaging means to image the second road intersecting the first road.
27. 25. or 26. In the program described in
A program for causing a computer to execute a procedure for causing the imaging means to capture an image of the second road connected to the first road via a third road.
28. 25. to 27. In the program according to any one of
The imaging means
　　The first camera installed at the entrance of the second road,
including a second camera installed in the middle of the second road,
A program for causing a computer to execute a procedure for processing the image of the first camera and displaying the image of the second camera on the display means when an intrusion of a person on the second road is detected.
29. 28. In the program described in
A procedure for processing the image of the first camera and identifying a person's attribute,
A program for causing a computer to execute a procedure for displaying the image of the second camera on the display means when the attribute satisfies the criteria.
30. 25. to 29. In the program according to any one of
A program for causing a computer to execute a procedure for displaying the image on the display means at a specific time.
31. 25. to 30. In the program according to any one of
A program for causing a computer to execute a procedure for displaying the image on the display means when the ambient brightness is below a standard.
32. 25. to 31. in the program described in any one of
A plurality of said second roads are linked to one said display means,
The imaging means includes a plurality of cameras installed at the entrance and exit of the second road,
a procedure for estimating the number of people staying on each of the second roads by processing the images of the plurality of cameras;
A program for causing a computer to execute a procedure for determining which road image to display on the display means using the estimated number of people.
The scope of the claims
[Claim 1]
the display means installed on the first road,
and imaging means for imaging a second road that is narrower than the first road,
A display system in which the display means acquires and displays an image generated by the imaging means or display data using the image.
[Claim 2]
In the display system according to claim 1,
A display system in which the imaging means captures an image of the second road that intersects with the first road.
[Claim 3]
In the display system according to claim 1 or 2,
The display system, wherein the imaging means captures an image of the second road connected to the first road via a third road.
[Claim 4]
In the display system according to any one of claims 1 to 3,
The imaging means
　　The first camera installed at the entrance of the second road,
including a second camera installed in the middle of the second road,
A display system further comprising display control means for processing an image of the first camera and displaying an image of the second camera on the display means when an intrusion of a person on the second road is detected.
[Claim 5]
In the display system according to claim 4,
further comprising identification means for processing the image of the first camera and identifying a person's attributes,
A display system, wherein the display control means causes the display means to display the image of the second camera when the attribute satisfies the criteria.
[Claim 6]
In the display system according to any one of claims 1 to 5,
A display system in which the display control means causes the display means to display the image at a specific time.
[Claim 7]
In the display system according to any one of claims 1 to 6,
A display system in which the display control means causes the display means to display the image when the ambient brightness is below a standard.
[Claim 8]
In the display system according to any one of claims 1 to 7,
A plurality of said second roads are linked to one said display means,
The imaging means includes a plurality of cameras installed at the entrance and exit of the second road,
an estimation means for estimating the number of people staying on each of the second roads by processing the images of the plurality of cameras;
a determination means for determining which road image to display on the display means using the estimated number of people.
[Claim 9]
A display process comprising display control means for obtaining an image generated by an imaging means for imaging a second road narrower than the first road on which the display is installed, or display data using the image, and for displaying the display on the display. Device.
[Claim 10]
In the display processing device according to claim 9,
A display processing device, wherein the imaging means captures an image of the second road that intersects with the first road.
[Claim 11]
In the display processing device according to claim 9 or 10,
The display processing device, wherein the imaging means captures an image of the second road connected to the first road via a third road.
[Claim 12]
In the display processing device according to any one of claims 9 to 11,
The imaging means
　　The first camera installed at the entrance of the second road,
including a second camera installed in the middle of the second road,
　The display control means
A display processing device that processes the image of the first camera and further displays the image of the second camera on the display means when an intrusion of a person on the second road is detected.
[Claim 13]
In the display processing device according to claim 12,
further comprising identification means for processing the image of the first camera and identifying a person's attributes,
A display processing device, wherein the display control means causes the display means to display the image of the second camera when the attribute satisfies the criteria.
[Claim 14]
In the display processing device according to any one of claims 9 to 13,
A display processing device in which the display control means causes the display means to display the image at a specific time.
[Claim 15]
In the display processing device according to any one of claims 9 to 14,
A display processing device in which the display control means causes the display means to display the image when the ambient brightness is below a reference level.
[Claim 16]
In the display processing device according to any one of claims 9 to 15,
A plurality of said second roads are linked to one said display means,
The imaging means includes a plurality of cameras installed at the entrance and exit of the second road,
an estimation means for estimating the number of people staying on each of the second roads by processing the images of the plurality of cameras;
　Using the estimated number of people, a decision procedure for deciding which road image to display on the display means A display processing device, comprising: a stage;
[Claim 17]
The display processing device
Acquire an image generated by an imaging means that captures a second road narrower than the first road on which the display is installed, or display data using the image,
A display processing method to be displayed on the display.
[Claim 18]
In the display processing method according to claim 17,
The display processing method, wherein the imaging means captures an image of the second road intersecting the first road.
[Claim 19]
In the display processing method according to claim 17 or 18,
The display processing method, wherein the imaging means images the second road connected to the first road via a third road.
[Claim 20]
　In the display processing method according to any one of claims 17 to 19,
The imaging means
　　The first camera installed at the entrance of the second road,
including a second camera installed in the middle of the second road,
　The display processing device
A display processing method for processing the image of the first camera, and further displaying the image of the second camera on the display means when an intrusion of a person on the second road is detected.
[Claim 21]
In the display processing method according to claim 20,
　The display processing device
　Process the image of the first camera, identify the attributes of the person,
A display processing method for displaying the image of the second camera on the display means when the attribute satisfies the criteria.
[Claim 22]
　In the display processing method according to any one of claims 17 to 21,
　The display processing device
A display processing method for displaying the image on the display means at a specific time.
[Claim 23]
　In the display processing method according to any one of claims 17 to 22,
　The display processing device
A display processing method for displaying the image on the display means when the ambient brightness is below a standard.
[Claim 24]
　In the display processing method according to any one of claims 17 to 23,
A plurality of said second roads are linked to one said display means,
The imaging means includes a plurality of cameras installed at the entrance and exit of the second road,
　The display processing device
　By processing the images of the plurality of cameras, estimate the number of people staying on each of the second roads,
A display processing method for determining which road image to display on the display means using the estimated number of people.
[Claim 25]
on the computer,
A procedure for acquiring an image generated by an image capturing means that captures an image of a second road narrower than the first road on which the display is installed, or display data using the image,
A program for executing the procedure for displaying on the display.
[Claim 26]
In the program according to claim 25,
A program for causing a computer to execute a procedure for causing the imaging means to image the second road intersecting the first road.
[Claim 27]
In the program according to claim 25 or 26,
A program for causing a computer to execute a procedure for causing the imaging means to capture an image of the second road connected to the first road via a third road.
[Claim 28]
　In the program according to any one of claims 25 to 27,
The imaging means
　　The first camera installed at the entrance of the second road,
including a second camera installed in the middle of the second road,
A program for causing a computer to execute a procedure for processing the image of the first camera and displaying the image of the second camera on the display means when an intrusion of a person on the second road is detected.
[Claim 29]
In the program according to claim 28,
A procedure for processing the image of the first camera and identifying a person's attribute,
A program for causing a computer to execute a procedure for displaying the image of the second camera on the display means when the attribute satisfies the criteria.
[Claim 30]
　In the program according to any one of claims 25 to 29,
A program for causing a computer to execute a procedure for displaying the image on the display means at a specific time.
[Claim 31]
　In the program according to any one of claims 25 to 30,
A program for causing a computer to execute a procedure for displaying the image on the display means when the ambient brightness is below a standard.
[Claim 32]
　In the program according to any one of claims 25 to 31,
A plurality of said second roads are linked to one said display means,
The imaging means includes a plurality of cameras installed at the entrance and exit of the second road,
a procedure for estimating the number of people staying on each of the second roads by processing the images of the plurality of cameras;
A program for causing a computer to execute a procedure for determining which road image to display on the display means using the estimated number of people.