Abstract: An occupant number sensing system (1) is configured to include: an image acquisition unit (110) for acquiring an image of a second vehicle present around a first vehicle, from an imaging device mounted on the first vehicle; and a count unit (120) for counting the number of occupants in the second vehicle using the image acquired by the image acquisition unit (110).
The present invention relates to a technique for grasping the number of occupants of the vehicle.
BACKGROUND
[0002]
There is a need that you want to know the number of occupants of the vehicle. For example, in Europe, HOV such (High-Occupancy Vehicle) lane and HOT (High-Occupancy Toll) lanes, a private lane number occupant is preferential is more than a predetermined number of the vehicle, the vehicle traveling such lanes there is a need that you want to know the number of occupants.
[0003]
The contrast needs, for example, a technique as described in Patent Document. The following Patent Document 1 and Patent Document 2, it acquires an image including a vehicle as an object by installing the imaging device to the side of the road, by analyzing the image, a technique for detecting the number of occupants of the vehicle is disclosed there.
CITATION
Patent Document
[0004]
Patent Document 1: WO 2014/064898 Patent
Patent Document 2: International Publication No. WO 2014/061195
Summary of the Invention
Problems that the Invention is to Solve
[0005]
In conventional systems, in order to detect the number of occupants of a vehicle traveling on the road, it is used fixedly installed imaging device to a specific location. In this case, the range capable of detecting the number of occupants of the vehicle is limited to the imaging range of the fixedly installed imaging device. Therefore, for the vehicles traveling while avoiding the place where such an imaging apparatus is installed, there is a problem that can not be detected number of occupants.
[0006]
The present invention has been made in view of the above problems. One object of the present invention, the number of occupants of vehicles traveling on the road, is to provide a technique that enables detection to anywhere.
Means for Solving the Problems
[0007]
According to the present invention,
the imaging device mounted on the first vehicle, and the image acquiring means for acquiring an image of the second vehicle is present around the first vehicle,
the image acquired by the image acquisition unit with, and counting means for counting the number of occupants of the second vehicle
occupant speed detection system with is provided.
[0008]
According to the present invention,
the computer,
from the imaging device mounted on the first vehicle, acquires an image of the second vehicle is present around the first vehicle,
using the image acquired, the second counting the number of occupants of a vehicle,
comprising, passenger number detecting method is provided.
[0009]
According to the present invention,
a program for executing the passenger number detecting method described above to the computer it is provided.
The invention's effect
[0010]
According to the present invention, the number of occupants of vehicles traveling on the road, it is possible to detect the anywhere.
BRIEF DESCRIPTION OF THE DRAWINGS
[0011]
Above objects, and other objects, features and advantages, preferred embodiments described below, and become more apparent from the following drawings associated therewith.
[0012]
FIG. 1 is a block diagram conceptually showing the functional configuration of the passenger number detecting system of the first embodiment.
2 is a diagram conceptually showing the system configuration of the passenger number detecting system.
3 is a diagram showing an installation example of the first imaging device and the second imaging device.
4 is a block diagram conceptually showing the hardware configuration of the information processing apparatus.
5 is a flowchart illustrating a flow of processing in the passenger number detecting system of the first embodiment.
6 is a block diagram showing an example of a configuration that allows obtaining the individual identification information of the second vehicle V2.
Is a diagram illustrating an installation example of FIG. 7 other imaging devices.
Is a diagram illustrating an example of a screen for outputting the processing result of FIG. 8 counting unit.
[9] Count portion of the vehicle is a diagram illustrating the operation of selecting the processed image.
FIG. 10 is a block diagram conceptually showing the functional configuration of the passenger number detecting system of the third embodiment.
11 is a diagram showing an example of a configuration for storing setting information of the imaging device.
12 is a block diagram conceptually showing the functional configuration of the passenger number detecting system of the fourth embodiment.
13 is a block diagram conceptually showing the functional configuration of the passenger number detecting system of the fifth embodiment.
14 is a block diagram conceptually showing the functional configuration of the passenger number detecting system according to the sixth embodiment.
15 is a flowchart illustrating a flow of processing in the passenger number detecting system according to the sixth embodiment.
DESCRIPTION OF THE INVENTION
[0013]
Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings, like numerals represent like components, the explanation will be appropriately omitted. Further, unless otherwise particularly stated, in each block diagram, each block is not a configuration of the hardware units, representing an arrangement of functional units.
[0014]
[First Embodiment]
[Functional Configuration]
FIG. 1 is a block diagram conceptually showing the functional configuration of the passenger number detecting system 1 of the first embodiment. As shown in FIG. 1, the passenger number detecting system 1 includes an image acquisition unit 110 and the count unit 120.
[0015]
Image acquisition unit 110, for example, a vehicle for patrol administrator steering (hereinafter referred to as "first vehicle", not shown) from an imaging device mounted on (not shown), around the first vehicle other vehicles existing (vehicle first vehicle travels a road which runs run in parallel or opposed to the first vehicle. hereinafter, "second vehicle" with notation. not shown) to acquire an image of. Counting unit 120 uses an image obtained by the image obtaining unit 110 counts the number of occupants in the second vehicle. Counting unit 120 is, for example, by utilizing the technique disclosed in Patent Document 1 or Patent Document 2, on the basis of the image including the second vehicle as a subject, it is possible to count the number of occupants of the second vehicle .
[0016]
Above, in this embodiment, the imaging device for capturing images to be used in processing of counting the number of passengers are provided in the first vehicle. According to this configuration, the first vehicle to move, also moves the imaging range of the imaging device. Thus, if the first vehicle that can travel places, it is possible to detect the number of occupants of the second vehicle regardless of its location. Further, if the conventional place must be installed imaging device fixed to the plurality of monitoring points, according to the passenger number detecting system 1 of the present embodiment, at least two or more imaging devices mounted on the first vehicle it is also possible to cover the monitoring point. Therefore, the introduction cost of the system required when the area of the same size as the monitoring target, the effect of reducing as compared with the conventional can be expected.
[0017]
Hereinafter, a first embodiment will be described in more detail.
[0018]
[Hardware Configuration]
functional components of the occupant number detecting system 1, the hardware for realizing each functional configuration unit: may be realized by (eg hard such as a wired electronic circuitry), hardware and software combination of: may be implemented in (example combinations such as electronic circuits and programs for controlling it). Hereinafter, the case where the functional structure of the occupant number detecting system 1 is realized by a combination of hardware and software will be further described.
[0019]
Figure 2 is a diagram conceptually showing the system configuration of the passenger number detecting system 1. As shown in FIG. 2, the passenger number detecting system 1, the information processing apparatus 20, the image pickup apparatus 30 configured vehicle detection sensor 40, and includes a light projector 50. Further, the information processing apparatus 20, a display device 22 for displaying the number of occupants of the count result by the counter unit 120 are connected.
[0020]
Imaging device 30 is mounted on the first vehicle V1, it is connected to the information processing apparatus 20 via the network. Although not shown, a plurality of imaging devices 30 may be mounted on the first vehicle V1. For example, the first and the imaging device used when the second vehicle V2 is parallel extended vehicle (when the first vehicle V1 and the second vehicle V2 is traveling in the same direction), the second vehicle V2 is oncoming vehicle If it is a second imaging device for use in (a first vehicle V1 second vehicle V2 is when the vehicle is traveling in the opposite direction), it may be mounted on the first vehicle V1. The first imaging apparatus, the second vehicle occupant characteristic portion of the face of the V2 (eyes, nose, mouth, etc.) so that it can shoot, for example, obliquely rearward or first vehicle running parallel to the first vehicle V1 It is installed transversely to the V1. In the case of oncoming vehicles to become shorter the time required for passing than the parallel running vehicle, the second imaging device is installed, for example, obliquely forward (diagonally forward left if right-hand traffic).
[0021]
As described above, the image pickup device 30 is oblique (running parallel imaging device 30 for a vehicle diagonally rearward, the imaging device 30 for the opposite vehicle diagonally forward) may be placed toward the. By installing toward the imaging device 30 obliquely extending in parallel with the first vehicle V1, or second vehicle V2 traveling in opposition are taken at different angles depending on the positional relationship between the first vehicle V1 . Further, by installing toward the imaging device 30 obliquely forward or backward, run parallel to the first vehicle V1, or may be taken the second vehicle V2 traveling facing obliquely from the front. Thus, less occupant of overlap in the image, it is possible to have multiple occupants face obtaining an image caught on better.
[0022]
An installation example of the first imaging device and the second imaging device will be described with reference to FIG. 3, reference numeral 30A denotes a first imaging device, reference numeral 30B denotes a second imaging device. Incidentally, FIG. 3 illustrates the case of right-hand traffic.
[0023]
In the example of FIG. 3, the first image pickup apparatus 30A is installed toward the right obliquely rearward of the first vehicle V1. First imaging device 30A, in order to photograph the parallel running vehicle are oriented in the same direction from the front, the traveling direction d of the first vehicle V1 V1 and directed to the opposite direction (the vehicle rear portion) installed It is. Although not shown, it may be a plurality of the first imaging device 30A is provided. For example, the first image pickup device 30A and another first imaging placed left or toward the left diagonally behind the first vehicle V1 disposed toward the right or right obliquely rearward of the first vehicle V1 device 30A may be provided in the first vehicle V1. In this case, the first imaging device 30A disposed toward the right or right obliquely rearward of the first vehicle V1 is used to shoot the vehicle running parallel to the right lane of the first vehicle V1. Another of the first imaging device 30A disposed toward the left or left obliquely rearward of the first vehicle V1 is used to shoot the vehicle running parallel to the left lane of the first vehicle V1 . The four first imaging device 30A toward the left and right obliquely rearward and lateral direction may be provided.
[0024]
In the example of FIG. 3, the second imaging device 30B is installed toward the diagonally forward left with respect to the first vehicle V1. Second imaging device 30B, in order to photograph the oncoming vehicle approaching facing from the front, the traveling direction d of the first vehicle V1 V1 is installed is directed to the (vehicle In other words, the photographing direction of the second imaging device 30B, than the shooting direction of the first imaging device 30A, is directed in the traveling direction dV1 side of the first vehicle. In the areas where left-hand traffic is employed, since the oncoming vehicle is present on the right side, the second imaging device 30B is disposed toward the right oblique front.
[0025]
In the case where the second vehicle V2 is when the oncoming vehicle is running parallel vehicle, the relative speed between the first vehicle V1 varies greatly. Therefore, for the setting of the image pickup device 30 when performing shooting, coming preferably set value is changed. By providing the second imaging device, respectively used when shooting a first image pickup device and the oncoming vehicle to be used for photographing a parallel running vehicle, regardless of the traveling direction of the second vehicle V2, the count processing it is possible to take the available image. In this case, the image acquisition unit 110 acquires a first image generated by the first imaging device, and a second image generated from the second imaging device, as different second vehicle V2 image to. The counting unit 120 includes a process of counting using a first image of the passenger number of the second vehicle V2 are run in parallel, the number of occupants of the second vehicle V2 which is traveling opposite second image can each be independently executed a process of counting, the using.
[0026]
Vehicle detection sensor 40 is used as a sensor for detecting a second vehicle V2 present around the first vehicle V1. Vehicle detection sensor 40, for example, a millimeter-wave radar, LIDAR (Light Detection and Ranging), sonar and the like, used as a distance measuring means for measuring the distance from the first vehicle V1 to a second vehicle V2 (and direction) can do. Imaging device 30 was measured by the vehicle detection sensor 40, based on the distance from the first vehicle V1 to a second vehicle V2, it is possible to measure the timing of taking the image of the second vehicle V2. The vehicle detection sensor 40 may be provided separately from the imaging device 30 may be incorporated in the imaging device 30.
[0027]
Projector 50 is provided to clearly photograph the person in the vehicle. Incidentally, the projector 50 may be provided separately from the imaging device 30 may be incorporated in the imaging device 30. Projector 50, in conjunction with the imaging timing of the imaging device 30 is irradiated with light (e.g., near infrared, etc.) to the second vehicle V2 is subject.
[0028]
Figure 4 is a block diagram conceptually showing the hardware configuration of the information processing apparatus 20. The information processing apparatus 20 is configured bus 201, processor 202, memory 203, storage device 204, input and output interface 205, and includes a network interface 206.
[0029]
Bus 201, a processor 202, memory 203, storage device 204, input and output interface 205 and the network interface 206, is a data transmission path for transmitting and receiving data with each other. However, processor 202, memory 203, storage device 204, how to connect input and output interface 205, and the network interface 206 and the like each other is not limited to the bus connection.
[0030]
Processor 202 is an arithmetic unit such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). Memory 203, RAM (Random Access Memory) or a ROM (Read Only Memory) which is a main storage device which is implemented by using a. The storage device 204, HDD (Hard Disk Drive), SSD (Solid State Drive), an auxiliary storage device which is implemented by using a memory card.
[0031]
The storage device 204, a program module for realizing the image acquisition unit 110 and the count unit 120, and stores a program module for realizing the function of acquiring the image generated by the imaging device 30. Processor 202 by executing these program modules is read into the memory 203, to implement the function corresponding to each program module.
[0032]
Output interface 205 is an interface for connecting the information processing apparatus 20 and the peripheral device. For example, or an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube) device for display output such as a display (display device 22), the device for input such as a keyboard or a mouse, or the touch panel to which they are integrated, It may be connected to the information processing apparatus 20 via the input and output interface 205.
[0033]
Network interface 206 is an interface for connecting the information processing apparatus 20 to various networks such as LAN (Local Area Network) or WAN (Wide Area Network). As shown in FIG. 4, the information processing apparatus 20 is connected to the network via the network interface 206 can communicate with other terminals that do not imaging device 30 and shown. For example, the information processing apparatus 20 can communicate with the imaging device 30 via the network interface 206, and acquires the image generated by the imaging device 30. Further, the information processing apparatus 20 by communicating with the first vehicle V1 via the network interface 206, as measured by the vehicle detection sensor 40, obtaining a distance from the first vehicle V1 to a second vehicle V2 It can also be. The method for the information processing apparatus 20 is connected to various networks may be a wireless connection, or may be a wired connection.
[0034]
Note that the configuration of FIG. 2 and FIG. 4 is only an example, the hardware configuration of the present invention is not limited to the example of FIG. 2 and FIG. For example, it integrated and the information processing apparatus 20 and the imaging device 30 may be mounted on the first vehicle V1. Further, for example, the information processing apparatus 20 may be mounted on the first vehicle V1 with the imaging device 30. In this case, the image acquiring unit 110 and the count unit 120 will be provided in the first vehicle. In this case, the number of occupants of the count result of the second vehicle V2 by counting section 120, for example, may be transmitted, such as the administrator terminal connected via the network interface 206 (not shown). Besides, the number of occupants of the count result of the second vehicle V2 by counting section 120 is, for example, the output devices connected to the first vehicle (such as a car navigation device or a mobile terminal, both not shown) through an output it may be.
[0035]
Operational Example
with reference to FIG. 5, illustrating the flow of processing in the passenger number detecting system 1 of the first embodiment. Figure 5 is a flowchart illustrating a flow of processing in the passenger number detecting system 1 of the first embodiment.
[0036]
First, the image pickup apparatus 30 mounted on the first vehicle V1, the image of the second vehicle V2 present around the first vehicle V1 is generated (S102). Imaging device 30 is, for example, as follows, to generate an image of the second vehicle. First, the imaging apparatus 30, as information indicating the distance from the first vehicle V1 to a second vehicle V2, to obtain the output signal of the vehicle detection sensor 40. The imaging device 30 compares the previously stored threshold in a memory or the like of the distance and the example imaging device 30 indicated by the output signal of the vehicle detection sensor 40, a distance indicated by the output signal of the vehicle detection sensor 40 is the threshold imaging the second vehicle V2 at the timing became less. Besides, in place of the vehicle detection sensor 40, a switch for remotely controlling the photographing operation is provided in the first vehicle V1, the imaging apparatus 30, the occupant of the first vehicle V1 has pressed the switch depending on, it may be configured to start the photographing operation.
[0037]
The second vehicle V2 of images generated by the imaging device 30 via the network interface 206, is acquired by the image acquisition unit 110 (S104). Image acquisition unit 110 transfers the image of the second vehicle V2 obtained from the imaging device 30 to the count unit 120. The counting unit 120 uses the image of the second vehicle V2 obtained by the image obtaining unit 110 counts the number of occupants of the second vehicle V2 (S106). Counting unit 120, for example, can be extracted from the acquired image region estimated as a person (e.g. a face area of a person) to impart different label to each (information identifying each region), is the grant and the number of labels can be calculated as the number of passengers of the second vehicle V2. The count unit 120 is, for example, template matching, or that using techniques such as SVM (Support Vector Machine) and CNN (Convolutional Neural Network) such as machine learning (or deep learning), to estimate the area of a person it can.
[0038]
The number of passengers counted in the process of S106 is in order to grasp whether the information about which vehicle, for example, as shown in FIG. 6, attached cord obtains information identifying the individual of the second vehicle V2 configuration There may be provided further.
[0039]
Figure 6 is a block diagram showing an example of a configuration that allows obtaining the individual identification information of the second vehicle V2. In Figure 6, separately from the imaging device 30 for generating an image to be used to count the number of occupants of the second vehicle V2, the other for generating an image to be used to obtain the individual identification information of the second vehicle V2 imaging device 32 is mounted on the first vehicle V1. The individual identification information of the second vehicle, such as characters and symbols are described in the license plate N of the vehicle are available. Other imaging device 32, the position and orientation to allow imaging the number plate N of the vehicle are adjusted, it is mounted on the first vehicle V1. Specifically, the license plate, at the front or rear of each vehicle, because it is attached to the lower region than the imaging range of the imaging device 30 (area where the occupant objects appear in the second vehicle), other imaging device 32 It is placed on the lower side facing the front also behind the first vehicle V1. Since there are countries which do not impose an obligation to attach the number plate to the vehicle front, as illustrated in Figure 6, if the other imaging device 32 is provided only on the front side of the first vehicle, the opposite it may not be able to image the license plate of the vehicle. Therefore, in order to photograph an image including a license plate of the opposed vehicle, toward the rear obliquely downward side of the first vehicle V1 (if regions adopting the right-hand traffic, lower left side of the first vehicle V1) hirsutism one imaging device 32 may be installed (e.g. Figure 7).
[0040]
Figure 7 is a diagram showing an example of installation of other imaging devices. In Figure 7, in addition to the imaging device 30, and other imaging apparatus 32A for capturing the license plate of the vehicle running parallel to the first vehicle V1, the license plate of vehicles traveling in opposition to the first vehicle V1 shooting and other imaging devices 32B to the examples that are installed in the first vehicle V1 is shown. Hereinafter, when no particular distinction other imaging devices 32A and other imaging devices 32B, simply denoted both other imaging device 32. Photographing direction and photographing timing of the other imaging device 32 is different from the imaging device 30. For example, other imaging devices 32A for running parallel vehicle is different from the image pickup device 30A, and is disposed toward the right oblique front. When the first vehicle V1 photographs the occupant of the second vehicle V2 when overtaking a second vehicle V2, other imaging devices 32A for running parallel vehicle, before imaging by the imaging device 30A is performed (second vehicle V2 somewhat closer before), the photographing license plates attached to the rear of the second vehicle V2. Another imaging device 32B for the oncoming vehicle, for example, unlike the imaging device 30B, are disposed toward the left oblique rear. Other imaging apparatus 32B for an oncoming vehicle, after photographing by the image pickup device 30B is performed (after I passed the second vehicle V2), to photograph the license plates attached to the rear of the second vehicle V2. Other imaging device 32 may be configured to perform automatic photographing according to the distance indicated by the output signal of the vehicle detection sensor 40, depending on the pressing operation of the switch that is mounted on the first vehicle it may be configured to perform the shooting Te.
[0041]
In the areas such as the obligation to wear a license plate in front of the vehicle is imposed, acquiring the imaging device 30, an image for counting the number of occupants of the second vehicle V2, the individual identification information such as license plate it is also possible to generate an image for. For example, in the example of FIG. 6, the license plate N because it is also attached to the front of the vehicle, using the imaging device 30, it is possible to generate an image number plate objects appear. In this case, it may not be another imaging device 32 of FIG. 5.
[0042]
In the example of FIG. 6, the count unit 120, a passenger counting unit 122 that executes the counting process of the number of passengers, the individual identification information: and a individual identification information acquisition unit 124 for acquiring (example number plate of string) They are out. Image acquiring section 110, as each acquiring the image generated by the imaging device 30 and the other imaging device 32, an image generated by the imaging device 30 to the passenger counting unit 122, generated by another imaging apparatus 32 respectively transfers the image to the identification information acquisition unit 124.
[0043]
Passenger number counting unit 122, as described above, to extract an area which is estimated to person from the images generated by the imaging device 30, based on the number of regions, the number of occupants of the second vehicle V2 it can be calculated. Furthermore, identification information acquisition unit 124, for example, template matching can SVM, by using a CNN, extracts an area of the license plate from the image generated by another imaging apparatus 32. The individual identification information acquisition unit 124, for example OCR (Optical character recognition) technology further using, it is possible to acquire a character string written in the license plate N of the second vehicle V2 as text data.
[0044]
Counting unit 120 has counted the passenger counting unit 122, and the number of occupants of the second vehicle V2, acquired by the individual identification information acquisition unit 124, the individual identification information of the second vehicle V2 (e.g. license plate characters column) and attached to output string a (S108). For example, the count unit 120 may display a screen as shown in FIG. 8 on the display device 22 connected to the information processing apparatus 20.
[0045]
Figure 8 is a diagram illustrating an example of a screen for outputting the processing result of the count unit 120. In Figure 8, the number of vehicle license plate, a screen for displaying the number of occupants of counted vehicle count unit 120 is illustrated.
[0046]
Here, the count unit 120 is a lane at HOV lane and HOT lane with the vehicle is traveling, if the number of occupants of the vehicle is less than a prescribed number, the number of occupants information of the vehicle, the number of occupants it may include certain additional information indicating that but is less than the specified number. Counting unit 120 is, for example, information about specified number previously stored in the memory 203, the image by comparing the number of occupants of a vehicle count based on, whether or not the number of passengers of the vehicle is defined persons or it is possible to determine. Then, the information processing apparatus 20, for example, by applying a predetermined mark M as shown in FIG. 8 according to the presence or absence of additional information, information about the vehicle speed occupant is less than the specified is distinguished from information relating to other vehicles Display it may be configured to. Besides, the information processing device 20, by changing the characters and background colors in accordance with the presence or absence of additional information, that the number of passenger information about the vehicle is lower than the specified, be displayed differently from information about other vehicles it can. According to such a screen, the administrator of the presence of a vehicle traveling on the HOV lane and HOT lane passenger number less than the predetermined number can be easily grasped. Besides, when the additional information to the passengers count of results output from the counter 120 is given, the information processing apparatus 20 is configured to output a predetermined buzzer sound and updates the display of the screen it may be. Thus, the person operating the information processing apparatus 20, easily notice the presence of a vehicle traveling on the HOV lane and HOT lane passenger number less than the predetermined number.
[0047]
Second Embodiment
If all the occupants of the second vehicle V2 is captured in a single image, the count unit 120 can be accurately count the number of occupants by using a single image that necessarily 1 not all of the occupant that is reflected in the images. For example, when from a certain angle shot of the second vehicle V2, for the reason such that hiding or shielding have been deviated from the imaging range (such as the exterior portion of the occupant and the vehicle located in front), the second vehicle V2 at least one of the occupant is also possible that not reflected in the image. In this case, count section 120 can not recognize the passenger from the image. Therefore, the passenger number detecting system 1 of the present embodiment may be configured as follows. Note that except for the points described below, passenger number detecting system 1 of the present embodiment has the same configuration as the first embodiment.
[0048]
Imaging device 30 according to a preset frame rate, since the first vehicle take continuous second vehicle V2 from different angles while passing each other and the second vehicle V2, a plurality for the second vehicle V2 single to generate a single image. By the first vehicle to shoot the second vehicle V2 from different directions (different angles) while passing each other and the second vehicle V2, the positional relationship between the imaging range and shields the second vehicle V2 and the occupant of the imaging device 30 varies, it is possible to each occupant in the second vehicle V2 is allowed to be projected to one of the plurality of images. Then, the image acquisition unit 110 acquires a plurality of images generated by the imaging device 30. The counting unit 120 uses a plurality of images acquired by the image acquisition unit 110 counts the number of occupants of the second vehicle V2.
[0049]
As a specific example, with respect to the second vehicle V2, the image that is reflected two occupants in the rear seat, it is reflected occupant of two one and the driver's seat of the passenger in the rear seat image, the driver's seat and image passenger in the passenger seat is reflected, the total of three images and obtained by the image obtaining unit 110. In this case, the count unit 120, for example as disclosed in Patent Document 1, by integrating the result of counting the occupant with each image, the number of occupants of the second vehicle V2, 1 person in the driver's seat, one in the front passenger's seat, and can be calculated as total four two in the back seat.
[0050]
Thus, by using the image of the second vehicle plurality V2, it is possible to accurately count the number of occupants of the second vehicle V2.
[0051]
Further, in the case where a plurality of images are generated by the imaging device 30, the count unit 120, a somewhat different picture appearance of the second vehicle V2 to sorting to passenger counts processing from among all the images available it may be configured to. For example, the count unit 120, from among a plurality of images obtained from the imaging device 30, selects a plurality of images that satisfy a predetermined selection criterion as a processing target image, by using a plurality of process target images the selected it may be configured to count the number of occupants of the second vehicle V2.
[0052]
Specifically, the count unit 120, among the plurality of images acquired by the image acquisition unit 110, at least one specific part of the second vehicle V2 is, in at least one area predetermined (selected reference region) the image that is reflected, is selected as the process target image. Here, the specific site, for example, pillar, etc. (the front pillar, center pillar, a rear pillar) and side mirrors, which part of the vehicle is either a distinguishable site is reflected in the image.
[0053]
The specific operation of the counter unit 120 is illustrated with reference to FIG. Figure 9 is a diagram illustrating the operation of counting unit 120 of the vehicle for selecting a process target image. Here, the first vehicle V1 and the second vehicle V2 illustrate cases run in parallel.
[0054]
First, when the first vehicle V1 overtakes a second vehicle V2, the imaging device 30 captures a second vehicle V2 at a preset frame rate, generating a plurality of images Pn. Counting unit 120 acquires a plurality of images Pn via the image acquisition unit 110 (in the example of FIG, rear pillar A, center pillar B, front pillar C) at least one specific part at least it has a predetermined (in the example of FIG, R1, R2, R3) 1 one selected reference region image that is reflected in the P1, P2, and P3, it is selected from among all the images Pn.
[0055]
Each selection criterion area, for example, as information indicating the position coordinates in the image, stored in a predetermined storage area such as memory 203. Counting unit 120, by comparing the position coordinates of the selected reference area stored in a predetermined storage area, and the position coordinates of the specific site recognized from the image, whether a particular site is reflected in the selection criteria area whether it is possible to determine. The selection criteria area, for example, regions for rear pillars A, and so region, about the center pillar B, it may be determined in association with the type of the specific portion of the vehicle. In the illustrated example, the selection criterion area R1, R2, R3 are each rear pillar A, center pillar B, and is defined as a region about a front pillar C.
[0056]
Further, in FIG. 9, the count unit 120 is an example of selecting a processing target image by using a plurality of the specific portion, the count unit 120 uses a single specific site (e.g., a center pillar B only) treatment it may be configured to sort the target image. In this case, the count unit 120 operates as follows, for example. Note that here, an example is given for the center pillar B and a specific site. First, the count unit 120 is a plurality of images Pn analyzed respectively, obtains the position coordinates of the center pillar B from each of the plurality of images Pn. Then, the count unit 120, stored in a predetermined storage area, reads the position coordinates of a plurality of selected reference areas about the center pillar B, and compared to the respective position information of the plurality of center pillar acquired from a plurality of images Pn . Counting section 120, the position coordinates of the center pillar B is an image closest to the position coordinates of each selected reference region are selected as the processing target image. As a specific example, if the four selected reference region about the center pillar B is stored in a predetermined storage area, the count unit 120, based on the position coordinates of the center pillar B obtained from each image, a plurality it can be selected four images from among the images Pn as the processing target image.
[0057]
The count unit 120, based on the positional relationship of the specific portion among the plurality of images, it is also possible to select the processing target image. For example, the count unit 120, the position coordinates of the specific portion caught on an image, the same coordinates and a predetermined relationship between the specific part caught on other images: if satisfying (eg a predetermined interval) can select these images as the processing target image. Here, as a specific example describes the case specific site is center pillar B. First, the count unit 120 is a plurality of images Pn analyzed respectively, obtains the position coordinates of the center pillar B from each of the plurality of images Pn. Then, the count unit 120, by comparing the position coordinates of the center pillar B among a plurality of images Pn, as in the interval of the position of the center pillar B becomes a predetermined distance, an image of a predetermined number it can be selected.
[0058]
The counting unit 120, for example as disclosed in Patent Document 1, by integrating the result of counting the occupant by using the image P1 to P3 were selected, the number of occupants of the second vehicle V2, the driver's seat 1 human, one in the front passenger's seat, and can be calculated as total four two in the back seat.
[0059]
According to such a configuration, as well as accurately count the number of occupants of the second vehicle V2, it is possible to reduce the overall amount of processing by reducing the number of images to be used in the counting section 120.
[0060]
Note that the second vehicle V2 is in the case and the second vehicle V2 when a parallel running vehicle is oncoming vehicle, a specific part of the second vehicle V2 is how bleeds through varies with the image. Therefore, the count unit 120, the second vehicle V2 is depending on whether the oncoming vehicle is running parallel vehicle may be configured to use different selection criteria. In this case, the selection criterion is suitable when the second vehicle V2 is parallel extended vehicle, selection criteria second vehicle V2 is suitable when it is facing the vehicle is prepared in advance in the memory 203 or the like.
[0061]
One method of identifying whether the second vehicle V2 is either oncoming vehicle is running parallel vehicle, for example, a switch for selecting whether to shoot either parallel running vehicle and an oncoming vehicle in the first vehicle V1 it is conceivable to provide. In this case, the imaging device 30, in conjunction with the selected state of the switch may have automatically adjusting a mechanism the direction and angle of view of the imaging device 30. Counting unit 120, a first further acquires information indicating the vehicle V1 selection state of the switch, based on the information, the second vehicle V2 in the image identifies whether the oncoming vehicle is running parallel vehicle be able to.
[0062]
The first and the imaging device used when the second vehicle V2 photographs the parallel running vehicle, a second imaging device used when the second vehicle V2 photographs the oncoming vehicle is mounted on the first vehicle V1 If it is, the count unit 120, based on whether it is a imaging device that provided the image to be processed the first imaging device and the second imaging device, a second vehicle V2 in the image the parallel running vehicle or it can identify a are either oncoming vehicle is.
[0063]
Other methods, for example, can be utilized as the first vehicle V1 the magnitude of the relative speed between the second vehicle V2. Specifically, the second vehicle V2 is if the parallel running vehicle, the first vehicle V1 and the second vehicle V2 is moving in the same direction, the relative speed is not so large. On the other hand, the second vehicle V2 is if oncoming vehicle, because the first vehicle and the second vehicle V2 is moving in opposite directions, as compared with when the second vehicle V2 is parallel extended vehicle, the relative speed increases. In this case, for example, the count unit 120 calculates the change in distance per unit time between the first vehicle V1 based on the output signal of the vehicle detection sensor 40 and the second vehicle V2, per the unit time change in distance to be able to calculate the relative speed between the first vehicle V1 based on the second vehicle V2. The counting unit 120, the relative speed between the first vehicle V1 and the second vehicle V2 is pre-stored threshold value 203 or the like (for example, 40 km / h) depending on whether more than a second in the image vehicle V2 can be identified whether the oncoming vehicle or a parallel running vehicle.
[0064]
[Third Embodiment]
and when a second vehicle V2 is parallel running vehicle, in a case where the second vehicle V2 is oncoming vehicle, the first vehicle V1 relative speed between the second vehicle V2 is greatly differs . In other words, the case where the second vehicle V2 is parallel extended vehicle, in a case where the second vehicle V2 is oncoming vehicle, setting of the imaging device 30 for the second vehicle V2 and its occupant to generate an image appears sharp it can be said that different. Therefore, the passenger number detecting system 1 of the present embodiment, set at the time of shooting of the imaging device 30 (e.g., a frame rate, the shutter speed, projection amount from the projector 50), the second vehicle V2 is a parallel running vehicle It has a case, a case where a different structure second vehicle V2 is oncoming vehicle.
[0065]
Specifically, than when the second vehicle V2 is parallel extended vehicle, towards the case where the second vehicle V2 is facing the vehicle, the first vehicle V1 relative speed between the second vehicle V2 increases. Therefore, when the second vehicle V2 is facing the vehicle, in order to clearly photograph the object, the imaging device 30, for taking second vehicle V2 at a high frame rate and high shutter speeds are preferred. Further, in this case, depending on the shutter speed, preferably to increase the projection amount from the projector 50. On the other hand, if the second vehicle V2 is parallel extended vehicle, since the relative speed between the first vehicle V1 and the second vehicle V2 is relatively small, even a slow shutter speed, generating some sharp image can. Further, when the shutter speed is slow, or may not many projection amount from the projector 50 can generate some sharp image. Further, when the relative speed between the first vehicle V1 and the second vehicle V2 is small, when taking a second vehicle V2 at a high frame rate, less change in the state of the object, an image not used for counting the number of occupants It would also be obtained many pieces. Thus, the imaging device 30 than the second vehicle V2 is oncoming vehicle, for taking second vehicle V2 at a low frame rate is preferred.
[0066]
[Functional Configuration]
FIG. 10 is a block diagram conceptually showing the functional configuration of the passenger number detecting system 1 of the third embodiment. Incidentally, FIG. 10 is is based on the configuration of the first embodiment, the configurations described in the other embodiments may also be further included. As shown in FIG. 10, the passenger number detecting system 1 of the present embodiment is configured to include a control unit 130.
[0067]
Control unit 130 receives information indicating whether to use the image pickup device 30 to capture either the parallel running vehicle and an oncoming vehicle based on the received information, changes the setting at the time of shooting of the imaging device 30. For example, if provided a switch for selecting whether to shoot either parallel running vehicle and an oncoming vehicle in the first vehicle V1, the control unit 130, information indicating the selected state of the switch from the first vehicle V1 get. Then, the control unit 130, for example, by referring to the table shown in FIG. 11, reads out the setting information of the image pickup device 30 corresponding to the selected state of the switch. Figure 11 is a diagram showing an example of a configuration for storing setting information of the imaging device 30. In the example of FIG. 11, in association with the selection information for the switch, the setting information of the image pickup apparatus 30 is stored. Controller 130 generates a control instruction, which changes the setting at the time of shooting of the imaging device 30 based on the read setting information to the image pickup device 30. Imaging device 30, in response to a control instruction from control unit 130, to change the settings at the time of shooting.
[0068]
Also, when the first imaging device used to capture the parallel running vehicle, a second imaging device used for photographing the oncoming vehicle are provided, respectively, the control unit 130 is not it may be. In this case, the first imaging device, a low frame rate, slow shutter speed and is preset to be taken in the normal projection amount, the second imaging device, high frame rate, high-speed shutter speed and, It is set in advance so as to shoot at a generous amount of emitted light.
[0069]
According to the configuration of the present embodiment, generates an image by employing the appropriate settings for each, suitable for counting the count unit 120 when photographing the vehicle and when oncoming shooting vehicle run in parallel can do.
[0070]
Fourth Embodiment
imaging device 30 is mounted on the first vehicle V1. Therefore, the imaging apparatus 30 mounted on the first vehicle V1 is the positional relationship between the second vehicle V2 can vary. In this case, outside the depth of field of the imaging device 30 so that the second vehicle V2 or occupants of the second vehicle V2 is located, there is a possibility that the subject is blurred caught on the image. Further, vibration transmitted from the first vehicle V1, the speed, etc. of the difference between the first vehicle V1 and the second vehicle V2, easily-called motion blur occurs. Therefore, the passenger number detecting system 1 of the present embodiment, in addition to the configuration of the embodiments described above, the image generated by the imaging device 30, further comprising a structure for reducing the blur of the subject.
[0071]
[Functional Configuration]
FIG. 12 is a block diagram conceptually showing the functional configuration of the passenger number detecting system 1 of the fourth embodiment. Incidentally, FIG. 12 has been based on the configuration of the first embodiment, the configurations described in the other embodiments may also be further included. As shown in FIG. 12, in the passenger number detecting system 1 of the present embodiment, the count unit 120 includes the image correcting unit 126.
[0072]
Image correcting unit 126, the distance and the first vehicle V1 from the first vehicle V1 to a second vehicle V2 based on at least one of the relative speed between the second vehicle V2, the object of which the image acquired by the image acquiring unit 110 (i.e., the second vehicle V2) executes a correction process of reducing the blur of. This correction process includes a process to reduce the blurring and so-called motion blur caused by the depth of field of the imaging device 30. Further, the image correction unit 126, for example, can be based on the output signal of the vehicle detection sensor 40 mounted on the first vehicle V1, to grasp the distance from the first vehicle V1 to a second vehicle V2. Image correcting unit 126 can determine a parameter depending on the distance from the first vehicle V1 to a second vehicle V2, to correct the blur of the subject due to the depth of field of the imaging device 30. For example, the image correction unit 126, the distance function and to calculate the parameters as arguments, such as by using a table that stores defining a parameter corresponding to a distance by, depending on the distance from the first vehicle V1 to a second vehicle V2 it is possible to determine the parameters. Further, the image correction unit 126, based on the Temporal change in the distance from the first vehicle V1 to a second vehicle V2, calculates the first vehicle V1 relative speed between the second vehicle V2, depending on the relative speed Te, it is possible to determine a parameter for correcting the motion blur of the object. For example, the image correction unit 126, the function and to calculate the parameters of the relative speed as a parameter, by using a corresponding table that stores defining parameters for each relative speed, the relative speed between the first vehicle V1 and the second vehicle V2 it is possible to determine the parameters in accordance with the. Image correction unit 126, thus using the determined parameters, performs correction processing on the image acquired by the image acquiring unit 110.
[0073]
Further, the image correction unit 126, by analyzing an image obtained by the image obtaining unit 110, to determine the blurriness of the image, it is also possible to determine the parameter corresponding to blurriness of the image. For example, the image correction unit 126 obtains the analysis information of the spatial frequency of the image, it is possible to determine the parameters for the correction based on the information. Is not particularly limited, the image correction unit 126, for example, if the point spread function (Point Spread Function) such blur function representing the nature of the blurring of the image is known, the blurring function of the image in the spatial frequency components by the Fourier transform decompose and, as shown in the following equation can be derived Wiener filter for blurring reduction.
[0074]
[Number 1]
[0075]
In the above formula, H is shown a Fourier transform of the blurring function image, H * denotes a complex conjugate of the Fourier transform H, gamma represents a constant determined by SN (Signal to Noise) ratio of the image signal. Incidentally, the above formula, for example, is stored in a predetermined storage area such as the memory 203 and storage devices 204, image correction unit 126 reads the expression from the storage area, determining a correction parameter to reduce blurring can.
[0076]
Besides, the image correction unit 126, information indicating the shake of the subject is calculated using an autocorrelation function, acquired as information indicating the extent of blurring of the image, determining a correction parameter to reduce blurring it can. In this case, the image correction unit 126, using a predetermined function to derive a parameter to cancel the shake by substituting the direction and amount of shake of an object in calculable image using an autocorrelation function, correction it can be determined parameters. Note that the function described above, for example, is stored in a predetermined storage area such as the memory 203 and storage devices 204, the image correction unit 126 may determine the parameters by reading the function from the storage area.
[0077]
[Hardware Configuration]
The hardware configuration of this embodiment, as in the first embodiment: a (of FIG. 2 and FIG. 4). In the present embodiment, the storage device 204 of the information processing apparatus 20 further stores a program module for realizing the functions of the image correction unit 126 described above. Processor 202 of the information processing apparatus 20 by executing the program module, the function of the image correction unit 126 described above is realized.
[0078]
Above, in this embodiment, depending on the distance between vehicles, processing of reducing the blur of the image is performed. Thus, by using the image object (occupant in the second vehicle and the second vehicle) is captured clearly can be counted accurately number of occupants.
[0079]
Fifth Embodiment
In a road having a plurality of lanes, if the portion of the lane is set as HOV lane and HOT lanes by running in the vicinity of the lane in which the first vehicle V1 is monitored, efficiently monitored business can be carried out. Therefore, the passenger number detecting system 1 of the present embodiment, the target lane Inspection Services: further has a structure to induce a first vehicle V1 in the vicinity of (eg HOV lane and HOT lane).
[0080]
[Functional Configuration]
FIG. 13 is a block diagram conceptually showing the functional configuration of the passenger number detecting system 1 of the fifth embodiment. Note that FIG. 13 is is based on the configuration of the first embodiment, the configurations described in the other embodiments may also be further included. As shown in FIG. 13, the passenger number detecting system 1 of the present embodiment is configured to include a target lane specifying section 140 and the guidance information output unit 150.
[0081]
Target lane specifying section 140, for example, in the following manner, the vehicle to be counting process of the passenger number to identify the target lane running. First, the target lane identification unit 140 is, for example, GPS (Global Positioning System, not shown) by using a, obtains the current position information of the first vehicle V1. Then, the target lane specifying section 140 uses the current location information of the first vehicle V1 obtained, searches the map information which is prepared in the memory 203 and storage devices 204 or the like. The map information includes a position information of the monitoring target lane, target lane specifying section 140 based on the current position information of the first vehicle V1, identifies a near target lane of the current position of the first vehicle V1 be able to.
[0082]
Guidance information output unit 150, in the vicinity of the target lane is identified by the target lane specifying section 140 lane (e.g., adjacent lanes), the information to induce first vehicle V1 (hereinafter, "guidance information" hereinafter) to Output. Guidance information output unit 150, for example, it is possible to output information for displaying a screen in which the first vehicle V1 to highlight the lanes should travel in the car navigation system (not shown), as guide information. Further, the induction information output unit 150, for example a message first vehicle V1 indicates lanes should travel (e.g., "Please travel center lane.", Etc.) either display or car speakers (car navigation device FIG. the information for output from Shimese not) can be output as a guide information. Person operating the first vehicle V1 is possible to operate the first vehicle V1 based on the guide information outputted from the car navigation device or a speaker device, to move the first vehicle V1 in lanes adjacent to the target lane can. Further, the induction information output unit 150, the information for controlling the operation of the automatic operation so that the vehicle travels the lane adjacent to the target lane, control unit for controlling the automatic operation of the first vehicle V1 (e.g., ECU ( Electronic Control Unit), can be output to not shown). The ECU by controlling the operation of the first vehicle V1 based on the derived information from the guide information output section 150, can be guided in adjacent lanes the first vehicle V1 to the target lane.
[0083]
[Hardware Configuration]
The hardware configuration of this embodiment, as in the first embodiment: a (of FIG. 2 and FIG. 4). In the present embodiment, the storage device 204 of the information processing apparatus 20 further stores a program module for realizing the functions of the target lane specifying section 140 and the guidance information output unit 150 described above. Processor 202 of the information processing apparatus 20 by executing these program modules, the function of the target lane specifying section 140 and the guidance information output unit 150 described above is realized, respectively.
[0084]
As described above, according to this embodiment, it is possible to induce the first vehicle V1 to a preferred lane for monitoring operations. Thus, efficiency of monitoring operations by the first vehicle V1 can be reduced.
[0085]
Sixth Embodiment
passenger number detecting system 1 of the present embodiment, except for the following points, having the same function configuration as the above embodiments.
[0086]
[Functional Configuration]
FIG. 14 is a block diagram conceptually showing the functional configuration of the passenger number detecting system 1 of the sixth embodiment. Incidentally, FIG. 14 has been based on the configuration of the first embodiment, the configurations described in the other embodiments may also be further included. As shown in FIG. 14, the passenger number detecting system 1 of the present embodiment further comprise constituted the vehicle recognizing section 160. In passenger number detecting system 1 of the present embodiment, the imaging device 30, for example as in the surveillance camera, always repeat the photography, the vehicle recognition unit 160 uses the known object recognition algorithm, the imaging device 30 is captured It determines whether or not the vehicle in the image exists. Vehicle recognizing section 160 issues an instruction to execute a process of counting the number of occupants by using the image when the vehicle is recognized, the count unit 120 in the image capturing apparatus 30 has been captured. Counting unit 120, in response to an instruction from the vehicle recognizing section 160, as described above, it executes a process of counting the number of occupants by using an image.
[0087]
[Hardware Configuration]
The hardware configuration of this embodiment, substantially the same as the first embodiment: a (of FIG. 2 and FIG. 4). In the present embodiment, since the imaging apparatus 30 is always repeated photographing, the vehicle detection sensor 40 for generating a trigger for shooting operation of the image pickup device 30 may be omitted. Moreover, and further stores a program module for realizing the functions of the above-described vehicle recognition unit 160. By processor 202 of the information processing apparatus 20 executes the program module, the function of the above-described vehicle recognition unit 160 are realized.
[0088]
Operational Example
with reference to FIG. 15, the flow of processing in the passenger number detecting system 1 of the sixth embodiment. Figure 15 is a flowchart illustrating a flow of processing in the passenger number detecting system 1 of the sixth embodiment.
[0089]
Image acquisition unit 110 acquires an image from the imaging device 30 makes constant imaging (S202), the vehicle recognizing section 160, the image acquired by the image acquisition unit 110 includes an object to be recognized with the vehicle dolphin perform whether or not the analysis (S204). As a result of analyzing the image, when the vehicle in the image is recognized (S206: YES), the vehicle recognizing section 160, the counting unit 120, passenger count of using the image acquired by the image acquisition unit 110 an instruction to execute processing (S208). Counting unit 120, in response to an instruction from the vehicle recognizing section 160, as described in the above embodiments, it executes a process of counting the number of occupants. On the other hand, as a result of analyzing the image, when the vehicle in the image is not recognized (S206: NO), the above process is skipped, the image acquisition unit 110 is processed in the newly acquired next image move.
[0090]
Having described embodiments of the present invention with reference to the attached drawings, merely as examples of the present invention, it is also possible to adopt various other configurations.
[0091]
Further, the plurality of flow chart used in the above description, a plurality of steps (processes) are described in order, the execution order of steps performed in each embodiment is not limited to the order of the description. In each embodiment, it is possible to change the order of the steps illustrated where not contents to trouble. Further, each of the embodiments discussed above can be combined to the extent that the content is not inconsistent.
[0092]
Some or all of the above embodiments, can be described as the following notes, are not limited to.
1.
From an imaging device mounted on the first vehicle, and the image acquiring means for acquiring an image of the second vehicle is present around the first vehicle,
using the image acquired by the image acquiring means, the second a counting means for counting the number of occupants of the vehicle
occupant number detecting system with.
2.
Said image acquisition means, the second to obtain a plurality of images obtained by photographing the vehicle from different directions,
said counting means counts the number of occupants of the second vehicle using the plurality of images,
1. Passenger number detecting system according to.
3.
The counting means,
from among the plurality of images, and select a plurality of process target image that satisfies a predetermined selection criterion,
using the plurality of process target image, and counts the number of occupants of the second vehicle ,
2. Passenger number detecting system according to.
4.
Said counting means includes a specific part of the second vehicle caught on one of the processing target image, and the specific portion of the second vehicle caught on other of the processing target image so as to meet a predetermined positional relationship, said plurality of from the image, selecting the plurality of process target image,
3. Passenger number detecting system according to.
5.
The counting means, among the plurality of images, an image of at least one specific part of the second vehicle that is reflected in the at least one selected reference region predetermined selected as the processing target image,
3. Or 4. Passenger number detecting system according to.
6.
The selection criterion, the second vehicle and the case where the parallel running vehicle, the second vehicle is different between when an oncoming vehicle,
3. To 5. Passenger number detecting system according to any one of.
7.
Shooting settings of the imaging device, the second vehicle and the case where the parallel running vehicle, the second vehicle is different between when an oncoming vehicle,
1. To passenger number detecting system according to 6.
8.
It said image acquisition means and the counting means is provided in the first vehicle,
1. To 7. Passenger number detecting system according to any one of.
9.
Wherein the first vehicle, the second and the distance is further provided a distance measuring means for measuring the up vehicle,
it said counting means,
the distance and the distance to the second vehicle, which is measured by said distance measuring means based on at least one of the relative speed between the first vehicle and the second vehicle is calculated, to execute the correction process of reducing the blur of the subject of the image using the change,
1. To 8. Passenger number detecting system according to any one of.
10.
The correction processing, blur based on the depth of field of the imaging device, or comprises a process of reducing the motion blur of the subject,
9. Passenger number detecting system according to.
11.
Wherein the first vehicle, the first and the imaging device used when the second vehicle is a parallel running vehicle, a second imaging device for use when the second vehicle is oncoming vehicle, is mounted are,
photographing direction of the second imaging device is directed in the traveling direction of the first vehicle than the photographing direction of the first imaging device,
1. To 10. Passenger number detecting system according to any one of.
12.
It said image acquisition means further acquires other images containing individual identification information of the second vehicle,
wherein the counting means obtains the identification information of the second vehicle from the other image, counted outputting with the number of occupants and the cord of the second vehicle,
1. To 11. Passenger number detecting system according to any one of.
13.
Wherein the first vehicle, other imaging device for capturing the other image is further equipped,
12. Passenger number detecting system according to.
14.
Based on the position information of the first vehicle, and the target lane specifying means for specifying a target lane in which the vehicle to be counting process of the passenger number travels,
adjacent to the target lane is identified by the target lane specifying means further comprising a guidance information output means for outputting the guidance information to guide the first vehicle lane, and
1. To 13. Passenger number detecting system according to any one of.
15.
Computer,
from the imaging device mounted on the first vehicle, the first to obtain a second image of the vehicles existing around the vehicle,
using the image acquired, counting the number of occupants of the second vehicle to,
includes, passenger number detecting method.
16.
The computer,
obtains a plurality of images obtained by capturing the second vehicle from different directions,
to count the number of occupants of the second vehicle using the plurality of images,
15 including that. Passenger number detecting method according to.
17.
The computer,
from the plurality of images, and select a plurality of process target image that satisfies a predetermined selection criterion,
using the plurality of process target image, and counts the number of occupants of the second vehicle,
16 including the fact. Passenger number detecting method according to.
18.
The computer,
so that a specific part of the second vehicle caught on one of the processing target image, and the specific portion of the second vehicle caught on other of the processing target image satisfies the predetermined positional relationship, said plurality of images from among, for selecting the plurality of process target image,
17 including the. Passenger number detecting method according to.
19.
The computer is,
among the plurality of images, the second image at least one specific part of the vehicle that is reflected in at least one selected reference region predetermined selected as the processing target image,
comprising 17. Or 18. Passenger number detecting method according to.
20.
The selection criterion, the second vehicle and the case where the parallel running vehicle, the second vehicle is different between when an oncoming vehicle,
17. To 19. Passenger number detecting method according to any one of.
21.
Shooting settings of the imaging device, the second vehicle and the case where the parallel running vehicle, the second vehicle is different between when an oncoming vehicle,
15. To 20. Passenger number detecting method according to any one of.
22.
The computer is provided in the first vehicle,
15. To 21. Passenger number detecting method according to any one of.
23.
Wherein the first vehicle, the second and the distance measuring means for measuring the distance to the vehicle is provided further
the computer,
the distance and the distance to the second vehicle, which is measured by said distance measuring means changed based on at least one of the relative speed between the first vehicle is calculated as the second vehicle using, it executes the correction process of reducing the blur of the subject of the image,
15 including that. To 22. Passenger number detecting method according to any one of.
24.
The correction processing, blur based on the depth of field of the imaging device, or comprises a process of reducing the motion blur of the subject,
23. Passenger number detecting method according to.
25.
Wherein the first vehicle, the first and the imaging device used when the second vehicle is a parallel running vehicle, a second imaging device for use when the second vehicle is oncoming vehicle, is mounted are,
photographing direction of the second imaging device is directed in the traveling direction of the first vehicle than the photographing direction of the first imaging device,
15. To 24. Passenger number detecting method according to any one of.
26.
Said computer,
said further acquire other images containing individual identification information of the second vehicle,
the other image to obtain individual identification information of the second vehicle from the number of occupants of the second vehicle counted in association to output,
15 including the fact. To 25. Passenger number detecting method according to any one of.
27.
Wherein the first vehicle, other imaging device for capturing the other image is further equipped,
26. Passenger number detecting method according to.
28.
The computer,
on the basis of the first position information of the vehicle to identify the target lane in which the vehicle to be counting process of the passenger number is traveling,
the first vehicle lane adjacent to the target lane is identified and outputs the guidance information to guide,
15 including that. To 27. Passenger number detecting method according to any one of.
29.
15. To 28. Program for executing the passenger number detecting method according to the computer in any one of.
[0093]
This application claims priority based on Japanese Patent Application No. 2017-143923, filed on July 25, 2017, the entire disclosure of which is incorporated herein.
WE claims
[Requested item 1]
From an imaging device mounted on the first vehicle, and the image acquiring means for acquiring an image of the second vehicle is present around the first vehicle,
using the image acquired by the image acquiring means, the second a counting means for counting the number of occupants of the vehicle
occupant number detecting system with.
[Requested item 2]
Said image acquisition means, the second to obtain a plurality of images obtained by photographing the vehicle from different directions,
said counting means counts the number of occupants of the second vehicle using the plurality of images,
passenger number detecting system according to claim 1.
[Requested item 3]
The counting means,
from among the plurality of images, and select a plurality of process target image that satisfies a predetermined selection criterion,
using the plurality of process target image, and counts the number of occupants of the second vehicle ,
passenger number detecting system according to claim 2.
[Requested item 4]
Said counting means includes a specific part of the second vehicle caught on one of the processing target image, and the specific portion of the second vehicle caught on other of the processing target image so as to meet a predetermined positional relationship, said plurality of from the image, selecting the plurality of process target image,
the passenger number detecting system according to claim 3.
[Requested item 5]
The counting means, among the plurality of images, an image of at least one specific part of the second vehicle that is reflected in the at least one selected reference region predetermined selected as the processing target image,
claim 3 or passenger number detecting system according to 4.
[Requested item 6]
The selection criteria, and if the second vehicle is a parallel running vehicle, the second vehicle is different between when an oncoming vehicle,
passenger number detecting according to any one of claims 3 to 5 system.
[Requested item 7]
Shooting settings of the imaging apparatus, a case where the second vehicle is a parallel running vehicle, the second vehicle is different between when an oncoming vehicle,
passenger number detecting according to claim 1 to 6 system.
[Requested item 8]
Said image acquisition means and the counting means is provided in the first vehicle,
occupant number detecting system according to any one of claims 1 to 7.
[Requested item 9]
Wherein the first vehicle, the second and the distance is further provided a distance measuring means for measuring the up vehicle,
it said counting means,
the distance and the distance to the second vehicle, which is measured by said distance measuring means based on at least one of the relative speed between the first vehicle and the second vehicle is calculated, to execute the correction process of reducing the blur of the subject of the image using the change,
according to claim 1 to 8 passenger number detecting system according to any one of.
[Requested item 10]
The correction processing, blur based on the depth of field of the imaging device, or comprises a process of reducing the motion blur of the subject,
the passenger number detecting system according to claim 9.
[Requested item 11]
Wherein the first vehicle, the first and the imaging device used when the second vehicle is a parallel running vehicle, a second imaging device for use when the second vehicle is oncoming vehicle, is mounted are,
photographing direction of the second imaging device is directed to the traveling direction of the first vehicle than the photographing direction of the first imaging device,
in any one of claims 1 to 10 passenger number detecting system according.
[Requested item 12]
It said image acquisition means further acquires other images containing individual identification information of the second vehicle,
wherein the counting means obtains the identification information of the second vehicle from the other image, counted outputting with the number of occupants and the cord of the second vehicle,
occupant number detecting system according to any one of claims 1 to 11.
[Requested item 13]
Wherein the first vehicle, said other other imaging device for taking an image is further mounted,
passenger number detecting system according to claim 12.
[Requested item 14]
Based on the position information of the first vehicle, and the target lane specifying means for specifying a target lane in which the vehicle to be counting process of the passenger number travels,
adjacent to the target lane is identified by the target lane specifying means further comprising a guidance information output means for outputting the guidance information to guide the first vehicle lane, the,
passenger number detecting system according to any one of claims 1 to 13.
[Requested item 15]
Computer,
from the imaging device mounted on the first vehicle, the first to obtain a second image of the vehicles existing around the vehicle,
using the image acquired, counting the number of occupants of the second vehicle to,
includes, passenger number detecting method.
[Requested item 16]
The computer,
obtains a plurality of images obtained by capturing the second vehicle from different directions,
to count the number of occupants of the second vehicle using the plurality of images,
it in claim 15 comprising passenger number detecting method according.
[Requested item 17]
The computer,
from the plurality of images, and select a plurality of process target image that satisfies a predetermined selection criterion,
using the plurality of process target image, and counts the number of occupants of the second vehicle,
passenger number detecting method according to claim 16 comprising.
[Requested item 18]
The computer,
so that a specific part of the second vehicle caught on one of the processing target image, and the specific portion of the second vehicle caught on other of the processing target image satisfies the predetermined positional relationship, said plurality of images from, for selecting the plurality of process target image, the
passenger number detecting method according to claim 17 which comprises.
[Requested item 19]
The computer is,
among the plurality of images, the second image at least one specific part of the vehicle that is reflected in at least one selected reference region predetermined selected as the processing target image,
comprising passenger number detecting method according to claim 17 or 18.
[Requested item 20]
The selection criteria, and if the second vehicle is a parallel running vehicle, the second vehicle is different between when an oncoming vehicle,
passenger number detecting according to any one of claims 17 to 19 Method.
[Requested item 21]
Shooting settings of the imaging apparatus, a case where the second vehicle is a parallel running vehicle, the second vehicle is different between when an oncoming vehicle,
to any one of claims 15 to 20 passenger number detecting method according.
[Requested item 22]
The computer is provided in the first vehicle,
the passenger number detecting method according to any one of claims 15 to 21.
[Requested item 23]
Wherein the first vehicle, the second and the distance measuring means for measuring the distance to the vehicle is provided further
the computer,
the distance and the distance to the second vehicle, which is measured by said distance measuring means changed based on at least one of the relative speed between the first vehicle is calculated as the second vehicle using, it executes the correction process of reducing the blur of the subject of the image,
according to claim 15, which comprises to passenger number detecting method according to any one of 22.
[Requested item 24]
The correction processing, blur based on the depth of field of the imaging device, or comprises a process of reducing the motion blur of the subject,
the passenger number detecting method according to claim 23.
[Requested item 25]
Wherein the first vehicle, the first and the imaging device used when the second vehicle is a parallel running vehicle, a second imaging device for use when the second vehicle is oncoming vehicle, is mounted are,
photographing direction of the second imaging device is directed to the traveling direction of the first vehicle than the photographing direction of the first imaging device,
in any one of claims 15 to 24 passenger number detecting method according.
[Requested item 26]
Said computer,
said further acquire other images containing individual identification information of the second vehicle,
the other image to obtain individual identification information of the second vehicle from the number of occupants of the second vehicle counted in association output,
passenger number detecting method according to any one of claims 15 to 25 comprising.
[Requested item 27]
Wherein the first vehicle, said other other imaging device for taking an image is further mounted,
passenger number detecting method according to claim 26.
[Requested item 28]
The computer,
on the basis of the first position information of the vehicle to identify the target lane in which the vehicle to be counting process of the passenger number is traveling,
the first vehicle lane adjacent to the target lane is identified and outputs the guidance information to guide,
passenger number detecting method according to any one of claims 15 to 27 comprising.
[Requested item 29]
Program for executing the passenger number detecting method according to the computer in any one of claims 15 to 28.
| # | Name | Date |
|---|---|---|
| 1 | 202017002844.pdf | 2020-01-22 |
| 2 | 202017002844-TRANSLATIOIN OF PRIOIRTY DOCUMENTS ETC. [22-01-2020(online)].pdf | 2020-01-22 |
| 3 | 202017002844-STATEMENT OF UNDERTAKING (FORM 3) [22-01-2020(online)].pdf | 2020-01-22 |
| 4 | 202017002844-REQUEST FOR EXAMINATION (FORM-18) [22-01-2020(online)].pdf | 2020-01-22 |
| 5 | 202017002844-PRIORITY DOCUMENTS [22-01-2020(online)].pdf | 2020-01-22 |
| 6 | 202017002844-POWER OF AUTHORITY [22-01-2020(online)].pdf | 2020-01-22 |
| 7 | 202017002844-NOTIFICATION OF INT. APPLN. NO. & FILING DATE (PCT-RO-105) [22-01-2020(online)].pdf | 2020-01-22 |
| 8 | 202017002844-FORM 18 [22-01-2020(online)].pdf | 2020-01-22 |
| 9 | 202017002844-FORM 1 [22-01-2020(online)].pdf | 2020-01-22 |
| 10 | 202017002844-DRAWINGS [22-01-2020(online)].pdf | 2020-01-22 |
| 11 | 202017002844-DECLARATION OF INVENTORSHIP (FORM 5) [22-01-2020(online)].pdf | 2020-01-22 |
| 12 | 202017002844-COMPLETE SPECIFICATION [22-01-2020(online)].pdf | 2020-01-22 |
| 13 | 202017002844-Power of Attorney-240120.pdf | 2020-01-27 |
| 14 | 202017002844-OTHERS-240120.pdf | 2020-01-27 |
| 15 | 202017002844-OTHERS-240120-.pdf | 2020-01-27 |
| 16 | 202017002844-Correspondence-240120.pdf | 2020-01-27 |
| 17 | abstract.jpg | 2020-01-30 |
| 18 | 202017002844-certified copy of translation [04-02-2020(online)].pdf | 2020-02-04 |
| 19 | 202017002844-OTHERS-060220.pdf | 2020-02-07 |
| 20 | 202017002844-Correspondence-060220.pdf | 2020-02-07 |
| 21 | 202017002844-MARKED COPIES OF AMENDEMENTS [14-02-2020(online)].pdf | 2020-02-14 |
| 22 | 202017002844-FORM 13 [14-02-2020(online)].pdf | 2020-02-14 |
| 23 | 202017002844-AMMENDED DOCUMENTS [14-02-2020(online)].pdf | 2020-02-14 |
| 24 | 202017002844-FORM 3 [20-07-2020(online)].pdf | 2020-07-20 |
| 25 | 202017002844-FER.pdf | 2021-10-19 |
| 26 | 202017002844-Proof of Right [22-12-2021(online)].pdf | 2021-12-22 |
| 27 | 202017002844-PETITION UNDER RULE 137 [22-12-2021(online)].pdf | 2021-12-22 |
| 28 | 202017002844-OTHERS [22-12-2021(online)].pdf | 2021-12-22 |
| 29 | 202017002844-Information under section 8(2) [22-12-2021(online)].pdf | 2021-12-22 |
| 30 | 202017002844-FORM 3 [22-12-2021(online)].pdf | 2021-12-22 |
| 31 | 202017002844-FER_SER_REPLY [22-12-2021(online)].pdf | 2021-12-22 |
| 32 | 202017002844-DRAWING [22-12-2021(online)].pdf | 2021-12-22 |
| 33 | 202017002844-COMPLETE SPECIFICATION [22-12-2021(online)].pdf | 2021-12-22 |
| 34 | 202017002844-CLAIMS [22-12-2021(online)].pdf | 2021-12-22 |
| 35 | 202017002844-FORM 3 [20-12-2022(online)].pdf | 2022-12-20 |
| 36 | 202017002844-PatentCertificate02-03-2024.pdf | 2024-03-02 |
| 37 | 202017002844-IntimationOfGrant02-03-2024.pdf | 2024-03-02 |
| 1 | search_202017002844E_12-07-2021.pdf |