Abstract: The present invention addresses the problem of obtaining an image processing device that, to control a vehicle more safely and comfortably, uses a sensor to sense the surrounding environment of a host vehicle and outputs information required for the control of the host vehicle and for warning. An image processing device according to the present invention detects a road edge of a travel path on the basis of a captured image from an on-vehicle camera, and is characterized by recognizing, from the captured image, the type of an object which constitutes the road edge and changing, in accordance with the type of the object, a parameter for detecting the road edge.
Technical Field
[0001]
The present invention relates to an image processing
device that recognizes a surrounding environment of a
vehicle by utilizing a sensor mounted on the vehicle.
Background Art
[0002]
PTL 1 describes a technique for detecting a road
shoulder by using a sensor and using the road shoulder for
preventive safety and automatic driving.
Citation List
Patent Literature
[0003]
PTL 1: JP 2009-053818 A
Summary of Invention
Technical Problem
[0004]
In recent years, warnings and control functions
related to preventive safety have reached a widespread
stage. Development of a sensing function for predicting an
3
accident in advance is also accelerated in order to realize
the preventive safety. Currently, many of the widely used
functions relate to preventive safety functions on an
expressway, driving assistance, or an emergency brake for
preventing a collision in advance on a general road. Among
these functions, a traveling road deviation prevention
function by road end detection which is one of the
preventive safety functions has not yet reached the
widespread stage since a degree of difficulty of sensing
the road end is high.
[0005]
Unlike a lane that is artificially painted to
indicate a section of a traveling road, a road end does not
necessarily have a wall of an artifact or a step of a
sidewalk. For example, in the case of the expressway, an
artificially maintained wall is mostly provided in the road
end, and the road end is a continuous and clean curve even
though the wall is not as good as the lane in many cases,
and recognition of the road end is relatively easy. On the
other hand, in the case of the general road, an obstacle
such as a utility pole, a rock, or grass may run out onto
the traveling road, and it is difficult to model a
curvature shape that facilitates traveling of a vehicle in
advance, and a degree of difficulty of sensing to detect
the road end is high. In the general road, not only a
4
shape of the road end but also discontinuity of the road
end and a classification of the road end are mixed in many
cases, and there are many scenes where it is difficult to
recognize the road end.
[0006]
In the general road, structures (objects) such as
fences, guardrails, and sidewalks are connected
continuously even though a shape in a direction along the
traveling road is basically not a somewhat smooth curve in
many cases. However, even in these structures,
discontinuity occurs at an entrance to a store or home, or
other obstacles block the traveling road, and the
classification of the road end may be immediately changed.
[0007]
On a side of the traveling road, there are a region
of lawn, gravel, or soil without pavement which is very
short and has no difference in height from the road surface,
a region having a height lower than the road surface, such
as a side groove, a rice field, or an upland field, and
boundaries between these regions and the traveling road are
also the road ends. As described above, not only a
classification of the region varies, but also various
objects such as a utility pole, an obstacle, grass, or a
lid of a side groove, and a tree is discontinuously present
at the road end of the traveling road, and it is an
5
important problem to more appropriately recognize these
objects.
[0008]
The present invention has been made in view of the
above problems, and an object of the present invention is
to provide an image processing device that senses a
surrounding environment of a host vehicle by using a sensor
and outputs information necessary for control and a warning
of the host vehicle in order to control the vehicle more
safely and comfortably.
WE CLAIM:
[Claim 1]
An image processing device that detects a road end of
a traveling road based on a captured image of an in-vehicle
camera, wherein the image processing device
recognizes classifications of objects constituting
the road end from the captured image, and
changes a parameter for detecting the road end in
accordance with the classification of the object.
[Claim 2]
The image processing device according to claim 1,
wherein
the in-vehicle camera is a stereo camera, and
the image processing device
votes features of the objects obtained from the
stereo camera on a map in accordance with a behavior of a
host vehicle, and
performs detection of the road end by using a
voting result on the map.
[Claim 3]
The image processing device according to claim 1,
wherein the image processing device
recognizes a plurality of classifications of the
objects, and
performs detection of the road end by simultaneously
66
using the objects of the plurality of classifications.
[Claim 4]
The image processing device according to claim 3,
wherein the image processing device
extracts the objects of the same classification from
among a plurality of the objects recognized from the
captured image, and
performs the detection of the road end by connecting
features of the objects of the same classification.
[Claim 5]
The image processing device according to claim 1,
wherein the image processing device recognizes, as one
classification of the object, a step between a region
present at a position lower than a road surface of the
traveling road and the traveling road from the captured
image.
[Claim 6]
The image processing device according to claim 1,
wherein the image processing device recognizes, as one
classification of the object, a boundary between the
traveling road and a region present at a position having
the same height position as a road surface of the traveling
road by using texture information of the captured image.
| # | Name | Date |
|---|---|---|
| 1 | 202317005536.pdf | 2023-01-27 |
| 2 | 202317005536-TRANSLATIOIN OF PRIOIRTY DOCUMENTS ETC. [27-01-2023(online)].pdf | 2023-01-27 |
| 3 | 202317005536-STATEMENT OF UNDERTAKING (FORM 3) [27-01-2023(online)].pdf | 2023-01-27 |
| 4 | 202317005536-REQUEST FOR EXAMINATION (FORM-18) [27-01-2023(online)].pdf | 2023-01-27 |
| 5 | 202317005536-PROOF OF RIGHT [27-01-2023(online)].pdf | 2023-01-27 |
| 6 | 202317005536-PRIORITY DOCUMENTS [27-01-2023(online)].pdf | 2023-01-27 |
| 7 | 202317005536-POWER OF AUTHORITY [27-01-2023(online)].pdf | 2023-01-27 |
| 8 | 202317005536-NOTIFICATION OF INT. APPLN. NO. & FILING DATE (PCT-RO-105-PCT Pamphlet) [27-01-2023(online)].pdf | 2023-01-27 |
| 9 | 202317005536-FORM 18 [27-01-2023(online)].pdf | 2023-01-27 |
| 10 | 202317005536-FORM 1 [27-01-2023(online)].pdf | 2023-01-27 |
| 11 | 202317005536-DRAWINGS [27-01-2023(online)].pdf | 2023-01-27 |
| 12 | 202317005536-DECLARATION OF INVENTORSHIP (FORM 5) [27-01-2023(online)].pdf | 2023-01-27 |
| 13 | 202317005536-COMPLETE SPECIFICATION [27-01-2023(online)].pdf | 2023-01-27 |
| 14 | 202317005536-Others-230223.pdf | 2023-02-28 |
| 15 | 202317005536-Others-230223-1.pdf | 2023-02-28 |
| 16 | 202317005536-Correspondence-230223.pdf | 2023-02-28 |
| 17 | 202317005536-FORM 3 [12-07-2023(online)].pdf | 2023-07-12 |
| 18 | 202317005536-FER.pdf | 2023-11-21 |
| 19 | 202317005536-Verified English translation [20-05-2024(online)].pdf | 2024-05-20 |
| 20 | 202317005536-OTHERS [20-05-2024(online)].pdf | 2024-05-20 |
| 21 | 202317005536-Information under section 8(2) [20-05-2024(online)].pdf | 2024-05-20 |
| 22 | 202317005536-FORM 3 [20-05-2024(online)].pdf | 2024-05-20 |
| 23 | 202317005536-FER_SER_REPLY [20-05-2024(online)].pdf | 2024-05-20 |
| 24 | 202317005536-COMPLETE SPECIFICATION [20-05-2024(online)].pdf | 2024-05-20 |
| 25 | 202317005536-CLAIMS [20-05-2024(online)].pdf | 2024-05-20 |
| 26 | 202317005536-ABSTRACT [20-05-2024(online)].pdf | 2024-05-20 |
| 27 | 202317005536-GPA-160524.pdf | 2024-05-27 |
| 28 | 202317005536-Correspondence-160524.pdf | 2024-05-27 |
| 29 | 202317005536-Others-030624.pdf | 2024-06-13 |
| 30 | 202317005536-Correspondence-030624.pdf | 2024-06-13 |
| 31 | 202317005536-US(14)-HearingNotice-(HearingDate-12-06-2025).pdf | 2025-05-05 |
| 32 | 202317005536-Correspondence to notify the Controller [09-06-2025(online)].pdf | 2025-06-09 |
| 33 | 202317005536-Written submissions and relevant documents [26-06-2025(online)].pdf | 2025-06-26 |
| 1 | SearchHistoryE_02-11-2023.pdf |