Abstract: This vehicle external communication apparatus is provided with: a giving-way intention assessment parameter learning unit (20) that preliminarily learns, on the basis of a learning database, a relation among the status of a giving-way intention which is a pedestrian's intention to give way to a vehicle, the motion of the head of the pedestrian, and the position of the pedestrian, generates a giving-way intention assessment parameter (31) which is learning data in which the motion and the position are associated with the status of the giving-way intention, and stores the giving-way intention assessment parameter (31) in a storage unit (30); a giving-way intention assessment unit (40) that assesses the giving-way intention of an actual pedestrian on the basis of an image of the head of the actual pedestrian and the positon of the actual pedestrian acquired from a peripheral state acquisition unit (10) and the giving-way intention assessment parameter (31) stored in the storage unit (30); and a display control unit (50) that determines whether or not to display a display content to the actual pedestrian, the details of the display content, and the display position, on a road, of the display content, on the basis of the assessment result of the giving-way intention of the actual pedestrian, and controls a display (60) on the basis of the determination.
WE CLAIM:
1. An out-of-vehicle communication device comprising:
a yielding-intention-judgment-parameter learning unit that previously learns a relationship among condition of yielding intention as a pedestrian's intention of yielding a way to a vehicle, behavior of a head of the pedestrian and a position of the pedestrian based on a learning database previously generated from a traffic scene and generates a yielding intention judgment parameter as learning data in which the behavior and the position are associated with the condition of the yielding intention;
a storage unit that stores the yielding intention judgment parameter;
a vicinal situation acquisition unit that acquires a head image and a position of a first pedestrian;
a yielding intention judgment unit that judges condition of yielding intention of the first pedestrian based on the acquired head image and position of the first pedestrian and the yielding intention judgment parameter stored in the storage unit;
a display device that displays display content on a road; and
a display control unit that determines whether or not to display the display content to the first pedestrian, contents of the display content, and a display position of the display content on the road based on result of the judgment on the condition of the yielding intention of the first pedestrian and controls the display device based on the determination.
2. The out-of-vehicle communication device according to claim
1, wherein the behavior associated with the condition of the
yielding intention in the yielding intention judgment parameter
includes one or more of:
behavior in a case of yielding intention presence that appears at the head of the pedestrian in a case where the
pedestrian has the yielding intention,
behavior in a case of yielding intention absence that appears at the head of the pedestrian in a case where the pedestrian does not have the yielding intention, and
behavior in a case of yielding intention undecided that appears at the head of the pedestrian in a case where the pedestrian is wavering on whether to yield a way to a vehicle or to cross a road first.
3. The out-of-vehicle communication device according to claim 1 or 2, wherein the yielding intention judgment parameter is the learning data in which a data set including a head image data set made up of chronological head images of the pedestrian and a position data set made up of chronological positions corresponding to the chronological head images is associated with the condition of the yielding intention.
4. The out-of-vehicle communication device according to any one of claims 1 to 3, wherein the yielding intention judgment unit judges the condition of the yielding intention of the first pedestrian based on the head image and the position of the first pedestrian and the yielding intention judgment parameter stored in the storage unit.
5. The out-of-vehicle communication device according to any one of claims 1 to 4, wherein
the storage unit previously stores a necessity determination table in which necessity information indicating whether displaying the display content is necessary or not is associated with the condition of the yielding intention, and
the display control unit includes a display necessity determination unit that determines whether to display the display content or not based on the necessity determination table.
6. The out-of-vehicle communication device according to any
one of claims 1 to 5, wherein
the storage unit previously stores a content database in which the display content is associated with the condition of the yielding intention, and
the display control unit includes a display content determination unit that determines the display content to be displayed based on the content database.
7. The out-of-vehicle communication device according to any one of claims 1 to 6, wherein the display control unit includes a display position determination unit that controls the display device so that the display content is displayed at a position on a line segment connecting the vehicle and the first pedestrian.
8. The out-of-vehicle communication device according to claim 7, wherein the display position determination unit controls the display device so that a lower part of a character included in the display content is situated close to the first pedestrian and an upper part of the character is situated far from the first pedestrian.
9. The out-of-vehicle communication device according to any one of claims 1 to 8, further comprising:
an understanding-level-judgment-parameter learning unit that previously learns a relationship among pedestrian's level of understanding of the display content displayed on the road, the behavior of the head of the pedestrian and the position of the pedestrian based on an understanding level learning database that is previously generated, generates an understanding level judgment parameter as learning data in which the behavior and the position are associated with the level of understanding, and stores the understanding level judgment parameter in the storage unit; and
an understanding level judgment unit that judges first
pedestrian's level of understanding of the display content based on the acquired head image and position of the first pedestrian and the understanding level judgment parameter stored in the storage unit,
wherein the display control unit determines whether changing the currently displayed display content is necessary or not based on result of the judgment on the first pedestrian's level of understanding.
10. The out-of-vehicle communication device according to claim
9, wherein the behavior associated with the level of understanding
in the understanding level judgment parameter includes one or more
of:
behavior that appears at the head of the pedestrian in a case where the pedestrian understands the display content,
behavior that appears at the head of the pedestrian in a case where the pedestrian cannot understand the display content, and
behavior that appears at the head of the pedestrian in a case where the pedestrian cannot visually recognize the display content.
11. The out-of-vehicle communication device according to claim
10, wherein in a case where the understanding level judgment unit
judges that the first pedestrian understands the display content,
the display control unit determines new display content and
controls the display device based on the new display content.
12. An out-of-vehicle communication method comprising:
a step of previously learning a relationship among
condition of yielding intention as a pedestrian's intention of yielding a way to a vehicle, behavior of a head of the pedestrian and a position of the pedestrian based on a learning database previously generated from a traffic scene, generating a yielding
intention judgment parameter as learning data in which the behavior and the position are associated with the condition of the yielding intention, and storing the yielding intention judgment parameter in a storage unit;
a step of acquiring a head image and a position of a first pedestrian from a vicinal situation acquisition unit;
a step of judging condition of yielding intention of the first pedestrian based on the acquired head image and position of the first pedestrian and the yielding intention judgment parameter stored in the storage unit; and
a step of determining whether or not to display display content to the first pedestrian, contents of the display content, and a display position of the display content on a road based on result of the judgment on the condition of the yielding intention of the first pedestrian and controlling a display device, for displaying the display content on the road, based on the determination.
13. An information processing device used in a vehicle equipped with a vicinal situation acquisition unit that acquires a head image and a position of a first pedestrian and a display device that displays display content on a road, comprising:
a yielding-intention-judgment-parameter learning unit that previously learns a relationship among condition of yielding intention as a pedestrian's intention of yielding a way to a vehicle, behavior of a head of the pedestrian and a position of the pedestrian based on a learning database previously generated from a traffic scene, generates a yielding intention judgment parameter as learning data in which the behavior and the position are associated with the condition of the yielding intention, and stores the yielding intention judgment parameter in a storage unit ;
a yielding intention judgment unit that judges condition of yielding intention of the first pedestrian based on the head image
and the position of the first pedestrian acquired from the vicinal situation acquisition unit and the yielding intention judgment parameter stored in the storage unit; and
a display control unit that determines whether or not to display the display content to the first pedestrian, contents of the display content, and a display position of the display content on the road based on result of the judgment on the condition of the yielding intention of the first pedestrian and controls the display device based on the determination.
14. An out-of-vehicle communication program that causes a computer to execute:
a process of previously learning a relationship among condition of yielding intention as a pedestrian's intention of yielding a way to a vehicle, behavior of a head of the pedestrian and a position of the pedestrian based on a learning database previously generated from a traffic scene, generating a yielding intention judgment parameter as learning data in which the behavior and the position are associated with the condition of the yielding intention, and storing the yielding intention judgment parameter in a storage unit;
a process of acquiring a head image and a position of a first pedestrian from a vicinal situation acquisition unit;
a process of judging condition of yielding intention of the first pedestrian based on the acquired head image and position of the first pedestrian and the yielding intention judgment parameter stored in the storage unit; and
a process of determining whether or not to display display content to the first pedestrian, contents of the display content, and a display position of the display content on a road based on result of the judgment on the condition of the yielding intention of the first pedestrian and controlling a display device, for displaying the display content on the road, based on the determination.
| # | Name | Date |
|---|---|---|
| 1 | 202047017598-Correspondence_Form 1_01-02-2023.pdf | 2023-02-01 |
| 1 | 202047017598.pdf | 2020-04-24 |
| 2 | 202047017598-FER.pdf | 2021-11-05 |
| 2 | 202047017598-TRANSLATIOIN OF PRIOIRTY DOCUMENTS ETC. [24-04-2020(online)].pdf | 2020-04-24 |
| 3 | 202047017598-STATEMENT OF UNDERTAKING (FORM 3) [24-04-2020(online)].pdf | 2020-04-24 |
| 3 | 202047017598-FORM 3 [06-10-2021(online)].pdf | 2021-10-06 |
| 4 | 202047017598-REQUEST FOR EXAMINATION (FORM-18) [24-04-2020(online)].pdf | 2020-04-24 |
| 4 | 202047017598-FORM 3 [06-10-2020(online)].pdf | 2020-10-06 |
| 5 | 202047017598-PROOF OF RIGHT [24-04-2020(online)].pdf | 2020-04-24 |
| 5 | 202047017598-AMMENDED DOCUMENTS [25-04-2020(online)].pdf | 2020-04-25 |
| 6 | 202047017598-POWER OF AUTHORITY [24-04-2020(online)].pdf | 2020-04-24 |
| 6 | 202047017598-FORM 13 [25-04-2020(online)].pdf | 2020-04-25 |
| 7 | 202047017598-MARKED COPIES OF AMENDEMENTS [25-04-2020(online)].pdf | 2020-04-25 |
| 7 | 202047017598-FORM 18 [24-04-2020(online)].pdf | 2020-04-24 |
| 8 | 202047017598-RELEVANT DOCUMENTS [25-04-2020(online)].pdf | 2020-04-25 |
| 8 | 202047017598-FORM 1 [24-04-2020(online)].pdf | 2020-04-24 |
| 9 | 202047017598-CLAIMS UNDER RULE 1 (PROVISIO) OF RULE 20 [24-04-2020(online)].pdf | 2020-04-24 |
| 9 | 202047017598-DRAWINGS [24-04-2020(online)].pdf | 2020-04-24 |
| 10 | 202047017598-COMPLETE SPECIFICATION [24-04-2020(online)].pdf | 2020-04-24 |
| 10 | 202047017598-DECLARATION OF INVENTORSHIP (FORM 5) [24-04-2020(online)].pdf | 2020-04-24 |
| 11 | 202047017598-COMPLETE SPECIFICATION [24-04-2020(online)].pdf | 2020-04-24 |
| 11 | 202047017598-DECLARATION OF INVENTORSHIP (FORM 5) [24-04-2020(online)].pdf | 2020-04-24 |
| 12 | 202047017598-CLAIMS UNDER RULE 1 (PROVISIO) OF RULE 20 [24-04-2020(online)].pdf | 2020-04-24 |
| 12 | 202047017598-DRAWINGS [24-04-2020(online)].pdf | 2020-04-24 |
| 13 | 202047017598-FORM 1 [24-04-2020(online)].pdf | 2020-04-24 |
| 13 | 202047017598-RELEVANT DOCUMENTS [25-04-2020(online)].pdf | 2020-04-25 |
| 14 | 202047017598-FORM 18 [24-04-2020(online)].pdf | 2020-04-24 |
| 14 | 202047017598-MARKED COPIES OF AMENDEMENTS [25-04-2020(online)].pdf | 2020-04-25 |
| 15 | 202047017598-FORM 13 [25-04-2020(online)].pdf | 2020-04-25 |
| 15 | 202047017598-POWER OF AUTHORITY [24-04-2020(online)].pdf | 2020-04-24 |
| 16 | 202047017598-AMMENDED DOCUMENTS [25-04-2020(online)].pdf | 2020-04-25 |
| 16 | 202047017598-PROOF OF RIGHT [24-04-2020(online)].pdf | 2020-04-24 |
| 17 | 202047017598-FORM 3 [06-10-2020(online)].pdf | 2020-10-06 |
| 17 | 202047017598-REQUEST FOR EXAMINATION (FORM-18) [24-04-2020(online)].pdf | 2020-04-24 |
| 18 | 202047017598-STATEMENT OF UNDERTAKING (FORM 3) [24-04-2020(online)].pdf | 2020-04-24 |
| 18 | 202047017598-FORM 3 [06-10-2021(online)].pdf | 2021-10-06 |
| 19 | 202047017598-TRANSLATIOIN OF PRIOIRTY DOCUMENTS ETC. [24-04-2020(online)].pdf | 2020-04-24 |
| 19 | 202047017598-FER.pdf | 2021-11-05 |
| 20 | 202047017598.pdf | 2020-04-24 |
| 20 | 202047017598-Correspondence_Form 1_01-02-2023.pdf | 2023-02-01 |
| 1 | SearchE_23-07-2021.pdf |