Description:Complete Specification:

The following specification describes and ascertains the nature of this invention and the manner in which it is to be performed.
Field of the invention
[0001] This invention is related to a device for detecting a pothole in a vehicle by a rearview camera.

Background of the invention

[0002] In recent years, in order to increase the safety and convenience of a user who uses the vehicle, technology to equip vehicles with, for example, a variety of sensors and electronic devices is being aggressively developed. In particular, for example, various devices for user driving convenience are being developed. When the autonomous driving function/cruise control function is executed, the vehicle can travel in a prescribed zone while recognizing the surrounding environment for itself by receiving only minimum user input or without receiving any user input.

[0003] A US patent 9944317 discloses a driver assistance apparatus includes at least one camera configured to generate images of a view in front of a vehicle, and a processor. The processor is configured to detect an object present in a traveling lane of the vehicle based on the generated images, and to provide a steering apparatus of the vehicle with a control signal to adjust a direction of travel of the vehicle within the traveling lane based on information regarding the object.

Brief description of the accompanying drawings
[0004] Figure 1 illustrates a device for detecting a pothole in a vehicle, in accordance with an embodiment of the invention; and
[0005] Figure 2 illustrates a flow chart of a method of detecting a pothole in the vehicle, in accordance with the present invention.

Detailed description of the embodiments
[0006] Figure 1 illustrates a device for detecting a pothole 11 in a vehicle 12, in accordance with an embodiment of the invention. The vehicle 12 comprises an image capturing unit 14 positioned at a rear side of the vehicle 12 and at least one sensing element 16 for detecting at least one vehicle parameter. The device comprises a processor 26 for detecting a variation in the at least one vehicle parameter. The processor 26 activates the image capturing unit 14 for capturing a cluster of images 18 of the road when the variation is detected.

[0007] Further the device and the components of the device 10 in the vehicle is explained in detail. The processor present in the vehicle 10 is chosen from a group of a microcontroller, a microprocessor, a digital circuit, an integrated chip and the like. The image capturing unit 14 positioned in the rear side of the vehicle 12 is a rear-view camera/sensor according to one embodiment of the invention. The rear-view camera captures a segment of the road where there is a variation in one of the vehicle parameters is detected. The captured cluster of images 18 are processed further in an image processing unit 24 of the device 10. The segment of the road that is captured comprises multiple road segments that are damaged like pothole, road construction scenario’s, an uneven speed breaker, an object lying on the road and the like.

[0008] The captured and processed cluster of images 18 are transmitted to a cloud -repository 20 for the future reference or for any other vehicle 12 that is travelling that route. The at least one vehicle parameter that varies when there is a pothole 11 or any damage occurred to the road, is chosen from a group of parameters like a wheel speed, a variation in the acceleration level, a variation in a yam rate and the like. It is to be noted that, the variation in the vehicle parameter is not limited to the above-mentioned parameters , but can be of any other parameters that is known to a person skilled in the art.

[0009] The at least one sensor 16 is that detects the variation in the vehicle parameters are chosen from a group of sensors comprising a wheel speed sensor 16(a), an integrated inertia sensor 16(b) and the like. For instance, the wheel speed sensor 16(a) detects a variation in the wheel speed, when the vehicle 12 slows down due to the presence of a pothole 11 on the road. Similarly, the integrated inertia sensor 16(b) detects the variation in the acceleration and the yaw rate when the vehicle 12 moves/vibrates sideways during the operating state due to the presence of the pothole 11.

[0010] Figure 2 illustrates a flowchart of a method of detecting a pothole, in a vehicle. The vehicle 12 comprises an image capturing unit 14 and at least one sensing element 16 for detecting a variation in at least one vehicle parameter. In step S1, a variation in at least one vehicle parameter is detected. In step S2, a cluster of images 18 are captured by an image capturing unit 14 when the variation in the at least one vehicle parameter is detected. In step S3,the image capturing unit 14 is activated for capturing the pothole 11 on the road and the captured cluster of images 18 are processed by an image processing unit 24. In step S4,the processed cluster of images 18 are transmitted to a cloud repository 20 for a future reference.

[0011] The method is explained in detail. Due to the damage of the road (either by the construction works, natural calamities, improper use of quality materials), the potholes 11 or any kind of depression 11 will be formed, which not only affects the driving of the vehicle 12 but also will become hazardous. In order to properly detect the pothole 11 and to alert the user of the vehicles 12 much in advance, the present invention provides a solution in this disclosure. When the vehicle 12 is in operating state, the device 10 continuously monitors multiple vehicle parameters.

[0012] Upon detecting a variation in at least one vehicle parameter, the processor 26 of the device 10 activates the image capturing unit 14 that is positioned in the rear side of the vehicle 12 to capture the cluster of images 18 of that segment of the road. For example. due to the presence of the pothole 11, the wheel speed is reduced and the wheel speed sensor 16(a) of the device 10 upon detecting the change in the wheel speed, transmits a signal to the processor 26 of the device 10 for activating the image capturing unit 14, which is a rear sensor for capturing that segment of the road. In another scenario, due to the pothole 11 present on the road, the vehicle 12 moves sideways which changes the acceleration or yaw rate levels.

[0013] The captured cluster of images 18 are processed further using the image processing unit 24. The image processing unit 24 process the captured cluster of images 18 and identifies the required portions in the cluster of images 18 and extracts the pothole 11/depression on the road portion and transmits the same to the cloud-repository 20. The image processing unit 24 process the cluster of images 18 to extract other portions that are related to the road work like a fallen tree, a construction cone, a speed breaker, a road closure sign and the like. The same is transmitted to the cloud-repository 20. This process of extracting and transmitting occurs continuously throughout the vehicle operating state.

[0014] Once the extracted portion of the captured cluster of images 18 are stored in the cloud-repository 20, the other vehicle that are passing the same route/road or the vehicles that needs to take the same route/road, can get the pothole 11 or damage 11 to the road information much ahead in advance. I.e.., the navigation unit/device 10 of the vehicle 12 receives the cluster of images 18 of the pothole 11 from the cloud -repository 20 while traveling via the same route/road and the processor 26 present in the vehicle 10 alerts the user of the vehicle 10 before a predefined distance. In case of cruise controlling mode of the vehicle 10, the processor 26 slows /reduces the speed of the vehicle 10 upon receiving the information from the cluster of images 18 of the pothole 11/damage to the work/road work related from the cloud repository 20.

[0015] According to one embodiment of the invention, the device 10 generates different level of alerts to the user of the vehicle 12 based on the state of the detected pothole 11 from the captured cluster of images 18. For instance, if the pothole 11 extracted from the cluster of images 18 is large and deep, then the processor 26 generates a high level of alert and provides a suggestion for the user of the vehicle 12 to take a different route. One set of clusters of images 18 are captured for every of 5milli seconds and when the captured images 18 are categorized as bad, then the images 18 are shared onto the cloud repository 20 and then to the navigation unit 10 or navigation applications present in the vehicle 12, for the user to decide to take the route or not. Whereas if the cluster of images 18 are categorized as good then a message is transmitted to cloud repository 20 in order to optimize the amount of data being processed.

[0016] With the above-mentioned device 10 and method, the presence of the pothole 11 or any damage 11 to the road can be identified/detected much in advance, which not only helps in avoiding unnecessary damage to the vehicle 12 but also reduces the discomfort to the user while taking that route.

[0017] It should be understood that embodiments explained in the description above are only illustrative and do not limit the scope of this invention. Many such embodiments and other modifications and changes in the embodiment explained in the description are envisaged. The scope of the invention is only limited by the scope of the claims.
, Claims:We Claim:

1. A device (10) for detecting a pothole (11) in a vehicle (12), said vehicle (12) comprising :
- an image capturing unit (14) positioned at a rear side of said vehicle (12),
- at least one sensing element (16) for detecting at least one vehicle parameter;
characterized in that :
said device (10) comprises a processor (11) for detecting a variation in said at least one vehicle parameter;
said processor (11) activates said image capturing unit (14) for capturing a cluster of images (18) of said road when said variation is detected.

2. The device (10) as claimed in claim 1, wherein said captured cluster of images are transmitted to a cloud repository (20) via a transreceiver (22) of said device (10).

3. The device (10) as claimed in claim 1, wherein said at least one sensing element (16) is chosen from any one of said sensing elements comprising a wheel speed sensor (16(a)) and an integrated inertia sensor (16(b)).

4. The device (10) as claimed in claim 3, wherein said variation in said vehicle parameter is a wheel speed variation detected by said wheel speed sensor (16(a)) and an acceleration and a yaw rate variation detected by said integrated inertia sensor (16(b)).

5. The device (10) as claimed in claim 1, wherein an image processing unit (24) of said device (10) adapted to process said captured cluster of images (18) for detecting a pothole (11) .

6. The device (10) as claimed in claim 1, wherein based on said transmitted image to a cloud repository (20) , said device (10) adapted to generate an alert before a predefined distance to at least one of the other vehicle travelling that route.

7. The device (10) as claimed in claim 1, wherein a level of said generated alert differs based on a state of a pothole(11) present in at least one said cluster of captured images (18) .

8. The device as claimed in claim 1, wherein said image capturing unit (14) is a rear-view camera positioned in said vehicle (12).

9. A method for detecting a pothole (11), in a vehicle (12), said vehicle (12) comprising an image capturing unit (14), at least one sensing element (16) for detecting a variation in at least one vehicle parameter, said method comprising :
- detecting a variation in at least one vehicle parameter ;
- capturing a cluster of images(18) by an image capturing unit (14) when said variation in said at least one vehicle parameter is detected ;
- processing said captured cluster of images (18) by an image processing unit (24) where said captured image comprises said pothole (11);
- transmitting said processed cluster of images (18) to a cloud repository (20) for a future reference.

10. The method as claimed in claim 9, wherein alerting at least one other vehicle regarding said detected pothole (11) while travelling that route