Abstract: A visual aid-based drowsiness detection and warning initiation system (100), wherein the system (100) comprising: an iris detection unit (102) comprises: an iris sensor (104) embedded in a rear mirror of a vehicle, to capture images of iris of a driver from different angles; a processing unit (106) connected to the iris sensor (104), wherein the processing unit (106) is configured to: cluster the captured images of the iris to determine a state of eyes of the driver such that the state of the eyes is determined based on a detection of the iris; and transmit an actuation signal to a hardware board (108) to trigger vibrators (110a-110b) installed within the vehicle to alert the driver when the state of the eyes is determined as closed.
Description: BACKGROUND
Field of the invention
[001] Embodiments of the present invention generally relate to a drowsiness detection system and particularly to a visual aid-based drowsiness detection and warning initiation system and method thereof.
Description of Related Art
[002] Driver drowsiness is one of major causes of road accidents which in turn leads to deaths, injuries, and economic loss. Drivers lose their control on a vehicle if they are feeling sleepy. Vehicle accident is not only a disaster for a victim but also for their family members. Further, transportation is a most important criteria in today’s economic world that serves in many aspects in terms of carrying people from one point to another point for different perspective. Also, the transportation serves to carry essential commodities to meet daily needs. The safety and transportation are mirror and its reflection. The safety transportation is entrusted by a skill of the driver or operator.
[003] Medical records claim that, a healthier person needs minimum 8 hours of sleep to remain stable physically and mentally. The transportation usually done in majority at night time as per transportation norms and, in consideration with an ease of traffic flow. Traffic surveys show that, the majority of accidents occurs in midnight, due to loss of control of the operator. The occurrence of loss of control is an outcome of drowsiness which is accidental but not incidental. However, to avoid the accidents, various systems have been introduced to detect the drowsiness of the driver in the vehicle.
[004] Conventionally, the systems which are available for drowsiness detection, captures images from a camera to determine a precise measurement of percentage of closure of eyes of the driver. However, such systems monitor an eyelid position of each eye, when the eyes of the driver are equal or greater than a pre-defined percentage of the closure. Hence, results obtained from such systems are not very accurate. Moreover, a percentage technique used in such systems are not cost-effective.
[005] There is thus a need for an advanced and more-effective system and method for detecting the drowsiness of the driver that can administer the drawbacks faced by the conventional systems.
SUMMARY
[006] Embodiments in accordance with the present invention provide a visual aid-based drowsiness detection and warning initiation system. The system comprising: an iris detection unit comprises: an iris sensor embedded in a rear mirror of a vehicle, to capture images of iris of a driver from different angles. The iris detection unit further comprises: a processing unit connected to the iris sensor. The processing unit is configured to: cluster the captured images of the iris to determine a state of eyes of the driver such that the state of the eyes is determined based on a detection of the iris; and transmit an actuation signal to a hardware board to trigger vibrators installed within the vehicle to alert the driver about drowsiness when the state of the eyes is determined as closed.
[007] Embodiments in accordance with the present invention further provide a method of detecting drowsiness and initiate warning based on iris detection. The method comprising steps of: capturing images of iris of a driver from different angles by an iris sensor; clustering the captured images of the iris to determine a state of eyes of the driver such that the state of the eyes is determined based on a detection of the iris; transmitting an actuation signal to a hardware board to trigger vibrators installed within a vehicle to alert the driver about drowsiness when the state of the eyes is determined as closed.
[008] Embodiments of the present invention may provide a number of advantages depending on its particular configuration. First, embodiments of the present application may provide a visual aid-based drowsiness detection and warning initiation system.
[009] Next, embodiments of the present application may provide a visual aid-based drowsiness detection and warning initiation system that may alert drivers during drowsiness.
[0010] Next, embodiments of the present application may provide a visual aid-based drowsiness detection and warning initiation system that facilitates monitoring as well as initiates a controlling action to prevent accidents.
[0011] These and other advantages will be apparent from the present application of the embodiments described herein.
[0012] The preceding is a simplified summary to provide an understanding of some embodiments of the present invention. This summary is neither an extensive nor exhaustive overview of the present invention and its various embodiments. The summary presents selected concepts of the embodiments of the present invention in a simplified form as an introduction to the more detailed description presented below. As will be appreciated, other embodiments of the present invention are possible utilizing, alone or in combination, one or more of the features set forth above or described in detail below.
BRIEF DESCRIPTION OF THE DRAWINGS
[0013] The above and still further features and advantages of embodiments of the present invention will become apparent upon consideration of the following detailed description of embodiments thereof, especially when taken in conjunction with the accompanying drawings, and wherein:
[0014] FIG. 1 illustrates a block diagram of a visual aid-based drowsiness detection and warning initiation system, according to an embodiment of the present invention;
[0015] FIG. 2 illustrates components of a processing unit of the visual aid-based drowsiness detection and warning initiation system, according to an embodiment of the present invention; and
[0016] FIG. 3 illustrates a flowchart of a method of detecting drowsiness and initiate warning based on iris detection, according to an embodiment of the present invention.
[0017] The headings used herein are for organizational purposes only and are not meant to be used to limit the scope of the description or the claims. As used throughout this application, the word "may" is used in a permissive sense (i.e., meaning having the potential to), rather than the mandatory sense (i.e., meaning must). Similarly, the words “include”, “including”, and “includes” mean including but not limited to. To facilitate understanding, like reference numerals have been used, where possible, to designate like elements common to the figures. Optional portions of the figures may be illustrated using dashed or dotted lines, unless the context of usage indicates otherwise.
DETAILED DESCRIPTION
[0018] The following description includes the preferred best mode of one embodiment of the present invention. It will be clear from this description of the invention that the invention is not limited to these illustrated embodiments but that the invention also includes a variety of modifications and embodiments thereto. Therefore, the present description should be seen as illustrative and not limiting. While the invention is susceptible to various modifications and alternative constructions, it should be understood, that there is no intention to limit the invention to the specific form disclosed, but, on the contrary, the invention is to cover all modifications, alternative constructions, and equivalents falling within the spirit and scope of the invention as defined in the claims.
[0019] "In any embodiment described herein, the open-ended terms "comprising", "comprises”, and the like (which are synonymous with "including", "having” and "characterized by") may be replaced by the respective partially closed phrases "consisting essentially of", “consists essentially of", and the like or the respective closed phrases "consisting of", "consists of”, the like."
[0020] As used herein, the singular forms “a”, “an”, and “the” designate both the singular and the plural, unless expressly stated to designate the singular only.
[0021] FIG. 1 illustrates a visual aid-based drowsiness detection and warning initiation system 100 (hereinafter referred to as the system 100), according to an embodiment of the present invention. According to embodiments of the present invention, the system 100 may be configured to monitor a driver of a vehicle and initiates a controlling action to prevent accidents. In an embodiment of the present invention, the system 100 may comprise an iris detection unit 102 that may be configured to recognize a state of eyes of the driver. The state of eyes may be, open or closed, in an embodiment of the present invention. Further, in an embodiment of the present invention, the iris detection unit 102 may comprise an iris sensor 104 and a processing unit 106.
[0022] The iris sensor 104 may be embedded in a rear mirror of the vehicle as an array of focus. The iris sensor 104 may be embedded in the rear mirror of the vehicle without any projection or disturbance to the driver, in an embodiment of the present invention. The iris sensor 104 may be configured to capture images of iris of the driver from different angles. The iris sensor 104 may use infrared light to generate highly-detailed images of unique patterns in an individual's iris. The iris sensor 104 may be configured to transmit the captured images of the iris to the processing unit 106, in an embodiment of the present invention.
[0023] The processing unit 106 may be connected to the iris sensor 104, to receive the captured images of the iris from the iris sensor 104. The processing unit 106 may be configured to execute computer executable instructions to generate an output. The output may be the state of the eyes of the driver based on the captured images of the iris, in an embodiment of the present invention. The processing unit 106 may be, but not limited to, a microprocessor, a Programmable Logic Control unit (PLC), a microcontroller, a computing device, a development board, and so forth. Embodiments of the present invention are intended to include or otherwise cover any type of the processing unit 106 including known related art and/or later developed technologies.
[0024] The system 100 may further comprise a hardware board 108 that may be configured to receive an actuation signal from the iris detection unit 102, in an embodiment of the present invention. The hardware board 108 may be configured to trigger vibrators 110a-110b to alert the driver based on the received actuation signal, in an embodiment of the present invention. In a preferred embodiment of the present invention, the hardware board 108 may be a PYNQ board. Embodiments of the present invention are intended to include or otherwise cover any type of the hardware board 108 including known related art and/or later developed technologies.
[0025] The vibrators 110a-110b may be removably installed in a steering and an accelerator paddle of the vehicle, in an embodiment of the present invention. In another embodiment of the present invention, the vibrators 110a-110b may be fixedly installed in the steering and the accelerator paddle of the vehicle. The vibrators 110a-110b may be used to alert the driver by using a vibration mechanism, in an embodiment of the present invention. The vibrators 110a-110b may be configured to start vibrating to alert the driver during drowsiness and, to alert co-passengers sitting in the vehicle, in an embodiment of the present invention.
[0026] The system 100 may further comprise a database 112 that may be configured to store data associated with the captured images of iris of the driver, in an embodiment of the present invention. In some embodiments of the present invention, the system 100 may comprise multiple databases (not shown) to store the data associated with the captured images of iris of the driver. The database 112 may be, but not limited to, a centralized database, a distributed database, a personal database, an end-user database, a commercial database, a Structured Query Language (SQL) database, a NoSQL database, an operational database, a relational database, an object-oriented database, a graph database, and so forth. In a preferred embodiment of the present invention, the database 112 may be a cloud database. Embodiments of the present invention are intended to include or otherwise cover any type of the database 112 including known, related art, and/or later developed technologies.
[0027] In an embodiment of the present invention, the captured images of the iris that may be stored in the database 112 may be monitored by a user remotely from a user device (not shown). The user device may be, but not limited to, a mobile device, a smart phone, a tablet computer, a portable computer, a laptop computer, a desktop computer, a smart device, and so forth. Embodiments of the present invention are intended to include or otherwise cover any type of the user device, including known, related art, and/or later developed technologies.
[0028] In an embodiment of the present invention, the iris detection unit 102, the hardware board 108, the vibrators 110a-110b, and the database 112 may be connected to each other through a network 114. According to embodiments of the present invention, the network 114 may be a data network such as, but not limited to, the Internet, a Local Area Network (LAN), a Wide Area Network (WAN), a Metropolitan Area Network (MAN), and so forth. Embodiments of the present invention are intended to include or otherwise cover any type of the data network, including known, related art, and/or later developed technologies. In some embodiments of the present invention, the network 114 may be a wireless network, such as, but not limited to, a cellular network and may employ various technologies including an Enhanced Data Rates for Global Evolution (EDGE), a General Packet Radio Service (GPRS), and so forth. Embodiments of the present disclosure are intended to include or otherwise cover any type of the wireless network, including known, related art, and/or later developed technologies.
[0029] FIG. 2 illustrates components of the processing unit 106 of the iris detection unit 102, according to an embodiment of the present invention. The components may be an input receiving module 200, a data processing module 202, and a vibrator control module 204.
[0030] The input receiving module 200 may be configured to receive the captured images of the iris of the driver from the iris sensor 104. Further, the input receiving module 200 may be configured to transmit the received captured images of the iris to the data processing module 202, in an embodiment of the present invention.
[0031] Further, the data processing module 202 may be configured to cluster the captured images of the iris into segments by using a data clustering technique, in an embodiment of the present invention. The data processing module 202 may be configured to cluster the captured images of the iris to determine the state of the eyes of the driver, in an embodiment of the present invention. The state of the eyes may be determined based on the detection of the iris, in an embodiment of the present invention. The data clustering technique may be, but not limited to, a k-means clustering, and so forth. Embodiments of the present invention are intended to include or otherwise cover any type of the data clustering technique including known related art and/or later developed technologies.
[0032] In an embodiment of the present invention, the data processing module 202 may be configured to determine the state of the eyes as open, when the iris is detected. In such embodiment of the present invention, the data processing module 202 may be configured to generate a vibrator deactivation signal, when the iris is detected. The data processing module 202 may be configured to transmit the generated vibrator deactivation signal to the vibrator control module 204.
[0033] In another embodiment of the present invention, the data processing module 202 may be configured to determine the state of the eyes as closed, when the iris is not detected. In such embodiment of the present invention, the data processing module 202 may be configured to generate a vibrator activation signal, when the iris is not detected. The data processing module 202 may be configured to transmit the generated vibrator activation signal to the vibrator control module 204.
[0034] The vibrator control module 204 may be configured to enable the hardware board 108 to trigger the vibrators 110a-110b installed in the steering and the accelerator paddle of the vehicle based on the vibrator activation signal. The vibrator control module 204 may be configured to enable the hardware board 108 to trigger the vibrators 110a-110b to generate the vibration for alerting the driver during drowsiness.
[0035] The vibrator control module 204 may be configured to enable the hardware board 108 to deactivate the vibrators 110a-110b installed in the steering and the accelerator paddle of the vehicle based on the vibrator deactivation signal.
[0036] FIG. 3 illustrates a flowchart of a method 300 of detecting the drowsiness and initiate warning based on the iris detection, according to an embodiment of the present invention.
[0037] At step 302, the system 100 may receive the images of iris captured from different angles from the iris sensor 104 that may be embedded within the rear mirror of the vehicle.
[0038] At step 304, the system 100 may detect whether eyes of the user are closed or open based on the captured image of the iris. The method 300 may proceed to a step 306, when the eyes of the user are open. Otherwise, the method 300 may proceed to a step 308.
[0039] At the step 306, the system 100 may deactivate the vibrators 110a-110b fixed in the steering and the accelerator paddle of the vehicle.
[0040] At the step 308, the system 100 may activate the vibrators 110a-110b fixed in the steering and the accelerator paddle of the vehicle to alert the driver.
[0041] Embodiments of the disclosure are described above with reference to block diagrams and schematic illustrations of methods and systems according to embodiments of the disclosure. It will be understood that each block of the diagrams and combinations of blocks in the diagrams can be implemented by computer program instructions. These computer program instructions may be loaded onto one or more general purpose computers, special purpose computers, or other programmable data processing apparatus to produce machines, such that the instructions which execute on the computers or other programmable data processing apparatus create means for implementing the functions specified in the block or blocks. Such computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means that implement the function specified in the block or blocks.
[0042] While the invention has been described in connection with what is presently considered to be the most practical and various embodiments, it is to be understood that the invention is not to be limited to the disclosed embodiments, but on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.
[0043] This written description uses examples to disclose the invention, including the best mode, and also to enable any person skilled in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. The patentable scope the invention is defined in the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements within substantial differences from the literal languages of the claims.
, Claims: I/We Claim:
1. A visual aid-based drowsiness detection and warning initiation system (100), the system (100) comprising:
an iris detection unit (102) comprises:
an iris sensor (104) embedded in a rear mirror of a vehicle, to capture images of iris of a driver from different angles; and
a processing unit (106) connected to the iris sensor (104), wherein the processing unit (106) is configured to:
cluster the captured images of the iris to determine a state of eyes of the driver such that the state of the eyes is determined based on a detection of the iris; and
transmit an actuation signal to a hardware board (108) to trigger vibrators (110a-110b) installed within the vehicle to alert the driver about drowsiness when the state of the eyes is determined as closed.
2. The system (100) as claimed in claim 1, wherein the hardware board (108) is a PYNQ board.
3. The system (100) as claimed in claim 1, wherein the vibrators (110a-110b) are installed at a steering and an accelerator paddle of the vehicle.
4. The system (100) as claimed in claim 1, wherein the processing unit (106) is configured to transmit a deactivation signal to the hardware board (108) to deactivate the vibrators (110a-110b) when the state of the eyes is determined as open.
5. The system (100) as claimed in claim 1, wherein the processing unit (106) is configured to store data associated with the captured images of iris of the driver in a database (112).
6. A method of detecting drowsiness and initiate warning based on iris detection, wherein the method comprising steps of:
capturing images of iris of a driver from different angles by an iris sensor (104);
clustering the captured images of the iris to determine a state of eyes of the driver such that the state of the eyes is determined based on a detection of iris; and
transmitting an actuation signal to a hardware board (108) to trigger vibrators (110a-110b) installed within a vehicle to alert the driver about drowsiness when the state of the eyes is determined as closed.
7. The method as claimed in claim 6, wherein the hardware board (108) is a PYNQ board.
8. The method as claimed in claim 6, wherein the vibrators (110a-110b) are installed at a steering and an accelerator paddle of the vehicle.
9. The method as claimed in claim 6, comprising a step of transmitting a deactivation signal to the hardware board (108) to deactivate the vibrators (110a-110b) when the state of the eyes is determined as open.
10. The method as claimed in claim 6, comprising a step of storing data associated with the captured images of iris of the driver in a database (112).
Date: 19th April, 2022
Place: Noida
Nainsi Rastogi
Patent Agent (IN/PA-2372)
Agent for the Applicant
| # | Name | Date |
|---|---|---|
| 1 | 202241023366-STATEMENT OF UNDERTAKING (FORM 3) [20-04-2022(online)].pdf | 2022-04-20 |
| 2 | 202241023366-REQUEST FOR EARLY PUBLICATION(FORM-9) [20-04-2022(online)].pdf | 2022-04-20 |
| 3 | 202241023366-POWER OF AUTHORITY [20-04-2022(online)].pdf | 2022-04-20 |
| 4 | 202241023366-OTHERS [20-04-2022(online)].pdf | 2022-04-20 |
| 5 | 202241023366-FORM-9 [20-04-2022(online)].pdf | 2022-04-20 |
| 6 | 202241023366-FORM FOR SMALL ENTITY(FORM-28) [20-04-2022(online)].pdf | 2022-04-20 |
| 7 | 202241023366-FORM 1 [20-04-2022(online)].pdf | 2022-04-20 |
| 8 | 202241023366-FIGURE OF ABSTRACT [20-04-2022(online)].jpg | 2022-04-20 |
| 9 | 202241023366-EVIDENCE FOR REGISTRATION UNDER SSI(FORM-28) [20-04-2022(online)].pdf | 2022-04-20 |
| 10 | 202241023366-EDUCATIONAL INSTITUTION(S) [20-04-2022(online)].pdf | 2022-04-20 |
| 11 | 202241023366-DRAWINGS [20-04-2022(online)].pdf | 2022-04-20 |
| 12 | 202241023366-DECLARATION OF INVENTORSHIP (FORM 5) [20-04-2022(online)].pdf | 2022-04-20 |
| 13 | 202241023366-COMPLETE SPECIFICATION [20-04-2022(online)].pdf | 2022-04-20 |
| 14 | 202241023366-FORM 18 [02-03-2023(online)].pdf | 2023-03-02 |
| 15 | 202241023366-FER.pdf | 2023-08-08 |
| 16 | 202241023366-OTHERS [31-01-2024(online)].pdf | 2024-01-31 |
| 17 | 202241023366-FER_SER_REPLY [31-01-2024(online)].pdf | 2024-01-31 |
| 18 | 202241023366-DRAWING [31-01-2024(online)].pdf | 2024-01-31 |
| 19 | 202241023366-CORRESPONDENCE [31-01-2024(online)].pdf | 2024-01-31 |
| 20 | 202241023366-COMPLETE SPECIFICATION [31-01-2024(online)].pdf | 2024-01-31 |
| 21 | 202241023366-CLAIMS [31-01-2024(online)].pdf | 2024-01-31 |
| 22 | 202241023366-ABSTRACT [31-01-2024(online)].pdf | 2024-01-31 |
| 23 | 202241023366-RELEVANT DOCUMENTS [30-03-2024(online)].pdf | 2024-03-30 |
| 24 | 202241023366-POA [30-03-2024(online)].pdf | 2024-03-30 |
| 25 | 202241023366-FORM 13 [30-03-2024(online)].pdf | 2024-03-30 |
| 26 | 202241023366-US(14)-HearingNotice-(HearingDate-01-07-2024).pdf | 2024-06-18 |
| 27 | 202241023366-Correspondence to notify the Controller [24-06-2024(online)].pdf | 2024-06-24 |
| 28 | 202241023366-Written submissions and relevant documents [16-07-2024(online)].pdf | 2024-07-16 |
| 29 | 202241023366-RELEVANT DOCUMENTS [16-07-2024(online)].pdf | 2024-07-16 |
| 30 | 202241023366-PETITION UNDER RULE 137 [16-07-2024(online)].pdf | 2024-07-16 |
| 31 | 202241023366-Annexure [16-07-2024(online)].pdf | 2024-07-16 |
| 32 | 202241023366-PatentCertificate07-08-2024.pdf | 2024-08-07 |
| 33 | 202241023366-IntimationOfGrant07-08-2024.pdf | 2024-08-07 |
| 1 | SearchE_07-08-2023.pdf |