[0001] The present disclosure, in general, relates to a driver state monitoring
5 apparatus to monitor driver state and respond accordingly in a vehicle. In
particular, to a method and an apparatus for monitoring driver state and generating
warning/alert based on angle of deviation of driver’s head, vehicle speed and time
of distraction.
BACKGROUND
10 [0002] Background description includes information that may be useful in
understanding the present invention.
[0003] Today, drowsiness or distracted state of the driver is one of the major
cause for road accidents.
[0004] To monitor the state of the driver and giving alerts are known in the
15 art. The existing systems generates distraction alerts based on static time or static
distraction angle based threshold values.
[0005] Technical problem in the existing systems are too frequent alerts
when threshold is very low and very rare alerts when threshold is very high. For
example, a system has static distraction angle threshold value. In this system,
20 when driver moves his head for a fraction of second, the system will generate the
warning/alert which may not be useful. Further, a small distraction angle which is
below the threshold value for a long time while driving the vehicle may cause a
problem and results in an accident.
[0006] In the view of the above-cited problem(s), there is a need for a method
25 and a system that can generate alerts based upon the real time level of distraction.
OBJECTS OF THE DISCLOSURE
[0007] Some of the objects of the present disclosure, which at least one
embodiment herein satisfy, are listed hereinbelow.
3
[0008] It is a general object of the present disclosure to provide a driver state
monitoring apparatus to monitor state of driver and generate alerts based upon
degree/intensity of distraction which is calculated collectively based on the time
duration, speed of the vehicle, and angle of deviation of the driver.
5 [0009] It is another object of the present disclosure to provide the apparatus
that generates effective alerts.
[0010] It is another object of the present disclosure to provide a method to
monitor state of driver and generate alerts based upon degree/intensity of
distraction which is calculated collectively based on the time duration, speed of
10 the vehicle, and angle of deviation of the driver.
[0011] These and other objects and advantages of the present invention will be
apparent to those skilled in the art after a consideration of the following detailed
description taken in conjunction with the accompanying drawings in which a
preferred form of the present invention is illustrated.
15 SUMMARY
[0012] This summary is provided to introduce concepts related to an apparatus
and a method to monitor state of a driver of the vehicle and generate alerts based
upon degree/intensity of distraction which is calculated collectively based on the
time duration, speed of the vehicle, and angle of deviation of the driver. The
20 concepts are further described below in the detailed description. This summary is
not intended to identify key features or essential features of the claimed subject
matter, nor is it intended to be used to limit the scope of the claimed subject
matter.
[0013] In an embodiment, the present disclosure relates to a driver state
25 monitoring apparatus to monitor state of driver of the vehicle and give
warnings/alerts when driver is distracted beyond a predefined level. The apparatus
comprising a vehicle speed calculation unit coupled with vehicle speed sensor to
calculate speed of the vehicle (Vs); a deviation angle calculation unit coupled with
an image capturing apparatus to calculate angle of deviation (α) of head of driver
4
based on a plurality of captured images; a distraction level determining unit to
determine sum of products (SOP) of the calculated angle of deviation (α) and the
calculated speed of the vehicle (Vs) for a time of distraction (Td), where the time
of distraction (Td) starts when angle of deviation (α) is more than zero degree; and
5 a warning generating unit coupled with a warning actuator to generate a warning
signal when the determined sum of products (SOP) is more than a predefined
threshold value (THsop).
[0014] In an aspect, the distraction level determining unit: calculates, at
predetermined regular time period interval (TPi), product of the calculated angle
10 of deviation (α), the calculated speed of the vehicle (Vs), and the predetermined
time period interval (TPi); and calculates the sum of the products of the calculated
angle of deviation (α), the calculated speed of the vehicle (Vs), and the
predetermined time period interval (TPi) at each of the predetermined regular time
period interval (TPi) until the calculated angle of deviation (α) is zero degree for a
15 predetermined time duration.
[0015] In an aspect, the sum of products (SOP) is zero when the angle of
deviation (α) is zero degree for a predetermined time duration.
[0016] In an aspect, the warning actuator generates audio or visual or haptic
warning based on the warning signal.
20 [0017] In an aspect, the image capturing apparatus is positioned in front of
driver seat in vehicle cabin to capture the plurality of captured images.
[0018] In another embodiment, the present disclosure relates to a method to
monitor state of driver of the vehicle and give warnings/alerts when driver is
distracted beyond a predefined level. The method comprising: calculating speed of
25 the vehicle (Vs); capturing image of the driver by the image capturing apparatus
and calculating an angle of deviation (α); determining sum of products (SOP) of
the calculated angle of deviation (α) and the calculated speed of the vehicle (Vs)
for a time of distraction (Td), where the time of distraction (Td) starts when angle
of deviation (α) is more than zero degree; and generating a warning signal to a
5
warning actuator when the determined sum of products (SOP) is more than a
predefined threshold value (THsop).
[0019] In an aspect, the method includes the determining, comprises:
calculating, at predetermined regular time period interval (TPi), product of the
5 calculated angle of deviation (α), the calculated speed of the vehicle (Vs), and the
predetermined time period interval (TPi); and calculating sum of the products of
the calculated angle of deviation (α), the calculated speed of the vehicle (Vs), and
the predetermined time period interval (TPi) at each of the predetermined regular
time period interval (TPi) until the calculated angle of deviation (α) is zero degree
10 or less than the zero degree.
[0020] In an aspect, the method includes the sum of products (SOP) is zero
when the angle of deviation (α) is zero degree or less than the zero degree.
[0021] Various objects, features, aspects, and advantages of the inventive
subject matter will become more apparent from the following detailed description
15 of preferred embodiments, along with the accompanying drawing figures in which
like numerals represent like components.
[0022] It is to be understood that the aspects and embodiments of the
disclosure described above may be used in any combination with each other.
Several of the aspects and embodiments may be combined to form a further
20 embodiment of the disclosure.
[0023] The foregoing summary is illustrative only and is not intended to be in
any way limiting. In addition to the illustrative aspects, embodiments, and features
described above, further aspects, embodiments, and features will become apparent
by reference to the drawings and the following detailed description.
25 BRIEF DESCRIPTION OF THE DRAWINGS
[0024] The accompanying drawings, which are incorporated in and constitute
a part of this disclosure, illustrate exemplary embodiments and, together with the
description, serve to explain the disclosed principles. In the figures, the left-most
digit(s) of a reference number identifies the figure in which the reference number
6
first appears. The same numbers are used throughout the figures to reference like
features and components. Some embodiments of system and/or methods in
accordance with embodiments of the present subject matter are now described, by
way of example only, and with reference to the accompanying figures, in which:
5 [0025] Fig. 1 illustrates a schematic view of driver side and apparatus/system
side components of a vehicle;
[0026] Fig. 2 illustrates block diagram of ECU with camera and vehicle speed
sensor;
[0027] Fig. 3 illustrates a block diagram of a driver state monitoring apparatus
10 of fig. 3; and
[0028] Fig. 4 illustrates a method for monitoring state of driver and generating
alerts.
[0029] It should be appreciated by those skilled in the art that any block
diagrams herein represent conceptual views of illustrative systems embodying the
15 principles of the present subject matter. Similarly, it will be appreciated that any
flow charts, flow diagrams, state transition diagrams, pseudo code, and the like
represent various processes which may be substantially represented in a computerreadable medium and executed by a computer or processor, whether or not such
computer or processor is explicitly shown.
20 DETAILED DESCRIPTION
[0030] The detailed description of various exemplary embodiments of the
disclosure is described herein with reference to the accompanying drawings. It
should be noted that the embodiments are described herein in such details as to
clearly communicate the disclosure. However, the amount of details provided
25 herein is not intended to limit the anticipated variations of embodiments; on the
contrary, the intention is to cover all modifications, equivalents, and alternatives
falling within the spirit and scope of the present disclosure as defined by the
appended claims.
7
[0031] It is also to be understood that various arrangements may be devised
that, although not explicitly described or shown herein, embody the principles of
the present disclosure. Moreover, all statements herein reciting principles, aspects,
and embodiments of the present disclosure, as well as specific examples, are
5 intended to encompass equivalents thereof.
[0032] The terminology used herein is for the purpose of describing particular
embodiments only and is not intended to be limiting of example embodiments. As
used herein, the singular forms “a", “an” and “the” are intended to include the
plural forms as well, unless the context clearly indicates otherwise. It will be
10 further understood that the terms “comprises,” “comprising,” “includes” and/or
“including,” when used herein, specify the presence of stated features, integers,
steps, operations, elements and/or components, but do not preclude the presence
or addition of one or more other features, integers, steps, operations, elements,
components and/or groups thereof.
15 [0033] In addition, the descriptions of "first", "second", “third”, and the like in
the present invention are used for the purpose of description only, and are not to
be construed as indicating or implying their relative importance or implicitly
indicating the number of technical features indicated. Thus, features defining
"first" and "second" may include at least one of the features, either explicitly or
20 implicitly.
[0034] It should also be noted that in some alternative implementations, the
functions/acts noted may occur out of the order noted in the figures. For example,
two figures shown in succession may, in fact, be executed concurrently or may
sometimes be executed in the reverse order, depending upon the functionality/acts
25 involved.
[0035] Unless otherwise defined, all terms (including technical and scientific
terms) used herein have the same meaning as commonly understood by one of
ordinary skill in the art to which example embodiments belong. It will be further
understood that terms, e.g., those defined in commonly used dictionaries, should
30 be interpreted as having a meaning that is consistent with their meaning in the
8
context of the relevant art and will not be interpreted in an idealized or overly
formal sense unless expressly so defined herein.
[0036] Micro-Controller: It is a compact integrated circuit designed to
govern a specific operation in an embedded system. A typical microcontroller
5 includes a processor, memory and input/output (I/O) peripherals on a single chip.
Generally, microcontrollers are designed to be readily usable without additional
computing components because they are designed with sufficient on board
memory as well as offering pins for general I/O operations, so they can directly
interface with sensors and other components.
10 [0037] FIG. 1 illustrates a schematic view of driver side and system side with
an Electronic Control Unit (ECU) 100 coupled with CAN bus to receive real time
vehicle speed from a vehicle speed sensor 105, an image capturing apparatus 103,
for example, camera, and warning actuator 102, for example, speaker or vibrator
coupled with handle or driver seat. As shown in fig. 1 and 2, the ECU 100
15 controls is main processing unit of a vehicle to receive all data of the vehicle
through various means, such as direct cable or CAN bus. As shown in fig. 1, the
image capturing apparatus 103 is positioned in front of the driver seat to capture
images of the driver while seating at the driver seat. The image capturing
apparatus 103 may capture images of the passenger and send the same to the
20 server for security purposes.
[0038] Fig. 2 illustrates block diagram of the system where ECU comprises a
driver state monitoring apparatus or driver state monitoring system to monitor
state of the driver and generate alerts based upon the degree/intensity of
distraction which is calculated collectively using time duration of distraction,
25 speed of the vehicle during that time duration, and angle of deviation. As shown
in fig. 2, the ECU 100 is coupled with a plurality of input devices and output
devices to receive the inputs and give the processed output signals, respectively.
[0039] Referring to fig. 1, 2, and 3, the present subject matter provides a
driver state monitoring apparatus 200 that may be implemented in the Electronic
30 Control Unit (ECU) 100 of the vehicle. In another embodiment, the driver state
9
monitoring apparatus 200 may be embedded in the ECU 100 or installed in the
ECU 100. In another embodiment, the driver state monitoring apparatus 200 may
be provided as a pre-configured micro-controller or as a standalone
device/apparatus to monitor the state of the driver and to generate alerts
5 accordingly. The standalone apparatus coupled with the ECU to receive various
inputs like speed of the vehicle, time and coupled with the camera to receive
captured image data. The driver state monitoring apparatus 200 includes a
processor(s) 202, an interface(s) 204, and a memory 206. In an embodiment, the
processor(s) 202, the interface(s) 204, and the memory 206 is same as of the ECU
10 100.
[0040] The processor(s) 202 may be implemented as one or more
microprocessors, microcomputers, microcontrollers, digital signal processors,
logic circuitries, and/or any devices that manipulate data based on operational
instructions.
15 [0041] Among other capabilities, the one or more processor(s) 202 are
configured to fetch and execute computer-readable instructions and one or more
routines stored in the memory 206. The memory 206 may store one or more
computer-readable instructions or routines, which may be fetched and executed to
implement to monitor driver state. The memory 206 may include any non20 transitory storage device including, for example, volatile memory such as RAM,
or non-volatile memory such as EPROM, flash memory, and the like.
[0042] The interface(s) 204 may include a variety of interfaces, for example,
interfaces for data input and output devices referred to as I/O devices, storage
devices, various sensors, such as speed sensor 105, and the like. The interface(s)
25 204 may facilitate communication of the driver state monitoring apparatus 200
with various devices, such as image capturing apparatus 103. The interface(s) 204
may also provide a communication pathway for one or more components of the
driver state monitoring apparatus 200. Examples of such components include, but
are not limited to, processing unit(s) 208 and data 220.
10
[0043] The processing unit(s) 208 may be implemented as a combination of
hardware and programming (for example, programmable instructions) to
implement one or more functionalities of the processing unit(s) 208. In examples
described herein, such combinations of hardware and programming may be
5 implemented in several different ways. For example, the programming for the
processing unit(s) 208 may be processor-executable instructions stored on a nontransitory machine-readable storage medium and the hardware for the processing
unit(s) 208 may include a processing resource (for example, one or more
processors), to execute such instructions. In the present examples, the machine10 readable storage medium may store instructions that, when executed by the
processing resource, implement the processing unit(s) 208. In such examples, the
driver state monitoring apparatus 200 may include the machine-readable storage
medium storing the instructions and the processing resource to execute the
instructions or the machine-readable storage medium may be separate but
15 accessible to the driver state monitoring apparatus 200 and the processing
resource. In other examples, the processing unit(s) 208 may be implemented by
electronic circuitry.
[0044] In an aspect, the processing unit(s) 208 may include a vehicle speed
calculation unit 212, a deviation angle calculation unit 214, a distraction level
20 determining unit 216, and a warning generating unit 218. The processing unit(s)
208 may include other unit(s) which may implement functionalities that
supplement applications or functions performed by the driver state monitoring
apparatus 200 or the processing unit(s) 208.
[0045] Further, the data 220 may include data that is either stored or generated
25 as a result of functionalities implemented by any of the components of the
processing unit(s) 208. In some aspects, the data 220 may be stored in the memory
206 in the form of various data structures. In the present subject matter, a table
may be provided as a data structure to receive real time values and store the
process values. The table is stored in the data 220 or in the memory 206.
30 Additionally, data 220 can be organized using data models, such as relational or
11
hierarchical data models. The data 220 may store data, including temporary data
and temporary files, generated by the processing unit(s) 208 for performing the
various functions of the driver state monitoring apparatus 200.
[0046] In operation, when the driver seats into the driver seat and starts the
5 vehicle, the driver state monitoring apparatus 200 starts monitoring the state of the
driver from the initial state by capturing images and vehicle speed. The deviation
angle calculation unit 214 receives the image from the image capturing apparatus
103 and detects the face angle with respect to pre-set straight line with respect to
driver seat. The deviation angle calculation unit 214 calculates angle of deviation
10 ‘α’ by below mentioned equation:
Angle of deviation (α) = Detected Face angle – predefined threshold angle value
……Eq. 1
[0047] Simultaneously, the vehicle speed calculation unit 212 calculates
vehicle speed from the signals received from the vehicle speed sensor 105. The
15 distraction level determining unit 216 determines sum of products (SOP) of the
calculated angle of deviation (α) and the calculated speed of the vehicle (Vs) for a
time of distraction (Td). The time of distraction (Td) starts when angle of
deviation (α) is more than zero degree.
[0048] The warning generating unit 218 coupled with the warning actuator
20 102 via the interface 204, the warning generating unit 218 generates a warning
signal to the warning actuator 102 when the determined sum of products (SOP) is
more than a predefined threshold value (THsop).
[0049] The distraction level determining unit 216 calculates, at predetermined
regular time period interval (TPi), product of the calculated angle of deviation (α),
25 the calculated speed of the vehicle (Vs), and the predetermined time period
interval (TPi). Further, the distraction level determining unit 216 calculates the
sum of the products of the calculated angle of deviation (α), the calculated speed
of the vehicle (Vs), and the predetermined time period interval (TPi) at each of the
12
predetermined regular time period interval (TPi) until the calculated angle of
deviation (α) is zero degree or less than zero degree.
[0050] The distraction level determining unit 216 calculates sum of products
(SOP) as zero when the angle of deviation (α) is zero degree for a predetermined
5 time duration.
[0051] The warning actuator 102 generates audio or visual or haptic warning
based on the warning signal.
[0052] Working example 1 with reference to Table 1 having all exemplary
10 values
TABLE 1
Time
Stamp
Time
Period=T2-
T1
Vehicle
Speed
(kmph)
Driver Face
Angle (°)
Deviation
Angle (°)
Product SOP
0 70 15.5 -4.5
0.1 0.1 71 16 -4 0
0.2 0.1 72 16.5 -3.5 0
0.3 0.1 73 17 -3 0
0.4 0.1 74 17.5 -2.5 0
0.5 0.1 75 18 -2 0
0.6 0.1 76 18.5 -1.5 0
13
0.7 0.1 77 19 -1 0
0.8 0.1 78 19.5 -0.5 0
0.9 0.1 79 20 0 0
1 0.1 80 20.5 0.5 4
1.1 0.1 81 21 1 8.1 12.1
1.2 0.1 82 21.5 1.5 12.3 24.4
1.3 0.1 83 22 2 16.6 41
1.4 0.1 84 22.5 2.5 21 62
1.5 0.1 85 23 3 25.5 87.5
1.6 0.1 86 23.5 3.5 30.1 117.6
1.7 0.1 87 24 4 34.8 152.4
1.8 0.1 88 24.5 4.5 39.6 192
1.9 0.1 89 25 5 44.5 236.5
2 0.1 90 25.5 5.5 49.5 286
2.1 0.1 91 26 6 54.6 340.6
2.2 0.1 90 26.5 6.5 58.5 399.1
14
2.3 0.1 89 27 7 62.3 461.4
2.4 0.1 88 27.5 7.5 66 527.4
2.5 0.1 87 28 8 69.6 597
2.6 0.1 86 28.5 8.5 73.1 670.1
2.7 0.1 85 29 9 76.5 746.6
2.8 0.1 84 29.5 9.5 79.8 826.4
[0053] As explained in the table 1, when the angle of deviation ‘α’ is more
than zero, here predetermined threshold angle value is taken as 20o
. Until the face
angle is 20o
, there is no deviation angle. Once the face angle goes beyond the 20o
5 which is predetermined threshold angle value, the deviation angle calculation unit
214 gives angle of deviation in positive degree for further calculation. Further, the
time period or one second time period, is divided into equal predetermined time
period intervals (TPi), for example 10, to product of the angle of deviation, speed
of the vehicle (Vs) and time period.
10 Product (P) = α (weightage 1) * time period (weightage 2)* speed of vehicle (Vs)
(weightage 3)….Eq.2
[0054] In another embodiment, each parameter may have equal weightage or
different weightage or dynamically changing weightage as per the requirement.
[0055] The distraction level determining unit 216 calculates the products at
15 each time period and further calculates sum of products for each time period by
adding products.
SOP = P1+P2+P3+P4+…………………until angle of deviation is zero for a
predetermined time duration ………………………Eq. 3
15
[0056] The warning generating unit 218 generates a warning signal to the
warning actuator 102 when the SOP at any time period interval is more than a
predefined threshold value here in table 1, the predefined threshold value is taken
5 as 800. Accordingly, the warning generating unit 218 generates a warning signal
to the warning actuator 102 when angle of deviation is 9.5o
, vehicle speed is 84
KMPH, and time of distraction is 1.8 seconds from the time when angle of
deviation is detected.
Table 2:
Time
Stamp
Time
Period=T2-
T1
Vehicle
Speed
(kmph)
Driver
Face
Angle (°)
Deviation
Angle (°) Product SOP
0 70 15.5 -4.5
0.1 0.1 71 16 -4 0
0.2 0.1 72 16.5 -3.5 0
0.3 0.1 73 17 -3 0
0.4 0.1 74 17.5 -2.5 0
0.5 0.1 75 18 -2 0
0.6 0.1 76 18.5 -1.5 0
0.7 0.1 77 19 -1 0
0.8 0.1 78 19.5 -0.5 0
0.9 0.1 79 20 0 0
1 0.1 80 20.5 0.5 4
1.1 0.1 81 25 5 40.5 44.5
1.2 0.1 82 27 7 57.4 101.9
1.3 0.1 83 25 5 41.5 143.4
1.4 0.1 84 28 8 67.2 210.6
16
1.5 0.1 85 35 15 127.5 338.1
1.6 0.1 86 32 12 103.2 441.3
1.7 0.1 87 35 15 130.5 571.8
1.8 0.1 88 35 15 132 703.8
1.9 0.1 89 35.5 15.5 137.95 841.8
[0057] In another example, as illustrated in table 2 where the warning
generating unit 218 generates a warning signal to the warning actuator 102 when
angle of deviation is 15.5o
, vehicle speed is 89 KMPH, and time of distraction is
5 0.8 seconds from the time when angle of deviation is detected.
[0058] Accordingly, present driver state monitoring apparatus 200 determines
level of distraction of state of drive collectively based on the time of distraction,
speed of the vehicle, and angle of deviation.
[0059] FIG. 4 illustrates a method 300 for monitoring state of driver and
10 generating warning signal based on level of distraction of driver which is
collectively based on time duration of distraction, speed of vehicle, and angle of
deviation. The order in which the method 300 is described is not intended to be
construed as a limitation, and any number of the described method blocks can be
combined in any appropriate order to carry out the method 300 or an alternative
15 method. Additionally, individual blocks may be deleted from the method 300
without departing from the scope of the subject matter described herein.
[0060] At block 302, the method includes calculating speed of the vehicle
(Vs).
[0061] At block 304, the method includes capturing image of the driver by the
20 image capturing apparatus 103 and calculating an angle of deviation (α). The
deviation angle is calculated by subtracting a predetermined threshold angle value
from the face angle.
[0062] At block 306, the method includes determining sum of products (SOP)
of the calculated angle of deviation (α) and the calculated speed of the vehicle
17
(Vs) for a time of distraction (Td), where the time of distraction (Td) starts when
angle of deviation (α) is more than zero degree. The method further includes
calculating, at predetermined regular time period interval (TPi), product of the
calculated angle of deviation (α), the calculated speed of the vehicle (Vs), and the
5 predetermined time period interval (TPi); and calculating sum of the products of
the calculated angle of deviation (α), the calculated speed of the vehicle (Vs), and
the predetermined time period interval (TPi) at each of the predetermined regular
time period interval (TPi) until the calculated angle of deviation (α) is zero degree
for a predetermined time duration . The sum of products (SOP) is zero when the
10 angle of deviation (α) is zero degree for a predetermined time duration.
[0063] At block 308, the method includes generating a warning signal to a
warning actuator (102) when the determined sum of products (SOP) is more than
a predefined threshold value (THsop).
Technical advantages:
15 [0064] Alerts/warnings are generated based upon the degree/ intensity of
distraction, which is calculated collectively using - time stamp, speed of vehicle
and angle of deviation
[0065] Unlike static individual thresholds of speed of vehicle and angle of
deviation, problem of too many and too rare alerts is mitigated
20 [0066] The above description does not provide specific details of the
manufacture or design of the various components. Those of skill in the art are
familiar with such details, and unless departures from those techniques are set out,
techniques, known, related art or later developed designs and materials should be
employed. Those in the art can choose suitable manufacturing and design details.
25 [0067] It should be understood, however, that all of these and similar terms
are to be associated with the appropriate physical quantities and are merely
convenient labels applied to these quantities. Unless specifically stated otherwise,
as apparent from the discussion herein, it is appreciated that throughout the
description, discussions utilizing terms such as “receiving,” or “determining,” or
18
“retrieving,” or “controlling,” or “comparing,” or the like, refer to the action and
processes of an electronic control unit, or similar electronic device, that
manipulates and transforms data represented as physical (electronic) quantities
within the control unit’s registers and memories into other data similarly
5 represented as physical quantities within the control unit memories or registers or
other such information storage, transmission or display devices.
[0068] Further, the terminology used herein is for the purpose of describing
particular embodiments only and is not intended to be limiting of the disclosure. It
will be appreciated that several of the above-disclosed and other features and
10 functions, or alternatives thereof, may be combined into other systems or
applications. Various presently unforeseen or unanticipated alternatives,
modifications, variations, or improvements therein may subsequently be made by
those skilled in the art without departing from the scope of the present disclosure
as encompassed by the following claims.
15 [0069] It will be appreciated that variants of the above-disclosed and other
features and functions, or alternatives thereof, may be combined into many other
different systems or applications. Various presently unforeseen or unanticipated
alternatives, modifications, variations, or improvements therein may be
subsequently made by those skilled in the art which are also intended to be
20 encompassed by the following claims.
[0070] The claims, as originally presented and as they may be amended,
encompass variations, alternatives, modifications, improvements, equivalents, and
substantial equivalents of the embodiments and teachings disclosed herein,
including those that are presently unforeseen or unappreciated, and that, for
25 example, may arise from applicants/patentees and others.

We claim:

1. A driver state monitoring apparatus (200) to monitor state of driver in a
vehicle, driver state monitoring apparatus (200) comprising:
a vehicle speed calculation unit (212) coupled with vehicle
speed sensor (105) to calculate speed of the vehicle (Vs);
a deviation angle calculation unit (214) coupled with an image
capturing apparatus (103) to calculate angle of deviation (α) of head of
driver; and
characterized in that
a distraction level determining unit (216) determine sum of
products (SOP) of the calculated angle of deviation (α) and the
calculated speed of the vehicle (Vs) for a time of distraction (Td); and
a warning generating unit (218) coupled with a warning actuator
(102), the warning generating unit (218) generates a warning signal to
the warning actuator (102) when the determined sum of products
(SOP) is more than a predefined threshold value (THsop).

2. The driver state monitoring apparatus (200) as claimed in claim 1, wherein
the distraction level determining unit (216):
calculates, at predetermined regular time period interval (TPi),
product of the calculated angle of deviation (α), the calculated speed of the
vehicle (Vs), and the predetermined time period interval (TPi); and
calculates the sum of the products of the calculated angle of
deviation (α), the calculated speed of the vehicle (Vs), and the
predetermined time period interval (TPi) at each of the predetermined
regular time period interval (TPi) until the calculated angle of deviation
(α) is zero degree for a predetermined time duration.
3. The driver state monitoring apparatus (200) as claimed in claim 1, wherein
the sum of products (SOP) is zero when the angle of deviation (α) is zero
degree or less than the zero degree.
20
4. The driver state monitoring apparatus (200) as claimed in claim 1, wherein
the warning actuator (102) generates audio or visual or haptic warning based
on the warning signal.
5. The driver state monitoring apparatus (200) as claimed in claim 1, wherein
the image capturing apparatus (103) is positioned in front of driver seat in
vehicle cabin to capture the plurality of captured images.
6. A method (300) for monitoring state of driver in a vehicle having an image
capturing apparatus (103), the method (300) comprising:
calculating (302) speed of the vehicle (Vs);
capturing (304) image of the driver by the image capturing
apparatus (103) and calculating an angle of deviation (α);
characterized in that
determining (306) sum of products (SOP) of the calculated angle of
deviation (α) and the calculated speed of the vehicle (Vs) for a time of
distraction (Td), where the time of distraction (Td) starts when angle of
deviation (α) is more than zero degree; and
generating (308) a warning signal to a warning actuator (102) when
the determined sum of products (SOP) is more than a predefined threshold
value (THsop).
7. The method (300) as claimed in claim 6, wherein the determining (306)
comprises:
calculating, at predetermined regular time period interval (TPi),
product of the calculated angle of deviation (α), the calculated speed of the
vehicle (Vs), and the predetermined time period interval (TPi); and
calculating sum of the products of the calculated angle of deviation
(α), the calculated speed of the vehicle (Vs), and the predetermined time
period interval (TPi) at each of the predetermined regular time period
21
interval (TPi) until the calculated angle of deviation (α) is zero degree or
less than the zero degree.
8. The method (300) as claimed in claim 6, wherein the sum of products (SOP)
is zero when the angle of deviation (α) is zero degree for a predetermined
time duration.
9. The method (300) as claimed in claim 6, wherein the warning actuator (102)
generates audio or visual or haptic warning based on the warning signal.
10. The method (300) as claimed in claim 6, wherein the image capturing
apparatus (103) is positioned in front of driver seat in vehicle cabin to
capture the plurality of captured images.