Specification
DESCRIPTION
PULSE WAVE DETECTION DEVICE, DEVICE CONTROL DEVICE, AND PULSE WAVE DETECTION METHOD
Technical Field
[0001] The present invention relates to a pulse wave detection
device which detects noise included in a pulse wave. Background Art
[0002] Recently, various research groups have been studying
techniques for evaluating the health conditions of people based on
their vital signs. As the results, some researchers found the
correlation between the health conditions of the people and their vital
signs, and proposed methods for evaluating the health conditions of
people based on their vital signs at academic meetings. However,
such correlation analysis was performed based on changes in vital
signs observed in segments where the health conditions surely
changed, and thus these results are mere results obtained at
laboratories far different from real environments. At present, there
is no established technique for performing back calculation to
evaluate the health condition of a person in the case where a change
in a vital sign is observed. One technique proposed in view of these
problems as a method for discriminating a specific health condition of
a person in the case where the person has a stress from a specific
health condition of a person in the case where the person is doing
sports is a technique for measuring a pulse wave, calculating pulse
wave values, the upper peak values of the pulse wave, and the pulse
pressure values each of which is the difference between an upper peak
value and a corresponding lower peak value of the pulse wave, and
determining a current status from among stress, sleepiness, fatigue
(muscle fatigue) (See Patent Reference 1, for example).
[0003] FIG. 1 is a block diagram showing the structure of a
health condition discrimination device disclosed in Patent Reference 1. The health condition discrimination device includes a pulse wave measurement unit 1301, a calculation unit 1302, a discrimination unit 1303, and an alert output unit 1304.
[0004] The pulse wave measurement unit 1301 measures the
flow amount of haemoglobin carried by oxygen and the flow amount of
haemoglobin not carried by oxygen which are generated through
blood circulation. The calculation unit 1302 calculates data of pulse
values, blood pressure values, and pulse pressure values each of
which is the difference between the upper and lower peaks of a
corresponding one of the pulse waves, based on the pulse wave data
measured by the pulse wave measurement unit 1301. The
discrimination unit 1303 detects changes in the data calculated by the
calculation unit 1302, and discriminates the health conditions into
plural levels. The alert output unit 1304 outputs alerts according to
the levels discriminated by the discrimination unit 1303.
[0005] As mentioned above, there are attempts to detect pulse
waves from human bodies using optical or piezoelectric pressure sensors, and determine human health conditions. However, pulse waves are susceptible to body movements or the like, and thus there is a need to discriminate between pulse wave signs and noise. Exemplary conventional methods for detecting noise included in pulse waves include a method for discriminating noise based on the variance in the peak values of velocity plethysmogram (abbreviated as VPG) obtained by differentiating the detected pulse waves (See Patent Reference 2, for example).
Patent Reference 1: Japanese Unexamined Patent Application Publication No. 2003-61921 (page 8, FIG. 2) Patent Reference 2: Japanese Patent Publication No. 3835073
Disclosure of Invention
Problems that Invention is to Solve
[0006] The health condition discrimination device structured
according to Patent Reference 1 determines the health condition of a user using a pulse wave. However, even when the health condition discrimination, device can determine the health condition such as fatigue, stress or sleepiness, it is not sure whether or not the change in the pulse wave is made due to the influence of the determined health condition considering that a pulse wave is a vital sign also
-2-
susceptible to a thermal environment. Accordingly, the health condition is determined based on the pulse wave affected by the thermal environment, which causes a problem that an erroneous result is highly likely to be outputted,
[0007] In addition, a pulse wave is significantly susceptible to
body movements, in addition to health conditions, and thermal sensations. FIG. 2 shows a pulse waveform affected by body movements. The pulse waveform is affected by body movements in Segments A and B, while the pulse waveform is not affected by body movements in the other segments. In this way, the pulse waveform is found to be changed significantly due to the influence of the body movements. In addition, FIG. 3 shows a pulse waveform affected by changes in thermal sensation. The pulse waveform is affected by changes in the thermal sensation in Segment C, while the pulse waveform is not affected by changes in the thermal sensation in the other segments. In this way, the pulse waveform is found to be changed significantly due to the influence of the thermal sensations. Accordingly, at the time of noise detection, there is a need to discriminate a case where the pulse waveform changes due to the influence of body movements from a case where the pulse waveform changes due to the influence of changes in the thermal sensation. Here, according to the conventional method disclosed in Patent Reference 2, FIG. 4 shows a solid-line graph representing the variance values of the peak values of velocity plethysmogram (FIG. 5) obtained by performing first-order derivative on the pulse waveform shown in FIG. 2, and shows a broken-line graph representing the variance values of the peak values of velocity plethysmogram (FIG. 6) obtained by performing first-order derivative on the pulse waveform shown in FIG. 3. As clear from FIG. 4, the variance in Segment C affected by a thermal sensation may be smaller than the variance in Segment A affected by body movements, and may be greater than the variance in Segment B affected by body movements. For this, the conventional method according to Patent Reference 1 entails a problem that it is impossible to determine whether a pulse wave change Indicates either a pulse wave sign made due to a change in thermal sensation or noise
-3-
caused due to the influence of body movements.
[0008] The present invention has been made in order to solve
the above-described problems, and has an object to provide a pulse wave detection device which can discriminate a change in a pulse wave made by a change in thermal sensation from noise caused due to the influence of body movements.
[0009] In addition, the present invention further has an object
to provide a device control device intended to evaluate a user's health condition based on a pulse wave after discriminating a change in the pulse wave made by a change in thermal sensation or noise caused due to the influence of body movements, and perform device control. More specifically, the object is to discriminate whether the change in the pulse wave is made due to the influence of either the thermal environment or the health condition by firstly determining whether or not the pulse wave has changed due to the influence of the thermal environment, and to perform device control for reliably making the user's health condition better.
Means to Solve the Problems
[0010] A pulse wave detection device according to an aspect of
the present invention is for detecting pulse wave data indicating a pulse wave of a user, and the wave detection device includes: a pulse wave detection unit configured to detect, in time series, the pulse wave data indicating the pulse wave of the user; a pulse wave derivative unit configured to calculate time-series velocity plethysmogram data by temporally deriving the time-series pulse wave data detected by the pulse wave detection unit; a component extraction unit configured to extract a maximum value and a minimum value in a current first time range in the time-series velocity plethysmogram data calculated by the pulse wave derivative unit while shifting the current first time range in a time axis direction, the extraction being repeated in a next current first time range; a component ratio calculation unit configured to calculate a component ratio which is a ratio of the maximum value and the minimum value extracted for each current first time range by the component
-4-
extraction unit; and a noise segment determination unit configured to determine, as a noise segment, a segment in which component ratios calculated by the component ratio calculation unit are temporally inconstant.
[0011] The pulse wave detection device with this structure
determines whether or not the pulse wave includes noise by extracting
the maximum values and the minimum values in the first time ranges
based on the velocity plethysmogram obtained by performing
first-order derivative on the pulse wave, calculating the ratios
(component ratios), and determining whether or not the component
ratios are temporally inconstant. For this, it is possible to
discriminate the change in a pulse wave made by a change in thermal
sensation from noise caused due to the influence of body movements.
[0012] It is preferable that the noise segment determination
unit includes: a variance value calculation unit configured to calculate a variance value of component ratios included in a second time range in the velocity plethysmogram data; and a determination unit configured to determine that the second time range includes noise of the pulse wave data when it is determined that the variance value calculated by the derivative value calculation unit does not fall within a predetermined range.
[0013] The pulse wave detection device with this structure
determines whether or not the pulse wave includes noise using the variance values of component ratios. For this, it is possible to discriminate the change in the pulse wave made by a change in thermal sensation from noise caused due to the influence of body movements.
[0014J It Is further preferable that the noise segment
determinatipn unit includes a determination unit configured to
determine whether or not the component ratio calculated by the
component ratio calculation unit falls within the predetermined range,
and determine that the first time range includes noise of the pulse
wave data when it is determined that the component ratio of the first
time range does not fall within the predetermined range.
[0015] The pulse wave detection device determines whether or
-5-
not the pulse wave includes noise by determining whether or not the component ratios fall within a predetermined range. For this, it is possible to discriminate the change in the pulse wave made by a change in thermal sensation from noise caused due to the influence of body movements.
[0016] A device control device according to an aspect of the
present invention is for controlling an on-vehicle device based on pulse wave data indicating a pulse wave of a user, and the device control device includes a vital sign measurement unit configured to measure, in time series, the pulse wave data indicating the pulse wave of the user; a parameter extraction unit configured to extract time-series parameter values for evaluating current statuses of the user based on the time-series pulse wave data measured by the vital sign measurement unit; a determination unit configured to determine whether a factor of a change in the pulse wave data is a change in a health condition of the user or a change in an environment temperature around the user, based on the parameter values extracted by the parameter extraction unit; and a control unit configured to control the on-vehicle device based on a result of the determination made by the determination unit, wherein the vital sign measurement unit includes: a pulse wave detection unit configured to detect, in time series, the pulse wave data indicating the pulse wave of the user; a pulse wave derivative unit configured to calculate time-series velocity plethysmogram data by temporally deriving the time-series pulse wave data detected by the pulse wave detection unit; a component extraction unit configured to extract a maximum value and a minimum value in a current first time range in the time-series velocity plethysmogram data calculated by Lhe puibe wdve derivative unit while shifting the current first time range in a time axis direction, the extraction being repeated in a next current first time range; a component ratio calculation unit configured to calculate a component ratio which is a ratio of the maximum value and the minimum value extracted for each current first time range by the component extraction unit; a noise segment determination unit configured to determine, as a noise segment, a segment in which
-6-
component ratios calculated by the component ratio calculation unit are temporally inconstant; and a noise segment removal unit configured to remove pulse wave data included in the noise segment, from the time-series pulse wave data detected by the pulse wave detection unit.
[0017] The pulse wave detection device with this structure
determines whether or not the pulse wave includes noise by extracting the maximum values and the minimum values in the first time ranges based on the velocity plethysmogram obtained by performing first-order derivative on the pulse wave, calculating the ratios (component ratios), and determining whether or not the component ratios are temporally inconstant. For this, it is possible to discriminate the change in the pulse wave made by a change in thermal sensation from noise caused due to the influence of body movements.
[0018] The pulse wave detection device can determine whether
or not the factor of the change in the pulse wave data is a change in user's health condition or a change in environment temperature around the user, using the parameter values extracted from the pulse wave data. For this, it is possible to control an on-vehicle device based on the determination result. Accordingly, it is possible to evaluate a user's health condition based on pulse wave data and perform device control, more specifically, to discriminate whether the change in the pulse wave is made due to the influence of either a change in thermal environment or a change in health condition, and to perform device control for reliably making the user's health condition better.
[0019] It IS preferable that the determmation unit includes: a
parameter change amount calculation unit configured to calculate, for each of the parameter values extracted by the parameter extraction unit, a change amount from a starting point which is the change amount between the parameter value extracted by the parameter extraction unit at a predetermined starting time point and a current parameter value; a parameter change time calculation unit configured to calculate, for each of the parameter values extracted by the
-7-
parameter extraction unit, change time from the starting time point to a current time point at which the current parameter value is extracted; and a change factor determination unit configured to: make a first determination that the factor of the change in the vital sign is the change in the health condition of the user when (i) the change amount from the starting point calculated by the parameter change amount calculation unit is greater than a threshold value for the change amount from the starting point and (ii) the time required for the change calculated by the parameter change time calculation unit is greater than a threshold value for the time required for the change; and make a second determination that the factor of the change in the vital sign is the change in the environment temperature around the user when (I) the change amount from the starting point calculated by the parameter change amount calculation unit is greater than the threshold value for the change amount from the starting point and (ii) the time required for the change calculated by the parameter change time calculation unit is not greater than the threshold value for the time required for the change, the first or second determination being made for each parameter value extracted by the parameter extraction unit.
[0020] With this structure, it is possible to determine the factor
of the change in the pulse wave data with reference to time required
for the change in the pulse data in addition to the amount of the
change, and control the on-vehicle device based on the determined
factor. Accordingly, it is possible to evaluate a user's health condition
based on pulse wave data and perform device control, more
specifically, to discriminate whether the change in the pulse wave is
made due to the influence of either a change in thermal environment
or a change in health condition, and to perform device control for
reliably making the user's health condition better.
[0021] It is further preferable that the determination unit
includes: a parameter change amount calculation unit configured to calculate, for each of the parameter values extracted by the parameter extraction unit, a change amount from a starting point which is a change amount between a parameter value extracted by the
-8-
parameter extraction unit at a predetermined starting time point and a current parameter value; an environment temperature measurement unit configured to measure, in time series, a current environment temperature around the user; a unit for calculating a temperature change amount from a starting point which calculates, for each of the environment temperatures measured by the environment temperature measurement unit; a temperature change amount from a starting point which is a change amount between an environment temperature at the starting point measured by the environment temperature measurement unit and a current environment temperature; and a change factor determination unit configured to: determine that the factor of the change in the vital sign is the change in the health condition of the user when (i) the change amount from the starting point calculated by the parameter change amount calculation unit is greater than a predetermined threshold value for the change amount from the starting point and (ii) the temperature change amount from the starting point calculated by the temperature change amount from the starting point is not greater than the threshold value for the predetermined temperature change amount from the starting point; and determine that the factor of the change in the vital sign is the change in the environment temperature around the user when (i) the change amount from the starting point calculated by the parameter change amount calculation unit is greater than the threshold value for the change amount from the starting point and (ii) the temperature change amount from the starting point calculated by the temperature change amount from the starting point is greater than the threshold value for the predetermined temperature change amount from the starting point.
[0022] With this structure, it is possible to determine the factor
of the change in the pulse wave data with reference to the amount of the change in the environment temperature in addition to the amount of the change, and control the on-vehicle device based on the determined factor. Accordingly, it is possible to evaluate a user's health condition based on pulse wave data and perform device control, more specifically, to discriminate whether the change in the pulse
-9-
wave is made due to the influence of either a c ^((■,\^^^'■■■ rA/AVW< i!
environment or a change in health condition, and to perform device
control for reliably making the user's health condition better.
[0023] It is further preferable that the determination unit
includes: a parameter change amount calculation unit configured to calculate, for each of the parameter values extracted by the parameter extraction unit, a change amount from a starting point which is a change amount between a parameter value extracted by the parameter extraction unit at a predetermined starting time point and a current parameter value; a parameter change amount integration unit configured to calculate, for each of the parameter values extracted by the parameter extraction unit, an integration value of change amounts each from a previous point, the integration value being obtained by integrating the change amounts of the parameter values extracted by the parameter extraction unit in a period from the starting time point to a time point at which the current parameter value is extracted; and a change factor determination unit configured to: determine that the factor of the change in the vital sign is the change in the health condition of the user when (i) the change amount from the starting point calculated by the parameter change amount calculation unit is greater than a predetermined threshold value for the change amount from the starting point and (ii) the integration value of the parameter values up to the current parameter value extracted by the parameter extraction unit is greater than a predetermined threshold value for the integration value; and determine that the factor of the change in the vital sign is the change in the environment temperature around the user when (i) the change amount from the starting point caicuiated by the pdfdfiieLei cliariye amount calculation unit is greater than the threshold value for the change amount from the starting point and (ii) the integration value of the parameter values up to the current parameter value extracted by the parameter extraction unit is not greater than the predetermined threshold value for the integration value.
[0024] With this structure, it is possible to determine the factor
of the change in the pulse wave data with reference to the integration
-10-
value of the change amounts in addition to the current change amount, and control the on-vehicle device based on the determined factor. Accordingly, it is possible to evaluate a user's health condition based on pulse wave data and perform device control, more specifically, to discriminate whether the change in the pulse wave is made due to the influence of either a change in thermal environment or a change in health condition, and to perform device control for reliably making the user's health condition better.
[0025] It is further preferable that the device control device
further includes a vehicle information obtainment unit configured to
obtain information about a status of a vehicle driven by the user, and
that the determination unit includes: a parameter change amount
calculation unit configured to calculate, for each of the parameter
values extracted by the parameter extraction unit, a change amount
from a starting point which is a change amount between a parameter
value extracted by the parameter extraction unit at a predetermined
starting time point and a current parameter value; and a
determination unit configured to determine whether the factor of the
change in the pulse wave data is the change in the health condition of
the user or the change in the environment temperature around the
user, based on the change amount from the starting point calculated
by the parameter change amount calculation unit and the vehicle
status obtained by the vehicle information obtainment unit.
[0026] With this structure, it is possible to determine the factor
of the change in the pulse wave data with reference to the status of the vehicle in addition to the change amount in the pulse wave data, and control the on-vehicle device based on the determined factor. Accordingly, it is possible to evaluate a user's health condition based on pulse wave data and perform device control, more specifically, to discriminate whether the change in the pulse wave is made due to the influence of either a change in thermal envlronnrient or a change in health condition, and to perform device control for reliably making the user's health condition better.
[0027] It is further preferable that the device control device
further includes a vehicle information obtainment unit configured to
-11 -
obtain information about a status of a vehicle driven by a user, and that the determination unit includes: a parameter change amount calculation unit configured to calculate, for each of the parameter values extracted by the parameter extraction unit, a change amount from a starting point which is a change amount between a parameter value extracted by the parameter extraction unit at a predetermined starting time point and a current parameter value; a parameter change time calculation unit configured to calculate, for each of the parameter values extracted by the parameter extraction unit, time required for a change which is time from the starting time point to a time point at which the current parameter value is extracted; and a change factor determination unit configured to determine whether the factor of the change in the pulse wave data is the change in the health condition of the user or the change in the environment temperature around the user, based on the change amount from the starting point calculated by the parameter change amount calculation unit, the time required for the change calculated by the parameter change time calculating unit, and the vehicle's running status obtained by the vehicle information obtainment unit.
[0028] With this structure, it is possible to determine the factor
of the change in the pulse wave data with reference to time required
for the change in addition to the amount of the change in the pulse
wave data, and control the on-vehicle device based on the determined
factor. Accordingly, it is possible to evaluate a user's health condition
based on pulse wave data and perform device control, more
specifically, to discriminate whether the change in the pulse wave is
made due to the influence of either a change in thermal environment
ut d chdiiye in hedlLu condition, and to perform device control for
reliably making the user's health condition better.
[0029] It is to be noted that the present invention can be
implemented not only as a pulse wave detection device including these unique processing units, but also as a pulse wave detection method including the steps corresponding to the unique processing units included in the pulse wave detection device, and as a program causing a computer to execute the unique steps included in the pulse
- 12-
wave detection method. As a matter of course, such program can be distributed using recording media such as CD-ROMs (Compact Disc-Read Only Memory) and can also be distributed via communication networks such as the Internet.
Effects of the Invention
[0030] According to the present invention, it is possible to
provide a pulse wave detection device which discriminates a change in
a pulse wave made by a change in thermal sensation from noise
caused due to the influence of body movements.
[0031] In addition, the present invention further has an object
to provide a device control device intended to evaluate a user's health condition based on a pulse wave after discriminating whether a change in the pulse wave is made by a change in thermal sensation or noise caused due to the influence of body movements, and perform device control. More specifically, the object is to discriminate a change made due to the influence of a thermal environment from a change made due to the influence of a health condition by firstly determining whether or not the pulse wave has changed due to the influence of the thermal environment, and to perform device control for reliably making the user's health condition better.
Brief Description of Drawings
[0032]
[FIG. 1] FIG. 1 is a block diagram showing the structure of a
conventional health condition discrimination device.
[FIG. 2] FIG. 2 is a diagram showing a pulse waveform affected by
body movements.
[FIG. 3] FIG. 3 is a diagram showing a pulse waveform affected by
changes in the thermal sensation.
[FIG. 4] FIG. 4 is a diagram showing (i) a graph representing
variance of the peak values of velocity plethysmogram obtained by
performing first-order derivative on the pulse waveform shown in FIG.
2, and (ii) a graph representing the variance of the peak values of
velocity plethysmogram obtained by performing first-order derivative
-13-
on the pulse waveform shown in FIG. 3.
[FIG. 5] FIG. 5 is a diagram showing a velocity plethysmogram
affected by body movements.
[FIG. 6] FIG. 6 is a diagram showing a velocity plethysmogram
affected by changes in the thermal sensation.
[FIG. 7] FIG. 7 is a block diagram showing the structure of a
device control device according to Embodiment 1 of the present
invention.
[FIG. 8] FIG. 8 is a block diagram showing the detailed structure
of a vital sign measurement unit.
[FIG. 9] FIG. 9 is a graph showing the ratio of each of maximum
values and the corresponding one of minimum values (the ratio is
obtained by dividing the minimum value by the maximum value) of the
velocity plethysmogram extracted, on a per predetermined time range
basis, based on (i) the velocity plethysmogram data affected by the
body movements shown in FIG. 5 and (ii) the velocity plethysmogram
data affected by the changes in the thermal sensation shown in FIG. 6.
[FIG. 10] FIG. 10 is a graph showing the variance in the ratio of
each of maximum values and a corresponding one of minimum value
(the minimum value/the maximum value) of the velocity
plethysmogram extracted, on a per predetermined time range basis,
based on (i) the velocity plethysmogram data affected by the body
movements shown in FIG. 5 and (ii) the velocity plethysmogram data
affected by the changes in the thermal sensation shown in FIG. 6.
[FIG. 11] FIG. 11 is a flowchart of processing performed by the
device control device according to Embodiment 1 of the present
invention.
[FIG. 12] FIG. 12 is a flowchart or procesbing performed by the
change factor determination unit according to Embodiment 1 of the
present invention.
[FIG. 13] FIG. 13 is a diagram showing a data table used for
determining the factor of a change in the pulse wave amplitude stored
by the change factor determination unit according to Embodiment 1 of
the present invention,
[FIG. 14] FIG. 14 shows graphs showing changes in the thermal
-14-
sensation and fatigue level in the case where the environment
temperature changes.
[FIG. 15] FIG. 15 is a diagram showing reaction time for thermal
sensations and reaction time for fatigue levels.
[FIG. 16] FIG. 16 is a diagram for illustrating a threshold value for
starting point change time used for discriminating between thermal
sensations and fatigue levels.
[FIG. 17] FIG. 17 is a flowchart of processing performed by the
vital sign measurement unit.
[FIG, 18] FIG. 18 is a diagram of a waveform representing
temporal changes in a velocity plethysmogram.
[FIG. 19] FIG. 19 is a diagram for illustrating the starting position
of a noise segment.
[FIG. 20] FIG. 20 is a diagram for illustrating the ending position of
the noise segment.
[FIG. 21] FIG. 21 is a diagram for illustrating removal of noise from
pulse wave data. FIG. 21(a) is a graph representing temporal
changes in the amplitude value of Wave a that is a first wave of the
velocity plethysmogram which has not yet been subjected to the noise
removal. FIG. 21(b) is a graph representing temporal changes in the
amplitude value of Wave a of the velocity plethysmogram which has
been subjected to the noise removal.
[FIG. 22] FIG. 22 is a diagram showing an exemplary waveform of
the velocity plethysmogram.
[FIG. 23] FIG. 23 is a block diagram showing the structure of a
device control device according to Embodiment 2 of the present
invention.
[FIG. 24] FIG. 24 is a flowchart of processing performed by the
device control device according to Embodiment 2 of the present
invention.
[FIG. 25] FIG. 25 is a flowchart of processing performed by a
change factor determination unit according to Embodiment 2 of the
present invention.
[FIG. 26] FIG. 26 is a diagram showing a data table used for
determining the factor of a change in the pulse wave amplitude stored
-15-
by the change factor determination unit according to Embodiment 2 of
the present invention.
[FIG. 27] FIG. 27 is a diagram for illustrating a threshold vale for
the temperature change amount from a starting point for
discriminating between thermal sensations and fatigue levels.
[FIG. 28] FIG. 28 is a block diagram showing the structure of a
device control device according to Embodiment 3 of the present
invention.
[FIG. 29] FIG. 29 is a flowchart of processing performed by the
device control device according to Embodiment 3 of the present
invention.
[FIG. 30] FIG. 30 is a flowchart of processing performed by the
change factor determination unit according to Embodiment 3 of the
present invention.
[FIG. 31] FIG. 31 is a diagram showing a data table used for
determining the factor of a change in the pulse wave amplitude stored
by the change factor determination unit according to Embodiment 3 of
the present invention.
[FIG. 32] FIG. 32 is a block diagram showing the structure of a
device control device according to Embodiment 4 of the present
invention.
[FIG. 33] FIG. 33 is a block diagram showing the detailed structure
of a vital sign measurement unit according to Embodiment 4 of the
present invention.
[FIG. 34] FIG. 34 is a flowchart of processing performed by the
device control device according to Embodiment 4 of the present
invention.
[FIG. 35] FIG. 35 is a flowchart of processing performed by the
change factor determination unit according to Embodiment 4 of the
present invention.
[FIG. 36] FIG. 36 is a diagram showing a data table used for
determining the factor of a change in the pulse wave amplitude stored
by the change factor determination unit according to Embodiment 4 of
the present invention.
[FIG. 37] FIG. 37 is a diagram for illustrating a threshold vale for
- 16-
handle operation data used for discriminating between thermal
sensations and fatigue levels.
[FIG. 38] FIG. 38 is a flowchart of processing performed by a
thermal sensation related device control unit according to
Embodiment 4 of the present invention.
[FIG. 39] FIG. 39 is a flowchart of processing performed by a
fatigue related device control unit according to Embodiment 4 of the
present invention.
[FIG. 40] FIG. 40 is a block diagram showing the structure of a
device control device according to Embodiment 5 of the present
invention.
[FIG. 41] FIG. 41 is a flowchart of processing performed by the
device control device according to Embodiment 5 of the present
invention.
[FIG. 42] FIG. 42 is a flowchart of processing performed by the
change factor determination unit according to Embodiment 5 of the
present invention.
[FIG. 43] FIG. 43 is a block diagram showing the structure of a
vital sign measurement unit.
[FIG. 44] FIG. 44 is a flowchart of processing performed by the
vital sign measurement unit according to Embodiment 5 of the present
invention.
Numerical References
[0033]
1 Pulse wave sensor
101, 1101, 3101 Vital sign measurement unit
102 Parameter extrdclion unit
103 Parameter change amount calculation unit
104 Parameter change time calculation unit
105, 506, 905, 1105, 1205 Change factor determination unit
106, 1116 Status evaluation unit
107, 1117 Device control unit
108 Thermal sensation evaluation unit
109 Health condition evaluation unit
- 17-
120, 520, 920, 1017, 1120, 1220, 3017 Determination unit
130, 1130 Control unit
504 Environment temperature measurement unit
505 Unit for calculating a temperature change amount from a starting point
904 Parameter change amount integration unit 1011, 1121 Pulse wave detection unit
1012 Pulse wave derivative unit
1013 Component extraction unit
1014 Component ratio calculation unit
1015 Component ratio storage unit
1016 Variance value calculation unit
1018 Noise segment removal unit
1019 Accumulation unit 1109 Fatigue evaluation unit
1111 Superior control unit
1112 Vehicle information obtainment unit
1113 Fatigue related device control unit
1114 Thermal sensation related device control unit
Best Mode for Carrying Out the Invention
[0034] Embodiments of the present invention will be described
below with reference to the drawings.
[0035] (Embodiment 1)
FIG. 7 is a block diagram showing the structure of a device
control device according to Embodiment 1 of the present invention.
The device control device shown in FIG. 7 is configured with known
computers for example, and includes a vital sign measurement unit
101, a parameter extraction unit 102, a determination unit 120, and a
control unit 130. These processing units function when the program
is executed by a CPU of a computer storing an installed device control
program designed according to this embodiment.
[0036] The vital sign measurement unit 101 samples a user's
finger-tip pulse wave detected by a known transducer or the like at a
- 18-
predetermined sampling cycle, and obtains pulse wave data in time
series. The parameter extraction unit 102 extracts the amplitude of
the pulse waveform from the pulse wave data as parameter values for
evaluating the pulse wave, and accumulates the parameter values.
[0037] The determination unit 120 is a processing unit for
determining the factor of a change in the pulse wave data using the parameter values extracted by the parameter extraction unit 102. The determination unit 120 includes a parameter change amount calculation unit 103, a parameter change time calculation unit 104, and a change factor determination unit 105.
[0038] The parameter change amount calculation unit 103 (i)
calculates, as a change amount from a starting point, the difference between the value at the predetermined starting time point and the value at a current time point in the time-series data of the pulse wave amplitude extracted by the parameter extraction unit 102, (ii) calculates, as a previous change amount, the difference between the value at the previous measurement time point and the value at the current time point, and (iii) outputs the change amount from the starting point and the previous change amount to the change factor determination unit 105.
[0039] The parameter change time calculation unit 104
calculates, as change time from the starting point, an elapsed time from the predetermined starting time point to the current time point in the pulse wave amplitude extracted by the parameter extraction unit 102, and outputs the change time from the starting point to the change factor determination unit 105.
[0040] The change factor determination unit 105 determines the
factor of the change in the puise wave amplitude (the factor is, for example, the influence of a thermal sensation or the influence of a health condition), based on (1) the change amount from the starting point and the previous change amount calculated by the parameter change amount calculation unit 103 and (ii) the change time from the starting point calculated by the parameter change time calculation unit 104. Based on the determined factor, the change factor determination unit 105 selects the best evaluation unit from among a
- 19-
thermal sensation evaluation unit 108 and a health condition evaluation unit 109 included in a later-described status evaluation unit 106, and outputs, to the selected evaluation unit, the current change amount from the starting point that is information to be used for evaluating the current status.
[0041] The control unit 130 is a processing unit for performing
device control based on the result of the determination made by the
change factor determination unit 105, and includes the status
evaluation unit 106 and a device control unit 107.
[0042] The status evaluation unit 106 includes (i) the thermal
sensation evaluation unit 108 for evaluating a user's thermal sensation based on the change amount from the starting point in the pulse wave amplitude and (ii) the health condition evaluation unit 109 for evaluating a user's health condition based on the same change amount from the starting point in the pulse wave amplitude. The thermal sensation evaluation unit 108 evaluates the user's thermal sensation based on the change amount from the starting point outputted by the change factor determination unit 105, and outputs the evaluation result to the device control unit 107. The health condition evaluation unit 109 evaluates the user's health condition based on the change amount from the starting point outputted by the change factor determination unit 105, and outputs the evaluation result to the device control unit 107.
[0043] Thermal sensations include not only a thermal sensation
but also an omen of a change in a vital sign before the perception of the thermal sensation.
[0044] Here, the change factor determination unit 105 outputs
the current change amount from the starting point as the information to be used for evaluating the thermal sensation, and the thermal sensation evaluation unit 108 evaluates the user's thermal sensation based on the change amount from the starting point. Alternatively, it is also good that the change factor determination unit 105 outputs the previous change amount as the information to be used for evaluating the thermal sensation, and the thermal sensation evaluation unit 108 evaluates the user's thermal sensation based on the previous change
-20-
amount.
[0045] Based on either the thermal sensation evaluated by the
thermal sensation evaluation unit 108 or the health condition
evaluated by the health condition evaluation unit 109, the device
control unit 107 performs either (i) device control for notifying the
user of the evaluation result of the user's thermal sensation or the
user's health condition, or (ii) device control for making better the
user's thermal sensation or the user's health condition.
[0046] FIG. 8 is a block diagram showing the detailed structure
of the vital sign measurement unit 101. It is assumed that the vital
sign measurement unit 101 is connected to a pulse wave sensor 1.
[0047] The pulse wave sensor 1 is a known transparent optical
sensor including light emitting elements and light receiving elements, and is intended to measure a pulse wave when mounted on a finger-tip portion.
[0048] The vital sign measurement unit 101 includes a pulse
wave detection unit 1011, a pulse wave derivative unit 1012, a
component extraction unit 1013, a component ratio calculation unit
1014, a component ratio storage unit 1015, a variance value
calculation unit 1016, a determination unit 1017, a noise segment
removal unit 1018, and an accumulation unit 1019.
[0049] The pulse wave detection unit 1011 detects, as a pulse
wave, an output signal from the pulse wave sensor 1. The pulse wave derivative unit 1012 performs first-order derivative on the pulse wave detected by the pulse wave detection unit 1011 to obtain a velocity plethysmogram. The component extraction unit 1013 extracts the maximum value and the minimum value in each of predetermined time ranges of the velocity plethysmogram obtained by the pulse wave derivative unit 1012. The component ratio calculation unit 1014 calculates a component ratio by dividing the minimum value by the maximum value of the velocity plethysmogram extracted by the component extraction unit 1013.
[0050] The component ratio storage unit 1015 stores the
component ratio calculated by the component ratio calculation unit 1014. The variance value calculation unit 1016calculates component
-21 -
ratio variance values stored in the component ratio storage unit 1015. It is assumed here that the variance values are sample variance values, and are calculated using the following expression. [0051] [Expression 1]
1 "
[0052] It is also good that the variance values are calculated
using the following expression when calculation can be continued to infinite order. [0053] [Expression 2]
[0054] The determination unit 1017 determines whether or not
the pulse wave contains noise, based on the variance values of the plural component ratios calculated by the variance value calculation unit 1016.
[0055] The noise segment removal unit 1018 removes a pulse
wave portion corresponding to the noise segment. The accumulation unit 1019 accumulates the data of the pulse wave without the portion corresponding to the noise segment.
[0056] FIG. 9 shows (!) a solid-line graph representing the
maximum value and the minimum value (the minimum value/the maximum value) of the velocity plethysmogram extracted, on a per predetermined time range basis, based on the velocity plethysmogram data affected by the body movements shown in FIG. 5 (Segments A and B are the segments affected by the body movements), and (ii) a broken-line graph representing the ratio of the
- 22 -
maximum value and the minimum value (the minimum value/the
maximum value) of the velocity plethysmogram extracted, on a per
predetermined time range basis, based on the velocity
plethysmogram data affected by the change in the thermal sensation
shown in FIG. 6(Segment C is the segment affected by the thermal
sensation). Here, as shown in FIG. 9, the Inventors of the present
invention have found that the ratio of the maximum value and the
minimum value in the velocity plethysmogram changes significantly in
each of Segments A and B affected by the body movements, and that
the ratio of the maximum value and the minimum value In the velocity
plethysmogram changes slightly in Segment C affected by the change
in the thermal sensation. Accordingly, the use of the ratio of the
maximum value and the minimum value in the velocity
plethysmogram makes it possible to discriminate the change in the
pulse wave due to a change in the thermal sensation from noise
caused due to the influence of body movements.
[0057] FIG. 10 shows (1) a solid-line graph representing the
variance values of the ratio of the maximum value and the minimum value (the minimum value/the maximum value) of the velocity plethysmogram extracted, on a per predetermined time range basis, based on the velocity plethysmogram data affected by body movements shown in FIG. 5 (Segments A and B are the segments affected by.the body movements), and (ii) a broken-line graph representing the variance value of the ratio of the maximum value and the minimum value (the minimum value/the maximum value) of the velocity plethysmogram extracted, on a per predetermined time range basis, based on the velocity plethysmogram data affected by change in the thermal sensation shown in FIG. 6 (Segment C is the segment affected by the thermal sensation). Here, as shown in FIG. 10, the Inventors of the present invention have found that the variance in the ratios of the maximum values and the minimum values in the velocity plethysmogram changes significantly in each of Segments A and B affected by the body movements, and that the variance of the ratios of the maximum values and the minimum values in the velocity plethysmogram changes slightly in Segment C affected by the change
-23-
in the thermal sensation. Accordingly, the use of the variance of the
ratios of the maximum values and the minimum values in the velocity
plethysmogram makes it possible to discriminate the change in the
pulse wave due to the change in the thermal sensation from noise
caused due to the influence of the body movements.
[0058] Next, a description is given of processing performed by
the device control device according to Embodiment 1.
[0059] FIG. 11 is a flowchart of processing performed by the
device control device according to Embodiment 1 of the present invention.
[0060] The vital sign measurement unit 101 measures and
accumulates pulse wave data in time series (SI). This process (SI) is described later in detail.
[0061] The parameter extraction unit 102 extracts pulse wave
amplitude from the time-series pulse wave data measured by the vital sign measurement unit 101 on a predetermined time range basis, and accumulates the pulse wave amplitude (S2).
[0062] The parameter change amount calculation unit 103
calculates, as a change amount from the starting point, the difference
between the value at the predetermined starting time point and the
value at a current time in the time-series pulse wave amplitude data
extracted by the parameter extraction unit 102. In addition, the
parameter change amount calculation unit 103 calculates, as the
previous change amount, the difference between the value at the
previous measurement time point and the value at the current time
point. The parameter change amount calculation unit 103 outputs
the calculated change amount from the starting point and the previous
change amount to the change factor determination unit 105 (S3).
[0063] {Meanwhile, the parameter change time calculation unit
104 calculates, as change time from the starting point, an elapsed
time from the predetermined starting time point to the current time
point in the time-series pulse wave amplitude data extracted by the
parameter extraction unit 102, and outputs the change time from the
starting point to the change factor determination unit 105 (S4).
[0064] The change factor determination unit 105 determines the
- 24 -
factor of the change in the pulse wave amplitude, based on (!) the
change amount from the starting point and the previous change
amount outputted by the parameter change amount calculation unit
103 and (ii) the change time from the starting point outputted by the
parameter change time calculation unit 104 (S5). When the change
factor determination unit 105 determines that the factor of the change
is the change in the thermal sensation (YES in S5), it outputs, to the
thermal sensation evaluation unit 108, the current change amount
from the starting point that is information to be used for evaluating
the thermal sensation. When the change factor determination unit
105 determines that the factor of the change is the change in the
health condition (NO in S5), it outputs, to the health condition
evaluation unit 109, the current change amount from the starting
point that is information to be used for evaluating the health condition.
This determination process (S5) is described later in detail.
[0065] The thermal sensation evaluation unit 108 evaluates the
user's thermal sensation based on the change amount from the starting point outputted by the change factor determination unit 105, and outputs the evaluation result to the device control unit 107 (S6). In other words, the thermal sensation evaluation unit 108 evaluates the user's thermal sensation based on a code representing the change amount from the starting point. For example, the thermal sensation evaluation unit 108 evaluates that the thermal sensation is shifted to "hot" when the value of the change amount is positive, and that the thermal sensation is shifted to "cold" when the value of the change amount is negative. In other words, the thermal sensation evaluation unit 108 evaluates that the thermal sensation is shifted to "hot" when the pulse wave amplitude of the pulse waveform increases, and that the thermal sensation is shifted to "cold" when the pulse wave amplitude of the pulse waveform decreases. It is also good to evaluate a thermal sensation based on not the pulse wave amplitude but (i) the maximum value of the pulse wave height, (ii) the waveform component ratio of the waveform of an accelerated plethysmogram (abbreviated as APG) obtained by performing second-order derivative on the pulse waveform, (iii) the amplitude of the accelerated
-25-
plethysmogram or the pulse rate, and (iv) the change amount in parameters obtainable by performing frequency analysis on a pulse wave interval basis.
[0066] Here, in the case of using the parameter obtainable by
performing frequency analysis on a pulse wave interval basis, it is also good to use a ratio of low frequency components (0.04 Hz to 0.15 Hz, for example) and high frequency components (0.15 Hz to 0.4 Hz, for example) obtained by dividing the low frequency components by the high frequency components (abbreviated as LF/HF), and evaluate that the thermal sensation is shifted to "discomfort" when the ratio increases and that the thermal sensation is shifted to "comfort" when the ratio decreases.
[0067] The health condition evaluation unit 109 evaluates the
user's health condition based on the change amount from the starting point outputted by the change factor determination unit 105, and outputs the evaluation result to the device control unit 107 (S7). A description is given of an exemplary case where the health condition evaluation unit 109 evaluates a fatigue level. For example, the health condition evaluation unit 109 evaluates that the fatigue level decreases when the change amount from the starting point is positive, and that the fatigue level increases when the change amount from the starting point is negative. In other words, the health'condition evaluation unit 109 evaluates that the fatigue level decreases when the pulse wave amplitude of the pulse waveform increases, and that the fatigue level increases when the pulse wave amplitude of the pulse waveform decreases. It is also good to evaluate a fatigue level based on not the pulse wave amplitude but (i) the maximum value of the pulse wave height, (ii) the waveform component ratio of the waveform of the accelerated plethysmogram obtained by performing second-order derivative on the pulse waveform, (iii) the amplitude of the accelerated plethysmogram or the pulse rate, and (iv) the change amount in parameters obtainable by performing frequency analysis on a pulse wave interval basis.
[0068] Here, the fatigue levels include not only a perceived
fatigue level but also an unperceived fatigue level.
-26-
[0069] In addition, in the case of using the parameter obtainable
by performing frequency analysis on a pulse wave interval basis, it is also good to use the ratio of low frequency components (0.04 Hz to 0.15 Hz, for example) and high frequency components (0.15 Hz to 0.4 Hz, for example) obtained using the LF/HF, and evaluate that the fatigue level Increases when the ratio increases and that the fatigue level decreases when the ratio decreases.
[0070] The device control unit 107 controls a predetermined
device based on the evaluation result outputted by either the thermal sensation evaluation unit 108 or the health condition evaluation unit 109 (S8). For example, it is also good to perform device control for notifying the user of the evaluation result. In addition, it is also good to perform device control for making better the thermal sensation or the health condition as the evaluation result.
[0071] Next, a detailed description is given of a determination
process (S5 in FIG, 11) for determining the factor of a change in the
pulse wave amplitude made by the change factor determination unit
105. FIG. 12 is a flowchart of processing performed by the change
factor determination unit 105 according to Embodiment 1 of the
present invention. In addition, FIG. 13 is a diagram showing .a data
table used for determining the factor of a change in the amplitude of
the pulse wave amplitude stored in the change factor determination
unit 105. The processing shown in FIG. 12 is described below based
on the contents of the data table shown in FIG. 13.
[0072] First, the change factor determination unit 105 obtains
the change amount from the starting point and the previous change amount from the parameter change amount calculation unit 103, and obtains the change time from the starting point from the parameter change time calculation unit 104 (S9). The change factor determination unit 105 determines whether or not the absolute value of the change amount from the starting point is greater than a predetermined numerical value (0.1) (SIO). When the absolute value of the change amount from the starting point is greater than 0.1 (YES in SIO), the change factor determination unit 105 determines whether or not the absolute value of the previous change amount is
-27-
smaller than the predetermined numerical value (0.1) (Sll). When the absolute value of the change amount from the starting point is not greater than 0.1 (NO in SIO), the change factor determination unit 105 waits until the next change amount from the starting point and the previous change amount are obtained, and repeats the processing from S9.
[0073] When the absolute value of the previous change amount
is smaller than 0.1 (YES in Sll), the change factor determination unit 105 determines whether or not the change time from the starting point is greater than a predetermined value (10 minutes) (S13). When the absolute value of the previous change amount is greater than 0.1 (NO in Sll), the change factor determination unit 105 determines that the factor of the change in the pulse wave amplitude is a change in the thermal sensation as shown in FIG. 13, and outputs, to the thermal sensation evaluation unit 108, the current change amount from the starting point that is information to be used for evaluating the thermal sensation (S12). When the change time from the starting point is greater than 10 minutes (YES in S13), the change factor determination unit 105 determines that the factor of the change in the pulse wave amplitude is a change in the health condition as shown in FIG. 13, and outputs the current change amount from the starting point that is information to be used for evaluating the health condition to the health condition evaluation unit 109 (S14). When the change time from the starting point is not greater than 10 minutes (NO in S13), the change factor determination unit 105 determines that the factor of the change in the pulse wave amplitude is a change in the thermal sensation, and outputs, to the thermal sensation evaluation unit 108, the current change amount from the starting point that is information to be used for evaluating the thermal sensation (S12).
[0074] Next, a description is given of why 10 minutes is used as
the threshold value for the change time from the starting point in the data table shown in FIG. 13. ,
[0075] FIG. 14 shows graphs of changes in the thermal
sensation and fatigue level in the case where the environment
-28-
temperature changes, The horizontal axis shows time. Meanwhile, the vertical axis shows temperatures, thermal sensation levels, and fatigue levels. These graphs show the average values of the thermal sensation levels and the fatigue levels perceived by 10 subjects in the case where the environment temperature changes within a range of approximately 17 to 32 degrees Celsius. The thermal sensation levels are represented as values within a range between -3 to +3 inclusive. Here, " + 3" denotes the hottest level, and "-3" denotes the coldest level. The numerical value increases toward the positive side as the level of hot sensation increases. In addition, the fatigue levels fall within the range between 0 and 3 inclusive. "0" indicates that the fatigue level is none, and "3" indicates that the fatigue level is the maximum level. The numerical value increases toward the positive side as the fatigue level increases.
[0076] The environment temperature is constant during a period
from 0 to 24 minutes, starts to change at the 24-minute point,
increases to the highest temperature at the 51-minute point, and
decreases to the lowest temperature at the 105-minute point.
Focusing on the thermal sensation, a change occurs approximately
after 3 minutes from the 24-minute point (Point 71). In addition, a
change occurs approximately after 3 minutes from the 51-minute
point (Point 72). Further, a change occurs approximately after 6
minutes from the lG5-minute point (Point 73). Likewise, focusing on
the fatigue level, a change occurs approximately after 12 minutes
from the 24-minute point (Point 74). In addition, a change occurs
approximately after 45 minutes from the 51-minute point (Point 75).
Further, a change occurs approximately after 24 minutes from the
105-mlnute point (Point 76). To sum up, the thermal sensation level
responds to a temperature change in a shorter time than in the fatigue
level. More specifically, as shown in FIG. 15, the thermal sensation
level starts to change approximately within 12 minutes in response to
the temperature change, whereas the fatigue level starts to change
approximately after 12 minutes or more in response to the
temperature change.
[0077] For this reason, setting a threshold value for the change
-29-
time from the starting point within 6 to 12 minutes inclusive enables the most appropriate discrimination between the thermal sensation and fatigue level. Therefore, the threshold value for the change time from the starting point Is determined to be 10 minutes in this embodiment.
[0078] Next, detailed descriptions are given of a measurement
and accumulation process (SI in FIG. 11) for the time-series pulse wave data performed by the vital sign measurement unit 101. FIG. 17 is a flowchart of processing performed by the vital sign measurement unit 101.
[0079] The pulse wave detection unit 1011 detects an output
signal from the pulse wave sensor 1 as a pulse wave (S201). The pulse wave derivative unit 1012 calculates velocity plethysmogram by performing first-order derivative on the pulse wave detected by the pulse wave detection unit 1011, and stores the velocity plethysmogram in an external memory (S202).
[0080] Next, the component extraction unit 1013 checks
whether or not the maximum value and the minimum value can be
extracted from the velocity plethysmogram calculated by the pulse
wave derivative unit 1012 (S203). When the maximum value and the
minimum value cannot be extracted from the velocity plethysmogram
(NO in S203), the vital sign measurement unit 101 checks whether or
not the vital sign measurement unit 101 satisfies a condition for
terminating the current processing (the condition Is, for example, an
elapse of a specified time and an End operation) (S213), and
terminates the processing In the case where the termination condition
Is satisfied (YES in S213). In the case where the termination
condition is not satisfied (NO in S213), the pulse wave detection unit
1011 continues the pulse wave detection process (S201). On the
other hand, when the maximum value and the minimum value can be
extracted from the velocity plethysmogram (YES in S203), the
component extraction unit 1013 extracts the maximum value and the
minimum value of the velocity plethysmogram within the
predetermined time range (S204).
[0081] Here, a description is given of the process (S204) for
-30-
extracting the maximum value and the minimum value performed by the component extraction unit 1013 with reference to FIG. 18 that is a waveform diagram showing temporal changes in the velocity plethysmogram. In the waveform diagram of FIG. 18, the horizontal axis shows time, and the vertical axis shows the magnitude of the velocity plethysmogram.
[0082] The component extraction unit 1013 extracts, as the
maximum value of the velocity plethysmogram, the maximum wave height value (U(n) in FIG. 18) in the predetermined time range (Tl in FIG, 18) of the velocity plethysmogram. In addition, the component extraction unit 1013 extracts, as the minimum value of the velocity plethysmogram, the minimum wave height value (S(n) in FIG. 18) in a time range temporally backward of the point (U(n) in FIG. 18) at which the maximum value has been extracted. It is also good to set the predetermined time range (Tl in FIG. 18) within a time range corresponding to a pulse in the case where the number of pulses per 1 minute is 60, or to dynamically change to the interval (T3 in FIG. 18) between two consecutive maximum values calculated immediately before. In addition, it is also good to calculate the average value of the intervals between plural maximum values, and dynamically change to the average value. In addition, the determination process (S203) for determining whether or not the maximum value and the minimum value of the velocity plethysmogram can be extracted is performed depending on whether or not the velocity plethysmogram which include all data items in the predetermined time range (Tl in FIG. 18) has already been calculated.
[0083] Next, the component ratio calculation unit 1014
calculates the component ratio by dividing the minimum value by the
maximum value (S205). The minimum value and the maximum value
are the values extracted by the component extraction unit 1013. The
component ratio storage unit 1015 stores the component ratio
calculated by the component ratio calculation unit 1014 (S206).
[0084] Next, the variance value calculation unit 1016 checks
whether or not the variance values of the component ratios stored in the component ratio storage unit 1015 can be calculated (S207). In
-31-
the case where the variance values of the component ratios cannot be calculated (NO in S207), the vital sign measurement unit 101 checks whether or not a condition for terminating the processing is satisfied (S213). In the case where the termination condition is satisfied (YES in S213), the vital sign measurement unit 101 terminates the processing. In the case where the termination condition is not satisfied (NO in S213), the pulse wave detection unit 1011 continues the pulse wave detection process (S201).
[0085] On the other hand, in the case where the variance values
of the component ratios can be calculated (YES in S207), the variance value calculation unit 1016 calculates, as indicators, the variance values of the component ratios (S208). Here, it is assumed that the i-th calculated component ratio is F(i), and the number of components F to be used for calculating the variance values is k. The n-th variance value is calculated based on the component ratios from F(n) to F(n + k), and the n-f 1-th variance value is calculated based on the component ratios from F(n + 1) to F(k+n + l) shifted by 1 from the respective components ratios used for the n-th variance value. It is also good to calculate the variance values based on the component ratios shifted by k instead of 1. In addition, the process (S207) for determining whether or not the variance values can be calculated is performed depending on whether or not the component ratios stored in the component ratio storage unit 1015 is sufficient in number in order to calculate the variance values.
[0086] Next, the determination unit 1017 determines whether
or not the variance values calculated by the variance value calculation
unit 1016 fall within the range predetermined for variance values (the
range is 0.00 to 0.01, for example) (S209). Here, in the case where
the variance values fall within the range predetermined for variance
values (YES in S209), the determination unit 1017 determines that
the detected pulse noise does not include noise, and the noise
segment removal unit 1018 outputs the data indicating the pulse wave
to the accumulation unit 1019 without performing noise removal
(S210).
[0087] In contrast, in the case where the variance values do no
-32-
fall within the range predetermined for variance values (NO in S209),
the determination unit 1017 determines that the detected pulse wave
includes noise, and the noise segment removal unit 1018 removes the
pulse wave portion corresponding to the noise segment and outputs
the data indicating the pulse wave which has been subjected to the
noise removal to the accumulation unit 1019 (S211).
[0088] The accumulation unit 1019 accumulates the pulse wave
data outputted by the noise segment removal unit 1018 (S212).
[0089] The vital sign measurement unit 101 checks whether or
not a condition for terminating the current processing is satisfied (S213). In the case where the termination condition is satisfied (YES in S213), the processing is terminated. In the case where the termination condition is not satisfied (NO in S213), the pulse wave detection unit 1011 continues the pulse wave detection process (S201).
[0090] Next, a description is given of a noise removal process
(S211) performed by the noise segment removal unit 1018. FIG. 19 is a diagram for illustrating the starting position of the noise segment, and FIG. 20 shows a diagram for illustrating the ending position of the noise segment.
[0091] Each of FIG. 19 and FIG. 20 is a graph representing the
waveform of the velocity plethysmogram. The horizontal axis shows time, and the vertical axis shows the values of velocity plethysmogram. For example, as shown in FIG. 19, it is assumed that the variance value calculation unit 1016 calculates the variance value in each of the consecutive time segments 1001, 1002, and 1003. In addition, it is assumed that the variance value in each of the time segments is calculated based on three temporally consecutive component ratios. Here, it is assumed that the variance values in the respective time segments 1001 and 1002 fall within the range predetermined for variance values, and the variance value in the time segment 1003 does not fall within the range predetermined for variance values. In this case, for example, the noise segment removal unit 1018 determines, as the starting position of the noise segment, the position of the second component ratio (In the diagram,
-33-
the position indicates the corresponding velocity plethysmogram)
among the three component ratios included in the time segment 1003.
[0092] In addition, as shown in FIG. 20, it is assumed that the
variance value calculation unit 1016 calculates the variance values in
the consecutive time segments 1004 and 1005. In addition, it is
assumed that the variance value in each of the time segments is
calculated based on three temporally consecutive component ratios.
Here, it is assumed that the variance value in the time segment 1004
does not fall within the range predetermined for variance values, and
the variance value in the time segment 1005 falls within the range
predetermined for variance values. In addition, it is assumed that
the variance values in the time segments prior to the time segment
1004 do not fall within the range predetermined for the variance
values. In this case, for example, the noise segment removal unit
1018 determines, as the ending position of the noise segment, the
position of the second component ratio (in the diagram, the position
indicates the corresponding velocity plethysmogram) among the three
component ratios included in the time segment 1005.
[0093] It is to be noted that the method for determining the
starting position and the ending position of the noise segment is not limited to this. For example, it is also good to determine, as the starting position of the noise segment, the position of the first component ratio or the position of the third component ratio in the time segment determined to be outside the range predetermined for variance values. Otherwise, it is also good to determine, as the ending position of the noise segment, the position of the first component ratio or the position of the third component ratio in the time segment determined to be within the range predetermined for variance values. Further, the number of component ratios used for calculating a variance value is not limited to three, any other number is possible.
[0094] FIG. 21 is a diagram for illustrating removal of noise from
pulse wave data. FIG. 21(a) is a graph representing temporal changes in the amplitude value of Wave a (described later) that is a first wave of the accelerated plethysmogram which has not yet been
-34-
subjected to noise removal. FIG. 21(b) is a graph representing temporal changes in the amplitude value of Wave a in the accelerated plethysmogram which has been subjected to the noise removal. In each graph, the horizontal axis shows time, and the vertical axis shows the amplitude values of Wave a in the accelerated plethysmogram.
[0095] Here, it is assumed that the pulse wave of a car driver is
being measured. It is assumed that the handle has been operated in
Segments 1201 to 1206 shown in FIG. 21(a), with body movements.
The diagram shows the reached maximum acceleration (x-y two axis
resultant force) at the time of the handle operation, and the reached
maximum acceleration in Segment 1201 is 132 mG, for example.
Due to such body movements, the amplitude values of Wave a vary.
This results in variance in component ratios. Accordingly, as shown in
FIG. 21(b), noise is removed from Segments 1211, 1212, and 1214 to
1216 respectively corresponding to Segments 1201, 1202, and 1204
to 1206. The variance value (variance value of component ratios) of
the amplitude values of Wave a in Segment 1203 is smaller than those
in the other segments. Thus, Segment 1213 corresponding to
Segment 1203 is not regarded as a noise segment, and no noise
removal is performed on Segment 1213. The example in FIG. 21
shows temporal changes in the amplitude values of Wave a in the
accelerated plethysmogram. Likewise, noise removal is performed
on the corresponding positions of the pulse wave data.
[0096] As shown in FIG. 21, it is also good to perform noise
removal shifting the ending position of the noise segment by several to 10 seconds because it takes a certain time for the blood flow to return immediately after the noise segment.
[0097] Next, a description is given of Wave a of the accelerated
plethysmogram. FIG. 22 is a diagram showing an example of the
waveform of the velocity pulse wave. The accelerated
plethysmogram includes Wave a, Wave b. Wave c. Wave d, and Wave e. The apex A of Wave a matches the starting point of the diastolic wave of the finger-tip plethysmogram (abbreviated as PTG), and thus the required time from Apex A to Apex E matches the length of systolic
-35-
time axis of the user's heart. Wave a is a positive wave that is upwardly convex with respect to the baseline, and Wave b is a negative wave that is downwardly convex with respect to the baseline. Wave c, Wave d, and Wave e are element waves that change between positive and negative depending on user's physiological conditions, and are highly correlated with the user's age.
[0098] According to the method described above, the parameter
extraction unit 102 extracts parameter vales which have been subjected to the noise removal. The parameter change amount calculation unit 103 calculates the change amount from the starting point and the previous change amount based on the parameter values which have been subjected to the noise removal. For example, it is also good to calculate the change amount from the starting point only when the parameter values at the starting time point and the current time point have been obtained, and to calculate the previous change amount only when the parameter values at the previous continuation time point and the parameter values at the current time point have been obtained. In addition, it is good to calculate the change amount from the starting point only when parameter values corresponding to a predetermined ratio (50%, for example) or more have been obtained at the measurement time points of the parameter values between the starting time point and the current time point, and to omit calculation of a change amount from the starting point in the other cases.
[0099] As described above, with the device control device
according to Embodiment 1, when a user's pulse wave changes, it is possible to determine the factor of the change in the pulse wave taking into account the time required for the change in addition to the change amount in the pulse wave. In other words, it is possible to discriminate the factor of the change in the pulse wave, that is, determine whether the change Is due to a change in the user's thermal sensation or a change in the user's health condition. In addition, it is also possible to evaluate the user's thermal sensation or health condition based on the factor of the change. This prevents device control based on an erroneous evaluation result in the system for
-36-
obtaining the user's pulse wave and feeding back information about
the pulse wave, and makes it possible to reliably present the user
status and perform device control to make better the user status.
[0100] In addition, in this Embodiment, it is possible to
discriminate a change in the pulse wave made due to a change in the user's thermal sensation from noise caused due to the influence of body movements by calculating the variance value of the component ratios based on the maximum value and minimum value in each predetermined time range of the accelerated plethysmogram and determining whether or not the variance value falls within a range predetermined for variance values.
[0101] (Embodiment 2)
The following description is given of a device control device according to Embodiment 2 of the present invention. The same elements as those of the device control device according to Embodiment 1 are assigned with the same numerical references. The functions and names are also the same, and thus no detailed descriptions are repeated here.
[0102] FIG. 23 is a block diagram showing the structure of a
device control device according to Embodiment 2 of the present invention. The device control device shown in FIG. 23 is configured with known computers for example, and includes a vital sign measurement unit 101, a parameter extraction unit 102, a determination unit 520, and a control unit 130. These processing units function when the program is executed by a CPU of a computer storing an installed device control program designed according to this embodiment.
[0103] The determination unit 520 is a processing unit for
determining the factor of a change in the pulse wave data using parameter values extracted by the parameter extraction unit 102. The determination unit 520 includes a parameter change amount calculation unit 103, an environment temperature measurement unit 504, a unit 505 for calculating a temperature change amount from a starting point, and a change factor determination unit 506.
-37-
[0104] The environment temperature measurement unit 504
measures and accumulates environment temperature data. The unit 505 for calculating a temperature change amount from a starting point calculates, as a change amount from a starting point, the difference between the value at a predetermined starting time point and the value at a current time point in the environment temperature data measured by the environment temperature measurement unit 504, and outputs the current change amount from the starting point to the change factor determination unit 506.
[0105] The change factor determination unit 506 determines the
factor of the change in the pulse wave amplitude (the factor is, for example, the influence of a thermal sensation or the influence of a health condition), based on (i) the change amount from the starting point calculated by the parameter change amount calculation unit 103 and (ii) the temperature change amount from the starting point calculated by the unit 505 for calculating a temperature change amount from the starting point. Based on the determined factor, the change factor determination unit 506 selects the best evaluation unit from among the thermal sensation evaluation unit 108 and the health condition evaluation unit 109 included in the status evaluation unit 106, and outputs, to the selected evaluation unit, the current change amount from the starting point that is information to be used for evaluating the current status.
[0106] Next, a description is given of processing performed by
the device control device according to Embodiment 2.
[0107] FIG. 24 is a flowchart of processing performed by the
device control device according to Embodiment 2 of the present invention.
[0108] The device control device executes the processes from
SI to S3 as in Embodiment 1.
[0109] On the other hand, the unit 505 for calculating a
temperature change amount from a starting point calculates, as the change amount from the starting point, the difference between the value at a predetermined starting time point and the value at a current time point in the environment temperature data measured by the
-38-
environment temperature measurement unit 504, and outputs the current change amount from the starting point to the change factor determination unit 506 (S18).
[0110] The change factor determination unit 506 determines the
factor of the change in the pulse wave amplitude based on the change amount from the starting point calculated by the parameter change amount calculation unit 103 and the temperature change amount from the starting point outputted by the unit 505 for calculating a temperature change amount from a starting point (S19). When the change factor determination unit 506 determines that the factor of the change is a change in the thermal sensation (YES in S19), it outputs, to the thermal sensation evaluation unit 108, the current change amount from the starting point that is information to be used for evaluating the thermal sensation. When the change factor determination unit 506 determines that the factor of the change is a change in the health condition (NO in S19), it outputs, to the health condition evaluation unit 109, the current change amount from the starting point that is information to be used for evaluating the health condition. This determination process (S19) is described later in detail.
[0111] Subsequently, the device control device performs device
control by executing the processes from S6 to SB as in Embodiment 1.
[0112] Next, a detailed description is given of a determination
process (S19 in FIG. 24) for determining the factor of the change in
the pulse wave amplitude made by the change factor determination
unit 506. FIG. 25 is a flowchart of processing performed by the
change factor determination unit 506 according to Embodiment 2 of
the present invention. In addition, FIG. 26 is a diagram showing a
data table used for determining the factor of the change in the
amplitude of the pulse wave stored in the change factor determination
unit 506. The processing shown in FIG. 25 is described below based
on the contents of the data table shown in FIG. 26.
[0113] First, the change factor determination unit 506 obtains
the change amount from the starting point from the parameter change amount calculation unit 103, and obtains the temperature change
-39-
amount from the starting point from the unit 505 for calculating the temperature change amount from the starting point (S23). The change factor determination unit 506 determines whether or not the absolute value of the change amount from the starting point is greater than a predetermined numerical value (0.1) (S24). When the absolute value of the change amount from the starting point is greater than 0.1 (YES in S24), the change factor determination unit 506 determines whether or not the absolute value of the temperature change amount from the starting point is greater than the predetermined numerical value (3 degrees Celsius) (S25). When the absolute value of the change amount from the starting point is not greater than 0.1 (NO in S24), the change factor determination unit 506 waits until the next change amount from the starting point and the temperature change amount from the starting point are obtained, and repeats the processing from S23.
[0114] When the absolute value of the temperature change
amount from the starting point is greater than 3 degrees Celsius (YES In S25), the change factor determination unit 506 determines that the factor of the change in the amplitude of the pulse wave as shown in FIG. 26 is a change in the thermal sensation, and outputs, to the thermal sensation evaluation unit 108, the current change amount from the starting point that is information to be used for evaluating the thermal sensation (S12). When the absolute value of the temperature change amount from the starting point Is not greater than 3 degrees Celsius (NO In S25), the change factor determination unit 506 determines that the factor of the change in the amplitude of the pulse wave as shown in FIG. 26 is a change in the health condition, and outputs, to the health condition evaluation unit 109, the current change amount from the starting point that Is Information to be used for evaluating the health condition (S14).
[0115] Next, a description is given of why 3 degrees Celsius is
determined as the threshold value for the temperature change time
from the starting point in the data table shown in FIG. 26.
[0116] For example, compared to the thermal sensation at
24-minute time point, the thermal sensation changes significantly for
-40-
the first time at Point 71. The change amount from the temperature
at the 24-minute time point from the time point 71 is approximately
0.5 degrees Celsius. On the other hand, compared to the fatigue
level at the 24-minute time point, the fatigue level changes
significantly for the first time at Point 74. The change amount from
the temperature at the 24-minute time point from the time point 74 is
approximately 3.6 degrees Celsius. In other words, the thermal
sensation is more susceptible to the temperature change than the
fatigue level, and the border is determined to be a range between 0.5
degrees Celsius and 3.6 degrees Celsius inclusive.
[0117] For this reason, as shown in FIG. 27, setting a threshold
value for the temperature change amount from the starting point within 1 to 3 degrees Celsius enables the most appropriate discrimination between the thermal sensation and the fatigue level. Therefore, the threshold value for the temperature change amount from the starting point is determined to be 3 degrees Celsius in this embodiment.
[0118] As described above, with the device control device
according to Embodiment 2, when a user's pulse wave changes, it is possible to determine the factor of the change in the pulse wave taking into account the change amount in the environment temperature in addition to the change amount in the pulse wave. In other words, it is possible to discriminate the factor of the change in the pulse wave, that is, determine whether the change is due to a change in the thermal sensation or a change in the health condition. In addition, it is also possible to evaluate the user's thermal sensation or health condition based on the change factor. This prevents device control based on an erroneous evaluation result in the system for obtaining the user's pulse wave and feeding back information about the pulse wave, and makes it possible to reliably present the user status and perform device control to make better the user status.
[0119] (Embodiment 3) The following description is given of a
device control device according to Embodiment 3 of the present invention. The same elements as those of the device control device
-41 -
according to Embodiment 1 are assigned with |:he same numerical references. The functions and names are also the same, and thus no detailed descriptions are repeated here.
[0120] FIG. 28 is a blocl< diagram showing the structure of a
device control device according to Embodiment 3 of the present invention. The device control device shown in FIG. 28 is configured with known computers for example, and includes a vital sign measurement unit 101, a parameter extraction unit 102, a determination unit 920, and a control unit 130. These processing units function when the program is executed by a CPU of a computer storing an installed device control program designed according to this embodiment.
[0121] The determination unit 920 is a processing unit for
determining the factor of a change in the pulse wave data using parameter values extracted by the parameter extraction unit 102. The determination unit 120 includes a parameter change amount calculation unit 103, a parameter change amount integration unit 904, and a change factor determination unit 905.
[0122] The parameter change amount integration unit 904
calculates, as an integration value of change amounts each from a
point immediately before a current point (a previous point), an
integration value of the change amounts from a predetermined
starting time point to a current time point in the time-series data of
the pulse wave amplitude extracted by the parameter extraction unit
102, and outputs, to the change factor determination unit 905, the
integration value of the change amounts each from the previous point.
[0123] The change factor determination unit 905 determines the
factor of the change in the pulse wave amplitude (the factor is, for example, the influence of a thermal sensation or the influence of a health condition), based on (i) the change amount from the starting point calculated by the parameter change amount calculation unit 103 and (ii) the integration value of the change amounts each from the previous point calculated by the parameter change amount integration unit 904. Based on the determined factor, the change factor determination unit 905 selects the best evaluation unit from
-42-
among the thermal sensation evaluation unit 108 and the health condition evaluation unit 109 included in the status evaluation unit 106, and outputs, to the selected evaluation unit, the current change amount from the starting point that is information to be used for evaluating the current status.
[0124] Next, a description is given of processing performed by
the device control device according to Embodiment 3.
[0125] FIG. 29 is a flowchart of processing performed by the
device control device according to Embodiment 3 of the present invention.
[0126] The device control device executes the processes from
SI to S3 as in Embodiment 1.
[0127] Meanwhile, the parameter change amount integration
unit 904 calculates, as an integration value of change amounts each from the previous point, an integration value of the change amounts from a predetermined starting time point to a current time point in the time-series data of the pulse wave amplitude extracted by the parameter extraction unit 102, and output, to the change factor determination unit 905, the integration value of the change amounts each from the previous point (S31).
[0128] The change factor determination unit 905 determines the
factor of the change in the pulse wave amplitude based on (i) the change amount from the starting point outputted by the parameter change amount calculation unit 103 and (ii) the integration value of the change amounts each from the previous point outputted by the parameter change amount integration unit 904 (S32). When the change factor determination unit 905 determines that the factor of the change is a change in the thermal sensation (YES in S32), it outputs, to the thermal sensation evaluation unit 108, the current change amount from the starting point that is information to be used for evaluating the thermal sensation. When the change factor determination unit 905 determines that the factor of the change is a change in the health condition (NO in S32), it outputs, to the health condition evaluation unit 109, the current change amount from the starting point that is information to be used for evaluating the health
-43-
condition. This determination process (S32) is described later in detail.
[0129] Subsequently, the device control device performs device
control by executing the processes from S6 to S8 as in Embodiment 1.
[0130] Next, a detailed description is given of a determination
process (S32 in FIG. 29) that the change factor determination unit
905 performs to determine the factor of the change in the pulse wave
amplitude. FIG. 30 is a flowchart of processing performed by the
change factor determination unit 905 according to Embodiment 3 of
the present invention. In addition, FIG. 31 is a diagram showing a
data table used for determining the factor of the change in the
amplitude of the pulse wave stored in the change factor determination
unit 905. The processing shown in FIG. 30 is described below based
on the contents of the data table shown in FIG. 31.
[0131] First, the change factor determination unit 905 obtains
the change amount from the starting point from the parameter change amount calculation unit 103, and obtains the integration value of the change amounts each from the previous point from the parameter change amount integration unit 904 (S36). The change factor determination unit 905 determines whether or not the absolute value of the change amount from the starting point Is greater than a predetermined numerical value (0.1) (S37). When the absolute value of the change amount from the starting point is greater than 0.1 (YES in S37), the change factor determination unit 905 determines whether or not the integration value of the change amounts each from the previous point is greater than a predetermined numerical value (1) (S38). When the absolute value of the change amount from the starting point is not greater than 0.1 (NO in S37), the change factor determination unit 905 waits until the next change amount from the starting point and the next integration value of the change amounts each from the previous point are obtained, and repeats the processing from S36.
[0132] When the integration value of the change amounts each
from the previous point is greater than 1 (YES in S38), the change factor determination unit 905 determines that the factor of the change
-44-
in the pulse wave amplitude is a change in the health condition as
shown in FIG. 31, and outputs, to the health condition evaluation unit
109, the current change amount from the starting point that is
information to be used for evaluating the health condition (S14).
When the integration value of the change amounts each from the
previous point is not greater than 1 (NO in S38), the change factor
determination unit 905 determines that the factor of the change in the
pulse wave amplitude is change in the thermal sensation as shown in
FIG. 31, and outputs, to the thermal sensation evaluation unit 108,
the current change amount from the starting point that is information
to be used for evaluating the thermal sensation (S12).
[0133] As described above, with the device control device
according to Embodiment 3, when a user's pulse wave changes, it is possible to determine the factor of the change in the pulse wave taking into account the integration value of the change amounts in addition to the change amount in the pulse wave. In other words, it is possible to discriminate the factor of the change in the pulse wave, that is, determine whether the change is due to a change in the thermal sensation or a change in the health condition. In addition, it is also possible to evaluate the user's thermal sensation or health condition based on the change factor. This prevents device control
0
based on an erroneous evaluation result in the system for obtaining the user's pulse wave and feeding back information about the pulse wave, and makes it possible to reliably present the user status and perform device control to make the user status better.
[0134] (Embodiment 4)
The following description is given of a device control device according to Embodiment 4 of the present invention. The same elements as those of the device control device according to Embodiment 1 are assigned with the same numerical references. The functions and names are also the same, and thus no detailed descriptions.are repeated here.
[0135] The device control device according to Embodiment 4 is
intended to control an on-vehicle device.
-45-
[0136] FIG. 32 is a block diagram showing the structure of the
device control device according to Embodiment 4 of the present invention. The device control device shown in FIG. 32 is configured with l
Documents
Application Documents
| # |
Name |
Date |
| 1 |
7220-chenp-2009 pct 08-12-2009.pdf |
2009-12-08 |
| 1 |
7220-CHENP-2009-AbandonedLetter.pdf |
2018-06-22 |
| 2 |
7220-CHENP-2009-FER.pdf |
2017-12-01 |
| 2 |
7220-chenp-2009 form-5 08-12-2009.pdf |
2009-12-08 |
| 3 |
7220-chenp-2009 form-3 08-12-2009.pdf |
2009-12-08 |
| 3 |
7220-chenp-2009 correspondence others 23-02-2011.pdf |
2011-02-23 |
| 4 |
7220-chenp-2009 form-2 08-12-2009.pdf |
2009-12-08 |
| 4 |
7220-chenp-2009 form-18 23-02-2011.pdf |
2011-02-23 |
| 5 |
7220-chenp-2009 form-1 08-12-2009.pdf |
2009-12-08 |
| 5 |
7220-chenp-2009 form-3 03-06-2010.pdf |
2010-06-03 |
| 6 |
7220-chenp-2009 drawings 08-12-2009.pdf |
2009-12-08 |
| 6 |
7220-chenp-2009 power of attorney 03-06-2010.pdf |
2010-06-03 |
| 7 |
7220-chenp-2009 description (complete) 08-12-2009.pdf |
2009-12-08 |
| 7 |
7220-chenp-2009 abstract 08-12-2009.pdf |
2009-12-08 |
| 8 |
7220-chenp-2009 correspondence-others 08-12-2009.pdf |
2009-12-08 |
| 8 |
7220-chenp-2009 claims 08-12-2009.pdf |
2009-12-08 |
| 9 |
7220-chenp-2009 correspondence-others 08-12-2009.pdf |
2009-12-08 |
| 9 |
7220-chenp-2009 claims 08-12-2009.pdf |
2009-12-08 |
| 10 |
7220-chenp-2009 abstract 08-12-2009.pdf |
2009-12-08 |
| 10 |
7220-chenp-2009 description (complete) 08-12-2009.pdf |
2009-12-08 |
| 11 |
7220-chenp-2009 drawings 08-12-2009.pdf |
2009-12-08 |
| 11 |
7220-chenp-2009 power of attorney 03-06-2010.pdf |
2010-06-03 |
| 12 |
7220-chenp-2009 form-1 08-12-2009.pdf |
2009-12-08 |
| 12 |
7220-chenp-2009 form-3 03-06-2010.pdf |
2010-06-03 |
| 13 |
7220-chenp-2009 form-2 08-12-2009.pdf |
2009-12-08 |
| 13 |
7220-chenp-2009 form-18 23-02-2011.pdf |
2011-02-23 |
| 14 |
7220-chenp-2009 form-3 08-12-2009.pdf |
2009-12-08 |
| 14 |
7220-chenp-2009 correspondence others 23-02-2011.pdf |
2011-02-23 |
| 15 |
7220-CHENP-2009-FER.pdf |
2017-12-01 |
| 15 |
7220-chenp-2009 form-5 08-12-2009.pdf |
2009-12-08 |
| 16 |
7220-CHENP-2009-AbandonedLetter.pdf |
2018-06-22 |
| 16 |
7220-chenp-2009 pct 08-12-2009.pdf |
2009-12-08 |
Search Strategy