United States Patent |
5,507,291 |
Stirbl , et al. |
April 16, 1996 |
Method and an associated apparatus for remotely determining
information as to person's emotional state
Abstract
In a method for remotely determining information relating to a person's
emotional state, an waveform energy having a predetermined frequency and a
predetermined intensity is generated and wirelessly transmitted towards a
remotely located subject. Waveform energy emitted from the subject is detected
and automatically analyzed to derive information relating to the individual's
emotional state. Physiological or physical parameters of blood pressure, pulse
rate, pupil size, respiration rate and perspiration level are measured and
compared with reference values to provide information utilizable in evaluating
interviewee's responses or possibly criminal intent in security sensitive areas.
Inventors: |
Stirbl; Robert C. (247 Wadsworth Ave.,
New York, NY 10033); Wilk; Peter J. (185 W. End Ave., New York, NY
10023) |
Appl. No.: |
222835 |
Filed: |
April 5, 1994 |
Current U.S. Class: |
600/407; 600/301; 600/504
|
Intern'l Class: |
A61B 005/04 |
Field of Search: |
128/653.1,660.01,660.02,661.08,691,736,745,664
|
References Cited
U.S. Patent Documents
3483860 |
Dec., 1969 |
Namerow |
128/653. |
3598107 |
Aug., 1971 |
Ishikawa et al. |
128/653. |
3875929 |
Apr., 1975 |
Grant |
128/653. |
3951134 |
Apr., 1976 |
Malech |
128/653. |
3993995 |
Nov., 1976 |
Kaplan et al. |
128/653. |
4048986 |
Sep., 1977 |
Ott |
128/653. |
4085740 |
Apr., 1978 |
Allen, Jr. |
128/653. |
4365637 |
Dec., 1982 |
Johnson |
128/734. |
4509531 |
Apr., 1985 |
Ward |
128/736. |
4556057 |
Dec., 1985 |
Hiruma et al. |
|
4569354 |
Feb., 1986 |
Shapiro et al. |
|
4981139 |
Jan., 1991 |
Pfohl. |
|
4991585 |
Feb., 1991 |
Mawhinney |
128/653. |
4998533 |
Mar., 1991 |
Winkelman |
128/653. |
5022405 |
Jun., 1991 |
Hok et al. |
|
5099852 |
Mar., 1992 |
Meister et al. |
128/691. |
5137027 |
Aug., 1992 |
Rosenfeld |
128/745. |
5305748 |
Apr., 1994 |
Wilk. |
|
5360005 |
Nov., 1994 |
Wilk |
128/653. |
Primary
Examiner: Zele; Krista M.
Attorney, Agent or Firm: Sudol; R.
Neil, Coleman; Henry D.
Claims
What is claimed is:
1. A method for remotely determining
information relating to a person's emotional state, comprising:
generating waveform energy having a predetermined frequency and a
predetermined intensity, the generating of said waveform energy being
implemented at a location remotely spaced from a target individual;
automatically monitoring the position of the individual;
wirelessly transmitting said waveform energy towards the individual;
detecting energy emitted from a predetermined point on the individual in
response to the waveform energy; automatically tracking the location of
said point; and automatically analyzing the emitted energy to derive
information relating to the individual's emotional state.
2. The method
defined in claim 1 wherein said step of analyzing includes the steps of:
determining a value related to a physiological parameter taken from the
group consisting of blood pressure, pulse rate, respiration rate, pupil size,
and perspiration; and comparing the value with a stored reference value
to identify a change in said parameter.
3. The method defined in claim 2
wherein said parameter is respiration rate and said emitted energy is reflected
from the individual's chest wall, further comprising the steps of:
processing the emitted energy to determine location of the individual's
chest wall; and automatically monitoring the individual's position and
compensating for changes in the individual's position in determining changes
location of the individual's chest wall.
4. The method defined in claim
3 wherein said waveform energy is taken from the group consisting of modulated
electromagnetic radiation and pressure waves.
5. The method defined in
claim 2 wherein said reference value includes a previously measured value for
said parameter, further comprising the step of storing said parameter in encoded
form in a memory.
6. The method defined in claim 1 wherein said waveform
energy is collimated modulated electromagnetic radiation, said step of
generating including the steps of: producing an electromagnetic waveform
of said predetermined frequency; modulating said electromagnetic
waveform; and collimating the modulated electromagnetic waveform, said
step of transmitting including the step of directing said electromagnetic
waveform to said predetermined point on said individual.
7. The method
defined in claim 6, further comprising the step of processing said emitted
energy to derive a measure of perspiration on the individual at a predetermined
location.
8. The method defined in claim 1 wherein said step of
monitoring includes the steps of deriving a contour of said individual and
comparing said contour with previously determined generic contour data.
9. The method defined in claim 1 wherein said step of analyzing includes
the step of measuring the emitted energy to determine at least one parameter
selected from the group including frequency, amplitude or intensity, phase, and
polarization, said step of analyzing also including the step of automatically
comparing the determined parameter with a reference value.
10. The
method defined in claim 9 wherein said reference value incorporates at least one
prior measurement of the selected parameter with respect to the individual.
11. The method defined in claim 1, further comprising the step of
changing a frequency of said waveform during a sequence of successive
measurements.
12. A system for remotely determining information relating
to a person's emotional state, comprising: generator means for
generating waveform energy having a predetermined frequency and a predetermined
intensity, said generator means being remotely spaced from a target individual;
transmitter means operatively connected to said generator means for
wirelessly transmitting said waveform energy towards the individual, said
transmitter means including directional means for directing said waveform to a
predetermined point on said individual; detector means for detecting
energy emitted from the individual in response to the waveform energy;
processing means operatively connected to said detector means for
analyzing the emitted energy to derive information relating to the individual's
emotional state, said processing means being operatively connected to at least
one of said generator means and said transmitter means for controlling emission
of energy towards the individual; and monitoring means operatively
connected to said processing means for monitoring the location of the
individual, said monitoring means being operatively connected to said
directional means for controlling the operation thereof.
13. The system
defined in claim 12 wherein said processing means includes first means for
determining a value related to a physiological parameter taken from the group
consisting of blood pressure, pulse rate, respiration rate, pupil size, and
perspiration and second means operatively connected to said first means for
comparing the determined value with a stored reference value to identify a
change in said parameter.
14. The system defined in claim 13 wherein
said parameter is respiration rate and said emitted energy is reflected from the
individual's chest wall, said processing means including third means for
processing the emitted energy to determine location of the individual's chest
wall and means for automatically monitoring the individual's position and
compensating for changes in the individual's position in determining changes in
location of the individual's chest wall.
15. The system defined in claim
14 wherein said waveform energy is taken from the group consisting of modulated
electromagnetic radiation and ultrasonic pressure waves, said generator means
including at least one of means for generating electromagnetic energy and means
for generating ultrasonic pressure waves.
16. The system defined in
claim 13 wherein said parameter is blood pressure, said waveform energy is a
first ultrasonic pressure wave and said emitted energy is a second ultrasonic
pressure wave, said processing means including means for processing said second
ultrasonic pressure wave to derive a rate of blood flow in a preselected blood
vessel of the individual, said processing also including means for automatically
calculating a blood pressure parameter from the derived blood flow rate.
17. The system defined in claim 13 wherein said parameter is pupil size,
said waveform energy being electromagnetic radiation, said detector means
including pixel receptors of a camera, said processing means including means for
automatically counting pixels corresponding to a diameter of the individual's
pupil.
18. The system defined in claim 13 wherein said reference value
includes a previously measured value for said parameter, further comprising
memory means for storing said parameter in encoded form.
19. The system
defined in claim 12 wherein said waveform energy is collimated modulated
electromagnetic radiation, said generator means including means for producing an
electromagnetic waveform of said predetermined frequency and means for
collimating said electromagnetic waveform.
20. The system defined in
claim 19, further comprising means for processing said emitted energy to derive
a measure of perspiration on the individual at a predetermined location.
21. The system defined in claim 12 wherein said monitoring means
includes means for deriving a contour of said individual and means connected
thereto for comparing said contour with previously determined generic contour
data.
22. The system defined in claim 12 wherein said detector means
includes means for measuring the emitted energy to determine at least one
parameter selected from the group including frequency, amplitude or intensity,
phase, and polarization, said processing means including means for comparing the
determined parameter with a previously determined reference value.
23.
The system defined in claim 22 wherein said reference value incorporates at
least one prior measurement of the selected parameter with respect to the
individual, said processing means including means for deriving said reference
value from said prior measurement.
24. The system defined in claim 12
wherein said generator means includes means for changing a frequency of said
waveform during a sequence of successive measurements.
25. A method for
remotely determining information relating to a person's emotional state,
comprising: generating waveform energy having a predetermined frequency
and a predetermined intensity, the generating of the waveform energy being
implemented at a location remotely spaced from a target individual;
wirelessly transmitting said waveform energy towards the individual;
detecting energy emitted from the individual in response to the waveform
energy; and automatically analyzing the emitted energy to derive
information relating to the individual's emotional state, the analyzing of the
emitted energy including determining a value related to pulse rate and comparing
the value with a stored reference value to identify a change in pulse rate,
wherein said emitted energy emanates from a predetermined point on the
individual overlying or on a blood vessel, further comprising processing the
emitted energy to determine (1) a change in a parameter taken from the group
consisting of intensity, change in intensity, change in polarization, and
fluorescence of the emitted energy and (2) amount of transdermal absorption,
said waveform energy being modulated electromagnetic radiation in a suboptical
range of the electromagnetic spectrum.
26. The method defined in claim
25, further comprising the steps of: automatically measuring emitted
radiation at an additional point proximate to said predetermined point to
determine a level of surface moisture; and compensating for surface
absorption due to surface moisture in determining said amount of transdermal
absorption.
27. The method defined in claim 25, further comprising the
step of automatically monitoring the individual's position and tracking
consequent changes in position of said predetermined point.
28. A method
for remotely determining information relating to a person's emotional state,
comprising: generating waveform energy having a predetermined frequency
and a predetermined intensity, the generating of the waveform energy being
implemented at a location remotely spaced from a target individual;
wirelessly transmitting said waveform energy towards the individual;
detecting energy emitted from the individual in response to the waveform
energy; and automatically analyzing the emitted energy to derive
information relating to the individual's emotional state, the analyzing of the
emitted energy including determining a value related to blood pressure and
comparing the value with a stored reference value to identify a change in blood
pressure, wherein said waveform energy is a first ultrasonic pressure
wave and said emitted energy is a second ultrasonic pressure wave, further
comprising processing said second ultrasonic pressure wave to derive a rate of
blood flow in a preselected blood vessel of the individual, the analyzing of the
energy emitted from the individual including automatically calculating a blood
pressure parameter from the derived blood flow rate.
29. A method for
remotely determining information relating to a person's emotional state,
comprising: generating waveform energy having a predetermined frequency
and a predetermined intensity, the generating of the waveform energy being
implemented at a location remotely spaced from a target individual;
wirelessly transmitting said waveform energy towards the individual;
detecting energy emitted from the individual in response no the waveform
energy; and automatically analyzing the emitted energy to derive
information relating to the individual's emotional state, the analyzing of the
emitted energy including determining a value related to a physiological
parameter and comparing the value with a stored reference value to identify a
change in said parameter, wherein said parameter is perspiration, said
waveform energy being modulated electromagnetic radiation, the determination of
surface moisture being implemented by measuring an intensity of radiation
emitted from a predetermined point on the individual.
30. A system for
remotely determining information relating to a person's emotional state,
comprising: generator means for generating waveform energy having a
predetermined frequency and a predetermined intensity, said generator means
being remotely spaced from a target individual; transmitter means
operatively connected to said generator means for wirelessly transmitting said
waveform energy towards the individual; detector means for detecting
energy emitted from the individual in response to the waveform energy; and
processing means operatively connected to said detector means for
analyzing the emitted energy to derive information relating to the individual's
emotional state, said processing means being operatively connected to at least
one of said generator means and said transmitter means for controlling emission
of energy towards the individual, said processing means including first means
for determining a value related to pulse rate and second means operatively
connected to said first means for comparing the determined value with a stored
reference value to identify a change in pulse rate, wherein said emitted
energy emanates from a predetermined point on the individual overlying or on a
blood vessel, said first means including means for deriving (1) a change in a
parameter taken from the group consisting of intensity, change in intensity,
change in polarization, and fluorescence of the emitted energy and (2) amount of
transdermal absorption, said waveform energy being modulated electromagnetic
radiation in a suboptical range of the electromagnetic spectrum.
31. The
system defined in claim 30, wherein said processing means includes means for
automatically measuring emitted radiation at an additional point proximate to
said predetermined point to determine a level of surface moisture and means for
compensating for surface absorption due to surface moisture in determining said
amount of transdermal absorption.
32. The system defined in claim 30,
further comprising means operatively connected to said processing means for
automatically and remotely monitoring the individual's position, thereby
enabling said processing means to track changes in position of said
predetermined point.
33. A system for remotely determining information
relating to a person's emotional state, comprising: generator means for
generating waveform energy having a predetermined frequency and a predetermined
intensity, said generator means being remotely spaced from a target individual;
transmitter means operatively connected to said generator means for
wirelessly transmitting said waveform energy towards the individual;
detector means for detecting energy emitted from the individual in
response to the waveform energy; and processing means operatively
connected to said detector means for analyzing the emitted energy to derive
information relating to the individual's emotional state, said processing means
being operatively connected to at least one of said generator means and said
transmitter means for controlling emission of energy towards the individual,
said processing means including first means for determining a value related to
perspiration and second means operatively connected to said first means for
comparing the determined value with a stored reference value to identify a
change in perspiration, said waveform energy being modulated electromagnetic
radiation, said detector means including means for measuring an intensity of
radiation emitted from a predetermined point on the individual.
Description
BACKGROUND OF THE INVENTION
This invention relates to a method
and an associated apparatus for remotely determining information pertaining to
an individual's emotional and/or metabolic state.
In many situations, to
make decisions it would be helpful to have objective information regarding a
person's emotional state. Such information is useful in ascertaining the
person's thoughts and intentions. For example, in an interview situation,
objective information as to the interviewee's emotional state provides a better
basis on which to judge the truthfulness of the interviewee's responses to
questions. Such information has been conventionally obtained, in certain
applications, by so-called lie detectors. A problem with such devices is that
the interviewee is necessarily aware of the testing. This introduces a
complication in evaluating the results of the lie detector testing. Accordingly,
it would be desirable to provide a means for objectively determining emotional
state parameters without the knowledge of the subject.
Such technology
would also be useful for medical purposes, to determine, for example, whether a
person is in danger of a life-threatening heart attack. Some of the
physiological parameters which indicate emotional stress are also indicative of
the physical stress of a heart condition. Such physiological parameters include
blood pressure and pulse rate. An irregular pulse is especially indicative of a
cardiac arrythmia which may be a prelude to myocardial infarction.
Technology which serves to objectively identify emotional state without
the knowledge of the subject is also useful in security applications. It would
be beneficial, for example, to detect an individual contemplating a robbery or
hijacking prior to entry of that individual into a bank or an airplane.
OBJECTS OF THE INVENTION
An object of the present invention is
to provide a method for obtaining information pertinent to a person's emotional
state, without the person's knowledge.
Another object of the present
invention is to provide such a method for use in determining the truthfulness or
sincerity of the person during an interview.
An alternative object of
the present invention is to provide such a method for use in checking the health
of the person.
Another alternative object of the present invention is to
provide such a method for use in detecting those contemplating a criminal act.
Another, more particular, object of the present invention is to provide
such a method which is implemented remotely, without touching the subject.
Yet another object of the present invention is to provide an associated
apparatus or system for obtaining information pertinent to a person's emotional
state, without the person's knowledge.
These and other objects of the
present invention will be apparent from the drawings and detailed descriptions
herein.
SUMMARY OF THE INVENTION
A method for remotely
determining information relating to a person's emotional state, comprising the
steps of (a) generating waveform energy having a predetermined frequency and a
predetermined intensity, the step of generating being implemented at a location
remotely spaced from a target individual, (b) wirelessly transmitting the
waveform energy towards the individual, (c) detecting energy emitted or
reflected from the individual in response to the waveform energy, and (d)
automatically analyzing the emitted or reflected energy to derive information
relating to the individual's emotional state.
According to another
feature of the present invention, the step of analyzing includes the steps of
determining a value related to a physiological parameter taken from the group
consisting of blood pressure, pulse rate, respiration rate, pupil size, and
perspiration, and comparing the value with a stored reference value to identify
a change in the parameter.
Where the parameter is respiration rate and
the detected energy is reflected from the individual's chest wall, the method
further comprises the steps of processing the reflected energy to determine
location of the individual's chest wall, and automatically monitoring the
individual's position and compensating for changes in the individual's position
in determining changes in location of the individual's chest wall.
Alternatively, respiration rate may be determined by monitoring the
differential remote absorption of the individual subject's exhalation gases.
Invisible electromagnetic radiation from a source such as a light emitting diode
(e.g., a laser diode) is directed towards the subject's mouth. The diode
generated radiation is modulated at a high rate with a phase-locked component.
Radiation returning from the subject and particularly from gases at the
subject's mouth are filtered via an electro-optical modulating polarization
component. This polarization component may take the form of a filter wheel
rotating, for example, at a speed between 300 and 1,000 Hz. An opto-electric
detector senses the radiation penetrating the filter wheel. An amplifier
phase-locked with the modulator component serves to detect signals only at the
frequency of modulation. Any ambient constant energy which is not part of the
measuring signal is filtered out.
In remotely monitoring a person's
respiration rate, the waveform energy may be modulated electromagnetic radiation
or ultrasonic or subsonic pressure waves. Where the measuring waveform is
electromagnetic, the measurement may be effectuated using the principles of
differential backscatter absorption or interferometery to detect phase changes
owing to a change in position of the subject surface (the individual's chest
wall). The wavelength or frequency of the modulated electromagnetic radiation is
selected from the infrared and near-millimeter portions of the spectrum so as to
penetrate clothing material and be reflected from the underlying skin surface.
Where the measuring waveform is an ultrasonic or subsonic pressure wave, changes
in position of the chest wall may be detected via phase changes and/or by
changes in travel time.
Where the monitored parameter is pulse rate, the
measuring energy may be modulated electromagnetic radiation, in the
near-ultraviolet, infrared or near-millimeter ranges. A collimated beam of
radiation is generated and directed or aimed towards a predetermined point on
the individual overlying or on a blood vessel. The emitted or reflected energy
is processed to determine (1) intensity, change in intensity or change in
polarization or fluorescence of the emitted or reflected energy and (2) amount
of transdermal absorption. Changes in transdermal absorption can be tracked to
determine changes in volume of blood and, accordingly, the pulse of the target
individual. If necessary, variance in the emitted or reflected radiation due to
surface moisture (perspiration) can be compensated for by automatically
measuring emitted or reflected radiation at an additional point proximate to the
predetermined point to determine a level of surface moisture. Any differential
owing to varying surface moisture can be isolated and removed or used as an
indication of metabolic activity or emotional state.
The surface
moisture is detected by measuring the intensity of the radiation returning to a
detector from a selected point on the skin surface of the target individual.
Surface moisture is indicative of stress, as is known by galvanic skin response,
the electrical measure which forms the basis for conventional lie detection.
It is to be noted that some measurements made in accordance with the
present invention can be improved by taking into account movements of the
subject. For example, where pulse rate is measured by monitoring changes in
transdermal radiation absorption, the individual's position can be automatically
monitored. Thus, the radiation beam's direction can be adjusted to track the
target blood vessel. The individual's position and configuration (posture) can
be tracked by a simple pattern recognition program analyzing input from a camera
(e.g., charge coupled device).
Where the parameter is blood pressure,
the measuring medium may be ultrasonic or subsonic pressure waves. An incoming
ultrasonic or subsonic pressure wave which has been reflected from a blood
vessel below the skin surface of the subject (e.g., at the temple or in the
retina) is monitored to determine the instantaneous blood flow rate or velocity.
The principles of this measurement procedure are known from conventional
ultrasonic Doppler devices. These devices are generally placed in contact with a
patient or inserted into the body and only determine blood flow rate. In
accordance with the present invention, ultrasonic measurements of blood flow
rate are implemented remotely, i.e., the ultrasonic wave generator and the
detector are spaced by at least several feet from the individual subject. In
addition, in analyzing the incoming ultrasonic waves, a blood pressure parameter
is automatically calculated using Bernoulli's equation.
An alternative
technique for measuring blood pressure utilizes Doppler speckle interferometery.
The speed of the measurement pulses are matched to the average speed of the
blood so that there is a modulation in the self interference term of the emitted
or reflected light and the reference light. Basically, this is a kind of
temporal interferometry.
Where the monitored parameter is pupil size,
detection may be implemented by counting pixel receptors of a camera
corresponding to the subject's pupil. In this case, the measuring energy is
electromagnetic (infrared, near-millimeter).
Generally, a monitored
physiological or emotional-state parameter is compared with a reference value
which includes a previously measured value for the parameter. For example, the
pressure value obtained through calculations based on blood vessel flow rate is
compared with previous blood pressure values computed seconds or minutes before
by the same technique. An average value for the pressure parameter may be
computed and used to detect rises or falls in blood pressure possibly indicative
of emotional stress. Such emotional stress may be connected with prevarication,
with criminal intent, or with a cardiovascular malfunction. Where people
entering a bank or airplane, for example, are being monitored, the blood
pressure parameter must be correlated with other measured parameters, such as
pulse rate and respiration rate, and with average ranges for those parameters,
based on age, size and sex.
Similarly, the pulse rate may be measured
and compared with prior pulse rates of the individual test subject or with an
average pulse rate for people of the same age, sex and size. These prior values
of the monitored parameter or of average ranges are stored in encoded form in a
memory.
Changes in any physiological or physical parameter measured or
monitored as described herein can be used at least as indicators or alert
signals that an emotional state exists or has come into being in the targeted
individual. Where the individual is an interviewee, the parametric changes may
be correlated with the subjects of the conversation with the interviewee. This
correlation may be executed subsequently to the interview, where the interview
is recorded on audio and/or video tape.
Where the waveform energy is
collimated modulated electromagnetic radiation, the step of generating includes
the steps of producing an electromagnetic waveform of the predetermined
frequency and collimating the electromagnetic waveform. Then the step of
transmitting includes the step of directing the waveform to a predetermined
point on the individual. This target point may overlie a preselected blood
vessel (pulse rate, blood pressure). Alternatively, it may lie in the retina or
carotid artery of the targeted individual or test subject (pulse rate, blood
pressure). It may be the subject's chest wall (respiration rate). In the case of
perspiration rate, the target point is preferably a point having a
characteristically high number of sweat glands.
According to another
feature of the present invention, the directing of the collimated beam of
(modulated) electromagnetic radiation includes the steps of monitoring the
location of the individual. Thus, the direction of the beam is controlled to
take into account the individual's voluntary and involuntary movements so that
the selected target point is effectively tracked.
This monitoring of the
individual's position and configuration may be implemented via video processing
technology, for example, by deriving a contour of the individual and comparing
the contour with previously determined generic contour data. Such technology is
similar to that used in so-called "smart bombs" in military applications.
According to an additional feature of the present invention, the step of
analyzing the incoming emitted or reflected waveform energy includes the step of
measuring the emitted or reflected energy to determine at least one parameter
selected from the group including frequency, fluorescence, amplitude or
intensity, change in intensity, change in phase, and change in polarization. The
step of analyzing also includes the step of automatically comparing the
determined parameter with a reference value, which may incorporate at least one
prior measurement of the selected parameter with respect to the individual.
Pursuant to another feature of the present invention, the methodology
further comprises the step of changing a frequency of the waveform during a
sequence of successive measurements.
A system for remotely determining
information relating to a person's emotional state comprises, in accordance with
the present invention, a waveform generator for generating waveform energy
having a predetermined frequency and a predetermined intensity, the generator
being remotely spaced from a target individual. A transmitter is operatively
connected to the waveform generator for wirelessly transmitting the waveform
energy towards the individual. A detector is provided for detecting energy
emitted or reflected from the individual in response to the waveform energy. A
processor is operatively connected to the detector for analyzing the emitted or
reflected energy to derive information relating to the individual's emotional
state. The processor is also operatively connected to at least one of the
waveform generator and the transmitter for controlling emission of energy
towards the individual. The processor is thus able to correlate the incoming
energy with that transmitted towards the targeted individual.
In
accordance with another feature of the present invention, the processor includes
first componentry for determining a value related to a monitored physiological
or physical parameter taken from the group consisting of blood pressure, pulse
rate, respiration rate, pupil size, skin fluorescence, and perspiration. The
processor further includes second componentry operatively connected to the first
componentry for comparing the determined value with a stored reference value to
identify a change in the parameter.
Where the monitored parameter is
respiration rate, the transmitter is controlled in one particular embodiment by
the processor to direct the measuring energy towards the individual's chest
wall. The first componentry of the processor includes means for processing the
emitted or reflected energy to determine location of the individual's chest wall
and means for automatically monitoring the individual's position and
compensating for changes in the individual's position in determining changes in
location of the individual's chest wall. In measuring respiration rate, the
measuring waveform energy is modulated electromagnetic radiation or ultrasonic
or subsonic pressure waves. The waveform generator includes either an
electromagnetic energy generator or an electro-acoustic transducer for producing
ultrasonic or subsonic pressure waves.
Where the monitored parameter is
pulse rate, the waveform energy is modulated electromagnetic radiation, in the
near-ultraviolet, infrared or near-millimeter ranges and the transmitter is
controlled by the processor to direct the waveform energy towards a
predetermined point on the individual overlying or on a blood vessel. The first
processing componentry of the processor then includes means for deriving (1)
intensity of the emitted or reflected energy and (2) amount of transdermal
absorption. In addition, the processor may include structure and/or programming
for automatically measuring emitted or reflected radiation at an additional
point proximate to the predetermined point to determine a level of surface
moisture (e.g., perspiration) and means for compensating for surface absorption
due to surface moisture in determining the amount of transdermal absorption.
In accordance with another feature of the present invention, the system
further comprises tracking circuitry operatively connected to the processor for
automatically and remotely monitoring the individual's position, thereby
enabling the processor to track changes in position of the predetermined point
from which measurements are remotely taken.
Where the monitored
parameter is blood pressure, the waveform energy takes the form of an ultrasonic
or subsonic pressure wave. The processor then includes architecture and
programming for processing a reflected, incoming ultrasonic or subsonic pressure
wave to derive a rate of blood flow in a preselected blood vessel of the
individual. The processor also includes means for automatically calculating a
blood pressure parameter from the derived blood flow rate. In analyzing the
incoming ultrasonic or subsonic waves, the processor automatically calculates a
blood pressure parameter using Bernoulli's equation or Doppler speckle
interferometery. In the latter case, the speed of the measurement pulses are
matched to the average speed of the blood so that there is a modulation in the
self interference term of the emitted or reflected light and the reference
light. Basically, this is a kind of temporal interferometry.
Where the
monitored parameter is pupil size and the waveform energy is electromagnetic
radiation, the detector includes pixel receptors of a camera. The processor
includes means for automatically counting pixels corresponding to a diameter of
the individual's pupil.
Generally, the processor compares a monitored
physiological or emotional-state parameter with a reference value which includes
a previously measured value for the parameter. The reference value is stored in
a memory of the processor. A pressure value obtained through calculations based
on blood vessel flow rate is compared with previous blood pressure values
computed and stored by the processor during the same testing or measurement
session. The processor may compute an average value for the pressure parameter
and use the average value to detect rises or falls in blood pressure possibly
indicative of emotional stress.
Where the parameter is perspiration, the
waveform energy is modulated electromagnetic radiation and the detector includes
means for measuring a change in polarization or intensity at the incident or
fluorescent wavelength of the radiation emitted or reflected from a
predetermined point on the individual. Generally the amount emitted or reflected
will vary as a function of the amount of perspiration on the skin surface.
Where the waveform energy is collimated modulated electromagnetic
radiation, the waveform generator includes a source for producing an
electromagnetic waveform of the predetermined frequency and elements for
collimating the electromagnetic waveform. The transmitter includes components
(e.g., lens, directional antennae, mechanical drives) for directing the waveform
to a predetermined point on the individual.
In accordance with a further
feature of the present invention, the system also comprises a monitoring unit
operatively connected to the processor for monitoring the location of the
individual, the monitoring unit being operatively connected to the directional
components of the transmitter for controlling the operation thereof. The
location monitoring unit may include means for deriving a contour of the
individual and means connected thereto for comparing the contour with previously
determined generic contour data. More specifically, the position and
configuration of the target may be tracked by processing video input from a
camera such as a charge coupled device. The techniques of pattern recognition
may be utilized to track changes in location of a selected target point as the
individual subject moves during the course of the testing period. Ultrasonic or
subsonic waves may also be used to determine the position of the individual
subject.
In an actual application of the instant invention, the
transmitter and detector may be located in a wall of a room and camouflaged by
decorative features. Of course, multiple transmitters and detectors may be
located in different locations about the subject individual. Where an individual
is moving along a path, multiple transmitters and detectors may be necessary to
obtain sufficient information. Input from a series of detectors are analyzed to
obtain information as to emotional or physical state of the individual.
In accordance with yet another feature of the present invention, the
detector includes means for measuring the emitted or reflected energy to
determine at least one parameter selected from the group including frequency,
fluorescence, amplitude or intensity, change in intensity, change in phase, and
change in polarization, while the processor includes means for comparing the
determined parameter with a previously determined reference value. As discussed
above, the reference value may incorporate at least one prior measurement of the
selected parameter with respect to the individual. The processor then includes
means for deriving the reference value from the prior measurement.
Where
the waveform energy is electromagnetic, several frequencies may be used to
collect data. The different frequencies may be multiplexed or transmitted in
sequence from a single transmitter or generated and transmitted simultaneously
in the case of multiple transmitters. Where a single waveform generator is used,
the generator includes means for changing a frequency of the waveform during a
sequence of successive measurements.
A method and associated apparatus
in accordance with the present invention enable information pertinent to a
person's emotional state to be obtained without the person's knowledge. This
information is useful in determining the truthfulness or sincerity of an
interviewee. Thus, people being interviewed for sensitive job positions or in
connection with a criminal investigation may be monitored to elicit information
pertinent to their veracity. Of course, legal limitations may exist in using the
garnished information as evidence in criminal trials.
A method and
associated apparatus in accordance with the present invention are also useful
for automatically checking health of individuals. A company may have the
apparatus installed for checking the health of employees. Hospitals may use the
invention for an additional check on patients.
A method and apparatus in
accordance with the present invention can provide information useful in
evaluating people entering a high security area for purposes of determining
whether anybody is possibly contemplating a criminal act. Usually, people with
such criminal intent will betray themselves by elevated pulse rates, increased
blood pressure, heightened respiration rates, and/or excessive amounts of
perspiration. In the event that one or more of these physiological/physical
parameters exceed pre-established limits, an alert signal is automatically given
to security personnel who can then attend to the suspected individuals. The
alert signal may take the form of an indicator on a video monitor. An arrow
pointing to the suspect or a circle about the suspect may be generated on the
monitor. In addition, the processor or computer may provide details on the
monitor, such as which physiological parameters are involved and the magnitude
by which those parameters exceed the respective pre-established limits.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram of a
system in accordance with the present invention for remotely collecting data
pertaining to an individual's emotional state.
FIG. 2 is a flow-chart
type diagram showing programming blocks of a computer illustrated in FIG. 1.
FIG. 3 is partially a block diagram and partially a schematic plan view
showing a particular use of the system of the present invention.
FIG. 4
is partially a block diagram and partially a schematic plan view showing a
another particular use of the system of the present invention.
FIG. 5 is
a block diagram of supplemental components includable in the system of FIG. 1,
for remotely collecting data as to a subject's respiration rate.
DETAILED DESCRIPTION
As illustrated in FIG. 1, a system for
remotely determining information relating to a subject's emotional state
comprises a waveform generator or source 10 for generating electromagnetic
waveform energy having a predetermined frequency and a predetermined intensity.
Waveform generator 10, as all the other components of the system described
herein, is remotely spaced from a target individual or subject (see FIGS. 3 and
4). The frequency of the waveform energy produced by generator 10 may be
adjusted within limits by a tuning circuit 12 in response to control signals
from a signal processing unit in the form of a computer 14. The intensity or
amplitude of an electromagnetic waveform produced by generator 10 may be varied
by the generator pursuant to signals from computer 14.
Connected to
generator 10 is a phase-locked modulation component 15 which provides the
waveform from generator 10 with an information component which facilitates
filtering of extraneous ambient waveform energy. The modulation provides a
signature which facilitates detection of radiation reflected from or emitted or
reflected by the individual subject in response to the testing energy produced
by generator 10.
A collimating lens or other elements 16 are provided
downstream of generator 10 and modulation component 15. Further downstream is a
transmitter 18. Transmitter 18 may take the form of an antenna or may simply be
an aperture at an output side of collimating elements 16. Focusing elements 19
may be provided about transmitter 18 for focusing the measuring radiation at a
predetermined target point on the individual subject. Focusing elements 19 may
be controlled by computer 14 to adjust the target point.
Computer 14 is
connected at an output to a drive assembly 20 which is operatively coupled to
one or more of the energy producing components, i.e., generator 10, collimating
elements 16 and/or transmitter 18, for controlling the direction of an output
radiation beam 22. As discussed below, computer 14 controls the direction of
transmission of parameter monitoring or measuring radiation to ensure that the
radiation falls on a selected target point on the individual subject, whether
the individual is still or moving, and whether the target point itself varies.
As further illustrated in FIG. 1, a detector 24 in the form of a
photoelectric cell is provided for detecting incoming electromagnetic energy 26
emitted or reflected from the individual subject in response to output radiation
beam 22. On an input side of detector 24 is a telescoping component 27 for
limiting the field of view or to a predetermined area of the individual subject
under observation. At an output of photoelectric detector 24 are connected an
analog-to-digital (A/D) converter 28 and, for noise reduction, a phase-locked
amplifier with digital filters 30. Computer 14 is operatively connected to
detector 24 via A/D converter 28 and amplifier/filters 30 for analyzing the
incoming reflected energy 26 to derive information relating to the individual's
emotional state. Because computer 14 is operatively connected to waveform
generator 10 and transmitter 18, the computer is able to correlate specific
parameters characteristic of incoming energy 26 with corresponding parameters of
output radiation beam 22. Such parameters include amplitude or intensity and
phase and possibly polarization and wavelength or frequency.
A
polarization detector 32 including a polarization analyzer (not shown), an
analog-to-digital converter (not shown), phase locked amplifier (not shown), and
digital filters (not shown) is connected to computer 14 for providing that unit
with polarization data. On an input side of detector 32 is a telescoping
component 33 for limiting the field of view or to a predetermined area of the
individual subject under observation. A polarization analyzer (not shown) may be
disposed in front of detector 24 for providing computer 14 with data relating to
change in polarization. In that event, the functions of polarization detector 32
are performed by the analyzer, detector 24, analog-to-digital converter 28, and
phase locked amplifier with digital filters 30. The polarization of the output
radiation beam 22 may be controlled in accordance with known techniques.
As discussed hereinafter with reference to FIG. 2, computer 14 includes
componentry and/or programming for determining values related to one or more
monitored physiological or physical parameters including blood pressure, pulse
rate, respiration rate, pupil size, and perspiration. Computer 14 further
includes componentry and/or programming for comparing the determined values with
one or more stored reference values to identify changes in the monitored
parameters. The parametric changes thus determined can be correlated with topics
of an interview with the individual subject to provide interviewers with data
concerning the veracity of the interviewee. The determined changes in monitored
parameters can also be correlated with one another to determine with a selected
individual is possibly entertaining criminal intent or is possibly a victim of a
heart attack.
As further illustrated in FIG. 1, the system further
comprises an ultrasonic or subsonic frequency generator 34 which is triggered or
controlled by computer 14 and which is linked at an output to a piezoelectric
electroacoustic transducer 36. Transducer 36 produces an ultrasonic or subsonic
output wave 38 of a predetermined wavelength. Output wave 38 may be concentrated
or focused by pressure wave modification elements 39 provided downstream of
transducer 36.
An incoming ultrasonic or subsonic pressure wave 40
reflected from an individual and particularly from a selected target point on
the individual is detected by a piezoelectric acousto-electric transducer array
42. A telescoping component 41 (as in a shot-gun microphone) may be provided on
an input side of the individual acousto-electric transducer of array 42, for
limiting the field of view of the transducers.
Electrical signals
produced by transducer array 42 in response to incoming ultrasonic or subsonic
pressure wave 40 are fed to analog-to-digital (A/D) converters 44. Converters 44
are operatively tied to digital filters 46 which in turn are connected at an
output to preprocessing circuitry 48. Preprocessing circuitry 48 aids computer
14 in analyzing incoming ultrasonic or subsonic pressure wave 40 to isolate
desired data pertaining to one or more preselected target points.
FIG. 1
also shows a video camera 50 (e.g., a charge coupled device) which converts
incoming electromagnetic waves 52 to an electrical video signal fed to a video
recording unit 54 and to computer 14. Generally, camera 50 is responsive to
radiation in the optical portion of the spectrum. However, it is also possible
for camera to be alternatively or additionally responsive to radiation in the
infrared and/or microwave portions of the spectrum.
A microphone 56 for
sensing acoustic-frequency pressure waves 58 is connected to video recording
unit 54 for enabling the storage of voice-frequency utterances of an individual
subject in tandem with or as a part of a video recording. Microphone 56 is
operatively connected to computer 14 for providing that unit with data
pertaining, for example, to voice-frequency utterances of the subject.
To monitor pulse rate, computer 14 controls tuning circuit 12 and
generator 10 so that output radiation beam 22 has a wavelength in a suboptical
range of the electromagnetic spectrum, i.e., in the infrared or near-millimeter
range. Transmitter 18 is controlled by computer 14 via drive assembly 20 to
direct output radiation beam 22 towards a predetermined point on the individual
overlying or on a blood vessel. The blood vessel may be, for example in the
temple or in the eye of the test subject.
As illustrated in FIG. 2, for
determining pulse rate, computer 14 makes a determination of the intensity or
amplitude of output radiation beam 22 in a programming routine 60. In another
step 62, computer 14 detects or measures the intensity of incoming reflected
energy 26. In a subsequent series of steps 64 66, computer 14 derives a change
in intensity between the output radiation beam 22 and the incoming reflected
energy 26 and calculates a transdermal absorption value characteristic of the
amount of blood in the monitored blood vessel underlying the target point on the
skin surface or the retina of the individual. Each successively calculated
transdermal absorption value is stored in a step 68 and used in a later
computation 70 to determine a substantially instantaneous pulse rate of the
individual subject.
A computed pulse rate is compared in a step 72 with
a reference value (represented by input arrow 74) to ascertain information
relevant to the emotional status of the person being monitored. The reference
value may take the form of a previously determined average or normal pulse rate
or may be calculated from a series of pulse rates of the individual during the
same test session, or even during prior test sessions with the same subject. An
average or normal pulse rate used as a reference value in comparison step 72 may
be a function of various physical characteristics of the individual test
subject, such as age and weight, and immediate history, such the exercise
status. If the individual is walking, the average pulse rate will be higher than
if the individual has been sitting for several minutes. The different average
pulse rate values, as well as parameters pertaining to the age, weight and
history of the individual test subject, may be fed to computer 14 via a keyboard
76 (FIG. 1).
In determining transdermal radiation absorption incident to
computing the pulse rate of the individual test subject, computer 14 may
compensate for changes in surface moisture (perspiration). Surface moisture is
measured, as discussed immediately below, at a point adjacent to the pulse rate
target point, but not overlying a blood vessel. Computer 14 controls drive
assembly 20 to adjust the location of the target point.
As further
illustrated in FIG. 2, computer 10 includes programming or hard-wired
componentry for making a surface moisture calculation 78 indicative of
perspiration rate. A change in intensity between the output radiation beam 22
and the incoming reflected energy 26, derived at 64, is used in calculation 78.
The results of surface moisture calculation 78 are compared in a step 80 with a
reference value 82. Reference value 82 may be a predetermined value
characteristic, for example, of an average reflectivity of dry skin. This value
is provided to computer 14 via keyboard 76. Alternatively, reference value 82
may be determined on the basis of a series of calibrating calculations of the
surface moisture of the individual test subject, at the test or target point
along or at a plurality of spaced points on the skin of the individual subject.
Pulse rate may alternatively be measured via a change in phase or a
frequency change (Doppler) measurement. Generally, such information is obtained
through ultrasonic or subsonic pressure waves, as discussed in detail
hereinafter. However, the potential for obtaining such information via an
electromagnetic measuring radiation is contemplated. To that end, computer 14
makes a determination 84 of the outgoing frequency of output radiation beam 22
and detects at 86 the frequency of incoming reflected energy 26. In a step 88,
computer 14 derives a frequency change indicative of the velocity of a moving
surface, e.g., a wall of a blood vessel in the retina of the individual test
subject. A succession of velocities may be integrated to derive position values.
(See steps 96, 100, and 102, discussed below).
To monitor respiration
rate, computer 14 energizes frequency generator 34 and transducer 36 to emit an
ultrasonic or subsonic pressure wave of a known wavelength towards the
individual test subject and particularly towards the chest wall of the
individual subject. As depicted in FIG. 2, computer 14 uses input from
preprocessing circuitry 48 in a step 90 to isolate ultrasonic or subsonic
pressure wave data corresponding the chest wall of the individual test subject.
The results of this isolation 90 are used in a step 92 to derive a frequency
change of ultrasonic or subsonic pressure wave 40 with respect to ultrasonic or
subsonic output wave 38 (frequency determined at 94). In a step 96, computer 14
uses the frequency change data to determine position of the chest wall via an
integration technique taking into account previously computed positional data at
98. In a further computation 100, computer 14 determines respiration rate. The
computed respiration rate is compared in a step 102 with a reference value 104
to derive information pertinent to the contemporaneous or real-time emotional
state of the individual test subject. Reference value 104 may be an average
respiration rate input into computer 14 via keyboard 76. Alternatively,
reference value 104 may be determined on the basis of a series of calibrating
calculations of the respiration of the individual test subject. A reference
value 104 in the form of a predetermined average may vary in accordance with the
immediate exercise history of the individual test subject. If the individual is
walking, the reference value for the respiration rate will be higher than if the
individual has been sitting for a time. In addition, the reference value may
vary depending on the size and apparent athleticism of the individual. People
who exercise a great deal tend to have lower respiration rates (and pulse rates)
than those who do not exercise. These variables may be entered into computer 14
via keyboard 76.
Respiration rate may be similarly measured by
monitoring a change in frequency of incoming reflected energy 26 with respect to
output radiation beam 22. In that case, of course, computer 14 controls drives
20 to direct the output radiation beam 22 toward the chest of the individual
test subject.
To obtain a measurement related to blood pressure, results
of isolation step 90 are used in a step 106 to calculate a Doppler effect from
fluid moving in a targeted subsurface blood vessel. In step 90, computer 14
isolates ultrasonic or subsonic data corresponding to the targeted subsurface
blood vessel. The Doppler effect calcuation of step 106 produces a velocity
value which is used by computer 14 to compute a pressure parameter at 108. This
computation is based on Bernoulli's fluid flow equation or Doppler speckle
interferometery. In the latter case, the speed of the measurement pulses are
matched to the average speed of the blood so that there is a modulation in the
self interference term of the emitted or reflected light and the reference
light.
In a subsequent step 110, the computed pressure value is compared
with a reference value (112) to determine information pertaining to the
contemporaneous or real-time emotional state of the individual test subject. As
discussed above with respect to the evaluation of other measured parameters, the
reference value 112 for blood pressure may be an average or normalized value
predetermined in accordance with known blood pressure data derived from known
populations.
To determine the size of a pupil of the individual test
subject, the detector is camera 50 (FIG. 1). An image from camera 50 is
subjected to pattern recognition processes in a step 114 (FIG. 2) so as to
identify the individual's pupil in the image. In a subsequent step 116, computer
14 calculates the individual test subject's contemporaneous or real-time pupil
size effectively by counting pixel receptors of camera 50 which correspond to a
diameter or area of pupil. In another step 118, the calculated pupil size is
compared with a reference value 120, e.g., a predetermined average.
Results of pattern recogition processes 114 are also utilizable by
computer 14 to track the location and posture of the individual test subject. In
a step 122, computer 14 calculates position of the individual test subject based
on the pattern recognition data from processes 114. The results of these
calculations 122 are used by computer 14 in a step 124 to track the selected
target point (e.g., over a blood vessel, in the retina). Computer 14 controls
directional drive assembly 20 (FIG. 1) in a step 126 in accordance with the
position of the target point as determined in step 124.
Pattern
recognition processes 114 may include steps for deriving a contour of the
individual test subject and for comparing the contour with previously determined
generic contour data. The techniques of pattern recognition may be utilized to
track changes in location of a selected target point as the individual subject
moves during the course of the testing period. Ultrasonic or subsonic waves may
also be used to determine the position of the individual subject.
It is
contemplated that other information such as polarization and phase contained in
an electromagnetic output radiation beam 22 and incoming reflected energy 26 may
be used for remotely obtaining information pertaining to the emotional state of
the individual test subject. To that end, for example, computer 14 determines
the polarization (and/or phase) of output radiation beam 22 at 128 and of
incoming reflected energy 26 at 130. A polarization change is derived in step
132.
Another source of remotely obtainable data about the emotional
and/or metabolic state of a subject is skin fluorescence. An activating or
stimulus wavelength in the ultraviolet range is produced by generator 10 and
directed from transmitter 18 towards a predetermined target spot on the
individual subject. The target spot is scanned by photoelectric detector 24 to
determine the fluorescent output of the target spot. A filter wheel (not shown)
may be provided at the input of detector 24 for facilitating determination of
the wavelength of fluorescent energy.
If in one or more of the
comparison steps 72, 80, 102, 110, 118, computer 14 determines that the
respective computed value for the blood pressure, perspiration rate, respiration
rate, blood pressure and/or pupil size has exceeded or fallen below the
respective reference value, the computer issues an alert signal in a step 133.
That alert signal may take a visually perceptible form. For example, computer 14
may generate a message on a monitor 135 (FIG. 1). The message may include
particulars as to the detected anomaly in the monitored physiological signs of
the individual under observation. The identity of the anomalous parameters, as
well as the kind and amount of deviation may be displayed on monitor 135.
As depicted in FIG. 3, in an actual application of the system of FIGS. 1
and 2, transmitter 18 and photoelectric detector 24 are located in a wall 134 of
a room 136 and camouflaged by decorative features such as wall sculptures or
paintings (not shown). FIG. 3 only shows some of the componentry of the system
of FIG. 1, for purposes of simplicity. An individual test subject TSI is seated
in a chair 138 in room 126. Camera 50 is one of a pair of cameras 50 and 140,
which are connected to a video processing circuit 142 (e.g., computer 14). The
dual input facilitates triangulation of the position of individual test subject
TSI in room 136.
FIG. 4 shows multiple electromagnetic radiation
transmitters 144 and multiple photoelectric detectors 146 spaced from one
another along a path 148 followed by a selected individual test subject TSU.
Input from detectors 146 are analyzed to obtain information as to emotional or
physical state of the individual TSU. The modified system of FIG. 4 also
includes multiple ultrasonic or subsonic frequency generators 150a, 150b
connected to respective piezoelectric transducers 152a, 152b. Generators 150a
and 150b generally produce pressure waves of different wavelengths or
frequencies to facilitate differentiation and processing of ultrasonic or
subsonic input at spaced points along path 148. A single array of piezoelectric
acousto-electric transducers 154 may be used to detect the ultrasonic or
subsonic signals from individual test subject TSU. Transducers 154 are connected
to A/D converters 158. The system of FIG. 4 also includes multiple video cameras
160a, 160b spaced along path 148. A video processing unit 162 receives signals
from cameras 160a, 160b. The signals from cameras 160a, 160b are used as
discussed above to determine pupil size and subject location.
With
respect to the system of FIG. 1, computer 14 may be programmed to control tuning
circuit 12 so that generator 10 produces different frequencies in an
interdigitated or multiplexed pattern for augmenting the obtainable information.
FIG. 5 illustrates components for monitoring the differential remote
absorption of the individual subject's exhalation gases, in order to determine
respiration rate. Invisible electromagnetic radiation 164 from a source such as
a light emitting diode (e.g., a laser diode) 166 is directed towards the
subject's mouth. The diode generated radiation is modulated at a high rate with
a phase-locked component 168. Focusing elements 170 may be controlled by
computer 14 to adjust the target point.
Radiation 172 returning from the
subject and particularly from gases at the subject's mouth are filtered via an
electro-optical modulating polarization component exemplarily in the form of a
filter wheel 174 rotating at a speed between 300 and 1,000 Hz. An opto-electric
transducer or detector 176 senses the radiation penetrating filter wheel 174. An
amplifier 178 phase-locked with modulator component 168 serves to detect signals
only at the frequency of modulation. Any ambient constant energy which is not
part of the measuring signal is filtered out.
Although the invention has
been described in terms of particular embodiments and applications, one of
ordinary skill in the art, in light of this teaching, can generate additional
embodiments and modifications without departing from the spirit of or exceeding
the scope of the claimed invention. Accordingly, it is to be understood that the
drawings and descriptions herein are profferred by way of example to facilitate
comprehension of the invention and should not be construed to limit the scope
thereof.
* * * * *