US20050024212A1 - Method and device for detecting the drowsiness state of drivers of moving objects - Google Patents

Method and device for detecting the drowsiness state of drivers of moving objects Download PDF

Info

Publication number
US20050024212A1
US20050024212A1 US10/498,659 US49865904A US2005024212A1 US 20050024212 A1 US20050024212 A1 US 20050024212A1 US 49865904 A US49865904 A US 49865904A US 2005024212 A1 US2005024212 A1 US 2005024212A1
Authority
US
United States
Prior art keywords
recited
logic
signal
drowsiness
indicates
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/498,659
Inventor
Hagen Hultzsch
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Deutsche Telekom AG
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Assigned to DEUTSCHE TELEKOM AG reassignment DEUTSCHE TELEKOM AG ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HULTZSCH, HAGEN
Publication of US20050024212A1 publication Critical patent/US20050024212A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K28/00—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
    • B60K28/02—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
    • B60K28/06—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
    • B60K28/066—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver actuating a signalling device
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
    • B60L3/00—Electric devices on electrically-propelled vehicles for safety purposes; Monitoring operating variables, e.g. speed, deceleration or energy consumption
    • B60L3/02—Dead-man's devices
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
    • B60L2200/00—Type of vehicles
    • B60L2200/26—Rail vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W2050/0001—Details of the control system
    • B60W2050/0019—Control system elements or transfer functions
    • B60W2050/0022—Gains, weighting coefficients or weighting functions
    • B60W2050/0025—Transfer function weighting factor

Definitions

  • the present invention is directed to a method, as well as to a device for monitoring the drowsiness state of operators of moving objects, such as vehicles, airplanes, trains or ships.
  • the method and the device can likewise be employed to determine the drowsiness state of other persons, such as security guards.
  • an alarm signal is triggered and/or the moving object is brought to a standstill by appropriate means.
  • GB 2 145 262 A and U.S. Pat. No. 5,402,109 Devices for detecting the drowsiness state are known from GB 2 145 262 A and U.S. Pat. No. 5,402,109.
  • special glasses are used to determine the state of the eyelid (closed or open).
  • GB 2 215 040 A discusses ascertaining the condition of the eyelid by using a video camera.
  • DE 32 29 773 uses a series of optical pulses, which are reflected differently depending on the state of the eyelid.
  • the object of the present invention is to reliably detect the drowsiness state of the operator of moving objects and to prevent accidents by subsequently initiating appropriate measures, such as waking up the operator and/or acting on the locomotive characteristics of the moving object.
  • a plurality of measured variables such as eyelid blinking frequency, yawning frequency, and the state of facial muscle relaxation, is determined and processed in accordance with FIG. 1 into a composite signal:
  • the frequency of eyelid blinking decreases with an advancing state of drowsiness and may, therefore, be used as an appropriate measured variable.
  • the eyelid pulse-duty ratio changes, i.e., the ratio between a closed and open eyelid as a function of time.
  • long phases of an open eyelid are interrupted by short phases of a closed eyelid.
  • the closed-eyelid phases lengthen.
  • Yawning by the operator of moving objects i.e., for a brief moment, the eyes are completely or partially closed, and the mouth is wide open, may be determined using optical recognition, by employing an electronic camera and subsequent image processing, such as pattern recognition and by making a comparison to stored images from the awake state.
  • Relaxation of the facial muscles, particularly in the area of the cheeks, is ascertained, for example, by using strain gauges applied to the facial skin, or with the aid of electronic image processing, such as cameras, pattern recognition, and by making a comparison to the images from the awake state.
  • a combination of the afore-mentioned signals may constitute an independent measuring signal.
  • the device according to the present invention may be expanded as needed to include consideration of other physiological measuring signals.
  • End-status signal 8 may be used as a wake-up signal, an acoustic and/or optical alarm and/or a vibrational alarm being used. Moreover, in response to an ascertained drowsiness, this signal may be used to act in a measured way upon the locomotive characteristics of the moving object. In the process, measures such as uncoupling the engine and transmission (disengaging), cutting off the engine, and/or gentle braking, may be carried out. In trains, this signal may be directly used to release the so-called dead-man brake.

Abstract

The invention relates to a method and a device for monitoring the drowsiness of drivers of moving objects, such as vehicles, aeroplanes, trains, and ships. According to said method, several physiological measurement variables such as e.g. blinking frequency, eyelid pulse frequency, yawning frequency or the state of face muscle relaxation are combined into a summation signal with a differentiated weighting, said signal constituting a final state signal, which indicates the drowsiness with the logic states 0 (zero/e.g. no drowsiness established) or 1 (one/e.g. drowsiness established).

Description

  • The present invention is directed to a method, as well as to a device for monitoring the drowsiness state of operators of moving objects, such as vehicles, airplanes, trains or ships. The method and the device can likewise be employed to determine the drowsiness state of other persons, such as security guards. When a drowsiness state is recognized, an alarm signal is triggered and/or the moving object is brought to a standstill by appropriate means.
  • Devices for detecting the drowsiness state are known from GB 2 145 262 A and U.S. Pat. No. 5,402,109. In this context, special glasses are used to determine the state of the eyelid (closed or open). GB 2 215 040 A discusses ascertaining the condition of the eyelid by using a video camera. To make such a determination, as discussed above, DE 32 29 773 uses a series of optical pulses, which are reflected differently depending on the state of the eyelid. These methods and devices have the disadvantage of concentrating only on the state of the eyelid and not being able to detect someone sleeping with his/her eyes open, for example.
  • The object of the present invention is to reliably detect the drowsiness state of the operator of moving objects and to prevent accidents by subsequently initiating appropriate measures, such as waking up the operator and/or acting on the locomotive characteristics of the moving object.
  • This objective is achieved by the method set forth in claim 1 and, respectively, by the device set forth in claim 6. In this context, a plurality of measured variables, such as eyelid blinking frequency, yawning frequency, and the state of facial muscle relaxation, is determined and processed in accordance with FIG. 1 into a composite signal:
      • Determining the individual measured variables using detectors 1.
      • Comparing the detector signals to comparison signals 2 in comparators 3. Each comparator supplies a status signal (z), which may assume logic values 0 (zero) or 1 (one). In this way, it is possible to prevent individual measured variables, which are below a threshold value, from contributing to the composite signal.
      • Weighting of the status signals with 4, so that signals (s) may assume any desired values between 0 (zero) and 1 (one).
      • Summing the signals (s) in 5.
      • Comparing the composite signal to comparison signal 6 in end comparator 7. The result is end-status signal 8, which may assume logic values 0 (zero/e.g., no drowsiness ascertained) and 1 (one/drowsiness ascertained).
  • Experience shows that the frequency of eyelid blinking decreases with an advancing state of drowsiness and may, therefore, be used as an appropriate measured variable. Moreover, in a state of drowsiness, the eyelid pulse-duty ratio changes, i.e., the ratio between a closed and open eyelid as a function of time. In this context, in the awake state, long phases of an open eyelid are interrupted by short phases of a closed eyelid. As drowsiness advances, the closed-eyelid phases lengthen.
  • Yawning by the operator of moving objects, i.e., for a brief moment, the eyes are completely or partially closed, and the mouth is wide open, may be determined using optical recognition, by employing an electronic camera and subsequent image processing, such as pattern recognition and by making a comparison to stored images from the awake state.
  • Relaxation of the facial muscles, particularly in the area of the cheeks, is ascertained, for example, by using strain gauges applied to the facial skin, or with the aid of electronic image processing, such as cameras, pattern recognition, and by making a comparison to the images from the awake state.
  • In the same way, a combination of the afore-mentioned signals, such as eyelid pulse-duty ratio and state of the facial-muscle relaxation, may constitute an independent measuring signal.
  • The device according to the present invention may be expanded as needed to include consideration of other physiological measuring signals.
  • End-status signal 8 may be used as a wake-up signal, an acoustic and/or optical alarm and/or a vibrational alarm being used. Moreover, in response to an ascertained drowsiness, this signal may be used to act in a measured way upon the locomotive characteristics of the moving object. In the process, measures such as uncoupling the engine and transmission (disengaging), cutting off the engine, and/or gentle braking, may be carried out. In trains, this signal may be directly used to release the so-called dead-man brake.

Claims (94)

1-29. (Canceled).
30. A method for monitoring a drowsiness state of operators of moving objects, such as vehicles, airplanes, trains, and ships, comprising:
combining a plurality of physiological measured variables, including at least eyelid blinking frequency and eyelid pulse-duty ratio, to form a differently weighted composite signal, which, by states of logic 0 or logic 1, then indicates the drowsiness state as an end-status signal.
31. A method for monitoring a drowsiness state of operators of moving objects, such as vehicles, airplanes, trains, and ships, comprising:
combining a plurality of physiological measured variables, including at least eyelid blinking frequency and yawning frequency, to form a differently weighted composite signal, which, by states of logic 0 or logic 1, then indicates the drowsiness state as an end-status signal.
32. A method for monitoring a drowsiness state of operators of moving objects, such as vehicles, airplanes, trains, and ships, comprising:
combining a plurality of physiological measured variables, including at least an eyelid blinking frequency and a state of facial-muscle relaxation, to form a differently weighted composite signal, which, by states of logic 0 or logic 1, then indicates the drowsiness state as an end-status signal.
33. A method for monitoring the drowsiness state of operators of moving objects, such as vehicles, airplanes, trains, and ships, comprising:
combining a plurality of physiological measured variables, including at least eyelid pulse-duty ratio and yawning frequency, to form a differently weighted composite signal, which, by states of logic 0 or logic 1, then indicates the drowsiness state as an end-status signal.
34. A method for monitoring the drowsiness state of operators of moving objects, such as vehicles, airplanes, trains, and ships, comprising:
combining a plurality of physiological measured variables, including at least eyelid pulse-duty ratio and state of facial-muscle relaxation, to form a differently weighted composite signal, which, by states of logic 0 or logic 1, then indicates the drowsiness state as an end-status signal.
35. A method for monitoring the drowsiness state of operators of moving objects, such as vehicles, airplanes, trains, and ships, comprising:
combining a plurality of physiological measured variables, including at least yawning frequency and state of facial-muscle relaxation, to form a differently weighted composite signal, which, by states of logic 0 or logic 1, then indicates the drowsiness state as an end-status signal.
36. The method as recited in claim 32, wherein, as a further physiological measured variable, a yawning frequency enters into the composite signal.
37. The method as recited in claim 30, wherein, as a further physiological measured variable, a state of relaxation enters into the composite signal.
38. The method as recited in claim 33, wherein, as a further physiological measured variable, eyelid frequency enters into the composite signal.
39. The method as recited in claim 31, wherein, as a further physiological measured variable, eyelid pulse-duty ratio enters into the composite signal.
40. The method as recited in claim 36, wherein, as a further physiological measured variable, eyelid pulse-duty ratio enters into the composite signal.
41. The method as recited in claim 40, wherein a suitable combination of a plurality of physiological measured variables constitutes an independent measuring signal.
42. The method as recited in claim 30, wherein, as a wake-up signal, the end-status signal triggers at least one of an acoustic alarm, an optical alarm, and a vibrational alarm.
43. The method as recited in claim 30, wherein the end-status signal acts on locomotive characteristics of the moving object, it being possible to carry out measures such as uncoupling, switching off an engine and/or gentle braking.
44. The method as recited in claim 30, wherein, in trains, the end-status signal can be directly used to release a dead-man brake.
45. A device for monitoring the drowsiness state of operators of moving objects, such as vehicles, airplanes, trains, and ships, comprising:
a differently weighted composite signal being formed by combining a plurality of physiological measured variables, including at least eyelid blinking frequency and eyelid pulse-duty ratio, which, by states of logic 0 and/or logic 1 then indicates the drowsiness state as end-status signal.
46. A device for monitoring the drowsiness state of operators of moving objects, such as vehicles, airplanes, trains, and ships, comprising:
a differently weighted composite signal being formed by combining a plurality of physiological measured variables, including at least eyelid blinking frequency and the yawning frequency, which, by states of logic 0 and/or logic 1 then indicates the drowsiness state as end-status signal.
47. A device for monitoring the drowsiness state of operators of moving objects, such as vehicles, airplanes, trains, and ships, comprising:
a differently weighted composite signal being formed by combining a plurality of physiological measured variables, including at least eyelid blinking frequency and the state of facial-muscle relaxation, which, by states of logic 0 and/or logic 1 then indicates the drowsiness state as end-status signal.
48. A device for monitoring the drowsiness state of operators of moving objects, such as vehicles, airplanes, trains, and ships, comprising:
a differently weighted composite signal being formed by combining a plurality of physiological measured variables, including at least eyelid pulse-duty ratio and the yawning frequency, which, by states of logic 0 and/or logic 1 then indicates the drowsiness state as end-status signal.
49. A device for monitoring the drowsiness state of operators of moving objects, such as vehicles, airplanes, trains, and ships, comprising:
a differently weighted composite signal being formed by combining a plurality of physiological measured variables, including at least eyelid pulse-duty ratio and state of facial-muscle relaxation, which, by states of logic 0 and/or logic 1 then indicates the drowsiness state as end-status signal.
50. A device for monitoring the drowsiness state of operators of moving objects, such as vehicles, airplanes, trains, and ships, comprising:
a differently weighted composite signal being formed by combining a plurality of physiological measured variables, including at least yawning frequency and the state of facial-muscle relaxation, which, by states of logic 0 and/or logic 1 then indicates the drowsiness state as end-status signal.
51. The device as recited in claim 47, wherein, as a further physiological measured variable, a yawning frequency enters into the composite signal.
52. The device as recited in claim 45, wherein, as a further physiological measured variable, a state of facial-muscle relaxation enters into the composite signal.
53. The device as recited in claim 48, wherein, as a further physiological measured variable, eyelid frequency enters into the composite signal.
54. The device as recited in claim 46, wherein, as a further physiological measured variable, eyelid pulse-duty ratio enters into the composite signal.
55. The device as recited in claim 51, wherein, as a further physiological measured variable, eyelid pulse-duty ratio enters into the composite signal.
56. The device as recited in claim 45, wherein, as a wake-up signal, the end-status signal triggers at least one of an acoustic alarm, an optical alarm, and a vibrational alarm.
57. The device as recited in one of claims 45 through 55, wherein the end-status signal acts on the locomotive characteristics of the moving object, it being possible to carry out measures such as uncoupling, switching off the engine and/or gentle braking.
58. The device as recited in claim 45, wherein, in trains, the end-status signal can be directly used to release a dead-man brake.
59. The method as recited in claim 30, wherein logic 0 indicates no drowsiness ascertained and logic 1 indicates drowsiness ascertained.
60. The method as recited in claim 30, wherein, as a further physiological measured variable, a yawning frequency enters into the composite signal.
61. The method as recited in claim 34, wherein, as a further physiological measured variable, a yawning frequency enters into the composite signal.
62. The method as recited in claim 31, wherein, as a further physiological measured variable, a state of facial-muscle relaxation enters into the composite signal.
63. The method as recited in claim 33, wherein, as a further physiological measured variable, a state of facial-muscle relaxation enters into the composite signal.
64. The method as recited in claim 34, wherein, as a further physiological measured variable, eyelid frequency enters into the composite signal.
65. The method as recited in claim 35, wherein, as a further physiological measured variable, eyelid frequency enters into the composite signal.
66. The method as recited in claim 32, wherein, as a further physiological measured variable, eyelid pulse-duty ratio enters into the composite signal.
67. The method as recited in claim 35, wherein, as a further physiological measured variable, eyelid pulse-duty ratio enters into the composite signal.
68. The method as recited claim 36, wherein a suitable combination of a plurality of physiological measured variables constitutes an independent measuring signal.
69. The method as recited in claim 37, wherein a suitable combination of a plurality of physiological measured variables constitutes an independent measuring signal.
70. The method as recited in claim 38, wherein a suitable combination of a plurality of physiological measured variables constitutes an independent measuring signal.
71. The method as recited in claim 60, wherein a suitable combination of a plurality of physiological measured variables constitutes an independent measuring signal.
72. The method as recited in claim 61, wherein a suitable combination of a plurality of physiological measured variables constitutes an independent measuring signal.
73. The method as recited in claim 62, wherein a suitable combination of a plurality of physiological measured variables constitutes an independent measuring signal.
74. The method as recited in claim 63, wherein a suitable combination of a plurality of physiological measured variables constitutes an independent measuring signal.
75. The method as recited in claim 64, wherein a suitable combination of a plurality of physiological measured variables constitutes an independent measuring signal.
76. The method as recited in claim 65, wherein a suitable combination of a plurality of physiological measured variables constitutes an independent measuring signal.
77. The method as recited in claim 66, wherein a suitable combination of a plurality of physiological measured variables constitutes an independent measuring signal.
78. The method as recited in claim 67, wherein a suitable combination of a plurality of physiological measured variables constitutes an independent measuring signal.
79. The method as recited in claim 31, wherein, as a wake-up signal, the end-status signal triggers at least one of an acoustic alarm, an optical alarm, and a vibrational alarm.
80. The method as recited in claim 32, wherein, as a wake-up signal, the end-status signal triggers at least one of an acoustic alarm, an optical alarm, and a vibrational alarm.
81. The method as recited in claim 33, wherein, as a wake-up signal, the end-status signal triggers at least one of an acoustic alarm, an optical alarm, and a vibrational alarm.
82. The method as recited in claim 34, wherein, as a wake-up signal, the end-status signal triggers at least one of an acoustic alarm, an optical alarm, and a vibrational alarm.
83. The method as recited in claim 35, wherein, as a wake-up signal, the end-status signal triggers at least one of an acoustic alarm, an optical alarm, and a vibrational alarm.
84. The method as recited in claim 31, wherein the end-status signal acts on locomotive characteristics of the moving object, it being possible to carry out measures such as uncoupling, switching off an engine and/or gentle braking.
85. The method as recited in claim 32, wherein the end-status signal acts on locomotive characteristics of the moving object, it being possible to carry out measures such as uncoupling, switching off an engine and/or gentle braking.
86. The method as recited in claim 33, wherein the end-status signal acts on locomotive characteristics of the moving object, it being possible to carry out measures such as uncoupling, switching off an engine and/or gentle braking.
87. The method as recited in claim 34, wherein the end-status signal acts on locomotive characteristics of the moving object, it being possible to carry out measures such as uncoupling, switching off an engine and/or gentle braking.
88. The method as recited in claim 35, wherein the end-status signal acts on locomotive characteristics of the moving object, it being possible to carry out measures such as uncoupling, switching off an engine and/or gentle braking.
89. The method as recited in claim 31, wherein, in trains, the end-status signal can be directly used to release a dead-man brake of the moving object.
90. The method as recited in claim 32, wherein, in trains, the end-status signal can be directly used to release a dead-man brake.
91. The method as recited in claim 33, wherein, in trains, the end-status signal can be directly used to release a dead-man brake.
92. The method as recited in claim 34, wherein, in trains, the end-status signal can be directly used to release a dead-man brake.
93. The method as recited in claim 35, wherein, in trains, the end-status signal can be directly used to release a dead-man brake.
94. The device as recited in claim 45, wherein, as a further physiological measured variable, a yawning frequency enters into the composite signal.
95. The device as recited in claim 49, wherein, as a further physiological measured variable, a yawning frequency enters into the composite signal.
96. The device as recited in claim 46, wherein, as a further physiological measured variable, a state of facial-muscle relaxation enters into the composite signal.
97. The device as recited in claim 48, wherein, as a further physiological measured variable, a state of facial-muscle relaxation enters into the composite signal.
98. The device as recited in claim 49, wherein, as a further physiological measured variable, eyelid frequency enters into the composite signal.
99. The device as recited in claim 50, wherein, as a further physiological measured variable, eyelid frequency enters into the composite signal.
100. The device as recited in claim 47, wherein, as a further physiological measured variable, eyelid pulse-duty ratio enters into the composite signal.
101. The device as recited in claim 50, wherein, as a further physiological measured variable, eyelid pulse-duty ratio enters into the composite signal.
102. The device as recited in claim 46, wherein, as a wake-up signal, the end-status signal triggers at least one of an acoustic alarm, an optical alarm, and a vibrational alarm.
103. The device as recited in claim 47, wherein, as a wake-up signal, the end-status signal triggers at least one of an acoustic alarm, an optical alarm, and a vibrational alarm.
104. The device as recited in claim 48, wherein, as a wake-up signal, the end-status signal triggers at least one of an acoustic alarm, an optical alarm, and a vibrational alarm.
105. The device as recited in claim 49, wherein, as a wake-up signal, the end-status signal triggers at least one of an acoustic alarm, an optical alarm, and a vibrational alarm.
106. The device as recited in claim 50, wherein, as a wake-up signal, the end-status signal triggers at least one of an acoustic alarm, an optical alarm, and a vibrational alarm.
107. The device as recited in claim 46, wherein, in trains, the end-status signal can be directly used to release a dead-man brake.
108. The device as recited in claim 47, wherein, in trains, the end-status signal can be directly used to release a dead-man brake.
109. The device as recited in claim 48, wherein, in trains, the end-status signal can be directly used to release a dead-man brake.
110. The device as recited in claim 49, wherein, in trains, the end-status signal can be directly used to release a dead-man brake.
111. The device as recited in claim 50, wherein, in trains, the end-status signal can be directly used to release a dead-man brake.
112. The method as recited in claim 31, wherein logic 0 indicates no drowsiness ascertained and logic 1 indicates drowsiness ascertained.
113. The method as recited in claim 32, wherein logic 0 indicates no drowsiness ascertained and logic 1 indicates drowsiness ascertained.
114. The method as recited in claim 33, wherein logic 0 indicates no drowsiness ascertained and logic 1 indicates drowsiness ascertained.
115. The method as recited in claim 34, wherein logic 0 indicates no drowsiness ascertained and logic 1 indicates drowsiness ascertained.
116. The method as recited in claim 35, wherein logic 0 indicates no drowsiness ascertained and logic 1 indicates drowsiness ascertained.
117. The method as recited in claim 45, wherein logic 0 indicates no drowsiness ascertained and logic 1 indicates drowsiness ascertained.
118. The method as recited in claim 46, wherein logic 0 indicates no drowsiness ascertained and logic 1 indicates drowsiness ascertained.
119. The method as recited in claim 47, wherein logic 0 indicates no drowsiness ascertained and logic 1 indicates drowsiness ascertained.
120. The method as recited in claim 48, wherein logic 0 indicates no drowsiness ascertained and logic I indicates drowsiness ascertained.
121. The method as recited in claim 49, wherein logic 0 indicates no drowsiness ascertained and logic I indicates drowsiness ascertained.
122. The method as recited in claim 50, wherein logic 0 indicates no drowsiness ascertained and logic I indicates drowsiness ascertained.
US10/498,659 2001-12-12 2002-12-12 Method and device for detecting the drowsiness state of drivers of moving objects Abandoned US20050024212A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
LU90879A LU90879B1 (en) 2001-12-12 2001-12-12 Method and device for recognizing the sleepiness state of guides of moving objects
LU90879 2001-12-12
PCT/EP2002/014116 WO2003049967A1 (en) 2001-12-12 2002-12-12 Method and device for identifying the drowsiness of drivers of moving objects

Publications (1)

Publication Number Publication Date
US20050024212A1 true US20050024212A1 (en) 2005-02-03

Family

ID=19732030

Family Applications (1)

Application Number Title Priority Date Filing Date
US10/498,659 Abandoned US20050024212A1 (en) 2001-12-12 2002-12-12 Method and device for detecting the drowsiness state of drivers of moving objects

Country Status (5)

Country Link
US (1) US20050024212A1 (en)
EP (1) EP1397268A1 (en)
JP (1) JP4024756B2 (en)
LU (1) LU90879B1 (en)
WO (1) WO2003049967A1 (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060262502A1 (en) * 2005-05-23 2006-11-23 Je-Young Chang Integrated circuit coolant microchannel assembly with manifold member that facilitates coolant line attachment
US20080212828A1 (en) * 2007-02-16 2008-09-04 Denso Corporation Device, program, and method for determining sleepiness
US7423540B2 (en) 2005-12-23 2008-09-09 Delphi Technologies, Inc. Method of detecting vehicle-operator state
US20080238694A1 (en) * 2007-03-26 2008-10-02 Denso Corporation Drowsiness alarm apparatus and program
US20100322507A1 (en) * 2009-06-22 2010-12-23 Toyota Motor Engineering & Manufacturing North America, Inc. System and method for detecting drowsy facial expressions of vehicle drivers under changing illumination conditions
US20130002417A1 (en) * 2010-03-11 2013-01-03 Toyota Jidosha Kabushiki Kaisha Biological state determination device
US9311800B2 (en) 2012-09-15 2016-04-12 Abb Technology Ag Safety device for a technical installation or a technical process
US10279825B2 (en) 2017-01-10 2019-05-07 General Electric Company Transfer of vehicle control system and method
US10370012B2 (en) 2017-03-09 2019-08-06 Ge Global Sourcing Llc Adaptive vehicle control system
US20190248374A1 (en) * 2017-03-14 2019-08-15 Omron Corporation Concentration degree determination device, concentration degree determination method, and program for determining concentration degree
US10457281B2 (en) 2017-01-23 2019-10-29 Ge Global Sourcing Llc Vehicle communication system
US11065958B2 (en) 2017-01-03 2021-07-20 Transportation Ip Holdings, Llc Control system and method
US20210271865A1 (en) * 2018-12-12 2021-09-02 Mitsubishi Electric Corporation State determination device, state determination method, and recording medium
US11963759B2 (en) * 2021-05-21 2024-04-23 Mitsubishi Electric Corporation State determination device, state determination method, and recording medium

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2004273252A1 (en) * 2003-09-15 2005-03-24 David Cohen Emergency situation detector
DE10355221A1 (en) * 2003-11-26 2005-06-23 Daimlerchrysler Ag A method and computer program for detecting inattentiveness of the driver of a vehicle
JP5292671B2 (en) * 2006-03-06 2013-09-18 トヨタ自動車株式会社 Awakening degree estimation apparatus, system and method
DE102006050017B4 (en) * 2006-10-24 2019-07-11 Volkswagen Ag Motor vehicle with a sensor arrangement for determining a condition of a driver of the motor vehicle
JP4743137B2 (en) * 2007-03-01 2011-08-10 株式会社豊田中央研究所 Sleepiness determination apparatus and program
JP5007975B2 (en) * 2007-07-13 2012-08-22 国立大学法人名古屋大学 Dozing detection device
JP5343631B2 (en) * 2009-03-04 2013-11-13 日産自動車株式会社 Driving assistance device
KR20160100654A (en) 2015-02-16 2016-08-24 주식회사 바이브라시스템 method and apparatus for detecting drowsiness by physiological signal by using video
CN107038435A (en) * 2017-05-24 2017-08-11 成都跟驰科技有限公司 The infrared inductor of human fatigue when mitigating operation

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5930751A (en) * 1997-05-30 1999-07-27 Lucent Technologies Inc. Method of implicit confirmation for automatic speech recognition
US6049747A (en) * 1996-06-12 2000-04-11 Yazaki Corporation Driver monitoring device
US6070098A (en) * 1997-01-11 2000-05-30 Circadian Technologies, Inc. Method of and apparatus for evaluation and mitigation of microsleep events
US6265978B1 (en) * 1996-07-14 2001-07-24 Atlas Researches, Ltd. Method and apparatus for monitoring states of consciousness, drowsiness, distress, and performance
US6415258B1 (en) * 1999-10-06 2002-07-02 Microsoft Corporation Background audio recovery system
US6584439B1 (en) * 1999-05-21 2003-06-24 Winbond Electronics Corporation Method and apparatus for controlling voice controlled devices
US6927694B1 (en) * 2001-08-20 2005-08-09 Research Foundation Of The University Of Central Florida Algorithm for monitoring head/eye motion for driver alertness with one camera
US7027621B1 (en) * 2001-03-15 2006-04-11 Mikos, Ltd. Method and apparatus for operator condition monitoring and assessment

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6049747A (en) * 1996-06-12 2000-04-11 Yazaki Corporation Driver monitoring device
US6265978B1 (en) * 1996-07-14 2001-07-24 Atlas Researches, Ltd. Method and apparatus for monitoring states of consciousness, drowsiness, distress, and performance
US6070098A (en) * 1997-01-11 2000-05-30 Circadian Technologies, Inc. Method of and apparatus for evaluation and mitigation of microsleep events
US5930751A (en) * 1997-05-30 1999-07-27 Lucent Technologies Inc. Method of implicit confirmation for automatic speech recognition
US6584439B1 (en) * 1999-05-21 2003-06-24 Winbond Electronics Corporation Method and apparatus for controlling voice controlled devices
US6415258B1 (en) * 1999-10-06 2002-07-02 Microsoft Corporation Background audio recovery system
US7027621B1 (en) * 2001-03-15 2006-04-11 Mikos, Ltd. Method and apparatus for operator condition monitoring and assessment
US6927694B1 (en) * 2001-08-20 2005-08-09 Research Foundation Of The University Of Central Florida Algorithm for monitoring head/eye motion for driver alertness with one camera

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7317615B2 (en) * 2005-05-23 2008-01-08 Intel Corporation Integrated circuit coolant microchannel assembly with manifold member that facilitates coolant line attachment
US7471515B2 (en) 2005-05-23 2008-12-30 Intel Corporation Integrated circuit coolant microchannel assembly with manifold member that facilitates coolant line attachment
US20060262502A1 (en) * 2005-05-23 2006-11-23 Je-Young Chang Integrated circuit coolant microchannel assembly with manifold member that facilitates coolant line attachment
US7423540B2 (en) 2005-12-23 2008-09-09 Delphi Technologies, Inc. Method of detecting vehicle-operator state
US8045766B2 (en) * 2007-02-16 2011-10-25 Denso Corporation Device, program, and method for determining sleepiness
US20080212828A1 (en) * 2007-02-16 2008-09-04 Denso Corporation Device, program, and method for determining sleepiness
US20080238694A1 (en) * 2007-03-26 2008-10-02 Denso Corporation Drowsiness alarm apparatus and program
US7821409B2 (en) * 2007-03-26 2010-10-26 Denso Corporation Drowsiness alarm apparatus and program
US8369608B2 (en) 2009-06-22 2013-02-05 Toyota Motor Engineering & Manufacturing North America, Inc. System and method for detecting drowsy facial expressions of vehicle drivers under changing illumination conditions
US20100322507A1 (en) * 2009-06-22 2010-12-23 Toyota Motor Engineering & Manufacturing North America, Inc. System and method for detecting drowsy facial expressions of vehicle drivers under changing illumination conditions
US20130002417A1 (en) * 2010-03-11 2013-01-03 Toyota Jidosha Kabushiki Kaisha Biological state determination device
US8791825B2 (en) * 2010-03-11 2014-07-29 Toyota Jidosha Kabushiki Kaishi Biological state determination device
US9311800B2 (en) 2012-09-15 2016-04-12 Abb Technology Ag Safety device for a technical installation or a technical process
US11065958B2 (en) 2017-01-03 2021-07-20 Transportation Ip Holdings, Llc Control system and method
US10279825B2 (en) 2017-01-10 2019-05-07 General Electric Company Transfer of vehicle control system and method
US10457281B2 (en) 2017-01-23 2019-10-29 Ge Global Sourcing Llc Vehicle communication system
US10370012B2 (en) 2017-03-09 2019-08-06 Ge Global Sourcing Llc Adaptive vehicle control system
US20190248374A1 (en) * 2017-03-14 2019-08-15 Omron Corporation Concentration degree determination device, concentration degree determination method, and program for determining concentration degree
US20210271865A1 (en) * 2018-12-12 2021-09-02 Mitsubishi Electric Corporation State determination device, state determination method, and recording medium
US11963759B2 (en) * 2021-05-21 2024-04-23 Mitsubishi Electric Corporation State determination device, state determination method, and recording medium

Also Published As

Publication number Publication date
JP4024756B2 (en) 2007-12-19
WO2003049967A1 (en) 2003-06-19
LU90879B1 (en) 2003-06-13
JP2005525142A (en) 2005-08-25
WO2003049967B1 (en) 2003-09-18
EP1397268A1 (en) 2004-03-17

Similar Documents

Publication Publication Date Title
US20050024212A1 (en) Method and device for detecting the drowsiness state of drivers of moving objects
CN110211335B (en) Method and device for detecting a microsleep of a driver of a vehicle
US7397382B2 (en) Drowsiness detecting apparatus and method
CN107697069A (en) Fatigue of automobile driver driving intelligent control method
EP0877346B1 (en) Apparatus for monitoring the activity of a person and/or detecting the falling down of a person
JP4677963B2 (en) Dozing detection device, dozing detection method
CN110517449A (en) A kind of intelligent air control system for net about vehicle, taxi
CN110103816B (en) Driving state detection method
CN210393305U (en) Detection apparatus for passenger's safe state in elevator
CN110435672A (en) One kind is based on scene anticipation safe driving householder method and its system
CN109190600A (en) A kind of driver's monitoring system of view-based access control model sensor
KR101177356B1 (en) Elevator security apparatus
CN110371133A (en) Fatigue of automobile driver detection system and method
CN105151938A (en) Elevator video monitoring device and method
CN110435662A (en) A kind of automobile driver and passenger monitoring system
JP2005108033A (en) Driver condition determination device and method
US20220309808A1 (en) Driver monitoring device, driver monitoring method, and driver monitoring-use computer program
CN109308467A (en) Traffic accident prior-warning device and method for early warning based on machine learning
CN206520508U (en) A kind of electric automobile safe driving assistant system
JP3036319B2 (en) Driver status monitoring device
CN109624844A (en) A kind of bus driving protection system based on image recognition and voice transmission control
CN105913523B (en) Specific people is prevented to be stranded ATM protection cabin door electronic system and its implementation
CN108408521A (en) A kind of big data analysis system and method based on elevator passenger daily behavior
WO2021046172A1 (en) Biometric data capturing and analysis using a hybrid sensing system
CN208101702U (en) A kind of non-security driving detection device of automobile based on image recognition

Legal Events

Date Code Title Description
AS Assignment

Owner name: DEUTSCHE TELEKOM AG, GERMANY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HULTZSCH, HAGEN;REEL/FRAME:015847/0195

Effective date: 20040913

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION