WO2017020501A1 - Fatigue monitoring and early-warning system and method based on digital helmet - Google Patents

Fatigue monitoring and early-warning system and method based on digital helmet Download PDF

Info

Publication number
WO2017020501A1
WO2017020501A1 PCT/CN2015/098576 CN2015098576W WO2017020501A1 WO 2017020501 A1 WO2017020501 A1 WO 2017020501A1 CN 2015098576 W CN2015098576 W CN 2015098576W WO 2017020501 A1 WO2017020501 A1 WO 2017020501A1
Authority
WO
WIPO (PCT)
Prior art keywords
fatigue
user
coefficient
wave
physiological
Prior art date
Application number
PCT/CN2015/098576
Other languages
French (fr)
Chinese (zh)
Inventor
张贯京
陈兴明
Original Assignee
深圳市易特科信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市易特科信息技术有限公司 filed Critical 深圳市易特科信息技术有限公司
Publication of WO2017020501A1 publication Critical patent/WO2017020501A1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/14Arrangements specially adapted for eye photography
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/06Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms

Definitions

  • the invention relates to the technical field of human physiological psychology detection, in particular to a fatigue monitoring and early warning system and method based on a digital helmet.
  • Human fatigue is a physiological and psychological phenomenon caused by excessive brain and physical activity, excessive mental stimulation or some monotonous activity. Human fatigue can be divided into two types: physical fatigue and mental fatigue.
  • military work fatigue refers to the fatigue caused by military labor, training and combat under the special environmental conditions of the troops or soldiers.
  • military labor and training due to the high labor intensity and long time, the muscles are repeatedly contracted and the energy consumption is large, resulting in physical fatigue. Because of the high concentration of attention, mental stress, and mental fatigue, the training ability is reduced, training The results have dropped.
  • the military operations have also undergone major changes. In a changing battlefield or mission environment, changes in the fatigue status of key position commanders can affect an action, a battle, or even a war. Therefore, it is of great significance to monitor the fatigue of the majority of officers and soldiers during the war or mission.
  • the single-person digital helmet system is known as the second brain of the vast number of officers and men, and its function is getting stronger and stronger, playing an increasingly important role in the war.
  • the individual digital helmet system is mainly divided into head protection system (including impact protection, nuclear biochemical protection, laser protection, etc.), human-computer interaction system (including call module, video module, etc.), detection and sensing system (including infrared thermal imaging, Laser detection, etc.).
  • head protection system including impact protection, nuclear biochemical protection, laser protection, etc.
  • human-computer interaction system including call module, video module, etc.
  • detection and sensing system including infrared thermal imaging, Laser detection, etc.
  • the existing single-person digital helmet system cannot monitor the fatigue situation of the soldiers during wartime or missions in real time. Therefore, the war preparation command center may not be able to grasp the soldiers immediately and cause battlefield decision-making mistakes, thus affecting the army's combat readiness or when performing tasks. The combat effectiveness of the soldiers.
  • the main object of the present invention is to provide a digital helmet-based fatigue monitoring and early warning system and method, aiming at solving the technical problem that the existing single-person digital helmet system cannot monitor and warn the soldiers in the event of military readiness or when performing tasks. .
  • the present invention provides a digital helmet-based fatigue monitoring and early warning system, the system comprising: a mental fatigue monitoring module for collecting a user's brain wave signal through an electroencephalogram collector integrated on a digitized helmet And analyzing a user's psychological fatigue coefficient according to the rhythmic change of the brain wave signal; the physiological fatigue monitoring module is configured to take a user's eye image through a camera integrated on the digitized helmet, and from the eye image The physiological fatigue coefficient of the user is analyzed; the fatigue calculation module is configured to calculate the fatigue degree of the user according to the psychological fatigue coefficient and the physiological fatigue coefficient of the user, and determine whether the fatigue degree exceeds a preset of the user under normal conditions.
  • the alarm module is configured to generate an alarm message including user fatigue when the fatigue exceeds a preset value of the user under normal conditions, and send the alarm information to the monitoring center platform through the communication network. Early warning of the user's fatigue.
  • the alarm module is further configured to control an alarm integrated on the digitized helmet to generate an alarm sound.
  • the psychological fatigue monitoring module analyzes the user's psychological fatigue coefficient according to the rhythmic change of the brain wave signal, including: preprocessing the brain wave signal collected by the brain power collector to extract the interference signal; using the wavelet packet
  • the decomposition method extracts the characteristic band alpha wave, delta wave, theta wave and beta wave of brain wave; the band energy proportional value method is used to analyze the rhythmic changes of the characteristic band alpha wave, delta wave, theta wave and beta wave.
  • the psychological fatigue factor of the person is used to analyze the rhythmic changes of the characteristic band alpha wave, delta wave, theta wave and beta wave.
  • the physiological fatigue monitoring module analyzes the physiological fatigue coefficient of the user from the eye image, including: identifying the eye movement of the user from the eye image taken by the camera; using Perclos measurement principle analysis The eye movement of the user obtains the physiological fatigue coefficient of the user.
  • the fatigue calculation module calculates the user's fatigue degree according to the user's psychological fatigue coefficient and the physiological fatigue coefficient, including: pre-defining the user's psychological fatigue coefficient and the physiological fatigue coefficient weight ratio; according to the predefined weighting The ratio weights the user's mental fatigue coefficient and physiological fatigue coefficient to obtain the user's fatigue.
  • the present invention also provides a fatigue monitoring and early warning method based on a digital helmet, the method comprising the steps of: The brain wave signal of the user is collected by an EEG collector integrated on the digitized helmet, and the user's psychological fatigue coefficient is analyzed according to the rhythmic change of the brain wave signal; the user is taken by the camera integrated in the digital helmet The eye image, and analyzing the physiological fatigue coefficient of the user from the eye image; calculating the user's fatigue degree according to the user's psychological fatigue coefficient and the physiological fatigue coefficient; determining whether the fatigue degree exceeds the user's normal situation Setting a value; when the fatigue degree exceeds a preset value of the user under normal conditions, generating an alarm message including user fatigue degree, and transmitting the alarm information to the monitoring center platform to the user through the communication network The situation is early warning.
  • the digital helmet-based fatigue monitoring and early warning method further comprises the step of: controlling an alarm integrated on the digitized helmet to generate an alarm sound when the fatigue level exceeds a preset value of the user under normal conditions.
  • the step of analyzing the user's psychological fatigue coefficient according to the rhythmic change of the brain wave signal comprises: pre-processing the brain wave signal collected by the brain power collector to extract the interference signal; using the wavelet packet decomposition method Extracting the characteristic band alpha wave, delta wave, theta wave, and beta wave of the brain wave; analyzing the rhythmic changes of the characteristic band alpha wave, delta wave, theta wave, and beta wave by using the band energy proportional value method to obtain the user's Psychological fatigue coefficient.
  • the step of analyzing a physiological fatigue coefficient of the user from the eye image includes: identifying an eye movement of the user from an eye image taken by the camera; analyzing the method by using a Perclos measurement principle The user's eye movements get the user's physiological fatigue coefficient.
  • the step of calculating the user's fatigue degree according to the user's psychological fatigue coefficient and the physiological fatigue coefficient includes: predefining a weighted ratio of the user's psychological fatigue coefficient and the physiological fatigue coefficient; according to a predefined weighting ratio The user's mental fatigue coefficient and physiological fatigue coefficient are weighted to obtain the user's fatigue.
  • the digital helmet-based fatigue monitoring and early warning method and the method can simultaneously monitor the user's fatigue condition and the physiological appearance by monitoring the user's psychological fatigue degree and physiological fatigue degree simultaneously. Fatigue users are alerted.
  • the present invention is applied to a digital battlefield, and is capable of accurately and accurately monitoring the fatigue condition of soldiers during military readiness or when performing tasks in real time. Warnings are given to soldiers with physical fatigue and soldiers with mild mental fatigue.
  • soldiers with severe mental fatigue report to the commander, perform job deployment, and avoid performing important battle operations, thus ensuring the smooth completion of combat missions and avoiding The various losses caused by the excessive fatigue of the soldiers.
  • the soldiers were mentally fatigued and the corresponding treatment plans were formulated for the moderate and severe mental fatigue soldiers to help the soldiers recover their mental fatigue and physical fatigue, thus improving the cohesiveness and combat effectiveness of the army.
  • FIG. 1 is a schematic diagram of an application environment of a preferred embodiment of a digital helmet-based fatigue monitoring and early warning system according to the present invention.
  • FIG. 2 is a schematic structural view of a preferred embodiment of the digitized helmet of FIG. 1.
  • FIG. 3 is a functional block diagram of a preferred embodiment of the fatigue monitoring and early warning system of FIG. 1.
  • FIG. 4 is a flow chart of a first preferred embodiment of the digital helmet-based fatigue monitoring and early warning method of the present invention.
  • Figure 5 is a flow chart of a second preferred embodiment of the digital helmet based fatigue monitoring and early warning method of the present invention.
  • the digitized helmet of the present invention can be worn by any user who needs to use the digitized helmet.
  • the term "users" as used in the present invention include, but are not limited to, those who use digital helmets for combat commanders and soldiers, and those who use digital helmets in high-intensity and high-risk operations (such as aerial work) in combat or performing combat readiness tasks, Competitive athletes who use digital helmets for high-intensity intense sports and staff who need to use the digital helmet of the present invention.
  • the embodiments of the present invention are only described in detail by taking the soldiers in the army preparation or when performing the tasks as an example.
  • FIG. 1 is a schematic diagram of an application environment of a preferred embodiment of the digital helmet-based fatigue monitoring and early warning system of the present invention.
  • the fatigue monitoring and early warning system 10 is installed and operated on a digitized helmet 1 worn on a soldier's head.
  • the digitized helmet 1 is not opened by a soldier, the digitized helmet 1 is in a dormant state, which is a low-radiation, low-power, non-working mode, and thus does not affect the health of the soldier.
  • the digital helmet 1 is wirelessly communicated with the monitoring center platform 2 installed in the combat read command through the communication network 3.
  • the communication network 3 is a remote wireless communication network, including but not limited to a wireless transmission network such as a GSM network, a GPRS network, or a CDMA.
  • the monitoring center platform 2 can be a monitor, a computer device, a server, or the like.
  • the fatigue monitoring and early warning system 10 can accurately monitor the fatigue condition of the soldier during the military readiness or the execution of the task in real time, and issue an early warning to the monitoring center platform 2 through the communication network 3 according to the fatigue condition of the soldier, so that the combat read command can be immediately Master the degree of fatigue of the soldiers, thus providing a basis for the combat read command to make battlefield decisions, and can improve the combat effectiveness of the military during the military readiness or when performing tasks.
  • the digitized helmet 1 includes, but is not limited to, a fatigue monitoring and early warning system 10, a brain wave collector 11, a camera 12, an alarm 13, a memory 14, and a microprocessor 15.
  • the brain wave collector 11, the camera 12, the alarm 13, and the memory 14 are electrically connected to the microprocessor 15, and can exchange information with the fatigue monitoring and early warning system 10 through the microprocessor 15.
  • the brain wave collector 11 is a sensor for detecting a user's brain wave, and is used for detecting a soldier's brain wave signal from a soldier's brain wearing the digitized helmet 1, the brain power collector 11 The soldier's brain wave signal was collected from the area above the forehead of the soldier's head.
  • the camera 12 can be an imaging instrument or a small image capturing device for monitoring and acquiring an eye image of a soldier.
  • two cameras 12 may be mounted on the left and right goggles of the digitized helmet 1, or a camera 12 may be mounted in the middle of the goggles of the digitized helmet 1.
  • the alarm device 13 can be a woofer or a speaker, which is used for soldiers to sound an alarm in high fatigue to seek help from surrounding soldiers.
  • the memory 14 can be a read only memory ROM, an electrically erasable memory EEPROM, or a flash memory FLASH or the like.
  • the microprocessor 15 can be a microcontroller (MCU), a data processing chip, or an information processing unit having data processing functions.
  • the fatigue monitoring and early warning system 10 includes, but is not limited to, a mental fatigue monitoring module 101, a physiological fatigue monitoring module 102, a fatigue calculation module 103, and an alarm module 104.
  • the module referred to in the embodiment of the present invention refers to a series of computer program instruction segments that can be executed by the microprocessor 15 of the digitized helmet 1 and that can perform a fixed function, which is stored in the memory 14 of the digitized helmet 1 . in.
  • the mental fatigue monitoring module 101 is configured to collect the brain wave signal of the soldier through the brain electrical collector 11 integrated on the digitized helmet 1, and analyze the mental fatigue coefficient of the soldier according to the rhythmic change of the soldier's brain wave signal.
  • the mental fatigue monitoring module 101 uses an electroencephalogram (EEG) to reflect the brainwave signal of the soldier, and changes the rhythm of the brain wave, such as the rhythmic changes of the alpha wave, the delta wave, the theta wave, and the beta wave.
  • EEG electroencephalogram
  • the delta wave frequency ranges from 1 to 4 Hz, and the healthy person can observe the wave while sleeping; the wave of the theta frequency ranges from 4 to 8 Hz, and the wave occurs when the soldier is in a sleepy state; the alpha wave, the frequency range is 8 -13 Hz, the band is related to whether the mood of the person is calm and easy, and whether the feeling is relaxed or not.
  • the anxiety and tension will inhibit the alpha wave, and disappear when the human body thinks about the problem or is stimulated; the beta wave, the frequency range is 14-30Hz, the brain
  • the cortex appears when excited, usually caused by depression and tension.
  • the alpha rhythm decreases or disappears, and the beta rhythm strengthens; as time increases, the load increases, theta wave appears, theta wave indicates inhibition of the cerebral cortex; when the force activity ends, The elimination of the load, the slow wave gradually disappears, the beta rhythm is gradually reduced, and the alpha rhythm is restored. If theta rhythm and delta rhythm increase in the EEG signal, and the beta rhythm decreases, it means that it is in a state of fatigue sleepiness.
  • the mental fatigue monitoring module 101 performs pre-processing of the brain wave signal to extract the interference signal, and extracts the characteristic band of the brain wave by using the wavelet packet decomposition method.
  • the wavelet packet decomposition method For example, delta wave, theta wave, alpha wave, beta wave.
  • a normalized energy relative monitoring method can be adopted, that is, a frequency band energy ratio method (Frequency) is adopted.
  • Band Energy Ratio, FBER analyze the characteristic band delta wave, theta wave, alpha wave, beta wave to get the degree of tension and psychological fatigue of the soldier.
  • the energy ratio method of the band includes: 1) When the alpha wave is dominant, FBERa is equal to 0.8 to 1 unit.
  • theta wave and belt wave have the greatest influence on the evaluation of the characteristic structure of normal human wakefulness and mental fatigue.
  • the energy of theta wave in EEG signal increases, the energy of belta wave decreases; the alpha wave is the comfortable state of the human body.
  • Wave; beta wave indicates stress; Theta wave indicates fatigue; delta wave is the normal band in sleep; in the state of mental fatigue, theta wave energy increases; beta wave energy decreases.
  • the physiological fatigue monitoring module 102 is configured to take an image of a soldier's eye through a camera 12 integrated on the digitized helmet 1 and analyze the physiological fatigue coefficient of the soldier from the eye image.
  • the physiological fatigue monitoring module 102 can analyze the eye movement from the eye image taken by the camera 12, such as the eye blink frequency, the eyelid average closing time, the eyelid average opening time, the left and right pupil diameters, and the eyeball rotation. Speed, eyes, etc., and the soldier's eye movements were analyzed using the Perclos measurement principle to obtain the soldier's physiological fatigue coefficient.
  • eye monitoring can assist EEG to monitor physiological fatigue, and at the same time help To confirm the degree of psychological fatigue of the soldiers in the awake state.
  • eye fatigue monitoring can be used as a standard for physiological fatigue monitoring, and together with EEG monitoring psychology to determine the degree of physical fatigue of soldiers.
  • the soldier is considered to be dozing. If the total number of closed eyes is more than 37 frames, the soldier is considered to be in a state of fatigue. If the average number of blinks is greater than 10-15 times per minute, the standard soldier may be in a state of fatigue sleepiness.
  • the fatigue calculation module 103 is configured to calculate the fatigue of the soldier according to the psychological fatigue coefficient and the physiological fatigue coefficient of the soldier, and determine whether the fatigue of the soldier exceeds a preset value of the soldier under normal conditions.
  • the fatigue calculation module 103 can calculate the fatigue of the soldier according to a weighted ratio of the predefined psychological fatigue coefficient and the physiological fatigue coefficient. For example, it can be defined that the soldier's psychological fatigue factor accounts for 60% of the soldier's fatigue, and defines the soldier's physiological fatigue coefficient as a proportion of 40% of the soldier's fatigue, and then the psychological fatigue coefficient and physical fatigue according to a predefined weighted ratio. The coefficients are weighted to obtain the fatigue of the soldiers.
  • the alarm module 104 is configured to generate an alarm message including the fatigue of the soldier when the fatigue of the soldier exceeds a preset value of the soldier under normal conditions, and send the alarm information to the monitoring center through the wireless communication network 3.
  • Platform 2 provides early warning of the fatigue of the soldiers, so that the combat readiness command can instantly grasp the fatigue level of the soldiers, thus providing a basis for the combat read command to make battlefield decisions.
  • the alarm module 104 is also used to control the alarm 13 integrated on the digitized helmet 1 to generate an alarm sound to seek help from surrounding soldiers. For soldiers with severe mental fatigue, report the commander, perform job deployment, and avoid mental fatigue. Soldiers perform important battle operations, thereby enhancing their morale and cohesion.
  • the present invention also provides a fatigue monitoring and early warning method based on a digital helmet, which can accurately and accurately monitor the fatigue condition of soldiers during military readiness or when performing tasks, for soldiers with physical fatigue and mildness.
  • a fatigue monitoring and early warning method based on a digital helmet, which can accurately and accurately monitor the fatigue condition of soldiers during military readiness or when performing tasks, for soldiers with physical fatigue and mildness.
  • Psychologically fatigued soldiers are warning.
  • FIG. 4 it is a flow chart of a first preferred embodiment of the digital helmet-based fatigue monitoring and early warning method of the present invention. 1 , 2 and 3, in the first preferred embodiment, the fatigue monitoring and early warning method is applied to a digital helmet 1 worn by a soldier, and the method includes, but is not limited to, steps S11 to S15. :
  • Step S11 collecting the brain wave signal of the soldier through an EEG collector integrated on the digitized helmet, and analyzing the psychological fatigue coefficient of the soldier according to the rhythmic change of the brain wave signal;
  • the mental fatigue monitoring module 101 uses an electroencephalogram (EEG) to reflect the brain wave signal of the soldier, and analyzes the rhythmic changes of the brain wave, such as the rhythmic changes of the alpha wave, the delta wave, the theta wave, and the beta wave.
  • EEG electroencephalogram
  • a mental fatigue factor indicating the degree of tension and psychological fatigue of the soldier.
  • the mental fatigue monitoring module 101 performs pre-processing of the brain wave signal to extract the interference signal, and extracts the characteristic band of the brain wave by using the wavelet packet decomposition method, delta wave, theta wave, Alpha wave, beta wave.
  • the present embodiment can use the band energy proportional value method (FBER) to analyze the soldier's degree of stress and the degree of psychological fatigue as the soldier's psychological fatigue coefficient.
  • FBER band energy proportional value method
  • Step S12 ingesting an image of the soldier's eye through an imaging device integrated on the digitized helmet, and analyzing the physiological fatigue coefficient of the soldier from the eye image;
  • the physiological fatigue monitoring module 102 takes in the image of the soldier's eye through the camera 12 integrated on the digitized helmet 1, and analyzes the soldier's physiological fatigue coefficient from the eye image.
  • the physiological fatigue monitoring module 102 can analyze the eye movement from the eye image taken by the camera 12, such as blink frequency, eyelid average closing time, eyelid average opening time, left and right pupils.
  • the diameter, the rotation speed of the eyeball, the eye's slight vision, etc. were analyzed by Perclos measurement principle to obtain the soldier's physiological fatigue coefficient.
  • Step S13 calculating the fatigue degree of the soldier according to the psychological fatigue coefficient and the physiological fatigue coefficient of the soldier;
  • the fatigue calculation module 103 calculates the fatigue of the soldier based on the mental fatigue coefficient and the physiological fatigue coefficient of the soldier.
  • the fatigue calculation module 103 can calculate the fatigue of the soldier according to a weighted ratio of the predefined psychological fatigue coefficient and the physiological fatigue coefficient. For example, it can be defined that the soldier's psychological fatigue factor accounts for 60% of the soldier's fatigue, and defines the soldier's physiological fatigue coefficient as a proportion of 40% of the soldier's fatigue, and then the psychological fatigue coefficient and physical fatigue according to a predefined weighted ratio. The coefficient is weighted to obtain the fatigue of the soldier.
  • Step S14 determining whether the fatigue degree exceeds a preset value of the soldier under normal conditions
  • the fatigue calculation module 103 determines whether the fatigue of the soldier exceeds a preset value of the soldier under normal conditions. If the fatigue of the soldier does not exceed the preset value of the soldier under normal conditions, the process proceeds to step S11; if the fatigue of the soldier exceeds the preset value of the soldier under normal conditions, the process proceeds to step S15.
  • step S15 an alarm message containing the fatigue of the soldier is generated, and the alarm information is sent to the monitoring center platform through the wireless communication network to warn the fatigue of the soldier.
  • the alarm module 104 generates an alarm message including the fatigue of the soldier and sends the alarm information to the monitoring center platform 2 through the wireless communication network 3 to alert the soldier's fatigue condition, so that the combat read command can immediately grasp the soldiers.
  • the degree of fatigue provides a basis for the battle preparation headquarters to make battlefield decisions.
  • the method further comprises a step S16 after the step S15, in addition to all the method steps (i.e., steps S11 to S15) of the first preferred embodiment shown in FIG.
  • Step S16 controlling an alarm integrated on the digitized helmet to generate an alarm sound
  • the alarm module 104 controls the alarm 13 integrated on the digitized helmet 1 to generate an alarm sound to seek assistance from surrounding soldiers. For soldiers with severe mental fatigue, report to the commander, perform job deployment, and avoid letting the mentally fatigued soldiers perform important. Battle position.
  • the digital helmet-based fatigue monitoring and early warning system and method provided by the invention can accurately and accurately monitor the fatigue condition of the soldiers during military readiness or when performing tasks, and provide early warning to soldiers with physiological fatigue and soldiers with mild mental fatigue.
  • soldiers with severe psychological fatigue report to the commander, carry out job deployment, avoid performing important battle operations, thus ensuring the smooth completion of combat missions and avoiding various losses caused by excessive fatigue of soldiers.
  • the EEG focuses on monitoring the psychological fatigue of the soldiers, and develops corresponding treatment plans for the moderate and severe mental fatigue soldiers to help the soldiers restore psychological fatigue and physical fatigue, thereby improving the cohesiveness and combat effectiveness of the army.

Abstract

A fatigue monitoring and early-warning system and method based on a digital helmet. The method comprises: collecting a brain-wave signal of a user by using an electroencephalograph collector (11) integrated on a digital helmet (1), and analyzing a mental fatigue coefficient of the user according to the rhythmic change of the brain-wave signal (S11); capturing an ocular image of the user by using a camera (12) integrated on the digital helmet (1), and analyzing a physiological fatigue coefficient of the user according to the ocular image (S12); calculating the fatigue degree of the user according to the mental fatigue coefficient and the physiological fatigue coefficient of the user (S13); generating alarm information comprising the fatigue degree of the user when the fatigue degree of the user exceeds a preset value of the user in the normal case, and sending the alarm information to a monitoring center platform (2) by using a communications network (3), to perform early-warning on the fatigue state of the user (S14, S15). The system and method are used for a digital battlefield, and can monitor the fatigue state of soldiers in real time during combat readiness or task execution of an army, and perform early-warning soldiers in mental fatigue or physiological fatigue.

Description

基于数字化头盔的疲劳监测及预警系统和方法  Digital helmet-based fatigue monitoring and early warning system and method
技术领域Technical field
本发明涉及人体生理心理侦测技术领域,尤其涉及一种基于数字化头盔的疲劳监测及预警系统和方法。The invention relates to the technical field of human physiological psychology detection, in particular to a fatigue monitoring and early warning system and method based on a digital helmet.
背景技术Background technique
人体疲劳是一种生理心理现象,由机体脑力和体力活动过度、精神刺激过多或某种单调活动所致。人体疲劳可以简单分为体力疲劳和脑力疲劳两类。特别是,军事作业疲劳是指部队官兵在平时或战士特殊环境条件下由军事劳动、训练及战斗所引起的疲劳。在军事劳动和训练中,由于劳动强度大、时间长,肌肉持久重复收缩,能量消耗大,从而产生体力疲劳;由于注意力高度集中,精神紧张,易产生脑力疲劳,从而使训练能力减退,训练成绩下降。同时,随着机械化及信息化的飞速发展,军队作战方式也发生了具大变化。在多变的战场或执行任务环境中,关键战位指挥员的疲劳状态的变化会影响一次行动、一个战斗甚至是一场战争。因此,在战争或执行任务过程中对广大官兵进行疲劳监测具有较重要的意义。Human fatigue is a physiological and psychological phenomenon caused by excessive brain and physical activity, excessive mental stimulation or some monotonous activity. Human fatigue can be divided into two types: physical fatigue and mental fatigue. In particular, military work fatigue refers to the fatigue caused by military labor, training and combat under the special environmental conditions of the troops or soldiers. In military labor and training, due to the high labor intensity and long time, the muscles are repeatedly contracted and the energy consumption is large, resulting in physical fatigue. Because of the high concentration of attention, mental stress, and mental fatigue, the training ability is reduced, training The results have dropped. At the same time, with the rapid development of mechanization and informatization, the military operations have also undergone major changes. In a changing battlefield or mission environment, changes in the fatigue status of key position commanders can affect an action, a battle, or even a war. Therefore, it is of great significance to monitor the fatigue of the majority of officers and soldiers during the war or mission.
目前,单兵数字化头盔系统被誉为广大官兵的第二大脑,功能越来越强大,在战争中发挥着越来越重要的作用。单兵数字化头盔系统主要分为头部防护系统(包括冲击防护、核生化防护、激光防护等)、人机交互系统(包括通话模块、视频模块等)、探测传感系统(包括红外热成像、激光探测等)等部分组成。然而,现有的单兵数字化头盔系统不能实时监测战时或执行任务时士兵的疲劳状况,因而战备指挥中心可能无法即时掌握士兵的而导致战场决策失误,从而影响到军队战备时或执行任务时士兵的战斗力。At present, the single-person digital helmet system is known as the second brain of the vast number of officers and men, and its function is getting stronger and stronger, playing an increasingly important role in the war. The individual digital helmet system is mainly divided into head protection system (including impact protection, nuclear biochemical protection, laser protection, etc.), human-computer interaction system (including call module, video module, etc.), detection and sensing system (including infrared thermal imaging, Laser detection, etc.). However, the existing single-person digital helmet system cannot monitor the fatigue situation of the soldiers during wartime or missions in real time. Therefore, the war preparation command center may not be able to grasp the soldiers immediately and cause battlefield decision-making mistakes, thus affecting the army's combat readiness or when performing tasks. The combat effectiveness of the soldiers.
发明内容Summary of the invention
本发明的主要目的在于提供一种基于数字化头盔的疲劳监测及预警系统和方法,旨在解决现有的单兵数字化头盔系统不能实时监测并预警军队战备时或执行任务时士兵疲劳状况的技术问题。The main object of the present invention is to provide a digital helmet-based fatigue monitoring and early warning system and method, aiming at solving the technical problem that the existing single-person digital helmet system cannot monitor and warn the soldiers in the event of military readiness or when performing tasks. .
为实现上述目的,本发明提供了一种基于数字化头盔的疲劳监测及预警系统,该系统包括:心理疲劳监测模块,用于通过集成在数字化头盔上的脑电采集器采集使用者的脑电波信号,并根据所述脑电波信号的节律性变化分析使用者的心理疲劳系数;生理疲劳监测模块,用于通过集成在数字化头盔上的摄像头摄取使用者的眼部图像,并从所述眼部图像中分析使用者的生理疲劳系数;疲劳度计算模块,用于根据使用者的心理疲劳系数和生理疲劳系数计算使用者的疲劳度,并判断所述疲劳度是否超过使用者正常情况下的预设值;报警模块,用于当所述疲劳度超过使用者正常情况下的预设值时,产生一条包含使用者疲劳度的报警信息,并将所述报警信息通过通讯网络发送至监测中心平台对使用者的疲劳情况进行预警。To achieve the above object, the present invention provides a digital helmet-based fatigue monitoring and early warning system, the system comprising: a mental fatigue monitoring module for collecting a user's brain wave signal through an electroencephalogram collector integrated on a digitized helmet And analyzing a user's psychological fatigue coefficient according to the rhythmic change of the brain wave signal; the physiological fatigue monitoring module is configured to take a user's eye image through a camera integrated on the digitized helmet, and from the eye image The physiological fatigue coefficient of the user is analyzed; the fatigue calculation module is configured to calculate the fatigue degree of the user according to the psychological fatigue coefficient and the physiological fatigue coefficient of the user, and determine whether the fatigue degree exceeds a preset of the user under normal conditions. The alarm module is configured to generate an alarm message including user fatigue when the fatigue exceeds a preset value of the user under normal conditions, and send the alarm information to the monitoring center platform through the communication network. Early warning of the user's fatigue.
优先地,当所述疲劳度超过使用者正常情况下的预设值时,所述的报警模块还用于控制集成在数字化头盔上的报警器产生警报声。Preferably, when the fatigue exceeds a preset value of the user under normal conditions, the alarm module is further configured to control an alarm integrated on the digitized helmet to generate an alarm sound.
进一步地,所述的心理疲劳监测模块根据脑电波信号的节律性变化分析使用者的心理疲劳系数包括:将所述脑电采集器采集的脑电波信号进行预处理剔出干扰信号;利用小波包分解法提取脑电波的特征波段alpha波、delta波、theta波、beta波;利用频带能量比例值法分析所述特征波段alpha波、delta波、theta波、beta波的节律性变化得到所述使用者的心理疲劳系数。Further, the psychological fatigue monitoring module analyzes the user's psychological fatigue coefficient according to the rhythmic change of the brain wave signal, including: preprocessing the brain wave signal collected by the brain power collector to extract the interference signal; using the wavelet packet The decomposition method extracts the characteristic band alpha wave, delta wave, theta wave and beta wave of brain wave; the band energy proportional value method is used to analyze the rhythmic changes of the characteristic band alpha wave, delta wave, theta wave and beta wave. The psychological fatigue factor of the person.
进一步地,所述的生理疲劳监测模块从眼部图像中分析使用者的生理疲劳系数包括:从所述摄像头摄取的眼部图像中识别出所述使用者的眼部运动;采用Perclos测量原理分析所述使用者的眼部运动得到使用者的生理疲劳系数。Further, the physiological fatigue monitoring module analyzes the physiological fatigue coefficient of the user from the eye image, including: identifying the eye movement of the user from the eye image taken by the camera; using Perclos measurement principle analysis The eye movement of the user obtains the physiological fatigue coefficient of the user.
进一步地,所述的疲劳度计算模块根据使用者的心理疲劳系数和生理疲劳系数计算使用者的疲劳度包括:预先定义使用者的心理疲劳系数和生理疲劳系数的加权比例;根据预定义的加权比例将使用者的心理疲劳系数和生理疲劳系数进行加权运算得到使用者的疲劳度。Further, the fatigue calculation module calculates the user's fatigue degree according to the user's psychological fatigue coefficient and the physiological fatigue coefficient, including: pre-defining the user's psychological fatigue coefficient and the physiological fatigue coefficient weight ratio; according to the predefined weighting The ratio weights the user's mental fatigue coefficient and physiological fatigue coefficient to obtain the user's fatigue.
为实现本发明上述目的,本发明还提供了一种基于数字化头盔的疲劳监测及预警方法,该方法包括步骤: 通过集成在数字化头盔上的脑电采集器采集使用者的脑电波信号,并根据所述脑电波信号的节律性变化分析使用者的心理疲劳系数;通过集成在数字化头盔上的摄像头摄取使用者的眼部图像,并从眼部图像中分析使用者的生理疲劳系数;根据使用者的心理疲劳系数和生理疲劳系数计算使用者的疲劳度;判断所述疲劳度是否超过使用者正常情况下的预设值;当所述疲劳度超过使用者正常情况下的预设值时,产生一条包含使用者疲劳度的报警信息,并将所述报警信息通过通讯网络发送至监测中心平台对使用者的疲劳情况进行预警。In order to achieve the above object of the present invention, the present invention also provides a fatigue monitoring and early warning method based on a digital helmet, the method comprising the steps of: The brain wave signal of the user is collected by an EEG collector integrated on the digitized helmet, and the user's psychological fatigue coefficient is analyzed according to the rhythmic change of the brain wave signal; the user is taken by the camera integrated in the digital helmet The eye image, and analyzing the physiological fatigue coefficient of the user from the eye image; calculating the user's fatigue degree according to the user's psychological fatigue coefficient and the physiological fatigue coefficient; determining whether the fatigue degree exceeds the user's normal situation Setting a value; when the fatigue degree exceeds a preset value of the user under normal conditions, generating an alarm message including user fatigue degree, and transmitting the alarm information to the monitoring center platform to the user through the communication network The situation is early warning.
优先地,所述的基于数字化头盔的疲劳监测及预警方法还包括步骤:当所述疲劳度超过使用者正常情况下的预设值时,控制集成在数字化头盔上的报警器产生警报声。Preferably, the digital helmet-based fatigue monitoring and early warning method further comprises the step of: controlling an alarm integrated on the digitized helmet to generate an alarm sound when the fatigue level exceeds a preset value of the user under normal conditions.
进一步地,所述的根据脑电波信号的节律性变化分析使用者的心理疲劳系数的步骤包括:将所述脑电采集器采集的脑电波信号进行预处理剔出干扰信号;利用小波包分解法提取脑电波的特征波段alpha波、delta波、theta波、beta波;利用频带能量比例值法分析所述特征波段alpha波、delta波、theta波、beta波的节律性变化得到所述使用者的心理疲劳系数。Further, the step of analyzing the user's psychological fatigue coefficient according to the rhythmic change of the brain wave signal comprises: pre-processing the brain wave signal collected by the brain power collector to extract the interference signal; using the wavelet packet decomposition method Extracting the characteristic band alpha wave, delta wave, theta wave, and beta wave of the brain wave; analyzing the rhythmic changes of the characteristic band alpha wave, delta wave, theta wave, and beta wave by using the band energy proportional value method to obtain the user's Psychological fatigue coefficient.
进一步地,所述的从眼部图像中分析使用者的生理疲劳系数的步骤包括:从所述摄像头摄取的眼部图像中识别出所述使用者的眼部运动;采用Perclos测量原理分析所述使用者的眼部运动得到使用者的生理疲劳系数。Further, the step of analyzing a physiological fatigue coefficient of the user from the eye image includes: identifying an eye movement of the user from an eye image taken by the camera; analyzing the method by using a Perclos measurement principle The user's eye movements get the user's physiological fatigue coefficient.
进一步地,所述的根据使用者的心理疲劳系数和生理疲劳系数计算使用者的疲劳度的步骤包括:预先定义使用者的心理疲劳系数和生理疲劳系数的加权比例;根据预定义的加权比例将使用者的心理疲劳系数和生理疲劳系数进行加权运算得到使用者的疲劳度。Further, the step of calculating the user's fatigue degree according to the user's psychological fatigue coefficient and the physiological fatigue coefficient includes: predefining a weighted ratio of the user's psychological fatigue coefficient and the physiological fatigue coefficient; according to a predefined weighting ratio The user's mental fatigue coefficient and physiological fatigue coefficient are weighted to obtain the user's fatigue.
相较于现有技术,本发明所述基于数字化头盔的疲劳监测及预警及方法,通过同时监测使用者的心理疲劳程度和生理疲劳程度,能够实时准确地监测使用者的疲劳状况并对于出现生理疲劳的使用者进行预警。特别是,本发明应用于数字化战场中,能够实时准确地监测军队战备时或执行任务时士兵的疲劳状况。对于出现生理疲劳的士兵和轻度心理疲劳的士兵进行预警,同时,对于严重心理疲劳的士兵,上报指挥员,进行岗位调配,避免执行重要战位作业,从而保障作战任务的顺利完成,避免因士兵过度疲劳而导致的各种损失。在执行任务结束时,通过重点监测士兵的心理疲劳,并对中度、重度心理疲劳士兵制定相应的治疗方案,帮助士兵恢复心理疲劳和生理疲劳,从而提高军队的凝聚力及战斗力。Compared with the prior art, the digital helmet-based fatigue monitoring and early warning method and the method can simultaneously monitor the user's fatigue condition and the physiological appearance by monitoring the user's psychological fatigue degree and physiological fatigue degree simultaneously. Fatigue users are alerted. In particular, the present invention is applied to a digital battlefield, and is capable of accurately and accurately monitoring the fatigue condition of soldiers during military readiness or when performing tasks in real time. Warnings are given to soldiers with physical fatigue and soldiers with mild mental fatigue. At the same time, for soldiers with severe mental fatigue, report to the commander, perform job deployment, and avoid performing important battle operations, thus ensuring the smooth completion of combat missions and avoiding The various losses caused by the excessive fatigue of the soldiers. At the end of the task, the soldiers were mentally fatigued and the corresponding treatment plans were formulated for the moderate and severe mental fatigue soldiers to help the soldiers recover their mental fatigue and physical fatigue, thus improving the cohesiveness and combat effectiveness of the army.
附图说明DRAWINGS
图1是本发明基于数字化头盔的疲劳监测及预警系统优选实施例的应用环境示意图。1 is a schematic diagram of an application environment of a preferred embodiment of a digital helmet-based fatigue monitoring and early warning system according to the present invention.
图2是图1中的数字化头盔优选实施例的结构示意图。2 is a schematic structural view of a preferred embodiment of the digitized helmet of FIG. 1.
图3是图1中的疲劳监测及预警系统优选实施例的功能模块图。3 is a functional block diagram of a preferred embodiment of the fatigue monitoring and early warning system of FIG. 1.
图4是本发明基于数字化头盔的疲劳监测及预警方法第一优选实施例的流程图。4 is a flow chart of a first preferred embodiment of the digital helmet-based fatigue monitoring and early warning method of the present invention.
图5是本发明基于数字化头盔的疲劳监测及预警方法第二优选实施例的流程图。Figure 5 is a flow chart of a second preferred embodiment of the digital helmet based fatigue monitoring and early warning method of the present invention.
本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.
具体实施方式detailed description
应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
本发明所述的数字化头盔可以佩戴在需要使用该数字化头盔的任意使用者。本发明所称的使用者包括,但不仅限于,在作战或执行战备任务中使用数字化头盔的作战指挥员和士兵等军人、高强度高危险作业(例如高空作业)时使用数字化头盔的建筑人员、参加高强度激烈运动时使用数字化头盔的竞技运动员以及需要使用本发明数字化头盔的工作人员等。本发明实施例仅以军队战备时或执行任务时的士兵为例进行详细阐述。The digitized helmet of the present invention can be worn by any user who needs to use the digitized helmet. The term "users" as used in the present invention include, but are not limited to, those who use digital helmets for combat commanders and soldiers, and those who use digital helmets in high-intensity and high-risk operations (such as aerial work) in combat or performing combat readiness tasks, Competitive athletes who use digital helmets for high-intensity intense sports and staff who need to use the digital helmet of the present invention. The embodiments of the present invention are only described in detail by taking the soldiers in the army preparation or when performing the tasks as an example.
如图1所示,是本发明基于数字化头盔的疲劳监测及预警系统优选实施例的应用环境示意图。在本实施例中,所述的疲劳监测及预警系统10安装并运行于佩戴在士兵头上的数字化头盔1上。当所述数字化头盔1未被士兵开启时,该数字化头盔1处于一种休眠状态,其为一种低辐射、低功耗的非工作模式,因此不会对士兵的身体健康带来影响。FIG. 1 is a schematic diagram of an application environment of a preferred embodiment of the digital helmet-based fatigue monitoring and early warning system of the present invention. In the present embodiment, the fatigue monitoring and early warning system 10 is installed and operated on a digitized helmet 1 worn on a soldier's head. When the digitized helmet 1 is not opened by a soldier, the digitized helmet 1 is in a dormant state, which is a low-radiation, low-power, non-working mode, and thus does not affect the health of the soldier.
所述的数字化头盔1通过通讯网络3与设置在战备指挥部的监控中心平台2进行无线通讯。所述通讯网络3为一种远程无线通讯网络,包括但不仅限于,GSM网络、GPRS网络、CDMA等无线传输网络。所述的监控中心平台2是可以为一种监控器、计算机装置、或者服务器等。The digital helmet 1 is wirelessly communicated with the monitoring center platform 2 installed in the combat read command through the communication network 3. The communication network 3 is a remote wireless communication network, including but not limited to a wireless transmission network such as a GSM network, a GPRS network, or a CDMA. The monitoring center platform 2 can be a monitor, a computer device, a server, or the like.
所述的疲劳监测及预警系统10能够实时准确地监测军队战备时或执行任务时士兵的疲劳状况,并根据士兵的疲劳状况通过通讯网络3向监控中心平台2发出预警,以便战备指挥部能够即时掌握士兵的疲劳程度,从而为战备指挥部进行战场决策提供依据,并能够在军队战备时或执行任务时提高军人的战斗力。The fatigue monitoring and early warning system 10 can accurately monitor the fatigue condition of the soldier during the military readiness or the execution of the task in real time, and issue an early warning to the monitoring center platform 2 through the communication network 3 according to the fatigue condition of the soldier, so that the combat read command can be immediately Master the degree of fatigue of the soldiers, thus providing a basis for the combat read command to make battlefield decisions, and can improve the combat effectiveness of the military during the military readiness or when performing tasks.
如图2所示,是图1中的数字化头盔1优选实施例的结构示意图。在本优选实施例中,所述的数字化头盔1包括,但不仅限于,疲劳监测及预警系统10、脑电波采集器11、摄像头12、报警器13、存储器14以及微处理器15。所述的脑电波采集器11、摄像头12、报警器13、存储器14电气连接至微处理器15上,并能通过微处理器15与疲劳监测及预警系统10进行信息交互。2 is a schematic structural view of a preferred embodiment of the digitized helmet 1 of FIG. 1. In the preferred embodiment, the digitized helmet 1 includes, but is not limited to, a fatigue monitoring and early warning system 10, a brain wave collector 11, a camera 12, an alarm 13, a memory 14, and a microprocessor 15. The brain wave collector 11, the camera 12, the alarm 13, and the memory 14 are electrically connected to the microprocessor 15, and can exchange information with the fatigue monitoring and early warning system 10 through the microprocessor 15.
所述的脑电波采集器11是一种侦测使用者脑电波的感测器,用于从佩戴有数字化头盔1的士兵脑部侦测出士兵的脑电波信号,该脑电采集器11从士兵头部额头上方区域采集士兵的脑电波信号。The brain wave collector 11 is a sensor for detecting a user's brain wave, and is used for detecting a soldier's brain wave signal from a soldier's brain wearing the digitized helmet 1, the brain power collector 11 The soldier's brain wave signal was collected from the area above the forehead of the soldier's head.
所述的摄像头12可以是一种摄像仪器或者小型影像摄取装置,用于监控并获取士兵的眼部图像。在本实施例中,可以在数字化头盔1的左右护目镜片上安装两个摄像头12,也可以在数字化头盔1的护目镜架中间区域安装一个摄像头12。The camera 12 can be an imaging instrument or a small image capturing device for monitoring and acquiring an eye image of a soldier. In the present embodiment, two cameras 12 may be mounted on the left and right goggles of the digitized helmet 1, or a camera 12 may be mounted in the middle of the goggles of the digitized helmet 1.
所述的报警器13可以为一种低音喇叭或者扬声器,其用于士兵在高度疲劳发出警报声来寻求周边战士帮助。所述存储器14可以为一种只读存储器ROM,电可擦写存储器EEPROM、或者快闪存储器FLASH等。所述微处理器15可以为一种微控制器(MCU)、数据处理芯片、或者具有数据处理功能的信息处理单元。The alarm device 13 can be a woofer or a speaker, which is used for soldiers to sound an alarm in high fatigue to seek help from surrounding soldiers. The memory 14 can be a read only memory ROM, an electrically erasable memory EEPROM, or a flash memory FLASH or the like. The microprocessor 15 can be a microcontroller (MCU), a data processing chip, or an information processing unit having data processing functions.
如图3所示,是图1中的疲劳监测及预警系统10优选实施例的功能模块图。在本优选实施例中,所述的疲劳监测及预警系统10包括,但不仅限于,心理疲劳监测模块101、生理疲劳监测模块102、疲劳度计算模块103以及报警模块104。本发明实施例所称的模块是指一种能够被所述数字化头盔1的微处理器15所执行并且能够完成固定功能的一系列计算机程序指令段,其存储在所述数字化头盔1的存储器14中。3 is a functional block diagram of a preferred embodiment of the fatigue monitoring and early warning system 10 of FIG. In the preferred embodiment, the fatigue monitoring and early warning system 10 includes, but is not limited to, a mental fatigue monitoring module 101, a physiological fatigue monitoring module 102, a fatigue calculation module 103, and an alarm module 104. The module referred to in the embodiment of the present invention refers to a series of computer program instruction segments that can be executed by the microprocessor 15 of the digitized helmet 1 and that can perform a fixed function, which is stored in the memory 14 of the digitized helmet 1 . in.
所述的心理疲劳监测模块101用于通过集成在数字化头盔1上的脑电采集器11采集士兵的脑电波信号,并根据士兵的脑电波信号的节律性变化分析出士兵的心理疲劳系数。The mental fatigue monitoring module 101 is configured to collect the brain wave signal of the soldier through the brain electrical collector 11 integrated on the digitized helmet 1, and analyze the mental fatigue coefficient of the soldier according to the rhythmic change of the soldier's brain wave signal.
在本实施例中,心理疲劳监测模块101采用脑电图(EEG)来反映士兵的脑电波信号,并通过脑电波节律性变化,例如alpha波、delta波、theta波、beta波的节律性变化,来分析出士兵的紧张程度及心理疲劳程度作为士兵的心理疲劳系数。所述delta波频率范围为1-4Hz,健康人在睡眠时能观察到此波;所述theta波频率范围4-8Hz,士兵处于困倦状态时会出现此波;所述alpha波,频率范围8-13Hz,该波段与人的心情是否平静随和、感觉是否轻松愉快有关,忧虑和紧张会抑制alpha波,当人体思考问题或受刺激时则消失;所述beta波,频率范围14-30Hz,大脑皮层兴奋时出现,一般由忧郁和紧张引起。当开始对人体作施力活动时,alpha节律减少或消失,beta节律加强;随着时间的延长,负荷增加,出现theta波,theta波表明大脑皮层受到抑制;当施力活动结束后,随着负荷的消除,慢波渐渐消失,beta节律也逐渐减少,alpha节律恢复。如果EEG信号中theta节律和delta节律增加,beta节律减少,则表示处于疲劳思睡状态。In the present embodiment, the mental fatigue monitoring module 101 uses an electroencephalogram (EEG) to reflect the brainwave signal of the soldier, and changes the rhythm of the brain wave, such as the rhythmic changes of the alpha wave, the delta wave, the theta wave, and the beta wave. To analyze the nervousness and psychological fatigue of the soldiers as the psychological fatigue coefficient of the soldiers. The delta wave frequency ranges from 1 to 4 Hz, and the healthy person can observe the wave while sleeping; the wave of the theta frequency ranges from 4 to 8 Hz, and the wave occurs when the soldier is in a sleepy state; the alpha wave, the frequency range is 8 -13 Hz, the band is related to whether the mood of the person is calm and easy, and whether the feeling is relaxed or not. The anxiety and tension will inhibit the alpha wave, and disappear when the human body thinks about the problem or is stimulated; the beta wave, the frequency range is 14-30Hz, the brain The cortex appears when excited, usually caused by depression and tension. When the force is applied to the human body, the alpha rhythm decreases or disappears, and the beta rhythm strengthens; as time increases, the load increases, theta wave appears, theta wave indicates inhibition of the cerebral cortex; when the force activity ends, The elimination of the load, the slow wave gradually disappears, the beta rhythm is gradually reduced, and the alpha rhythm is restored. If theta rhythm and delta rhythm increase in the EEG signal, and the beta rhythm decreases, it means that it is in a state of fatigue sleepiness.
在本实施例中,当脑电采集器11采集士兵的脑电波信号后,心理疲劳监测模块101进行脑电波信号预处理来剔出干扰信号,并利用小波包分解法提取脑电波的特征波段,例如delta波、theta波、alpha波、beta波。本实施例可采取归一化能量相对监测法,即采用频带能量比例值法(Frequency Band Energy Ratio, FBER),分析特征波段delta波、theta波、alpha波、beta波来得到士兵的紧张程度及心理疲劳程度,该频带能量比例值法包括:1)当alpha波为主,FBERa等于0.8至1单位之间,处于清醒状态;2)当FBER(beta)>FBER(alpha)且 FBER(alpha+beta)>FBER(theta+delta)时,处于紧张状态;3)当FBER(alpha+beta)<FBER(theta+delta)处于疲劳状态。其中,theta波和belta波对评估正常人清醒和脑力疲劳的特征结构影响最大,随着脑力疲劳的加深,EEG信号中的theta波能量增多,belta波能量减少;alpha波为人体在舒适状况下的波;beta波表示紧张压力; theta波表示疲倦;delta波为睡眠中的正常波段;在脑力疲劳状态下,theta波能量增多;beta波能量减少。In this embodiment, after the EEG collector 11 collects the brain wave signal of the soldier, the mental fatigue monitoring module 101 performs pre-processing of the brain wave signal to extract the interference signal, and extracts the characteristic band of the brain wave by using the wavelet packet decomposition method. For example, delta wave, theta wave, alpha wave, beta wave. In this embodiment, a normalized energy relative monitoring method can be adopted, that is, a frequency band energy ratio method (Frequency) is adopted. Band Energy Ratio, FBER), analyze the characteristic band delta wave, theta wave, alpha wave, beta wave to get the degree of tension and psychological fatigue of the soldier. The energy ratio method of the band includes: 1) When the alpha wave is dominant, FBERa is equal to 0.8 to 1 unit. Between, awake; 2) when FBER(beta)>FBER(alpha) and FBER (alpha+beta)>FBER(theta+delta) is in a state of tension; 3) when FBER(alpha+beta)<FBER(theta+delta) is in a state of fatigue. Among them, theta wave and belt wave have the greatest influence on the evaluation of the characteristic structure of normal human wakefulness and mental fatigue. With the deepening of mental fatigue, the energy of theta wave in EEG signal increases, the energy of belta wave decreases; the alpha wave is the comfortable state of the human body. Wave; beta wave indicates stress; Theta wave indicates fatigue; delta wave is the normal band in sleep; in the state of mental fatigue, theta wave energy increases; beta wave energy decreases.
所述的生理疲劳监测模块102用于通过集成在数字化头盔1上的摄像头12摄取士兵的眼部图像,并从眼部图像中分析出士兵的生理疲劳系数。在本实施例中,生理疲劳监测模块102可以从摄像头12所摄取的眼部图像中通过分析眼部运动,例如眼眨眼频率、眼睑平均闭合时间、眼睑平均张开时间、左右瞳孔直径、眼球转动速度、眼睛稍视等,并采用Perclos测量原理分析所述士兵的眼部运动来得到士兵的生理疲劳系数。在复杂多变的外界环境和数字化单兵系统的信息干扰情况下,会对EEG监测士兵的生理疲劳和心理疲劳结果准确性产生影响;利用眼部监测可以辅助EEG对生理疲劳监测,同时有助于确认士兵在清醒状态下的心理疲劳程度。在士兵清醒状态下,眼部疲劳监测可以作为生理疲劳监测的标准,并与EEG监测心理来共同判别士兵的生理疲劳程度。The physiological fatigue monitoring module 102 is configured to take an image of a soldier's eye through a camera 12 integrated on the digitized helmet 1 and analyze the physiological fatigue coefficient of the soldier from the eye image. In the present embodiment, the physiological fatigue monitoring module 102 can analyze the eye movement from the eye image taken by the camera 12, such as the eye blink frequency, the eyelid average closing time, the eyelid average opening time, the left and right pupil diameters, and the eyeball rotation. Speed, eyes, etc., and the soldier's eye movements were analyzed using the Perclos measurement principle to obtain the soldier's physiological fatigue coefficient. In the case of complex and variable external environment and information interference of digital individual soldier system, it will affect the accuracy of EEK monitoring soldiers' physiological fatigue and mental fatigue results; using eye monitoring can assist EEG to monitor physiological fatigue, and at the same time help To confirm the degree of psychological fatigue of the soldiers in the awake state. Under the awake state of the soldiers, eye fatigue monitoring can be used as a standard for physiological fatigue monitoring, and together with EEG monitoring psychology to determine the degree of physical fatigue of soldiers.
本发明实施例根据Perclos测量原理,结合摄像头12摄取的眼部图像中的瞳孔面积,利用疲劳检测公式:f=∑[open(t)]/N,其中f为单位时间眼睛的总帧数睁闭比例,即用帧数比例代替具体的时间比例,比如将取30秒为一个单位。N为单位时间内的总帧数。open(t)为当前帧图像中的人眼是否睁闭,如果open(t)=0,则为睁眼;如果open(t)=1,则为闭眼。如果单位时间内,f大于0.4则认为士兵疲劳状态。如果闭眼的持续闭眼时间超过3秒,则认为士兵处于瞌睡状态,若持续闭眼总帧数超过37帧,则认为士兵出于疲劳状态。如果平均眨眼次数为大于10-15次/分钟这个标准士兵可能处于疲劳思睡状态。According to the Perclos measurement principle, in accordance with the Perclos measurement principle, the fatigue detection formula is used in combination with the pupil area in the eye image taken by the camera 12: f=∑[open(t)]/N, where f is the total number of frames per eye. Closed ratio, that is, the proportion of frames is used instead of the specific time ratio, for example, 30 seconds is taken as one unit. N is the total number of frames per unit time. Open(t) is whether the human eye in the current frame image is closed. If open(t)=0, it is blinking; if open(t)=1, it is closed. If the unit time, f is greater than 0.4, the soldier is considered to be in a state of fatigue. If the closed eye continues to close the eye for more than 3 seconds, the soldier is considered to be dozing. If the total number of closed eyes is more than 37 frames, the soldier is considered to be in a state of fatigue. If the average number of blinks is greater than 10-15 times per minute, the standard soldier may be in a state of fatigue sleepiness.
所述的疲劳度计算模块103用于根据士兵的心理疲劳系数和生理疲劳系数计算出士兵的疲劳度,以及判断所述士兵的疲劳度是否超过士兵正常情况下的预设值。在本实施例中,疲劳度计算模块103可以按照预先定义的心理疲劳系数和生理疲劳系数的加权比例来计算士兵的疲劳度。例如,可以定义士兵的心理疲劳系数占士兵的疲劳度的60%比例,而定义士兵的生理疲劳系数占士兵的疲劳度的40%比例,再根据预定义的加权比例将心理疲劳系数和生理疲劳系数进行加权运算得到士兵的疲劳度。The fatigue calculation module 103 is configured to calculate the fatigue of the soldier according to the psychological fatigue coefficient and the physiological fatigue coefficient of the soldier, and determine whether the fatigue of the soldier exceeds a preset value of the soldier under normal conditions. In the present embodiment, the fatigue calculation module 103 can calculate the fatigue of the soldier according to a weighted ratio of the predefined psychological fatigue coefficient and the physiological fatigue coefficient. For example, it can be defined that the soldier's psychological fatigue factor accounts for 60% of the soldier's fatigue, and defines the soldier's physiological fatigue coefficient as a proportion of 40% of the soldier's fatigue, and then the psychological fatigue coefficient and physical fatigue according to a predefined weighted ratio. The coefficients are weighted to obtain the fatigue of the soldiers.
所述的报警模块104用于当所述士兵的疲劳度超过士兵正常情况下的预设值时,产生一条包含士兵疲劳度的报警信息并将所述报警信息通过无线通讯网络3发送至监测中心平台2对士兵的疲劳情况进行预警,以便战备指挥部能够即时掌握广大士兵的疲劳程度,从而为战备指挥部进行战场决策时提供依据。The alarm module 104 is configured to generate an alarm message including the fatigue of the soldier when the fatigue of the soldier exceeds a preset value of the soldier under normal conditions, and send the alarm information to the monitoring center through the wireless communication network 3. Platform 2 provides early warning of the fatigue of the soldiers, so that the combat readiness command can instantly grasp the fatigue level of the soldiers, thus providing a basis for the combat read command to make battlefield decisions.
所述的报警模块104还用于控制集成在数字化头盔1上的报警器13产生警报声,来寻求周边战士帮助,对于严重心理疲劳的士兵,上报指挥员,进行岗位调配,避免让心理疲劳的士兵执行重要战位作业,从而增强部队的斗志及凝聚力。The alarm module 104 is also used to control the alarm 13 integrated on the digitized helmet 1 to generate an alarm sound to seek help from surrounding soldiers. For soldiers with severe mental fatigue, report the commander, perform job deployment, and avoid mental fatigue. Soldiers perform important battle operations, thereby enhancing their morale and cohesion.
为实现本发明上述目的,本发明还提供了一种基于数字化头盔的疲劳监测及预警方法,能够实时准确地监测军队战备时或执行任务时士兵的疲劳状况,对于出现生理疲劳的士兵和轻度心理疲劳的士兵进行预警。In order to achieve the above object of the present invention, the present invention also provides a fatigue monitoring and early warning method based on a digital helmet, which can accurately and accurately monitor the fatigue condition of soldiers during military readiness or when performing tasks, for soldiers with physical fatigue and mildness. Psychologically fatigued soldiers are warning.
如图4所示,是本发明基于数字化头盔的疲劳监测及预警方法第一优选实施例的流程图。结合图1、图2和图3,在第一优选实施例中,所述的疲劳监测及预警方法应用于军人随身佩戴的数字化头盔1中,该方法包括,但不仅限于,步骤S11至步骤S15:As shown in FIG. 4, it is a flow chart of a first preferred embodiment of the digital helmet-based fatigue monitoring and early warning method of the present invention. 1 , 2 and 3, in the first preferred embodiment, the fatigue monitoring and early warning method is applied to a digital helmet 1 worn by a soldier, and the method includes, but is not limited to, steps S11 to S15. :
步骤S11,通过集成在数字化头盔上的脑电采集器采集士兵的脑电波信号,并根据脑电波信号的节律性变化分析出士兵的心理疲劳系数;Step S11, collecting the brain wave signal of the soldier through an EEG collector integrated on the digitized helmet, and analyzing the psychological fatigue coefficient of the soldier according to the rhythmic change of the brain wave signal;
具体地,心理疲劳监测模块101采用脑电图(EEG)来反映士兵的脑电波信号,并通过脑电波节律性变化,例如alpha波、delta波、theta波、beta波的节律性变化,来分析出表示士兵的紧张程度及心理疲劳程度的心理疲劳系数。当脑电采集器11采集士兵的脑电波信号后,心理疲劳监测模块101进行脑电波信号预处理来剔出干扰信号,并利用小波包分解法提取脑电波的特征波段,delta波、theta波、alpha波、beta波。如前所述,本实施例可采用频带能量比例值法(FBER)分析士兵的紧张程度及心理疲劳程度作为士兵心理疲劳系数。Specifically, the mental fatigue monitoring module 101 uses an electroencephalogram (EEG) to reflect the brain wave signal of the soldier, and analyzes the rhythmic changes of the brain wave, such as the rhythmic changes of the alpha wave, the delta wave, the theta wave, and the beta wave. A mental fatigue factor indicating the degree of tension and psychological fatigue of the soldier. After the brain electricity collector 11 collects the brain wave signal of the soldier, the mental fatigue monitoring module 101 performs pre-processing of the brain wave signal to extract the interference signal, and extracts the characteristic band of the brain wave by using the wavelet packet decomposition method, delta wave, theta wave, Alpha wave, beta wave. As described above, the present embodiment can use the band energy proportional value method (FBER) to analyze the soldier's degree of stress and the degree of psychological fatigue as the soldier's psychological fatigue coefficient.
步骤S12,通过集成在数字化头盔上的摄像装置摄取士兵的眼部图像,并从眼部图像中分析出士兵的生理疲劳系数;Step S12, ingesting an image of the soldier's eye through an imaging device integrated on the digitized helmet, and analyzing the physiological fatigue coefficient of the soldier from the eye image;
具体地,生理疲劳监测模块102通过集成在数字化头盔1上的摄像头12摄取士兵的眼部图像,并从眼部图像中分析出士兵的生理疲劳系数。当摄像头12摄取士兵的眼部图像时,生理疲劳监测模块102可以从摄像头12所摄取的眼部图像中通过分析眼部运动,例如眨眼频率、眼睑平均闭合时间、眼睑平均张开时间、左右瞳孔直径、眼球转动速度、眼睛稍视等,再采用Perclos测量原理分析士兵的眼部运动来得到士兵的生理疲劳系数。Specifically, the physiological fatigue monitoring module 102 takes in the image of the soldier's eye through the camera 12 integrated on the digitized helmet 1, and analyzes the soldier's physiological fatigue coefficient from the eye image. When the camera 12 takes the eye image of the soldier, the physiological fatigue monitoring module 102 can analyze the eye movement from the eye image taken by the camera 12, such as blink frequency, eyelid average closing time, eyelid average opening time, left and right pupils. The diameter, the rotation speed of the eyeball, the eye's slight vision, etc., were analyzed by Perclos measurement principle to obtain the soldier's physiological fatigue coefficient.
步骤S13,根据所述士兵的心理疲劳系数和生理疲劳系数计算出士兵的疲劳度;Step S13, calculating the fatigue degree of the soldier according to the psychological fatigue coefficient and the physiological fatigue coefficient of the soldier;
具体地,疲劳度计算模块103根据士兵的心理疲劳系数和生理疲劳系数计算出士兵的疲劳度。在本实施例中,疲劳度计算模块103可以按照预先定义的心理疲劳系数和生理疲劳系数的加权比例来运算士兵的疲劳度。例如,可以定义士兵的心理疲劳系数占士兵的疲劳度的60%比例,而定义士兵的生理疲劳系数占士兵的疲劳度的40%比例,再根据预定义的加权比例将心理疲劳系数和生理疲劳系数进行加权计算得到士兵的疲劳度。Specifically, the fatigue calculation module 103 calculates the fatigue of the soldier based on the mental fatigue coefficient and the physiological fatigue coefficient of the soldier. In the present embodiment, the fatigue calculation module 103 can calculate the fatigue of the soldier according to a weighted ratio of the predefined psychological fatigue coefficient and the physiological fatigue coefficient. For example, it can be defined that the soldier's psychological fatigue factor accounts for 60% of the soldier's fatigue, and defines the soldier's physiological fatigue coefficient as a proportion of 40% of the soldier's fatigue, and then the psychological fatigue coefficient and physical fatigue according to a predefined weighted ratio. The coefficient is weighted to obtain the fatigue of the soldier.
步骤S14,判断所述疲劳度是否超过士兵正常情况下的预设值;Step S14, determining whether the fatigue degree exceeds a preset value of the soldier under normal conditions;
具体地,疲劳度计算模块103判断所述士兵的疲劳度是否超过士兵正常情况下的预设值。若所述士兵的疲劳度未超过士兵正常情况下的预设值,则流程执行步骤S11;若所述士兵的疲劳度超过士兵正常情况下的预设值,则流程执行步骤S15。Specifically, the fatigue calculation module 103 determines whether the fatigue of the soldier exceeds a preset value of the soldier under normal conditions. If the fatigue of the soldier does not exceed the preset value of the soldier under normal conditions, the process proceeds to step S11; if the fatigue of the soldier exceeds the preset value of the soldier under normal conditions, the process proceeds to step S15.
步骤S15,产生一条包含士兵疲劳度的报警信息,并将所述报警信息通过无线通讯网络发送至监测中心平台对士兵的疲劳情况进行预警。In step S15, an alarm message containing the fatigue of the soldier is generated, and the alarm information is sent to the monitoring center platform through the wireless communication network to warn the fatigue of the soldier.
具体地,报警模块104产生一条包含士兵疲劳度的报警信息并将所述报警信息通过无线通讯网络3发送至监测中心平台2对士兵的疲劳情况进行预警,以便战备指挥部能够即时掌握广大士兵的疲劳程度,从而为战备指挥部进行战场决策提供依据。Specifically, the alarm module 104 generates an alarm message including the fatigue of the soldier and sends the alarm information to the monitoring center platform 2 through the wireless communication network 3 to alert the soldier's fatigue condition, so that the combat read command can immediately grasp the soldiers. The degree of fatigue provides a basis for the battle preparation headquarters to make battlefield decisions.
如图5所示,是本发明基于数字化头盔的疲劳监测及预警方法第二优选实施例的流程图。在第二优选实中,方法除了包括与图4所示的第一优选实施例的全部方法步骤(即步骤S11至步骤S15)之外,在步骤S15之后还包括步骤S16。As shown in FIG. 5, it is a flow chart of a second preferred embodiment of the digital helmet-based fatigue monitoring and early warning method of the present invention. In a second preferred embodiment, the method further comprises a step S16 after the step S15, in addition to all the method steps (i.e., steps S11 to S15) of the first preferred embodiment shown in FIG.
步骤S16,控制集成在数字化头盔上的报警器产生警报声;Step S16, controlling an alarm integrated on the digitized helmet to generate an alarm sound;
具体地,报警模块104控制集成在数字化头盔1上的报警器13产生警报声,来寻求周边战士帮助,对于严重心理疲劳的士兵,上报指挥员,进行岗位调配,避免让心理疲劳的士兵执行重要战位作业。Specifically, the alarm module 104 controls the alarm 13 integrated on the digitized helmet 1 to generate an alarm sound to seek assistance from surrounding soldiers. For soldiers with severe mental fatigue, report to the commander, perform job deployment, and avoid letting the mentally fatigued soldiers perform important. Battle position.
本发明提供的基于数字化头盔的疲劳监测及预警系统及方法,能够实时准确地监测军队战备时或执行任务时士兵的疲劳状况,对于出现生理疲劳的士兵和轻度心理疲劳的士兵进行预警。对于严重心理疲劳的士兵,上报指挥员,进行岗位调配,避免执行重要战位作业,从而保障作战任务的顺利完成,避免因士兵过度疲劳而导致的各种损失。在执行任务结束时,通过EEG重点监测士兵的心理疲劳,并对中度、重度心理疲劳士兵制定相应的治疗方案,帮助士兵恢复心理疲劳和生理疲劳,从而提高军队的凝聚力及战斗力。The digital helmet-based fatigue monitoring and early warning system and method provided by the invention can accurately and accurately monitor the fatigue condition of the soldiers during military readiness or when performing tasks, and provide early warning to soldiers with physiological fatigue and soldiers with mild mental fatigue. For soldiers with severe psychological fatigue, report to the commander, carry out job deployment, avoid performing important battle operations, thus ensuring the smooth completion of combat missions and avoiding various losses caused by excessive fatigue of soldiers. At the end of the task, the EEG focuses on monitoring the psychological fatigue of the soldiers, and develops corresponding treatment plans for the moderate and severe mental fatigue soldiers to help the soldiers restore psychological fatigue and physical fatigue, thereby improving the cohesiveness and combat effectiveness of the army.
以上仅为本发明的优选实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效功能变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。The above is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and equivalent structural or equivalent functional changes made by the description of the present invention and the accompanying drawings may be directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

Claims (13)

  1. 一种基于数字化头盔的疲劳监测及预警方法,其特征在于,该方法包括步骤: A digital helmet-based fatigue monitoring and early warning method, characterized in that the method comprises the steps of:
    通过集成在数字化头盔上的脑电采集器采集使用者的脑电波信号,并根据所述脑电波信号的节律性变化分析使用者的心理疲劳系数;The brain wave signal of the user is collected by an EEG collector integrated on the digitized helmet, and the user's psychological fatigue coefficient is analyzed according to the rhythmic change of the brain wave signal;
    通过集成在数字化头盔上的摄像头摄取使用者的眼部图像,并从眼部图像中分析使用者的生理疲劳系数;The user's eye image is taken by a camera integrated on the digitized helmet, and the user's physiological fatigue coefficient is analyzed from the eye image;
    根据使用者的心理疲劳系数和生理疲劳系数计算使用者的疲劳度;Calculating the user's fatigue degree according to the user's psychological fatigue coefficient and physiological fatigue coefficient;
    判断所述疲劳度是否超过使用者正常情况下的预设值;Determining whether the fatigue degree exceeds a preset value of a normal condition of the user;
    当所述疲劳度超过使用者正常情况下的预设值时,产生一条包含使用者疲劳度的报警信息,并将所述报警信息通过通讯网络发送至监测中心平台对使用者的疲劳情况进行预警。 When the fatigue degree exceeds a preset value of the user under normal conditions, an alarm information including user fatigue is generated, and the alarm information is sent to the monitoring center platform through the communication network to alert the user of the fatigue condition. .
  2. 如权利要求1所述的基于数字化头盔的疲劳监测及预警方法,其特征在于,所述的根据脑电波信号的节律性变化分析使用者的心理疲劳系数的步骤包括:The digital helmet-based fatigue monitoring and early warning method according to claim 1, wherein the step of analyzing the user's psychological fatigue coefficient according to the rhythmic change of the brain wave signal comprises:
    将所述脑电采集器采集的脑电波信号进行预处理剔出干扰信号;Performing pre-processing of the brain wave signal collected by the EEG collector to remove the interference signal;
    利用小波包分解法提取脑电波的特征波段alpha波、delta波、theta波、beta波;The wavelet wave packet decomposition method is used to extract the characteristic band alpha wave, delta wave, theta wave and beta wave of brain wave;
    利用频带能量比例值法分析所述特征波段alpha波、delta波、theta波、beta波的节律性变化得到所述使用者的心理疲劳系数。Using the band energy ratio method to analyze the rhythmic changes of the characteristic band alpha wave, delta wave, theta wave, and beta wave, the psychological fatigue coefficient of the user is obtained.
  3. 如权利要求1所述的基于数字化头盔的疲劳监测及预警方法,其特征在于,所述的从眼部图像中分析使用者的生理疲劳系数的步骤包括:The digital helmet-based fatigue monitoring and early warning method according to claim 1, wherein the step of analyzing a physiological fatigue coefficient of the user from the image of the eye comprises:
    从所述摄像头摄取的眼部图像中识别出所述使用者的眼部运动;Identifying an eye movement of the user from an eye image taken by the camera;
    采用Perclos测量原理分析所述使用者的眼部运动得到使用者的生理疲劳系数。The user's eye movement is analyzed using the Perclos measurement principle to obtain the user's physiological fatigue coefficient.
  4. 如权利要求1所述的基于数字化头盔的疲劳监测及预警方法,其特征在于,所述的根据使用者的心理疲劳系数和生理疲劳系数计算使用者的疲劳度的步骤包括:The digital helmet-based fatigue monitoring and early warning method according to claim 1, wherein the step of calculating the user's fatigue according to the user's psychological fatigue coefficient and the physiological fatigue coefficient comprises:
    预先定义使用者的心理疲劳系数和生理疲劳系数的加权比例;Pre-defining the weighted ratio of the user's psychological fatigue coefficient and physiological fatigue coefficient;
    根据预定义的加权比例将使用者的心理疲劳系数和生理疲劳系数进行加权运算得到使用者的疲劳度。The user's fatigue factor is obtained by weighting the user's mental fatigue coefficient and physiological fatigue coefficient according to a predefined weighting ratio.
  5. 如权利要求1所述的基于数字化头盔的疲劳监测及预警方法,其特征在于,该方法还包括步骤:The digital helmet-based fatigue monitoring and early warning method according to claim 1, wherein the method further comprises the steps of:
    当所述疲劳度超过使用者正常情况下的预设值时,控制集成在数字化头盔上的报警器产生警报声。The alarm integrated on the digitized helmet generates an alarm when the fatigue exceeds a preset value under normal conditions of the user.
  6. 如权利要求5所述的基于数字化头盔的疲劳监测及预警方法,其特征在于,所述的根据脑电波信号的节律性变化分析使用者的心理疲劳系数的步骤包括:The digital helmet-based fatigue monitoring and early warning method according to claim 5, wherein the step of analyzing the user's psychological fatigue coefficient according to the rhythmic change of the brain wave signal comprises:
    将所述脑电采集器采集的脑电波信号进行预处理剔出干扰信号;Performing pre-processing of the brain wave signal collected by the EEG collector to remove the interference signal;
    利用小波包分解法提取脑电波的特征波段alpha波、delta波、theta波、beta波;The wavelet wave packet decomposition method is used to extract the characteristic band alpha wave, delta wave, theta wave and beta wave of brain wave;
    利用频带能量比例值法分析所述特征波段alpha波、delta波、theta波、beta波的节律性变化得到所述使用者的心理疲劳系数。Using the band energy ratio method to analyze the rhythmic changes of the characteristic band alpha wave, delta wave, theta wave, and beta wave, the psychological fatigue coefficient of the user is obtained.
  7. 如权利要求5所述的基于数字化头盔的疲劳监测及预警方法,其特征在于,所述的从眼部图像中分析使用者的生理疲劳系数的步骤包括:The digitized helmet-based fatigue monitoring and early warning method according to claim 5, wherein the step of analyzing a physiological fatigue coefficient of the user from the image of the eye comprises:
    从所述摄像头摄取的眼部图像中识别出所述使用者的眼部运动;Identifying an eye movement of the user from an eye image taken by the camera;
    采用Perclos测量原理分析所述使用者的眼部运动得到使用者的生理疲劳系数。The user's eye movement is analyzed using the Perclos measurement principle to obtain the user's physiological fatigue coefficient.
  8. 如权利要求5所述的基于数字化头盔的疲劳监测及预警方法,其特征在于,所述的根据使用者的心理疲劳系数和生理疲劳系数计算使用者的疲劳度的步骤包括:The digital helmet-based fatigue monitoring and early warning method according to claim 5, wherein the step of calculating the user's fatigue according to the user's psychological fatigue coefficient and the physiological fatigue coefficient comprises:
    预先定义使用者的心理疲劳系数和生理疲劳系数的加权比例;Pre-defining the weighted ratio of the user's psychological fatigue coefficient and physiological fatigue coefficient;
    根据预定义的加权比例将使用者的心理疲劳系数和生理疲劳系数进行加权运算得到使用者的疲劳度。The user's fatigue factor is obtained by weighting the user's mental fatigue coefficient and physiological fatigue coefficient according to a predefined weighting ratio.
  9. 一种基于数字化头盔的疲劳监测及预警系统,其特征在于,该系统包括: A digital helmet-based fatigue monitoring and early warning system, characterized in that the system comprises:
    心理疲劳监测模块,用于通过集成在数字化头盔上的脑电采集器采集使用者的脑电波信号,并根据所述脑电波信号的节律性变化分析使用者的心理疲劳系数;a psychological fatigue monitoring module, configured to collect a brain wave signal of a user through an EEG collector integrated on the digitized helmet, and analyze a user's psychological fatigue coefficient according to a rhythmic change of the brain wave signal;
    生理疲劳监测模块,用于通过集成在数字化头盔上的摄像头摄取使用者的眼部图像,并从所述眼部图像中分析使用者的生理疲劳系数;a physiological fatigue monitoring module, configured to ingest a user's eye image through a camera integrated on the digitized helmet, and analyze a physiological fatigue coefficient of the user from the eye image;
    疲劳度计算模块,用于根据使用者的心理疲劳系数和生理疲劳系数计算使用者的疲劳度,并判断所述疲劳度是否超过使用者正常情况下的预设值;a fatigue calculation module, configured to calculate a user's fatigue degree according to a user's psychological fatigue coefficient and a physiological fatigue coefficient, and determine whether the fatigue degree exceeds a preset value of the user under normal conditions;
    报警模块,用于当所述疲劳度超过使用者正常情况下的预设值时,产生一条包含使用者疲劳度的报警信息,并将所述报警信息通过通讯网络发送至监测中心平台对使用者的疲劳情况进行预警。An alarm module, configured to generate an alarm message including user fatigue when the fatigue exceeds a preset value of the user under normal conditions, and send the alarm information to the monitoring center platform to the user through the communication network Early warning of fatigue.
  10. 如权利要求9所述的基于数字化头盔的疲劳监测及预警系统,其特征在于,当所述疲劳度超过使用者正常情况下的预设值时,所述的报警模块还用于控制集成在数字化头盔上的报警器产生警报声。The digital helmet-based fatigue monitoring and early warning system according to claim 9, wherein said alarm module is further used for controlling integration in digitization when said fatigue degree exceeds a preset value of a user under normal conditions. The alarm on the helmet produces an alarm.
  11. 如权利要求10所述的基于数字化头盔的疲劳监测及预警方法,其特征在于,所述的心理疲劳监测模块根据脑电波信号的节律性变化分析使用者的心理疲劳系数包括:The digital helmet-based fatigue monitoring and early warning method according to claim 10, wherein the psychological fatigue monitoring module analyzes the user's psychological fatigue coefficient according to the rhythmic change of the brain wave signal, including:
    将所述脑电采集器采集的脑电波信号进行预处理剔出干扰信号;Performing pre-processing of the brain wave signal collected by the EEG collector to remove the interference signal;
    利用小波包分解法提取脑电波的特征波段alpha波、delta波、theta波、beta波;The wavelet wave packet decomposition method is used to extract the characteristic band alpha wave, delta wave, theta wave and beta wave of brain wave;
    利用频带能量比例值法分析所述特征波段alpha波、delta波、theta波、beta波的节律性变化得到所述使用者的心理疲劳系数。Using the band energy ratio method to analyze the rhythmic changes of the characteristic band alpha wave, delta wave, theta wave, and beta wave, the psychological fatigue coefficient of the user is obtained.
  12. 如权利要求10所述的基于数字化头盔的疲劳监测及预警系统,其特征在于,所述的生理疲劳监测模块从眼部图像中分析使用者的生理疲劳系数包括:The digital helmet-based fatigue monitoring and early warning system according to claim 10, wherein the physiological fatigue monitoring module analyzes the physiological fatigue coefficient of the user from the image of the eye, including:
    从所述摄像头摄取的眼部图像中识别出所述使用者的眼部运动;Identifying an eye movement of the user from an eye image taken by the camera;
    采用Perclos测量原理分析所述使用者的眼部运动得到使用者的生理疲劳系数。The user's eye movement is analyzed using the Perclos measurement principle to obtain the user's physiological fatigue coefficient.
  13. 如权利要求10所述的基于数字化头盔的疲劳监测及预警系统,其特征在于,所述的疲劳度计算模块根据使用者的心理疲劳系数和生理疲劳系数计算使用者的疲劳度包括:The digital helmet-based fatigue monitoring and early warning system according to claim 10, wherein the fatigue calculation module calculates the user's fatigue according to the user's psychological fatigue coefficient and the physiological fatigue coefficient, including:
    预先定义使用者的心理疲劳系数和生理疲劳系数的加权比例;Pre-defining the weighted ratio of the user's psychological fatigue coefficient and physiological fatigue coefficient;
    根据预定义的加权比例将使用者的心理疲劳系数和生理疲劳系数进行加权运算得到使用者的疲劳度。The user's fatigue factor is obtained by weighting the user's mental fatigue coefficient and physiological fatigue coefficient according to a predefined weighting ratio.
PCT/CN2015/098576 2015-07-31 2015-12-24 Fatigue monitoring and early-warning system and method based on digital helmet WO2017020501A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510460210.3 2015-07-31
CN201510460210.3A CN105167785A (en) 2015-07-31 2015-07-31 Fatigue monitoring and early warning system and method based on digital helmet

Publications (1)

Publication Number Publication Date
WO2017020501A1 true WO2017020501A1 (en) 2017-02-09

Family

ID=54890591

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/098576 WO2017020501A1 (en) 2015-07-31 2015-12-24 Fatigue monitoring and early-warning system and method based on digital helmet

Country Status (2)

Country Link
CN (1) CN105167785A (en)
WO (1) WO2017020501A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109917916A (en) * 2019-03-05 2019-06-21 浙江强脑科技有限公司 E-book control method, electronic equipment and computer readable storage medium
CN110650685A (en) * 2017-03-24 2020-01-03 爱尔西斯有限责任公司 Method for assessing a psychophysiological state of a person

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105167785A (en) * 2015-07-31 2015-12-23 深圳市前海安测信息技术有限公司 Fatigue monitoring and early warning system and method based on digital helmet
CN105534502B (en) * 2016-01-30 2019-05-03 深圳市易特科信息技术有限公司 Sick and wounded's savng system and method based on the digitlization helmet
CN105701973A (en) * 2016-04-26 2016-06-22 成都远控科技有限公司 Fatigue detection and early warning method based on brain wave acquisition and system thereof
CN106293073A (en) * 2016-07-29 2017-01-04 深圳市前海安测信息技术有限公司 Auxiliary patients of senile dementia based on virtual reality finds the system and method for article
CN106388818B (en) * 2016-09-21 2019-05-07 广州视源电子科技股份有限公司 The characteristics information extraction method and system of sleep state monitoring model
CN106473705B (en) * 2016-09-21 2019-05-07 广州视源电子科技股份有限公司 Brain-electrical signal processing method and system for sleep state monitoring
CN106691443B (en) * 2017-01-11 2020-06-26 中国科学技术大学 Wearable driver fatigue-prevention intelligent monitoring and early warning system based on electroencephalogram
CN107296596A (en) * 2017-07-18 2017-10-27 西安科技大学 The staff's fatigue monitoring system and method for a kind of underground coal mine
CN107789796A (en) * 2017-11-28 2018-03-13 江苏理工学院 A kind of exercycle auxiliary equipment for monitoring exercise state in real time using brain wave
CN109993180A (en) * 2017-12-29 2019-07-09 新华网股份有限公司 Human biological electricity data processing method and device, storage medium and processor
CN110063734B (en) * 2019-03-22 2022-10-04 中国人民解放军空军特色医学中心 Fatigue detection method, device and system and fatigue detection helmet
CN110101385A (en) * 2019-05-09 2019-08-09 吉林大学 A kind of intelligent military helmet and monitoring stimulating method of enhancing soldier's function of human body
CN110502102B (en) * 2019-05-29 2020-05-12 中国人民解放军军事科学院军事医学研究院 Virtual reality interaction method based on fatigue monitoring and early warning
CN112021715A (en) * 2020-08-25 2020-12-04 佛山市顺德区蚬华多媒体制品有限公司 Helmet

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6070098A (en) * 1997-01-11 2000-05-30 Circadian Technologies, Inc. Method of and apparatus for evaluation and mitigation of microsleep events
US20100292545A1 (en) * 2009-05-14 2010-11-18 Advanced Brain Monitoring, Inc. Interactive psychophysiological profiler method and system
CN102835964A (en) * 2012-08-31 2012-12-26 漳州师范学院 Glasses for acquiring fatigue driving physiological signal transmitted via Bluetooth
CN102848918A (en) * 2012-08-31 2013-01-02 漳州师范学院 Fatigue driving detection control system based on physiological signal collection and control method thereof
CN103818256A (en) * 2012-11-16 2014-05-28 西安众智惠泽光电科技有限公司 Automobile fatigue-driving real-time alert system
CN104305964A (en) * 2014-11-11 2015-01-28 东南大学 Head mounted fatigue detector and method
CN104586377A (en) * 2014-12-27 2015-05-06 深圳市前海安测信息技术有限公司 Detection system and method for predicting task execution ability of soldier
CN105167785A (en) * 2015-07-31 2015-12-23 深圳市前海安测信息技术有限公司 Fatigue monitoring and early warning system and method based on digital helmet

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6070098A (en) * 1997-01-11 2000-05-30 Circadian Technologies, Inc. Method of and apparatus for evaluation and mitigation of microsleep events
US20100292545A1 (en) * 2009-05-14 2010-11-18 Advanced Brain Monitoring, Inc. Interactive psychophysiological profiler method and system
CN102835964A (en) * 2012-08-31 2012-12-26 漳州师范学院 Glasses for acquiring fatigue driving physiological signal transmitted via Bluetooth
CN102848918A (en) * 2012-08-31 2013-01-02 漳州师范学院 Fatigue driving detection control system based on physiological signal collection and control method thereof
CN103818256A (en) * 2012-11-16 2014-05-28 西安众智惠泽光电科技有限公司 Automobile fatigue-driving real-time alert system
CN104305964A (en) * 2014-11-11 2015-01-28 东南大学 Head mounted fatigue detector and method
CN104586377A (en) * 2014-12-27 2015-05-06 深圳市前海安测信息技术有限公司 Detection system and method for predicting task execution ability of soldier
CN105167785A (en) * 2015-07-31 2015-12-23 深圳市前海安测信息技术有限公司 Fatigue monitoring and early warning system and method based on digital helmet

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110650685A (en) * 2017-03-24 2020-01-03 爱尔西斯有限责任公司 Method for assessing a psychophysiological state of a person
CN110650685B (en) * 2017-03-24 2024-02-20 爱尔西斯有限责任公司 Method for assessing psychophysiological state of human
CN109917916A (en) * 2019-03-05 2019-06-21 浙江强脑科技有限公司 E-book control method, electronic equipment and computer readable storage medium

Also Published As

Publication number Publication date
CN105167785A (en) 2015-12-23

Similar Documents

Publication Publication Date Title
WO2017020501A1 (en) Fatigue monitoring and early-warning system and method based on digital helmet
KR101049605B1 (en) Biosensors, communicators, and controllers that monitor eye movements and how to use them
Johnson et al. Drowsiness/alertness algorithm development and validation using synchronized EEG and cognitive performance to individualize a generalized model
JP6129161B2 (en) System and method for measuring head, eye, eyelid and pupil response
US8784293B2 (en) Systems and methods for optimization of sleep and post-sleep performance
US6497658B2 (en) Alarm upon detection of impending sleep state
US10039445B1 (en) Biosensors, communicators, and controllers monitoring eye movement and methods for using them
Leng et al. Wearable driver drowsiness detection system based on biomedical and motion sensors
US11179092B2 (en) Information processing apparatus and information processing method
Kanoh et al. Development of an eyewear to measure eye and body movements
US11602296B2 (en) Non-invasive systems and methods for detecting mental impairment
Lukšys et al. Quantitative analysis of parkinsonian tremor in a clinical setting using inertial measurement units
Dhole et al. A novel helmet design and implementation for drowsiness and fall detection of workers on-site using EEG and Random-Forest Classifier
WO2015152536A1 (en) Method and device for detecting sleepiness using moving image-based physiological signal
WO2012170816A2 (en) Sleep onset detection system and method
He et al. A noninvasive real-time driving fatigue detection technology based on left prefrontal Attention and Meditation EEG
Lahane et al. Innovative approach to control wheelchair for disabled people using BCI
JP6625930B2 (en) Hat with electro-oculogram detection electrode, headwear with electro-oculogram detection electrode, and alert method using electro-oculogram detection
Zeng et al. Classifying driving fatigue by using EEG signals
KR20220069177A (en) Smart control system and method of autonomous vehicle
CN209932735U (en) Wearable smart machine
Tabal et al. Development of low-cost embedded-based electrooculogram blink pulse classifier for drowsiness detection system
JP2022516033A (en) Stroke detection sensor
Chowdhury et al. Wearable Real-Time Epileptic Seizure Detection and Warning System
Salimuddin et al. Driver drowsiness monitoring system using fusion of facial features & EEG

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15900266

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15900266

Country of ref document: EP

Kind code of ref document: A1