CN103253275A - Driving attention detection device and method for interactive voice question - Google Patents

Driving attention detection device and method for interactive voice question Download PDF

Info

Publication number
CN103253275A
CN103253275A CN2013100033551A CN201310003355A CN103253275A CN 103253275 A CN103253275 A CN 103253275A CN 2013100033551 A CN2013100033551 A CN 2013100033551A CN 201310003355 A CN201310003355 A CN 201310003355A CN 103253275 A CN103253275 A CN 103253275A
Authority
CN
China
Prior art keywords
voice
question
order
instruction
driving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2013100033551A
Other languages
Chinese (zh)
Inventor
邹嘉骏
方志恒
林伯聪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Utechzone Co Ltd
Original Assignee
Utechzone Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Utechzone Co Ltd filed Critical Utechzone Co Ltd
Publication of CN103253275A publication Critical patent/CN103253275A/en
Pending legal-status Critical Current

Links

Images

Abstract

A driving attention detection device and method of interactive voice question is used for monitoring head action of driving and judging the attention concentration degree of driving, mainly by means of device question, driving response and device judgment, and comprises an image capturing unit for capturing driving images, a processing unit for performing image digital processing on the images, a voice question unit for providing voice question instructions, a safety judgment unit for performing numerical comparison and judgment according to the characteristics of the images, and when the images do not meet the requirements of the voice question instructions, warning messages are sent to prompt driving.

Description

The driving demand force detection devices and methods therefor that interactive voice is putd question to
Technical field
The present invention is relevant a kind of arrangement for detecting and method thereof, particularly a kind of devices and methods therefor of driving demand force detection of interactive voice enquirement.
Background technology
The road safety of driving about driving a vehicle etc. subject under discussion comes into one's own in recent years gradually.The safety traffic accident that causes owing to the maloperation of driving often takes place, and main cause is not have the rest of appropriateness owing to driving fatigue, the driving overlong time that causes of not having enough sleep, or drives when intoxicated etc.Rhembasmus, absent minded etc., the not good and generation of the accident that results in an automobile accident of the mental status of driving.In order to solve this type of problem, there is the multiple technologies scheme to be suggested.As No. the 200910310326.3rd, Chinese patent, " driving monitoring device and method ", it mainly is the acquisition that sees through image, detecting driver's eye areas be placed on the hand of bearing circle, judge whether the hand of driving is placed on the correct zone on the bearing circle and whether eyes open or because tired and close.
US Patent the 8th, 045, No. 766, " Device, program; and method for determining sleepiness " provides another kind of solution, mainly be the image of face that acquisition is driven, see through specific algorithm face is calculated, when finding the ill health of driving, utilize gas device and safety strap shaking device to wake driving up, or even warned through brake controller.
More than at the road safety subject under discussion, detecting driving condition and the technological means warned can both reasonable operation and certain effect is arranged.Yet can not detect attention intensity and the state of mind of driving quickly and accurately.
Summary of the invention
Technical matters to be solved by this invention is: at above-mentioned the deficiencies in the prior art, the driving demand force detection devices and methods therefor that provides a kind of interactive voice to put question to is with the flow process that device is putd question to, driving is answered, device is judged to be main monitoring.Device can propose voice suggestion, drive hear voice suggestion after, must make corresponding headwork, as nictation, rotate eyes etc. action, the headwork of shaking the head etc. of nodding, or open mouth action of shutting up etc.Under general normal situation, drive and can make correct action certainly, judge the state of mind and the attention intensity of driving by this.Compared to general known technology, the driving demand force detection devices and methods therefor that interactive voice provided by the invention is putd question to has simple to operately, carries out characteristics such as quick, effective.
Therefore, the technical scheme that one aspect of the present invention adopts is: the device of the driving demand force detection that a kind of interactive voice is putd question to, this device includes in order to the taking unit of obtaining the driving image, puts question to the voice of instruction to put question to unit and safe judging unit in order to propose voice, this safe judging unit puts question to the unit to link to each other with this taking unit, these voice, to detect the variation of this image, judge whether to meet the requirement that instruction putd question in these voice.
According to device of the present invention, more comprise the sound generating unit, if the variation of this image does not meet the requirement that instruction putd question in these voice, then send the caution message.In a preferred embodiment, wherein these voice put question to instruction to refer to see through a sound generating unit, send a voice suggestion; In another preferred embodiment, wherein should detect the variation of this image, judge whether to meet the requirement that instruction putd question in these voice, refer to drive whether make corresponding action according to this voice suggestion.And according to device of the present invention, wherein this voice suggestion is selected from by seeing earlier and left backly sees right order, takes a fancy to and see that afterwards taking a fancy to order, pitch of the laps order, order nictation, the order of shaking the head, the order of nodding, the order of smiling after issuing orders, seeing down earlier reaches the group that the order of shutting up is formed earlier.
The present invention provides a kind of method of driving demand force detection of interactive voice enquirement on the other hand, and this method includes the following step: propose voice and put question to instruction; Obtain an image of driving; Detect the variation of this image, judge whether to meet the requirement that instruction putd question in these voice; And if the variation of this image does not meet the requirement that instruction putd question in these voice, then send a caution message.
The method according to this invention, wherein the proposition time point of instruction putd question in these voice, sends instruction at random for periodically sending instruction or not timing; According to method of the present invention, wherein instruction putd question in these voice, can see through a sound generating unit, sends a voice suggestion again.And furthermore, wherein should detect the variation of this image, and judge whether to meet the requirement that instruction putd question in these voice, refer to drive whether make corresponding action according to this voice suggestion.And according to a preferred embodiment of the present invention, wherein this voice suggestion is selected from and sees earlier and left backly see right order, take a fancy to and see that afterwards taking a fancy to order, pitch of the laps order, order nictation, the order of shaking the head, the order of nodding, the order of smiling after issuing orders, seeing down earlier reaches the group that the order of shutting up is formed earlier.
So, drive hear the voice suggestion that this device proposes after, must make corresponding headwork, as nictation, rotate eyes etc. action, the headwork of shaking the head etc. of nodding, or open a mouth of shutting up and move etc.Under general normal situation, drive and can make correct action certainly, judge the state of mind and the attention intensity of driving by this.Compared to general known technology, devices and methods therefor provided by the invention has simple to operately, carries out characteristics such as quick, effective.
About purpose of the present invention, technology contents and characteristics, below lift a preferred embodiment and cooperate graphic the explanation.
Description of drawings
Fig. 1 is device architecture scheme drawing of the present invention.
Fig. 2 is method flow scheme drawing of the present invention.
Fig. 3 A is connecting method schematic flow sheet of the present invention.
Fig. 3 B is another connecting method schematic flow sheet of the present invention.
Fig. 4 is use assembling scheme drawing of the present invention.
Fig. 5 is capture computing scheme drawing of the present invention.
Fig. 6 is that scheme drawing is used in driving of the present invention.
Fig. 7 is that of the present invention another driven the use scheme drawing.
Label declaration
10 taking units, 20 processing units
The unit putd question in 30 safe judging unit 40 voice
50 sound generating unit, 60 communication units
70 caution unit, 100 device bodies
101 video cameras, 102 sound generating unit
200 head phantom, 201 eye Search Areas
202 eye images
S101 sends voice and puts question to instruction S102 to obtain the head phantom of driving
The head phantom of S103 is carried out image digital and is handled generation eye Search Area
S104 obtains the variation of the eye image S105 detecting eye image of driving
Whether S106 meets voice is putd question to the S107 that requires of instruction to send the caution message
The head phantom of S201 is carried out the variation of image digital treatment S 202 detecting head phantom
Whether S203 meets voice is putd question to the S204 that requires of instruction to send the caution message
The specific embodiment
Please refer to Fig. 1, be device architecture scheme drawing of the present invention.According to the driving demand force detection device that interactive voice provided by the present invention is putd question to, consist predominantly of taking unit 10, processing unit 20, sound generating unit 50, communication unit 60 and caution unit 70.Wherein, taking unit 10 links to each other with processing unit 20, uses the head phantom that obtains driving.Processing unit 20 includes voice at least and puts question to unit 40 and safe judging unit 30, voice are putd question to unit 40 can propose voice and are putd question to instruction, 30 of safe judging units carry out calculation process to head phantom, can judge that the image of driving head, face or even eye changes the action of head, face and eye that detecting is driven.
Instruction putd question in the voice that voice put question to unit 40 to send, and can be a kind of voice suggestion that can be heard by driving, sees through sound generation unit 50 and sound.Voice suggestion has multiple variation, such as: see earlier and left backly see right order, take a fancy to and afterwards see and take a fancy to order after issuing orders, seeing down earlier earlier, pitch of the laps order or order etc. nictation.The voice enquirement instruction that voice put question to unit 40 to provide is provided in driving, or after the voice suggestion, must make corresponding action, such as nictation specific times, eyes see that a left side sees the right side, or put question to order according to voice, whole head rotation towards a left side or towards right, nod shake the head, smile, face open and close etc. action.Above-mentioned voice suggestion has multiple variation, more than be example only, be not in order to limit right category of the present invention.Then, safe judging unit 30 will be detected and drive continuous image variation, judges whether to meet the requirement that instruction putd question in voice.If changing, the image of driving do not meet the requirement that instruction putd question in voice, then send the caution message, sound such as the same sound generation unit 50 that sees through, the caution unit 70 that sees through as the LED lamp sends blinker light, or can optionally pass back to traffic control center to the caution message by communication unit 60, and the state of attention that prompting is driven, this designs for the public transportation industry, be a kind of very effective driving condition repayment mechanism, guarantee the safety of passenger and goods.
About the driving demand force detection device that interactive voice provided by the invention is putd question to, please refer to Fig. 4, Fig. 6 and Fig. 7 actual service condition is described.Device body 100 of the present invention can optionally be placed in operator's saddle the place ahead, preferably can be contained in the top of instrument carrier panel, as shown in Figure 4.Device body 100 mounted inside have aforesaid processing unit 20 and operate other required electronics spare part, and the image that video camera 101 fechtables are driven, 102 of sound generating unit are used for sending voice and put question to instruction, voice suggestion.After the voice suggestion of sending from sound generating unit 102 is heard in driving, should make corresponding action, such as voice suggestion be: " please seeing the left back right side of seeing earlier ", so as Fig. 6 and shown in Figure 7, driving should be wanted to see towards a left side earlier, and then see towards the right side.After correct action was made in driving, just representative was driven in clear-headed state, and attention has certain intensity.Otherwise, do not make correct action if drive, will send the caution message so, wake driving up as the sound that gives a warning through sound generation unit 102.
The method of the driving demand force detection of puing question to about interactive voice of the present invention please cooperate with reference to figure 2, Fig. 3 A, Fig. 3 B to be described in detail.At first, device sends voice and puts question to instruction (S101), voice put question to instruction can see through the sound generation unit send voice suggestion, voice suggestion have multiple may, left backly see right order as seeing earlier, take a fancy to and afterwards see and take a fancy to order, pitch of the laps order etc. after issuing orders, seeing down earlier earlier.Then, obtain the head phantom (S102) of driving.Head phantom is carried out image digital handle, and produce eye Search Area (S103), obtain the eye image (S104) of driving.Please cooperate with reference to figure 5 about step S103 and step S104, after obtaining the head phantom 200 of driving, in the scope of head phantom 200, carry out image digital and handle, and define an eye Search Area 201, and within eye Search Area 201, find eye image 202.This external declaration, abovementioned steps S102 is the selectivity step to S104, has correlation technique can directly obtain the eye image, analysis obtains the eye image and need not obtain after the head phantom more earlier.
Continue after step S104, as shown in Figure 3A, the variation of detecting eye image, obtain eye feature (S105), and judge the variation of eye image, whether meet the requirement (S106) that instruction putd question in voice, if drive to have and make the correc operation of puing question to instruction corresponding to voice, inform to drive and make such as voice enquirement instruction, voice suggestion: the left back right side of elder generation, see the left back action of seeing the eye rotation on the right side earlier and drive also to make, so just can finish to detect the flow process of judgement.Otherwise, put question to instruction to make correct action if drive the voice that have no basis, device will send caution message (S107) so, wakes prompting up and drives.
Except the rotation of eyes is driven in detecting, also can detect the action of the head swing of driving and be judged.Please refer to Fig. 2 and Fig. 3 B, continue after step S102, also execution in step S201 optionally, head phantom is carried out image digital handle (S201), the image digital of this moment is handled can do further reinforcement to image, as strengthen the numerical value such as correlative value, brightness of image, help to look for the edge of feature in the image.Then, the variation of detecting head phantom obtains head feature (S202), and detect whether meet the requirement (S203) that instruction putd question in voice, as the preceding method flow process, driving is putd question to according to voice and is instructed, the content of voice suggestion, make correct action, so just finish the flow process that detecting is judged.Otherwise then send caution message (S204) and wake driving up.
Though the present invention discloses preferred embodiment as above; so it is not in order to limit the present invention; the technical personnel that has common knowledge in the field of the present invention; without departing from the spirit and scope of the present invention; when doing a little change and retouching, protection scope of the present invention is worked as with being as the criterion that accompanying claim was defined.

Claims (10)

1. the interactive voice driving demand force detection device of puing question to, it is characterized in that: this device includes in order to the taking unit of obtaining the driving image, puts question to the voice of instruction to put question to unit and safe judging unit in order to propose voice, this safe judging unit puts question to the unit to link to each other with this taking unit, these voice, to detect the variation of this image, judge whether to meet the requirement that instruction putd question in these voice.
2. the interactive voice as claimed in claim 1 driving demand force detection device of puing question to, it is characterized in that: this device more comprises the sound generating unit, puts question to the requirement of instructing if the variation of this image meets these voice, then sends the caution message.
3. the interactive voice as claimed in claim 1 driving demand force detection device of puing question to, it is characterized in that: described voice put question to instruction to refer to see through a sound generating unit, send a voice suggestion.
4. the interactive voice as claimed in claim 3 driving demand force detection device of puing question to, it is characterized in that: the variation of described this image of detecting judges whether to meet the requirement that instruction putd question in these voice, refers to drive whether make corresponding action according to this voice suggestion.
5. the interactive voice as claimed in claim 3 driving demand force detection device of puing question to is characterized in that: described voice suggestion is to be selected from by seeing earlier left backly to see right order, take a fancy to and see that afterwards taking a fancy to order, pitch of the laps order, order nictation, the order of shaking the head, the order of nodding, the order of smiling after issuing orders, seeing down earlier reaches the group that the order of shutting up is formed earlier.
6. the method for the interactive voice driving demand force detection of puing question to, it is characterized in that: this method includes the following step:
Instruction putd question in a, proposition one voice;
B, obtain an image of driving;
C, detect the variation of this image, judge whether to meet the requirement that instruction putd question in these voice;
D, if the variation of this image meets the requirement that instruction putd question in these voice, then send a caution message.
7. the method for the interactive voice as claimed in claim 6 driving demand force detection of puing question to, it is characterized in that: the proposition time point of instruction putd question in described voice, sends instruction at random for periodically sending instruction or not timing.
8. the method for the interactive voice as claimed in claim 6 driving demand force detection of puing question to, it is characterized in that: described voice put question to instruction to see through a sound generating unit, send a voice suggestion.
9. the method for the interactive voice as claimed in claim 8 driving demand force detection of puing question to, it is characterized in that: the variation of described this image of detecting, judge whether to meet the requirement that instruction putd question in these voice, refer to drive whether make corresponding action according to this voice suggestion.
10. the method for the interactive voice as claimed in claim 8 driving demand force detection of puing question to is characterized in that: described voice suggestion is selected from by seeing earlier and left backly sees right order, takes a fancy to and see that afterwards taking a fancy to order, pitch of the laps order, order nictation, the order of shaking the head, the order of nodding, the order of smiling after issuing orders, seeing down earlier reaches the group that the order of shutting up is formed earlier.
CN2013100033551A 2012-02-17 2013-01-06 Driving attention detection device and method for interactive voice question Pending CN103253275A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TW101105290 2012-02-17
TW101105290A TWI459333B (en) 2012-02-17 2012-02-17 An Attractive Force Detection Device and Its Method for Interactive Voice

Publications (1)

Publication Number Publication Date
CN103253275A true CN103253275A (en) 2013-08-21

Family

ID=48957582

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2013100033551A Pending CN103253275A (en) 2012-02-17 2013-01-06 Driving attention detection device and method for interactive voice question

Country Status (2)

Country Link
CN (1) CN103253275A (en)
TW (1) TWI459333B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107036620A (en) * 2015-11-25 2017-08-11 普瑞车联有限公司 The method for sending action instruction
US9878663B1 (en) 2016-12-07 2018-01-30 International Business Machines Corporation Cognitive dialog system for driving safety
CN107908289A (en) * 2017-12-01 2018-04-13 宁波高新区锦众信息科技有限公司 A kind of recognition of face interactive system of the robot based on head
CN111009146A (en) * 2018-10-04 2020-04-14 丰田自动车株式会社 Server, information processing method, and non-transitory storage medium storing program
CN111625094A (en) * 2020-05-25 2020-09-04 北京百度网讯科技有限公司 Interaction method and device for intelligent rearview mirror, electronic equipment and storage medium
US10832148B2 (en) 2016-12-07 2020-11-10 International Business Machines Corporation Cognitive dialog system for driving safety
CN113066263A (en) * 2020-01-02 2021-07-02 中车株洲电力机车研究所有限公司 Method and device for preventing fatigue driving
CN114475636A (en) * 2022-01-07 2022-05-13 深圳时空科技集团有限公司 Man-machine interaction system with vehicle driving assistance function

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI766463B (en) * 2020-12-03 2022-06-01 長庚大學 Auxiliary system for awake craniotomy

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7227472B1 (en) * 2005-06-02 2007-06-05 Kevin Roe Multistage safety screening of equipment operators
CN101256706A (en) * 2007-02-26 2008-09-03 株式会社电装 Sleep warning apparatus
CN102069710A (en) * 2009-11-24 2011-05-25 鸿富锦精密工业(深圳)有限公司 Device and method for monitoring driving
US8045766B2 (en) * 2007-02-16 2011-10-25 Denso Corporation Device, program, and method for determining sleepiness

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10324812A1 (en) * 2003-06-02 2004-12-23 Robert Bosch Gmbh Display arrangement for a motor vehicle and method for outputting driver information, in particular for a parking aid
CN101667323A (en) * 2009-09-25 2010-03-10 武汉理工大学 Real-time monitoring and alarming system for distraction of driver
TWM416161U (en) * 2011-05-19 2011-11-11 Zealtek Electronic Co Ltd Image processing system capable of reminding driver to drive carefully and preventing doze

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7227472B1 (en) * 2005-06-02 2007-06-05 Kevin Roe Multistage safety screening of equipment operators
US8045766B2 (en) * 2007-02-16 2011-10-25 Denso Corporation Device, program, and method for determining sleepiness
CN101256706A (en) * 2007-02-26 2008-09-03 株式会社电装 Sleep warning apparatus
CN102069710A (en) * 2009-11-24 2011-05-25 鸿富锦精密工业(深圳)有限公司 Device and method for monitoring driving
US20110121960A1 (en) * 2009-11-24 2011-05-26 Hon Hai Precision Industry Co., Ltd. Driving monitoring device and method utilizing the same

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107036620A (en) * 2015-11-25 2017-08-11 普瑞车联有限公司 The method for sending action instruction
US9878663B1 (en) 2016-12-07 2018-01-30 International Business Machines Corporation Cognitive dialog system for driving safety
US10832148B2 (en) 2016-12-07 2020-11-10 International Business Machines Corporation Cognitive dialog system for driving safety
CN107908289A (en) * 2017-12-01 2018-04-13 宁波高新区锦众信息科技有限公司 A kind of recognition of face interactive system of the robot based on head
CN107908289B (en) * 2017-12-01 2021-06-11 宁波高新区锦众信息科技有限公司 Head-based robot face recognition interaction system
CN111009146A (en) * 2018-10-04 2020-04-14 丰田自动车株式会社 Server, information processing method, and non-transitory storage medium storing program
CN113066263A (en) * 2020-01-02 2021-07-02 中车株洲电力机车研究所有限公司 Method and device for preventing fatigue driving
CN111625094A (en) * 2020-05-25 2020-09-04 北京百度网讯科技有限公司 Interaction method and device for intelligent rearview mirror, electronic equipment and storage medium
CN114475636A (en) * 2022-01-07 2022-05-13 深圳时空科技集团有限公司 Man-machine interaction system with vehicle driving assistance function

Also Published As

Publication number Publication date
TWI459333B (en) 2014-11-01
TW201335899A (en) 2013-09-01

Similar Documents

Publication Publication Date Title
CN103253275A (en) Driving attention detection device and method for interactive voice question
CN106585624B (en) Driver status monitoring method and device
JP6678311B2 (en) Driving support method, driving support device using the same, information presentation device, and vehicle
JP5907268B2 (en) Driving assistance device
CN105389948A (en) System and method for preventing fatigue driving of driver
CN105946575A (en) Intelligent bus-mounted host computer capable of collecting state of driver in real time
US20130257620A1 (en) Device and method for detecting driver's attention through interactive voice questioning
CN205365407U (en) Car safe driving initiative early warning system
CN110293969A (en) A kind of adaptive cruise control loop, method and automobile
US20130187847A1 (en) In-car eye control method
CN209795467U (en) Fatigue driving detection system and vehicle
JP2009075695A (en) Danger notification device and system
CN104527640B (en) Semiautomatic parking control system
CN106600894A (en) Fatigue driving and drunk driving monitoring and warning system
CN203496768U (en) Children safety monitoring warning system and automobile
TW201330827A (en) Attention detection device based on driver's reflex action and method thereof
US20140118131A1 (en) Monitoring and warning system for vehicles
CN106114604A (en) With alcohol detection and the steering wheel of fatigue detecting
CN109823347A (en) Intelligent network joins vehicle driving behavior supplementary security system and method
JP2007099046A (en) Alarm display device for vehicle
CN204256898U (en) A kind of fatigue driving prompt instrument
CN109541243A (en) A kind of drunk driving automatic checkout system and its method based on vehicle steering wheel
CN103625288A (en) Fatigue driving alarm system
CN110077417A (en) A kind of method and system of automobile guideboard acquisition of information prompt
JP2008189057A (en) Vehicle notice alarm system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20130821