US20020036570A1 - Object detection apparatus - Google Patents

Object detection apparatus Download PDF

Info

Publication number
US20020036570A1
US20020036570A1 US09/348,700 US34870099A US2002036570A1 US 20020036570 A1 US20020036570 A1 US 20020036570A1 US 34870099 A US34870099 A US 34870099A US 2002036570 A1 US2002036570 A1 US 2002036570A1
Authority
US
United States
Prior art keywords
light
wavelength
illuminance
sunlight
detection apparatus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US09/348,700
Other versions
US6392539B1 (en
Inventor
Katsumi Kanasugi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honda Motor Co Ltd
Original Assignee
Honda Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honda Motor Co Ltd filed Critical Honda Motor Co Ltd
Assigned to HONDA GIKEN KOGYO KABUSHIKI KAISHA reassignment HONDA GIKEN KOGYO KABUSHIKI KAISHA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SANASUGI, KATSUMI
Assigned to HONDA GIKEN KOGYO KABUSHIKI KAISHA reassignment HONDA GIKEN KOGYO KABUSHIKI KAISHA CORRECTIVE ASSIGNMENT TO CORRECT THE NAME OF THE ASSIGNOR, FILED ON 07/07/99, PREVIOUSLY RECORDED ON REEL 10090 FRAME 0287. ASSIGNOR HEREBY CONFIRMS THE ASSIGNMENT OF THE ENTIRE INTEREST. Assignors: KANASUGI, KATSUMI
Publication of US20020036570A1 publication Critical patent/US20020036570A1/en
Application granted granted Critical
Publication of US6392539B1 publication Critical patent/US6392539B1/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/87Combinations of systems using electromagnetic waves other than radio waves
    • G01S17/875Combinations of systems using electromagnetic waves other than radio waves for determining attitude
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/143Sensing or illuminating at different wavelengths
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris

Definitions

  • the present invention relates to an object detection apparatus, with a light emission device and a light reception device, for employing the wavelength in a solar absorption zone in a light spectrum extending from a visible radiation band to a near-infrared radiation band.
  • a light emission device is used to irradiate the eyes of the crew member with a specific light beam
  • a light reception device is used to receive images reflected by the crew member's retinas and corneas, so that the direction of the individual's line of sight can be determined and the observed point can be calculated.
  • An observed point calculation device intended for use in a vehicle which is disclosed in Japanese Unexamined Patent Publication No. Hei 7-35543, calculates the position of the observed point viewed by a vehicular operator, without any physical contact being required.
  • This device calculates the observed point by employing the fact that when the eyes are irradiated by a near-infrared beam, the luminance of the reflected retinal image depends on the distance to the observed point of the eye.
  • the position of the observed point is calculated by using the brightness of the images reflected by the retinas, and the direction of the line of sight is calculated by using information obtained from the images reflected by both the corneas and the retinas. In this fashion, the calculation of the position of the observed point is performed.
  • the sunlight acts as a disturbance, and an image obtained by the reflection of the beam that is radiated by the light emission member is blurred because of the adverse affect of the sunlight. That is, when the quantity of the incident light produced by sunlight having the same wavelength as that of a beam radiated by a light emission member is equal to or greater than the incident light produced by the beam produced by the light emission member, the S/N ratio (signal-to-noise ratio) is drastically deteriorated, and the reflected image obtained using the light from the target light emission member can not be identified by using the light reception results.
  • An operator pickup apparatus disclosed in Japanese Unexamined Patent Publication No. Hei 7-134800 can obtain clear reflected images from the retinas of an operator by providing device for limiting the above described disturbance.
  • the disturbance restriction device such as a band-pass filter (B.P.F; an optical filter) is located along an optical path connecting the operator and a light reception device, so that a clear retinal-reflection image can be obtained even in the presence of a strong disturbance.
  • An adverse effect produced by a disturbance that has a wavelength other than that of the beam radiated by the light emission member can be attenuated by using a band-pass filter; however, a disturbance producing light having the same wavelength as the light radiated by the light emission member will be passed through the band-pass filter, and as a result, will cause deterioration of the S/N ratio.
  • an apparatus that is disclosed in Japanese Unexamined Patent Publication No. Hei 8-159733 can determine the direction of the line of sight while ensuring the eyes will not be injured in the presence of a strong disturbance. Since in the presence of a strong disturbance the pupils are constricted, accordingly, a greater quantity of light must be emitted, and as a result, a problem concerning the safety of the eyes has arisen. Therefore, the disclosed device precisely determines the direction of the line of sight even in the presence of a strong disturbance, while providing for the safety of the eyes.
  • the eyes of an operator are irradiated by an infrared ray so that the radiant energy density is equal to or smaller than a safety reference value, and so that the peak pulse power of the a light emission device is inversely proportional to the operating speed of a shutter; so that a reflected image is picked up in order to extract a reflected retinal image and a reflected corneal image; and so that the direction of the line of sight of the operator can be calculated from the positions of the reflected images. While the adverse effects produced by a disturbance can be reduced by increasing the shutter operating speed and the peak light emission power, the S/N ratio is not drastically reduced. However, the affect on the eyes due to the addition of the large amount of pulse light is unknown.
  • an object detection apparatus for detecting the state of an object includes: a light emission device irradiating an object with a light beam at a wavelength that produces less disturbance; and a light reception device including a filter through which to pass the light beam at the wavelength, and receiving a light beam reflected from the object.
  • the light emission device emits light at a wavelength that produces less disturbance, and the light is received by the light reception device after passing through the filter so that the state of the object can be precisely detected without the process being affected by any disturbance.
  • Disturbance is changed to noise when a reflected light is received, and in the daytime, sunlight acts as a representative disturbance.
  • all the lights in a town such as the lights of cars, neon signs, or lights in shops and houses, act as disturbances.
  • sunlight may act as the disturbance. That is, detection of the object is performed by using a light at a wavelength that has the low spectral radiative illuminance of the spectrum of sunlight. With this arrangement, sunlight at a wavelength other than that used for the detection of an object has no effect on the detection operation, and therefore, even in the daytime the state of the object can be precisely detected.
  • the object may be the eyes of an operator, and the object detection apparatus may be mounted on a vehicle so as to obtain reflected images from the retinas and the corneas of the eyes and to thus calculate an observed point viewed by the operator.
  • the object detection apparatus may be mounted on a vehicle so as to obtain reflected images from the retinas and the corneas of the eyes and to thus calculate an observed point viewed by the operator.
  • the wavelength may be a wavelength in a non-visible irradiation band.
  • the wavelength may be one of a plurality of wavelengths producing less disturbance. That is, since sunlight includes a plurality of wavelengths for which the spectral radiative illuminance is quite low, one of the wavelengths is selected in accordance with the environment in which the invention is employed. With this arrangement, since the environment is taken into consideration when a wavelength is selected, the state of an object can be precisely detected in accordance with the environment.
  • the wavelength may be selected from a visible irradiation band in the daytime and from a non-visible irradiation band at night.
  • FIG. 1 is a graph showing a light spectral characteristic of standard sunlight in a standard atmosphere
  • FIG. 2 is a block diagram illustrating an object detection apparatus according to one embodiment of the present invention.
  • FIG. 3 is a block diagram illustrating the mechanical structure of an image data processor
  • FIG. 4 is a diagram showing the calculation of the direction of the line of sight and an observed point
  • FIG. 5 is a graph showing the spectral illuminance characteristic on the surface of an eye of light emitted by a light-emitting diode
  • FIG. 6 is a graph showing the illuminance characteristic on the surface of an eye of light emitted by a light-emitting diode
  • FIG. 7 is a graph showing the spectral illuminance characteristic on the light-receiving face of a CCD after light emitted by a light-emitting diode and a sunlight have been passed through an optical filter;
  • FIG. 8 is a graph showing the illuminance characteristic on the light-receiving face of the CCD.
  • FIG. 1 is a diagram showing the general solar spectrum. This is a solar spectrum characteristic described in the “Solar Battery Handbook” (by the Electric Institution).
  • the horizontal axis represents the wavelength element of sunlight, and the vertical axis represents the spectral radiative illuminance, i.e., the radiation intensity per 1 cm 2 . Therefore, FIG. 1 shows the intensity (energy) of a radiated beam for a wavelength element. As is shown in FIG. 1, the light is roughly divided at a wavelength of 0.75 ⁇ m to 0.77 ⁇ m into a visible radiation spectrum 1 and a near-infrared radiation spectrum 2 .
  • the visible beam has a wavelength of 0.4 ⁇ m to 0.77 ⁇ m, and the near-infrared beam has a wavelength of 0.75 ⁇ m to 2.5 ⁇ m.
  • the light having the highest spectral radiative illuminance is a green area that has a wavelength of about 0.58 ⁇ m.
  • FIG. 1 It is apparent from FIG. 1 that at specific wavelengths, sunlight is strongly damped (points A, B, C and D in FIG. 1).
  • the wavelength at point A in FIG. 1 is 0.761 ⁇ m to 0.762 ⁇ m, and belongs to the visible radiation area 1 .
  • the spectral radiative illuminance at point A is substantially reduced and is near 0. This is approximately ⁇ fraction (1/10) ⁇ , or less, of the spectral radiative illuminance of the green area, and it feels dark, even in the daytime.
  • the damping of the sunlight at point A occurs because nearby wavelengths are absorbed by the oxygen in the atmosphere. The amount that is absorbed is substantially constant, depending on the density of the oxygen in the air.
  • Points B, C and D in FIG. 1 belong to the near-infrared radiation area that human beings can not see.
  • the wavelengths at points B, C and d are 0.934 to 0.935 ⁇ m, 1.13 ⁇ m, and 1.34 to 1.44 ⁇ m, respectively.
  • the radiation energy is approximately 1 ⁇ 5, or less, of the spectral radiative illuminance in the green area.
  • the damping rates are approximately 50 to 100% of the spectral radiative illuminance in the green area.
  • the damping of the sunlight at points B, C and D occurs because nearby wavelengths are absorbed by water vapor in the air.
  • the amount to which sunlight is absorbed varies somewhat in consonance with the precipitable water content of the air, which normally varies, depending on climatic conditions, fluctuates within a range extending from 5 mm to 50 mm.
  • the damping of the sunlight that occurs at points B, C and D is in proportion to the precipitable water content of the air, and the degree of damping can satisfy the above factors when the precipitable water content is at the lower limit of 5 mm.
  • the spectrum of sunlight has a feature that the spectral radiative illuminance is damped at a plurality of specific wavelengths. This means, substantially, that sunlight does not act as a disturbance at these specific wavelengths. Therefore, to detect an object, the object is irradiated with light containing the specific wavelengths at points A, B, C and D, and since an optical filter is employed that permits the passage of only these same wavelengths in reflected light, the S/N ratio in the detection process can be drastically improved. Further, in case that the object is the eyes, since a light in the wavelength containing less sunlight is irradiated to the eyes, the amount of radiation of the eyes by the emission device need not be increased, and the eyes will not be adversely affected.
  • the wavelengths at points C and D can not provide satisfactory reflected retinal images because the light reflectivity of the retinas is low, but such light can provide preferable reflected corneal images. Therefore, the wavelengths at point C and D can be employed to determine the positions of eyes, but are not appropriate for the determination of the line of sight.
  • FIG. 2 is a diagram showing an object detection apparatus 10 according to one embodiment of the present invention.
  • the object detection apparatus 10 includes a light-emitting diode (LED) 20 , a pickup camera 30 , an optical filter 40 , and an image data processor 60 .
  • LED light-emitting diode
  • the object detection apparatus 10 includes a light-emitting diode (LED) 20 , a pickup camera 30 , an optical filter 40 , and an image data processor 60 .
  • LED light-emitting diode
  • the light-emitting diode 20 is a diode that emits light at a wavelength where the spectral radiative illuminance of sunlight is damped. This wavelength corresponds to a wavelength of 0.76 ⁇ m (A) in the visible radiation spectrum 1 in FIG. 1, or to a wavelength of 0.94 ⁇ m (B) in the near-infrared radiation spectrum 2 .
  • a diode having a predetermined wavelength that is available on the market is employed as the light-emitting diode 20 .
  • the object detection apparatus 10 may include only a light-emitting diode that emits light at wavelength A, or it may also include an additional diode that emits light at wavelength B, in which case the diodes may be switched in accordance with the environment in which employed.
  • Wavelength A is ideal because at that wavelength the damping of the illuminance of sunlight is the strongest; however, as this wavelength belongs to the visible radiation spectrum, it may at a dark environment such as at night, be undesirable, since in the dark environment it appears as red. In this case, if the object detection apparatus 10 has two light-emitting diodes, the diodes can be switched in the daytime and at night to solve the above problem.
  • the pickup camera 30 is a CCD camera having a function that an image signal is generated upon the receipt of the light reflected by an object to be picked up.
  • the optical filter 40 is located in front of the CCD and permits only specific wavelengths to pass.
  • the optical filter 40 may be applied as a coating on the surface of the CCD, or it may be a separate member that is located in front of CCD.
  • the object detection apparatus 10 includes two light-emitting diodes 20 having different wavelengths, two optical filters, corresponding respectively to the two wavelengths, are provided, and in use are switched in unison with their respective light-emitting diodes.
  • Such an optical filter can be one available on the market that has a predetermined central wavelength and a predetermined half-width.
  • one of the optical filters that is employed has a central wavelength of 0.76 ⁇ m and a half-width of 5 nm, while the other has a central wavelength of 0.94 ⁇ m and a half-width of 10 nm.
  • the image data processor 60 is mounted in the object detection apparatus 10 to obtain the observed point of an eye 50 .
  • Light that is projected onto the eye 50 by the light emitting diode 20 is reflected by the cornea and the retina of the eye 50 .
  • the reflected light is routed through the optical filter 40 , which selects and permits only light having a wavelength of 0.76 ⁇ m to pass, and is transmitted to the pickup camera 30 .
  • the pickup camera 30 uses the received light to generate an image signal, and transmits the signal to the image data processor 60 of the object detection apparatus 10 .
  • FIG. 3 is a block diagram illustrating the functional arrangement of the image data processor 60 .
  • An image signal from the pickup camera 30 is converted by an A/D converter 110 into a digital signal.
  • the digital signal is then stored as x and y coordinate data in an image memory 120 .
  • An image extractor 130 extracts a cornea reflected image (x 1 , y 1 ) and a retina reflected image (x 2 , y 2 ) from the coordinate data.
  • an observed point calculator 140 determines the direction of the line of sight, based on the extracted coordinates of the reflected corneal and retinal images, and calculates the observed point.
  • the image extractor 130 in the image data processor 60 extracts coordinates (x 1 , y 1 ) of a reflected corneal image 250 and coordinates (x 2 , y 2 ) of a reflected retinal image 260 .
  • the location of the pickup camera 30 is established in advance, and it is known that the size of an eye 50 of an adult is approximately constant and that the radius 230 of the eye 50 is about 4.2 mm.
  • These data and a distance 210 from the pickup camera 30 to the eye 50 which is calculated can be used to perform a simple calculation to obtain the position of the cornea of the eye 50 and the center position of the eye 50 .
  • a vector 200 in the direction of the line of sight is calculated using the position of the cornea and the center position of the eye 50 that are obtained.
  • An observed point 300 can be calculated from the direction of the line of sight 200 and the distance between the eye 50 and the observed point 300 , and the distance to the observed point 300 can be acquired from, for example, the luminance of the retina reflected image 260 .
  • the images reflected by the eyes of a crew member in a vehicle are obtained.
  • the invention is applied to a case that the state of another object can be detected by irradiating it with light having a wavelength which produces only a small disturbance and by acquiring the reflected image.
  • the object is a specific mobile member
  • the moving state of the specific mobile member can be detected.
  • FIG. 5 is a graph showing the spectral illuminance characteristic of the light with which a light-emitting diode irradiates the eyes of the operator of a vehicle in order to detect the operator's line of sight.
  • the vertical axis represents the spectral illuminance at the surface of the eye, i.e., the intensity, on the surface of the eye, of the light emitted by the light-emitting diodes; and the horizontal axis represents the wavelength.
  • the wavelengths E and B correspond to those at points E and B in FIG. 1.
  • a curve 500 represents the spectral illuminance characteristic of the light at the surface of the eye, at point E in FIG.
  • An area 510 which is defined by the curve 500 and the horizontal axis representing the wavelength, represents the total quantity of spectral illuminance at the eye, i.e., the illuminance on the surface of the eye, when the eye is irradiated by a light-emitting diode having wavelength E.
  • An area 520 is the portion of the area 510 that corresponds to a half-width of 50 nm.
  • a curve 550 represents the spectral illuminance characteristic of the light at the surface of the eye, at point B in FIG. 1, with which the light-emitting diode having the wavelength B should irradiate the eye in order to detect the line of sight under the illuminance provided by sunlight.
  • An area 560 which is defined by the curve 550 and the horizontal axis, represents the illuminance at the surface of the eye when the eye is irradiated by the light-emitting diode having the wavelength B.
  • An area 570 is the portion of the area 560 that corresponds to a half-width of 50 nm.
  • the spectral illuminance characteristic of the curve 500 is greater as a whole than that of the curve 550 .
  • the illuminance indicated by the curve 500 is required in order to obtain the image reflected by the object. Since sunlight is strongly damped at wavelength B, the reflected image can be obtained without increasing the illuminance as for wavelength E. Following this, an explanation will be given concerning how eyes are affected in accordance with differences in the illuminances of the wavelengths.
  • FIG. 6 is a bar graph showing the illuminance characteristic of light, produced by the light-emitting diode, on the surface of the eye.
  • the vertical axis represents the illuminance on the surface of the eye, i.e., the light intensity emitted at the eye.
  • Wavelengths E and B along the horizontal axis correspond to wavelengths E and B in FIG. 5.
  • a graph bar 600 shows the degree of the illuminance, which that is obtained by integrating the spectral illuminance of the curve 500 in FIG. 5, on the surface of the eye of light having wavelength E.
  • a graph bar 610 shows the degree of the illuminance, which is obtained by integrating the spectral illuminance of the curve 550 , on the surface of the eye of light having wavelength B.
  • An illuminance safety reference 650 is used to indicate the advisory value of 10 mW/cm 2 determined at the U.S. Labor Safety Conference.
  • the “safety factor” is the difference between the illuminance safety reference of 10 mW/cm 2 , which is indicated by the illuminance safety reference 650 , and the illuminance on the surface of the eye.
  • an illuminance 600 on the surface of the eye of light having wavelength E substantially reaches the illuminance safety reference 650 , while an illuminance 610 on the surface of the eye of light having wavelength B is considerably below the reference 650 . Therefore, the safety factor for the eye due to the light having wavelength B is high, and the safety factor due to the light having wavelength E is quite low.
  • the eyes are irradiated by light having a wavelength at which sunlight is damped less, high illuminance is required to detect a signal, so that the illuminance reaches the safety reference and adversely affects the eyes.
  • the disturbance is small and high illuminance is not required, and thus, the illuminance is sufficiently below the safety reference so that it does not affect the eyes.
  • FIG. 7 is a graph showing the spectral illuminance characteristic on the light-receiving face of the CCD after light from the light-emitting diode and sunlight have passed through the optical filter.
  • the vertical axis represents the spectral illuminance on the light-receiving face of the CCD, i.e., represents the intensity of light with which the CCD is to be irradiated.
  • Wavelengths E and B along the horizontal axis correspond to the wavelengths at points E and B in FIG. 1.
  • a curve 700 shows the illuminance characteristic at the CCD light-receiving face when the light from the light-emitting diode having wavelength E passes through the optical filter having transmission wavelength E.
  • a curve 710 shows the illuminance characteristic at the CCD light-receiving face when sunlight passes through the optical filter having transmission wavelength E.
  • a portion that is surrounded by the curve 710 and the horizontal axis corresponds to the shaded portion at wavelength E′ for sunlight in FIG. 1.
  • the central wavelength to be passed through is wavelength E and the half-width is 10 nm.
  • An area 720 is the portion which corresponds to the half-width portion of the area defined by the curve 700 and the horizontal axis, and an area 730 corresponds to the half-width portion of the shaded portion surrounded by the curve 710 .
  • a curve 750 shows the illuminance characteristic at the CCD light-receiving face when light from the light-emitting diode having wavelength B passes through the optical filter having transmission wavelength B.
  • a curve 760 shows the illuminance characteristic at the CCD light-receiving face when sunlight passes through the optical filter having transmission wavelength B.
  • a portion that is surrounded by the curve 760 and the horizontal axis corresponds to the shaded portion at wavelength B′ for sunlight in FIG. 1.
  • the central wavelength to be passed through is wavelength B and the half-width is 10 nm.
  • An area 770 is the portion which corresponds to the half-width portion of the area defined by the curve 750 and the horizontal axis, and an area 780 corresponds to the half-width portion of the shaded portion defined by the curve 760 .
  • FIG. 8 is a graph showing the illuminance characteristic on the light-receiving face of the CCD.
  • the vertical axis represents the illuminance at the light-receiving face of the CCD that corresponds to the quantity of CCD charges for the hour unit.
  • Wavelengths E and B along the horizontal axis correspond to wavelengths E and B in FIG. 7.
  • the S/N ratio in FIG. 8 represents the difference between the illuminance of light from the light-emitting diode on the CCD light-receiving face and the illuminance of sunlight on the CCD light-receiving face.
  • a graph bar 800 shows the results obtained by integrating the curve 700 in FIG.
  • a graph bar 810 shows the results obtained by integrating the curve 710 in FIG. 7, and represents the degree of the illuminance of light that the CCD-light receiving face receives from sunlight via the optical filter having transmission wavelength E.
  • a graph bar 850 shows the results obtained by integrating the curve 750 in FIG. 7, and represents the degree of the illuminance of light that the CCD-light receiving face receives from the light-emitting diode having wavelength B via the optical filter having transmission wavelength B.
  • a graph bar 860 shows the results obtained by integrating the curve 760 in FIG. 7, and represents the degree of the illuminance of light that the CCD-light receiving face receives from sunlight via the optical filter having wavelength B.
  • the S/N ratio can be very high. Therefore, according to the present invention, the state of an object can be detected at a high safety factor and a high S/N ratio.
  • the state of an object can be preferably detected without being affected adversely by a disturbance. Further, since sunlight at a wavelength other than that used for the detection of an object is not related to the detection process, the state of an object can be preferably detected even in the daytime.
  • the state of an object can be preferably detected in accordance with the environment. Further, since the wavelength is selected in accordance with the environment in the daytime and at night, the state of an object can be satisfactorily detected throughout the day.

Abstract

Provided is an object detection apparatus, which includes a light emission device irradiating an object with light at a wavelength having less disturbance, and a light reception device including a filter that permits light having the aforementioned wavelength to pass, for receiving reflected light from the object. When the disturbance is sunlight, the light having a wavelength whereat the spectral radiative illuminance is damped is employed in accordance with the spectral characteristic of sunlight. In one embodiment, an object detection apparatus, which is mounted in a vehicle, employs, as an object, the eyes of a crew member in the vehicle, and obtains reflected images of the crew member's corneas and retinas to calculate the observed point viewed by the crew member.

Description

    BACKGROUND OF THE INVENTION
  • 1. Field of the Invention [0001]
  • The present invention relates to an object detection apparatus, with a light emission device and a light reception device, for employing the wavelength in a solar absorption zone in a light spectrum extending from a visible radiation band to a near-infrared radiation band. [0002]
  • 2. Description of the Related Art [0003]
  • Several techniques have been proposed for employing light to calculate an observed point viewed by a crew member in a vehicle. Generally, a light emission device is used to irradiate the eyes of the crew member with a specific light beam, and a light reception device is used to receive images reflected by the crew member's retinas and corneas, so that the direction of the individual's line of sight can be determined and the observed point can be calculated. An observed point calculation device intended for use in a vehicle, which is disclosed in Japanese Unexamined Patent Publication No. Hei 7-35543, calculates the position of the observed point viewed by a vehicular operator, without any physical contact being required. This device calculates the observed point by employing the fact that when the eyes are irradiated by a near-infrared beam, the luminance of the reflected retinal image depends on the distance to the observed point of the eye. First, for calibration, an image of the eyeballs is recorded by a pickup camera each time an imaginary image at a predetermined distance is moved. Information concerning the images reflected by the retinas and the corneas is extracted from the obtained image data, and the brightness of the images reflected by the retinas is calculated and stored. At the next calculation performed for the observed location, the position of the observed point is calculated by using the brightness of the images reflected by the retinas, and the direction of the line of sight is calculated by using information obtained from the images reflected by both the corneas and the retinas. In this fashion, the calculation of the position of the observed point is performed. [0004]
  • According to this method, in the daytime, when the face or another portion of the head is irradiated directly or indirectly by sunlight, the sunlight acts as a disturbance, and an image obtained by the reflection of the beam that is radiated by the light emission member is blurred because of the adverse affect of the sunlight. That is, when the quantity of the incident light produced by sunlight having the same wavelength as that of a beam radiated by a light emission member is equal to or greater than the incident light produced by the beam produced by the light emission member, the S/N ratio (signal-to-noise ratio) is drastically deteriorated, and the reflected image obtained using the light from the target light emission member can not be identified by using the light reception results. [0005]
  • An operator pickup apparatus disclosed in Japanese Unexamined Patent Publication No. Hei 7-134800 can obtain clear reflected images from the retinas of an operator by providing device for limiting the above described disturbance. The disturbance restriction device, such as a band-pass filter (B.P.F; an optical filter), is located along an optical path connecting the operator and a light reception device, so that a clear retinal-reflection image can be obtained even in the presence of a strong disturbance. An adverse effect produced by a disturbance that has a wavelength other than that of the beam radiated by the light emission member can be attenuated by using a band-pass filter; however, a disturbance producing light having the same wavelength as the light radiated by the light emission member will be passed through the band-pass filter, and as a result, will cause deterioration of the S/N ratio. [0006]
  • In addition, an apparatus that is disclosed in Japanese Unexamined Patent Publication No. Hei 8-159733 can determine the direction of the line of sight while ensuring the eyes will not be injured in the presence of a strong disturbance. Since in the presence of a strong disturbance the pupils are constricted, accordingly, a greater quantity of light must be emitted, and as a result, a problem concerning the safety of the eyes has arisen. Therefore, the disclosed device precisely determines the direction of the line of sight even in the presence of a strong disturbance, while providing for the safety of the eyes. The eyes of an operator are irradiated by an infrared ray so that the radiant energy density is equal to or smaller than a safety reference value, and so that the peak pulse power of the a light emission device is inversely proportional to the operating speed of a shutter; so that a reflected image is picked up in order to extract a reflected retinal image and a reflected corneal image; and so that the direction of the line of sight of the operator can be calculated from the positions of the reflected images. While the adverse effects produced by a disturbance can be reduced by increasing the shutter operating speed and the peak light emission power, the S/N ratio is not drastically reduced. However, the affect on the eyes due to the addition of the large amount of pulse light is unknown. [0007]
  • As is described above, when, to ensure the S/N ratio, the quantity of emitted light is increased until it is equal to or greater than the amount of incident light that acts as a disturbance, as does sunlight, a problem has arisen concerning the safety of the eyes when they are subjected to irradiation. To protect the eyes, a standard has been established to ensure that when the light emitted by an emission source is within a near-infrared irradiation band, its intensity should not exceed a recommended value of “10 mW/cm[0008] 2,” as determined at a U.S. Labor Safety Conference. When the light emitted by a light emission source is within a visible radiation band, an operator may be dazzled by emitted light that exceeds the light beam in quantity and the operator's eyes may be adversely affected.
  • SUMMARY OF THE INVENTION
  • It is, therefore, one object of the present invention to detect the state of an object at a high S/N ratio. It is another object of the present invention to provide an apparatus that is friendly to the eyes when detecting the line of sight. [0009]
  • To achieve the above objects, according to the invention, an object detection apparatus for detecting the state of an object includes: a light emission device irradiating an object with a light beam at a wavelength that produces less disturbance; and a light reception device including a filter through which to pass the light beam at the wavelength, and receiving a light beam reflected from the object. With this arrangement, the light emission device emits light at a wavelength that produces less disturbance, and the light is received by the light reception device after passing through the filter so that the state of the object can be precisely detected without the process being affected by any disturbance. [0010]
  • Disturbance is changed to noise when a reflected light is received, and in the daytime, sunlight acts as a representative disturbance. At night, all the lights in a town, such as the lights of cars, neon signs, or lights in shops and houses, act as disturbances. [0011]
  • In the above object detection apparatus, sunlight may act as the disturbance. That is, detection of the object is performed by using a light at a wavelength that has the low spectral radiative illuminance of the spectrum of sunlight. With this arrangement, sunlight at a wavelength other than that used for the detection of an object has no effect on the detection operation, and therefore, even in the daytime the state of the object can be precisely detected. [0012]
  • Further, in the above object detection apparatus, the object may be the eyes of an operator, and the object detection apparatus may be mounted on a vehicle so as to obtain reflected images from the retinas and the corneas of the eyes and to thus calculate an observed point viewed by the operator. With this arrangement, preferred reflected images of the retinas and corneas can be obtained, and the observed point viewed by the operator can be accurately calculated. [0013]
  • In addition, according to the above object detection apparatus, the wavelength may be a wavelength in a non-visible irradiation band. With this arrangement, since flicker due to light from the light emission device can be prevented, for example, when the detection apparatus is used at night, the state of an object can be detected without causing the eyes of a human being to be distressed. [0014]
  • Further, in the above object detection apparatus, the wavelength may be one of a plurality of wavelengths producing less disturbance. That is, since sunlight includes a plurality of wavelengths for which the spectral radiative illuminance is quite low, one of the wavelengths is selected in accordance with the environment in which the invention is employed. With this arrangement, since the environment is taken into consideration when a wavelength is selected, the state of an object can be precisely detected in accordance with the environment. [0015]
  • Moreover, the wavelength may be selected from a visible irradiation band in the daytime and from a non-visible irradiation band at night. With this arrangement, since wavelengths can be selected that are appropriate for the environmental conditions encountered in the daytime and at night, the state of an object can be accurately detected both in the daytime and at night.[0016]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a graph showing a light spectral characteristic of standard sunlight in a standard atmosphere; [0017]
  • FIG. 2 is a block diagram illustrating an object detection apparatus according to one embodiment of the present invention; [0018]
  • FIG. 3 is a block diagram illustrating the mechanical structure of an image data processor; [0019]
  • FIG. 4 is a diagram showing the calculation of the direction of the line of sight and an observed point; [0020]
  • FIG. 5 is a graph showing the spectral illuminance characteristic on the surface of an eye of light emitted by a light-emitting diode; [0021]
  • FIG. 6 is a graph showing the illuminance characteristic on the surface of an eye of light emitted by a light-emitting diode; [0022]
  • FIG. 7 is a graph showing the spectral illuminance characteristic on the light-receiving face of a CCD after light emitted by a light-emitting diode and a sunlight have been passed through an optical filter; and [0023]
  • FIG. 8 is a graph showing the illuminance characteristic on the light-receiving face of the CCD.[0024]
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
  • FIG. 1 is a diagram showing the general solar spectrum. This is a solar spectrum characteristic described in the “Solar Battery Handbook” (by the Electric Institution). The horizontal axis represents the wavelength element of sunlight, and the vertical axis represents the spectral radiative illuminance, i.e., the radiation intensity per 1 cm[0025] 2. Therefore, FIG. 1 shows the intensity (energy) of a radiated beam for a wavelength element. As is shown in FIG. 1, the light is roughly divided at a wavelength of 0.75 μm to 0.77 μm into a visible radiation spectrum 1 and a near-infrared radiation spectrum 2. The visible beam has a wavelength of 0.4 μm to 0.77 μm, and the near-infrared beam has a wavelength of 0.75 μm to 2.5 μm. In the wavelength area shown in FIG. 1, the light having the highest spectral radiative illuminance is a green area that has a wavelength of about 0.58 μm.
  • It is apparent from FIG. 1 that at specific wavelengths, sunlight is strongly damped (points A, B, C and D in FIG. 1). The wavelength at point A in FIG. 1 is 0.761 μm to 0.762 μm, and belongs to the [0026] visible radiation area 1. The spectral radiative illuminance at point A is substantially reduced and is near 0. This is approximately {fraction (1/10)}, or less, of the spectral radiative illuminance of the green area, and it feels dark, even in the daytime. The damping of the sunlight at point A occurs because nearby wavelengths are absorbed by the oxygen in the atmosphere. The amount that is absorbed is substantially constant, depending on the density of the oxygen in the air.
  • Points B, C and D in FIG. 1 belong to the near-infrared radiation area that human beings can not see. The wavelengths at points B, C and d are 0.934 to 0.935 μm, 1.13 μm, and 1.34 to 1.44 μm, respectively. At point B, the radiation energy is approximately ⅕, or less, of the spectral radiative illuminance in the green area. At points C and D, the damping rates are approximately 50 to 100% of the spectral radiative illuminance in the green area. The damping of the sunlight at points B, C and D occurs because nearby wavelengths are absorbed by water vapor in the air. Therefore, the amount to which sunlight is absorbed varies somewhat in consonance with the precipitable water content of the air, which normally varies, depending on climatic conditions, fluctuates within a range extending from 5 mm to 50 mm. The damping of the sunlight that occurs at points B, C and D is in proportion to the precipitable water content of the air, and the degree of damping can satisfy the above factors when the precipitable water content is at the lower limit of 5 mm. [0027]
  • The spectrum of sunlight has a feature that the spectral radiative illuminance is damped at a plurality of specific wavelengths. This means, substantially, that sunlight does not act as a disturbance at these specific wavelengths. Therefore, to detect an object, the object is irradiated with light containing the specific wavelengths at points A, B, C and D, and since an optical filter is employed that permits the passage of only these same wavelengths in reflected light, the S/N ratio in the detection process can be drastically improved. Further, in case that the object is the eyes, since a light in the wavelength containing less sunlight is irradiated to the eyes, the amount of radiation of the eyes by the emission device need not be increased, and the eyes will not be adversely affected. [0028]
  • When the object is the eyes, light having the wavelengths at points C and D can not provide satisfactory reflected retinal images because the light reflectivity of the retinas is low, but such light can provide preferable reflected corneal images. Therefore, the wavelengths at point C and D can be employed to determine the positions of eyes, but are not appropriate for the determination of the line of sight. [0029]
  • FIG. 2 is a diagram showing an [0030] object detection apparatus 10 according to one embodiment of the present invention. The object detection apparatus 10 includes a light-emitting diode (LED) 20, a pickup camera 30, an optical filter 40, and an image data processor 60.
  • The light-emitting [0031] diode 20 is a diode that emits light at a wavelength where the spectral radiative illuminance of sunlight is damped. This wavelength corresponds to a wavelength of 0.76 μm (A) in the visible radiation spectrum 1 in FIG. 1, or to a wavelength of 0.94 μm (B) in the near-infrared radiation spectrum 2. A diode having a predetermined wavelength that is available on the market is employed as the light-emitting diode 20. The object detection apparatus 10 may include only a light-emitting diode that emits light at wavelength A, or it may also include an additional diode that emits light at wavelength B, in which case the diodes may be switched in accordance with the environment in which employed. Wavelength A is ideal because at that wavelength the damping of the illuminance of sunlight is the strongest; however, as this wavelength belongs to the visible radiation spectrum, it may at a dark environment such as at night, be undesirable, since in the dark environment it appears as red. In this case, if the object detection apparatus 10 has two light-emitting diodes, the diodes can be switched in the daytime and at night to solve the above problem.
  • The [0032] pickup camera 30 is a CCD camera having a function that an image signal is generated upon the receipt of the light reflected by an object to be picked up. The optical filter 40 is located in front of the CCD and permits only specific wavelengths to pass.
  • The [0033] optical filter 40 may be applied as a coating on the surface of the CCD, or it may be a separate member that is located in front of CCD. When the object detection apparatus 10 includes two light-emitting diodes 20 having different wavelengths, two optical filters, corresponding respectively to the two wavelengths, are provided, and in use are switched in unison with their respective light-emitting diodes. Such an optical filter can be one available on the market that has a predetermined central wavelength and a predetermined half-width. In this embodiment, for example, one of the optical filters that is employed has a central wavelength of 0.76 μm and a half-width of 5 nm, while the other has a central wavelength of 0.94 μm and a half-width of 10 nm.
  • The [0034] image data processor 60 is mounted in the object detection apparatus 10 to obtain the observed point of an eye 50. Light that is projected onto the eye 50 by the light emitting diode 20 is reflected by the cornea and the retina of the eye 50. The reflected light is routed through the optical filter 40, which selects and permits only light having a wavelength of 0.76 μm to pass, and is transmitted to the pickup camera 30. The pickup camera 30 uses the received light to generate an image signal, and transmits the signal to the image data processor 60 of the object detection apparatus 10.
  • FIG. 3 is a block diagram illustrating the functional arrangement of the [0035] image data processor 60. An image signal from the pickup camera 30 is converted by an A/D converter 110 into a digital signal. The digital signal is then stored as x and y coordinate data in an image memory 120. An image extractor 130 extracts a cornea reflected image (x1, y1) and a retina reflected image (x2, y2) from the coordinate data. Then, an observed point calculator 140 determines the direction of the line of sight, based on the extracted coordinates of the reflected corneal and retinal images, and calculates the observed point.
  • A description will be given of the method used for calculating the direction of the line of sight and an observed point with reference to FIG. 4. In the above described manner, the [0036] image extractor 130 in the image data processor 60 extracts coordinates (x1, y1) of a reflected corneal image 250 and coordinates (x2, y2) of a reflected retinal image 260. The location of the pickup camera 30 is established in advance, and it is known that the size of an eye 50 of an adult is approximately constant and that the radius 230 of the eye 50 is about 4.2 mm. These data and a distance 210 from the pickup camera 30 to the eye 50 which is calculated can be used to perform a simple calculation to obtain the position of the cornea of the eye 50 and the center position of the eye 50. A vector 200 in the direction of the line of sight is calculated using the position of the cornea and the center position of the eye 50 that are obtained. An observed point 300 can be calculated from the direction of the line of sight 200 and the distance between the eye 50 and the observed point 300, and the distance to the observed point 300 can be acquired from, for example, the luminance of the retina reflected image 260.
  • As is described above, according to this embodiment, since a light-emitting diode that emits light at a wavelength at which the spectral radiative illuminance is greatly damped, and an optical filters that permits only light at such a wavelength to pass are employed to obtain a clear reflected image, the observed point of a crew member in a vehicle can be easily obtained, and the line of sight, and whether the crew member is asleep, can easily be detected. In addition, since the wavelength is changed in accordance with the environment, the state of an object can be preferably detected in accordance with the environment. [0037]
  • Further, in this embodiment, the images reflected by the eyes of a crew member in a vehicle are obtained. However, the invention is applied to a case that the state of another object can be detected by irradiating it with light having a wavelength which produces only a small disturbance and by acquiring the reflected image. For example, assuming that the object is a specific mobile member, the moving state of the specific mobile member can be detected. [0038]
  • FIG. 5 is a graph showing the spectral illuminance characteristic of the light with which a light-emitting diode irradiates the eyes of the operator of a vehicle in order to detect the operator's line of sight. The vertical axis represents the spectral illuminance at the surface of the eye, i.e., the intensity, on the surface of the eye, of the light emitted by the light-emitting diodes; and the horizontal axis represents the wavelength. In this instance the wavelengths E and B correspond to those at points E and B in FIG. 1. A [0039] curve 500 represents the spectral illuminance characteristic of the light at the surface of the eye, at point E in FIG. 1, with which a light-emitting diode having the wavelength E should irradiate the eye in order to detect the line of sight under the illuminance provided by sunlight. An area 510, which is defined by the curve 500 and the horizontal axis representing the wavelength, represents the total quantity of spectral illuminance at the eye, i.e., the illuminance on the surface of the eye, when the eye is irradiated by a light-emitting diode having wavelength E. An area 520 is the portion of the area 510 that corresponds to a half-width of 50 nm.
  • A [0040] curve 550 represents the spectral illuminance characteristic of the light at the surface of the eye, at point B in FIG. 1, with which the light-emitting diode having the wavelength B should irradiate the eye in order to detect the line of sight under the illuminance provided by sunlight. An area 560, which is defined by the curve 550 and the horizontal axis, represents the illuminance at the surface of the eye when the eye is irradiated by the light-emitting diode having the wavelength B. An area 570 is the portion of the area 560 that corresponds to a half-width of 50 nm.
  • As is apparent from the graph, the spectral illuminance characteristic of the [0041] curve 500 is greater as a whole than that of the curve 550. As is apparent from FIG. 1, since sunlight is damped less at wavelength E and acts as a disturbance, the illuminance indicated by the curve 500 is required in order to obtain the image reflected by the object. Since sunlight is strongly damped at wavelength B, the reflected image can be obtained without increasing the illuminance as for wavelength E. Following this, an explanation will be given concerning how eyes are affected in accordance with differences in the illuminances of the wavelengths.
  • FIG. 6 is a bar graph showing the illuminance characteristic of light, produced by the light-emitting diode, on the surface of the eye. The vertical axis represents the illuminance on the surface of the eye, i.e., the light intensity emitted at the eye. Wavelengths E and B along the horizontal axis correspond to wavelengths E and B in FIG. 5. A [0042] graph bar 600 shows the degree of the illuminance, which that is obtained by integrating the spectral illuminance of the curve 500 in FIG. 5, on the surface of the eye of light having wavelength E. Similarly, a graph bar 610 shows the degree of the illuminance, which is obtained by integrating the spectral illuminance of the curve 550, on the surface of the eye of light having wavelength B. An illuminance safety reference 650 is used to indicate the advisory value of 10 mW/cm2 determined at the U.S. Labor Safety Conference. The “safety factor” is the difference between the illuminance safety reference of 10 mW/cm2, which is indicated by the illuminance safety reference 650, and the illuminance on the surface of the eye.
  • As is apparent from FIG. 6, an [0043] illuminance 600 on the surface of the eye of light having wavelength E substantially reaches the illuminance safety reference 650, while an illuminance 610 on the surface of the eye of light having wavelength B is considerably below the reference 650. Therefore, the safety factor for the eye due to the light having wavelength B is high, and the safety factor due to the light having wavelength E is quite low. As is described above, when the eyes are irradiated by light having a wavelength at which sunlight is damped less, high illuminance is required to detect a signal, so that the illuminance reaches the safety reference and adversely affects the eyes. Whereas, when eyes are irradiated by light having a wavelength at which sunlight is strongly damped, the disturbance is small and high illuminance is not required, and thus, the illuminance is sufficiently below the safety reference so that it does not affect the eyes.
  • FIG. 7 is a graph showing the spectral illuminance characteristic on the light-receiving face of the CCD after light from the light-emitting diode and sunlight have passed through the optical filter. The vertical axis represents the spectral illuminance on the light-receiving face of the CCD, i.e., represents the intensity of light with which the CCD is to be irradiated. Wavelengths E and B along the horizontal axis correspond to the wavelengths at points E and B in FIG. 1. A [0044] curve 700 shows the illuminance characteristic at the CCD light-receiving face when the light from the light-emitting diode having wavelength E passes through the optical filter having transmission wavelength E. A curve 710 shows the illuminance characteristic at the CCD light-receiving face when sunlight passes through the optical filter having transmission wavelength E. A portion that is surrounded by the curve 710 and the horizontal axis (shaded portion on the left in FIG. 7) corresponds to the shaded portion at wavelength E′ for sunlight in FIG. 1. For the optical filter employed here, the central wavelength to be passed through is wavelength E and the half-width is 10 nm. An area 720 is the portion which corresponds to the half-width portion of the area defined by the curve 700 and the horizontal axis, and an area 730 corresponds to the half-width portion of the shaded portion surrounded by the curve 710.
  • A [0045] curve 750 shows the illuminance characteristic at the CCD light-receiving face when light from the light-emitting diode having wavelength B passes through the optical filter having transmission wavelength B. A curve 760 shows the illuminance characteristic at the CCD light-receiving face when sunlight passes through the optical filter having transmission wavelength B. A portion that is surrounded by the curve 760 and the horizontal axis (shaded portion on the right in FIG. 7) corresponds to the shaded portion at wavelength B′ for sunlight in FIG. 1. For the optical filter employed here, the central wavelength to be passed through is wavelength B and the half-width is 10 nm. An area 770 is the portion which corresponds to the half-width portion of the area defined by the curve 750 and the horizontal axis, and an area 780 corresponds to the half-width portion of the shaded portion defined by the curve 760.
  • FIG. 8 is a graph showing the illuminance characteristic on the light-receiving face of the CCD. The vertical axis represents the illuminance at the light-receiving face of the CCD that corresponds to the quantity of CCD charges for the hour unit. Wavelengths E and B along the horizontal axis correspond to wavelengths E and B in FIG. 7. The S/N ratio in FIG. 8 represents the difference between the illuminance of light from the light-emitting diode on the CCD light-receiving face and the illuminance of sunlight on the CCD light-receiving face. A [0046] graph bar 800 shows the results obtained by integrating the curve 700 in FIG. 7, and represents the degree of the illuminance of light that the CCD-light receiving face receives from the light-emitting diode having wavelength E via the optical filter having transmission wavelength E. A graph bar 810 shows the results obtained by integrating the curve 710 in FIG. 7, and represents the degree of the illuminance of light that the CCD-light receiving face receives from sunlight via the optical filter having transmission wavelength E. Similarly, a graph bar 850 shows the results obtained by integrating the curve 750 in FIG. 7, and represents the degree of the illuminance of light that the CCD-light receiving face receives from the light-emitting diode having wavelength B via the optical filter having transmission wavelength B. A graph bar 860 shows the results obtained by integrating the curve 760 in FIG. 7, and represents the degree of the illuminance of light that the CCD-light receiving face receives from sunlight via the optical filter having wavelength B.
  • As is apparent from FIG. 8, at wavelength E the ratio of the illuminance of sunlight to the illuminance of light emitted by the light-emitting diode is high so that sunlight acts as a disturbance and adversely affects the eyes, and as a result, the S/N ratio is quite low. That is, it is apparent that at wavelength E the S/N ratio is quite low even if the illuminance is at the limit established by the safety reference (FIG. 6). On the other hand, it is found that at wavelength B the ratio of the illuminance of sunlight to the illuminance of light emitted by the light-emitting diode is quite low so that sunlight does not act as a disturbance and does not adversely affect the eyes, and as a result, the S/N ratio is improved. That is, it is apparent that at wavelength B the S/N ratio can be considerably improved while the illuminance relative to the limit established by the safety reference (FIG. 6) is satisfactory. [0047]
  • As is described above, since sunlight is radiated at a wavelength that can be absorbed, and only light having that wavelength is permitted to pass through the optical filter, the S/N ratio can be very high. Therefore, according to the present invention, the state of an object can be detected at a high safety factor and a high S/N ratio. [0048]
  • Further, sunlight has been employed as a representative disturbance. However, even when a disturbance results from a light source other than the sun, such as the headlights of a car, a fluorescent lamp or a neon sign in a town, when light at a wavelength that is accompanied by less disturbance is employed, the state of an object can be detected at a high S/N ratio. [0049]
  • According to the present invention, since the light emission device emits light at a wavelength accompanied by less disturbance, and the light reception device receives that light though a filter, the state of an object can be preferably detected without being affected adversely by a disturbance. Further, since sunlight at a wavelength other than that used for the detection of an object is not related to the detection process, the state of an object can be preferably detected even in the daytime. [0050]
  • In addition, since clear reflected images of the corneas and retinas are obtained, the observed point viewed by a crew member can be calculated more precisely and more safely. And, since flicker due to light from the light emission device is prevented during night use, the state of an object can be satisfactorily detected without distressing the eyes of a person. [0051]
  • Since the wavelength is selected in accordance with the environment, the state of an object can be preferably detected in accordance with the environment. Further, since the wavelength is selected in accordance with the environment in the daytime and at night, the state of an object can be satisfactorily detected throughout the day. [0052]
  • The present disclosure relates to the subject matter contained in Japanese patent application No. Hei. 10-197612 filed on Jul. 13, 1998 which is expressly incorporated herein by reference in its entirety. [0053]
  • While only certain embodiments of the invention have been specifically described herein, it will apparent that numerous modifications may be made thereto without departing from the spirit and scope of the invention. [0054]

Claims (6)

What is claimed is:
1. An object detection apparatus for detecting the state of an object, comprising:
a light emission device which irradiates the object with a light at a wavelength that produces less disturbance; and
a light reception device which receives the light reflected from the object, said light reception device including a filter through which passes the light at the wavelength.
2. An object detection apparatus according to claim 1, wherein sunlight acts as the disturbance.
3. An object detection apparatus according to claim 1, wherein said object is eyes of an operator, and said object detection apparatus is mounted on a vehicle so as to obtain reflected images from the retinas and the corneas of the eyes and to thus calculate an observed point viewed by the operator.
4. An object detection apparatus according to claim 1, wherein the wavelength is a wavelength of the light in a non-visible irradiation band.
5. An object detection apparatus according to claim 1, wherein said wavelength is one of a plurality of the wavelengths producing less disturbance.
6. An object detection apparatus according to claim 5, wherein said wavelength is selected from a visible irradiation band in the daytime and from a non-visible irradiation band at night.
US09/348,700 1998-07-13 1999-07-07 Object detection apparatus Expired - Fee Related US6392539B1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP10-197612 1998-07-13
JPHEI.10-197612 1998-07-13
JP10197612A JP2000028315A (en) 1998-07-13 1998-07-13 Object detector

Publications (2)

Publication Number Publication Date
US20020036570A1 true US20020036570A1 (en) 2002-03-28
US6392539B1 US6392539B1 (en) 2002-05-21

Family

ID=16377379

Family Applications (1)

Application Number Title Priority Date Filing Date
US09/348,700 Expired - Fee Related US6392539B1 (en) 1998-07-13 1999-07-07 Object detection apparatus

Country Status (2)

Country Link
US (1) US6392539B1 (en)
JP (1) JP2000028315A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2849627A1 (en) * 2003-01-03 2004-07-09 Daniel Kolodziej Sun-visor display device for vehicle e.g. automobile, has motorized mechanism moving display device and includes gear motor in motor compartment, where mechanism is charged to transmit and adapt rotating movement of motor
FR2910150A1 (en) * 2006-12-15 2008-06-20 Sagem Defense Securite Iris image capturing method for individual identification, involves selecting wavelength of infrared radiation source of lighting unit for showing pattern of iris during capturing of image of iris, for individual
WO2010035046A1 (en) * 2008-09-26 2010-04-01 Cybula Ltd Image recognition
CN113566960A (en) * 2020-04-28 2021-10-29 广东博智林机器人有限公司 Configuration method and system of visual sensor, electronic device and medium

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2375530A1 (en) * 1999-06-23 2000-12-28 Patrick Toomey Water detection and source identification methods for structures using electromagnetic radiation spectroscopy
US6685317B2 (en) * 2000-06-13 2004-02-03 Massie Research Laboratories, Inc. Digital eye camera
JP2002352229A (en) * 2001-05-30 2002-12-06 Mitsubishi Electric Corp Face region detector
US7199767B2 (en) * 2002-03-07 2007-04-03 Yechezkal Evan Spero Enhanced vision for driving
DE102004010725A1 (en) * 2004-02-27 2005-10-06 Technische Universität Ilmenau Abteilung Forschungsförderung und Technologietransfer Image optimizing device for optimizing color shots taken with an image-capture unit detects reflected/transmitted light with an electronic camera
US7231288B2 (en) * 2005-03-15 2007-06-12 Visteon Global Technologies, Inc. System to determine distance to a lead vehicle
JP2007316036A (en) * 2006-05-29 2007-12-06 Honda Motor Co Ltd Occupant detector for vehicle
FR2909182B1 (en) * 2006-11-28 2011-06-24 Compagnie Ind Des Lasers Cilas METHOD AND DEVICE FOR DETECTING AN OBJECT CAPABLE OF RETROREFLECTING LIGHT
JP4915314B2 (en) * 2007-08-23 2012-04-11 オムロン株式会社 Imaging apparatus and imaging control method
JP2010066182A (en) * 2008-09-12 2010-03-25 Nikon Corp Shape measuring apparatus
US8760631B2 (en) * 2010-01-27 2014-06-24 Intersil Americas Inc. Distance sensing by IQ domain differentiation of time of flight (TOF) measurements
JP5378614B2 (en) * 2013-01-07 2013-12-25 株式会社日立ソリューションズ Coordinate detection device
JP6399538B2 (en) * 2014-05-13 2018-10-03 リコーインダストリアルソリューションズ株式会社 Laser radar equipment
JP6320315B2 (en) * 2015-02-06 2018-05-09 三菱電機株式会社 Mobile imaging device
US20190141264A1 (en) * 2016-05-25 2019-05-09 Mtekvision Co., Ltd. Driver's eye position detecting device and method, imaging device having image sensor with rolling shutter driving system, and illumination control method thereof
US20190012552A1 (en) * 2017-07-06 2019-01-10 Yves Lambert Hidden driver monitoring
JP7078386B2 (en) * 2017-12-07 2022-05-31 矢崎総業株式会社 Image processing equipment

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS54146682A (en) * 1978-05-08 1979-11-16 Murata Manufacturing Co Infrared ray detector
US4867561A (en) * 1986-08-22 1989-09-19 Nippondenso Co., Ltd. Apparatus for optically detecting an extraneous matter on a translucent shield
US4874938A (en) * 1988-03-16 1989-10-17 Prospects Corp. Automatic motor vehicle visor system
US5402109A (en) * 1993-04-29 1995-03-28 Mannik; Kallis H. Sleep prevention device for automobile drivers
JPH0735543A (en) 1993-07-20 1995-02-07 Nissan Motor Co Ltd Eye point measuring device for vehicle
JP3214195B2 (en) 1993-11-11 2001-10-02 三菱電機株式会社 Driver photography device
JP3296119B2 (en) 1994-12-01 2002-06-24 日産自動車株式会社 Gaze direction measuring device for vehicles
US5635905A (en) * 1995-02-02 1997-06-03 Blackburn; Ronald E. System for detecting the presence of an observer
US5689241A (en) * 1995-04-24 1997-11-18 Clarke, Sr.; James Russell Sleep detection and driver alert apparatus
US5682144A (en) * 1995-11-20 1997-10-28 Mannik; Kallis Hans Eye actuated sleep prevention devices and other eye controlled devices
US5895910A (en) * 1996-04-11 1999-04-20 Fmc Corporation Electro-optic apparatus for imaging objects

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2849627A1 (en) * 2003-01-03 2004-07-09 Daniel Kolodziej Sun-visor display device for vehicle e.g. automobile, has motorized mechanism moving display device and includes gear motor in motor compartment, where mechanism is charged to transmit and adapt rotating movement of motor
FR2910150A1 (en) * 2006-12-15 2008-06-20 Sagem Defense Securite Iris image capturing method for individual identification, involves selecting wavelength of infrared radiation source of lighting unit for showing pattern of iris during capturing of image of iris, for individual
WO2010035046A1 (en) * 2008-09-26 2010-04-01 Cybula Ltd Image recognition
CN113566960A (en) * 2020-04-28 2021-10-29 广东博智林机器人有限公司 Configuration method and system of visual sensor, electronic device and medium

Also Published As

Publication number Publication date
US6392539B1 (en) 2002-05-21
JP2000028315A (en) 2000-01-28

Similar Documents

Publication Publication Date Title
US6392539B1 (en) Object detection apparatus
US11645856B2 (en) Vehicular driver monitoring system
CN103907011B (en) Attachment detector and vehicle equipment control device
US6919548B2 (en) control system to automatically control vehicle headlamps
US7015944B2 (en) Device for improving visibility in vehicles
US7330124B2 (en) Image capturing apparatus and monitoring apparatus for vehicle driver
EP1653248A1 (en) Actively-illuminating optical sensing system for an automobile
JP2001524703A (en) Method and apparatus for illuminating and imaging eyes through glasses using multiple light sources
JP2005136952A (en) Infrared night vision system in color
JP2002513176A (en) Apparatus and method for monitoring a subject's eye using two different wavelengths of light
CN105034929A (en) Irradiation apparatus
WO2008099146A1 (en) Method and apparatus for counting vehicle occupants
US8319953B2 (en) Method and device for spectrally detecting presence of blood
CN107092885B (en) Linear light source finger vein image acquisition device and acquisition method thereof
JP3296119B2 (en) Gaze direction measuring device for vehicles
US20220050202A1 (en) Flight time sensor and surveillance system comprising such a sensor
WO2005119571A1 (en) Imaging apparatus and method for vehicle occupant determination
CN116184661A (en) Eye tracking device and intelligent glasses
US20240123931A1 (en) Method and device for performing a checking of a person by means of infrared radiation as well as a motor vehicle having said device
WO2022014416A1 (en) Gating camera, vehicle sensing system, and vehicle lamp
JP2005017863A (en) Apparatus and method for photography
CA2354093C (en) Control system to automatically dim vehicle head lamps
CN111641786A (en) Method for improving snapshot imaging effect
KR20200073038A (en) lamp system for vehicle
JPH05288514A (en) Detecting method for obstacle on restriction boundary of building

Legal Events

Date Code Title Description
AS Assignment

Owner name: HONDA GIKEN KOGYO KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SANASUGI, KATSUMI;REEL/FRAME:010090/0287

Effective date: 19990629

AS Assignment

Owner name: HONDA GIKEN KOGYO KABUSHIKI KAISHA, JAPAN

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE NAME OF THE ASSIGNOR, FILED ON 07/07/99, PREVIOUSLY RECORDED ON REEL 10090 FRAME 0287;ASSIGNOR:KANASUGI, KATSUMI;REEL/FRAME:010966/0749

Effective date: 19990629

FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees
STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20140521