WO2001049526A1

WO2001049526A1 - System and method for vision enhancement in a vehicle

Info

Publication number: WO2001049526A1
Application number: PCT/US2001/000436
Authority: WO
Inventors: Larry E. Mathias; Paul R. Amos; Jonathan Peter Cansfield; Eugene J. Sobieski
Original assignee: Johnson Controls Technology Company
Priority date: 2000-01-06
Filing date: 2001-01-08
Publication date: 2001-07-12
Also published as: EP1244572A1; EP1244571A1; WO2001049527A1

Abstract

A vision enhancement system for a vehicle includes a camera (22) and a display (20). The camera (22) and display (20) are coupled to an interior of the vehicle. The camera (22) is configured to view the interior of the vehicle and to generate a video signal representative of the interior of the vehicle. The display (20) is coupled to the interior of the vehicle and coupled to the camera (22). The display (20) is configured to display the video signal.

Description

TITLE OF THE INVEN TION

SYSTEM AND METHOD FOR VISION ENHANCEMENT IN A VEHICLE

CROSS-REFERENCE TO RELATED APPLICATIONS Not Applicable.

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT Not Applicable.

FIELD OF THE INVENTION

The present invention relates to a vision enhancement system and method for a vehicle, and more particularly, to a vision enhancement system incorporating single or multiple video inputs generated by single or multiple cameras that may include an interior camera, such as, a rear passenger camera, and a camera for viewing the rear of the vehicle.

BACKGROUND OF THE INVENTION Rearview and sideview mirror systems are widely used in motor vehicles, such as cars and trucks, to enable the driver to view the rear or side of the vehicle and to monitor the activities of passengers, such as children in the rear seat of a vehicle. Traditionally, rearview mirrors and sideview mirrors are located on the inside of the front windshield and on the sides of a vehicle. All such rearview mirrors and sideview mirrors include a blind spot where the driver cannot accurately view a portion of the area around the vehicle, necessitating the driver to turn his/her head to view the rear portion of the vehicle. Furthermore, in many instances where children are located in the rear seat of a vehicle, it is difficult to monitor the children using a rearview mirror, especially since the rearview mirror has been adjusted for driving and not for viewing the rear seat of a vehicle. In a situation where children are located in the rear seat of a vehicle, a driver must turn his/her head to monitor the behavior of the children. In most traffic conditions, driving a vehicle while trying to view the rear of a vehicle is an awkward task.

Accordingly, there is a need for a rearview vision system that is easily accessed by the driver of a vehicle and can be switched between multiple perspectives of difficult viewing areas in and around a vehicle. Furthermore, there is a need for system and method for viewing the interior of a vehicle to monitor children or other activities within the vehicle. Further still, there is a need for a system and method for improving the quality, visibility, or perspective of images displayed by such systems. Further yet, there is a need for a system and method for improving both audio and visual communication between a front seat passenger and a rear seat passenger in a vehicle. There is also a need for providing convenient and easy-to-use operator controls for such systems. There is also a need for an improved vehicle camera system to provide images of areas in and around the vehicle. The teachings hereinbelow extend to those embodiments which fall within the scope of the appended claims, regardless of whether they accomplish one or more of the above-mentioned needs.

SUMMARY OF THE INVENTION

According to one exemplary embodiment, a vision enhancement system for a vehicle includes a camera and a display. The camera is coupled to the interior of the vehicle and is configured to view the interior of the vehicle and to generate a video signal representative of the interior of the vehicle. The display is coupled to the interior of the vehicle and coupled to the camera. The display is configured to display the video signal. According to another exemplary embodiment, a vision enhancement system for a vehicle includes a camera, a display, and a light source. The camera is configured to view an area of the vehicle interior and to generate a video signal representative of the area of the vehicle interior. The display is coupled to the camera and is configured to display the video signal. The light source is positioned proximate the area of the vehicle interior configured to illuminate the area.

According to yet another exemplary embodiment, an integrated audio/visual system for a vehicle includes a vision enhancement system, an audio system, and an operator input device. The vehicle has an interior, and the interior has a front seat and a rear seat. The vision enhancement system includes a camera and a display. The camera is coupled to the interior of the vehicle and is configured to view the interior of the vehicle and to generate a video signal representative of the interior of the vehicle. The display is coupled to the camera and is configured to display the video signal. The audio system is configured to provide an audio signal between a passenger in the front seat and a passenger in the rear seat. An operator input device is coupled to the display and the audio system. The vision enhancement system and the audio system are activated in response to operator input at the operator input device.

According to still another exemplary embodiment, a vision enhancement system for a vehicle includes first and second cameras, a display, and a switch. The first camera is configured to view the interior of the vehicle and to generate a first video signal representative of the inferior of the vehicle. The second camera is configured to view the exterior of the vehicle and to generate a second video signal representative of the exterior of the vehicle. The switch is coupled to the first and second cameras and to the display. The switch is configured to receive the first and second video signals and to selectively provide the first and second video signals to the display. According to another exemplary embodiment, a vision enhancement system for a vehicle includes a rearview camera, a display, and operator input device, and a light source. The rearview camera is configured to generate a video signal representative of an area proximate the rear of the vehicle. The display is coupled to the interior of the vehicle. The light source is coupled to the operator input device and is configured to provide illumination to the area proximate the rear of the vehicle in response to actuation of the operator input device.

According to another exemplary embodiment, a vehicle camera system for a vision enhancement system includes a housing, a camera, and a light source. The camera and light source are both disposed at least partially in the housing. The camera is configured to generate a video signal representative of an area proximate the rear of the vehicle. The light source is configured to provide illumination to the area proximate the rear of the vehicle.

According to another exemplary embodiment, a vision system which incorporates a video display receives video image signals from cameras viewing the interior of a vehicle and cameras viewing the exterior of a vehicle. The video display is placed in an easy to view position with reference to the forward viewing perspective of a driver such that he/she is able to view the video display without significant disruption in operation of the vehicle. In one exemplary embodiment, the video display and controls are incorporated in a bezel mounted in the roof or headliner of a vehicle. The bezel may be mounted in the forward area of a vehicle cabin such as in a position directly above a rearview mirror. The bezel may further include a video camera positioned to view the rear seats of a vehicle. According to another exemplary embodiment, the video system includes a control interface mounted in the bezel which allows the video display and video inputs to be easily switched by the driver of the vehicle. Light sources remote or proximate the cameras allow dark areas to be illuminated when the driver of a vehicle has switched to a camera viewing the dark areas. For example, when the video display is switched to a camera viewing the rear of the vehicle in a dark or low light condition, a light on the rear of the vehicle will illuminate the area being viewed by the camera. Furthermore, when the video display is switched to the rear seat camera a light positioned proximate the rear seat will automatically illuminate the rear seat.

According to another exemplary embodiment, an audio system is included to allow communication between the driver and passengers in the rear seats of a vehicle. The audio system includes a microphone which responds to the voice of the driver and generates an audio signal. When audio input to the microphone is detected, the audio system will attenuate the signal on the front speakers of a vehicle and switch the rear speakers to the audio signal from the microphone. In this manner, the driver may be clearly heard and understood by passengers in the rear seat of a vehicle.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will become more fully understood from the following detailed description, taken in conjunction with the accompanying drawings, wherein like reference numerals refer to like parts, in which:

Figure 1 is a cutaway perspective view of a vehicle including a video system according to an exemplary embodiment; Figure 2 is an overhead view of a vehicle including the video system of Figure 1 ;

Figure 3 is a diagrammatic view of a video control panel according to an exemplary embodiment;

Figure 4 is a diagrammatic view of an overhead light positioned over a rear seat according to an exemplary embodiment; and

Figures 5-7 are views of a vehicle camera system equipped with lights and a video camera according to an exemplary embodiment.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Referring to Figure 1 , 2, and 3, in accordance with a first embodiment of the present invention, a vehicle 1 0 is shown equipped with a video system or vision enhancement system 1 2. Vehicle 1 0 may be a car, truck, or other vehicle. The vehicle 1 0 has a rear 6, an interior 7 and an exterior 8, wherein the interior includes front seats 9, rear seats 1 1 , and a chimsel 1 3. Vehicle exterior 8 generally refers to areas surrounding vehicle interior 7 and/or the exterior surfaces of vehicle 1 0.

The video system 1 2 includes a video control panel 14, one or more lights 1 6 (e.g., rear seat lights), and a camera unit 1 8 (e.g., a rearview camera unit) . The video control panel 14 is preferably mounted in the vehicle 1 0 cabin in a bezel 1 7 attached to the roof of the vehicle 1 0; thus, control panel 1 4 is mounted in the forward viewing perspective of a driver. The video control panel 1 4 includes a video display 20 that may be switched from a video input or signal provided by a camera 22 viewing the vehicle interior 7

(e.g., the rear seats 1 1 , other portions of the vehicle interior, etc.) of the vehicle 10 and a video signal provided by the rearview camera unit 1 8 or another camera unit which views exterior 8 of the vehicle. The video display 20, because of its ergonomic positioning, allows the driver or other front seat passenger of a vehicle to easily view the video display 20 while driving.

An operator input device 24 (e.g., button, switch, dial, clickable icon on display 20, etc.) activates the video display 20 into a default mode wherein the video display 20 receives and displays the video signal from the rearview camera 1 8. In the preferred embodiment, the video display 20 is a liquid crystal display ("LCD") with the ability to display analog or digital video inputs, although any video display (e.g., a light-emitting diode (LED) display, a cathode ray tube (CRT), etc.) is considered within the scope of this invention . Thus, cameras 1 8 and 22 may be any type of digital or analog camera. Video display 20 may be any shape, such as square, rectangular, or elliptical, and may have a surface area of between 8.75 in² and 1 2 in² or other sizes. Furthermore, the video display 20, in alternate embodiments, may also be electronically configured or reconfigured to display vehicle operation and/or trip data from an onboard controller or ccmputer such as mileage, compass heading, tire pressure, fuel efficiency data, outside/inside temperature, etc., but is not limited to such. Such data may be received from sensors 5 positioned at various locations on the vehicle, and may be received via a wired or wireless connection (e.g., radio frequency, infrared, etc.) .

As seen in Figures 1 -4, the rear seat lights 1 6 are mounted to the roof of the vehicle 1 0 proximate the sides of the ιo vehicle 1 0 and provide ambient light to the rear seats 1 1 of the vehicle 1 0 to allow the rear seat camera 22 to provide a well- illuminated picture of the rear seats 1 1 in low light conditions. Alternatively, lights 1 6 may be mounted anywhere on vehicle 1 0, and may be configured to provide illumination to any area of vehicle i s interior 7 to be viewed by camera 22. Lights 1 6 may be mounted alone or in a housing or bezel containing one or more of lights 1 6, a rear speaker for an audio system, a coat hook, and a task light or map light. Lights 1 6, the rear speaker, and the task light may further have ON/OFF switches associated therewith.

20 In one embodiment, at least one of the rear seat lights

1 6 will be automatically turned on when the rear seat camera 22 is switched on using the button 24, but any number or combination of lights 1 6 switched on is considered within the scope of the present invention. Further, at least one of rear seat lights 1 6 may be

25 automatically switched off when the rear seat camera 22 is switched off using button 24. A manual override control comprising a pushbutton dial 26 will allow the driver to turn the rear seat lights 1 6 on and off by pushing the pushbutton dial 26 and will allow the driver to adjust the amount of light generated by the rear seat light by dialing the pushbutton dial 26. In further embodiments, a light sensor may be used to disable the automatic operation of the rear seat light 1 6 during daylight or high light conditions. The light sensor may include a light sensor circuit comprising the necessary analog or digital logic, software code, etc. to perform the operation of disabling the automatic operation of rear seat light 1 6.

Lights 1 6 may include any type of light source, such as fluorescent bulbs, incandescent bulbs, infrared, ultraviolet, a sconce light, an LED, etc. Lights 1 6 preferably provide a light source easily detectable by camera 22. According to one advantageous feature, the light source provides light in the infrared range. Since infrared light is not visible light, passengers in the rear seats 1 1 , such as children, will not be disturbed or awakened by the presence of the light. Since camera 22 may be configured to detect infrared light, the video signals provided by camera 22 will result in enhanced, easy-to-view images.

As illustrated in Figure 3, video control panel 1 4 includes camera 22 and display 20 mounted in the same bezel or other housing 1 7. By mounting camera 22 in a forward viewing perspective of the driver of the vehicle, or otherwise in the front of the vehicle, the view of rear seats 1 1 has a better picture quality (e.g., angle) than if camera 22 were mounted closer to seats 1 1 . Also, since video control panel 1 4 is mounted in the roof or headliner in this exemplary embodiment, the video display 20 and microphone 38 are closer to the front seat passengers, such as the driver, for ease of use and clarity of sound.

Referring to Figures 1 , 2, and 5-7, the rearview camera unit 1 8 is mounted at least partially in a housing 1 3 (e.g., a chimsel) to provide images below the sightline of a rearview mirror or images normally out of sight of a driver looking towards the rear of the vehicle 1 0. A chimsel or CHMSL (Center High Mounted Stop Lamp) is a brake light housing mounted to a vehicle in or near an area of the forward visual field toward which a following driver most often glances. The chimsel 1 3 includes brake lights and the necessary electrical connections to operate the brake lights and the rearview camera unit 1 8. Advantageously, the rearview camera unit 1 8 is fully integrated to or fully contained within the chimsel 1 3 to have an aesthetically appealing physical configuration free of unsightly protrusions normally found in traditional vehicle camera systems.

The rearview camera unit 1 8 provides video signals that detail the rear area of the vehicle 10. Many objects such as bikes, pets or toys may lie hidden directly below the back of the vehicle 1 0, producing a situation where the driver may back the vehicle 10 onto such objects. The rearview camera unit 1 8 enables the driver to view these previously hidden areas or blind spots to avoid such an occurrence. In the preferred embodiment of the present invention, the video signal of the rearview camera unit 1 8 will automatically be displayed on the video display 20 when the vehicle 1 0 is placed in reverse via a gearshift lever or other suitable operator input device. The rearview camera unit 1 8 includes one or more rear lights 28 to illuminate the rear of the vehicle 10 with light directed at the hidden areas or blind spots. Rear lights 28 may include any type of light source, such as fluorescent bulbs, incandescent bulbs, infrared, ultraviolet, sconce lights, LEDs, etc. Lights 28 preferably provide a light source easily detectable by camera 1 8. The rear lights 28 will be automatically switched on when the vehicle 1 0 is placed in reverse but may be manually overridden and adjusted by pushbutton dial 30. A light sensor may also be included to disable the rear lights 28 in daylight or in a high light condition. The rearview camera unit 1 8 further includes a lens 32 to slightly diffuse the light generated by rear lights 28 to allow greater illumination of the rear of the vehicle 1 0. An aperture or window 34 is formed in the lens 32 to allow the rear camera unit 1 8 to bypass the interference of the lens 32.

Referring to Figures 1 and 3, the video control panel 1 4 includes various other controls or operator input devices such as an audio system control or input device 36 and a microphone 38. Upon activation of the audio system control 36, audio input generated by a driver or front passenger to the microphone 38 will be measured and compared to a threshold level using a microcontroller or microprocessor. If the audio input is greater than the threshold level, then audio output to front speakers 40 mounted in the vehicle 1 0 (e.g., from a radio, CD player, or other audio system) will be attenuated (the volume will be reduced) and the audio input to the microphone 38 will be switched to rear speakers 42 mounted in the vehicle 1 0. In this manner, the voice of a driver will be easily heard by passengers seated in the rear seats 1 1 of the vehicle 1 0, via microphone 38 and rear speakers 42.

According to another embodiment, an integrated audio/visual system is provided. A vision enhancement system in one or more of the above-mentioned embodiments is integrated with an audio system. The vision enhancement system includes camera 22, display 20, and an operator input device, such as audio system control 36 or microphone 38. In response to operator input (e.g ., a button press, oral command, etc.), the vision enhancement system and the audio system are both activated. For example, camera 22 may begin providing video signals to generate an image on display 20, and microphone 38 may begin transmitting audible signals from a passenger in the front seat to a passenger in the rear seat, or vice- versa, via front- or rear-mounted speakers. Rear-mounted speakers may be provided near lights 1 6 or in another location near rear seats

5 1 1 . In this integrated audio/visual system, a single operator input may activate both a video system and an audio system to allow communication between a front seat passenger and a rear seat passenger. Alternatively, if one of the video and audio systems is already activated, the single operator input may activate the other of ιo the video and audio systems. Further, a single operator input may deactivate both the video and audio systems. The activation and deactivation may occur substantially simultaneously.

While the exemplary embodiments illustrated in the Figures and described above are presently preferred, it should be i s understood that these embodiments are offered by way of example only. For example, while the cameras, speakers, lights and operator input devices are coupled to various portions of the vehicle, alternative locations for these elements are contemplated. Further, the materials and structures shown and described herein may be

20 replaced with other suitable materials and structures. Accordingly, the present invention is not limited to a particular embodiment, but extends to various modifications that nevertheless fall within the scope of the appended claims.

Claims

WHAT IS CLAIMED IS:

1 1 . A vision enhancement system for a vehicle, the vehicle having an interior, comprising: a camera coupled to the interior of the vehicle configured to view the interior of the vehicle and to generate a video

5 signal representative of the interior of the vehicle; and a display coupled to the interior of the vehicle and

7 coupled to the camera, wherein the display is configured to display

8 the video signal.

1 2. The vision enhancement system of claim 1 , further

2 comprising a video control panel housing the camera and the display.

1 3. The vision enhancement system of claim 2, wherein the

2 video control panel is positioned in a forward viewing perspective of

3 a driver of the vehicle.

1 4. The vision enhancement system of claim 3, wherein the

2 video control panel mounted in the roof or headliner of the vehicle.

ι 5. The vision enhancement system of claim 1 , wherein the

2 camera is configured to view a rear seat of the vehicle.

1 6. The vision enhancement system of claim 1 , further

2 comprising a computer coupled to the display configured to provide

3 operation data to the display.

ι 7. The vision enhancement system of claim 6, wherein the

2 operation data includes a compass heading.

ι 8. The vision enhancement system of claim 1 , further

2 comprising an operator input device coupled to the display, wherein the display is configured to display the video signal in response to operator actuation of the operator input device.

1 9. A vision enhancement system for a vehicle, the vehicle

2 having an interior, comprising:

3 a camera configured to view an area of the vehicle

4 interior and to generate a video signal representative of the area of

5 the vehicle interior;

6 a display coupled to the camera, wherein the display is

7 configured to display the video signal; and

8 a light source positioned proximate the area of the

9 vehicle interior configured to illuminate the area.

ι 1 0. The vision enhancement system of claim 9, wherein the

2 area includes a rear seat of the vehicle.

ι 1 1 . The vision enhancement system of claim 9, further

2 comprising an operator input device coupled to the display, wherein

3 the display is configured to display the video signal in response to

4 operator actuation of the operator input device.

1 1 2. The vision enhancement system of claim 1 1 , wherein

2 the light source is coupled to the operator input device and wherein

3 the light source is automatically turned on when the camera is

4 switched on using the operator input device.

1 1 3. The vision enhancement system of claim 1 1 , further

2 comprising a second operator input device configured to turn the

3 light source on and off in response to operator actuation of the

4 operator input device.

1 14. The vision enhancement system of claim 9, wherein the

2 light source is mounted to a roof of the vehicle proximate a side of

3 the vehicle.

1 5. The vision enhancement system of claim 9, wherein the light source provides illumination in the infrared range.

₁ 1 6. An integrated audio/visual system for a vehicle having

2 an interior, the interior having a front seat and a rear seat,

3 comprising:

₄ a vision enhancement system including :

5 a camera coupled to the interior of the vehicle

6 configured to view the interior of the vehicle and to generate a video

7 signal representative of the interior of the vehicle; and

8 a display coupled to the camera, wherein the display is

9 configured to display the video signal; ιo an audio system configured to provide an audio signal ι ι between a passenger in the front seat and a passenger in the rear

12 seat; and

13 an operator input device coupled to the display and the

14 audio system, wherein the vision enhancement system and the audio

15 system are activated in response to operator input at the operator

16 input device.

1 1 7. The integrated audio/visual system of claim 1 6, wherein

2 the operator input device is a button or switch and the operator

3 input is a manual actuation of the button or switch.

1 1 8. The integrated audio/visual system of claim 1 7, wherein

2 the operator input device is a microphone and the operator input is

3 an oral command, whereby the vision enhancement system and the

4 audio system are voice activated.

1 1 9. The integrated audio/visual system of claim 1 6, wherein

2 when only one of the vision enhancement system and audio system

3 are already activated when the operator input is provided, the other 4 of the vision enhancement system and audio system is activated in

5 response to the operator input.

ι 20. The integrated audio/visual system of claim 1 6, wherein

2 the visual enhancement system is activated by providing an image of

3 the vehicle interior on the display.

ι 21 . The integrated audio/visual system of claim 1 6, wherein

2 the audio system is activated by transmitting audible signals from

3 the passenger in the front seat to the passenger in the rear seat, or

4 vice-versa.

1 22. The integrated audio/visual system of claim 1 6, wherein

2 the camera is configured to view a rear seat of the vehicle.

1 23. The integrated audio/visual system of claim 1 6, wherein

2 the audio system includes a microphone mounted near the passenger

3 in the front seat and a rear speaker mounted near the passenger in

4 the rear seat.