APPARATUS FOR IMAGE PROJECTION
CROSS-REFERENCE TO RELATED APPLICATIONS
[ 0001] This application claims the benefit of priority of U.S. Provisional Application, No. 60/333,266, filed November 6, 2001 entitled "APPARATUS FOR PROJECTION DISPLAY", and is incorporated herein by leference m its entirety
[ 0002 ] This application claims the benefit of pnonty of U.S. provisional Application, No 60/333,178, filed November 6, 2001 entitled "APPARATUS FOR AGE PROJECTION", and is incorporated herein by reference in its entirety
TECHNICAL FIELD
[ 0003 ] The present invention I elates to portable projection devices Specifically, the present invention relates to portable projection devices operable to display images.
BACKGROUND OF THE INVENTION
[0004] Business and other functions are moving to a mobile paradigm. With the expanding use of portable computing devices and portable devices include laptops, cellular phones, and PDAs, among others, many typical portable display and portable projection devices are available. However, typical display technologies are cumbersome, have low quality, and have a high powei consumption. [0005] Many typical projection devices are large projection devices designed to be connected to a computer, often a desktop computer With the proliferation of laptop computers, the market has expanded as the projection devices became more portable Recently, vendors have developed devices that enable a PDA, such as a Palm or Pocket PC device, to be connected to a projector and drive a presentation, eliminating the need for a laptop computer. Likewise, many high-end projectors include the ability to store and display Powerpomt files without an external device. The typical user of these projectors is the corporate user for the presentation purposes, but the market is expanding to home theatre, specialty displays, and training simulation applications.
[0006] Display projection systems aie typically large, heavy and power hungry devices. They require high-power and high-temperature light sources to work This means they also requne significant cooling and power supplies Also, current devices require fairly complex optics to focus and manipulate the display for "keystone correction" and zoom, among other features. Manual correction of the display is required to accommodate environmental issues. Typical devices are shrinking through the use of smaller components, but essentially the technologies used are old. The problems of high-power, large size, durability, and usability remain. These typical display technologies include CRTs, LCDs, Plasma Displays, and Light Valve or DLP® Proj ectors .
[ 0007 ] Many typical portable projectors are the size of a large laptop m width and depth but often twice the height of many typical laptops One typical unit is 1.9"h x 9" x 7" weighing 2 9 pounds This
devise is based on the Tl DLP® (Digital Light Processor) technology, outputs 800 ANSI Lumens (a measure of display bπghtness), and supports XGA (1024x768) resolution. Many typical products range m price from $3000 to $10000 depending on features, brightness, and resolution. [0008] Size and weight reductions are limited utilizing current technology. Fragile, power hungry, and expensive bulbs are required to be precisely assembled with precision optical components to make current devices. This keeps manufacturing costs high and margins low. The current devices are relegated to special use and only one or two per location are owned by a typical business Although somewhat portable at 3 pounds, the current devices require bulb replacements every 200 or so hours of use at a cost of $200-$300 [ 0009 ] Often, projector brightness is measured ANSI Lumens, hi projector specification sheets this measurement is labeled "brightness" but technically is a measure of fummant power Lumens are a measure of the quantity of light, not illumination or brightness To determine brightness, the number of lumens are divided by the area to get Lumens/sq ft [ 0010 ] The specification for ANSI lumen measurement of projectors is independent of projected image size, and uses measurement from nine points around the screen to come up with an average value. Many typical display projectors are rated at between 800-1100 ANSI Lumens [ 0011] In contrast, a typical television picture has a brightness of about 20-30 Lumens/sq.ft. Comparison to an 800 ANSI lumen projector depends on the size of the displayed image Remember, to get the brightness we divide the lumens latmg by the display area An 800 lumen projector is about as bright as a typical TV for a display size of 7 1/2 feet assuming that the screen is not absorbing too much light
[0012] The brightness of a typical 800 lumen proj ector on a screen to create a 7 1/2 ft diagonal image (which covers 27 sq ft ) is 30 lumens/sq ft (dividing 800 lumens by 27 sq. ft ) For a larger display, the image is less bright For example, a 10 ft diagonal size image (covers 48 sq. ft.), the same projector will have a brightness of 17 lumens/sq ft (800/48=17)
[ 0013] Many typical proj ectors are either LCD (Liquid-Crystal-Display) or DLP® (Digital Light Processor) projectors Both type projectors use a high-intensity lamp that burns at a constant brightness Each pixel of the LCD panels inside acts as a tiny shutter to block some of that light and vary the brightness on the screen DLP® projectors have an array of the tiny mirrors and the light is either aimed through the lens onto the screen or aimed at a black "light sink" in the projector to absorb the unneeded light. Whether one pixel or all pixels are transmitting maximum hght the bulb bnghtness will not vary. (Because the LCD Pixels cannot completely block the light, and DLP® projectors leak light even when the pixel's muror is pointing toward the light sink, both types of piojectors typically produce a less than perfect black ) [ 0014] A lOO W light bulb puts out only 5-7 W of visible light, the rest of the energy is wasted m heat The 100W bulb emits the equivalent of about 800 lumens, but a projector that outputs 800 lumens typically requires a 250 W bulb. This is because the bulb outputs light in all directions. Imperfections
in the reflector, leakage of light, and the light absorbed going through the LCD panel and the lenses waste about half of the luminous intensity before it leaves the projector. Also, some light is lost dispersion as it crosses the loom to the screen Getting the light from the bulb to the screen wastes a lot of energy. [0015] To get a very "white" color from a bulb the filament must operate at a high temperature which requires higher voltages and a much larger power supply. This also increases the power lost as heat.
[ 001 S ] The difference between many typical projectors and many typical televisions is the projection method In a television CRT (Cathode-Ray-Tube), light is created by a focused beam of electrons hitting the phosphor on the inside of its face. The beam illuminates a very small point and moves that point rapidly across the faces from left to right, top to bottom until it covers the whole surface. This takes place rapidly so the eye doesn't notice and sees the picture as one solid image. [0017] The electron beam intensity is varied as needed to change the brightness of the dot The primary limitation of brightness in a CRT is its maximum beam current The average power required to create a complete picture is much lower If only 10% of the screen needs to be at maximum brightness, then maximum power is required for only 10% of the time For a scanning type display two measurements are needed, aveiage power (the equivalent to ANSI lumens) and peak power. The average power can be much lower for the same quality picture because it is rarely required that the whole screen be white. [ 0018] There are CRT based proj ectors, which typically use 3 very bright CRTs, focused through lenses to project an image. However, they are heavy and large. CRTs are sometimes still used for reai- projection TVs. The peak to average (ANSI) lumens ratio of CRT projectors is typically five to one For example, a 160 ANSI lumen lated CRT projector will have over 800 peak lumens Since CRTs can completely cut off the beam current, CRTs can provide a perfect black level. A clean black is just as important to picture quality as a bright white. Because of the basic difference, a CRT projector with a typical, 160-lumen ANSI brightness and 800-plus peak brightness, will actually look brighter than an LCD projector rated at 800 lumens
[0019] Early computer monitors (green screens) could not scan the number of lines required often enough, (at a high-enough refresh late) so they had phosphors with more persistence, (i.e they glowed longer after the electron beam hit them.) High persistence phosphors were required to overcome limitations of the electronics and are designed to improve display quality when the device cannot scan fast enough.
[0020] All phosphors have some persistence, which is unavoidable Paradoxically, as display electronics got faster and could drive the beam more quickly (l e higher refresh rates), CRT manufacturers have had to work to minimize the persistence of the phosphors in CRTs. Computer monitors have increasingly used lower persistence phosphors at higher refresh rates so they get less image flicker and cπsper images of moving pictures like video.
[0021] In addition to the display issues, connection to devices may prove problematic Typical display devices for laptops use connections that are not available for other portable computing devices. Cross compatibility is limited and multiple display devices must be used for multiple portable devices. [0022 ] These problems persist in many display arenas including heads-up displays, gauge displays, rear projection televisions, front projection televisions, computer monitors, cell phone screens, PDA screens, portable projection devices, and photocopier imaging, among others As such, this solution may be applied to a variety of display applications
[0023 ] As such, many typical display devices suffer from the display capabilities, interface formats, and portability Further, many typical displays are bulky, heavy, expensive, high power consumers, high heat producers, mechanically complex, difficult to setup, and/or fragile, among others Many other problems and disadvantages of the prior art will become apparent to one skilled m the art after comparing such prior art with the present invention as described herein
BRIEF SUMMARY OF THE INVENTION [0024] Aspects of the invention are found a single light projecting unit having at least one substrate layer. The unit may have a substrate layer with several electromagnetic energy sources, a substrate layer with several micro-electromechanical mirrors, and a substrate layer with computational circuitry Each micro-electromechanical mirror may be uniquely associated with a set of electromagnetic energy sources Further, the computation circuitry may drive the electromagnetic energy sources and the micro-electromechanical mirrors to produce an image The electiomagnetic energy sources may comprise microlasers, nanodots, and VCSELs, among others The set of electromagnetic energy source may include a red, blue, and green light source In addition, the set of electromagnetic energy sources may include infra-red sources, among other sources Integrated with the substrate layers may be transparent layers These layers may be used as wedges to aid m directing light or to seal sensitive components
[0025] Further aspects of the invention may be found m a proxel unit The proxel unit may have a set of electromagnetic energy sources, each emitting a different wavelength This set of energy sources is associated with an electromagnetic eneigy modulator with which light emitted from the energy sources is directed. A group of these proxel units may be combined in a single chip-like unit to facilitate the projection of images The differing wavelengths may include red, blue, green, and infrared, among others Further the electromagnetic energy source may be nanodots, VCSELs, light emitting diodes, and microlasers, among others The electromagnetic energy modulator may be a micro-electromechanical mirror In addition, the proxel unit may include a light detector Such a hght detector may be used to determine mirror position, operabihty, calibration, and proximity of objects, among others [0026 ] Additional aspects of the invention may be found m a projection apparatus including a substrate with several light sources, a first modulator substrate with several micro-electromechanical mirrors, and a second substrate with micro-electromechanical mirrors These may all be integrated with
a computation circuitry into a single chip-like unit. The unit may further include transparent layers integrated with the substrate layers. The transparent layers may be used as wedges to aid in directing light or for sealing and protecting sensitive parts.
[0027 ] Other aspects of the invention are found in a method for using an integrated proj ection unit with a plurality of proxels. The method includes, adjusting the range or data assigned to an individual proxel and directing the emitting of light to coordinate with one or more light modulators to produce an image.
[0028] As such, a apparatus for image projection is described. Other aspects, advantages and novel features of the present invention will become apparent from the detailed description of the invention when considered in conjunction with the accompanying drawings.
BRIEF SUMMARY OF DRAWINGS
[0029 ] For a more complete understanding of the present invention and advantages thereof, reference is now made to the following description taken in conjunction with the accompanying drawings in which like reference numbers indicate like features and wherein:
[ 0030] FIGURE 1 is a schematic block diagram depicting a projection device according to the invention;
[0031] FIGURES 2 and 3 are schematic block diagrams depicting another projection device according to the invention; [ 0032 ] FIGURE 4 is a pictorial depicting a proxel for use in the projection device as seen in
FIGURES 1, 2 and 3;
[0033 ] FIGUREs 5A, 5B and 5C are diagrams depicting arrangements of proxels within a projection device, according to the invention;
[0034 ] FIGUREs 6A, 6B, 6C, and 6D are schematic diagrams depicting projected light an-angements, according to the invention;
[ 0035 ] FIGUREs 7 A, 7B, 7C, and 7D are diagrams depicting projection attributes, according to the invention;
[0036] FIGURE 8 is a schematic block diagram depicting the sensing of light reflected from objects about the field of view of the projection device; [0037 ] FIGURE 9 is block flow diagram depicting an exemplary method for use by the invention as seen in FIGUREs 1, 2 and 3;
[0038 ] FIGUREs 10 A, 10B, 10C, and 10D are schematic diagrams depicting exemplary embodiments of a proxel as seen in FIGURE 4;
[0039 FIGURE 11 is another exemplary embodiment of a proxel, as seen in FIGURE 4; [0040] FIGUREs 12A, 12B, 12C, and 12D are schematic diagrams depicting further exemplary embodiments of a proxel as seen in FIGURE 4;
[0041] FIGUREs 13 A, 13B, 13C, 13D and 13E are schematic diagrams depicting exemplary embodiments of a layered projection device as seen m FIGUREs 1, 2 and 3;
[0042] FIGUREs 14 A, 14B and 14C are schematic diagrams depicting exemplary embodiments of projection devices as seen in FIGUREs 13A, 13B, 13C, 13D and 13E. [0043] FIGUREs 15 and 16 are schematic block diagrams depicting an exemplary embodiment of a circuitry for manipulating the projection device as seen m FIGUREs 1, 2 and 3, and [0044] FIGURES 17, 18, 19A, 19B, 19C, 19D, 20, 21, 22 and 23 are schematic diagrams depicting exemplary applications for a projection device as seen in FIGUREs 1, 2 and 3
DETAILED DESCRIPTION OF THE INVENTION
[0045] The invention is related to the creation of portable display devices based on a projection device with integrated light sources and light modulation devices One possible application includes a basic scannmg projection system Other exemplary applications include a heads-up display, a rear projection display, a gesture interface, and copiers, among others [0046 ] The light source and light modulation devices may be integrated into a single unit or light projection apparatus. This unit may comprise several optically coupled layers. In addition, the unit may comprises computational circuitry electrically coupled to the light source and light modulation devices. As such, the layers may be semiconductor layers integrated with other matenals to fonn a single chip- like unit The unit may take a ch p-hke form and be made with various semiconductors, substrates, and hybrid semiconductor layers, among others The single chip-like unit may project light from various subumts, tenried proxels, to pioduce an image
[0047 ] FIGURE 1 is schematic block diagram of a system 10 for image proj ection accoi ding to the invention. A light source 12 generates an electromagnetic signal that impinges on a modulation device 14. The modulation device 14 directs the electromagnetic signal from the device 22 The electromagnetic signal may be directed through a focusing device 16. The electromagnetic signal may be directed to impinge on a specific object 18 In addition, a sensing device 20 may detected scattered electromagnetic signals and use those electromagnetic signals to control the light source 12, the modulation device 14, and/or the focusing device 16. [0048] These devices may be located in separate units, on a single substrate, or in various other combinations. For example, a VCSEL device and a MEM mirror may be located on a single substrate The VCSEL may generate a beam The beam may impinge on the mirror The mirror may direct the beam to a screen or other display. Further, a light sensor may be included on the device. The reflected light may be detected and measured to determine the distance of reflecting objects or other qualities of the reflected light [0049] Semiconductor light source technologies may take various forms. These forms may include, LEDs, RC LEDs, NRC LEDs, surface LEDs, thin film LEDs, OLEDs, VCSELS, EELs, tunable multicolor lasers, diode laser, and nanodots, among others
[ 0050] The modulation device may take various forms. These fonns may include digital light processors, oscillating MEMs minors, image correcting piston mirror arrays, nano- or micro- translators with mirrors, stationary minors, liquid crystal cells, devices with variable reflectivity, and other spatial light modulators, to name a few. In addition, spatial light modulators may be amplitude and/or phase modulators. These, among others, may be used in the invention.
[0051] The invention may use a digital signal processor. This processor may act to control, manipulate, and/or communicate with the semiconductor light emitter technology and/or the modulation devices. Further, the invention may function to direct electromagnetic energy produced by the semiconductor light emitter technology with the modulation device under the instruction of the digital signal processor. Further, the digital signal processor may communicate with a computing device, including a portable computing device, among others.
[ 0052 ] hi one exemplary embodiment, the invention may take the form of a scanned projecting display. The display may use MEM-based minors and semiconductor light source anay integrated on a single chip. The MEM-based minors and semiconductor light sources are grouped into "Proxel" elements. Each "Proxel" element has one or more light sources and one or more modulation devices. Proxel elements may be ananged on the integrated device to facilitate functionality such as electronic zoom, masking, and keystone conection, among others. As such, the system will be extremely durable, consume less power, and be matchbook size. In addition, the resolution and size of the projected image may not be limited by the device size and yields will not be susceptible to pixel enors. As such, it can function as a personal display or group projector.
[ 0053] In another embodiment, the scanned proj ecting display may have MEM-based mirrors, semiconductor light source anay and LiDAR imaging anay integrated on a single chip. The LiDAR may be used to track display surface to control display size and enable distortion conection, track user movements for gesture-based user interface, and/or scan user provided objects (2D or 3D) for input. [0054] In a further embodiment, the integrated device combines one or more oscillating minors with VCSELs in Proxel elements. The device projects dots associated with the Proxels on to the screen and moves them rapidly to create a picture. This differs from the traditional approach of modulating of light with a spatial light modulator such as a single DLP® or LCD directed through a lens. Instead it is more similar to a TV. In a television, in order to create an electron beam, the cathode must be enclosed in a vacuum and heated to fairly high temperatures. Then the beam hits the phosphors on the face of the screen, creating a dot of light. By contrast, the semiconductor light source converts electrons directly to photons and emits them in a light beam that doesn't disperse, even when sent over relatively long distances. Further, having a multitude of Proxel elements, can scan images at a great scan rate. [ 0055] Alternately, a color display may be generated by directing a single light source through a set of minored surfaces, variably reflective surfaces, beam splitters or other directional devices to a phase or frequency modulator. The resulting frequency altered beam or beams may be directed to form an image.
[0056] While a single light source approach is feasible, the design may include multiple light sources scanning simultaneously to get increased brightness and image stability.
[0057] FIGURE 2 is a schematic block diagram of an exemplary embodiment of a projection system according to the system as seen in FIGURE 1. In this embodiment, light sources 32, MEM minors 36, and controlling circuitry 34 may all be located on separate substrates or substrate layers. The light sources 32 may be a single light source, a set of light sources, or an array of sources, among others [0058] Alternately, the devices may be located on a single substrate. FIGURE 3 is a schematic block diagram of an exemplary embodiment of a projection system accoidmg to the system as seen m FIGURE 1 hi this embodiment, the controlling circuitry 56 and integrated light source and directional devices 54 are located on a single substrate However, other various combinations are possible [ 0059 ] FIGURE 4 depicts an exemplary embodiment of an integrated light source and light modulator in a proxel element In this exemplary embodiment, a set of light sources 74 produce light in various wavelengths This light impinges minors 76 and 78 from which it is directed or projected to produce an image. In this case, the collection of light sources and light modulators is termed a proxel However, various embodiments may be envisaged
[0060] The set of light sources 74 may take various forms including VCSELs, nanodots, edge emitting lasers (EELs), LEDs, RCLEDs, NRC LEDs, surface LEDs, and OLEDs, among others In the example seen m FIGURE 4, a single wafer layer housing a set of VCSELs is overlaid with modulatng layers [ 0061] The light modulators seen in FIGURE 4 include a set of minors 76 and 78 These minors act to redirect the light 79 m accordance with the requirements to reproduce an image In an exemplary embodiment, at least one of the minor is an oscillating minor Light projection from the light sources is timed with the path of the one or more oscillating minors to illuminate specific points that compose an image. [0062] However, various other modulatois may be envisaged. For example, the minors may be digital. Alternately, other modulating devices such as leaver arms, prisms, and angled Pyrex, among others, may be used
[0063 ] More than one proxel may be arcanged on the surface of the integrated device The number and arrangement of proxels provides for various features such as proxel redundancy, variable aspect ratios, electronic ammorphics and panamorphics, masking, reverse scanning, interleaving, gang scanning, and partial gang scanning, among others
[0064] The proxels may be ananged such that their range of proj ection overlaps with other proxels In this manner, a set of adjacent proxels may assume the responsibilities of a failed pioxel The proxels may project in a limited region of their range to allow for vanous features, including zoom, masking and keystone conection, among others. Unlike typical DLP® projectors, an individual proxel is responsible for more than one pixel or an extended path on which various light projections can take place. Typical
DLP® projections assign a single digital minor to a pixel. The minor projects with an on/off pixel state. As such, many of the above features are not possible.
[0065] The pattern of the anay may also be significant FIGURE 5A depicts an exemplary anangement or anay of proxels 94 on an integrated device surface 92. Each proxel may be unifonn m composition or vary by row, column or m some other pattern about the surface of the chip 92. For example, each proxel may have a set of VCSELs projecting visible light and two oscillating mirrors Alternately, proxels having a single wavelength may be ananged in accordance with their projection. Rows of proxels may be established for Red projecting proxels, blue projecting proxels and green projecting pioxels. In another example, proxels projecting differing wavelengths may be ananged m accordance with a pattern.
[0066] One aspect of this feature is the reduction of line scanning Proxels may scan a single line or portion of a single line. A set of proxels may then scan multiple lines simultaneously In another embodiment, the proxels may scan the same line back and forth or a subsequent line on a reverse scan. On a typical CRT monitor with 800 lines, a beam is scanned across the screen 800 times The cross scanning is repeated for each honzontal line. In contrast, a device with 800 or more proxels could produce each horizontal line without scanning more than once Alternately, the proxels could scan vertically and produce each pixel m a horizontal line. As a result, screens could be refreshed faster. Similarly, a device could be used with enough proxels to scan each vertical line without scanning Moreover, the proxels may scan in both directions Both the number of proxels and the bi-directional scanning enable interleaving, and very high resolutions
[0067] With a large number of devices, redundancy could also be enabled The various devices could be adaptively altered to compensate for loss of one or more adjacent devices. The adaptation could be as simple as adjusting the scan range and data allocated to any given proxel through software or hardware switches. [0068] In addition, sensors and other non-visible light source sources could be located with the visible light sources These could be used to detect the location of obj ects and movement of obj ects m the field of view.
[0069 ] However, various anangements may be envisaged. FIGURE 5B represents a circular or Fresnel-hke arrangement FIGURE 5C represents an oval-like anangement. The proxels may be ananged in various shapes, regular or inegular. Each of these anangements may produce advantages for specific applications For example, FIGURE 5A may be applied to a portable projector or rear projection television. FIGUREs 5B and 5C maybe applied to more exotic applications such as display panels, heads-up displays and objects with an uneven surface, among others. [ 0070] FIGURE 6A lepresents a scan line anangement for the proxels with a single oscillating mirror Light may be projected along a given scan line such as the scan line indicated on top. By timing the activation of a light source, such as a VCSEL, the system may produce the full circles indicated along the top scanning path. However, if the oscillators' full range were to be used, light may be
projected on any point along a segment of the top path indicated. The bottom path may represent a second proxel. If multiple proxels are ananged, all lines of an image may be scanned simultaneously. [0071] In a. second embodiment, the lower line may represent an alternate path for the first proxel. If an oscillating minor is associated with a digital minor having at least two positions, a light source may project at any point along the various paths for any full sweep of the oscillating minor. If a multitude of such proxels are ananged, a partial gang scan may be accomplished. [0072 ] FIGURE 6B depicts an alternate embodiment in which various proxels have overlapping ranges. In this manner, if any one proxel were to be disabled or damaged, other proxels m the region could take responsibility for select portions of the proxel's range; providing redundancy. Such an arrangement could also accomplish an electronic zoom feature in which the various adjacent proxels could be assigned ranges within the central proxel's range. The same image data could then be projected in the smaller region or larger region as dictated by the assigned ranges. [0073 ] If two oscillating rmrrors were used in the modulation, a sinusoidal path may be produced such as that seen in FIGURE 6C. The light may be timed to project at any point along the path. If the ratio of the oscillations rates of the two mirrors is indexed greater than one-to-one, various sinusoidal paths may be produced which permit varying coverage of the given region. Such an indexing may be fixed through manufacturing or be varied with a software or hardware parameter or switch. [0074 ] FIGURE 6D shows a further potential embodiment of the output from two digital minors. If each of the two minors have two positions, a set of four pixels may be produced by any given proxel. Alternately, if each of the minors has three positions, 9 pixels may be produced by any given proxel. However, various combinations may be envisaged. Such a feature could be further used to provide overlapping or redundancy.
[0075] FIGURE 7A, 7B, 7C, and 7D further depict the use of proxels to produce various effects or features. For example, FIGURE 7A depicts the varying of ranges of the given proxels in a spreading manner. Such control of responsible regions could be used to provide features such as keystone conection, aspect ratio varying, and zoom. FIGURE 7B depicts a similar altering of responsible regions in which the responsible regions are compressed or nanowed. This too may produce features such as keystone conection, zoom, aspect ratio variance, among others. FIGURE 7C depicts the use of less than all of the available proxels. In this case, a masking may be provided. FIGURE 7D depicts the use of one or more proxels to project into the region of a inoperable proxel. As seen by the "x", an inoperable proxel may fail to produce a pixel or scan line. An adjacent proxel may take one the task of both proxels. Alternately, a lemote proxel may assume responsibility for the projection region or a combination of proxels may compensate for the loss of the inoperable proxel. With these functionalities, various features may be provided such as varying aspect ratio, supporting multiple aspect ratios, software based keystone conection, animorphics, panamorphics, masking, scanning, interleaving and gang scanning, among others.
[ 0076 ] In another aspect, the anay of devices may act to create a set of diverging, converging, interfering, or additive beams, among others. The set of beams may create additive color anays Alternatively, for some applications, the devices may be arranged to create interference patterns The interference patterns may construct regions of low amplitude and regions of greater amplitude Further, the devicemay be ananged to create overlapping patterns The various patterns may operate m a manner to increase the light intensity at a given location which exceeds the intensity of a single device [ 0077 ] i an alternate embodiment, the proxels may be provided with an electromagnetic energy source that may or may not be visible as exemplified in FIGURE 8. A sensing mechanism may be employed to detect objects in the field of view, aspects of the projection surface, and/or objects beyond the projection surface, among others The source may be used along with the detector situated m the chip 102 to detect objects or the shape or angle of the projection surface For example, chip 102 may project an image m a visible spectrum and an infrared beam The infrared beam may, for example, reflect from objects 106 and 108 or screen 104 A detector in 102 may then be used to determine the shape of the objects, the location of objects, the shape of the screen 104 or the angle at which screen 104 resides Conections may then be made automatically, changing the range of proxel, scanning data assigned to each proxel, and other characteristics to produce a conected image For example, if screen 104 were to be angled into position 112, the chip 102 could automatically conect the projected image to compensate for the new angle and maintain image quality Proper selection of screen material may also enable detection of objects on the opposite side of the screen such as object 110 In another exemplary embodiment, the proxel modulators may also be used as light collection sources collecting light along a given path with either the light collection scenano or the light projection scenario with detection A gesture interface may be envisaged
[0078] For example, a LiDAR system may be used to detect screen position, orientation, surface quality, and other parameters This fonnation may then be used to adapt the focusing, directing, and firing of the light In addition the system may detect objects m the front of the screen and adaptively project to compensate for distortions In this manner, the system may have adaptive optics capabilities The LiDAR system may be built into each proxel, comprises separate proxels, or take another form separate or integrated with the pioxel anay and chip. [0079] Light detector may also be integrated with each proxel element for determining minor position, detecting reflected light from a given projection angle, and/or determining operabihty of proxel light sources However, various uses may be envisioned.
[0080] FIGURE 9 depicts an exemplary method for accomplishing the various functionalities possible with a proxel anangement The system may or may not receive instructions as indicated by block 122 For example, these instructions could include directions to zoom, change aspect ratio, or adjust for image requirements, among others. The instructions may be provided by a user, a controller, or a feedback mechanism, among others
[0081] The system may also be constructed with sensors and detectors. With these instruments, the system may sense the environment, as seen in block 124. In this case, sensing of projection characteristics such as screen angle, screen shape, the presence of other objects in the light path may be used in conjunction with other instructions to detennine a prefened range and allocation of data for each proxel. Through software and/or hardware queues, the range of the proxel may be adjusted to accomplish the desired image feature, as seen a block 126. The image may then be implemented by supplying the select data to the individual proxel control unit as seen in block 128. [0082] In this manner, various features such as varying aspect ratio, supporting multiple aspect ratios, animorphics, panamorphics, keystone conection, masking, scanning, interleaving, and gang scanning, among others, may be provided. For example, pretesting of the system may determine operabihty of various proxels and sensing capabilities may aid in determining which proxels are operational. The integrated device may then store the operabihty infonnation and use this for determining new ranges for proxels to accomplish redundancy among proxels. Alternately, keystone conection may be accomplished by sensing an angle of the screen or the angle of the screen relative to the projection. Adjustments may be made m proxel ranges and the timing of light projection to reduce the foreshortening of the image. Various optical elements may be incorporated with the light source or in the optical path as part of the device with the purpose of focusing or modifying the optical properties of the beam. Also the minors may include optical elements and or specific surface shapes or features to accomplish specific optical conditioning or modify the properties of the beam [ 0083] FIGUREs 10 A, 10B and 10C are exemplary embodiments of a proxel . The proxel system 130 may be developed with one or more light sources 132 and two minors 134 and 136. The light sources 132 may project light in time with the oscillations or movements of the minors 134 and 136 to produce a projected beam 138. In this exemplary embodiment, the minors 134 and 136 may oscillate to produce perpendicular changes in the light direction. For example, minor 134 may oscillate to produce vertical deviances in the projected beam and minor 136 may oscillate to produce horizontal deviances m the projected beam 138. However, these may also be reversed.
[ 0084] Alternately, one minor may be static or stationary. This would reduce the size requirement for the moving minor. A two axis moving minor may be used in combination with the static minor to produce the scanning projection. Further, vanous combinations of digital and oscillating minors may be envisaged.
[0085] FIGURE 10A is a sideways view of the system 130. The system resides on a common substrate 140 A light source or set of light sources 132 is constructed into the substrate as are the minors 134 and 136. Not shown are the appropriate electrical or conductor connections and insulative structures included m the substrate 140. FIGURE 10B depicts a view from above the pixel. In one exemplary embodiment, light projected from the light source or set of light sources 132 is modulated up or down by minor 134 and subsequently reflecting to minor 136. There, it is modulated side-to-side as seen by FIGURE 10B. However, the roles may be reversed. Further, the minors may oscillate at
differing rates . If these rates are indexed to ratios such as 2 : 1 , 3 : 1 or other ratios, a sinusoidal curve or various other shapes may be produced. Timed light projection may then produce pixels or lines along this curve. Combinations of these pixels or lines produced by one or more proxels can then be combined to produce an image. [ 0086] FIGURE IOC depicts an alternate embodiment in which the integrated device is composed of various layers 142, 144 and 146. In this alternate embodiment, the light sources 132, along with other electronic circuitry, resides with layer 142. The first minor 134 resides on layer 146 and the second minor resides on layer 144. These layers may be interconnected and each layer may have various components of the control circuitry. In combination, the timed light produced by the light sources 132 is modulate by the minors 134 and 136 to produce the projected beam 138. The projected beam is then used in combination with other beams to produce the image.
[0087] FIGURE 10D shows a further embodiment in which a set of light sources are produced on varying wafer layers. Such wafer layers may be used to produce light sources having differing wavelengths. In this exemplary embodiment, light sources 152, 154 and 156 are located separately on layers 168, 166 and 164, respectively. Each of the light sources 152, 154 and 156 have a differing wavelength such as red, blue or green. In conjunction with control circuitry, these light sources 152, 154 and 156 then project, in accordance with the time signal, a beam which is then modulated by minors 158 and 160 to produce the modulated beam 162. The modulated beam 162 is used in conjunction with other beams from other proxels to produce an image. [0088] An alternate embodiment or a proxel may be seen m FIGURE 11. FIGURE 11 depicts a set of edge emitting lasers 182, 184, and 186. Each ofthese edge emitting lasers may have a differing wavelength such as red, blue or green. The lasers may be directed at a minor 188 or other modulator. The full anangement may reside on a common substrate 190. However, various light sources and modulating systems may be envisaged. [0089] FIGURE 12A shows a further embodiment. In this case, a light source 202 resides in a substrate 208. A minor 204 resides in a substrate 212. Between the substrates 208 and 212 is a transparent layer 210 such as Pyrex, among others. The transparent layer 210 may be angled. Light produced by the light source 202 impinges the minor 204 at an angle and is then directed out of an opening 214 m substrate 204 to produce a modulated beam 206. [ 0090] FIGURE 12B shows a further exemplary embodiment in which a light source 212 resides m a layer 224. A lever ann 226 having a transmissive light directing element 228 is used to modulate and/or direct the light produced by light source 222 to produce the modulated beam 230. hi a further embodiment, FIGURE 12C places the light source 226 on the beam 224. Movement of the beam or oscillation of the beam may then be used in conjunction with other modulators to produce the effects described previously. As such, various combinations of beams, digital minors, oscillating minors and other light modulators may be envisaged.
[0091] FIGURE 12D depicts another embodiment in which an LCD panel layer is integrated with one or more minor layers. One or more light sources may be filtered or modulated by the LCD layer. The light emitting from the LCD layer may then be scanned using the one or more minor layers. [0092 ] FIGUREs 13A, 13B, 13C, 13D and 13E ιepresent vanous embodiments of a layered device having integrated light source and modulation means FIGURE 13A is similar to FIGURE 10C m that the light source and modulation layers are ananged m a layered fashion as shown hi addition, a transparent layer may be overlaid over the first modulation layer effectively sealing the modulation layers and preventing dust, moisture and other contaminants from damaging or impairing the function of the modulators or light source. Further, a circuitry layer may be coupled below the source layer. Alternately, the circuitry layer may be integrated with the source layer, first modulator layer or second modulator layer, among others.
[ 0093 ] FIGURE 13B depicts an exemplary variant of this system m which the first modulator layer and second modulator layer are sealed between two transparent layers Subsequently circuit layers and source layers may be coupled around this structure. This structure has the advantage that the modulatoi layers are sealed earlier in the manufacturing process preventing damage and improving yield FIGURE 13C is a further vanant in which the circuitry layer is located between the first modulator layer and the second modulator layer. This arrangement has the advantage of maintaining the circuitry layer m closer proximity to the modulator layers. Further, the desired light path between the first and second modulator layers may be greater than two adjacent layers permit In this case, a third layer, such as the circuitry layer or a transparent layer, placed in between the first and second modulator layers, act to piovide greater distance between modulators
[0094] FIGUREs 13D and 13E represent the placement of an angled transparent layer withm the integrated device In each ofthese cases, the angled transparent layer acts to alter the relative angle of light incidence, hi the case of mmored modulators, if the light source is perpendicular to the mmored surface at rest, the system must consistently bias the minor to cause the light to reflect to a subsequent minor In addition, less than the full range of the minor is available for modulation of the light Angling the light incidence functions to increase the range of the proxel. In FIGURE 13D, the angled transparent layer or wedge is placed between the first modulator layer and second modulator layer. When light impinges the first modulator layer, it is reflected at an angle to the second modulator layer. When the modulator layers are parallel, the first modulator must work to perform the additional angled movement However, with the wedge, the full range of the first modulator may be used. FIGURE 13E depicts an alternate example in which the transpaient layer wedge is placed between the modulator layers and the source layer. In this case, the light incidence on the first modulated layer is again angled relative to the first modulator conserving an amount of range [ 0095] FIGURE 14A depicts a more detailed embodiment of the transparent wedge In this case, a set of VCSELs 252 reside in a layer 260. The VCSELs produce a timed light signal which impinges minor 254 and 256 to produce the modulated light 258 The mirrors 254 and 256 may be static minors,
digital minors, single-axis oscillating minors, two-axis minors, or combinations, among others hi this exemplary embodiment, a transparent wedge 266 made of a material such as Pyrex is placed between the first modulator layer 268 and that of the second modulator 262 with the transparent layer wedge 266. Light from the VCSELs 252 impinges the minor 254 withm automatic incidence angle As such, the full range of motion of minor 254 may be used Further, the circuitry may or may not be placed in a layer 264 and the system may or may not be sealed with a transparent layer 270 [0096 ] FIGURE 14B depicts an alternate embodiment of the system in which the transparent wedge 292 is placed between the source layer 290 and the modulator layers 298 and 294 In this case, light from the VCSELs 282 impinges the mirror 284 with an automatic incidence angle that directs the light toward minor 286. Minor 286 then produces the beam 288 Here too, a circuitry layer 296 may be placed between the modulator layers 294 and 298 and a transparent layer 300 may be used to seal the system.
[0097 ] FIGURE 14C depicts a further use of π ansparent layers to effectively seal the modulator layers early m the manufacturing process In this case, a modulator layer 322 is sealed between transparent layers 320 and 324. Similarly, a modulator layer 328 is sealed between transparent layers 326 and 330 The modulator layers with their associated transparent layers are then superimposed so that a beam 318 may first impinge a modulator 314 and subsequently the modulator 316 In one special case, the modulator layers may comprise the same circuitry design The two are coupled such that the top modulator layer is upside down and rotated 90 degrees relative to the bottom modulator layer. The layers may then be connected to control circuitries and the integrated light sources In this manner, a single modulator layer design may be implemented and used twice m each device [0098] FIGURE 15 represents an exemplary circuitry for use with the system The circuitry 340 includes a frame buffer 342, a video processor subsystem 344 and various proxel control units 346, 348, 350 and 352, among others The frame buffer may act to receive and store video data and/or control data and provide control outputs The data is provided to the video processor subsystem 344 which interprets the data and control instructions The video processor subsystem further subdivides instructions and control data and provides data and instructions to the proxel control units 346, 348, 350 and 352, among others The proxel contiol units then manipulate the proxel elements to, m combination, produce the image [0099] The frame buffers 342 may take various forms. These forms may include RAM and various memory circuitries Alternately, each proxel may have a frame buffer, a sepaiate frame buffer may be used for each wavelength on each proxel, the chip may have a single memory comprising the frame buffer, or various combinations, among others [00100] The video processoi subsystem 344 may take various forms These forms may include digital signal processors, among others
[00101] The proxel control units 346, 348, 350 and 352 may take the form exemplified m FIGURE 16, among others FIGURE 16 shows a circuitry for controlling proxels Serial RGB data enters a
converter 362. A clock signal derived from the Serial RGB signal is directed to a Write Address Generator 366 The RGB data is directed to a color channel separation circuitry 364 The separated channel signals are directed to their respective line buffers 370, 372, and 374. There, they are stored m accordance with a write address generated by the write address generator 366 The line buffers 370, 372, and 374 are then read in accordance with a read address signal generated by a read address generator 368. The read address signal is determined in accordance with the motion or position of modulation minors and a pixel clock The address may be generated, for example, to produce light pulses in accoi dance with a motion m one direction. Then, the addresses may be generated to produce light pulses m accordance with an opposite motion For a horizontal line, the address may be generated so that pixels are produced m accordance with a left to right scan of an image Then, as the minor leverses direction, the data may be read in accordance with a right to left scan. In this manner, pixels may be produced for each sweep of the minor. The write address generator 366 and read address generator 368 may also communicate to ensure proper address handling [00102 ] From the line buffers 370, 372, and 374, the RGB data is sent to a coπespondmg DAC 376, 378, and 380, respectively. The DACs 376, 378, and 380 then produce a signal to activate the associated emitter 382, 384, and 386, respectively The DACs 376, 378, and 380 may also receive signals associated with brightness. Further, the DACs 376, 378, and 380 may receive a cahbiation signal associated with each emitter 382, 384, and 386, respectively The calibration signal may be an offset determined at the time of manufacture to compensate for variability among devices. For example, the device may be tested and a calibrated shift stored in the configuration memory 390 for each proxel and emitter.
[ 00103 ] In the example of FIGURE 16, a red, green, and blue emitter (382, 384, and 386, respectively) are shown In addition, signals of other wave lengths may be produced For example, an additional signal may enter a line buffer and DAC associated with an infrared signal. [0010 ] Serial control data and status data may be communicated between a video processor subsystem and a converter 388 The data may be directed to a configuration memory 390. The configuration memory may store emitter calibration information, brightness information, and parameters associated with the vertical drive and horizontal drive In this exemplary embodiment, the configuration memory provides parameters associated with the vertical drive to a vertical drive DAC 394. The vertical drive DAC 394 then signals the vertical minor drive 396 In the case of a digital minor, the minor may assume a desired position In the case of an oscillatory minor, the minor may be dnven to oscillate with a given frequency indexed to the oscillation or position of a horizontal minor
[ 00105 ] The configuration memory 390 also provides timing in accordance with the oscillation of a horizontal minor In this exemplary embodiment, a horizontal minor driver 399 drive a horizontal oscillating minor with a know frequency. A minor sensor 398 senses the position of the minor. In this example, the minor sensor 398 produces a signal when the minor has reached one limit of the range of oscillation. The sensor signals are provided to a pixel timing circuitry 392 which, along with position,
size and resolution data, determines the pixel clock signal and direction signal sent to the read address generator 368.
[00106] The range of projection, timing of emitter firing and duration of emitter firing can all be varied to produce the desired effect. For example, the RGB data may be emitted over a shorter range of the horizontal oscillation or spread out across the complete range. In this manner, various features are enabled. Signals and data timing may be used to produce varying aspect ratio, multiple aspect ratios, keystone conection, animorphics, panamorphics, masking, scanning, zoom, interleaving, inverted signals, reverse signals, lens shift, and gang scanning, among others [ 00107] As such, the integrated systems shown in FIGUREs 1 , 2 and 3 may be used in various applications. FIGURE 17 depicts a rear projection television or monitor in which the integrated device 412 projects onto a mirrored surface 414 that subsequently projects onto a screen 416 Alternately, the integrated device 412 may project directly onto the screen 416 or through various optics [00108] hi a further embodiment, FIGURE 18 depicts a heads-up display in which an integrated device 432 is situated in a dashboard 434 and projects an image 436 onto a windshield 430 The integrated device 432 or similar devices may be used also to create instrument panels 438 and 440 and travel screen 442 The travel screen may, for example, may be used to show maps or travel directions, a rear view from a vehicle, or any other image data The heads-up display may be used m an automobile, truck, boat, cruise ship, airplane, and others The heads-up display may even be projected on windows m buildings and other structures. [00109] The system may be used to provide relevant information to ambient conditions, news, instrument panels, warning indicators, enhanced vision images, air motion, and other information For example, the system may be used m a cai to provide additional seatbelt warnings Further, the system may be used to overlay night vision images over the vision field to enhance recognition of road hazards for automobiles [ 00110] Further, the system may be used to replace instrumentation panels. The system may, for example, project the instrument panel from behind the dash m a rear projector embodiment. Alternatively, the panel may be projected m a front projection manner or various other configurations In addition, a projector system may be used to project information from a mapping system, a rear view system, climate control systems, audio systems, and other systems The embodiment may be used for equivalent systems m other vehicles such as boats, airplanes, trucks, and others.
[00111] Moreover, the display area may take various shapes. These shapes may be associated with the contour of the instrumentation panels, instruments, windshield, and others Additionally, the display may function to project images m dynamically changing shapes. [00112] FIGUREs 19A, 19B, 19C and 19D depict the integrated device used m an exemplary miniature projection device. The system may be connected to a computer, PDA, or other computing device. Alternatively, the unit may function as a self-contained projection device The projection device 452 has a popup projector 456 that projects onto objects screen 454. FIGURE 19B is an
overhead view of the projection 452. The integrated device may be housed m the popup projection 456. This system may or may not have optics 458. FIGURE 19C is a side view of the miniature projection 452 near to the popup arm 456 as seen with optics 458. The system may also have input devices including vanous connectors such as serial ports, parallel ports, USB, fire wire, SCSI, frDA, smart media, and video input, among others, and drive 462 such as a floppy drive, removable hard drive, smart media reader, CD, or DVD, among others. FIGURE 19D depicts a front view of the device 452 with arm 456 and optics 458
[00113 ] However, the projection may be made on a wall, a window, or other surfaces. Further the device may be configured to project on uneven surfaces, oddly shaped surfaces or angled surfaces. Alternatively, a sensing device such as LiDAR may be used to detect the shape of the surface and control the projection to compensate for the surface
[ 00114] In another exemplary embodiment, the projection device may be part of a laptop, PDA or other computational device. The projector may project the image, for example, on a laptop screen In this manner, the flip up display of the laptop may be reduced to a surface application or even be removed In another example, a PDA may project the display on a wall, a desk, a piece of paper, a hand, glasses, or even the eye.
[00115] This projector is capable of adjusting the horizontal and vertical position of the projected image by electronic control of each of the pioxels' beam deflections and assigned langes. This enables a fonn of automatic keystone conection that is based on the assumption that the projector is positioned orthogonal to the surface being displayed. As the projectors image is adjusted electronically the change of angular deflection of the proxels can be measured and that angular change can be used to calculate a conespondmg change m the required keystone conection This approach can be applied for deflection in the horizontal or vertical direction, or a combination of the two. This enables and automatic conection of the keystone distortion of the image as the image is moved on the plane of the surface on which the image is being projected Various sensor methods such as tilt sensors, infrared sensors, or feedback from the viewer may also be used.
[00116 ] FIGURE 20 represents another exemplary embodiment in which a chip or unit based projection system is integrated with a card or insert for a computation device. The piojector unit 468 is attached to a joint 466 The joint 466 may permit multi-axis rotation of the projection unit 468. The projection unit 468 is also communicatively coupled to a card 464 This card 464 may take the form of a PCMCIA card, PCI card, or smart card, among others.
[00117 ] FIGURE 21 represents a further exemplary use for the integrated device. The integrated device 472 projects onto a bundled set of fiber optics. The set of fiber optics may be guided or molded into various shapes to produce image surfaces [00118] In a further use seen in FIGURE 22, an integrated device 492 may project onto a screen 494. The range of motion of the proxels and the timed signal of the light sources may be used to produce an image on the surface 494 Further, detection means either separate or associated with each
proxel may be used to determine the shape and angle or position of the screen and adjust the range of motion or range of responsibility for each proxel to compensate accordingly
[00119] Such a system may also be used for touch screen applications For example, Figure 23 depicts a kiosk anangement. The kiosk 500 has a removable board 502 with the light projection chip 504 and a durable screen 506 Since the touch detection is based on light projected from the chip 504, the screen can be passive and made with a more rugged material
[00120 ] While suitable for traditional front and rear projection applications, the unique attributes of the light projection device include very small size, low power consumption, and low heat production These attributes enable a wide range of applications for projection technology that were not previously possible. These applications include both front and rear projection applications. The light projection apparatus can be mounted with a gimbaled joint that allows the projection device to be aimed manually. The light projection apparatus also has a capability to conect the image even when the chip is positioned at a fairly large angle from normal to the screen surface, either left or nght, above or below. This flexible positioning capability also further enables a range of unusual applications for the device. [00121] Some of the uniquely enabled applications include.
[ 00122 ] Rear projection displays with cabinet sizes close to the screen size in the height and width and less than 1/3 the diagonal screen size m depth with an enclosure that can be folded up into a flat package.
[ 00123 ] Rugged kiosks that use cheaply and easily replaced screens while protecting the active display component m a small enclosure These are ideal for touch screen applications, as the screen is a rugged and cheap passive device
[00124] Automotive, aeronautic, and marine displays that project their images on a windshield, but are compact enough to sit on the dashboard without complex enclosures. These devices could be implemented as aftermarket devices that plug in to a power source but require no further installation. Applications of this type could function as informational displays for navigation or systems monitoring
[00125] Automotive, aeronautic, and marine displays that project their images on a rear proj ection screen, replacing cunent "dashboard" instrumentation with flexible reconfigurable displays.
[00126] Embedded applications, where the light projection apparatus is built into a number of electronic devices. This would include camcorders and digital cameras enabling the display of capture video and images for larger groups without external display devices. It could also include embedding in game consoles, handheld electronic toys, specialty tools. In addition, it could also replace LCD panels m portable DVD players or laptops by embedding the projector into same and replacing existing displays with a passive screen.
[00127] Embedded into vehicles for information and entertainment displays. The device could be embedded in the overhead or other components of an airplane or other vehicles for the purpose of projecting displays on seatbacks and bulkheads.
[00128] Attached to various interface cards such as compact flash, PCMCIA, or others to expand display capabilities of existing devices.
[00129] Miniature teleprompters that can easily be positioned on floor or podium without obscuring the view of the speaker. [ 00130] Dynamic signage - easily positionable with retail environments yet capable of display moving images and refreshable mfomiation.
[00131] Reconfigurable applications, where the device is converted from use as a heads up display mounted on eyewear to project larger images for groups on a convenient surface or from a personal DVD or game console rear or front projection device to a large screen display [ 00132 ] However, various applications may be envisioned m which the light projection apparatus may be utilized.
[ 00133] As such, a portable display system is described. In view of the above detailed description of the present invention and associated drawings, other modifications and variations will now become apparent to those skilled in the art. It should also be apparent that such other modifications and variations may be effected without departing from the spmt and scope of the present invention as set forth m the claims which follow.