US20150022887A1 - Variable focus stereoscopic display system and method - Google Patents
Variable focus stereoscopic display system and method Download PDFInfo
- Publication number
- US20150022887A1 US20150022887A1 US14/506,849 US201414506849A US2015022887A1 US 20150022887 A1 US20150022887 A1 US 20150022887A1 US 201414506849 A US201414506849 A US 201414506849A US 2015022887 A1 US2015022887 A1 US 2015022887A1
- Authority
- US
- United States
- Prior art keywords
- stereoscopic display
- focus
- eyes
- optical power
- vergence
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G02B27/2228—
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
- G02B30/22—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type
- G02B30/24—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type involving temporal multiplexing, e.g. using sequentially activated left and right shutters
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B15/00—Optical objectives with means for varying the magnification
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
- G02B30/22—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type
- G02B30/25—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type using polarisation techniques
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
- G02B30/34—Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2213/00—Details of stereoscopic systems
- H04N2213/008—Aspects relating to glasses for viewing stereoscopic images
Definitions
- the exemplary embodiments described herein generally relate to information displays and more particularly to stereoscopic displays.
- 3D displays are becoming increasingly popular.
- 3D displays implement stereoscopic techniques to generate a 3D visual display to a user.
- Such displays which may be referred to as stereoscopic 3D displays, rely on the well known stereoscopic imaging technique for creating the illusion of depth in an image.
- stereoscopy is a method of creating a 3D image from a pair of two dimensional (2D) images, in which each of the 2D images preferably represents the same object or image from a slightly different perspective, such as a right eye perspective and a left eye perspective.
- a typical prior art stereoscopic display 102 is configured to generate a 3D representation of an image viewable by a viewer 104 .
- a left eye 106 and a right eye 108 of the viewer 104 are focused on a focus plane 109 at the stereoscopic display 102 (the viewer 104 is a binocular viewer having two eyes separated by an interpupillary distance 110 ).
- a left stereo channel selection mechanism 112 is positioned between the left eye 106 and the stereoscopic display 102 and a right stereo channel selection mechanism 114 is positioned between the right eye 108 and the stereoscopic display 102 .
- Stereo channel selection mechanisms 112 and 114 can take many conventional forms well known in the art, including polarized filters, colored filters, temporal shutters, and others. These selection mechanisms 112 , 114 can also be incorporated as part of the display, for example using lenticular arrays or other mechanisms known in the art.
- the function of the stereo selection mechanisms 112 , 114 is to cause the left eye 106 to see only left perspective view 116 and right eye 108 to see only right perspective view 118 .
- the perceived depth, or distance from the viewer, of feature 120 is determined by the intersection or converging of the lines of sight from the eyes to their respective perspective views.
- Stereoscopic display systems which provide enhanced interpretation of the information by users over two dimensional displays and can result in improvements in performing various tasks as well as various other potential benefits, may be used for applications which rely on periods of extended concentration and/or critical information, such as avionics, medical, engineering/industrial or military applications, and may also be used for applications of shorter concentration periods, such as entertainment applications, for example, movies.
- Stereoscopic 3D displays have been conventionally directed toward intermittent and non-critical applications such as entertainment and modeling.
- One of the lingering concerns of use for extended periods or critical information is the human tolerance for the vergence-accommodation disparity present in these displays. Vergence refers generally to the relative inward angle of the two eyes to detect depth, whereas accommodation refers to the distance for which the eyes are optically focused.
- the vergence and accommodation cues typically match. Both of these cues are valid 3D depth or distance cues, along with a number of other 3D cues, for example, motion parallax, occlusion, relative size, absolute size, linear perspective, and shading/shadows.
- Conventional stereoscopic displays achieve the sensation of 3D by manipulating vergence cues while having the eyes remain focused on a fixed display surface or screen. This disparity between competing depth cues can result in viewer fatigue and discomfort, especially over an extended period of time, and can potentially interfere with the benefits of using a stereoscopic display.
- the potential for fatigue, including eyestrain, headaches or other discomfort is generally believed to be increased as the degree of mismatch increases and can potentially interfere with the benefits of using a stereoscopic display.
- Apparatus' and methods alter the distance to the focus plane of the stereoscopic 3D display based on the vergence of the eyes while viewing portions of the display.
- Embodiments include both active and passive methods.
- variable focus stereoscopic display system defining a focus plane
- the variable focus stereoscopic display system comprising a first lens configured to be positioned between a first eye and a stereoscopic display, and a second lens configured to be positioned between a second eye and the stereoscopic display, wherein the first and second lenses are configured to modify the distance of the focus plane from the first and second eyes in response to a vergence of the first and second eyes, and changes in the focus distance are positively correlated with changes in the convergence distance of the lines of sight of the first and second eyes.
- Another variable focus stereoscopic display comprises a focus plane, a first lens configured to be positioned over a first eye for viewing the stereoscopic display, a second lens configured to be positioned over a second eye for viewing the stereoscopic display, the first and second lenses each comprising a first portion having a first optical power, and a second portion having a second optical power higher than the first optical power, the first and second portions configured to increase the focus distance as the convergence distance increases (corresponding to decreased convergence), and to decrease the focus distance as the convergence distance decreases (corresponding to increased convergence).
- a method for adjusting a focus plane for viewing a stereoscopic display comprising altering the distance of the focus plane from first and second eyes in response to vergence of the first and second eyes, wherein changes in the focus plane distance are positively correlated with changes in the convergence distance.
- FIG. 1 is a prior art schematic of two eyes viewing a displayed feature on a stereoscopic display
- FIG. 2 is a schematic of two eyes viewing a displayed feature on a stereoscopic display having a first shifted focus plane in accordance with an exemplary embodiment
- FIG. 3 is a schematic of two eyes viewing a displayed feature on a stereoscopic display having a second shifted focus plane in accordance with an exemplary embodiment
- FIG. 4 is a functional block diagram of a system in accordance with the exemplary embodiment of FIG. 2 ;
- FIG. 5 is a flow chart of the method for implementing the exemplary embodiments
- FIG. 6 is a near-to-eye stereoscopic display system in accordance with an exemplary embodiment
- FIG. 7 is a functional block diagram of a aircraft display system in which the exemplary embodiments may be used.
- FIG. 8 is a schematic of two eyes viewing a displayed feature on a stereoscopic display having a shifted focus plane in accordance with another exemplary embodiment
- FIG. 9 is a first pair of lenses for implementing the exemplary embodiment of FIG. 8 .
- FIG. 10 is a second pair of lenses for implementing the exemplary embodiment of FIG. 8 .
- a stereoscopic display system (three dimensional (3D)) provides two images of the same object taken from two perspectives that when viewed by two eyes are interpreted as an image having depth (depth perception).
- the stereoscopic display system described herein provides enhanced usability by users of the display, especially for applications which rely on extended duration and/or critical information, such as avionics, medical, engineering/industrial, or military applications. Entertainment-based applications would also benefit from these improvements even though the user has an increased opportunity to divert attention from the stereoscopic content and thereby reduce a strain on human tolerance.
- Embodiments described herein alter the distance to the focus plane of the stereoscopic 3D display based on the vergence of the eyes while viewing portions of the display.
- Embodiments include both active and passive methods.
- Convergence means central or foveal binocular lines of sight rotated inward and crossing at a point in front of the viewer. Increased and decreased convergence corresponds to the crossing point being closer to or further from the viewer, respectively. Substantially zero convergence corresponds to the crossing point being very distant, e.g., infinity, from the viewer. Divergence refers to the lines of sight diverging (moving apart) from zero convergence in front of the viewer, which is not normally the case for human viewers. Vergence describes the relationship of convergence to divergence. Focus distance is the distance from the eye to the effective apparent plane of focus as seen by the eye. Convergence distance is the distance from the eye to the convergence crossing point.
- a first embodiment involves the use of dynamic focus lenses over each eye.
- These lenses are preferably electro-optically adjustable, for example through the use of switchable liquid crystal materials, electro-active polymer gels, field deformable surfaces or other optically switchable materials.
- the drive signal for the lens pair is to be derived from a corresponding differential eye tracking sensor mechanism, such as one or more small sensors (cameras) which would detect the relative orientation or vergence of the two eyes.
- a differential eye tracking sensor mechanism such as one or more small sensors (cameras) which would detect the relative orientation or vergence of the two eyes.
- the sensor would detect the apparent stereo distance from the eyes and would add or subtract optical power to the lenses to make the apparent focus distance of the object or feature match the convergence distance based on vergence cues.
- the variable focus lenses would preferably be adjusted to a more positive (or less negative) power to effectively increase the apparent focus distance when vergence cues indicate greater distance or depth.
- a preferred (but non-limiting) positive focal length for the lenses would be the distance from the lenses to the stereoscopic display screen or panel.
- the lenses would preferably impart a somewhat negative (or less positive) optical power such that the eyes, including normally worn corrective eyewear or contact lenses, would have to focus closer to see a sharp image.
- relative changes in the one depth cue, the focus distance are positively correlated with relative changes in another depth cue, the convergence distance.
- a passive variable focus embodiment includes a suitable pair of progressive focus lenses.
- the optical power of the lens most typically increases from top to bottom of the lens. In this embodiment, however, the optical power of the lens increases from the inner edge (converged lines of sight suggesting slight negative power in the variable focus lens) and reaching zero or preferably higher power toward the centers and outer regions of the progressive lenses.
- Yet another embodiment is a variant on the passive progressive lens approach which applies a correction while allowing somewhat more user control based on viewer head position.
- there is a vergence-dependency of the optical power but this is combined with an up/down tilt aspect.
- a further option is to combine these active and passive techniques to reduce the degree of actively switched optical power needed and at the same time relax the need to center the foveal view relative to the passive eyewear.
- both active and passive methods can be used to restrict the variable power to the viewing of the particular display, while avoiding the variable power when looking away from the display. Numerous other similar techniques and/or apparatus are possible.
- a standard display such as an active-matrix liquid crystal display, plasma, organic light emitting diode, projection, or other real image display
- a collimated display such as a head up display or binocular near-to-eye display, which provides vergence cues.
- the system/approach as described applies the disclosed techniques to expand the range of accommodation or focus distance required of the viewer's eyes, so that instead of simply focusing on the plane of a stereoscopic display, the eyes focus over a larger and more natural range for the imagery being viewed.
- Another candidate usage for the above described techniques is to instead shrink the range of accommodation or focus distance required from the viewer's eyes when viewing a real world or other volumetric scene. This would be analogous to using conventional progressive or bifocal eyewear, except that the effective lens prescription being utilized would be controlled, either actively or through a combination of both active and passive techniques, based on actual eye vergence rather than tilting of the head. In this case, the progression of the optical power would preferably be reversed from the stereoscopic embodiments.
- the lenses described in the various embodiments may be implemented in any one of several arrangements, for example, binoculars, or embedded in a hardware system in which the viewer would move his eyes to the lenses or otherwise appropriate vantage point; however, the preferred embodiments are implemented in a head-worn system as described hereinafter. Additionally, the display may alternatively be included in the head worn system. Though the methods and systems may be implemented in any one of several environments, for example, medicine, modeling, and mobile vehicle such as automobiles, ships, and heavy machinery, the use in an aircraft system is described as an example.
- an embodiment of a system or a component may employ various integrated circuit components, e.g., memory elements, digital signal processing elements, logic elements, look-up tables, or the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices.
- integrated circuit components e.g., memory elements, digital signal processing elements, logic elements, look-up tables, or the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices.
- the stereoscopic display 102 may be implemented using any one of numerous suitable stereoscopic display devices now known or developed in the future.
- the stereoscopic display 102 may also be implemented using either coplanar display media or non-coplanar display media.
- a sensor 222 is positioned with respect to the eyes 106 , 108 of the viewer 104 for determining the amount, or degree, of vergence, typically convergence which is an inward viewing angle, of the eyes towards one another.
- the sensor 222 could take any form capable of detecting the relative directions the two eyes 106 , 108 are aimed, and may be mounted along with the lenses 212 , 214 and any other optical components required such as polarizers, shutters, selective filters and/or corrective eyewear.
- the sensor 222 could sense vergence via analysis of sensor imagery, or alternately could sense vergence by mechanical, electrical or any other means possible.
- the lens 212 is positioned between the left eye 106 and the stereoscopic display 102 and the lens 214 is positioned between the right eye 108 and the stereoscopic display 102 .
- These lenses 212 , 214 are preferably electro-optically adjustable, for example through the use of switchable liquid crystal materials, electro-active polymer gels, field deformable surfaces or other optically switchable materials. See for example, the technology described in U.S. Pat. Nos. 4,190,330 or 6,619,799.
- Dynamically adjusted contact lenses would be another embodiment. Alternately, the lenses could be mounted separately from the head of the viewer. A single lens or lens region could be used provided both lines of sight pass through it. Other dynamic focus means would also be possible, such as optics moved or deformed by mechanical means, or switchable viewing screen depths. Modifying the focus of the lens or lens system in this context refers to modifying the optical power, and thereby the related focus distance for the display. It should be noted that the focus distance is adjusted based on vergence of the eyes, not the input image data to the stereoscopic display.
- FIG. 4 depicts a block diagram of a system 400 in accordance with the present embodiments.
- a processor 420 is coupled to the lenses 212 , 214 and is configured to receive information from the sensor 222 regarding the degree of vergence and, in response thereto, adjust the strength of the lenses 212 , 214 to alter the focal point or focal length. For example, when the sensor 222 determines the eyes have rotated outward (away from one another, such that they are less converged), the lenses 212 , 214 are adjusted to shift the required focus of the eyes 106 , 108 the distance (focus plane shift) 224 ( FIG. 2 ) from the display screen 102 (where the eyes are focused without adjustment) to a focus plane 226 ( FIG.
- the lenses 212 , 214 are adjusted to shift the corresponding focus of the eyes 106 , 108 to a convergence plane 332 closer to the eyes 106 , 108 .
- This method ( FIG. 5 ) of adjusting the visual focus for viewing a stereoscopic display includes the step of altering the focus plane distance between a stereoscopic display focus plane and first and second eyes of a viewer in response to vergence of the first and second eyes, wherein changes in the focus plane distance are positively correlated with changes in the convergence distance for the first and second eyes' lines of sight.
- the adjustment of the visual focus for a stereoscopic display may be accomplished in several types of systems, for example, the vergence sensor 222 and the lenses 212 , 214 may be positioned on a stationary apparatus, with the user positioning himself to view a display through the lenses 212 , 214 , or they may be positioned on a head-worn vision system 632 ( FIG. 6 ).
- the lens system 632 is a type of head worn lens system which uses a visor, a helmet, goggles or a cap to place the lenses 212 , 214 and optionally also the channel selection mechanisms 112 , 114 in front of both eyes 106 , 108 of the viewer 104 .
- a headband 634 positions the lens 212 , 214 over the eyes 106 , 108 .
- the variable focus lenses are a material (such as a liquid crystal materials, electro-active polymer gels, field deformable surfaces, or other optically switchable materials) so that the focus of the lenses may be adjusted in a manner known to those in the industry (see U.S. Pat. Nos. 4,190,330 and 6,619,799).
- sensors 222 are positioned on the headband 634 so they may detect movement of the eyes. While four sensors 222 are shown in FIG. 6 , any number from one or more may be used, and other components and processing algorithms may be applied.
- variable focus lens system such that the optical power provided by the lenses is substantially zero at a viewer-preferred focus plane, for example when the vergence of the eyes is consistent with viewing the physical display device.
- Another example could be to adjust the zero power plane such that both near and distant stereoscopic distances are comfortable for the viewer.
- Head-worn vision system 632 may also comprise one or more light emitting diodes (LED), not shown, which may be placed along with sensors 222 , to enable monitoring the head position of operator 104 by monitoring the position and orientation of the head-worn vision system 632 .
- LED light emitting diodes
- the operator's direction and location of gaze at any point in time can be sensed for enabling the dynamic lenses 212 , 214 when the operator 104 is viewing the stereoscopic 3D display or disable the dynamic lenses 212 , 214 when the operator 104 is not viewing the stereoscopic 3D display.
- the LEDs are preferably infrared in order to emit wavelengths not visible to the operator 109 and thereby not interfere with, e.g., operation of an aircraft and/or the view of the operator 109 .
- the present embodiment is not limited to the use of infrared LEDs or, in fact, is not limited to the use of LEDs, and may include any reflective surface or emissive device attachable to the head-worn vision system 632 that would allow sensing of the position and orientation of the head-worn vision system 632 and, consequently, determination of the direction of gaze or focus of the pilot.
- the sensor (not shown) for sensing the emissions from the LEDs on the head-worn vision system 632 may be positioned on a stationary nearby object. Other head-tracking configurations may also be used.
- one or more (but not all) of sensors 222 face forward to collect imagery of the forward scene. The forward scene is then analyzed in conjunction with the binocular gaze angles and focus plane distance detected as described above to determine the spatial location of binocular foveal interest.
- this detected location of interest is used to determine whether the operator is looking at the 3D display or not. This information is then used to enable or disable the variable focus 3D display functionality.
- One mode of operation when the 3D display content is not being viewed foveally is to switch the variable focus back to a nominal optical power setting.
- the preferred optical power setting in this case is zero optical power, but other nominal power settings can be used.
- the optical power of the variable focus eyewear continues to be adjusted based on vergence, but the optical power is actively increased as the convergence distance is decreased over a certain range when not viewing the 3D display or when no 3D display is present. This is analogous to providing reading glasses which automatically adjust their optical power based on convergence of the eyes. It is important to note that changes, if any, in response to convergence distance in this non-3D mode are generally in the opposite direction of those provided when viewing the 3D display, in other words optical power is increased rather than decreased as the convergence distance is decreased.
- variable focus stereoscopic display system As previously mentioned, many applications exist for the use of the variable focus stereoscopic display system and method described herein. Such a display system would be especially of benefit in an avionics environment such as a flight deck display system 700 ( FIG. 7 ) including a user interface 702 , a processor 704 , one or more terrain databases 706 (including runway and taxiway information), one or more navigation databases 708 , sensors 712 , external data sources 714 , one or more display devices 716 including the stereoscopic display ( FIG. 2 ), and the variable focus lens system 717 previously discussed.
- a flight deck display system 700 FIG. 7
- terrain databases 706 including runway and taxiway information
- navigation databases 708 including sensors 712
- external data sources 714 external data sources 714
- display devices 716 including the stereoscopic display ( FIG. 2 )
- variable focus lens system 717 previously discussed.
- the user interface 702 is in operable communication with the processor 704 and is configured to receive input from a user 709 (e.g., a pilot) and, in response to the user input, supplies command signals to the processor 704 .
- the user interface 702 may be any one, or combination, of various known user interface devices including, but not limited to, one or more buttons, switches, knobs, and touch panels (not shown).
- the processor 704 may be implemented or realized with a general purpose processor, a content addressable memory, a digital signal processor, an application specific integrated circuit, a field programmable gate array, any suitable programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination designed to perform the functions described herein.
- a processor device may be realized as a microprocessor, a controller, a microcontroller, or a state machine.
- a processor device may be implemented as a combination of computing devices, e.g., a combination of a digital signal processor and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a digital signal processor core, or any other such configuration.
- the processor 704 includes on-board RAM (random access memory) 703 , and on-board ROM (read-only memory) 705 .
- the program instructions that control the processor 704 may be stored in either or both the RAM 703 and the ROM 705 .
- the operating system software may be stored in the ROM 705
- various operating mode software routines and various operational parameters may be stored in the RAM 703 .
- the software executing the exemplary embodiment is stored in either the ROM 705 or the RAM 703 . It will be appreciated that this is merely exemplary of one scheme for storing operating system software and software routines, and that various other storage schemes may be implemented.
- the memory 703 , 705 may be realized as RAM memory, flash memory, EPROM memory, EEPROM memory, registers, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
- the memory 703 , 705 can be coupled to the processor 704 such that the processor 704 can be read information from, and write information to, the memory 703 , 705 .
- the memory 703 , 705 may be integral to the processor 704 .
- the processor 704 and the memory 703 , 705 may reside in an ASIC.
- a functional or logical module/component of the display system 700 might be realized using program code that is maintained in the memory 703 , 705 .
- the memory 703 , 705 can be used to store data utilized to support the operation of the display system 700 , as will become apparent from the following description.
- the processor 704 is in operable communication with the terrain databases 706 , the navigation databases 708 , and the display devices 716 , and is coupled to receive various types of inertial data from the sensors 712 , and various other avionics-related data from the external data sources 714 .
- the processor 704 is configured, in response to the inertial data and the avionics-related data, to selectively retrieve terrain data from one or more of the terrain databases 706 and navigation data from one or more of the navigation databases 708 , and to supply appropriate display commands to the display devices 716 .
- the display devices 716 in response to the display commands, selectively render various types of textual, graphic, and/or iconic information.
- the terrain databases 706 include various types of data representative of the taxiways and runways over which the aircraft is taxing, and the navigation databases 708 include various types of navigation-related data.
- the sensors 712 may be implemented using various types of inertial sensors, systems, and or subsystems, now known or developed in the future, for supplying various types of inertial data, for example, representative of the state of the aircraft including aircraft speed, heading, altitude, and attitude.
- the sensors 712 include an Infrared camera.
- the other avionics receivers 718 include, for example, an ILS receiver and a GPS receiver.
- the ILS receiver provides aircraft with horizontal (or localizer) and vertical (or glide slope) guidance just before and during landing and, at certain fixed points, indicates the distance to the reference point of landing on a particular runway.
- the ILS receiver may also give ground position.
- the GPS receiver is a multi-channel receiver, with each channel tuned to receive one or more of the GPS broadcast signals transmitted by the constellation of GPS satellites (not illustrated) orbiting the earth.
- the display devices 716 in response to display commands supplied from the processor 704 , selectively render various textual, graphic, and/or iconic information, and thereby supplies visual feedback to the user 709 .
- some of the display devices 716 may be implemented using any one of numerous known display devices suitable for rendering textual, graphic, and/or iconic information in a format viewable by the user 709 .
- Non-limiting examples of such display devices include various flat panel displays such as various types of LCD (liquid crystal display), TFT (thin film transistor) displays, and projection display LCD light engines.
- the display devices 716 may additionally be implemented as a panel mounted display, or any one of numerous known technologies.
- One or more of the display devices may be a stereoscopic 3D display as described herein.
- the display devices 716 may additionally be implemented as a panel mounted display, a HUD (head-up display) projection, or any one of numerous known technologies. It is additionally noted that the display devices 716 may be configured as any one of numerous types of aircraft flight deck displays. For example, it may be configured as a multi-function display, a horizontal situation indicator, a vertical situation indicator, or a primary flight display.
- the variable focus stereoscopic display system 717 preferably includes a variable focus lens system 632 .
- the preferred exemplary embodiment also includes the operator 709 of a vehicle, such as a flight crew member of an aircraft, wearing a variable focus lens system 632 .
- the first exemplary passive variable focus embodiment includes the lens 812 positioned between the left eye 106 and the stereoscopic display 102 , and the lens 814 positioned between the right eye 108 and the stereoscopic display 102 .
- a frontal view of the lenses 812 , 814 is shown in FIG. 9 .
- An inner portion 942 of each of the lenses 812 , 814 (adjacent to one another) is constructed with a lower (e.g., negative) optical power than a center portion 944 and optionally an outer portion as well.
- the lower optical power causes the effective focus plane to adjust closer to the viewer 104 from the physical focus plane 109 of the stereoscopic display 102 .
- the higher optical power causes the effective focus plane to adjust further from the viewer 104 , for example from the physical focus plane 109 of the stereoscopic display 102 to the vergence-related convergence plane 826 ( FIG. 8 ).
- the progression between regions of differing optical power can for example vary smoothly or via one or more discrete steps.
- the degree of focus compensation to be used may vary with the intended usage or individual preferences. This is true for both passive and active embodiments, as well as combinations of passive and active variable focus techniques wherein the stereoscopic 3D system would include both the dynamic and passive focus lenses. Some viewers may do best with a strong progressive variation, while others may prefer less compensation. This might be based on many factors, including but not limited to the presence of age-related presbyopia, details of the intended application, or level of prior experience with stereoscopic 3D displays (and perhaps a correspondingly higher tolerance of the vergence-accommodation mismatch).
- the vergence-dependent correction can be combined with appropriate individual optics or prescription and/or stereoscopic selection optics, as desired.
- the head and not just the eyes
- the lenses are positioned 50 mm or more from the eyes.
- a second exemplary passive variable focus embodiment ( FIG. 10 ) includes the lens 1012 positioned between the left eye 106 and the stereoscopic display 102 , and the lens 1014 positioned between the right eye 108 and the stereoscopic display 102 .
- a lower inner portion 1042 of each of the lenses 1012 , 1014 is constructed with a lower (more negative or less positive) optical power than an upper center and outer portion 1044 . Therefore, when the viewer 104 shifts his vision down and inward through the portions 1042 , the lower optical power causes the focus plane to adjust closer (not shown) to the viewer 104 from the physical focus plane 109 of the stereoscopic display 102 .
- the higher optical power causes the focus plane to adjust further from the viewer 104 from the focus plane 109 of the stereoscopic display 102 to the perceived depth or convergence plane 826 ( FIG. 8 ).
- the wearer can adjust the orientation to maximize the viewing comfort for the object or feature of interest by moving his head, and therefore the lenses, up or down. Due to the inclusion of the user repositioning, this variant may be best suited for applications which involve familiarity of use and deliberate emphasis on detail in particular portions of the stereoscopic space, such as remote manipulation, monitoring, modeling or analysis.
- optical power is largely inverted relative to traditional bifocal progression, but is still consistent with viewing near objects through the lower portion and more distant stereoscopic objects through the central or upper portions. Other arrangements can certainly be substituted.
- Active devices include adjusting the optical power of lenses while the passive devices have lenses constructed of spatially varying optical power.
Abstract
A variable focus stereoscopic display system includes first and second lenses positioned between a viewer's eyes and a stereoscopic display that alters the distance to the focus plane of the viewer based on the vergence of the viewer's eyes while viewing the stereoscopic display.
Description
- This is a Continuation of U.S. patent application Ser. No. 13/077,197, filed Mar. 31, 2011.
- The exemplary embodiments described herein generally relate to information displays and more particularly to stereoscopic displays.
- Three dimensional (3D) displays are becoming increasingly popular. Presently, many 3D displays implement stereoscopic techniques to generate a 3D visual display to a user. Such displays, which may be referred to as stereoscopic 3D displays, rely on the well known stereoscopic imaging technique for creating the illusion of depth in an image. As is generally known, stereoscopy is a method of creating a 3D image from a pair of two dimensional (2D) images, in which each of the 2D images preferably represents the same object or image from a slightly different perspective, such as a right eye perspective and a left eye perspective.
- Referring to
FIG. 1 , a typical prior artstereoscopic display 102 is configured to generate a 3D representation of an image viewable by aviewer 104. Aleft eye 106 and aright eye 108 of theviewer 104 are focused on afocus plane 109 at the stereoscopic display 102 (theviewer 104 is a binocular viewer having two eyes separated by an interpupillary distance 110). A left stereochannel selection mechanism 112 is positioned between theleft eye 106 and thestereoscopic display 102 and a right stereochannel selection mechanism 114 is positioned between theright eye 108 and thestereoscopic display 102. Two stereo perspective views, a left perspective view 116 and aright perspective view 118, of a single stereoscopic object orfeature 120 are presented to the binocular viewer with a convergence plane 122 (perceived location) based on vergence. The distance between thefocus plane 109 and theconvergence plane 122 is adepth cue disparity 121. Stereochannel selection mechanisms selection mechanisms stereo selection mechanisms left eye 106 to see onlyleft perspective view 116 andright eye 108 to see onlyright perspective view 118. When the viewer's gaze is directed atfeature 120, the perceived depth, or distance from the viewer, offeature 120 is determined by the intersection or converging of the lines of sight from the eyes to their respective perspective views. - Stereoscopic display systems, which provide enhanced interpretation of the information by users over two dimensional displays and can result in improvements in performing various tasks as well as various other potential benefits, may be used for applications which rely on periods of extended concentration and/or critical information, such as avionics, medical, engineering/industrial or military applications, and may also be used for applications of shorter concentration periods, such as entertainment applications, for example, movies. Stereoscopic 3D displays have been conventionally directed toward intermittent and non-critical applications such as entertainment and modeling. One of the lingering concerns of use for extended periods or critical information is the human tolerance for the vergence-accommodation disparity present in these displays. Vergence refers generally to the relative inward angle of the two eyes to detect depth, whereas accommodation refers to the distance for which the eyes are optically focused. Under normal real-world circumstances of viewing actual objects (including most two dimensional electronic displays), the vergence and accommodation cues typically match. Both of these cues are valid 3D depth or distance cues, along with a number of other 3D cues, for example, motion parallax, occlusion, relative size, absolute size, linear perspective, and shading/shadows. Conventional stereoscopic displays achieve the sensation of 3D by manipulating vergence cues while having the eyes remain focused on a fixed display surface or screen. This disparity between competing depth cues can result in viewer fatigue and discomfort, especially over an extended period of time, and can potentially interfere with the benefits of using a stereoscopic display. The potential for fatigue, including eyestrain, headaches or other discomfort, is generally believed to be increased as the degree of mismatch increases and can potentially interfere with the benefits of using a stereoscopic display.
- As the environment, such as aviation, in which these stereoscopic systems are used becomes more complex, it is preferable that the operator be attentive and receive information in a timely manner and with little stress (such as eye fatigue) to ensure proper operation. The user must interpret the information provided on the screen occupying his/her thought processes when he/she may have many other decisions to make.
- Accordingly, it is desirable to provide a method and system displaying information stereoscopically that may be more easily understood by the user without taxing human tolerances. Furthermore, other desirable features and characteristics of the exemplary embodiments will become apparent from the subsequent detailed description and the appended claims, taken in conjunction with the accompanying drawings and the foregoing technical field and background.
- Apparatus' and methods alter the distance to the focus plane of the stereoscopic 3D display based on the vergence of the eyes while viewing portions of the display. Embodiments include both active and passive methods.
- In a first exemplary embodiment, a variable focus stereoscopic display system defining a focus plane, the variable focus stereoscopic display system comprising a first lens configured to be positioned between a first eye and a stereoscopic display, and a second lens configured to be positioned between a second eye and the stereoscopic display, wherein the first and second lenses are configured to modify the distance of the focus plane from the first and second eyes in response to a vergence of the first and second eyes, and changes in the focus distance are positively correlated with changes in the convergence distance of the lines of sight of the first and second eyes.
- Another variable focus stereoscopic display comprises a focus plane, a first lens configured to be positioned over a first eye for viewing the stereoscopic display, a second lens configured to be positioned over a second eye for viewing the stereoscopic display, the first and second lenses each comprising a first portion having a first optical power, and a second portion having a second optical power higher than the first optical power, the first and second portions configured to increase the focus distance as the convergence distance increases (corresponding to decreased convergence), and to decrease the focus distance as the convergence distance decreases (corresponding to increased convergence).
- A method for adjusting a focus plane for viewing a stereoscopic display, comprising altering the distance of the focus plane from first and second eyes in response to vergence of the first and second eyes, wherein changes in the focus plane distance are positively correlated with changes in the convergence distance.
- The present invention will hereinafter be described in conjunction with the following drawing figures, wherein like numerals denote like elements, and
-
FIG. 1 is a prior art schematic of two eyes viewing a displayed feature on a stereoscopic display; -
FIG. 2 is a schematic of two eyes viewing a displayed feature on a stereoscopic display having a first shifted focus plane in accordance with an exemplary embodiment; -
FIG. 3 is a schematic of two eyes viewing a displayed feature on a stereoscopic display having a second shifted focus plane in accordance with an exemplary embodiment; -
FIG. 4 is a functional block diagram of a system in accordance with the exemplary embodiment ofFIG. 2 ; -
FIG. 5 is a flow chart of the method for implementing the exemplary embodiments; -
FIG. 6 is a near-to-eye stereoscopic display system in accordance with an exemplary embodiment; -
FIG. 7 is a functional block diagram of a aircraft display system in which the exemplary embodiments may be used; -
FIG. 8 is a schematic of two eyes viewing a displayed feature on a stereoscopic display having a shifted focus plane in accordance with another exemplary embodiment; -
FIG. 9 is a first pair of lenses for implementing the exemplary embodiment ofFIG. 8 ; and -
FIG. 10 is a second pair of lenses for implementing the exemplary embodiment ofFIG. 8 . - The following detailed description is merely illustrative in nature and is not intended to limit the embodiments of the subject matter or the application and uses of such embodiments. Any implementation described herein as exemplary is not necessarily to be construed as preferred or advantageous over other implementations. Furthermore, there is no intention to be bound by any expressed or implied theory presented in the preceding technical field, background, brief summary, or the following detailed description.
- A stereoscopic display system (three dimensional (3D)) provides two images of the same object taken from two perspectives that when viewed by two eyes are interpreted as an image having depth (depth perception). The stereoscopic display system described herein provides enhanced usability by users of the display, especially for applications which rely on extended duration and/or critical information, such as avionics, medical, engineering/industrial, or military applications. Entertainment-based applications would also benefit from these improvements even though the user has an increased opportunity to divert attention from the stereoscopic content and thereby reduce a strain on human tolerance.
- The exemplary embodiments described herein alter the distance to the focus plane of the stereoscopic 3D display based on the vergence of the eyes while viewing portions of the display. Embodiments include both active and passive methods.
- The following definitions apply as used herein. Convergence means central or foveal binocular lines of sight rotated inward and crossing at a point in front of the viewer. Increased and decreased convergence corresponds to the crossing point being closer to or further from the viewer, respectively. Substantially zero convergence corresponds to the crossing point being very distant, e.g., infinity, from the viewer. Divergence refers to the lines of sight diverging (moving apart) from zero convergence in front of the viewer, which is not normally the case for human viewers. Vergence describes the relationship of convergence to divergence. Focus distance is the distance from the eye to the effective apparent plane of focus as seen by the eye. Convergence distance is the distance from the eye to the convergence crossing point.
- A first embodiment involves the use of dynamic focus lenses over each eye. These lenses are preferably electro-optically adjustable, for example through the use of switchable liquid crystal materials, electro-active polymer gels, field deformable surfaces or other optically switchable materials.
- The drive signal for the lens pair is to be derived from a corresponding differential eye tracking sensor mechanism, such as one or more small sensors (cameras) which would detect the relative orientation or vergence of the two eyes. In one example, as the two eyes converge to a binocular representation of a particular object or feature in the stereoscopic image, the sensor would detect the apparent stereo distance from the eyes and would add or subtract optical power to the lenses to make the apparent focus distance of the object or feature match the convergence distance based on vergence cues. The variable focus lenses would preferably be adjusted to a more positive (or less negative) power to effectively increase the apparent focus distance when vergence cues indicate greater distance or depth. For showing an object at infinity, a preferred (but non-limiting) positive focal length for the lenses would be the distance from the lenses to the stereoscopic display screen or panel. For apparent depths close to the viewer and in front of the display, the lenses would preferably impart a somewhat negative (or less positive) optical power such that the eyes, including normally worn corrective eyewear or contact lenses, would have to focus closer to see a sharp image. In this manner, relative changes in the one depth cue, the focus distance, are positively correlated with relative changes in another depth cue, the convergence distance.
- While full compensation of the accommodation distance might completely remove visual fatigue, partial compensation may be sufficient. Visual fatigue from depth cue mismatches is difficult to quantify, and propensity for fatigue may vary significantly from person to person.
- A passive variable focus embodiment includes a suitable pair of progressive focus lenses. In typical bifocal or progressive lenses for reading or other close up work, the optical power of the lens most typically increases from top to bottom of the lens. In this embodiment, however, the optical power of the lens increases from the inner edge (converged lines of sight suggesting slight negative power in the variable focus lens) and reaching zero or preferably higher power toward the centers and outer regions of the progressive lenses.
- Yet another embodiment is a variant on the passive progressive lens approach which applies a correction while allowing somewhat more user control based on viewer head position. As in previous embodiments, there is a vergence-dependency of the optical power, but this is combined with an up/down tilt aspect.
- A further option is to combine these active and passive techniques to reduce the degree of actively switched optical power needed and at the same time relax the need to center the foveal view relative to the passive eyewear. Similarly, both active and passive methods can be used to restrict the variable power to the viewing of the particular display, while avoiding the variable power when looking away from the display. Numerous other similar techniques and/or apparatus are possible.
- While described in the context of a standard display, such as an active-matrix liquid crystal display, plasma, organic light emitting diode, projection, or other real image display, similar techniques can be used with a collimated display, such as a head up display or binocular near-to-eye display, which provides vergence cues.
- The system/approach as described applies the disclosed techniques to expand the range of accommodation or focus distance required of the viewer's eyes, so that instead of simply focusing on the plane of a stereoscopic display, the eyes focus over a larger and more natural range for the imagery being viewed. Another candidate usage for the above described techniques is to instead shrink the range of accommodation or focus distance required from the viewer's eyes when viewing a real world or other volumetric scene. This would be analogous to using conventional progressive or bifocal eyewear, except that the effective lens prescription being utilized would be controlled, either actively or through a combination of both active and passive techniques, based on actual eye vergence rather than tilting of the head. In this case, the progression of the optical power would preferably be reversed from the stereoscopic embodiments.
- The lenses described in the various embodiments may be implemented in any one of several arrangements, for example, binoculars, or embedded in a hardware system in which the viewer would move his eyes to the lenses or otherwise appropriate vantage point; however, the preferred embodiments are implemented in a head-worn system as described hereinafter. Additionally, the display may alternatively be included in the head worn system. Though the methods and systems may be implemented in any one of several environments, for example, medicine, modeling, and mobile vehicle such as automobiles, ships, and heavy machinery, the use in an aircraft system is described as an example.
- Techniques and technologies may be described herein in terms of functional and/or logical block components, and with reference to symbolic representations of operations, processing tasks, and functions that may be performed by various computing components or devices. Such operations, tasks, and functions may be referred to as being computer-executed, computerized, software-implemented, or computer-implemented. In practice, one or more processor devices can carry out the described operations, tasks, and functions by manipulating electrical signals representing data bits at memory locations in the system memory, as well as other processing of signals. The memory locations where data bits are maintained are physical locations that have particular electrical, magnetic, optical, or organic properties corresponding to the data bits. It should be appreciated that the various block components shown in the figures may be realized by any number of hardware, software, and/or firmware components configured to perform the specified functions. For example, an embodiment of a system or a component may employ various integrated circuit components, e.g., memory elements, digital signal processing elements, logic elements, look-up tables, or the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices.
- For the sake of brevity, conventional techniques related to graphics and image processing, navigation, flight planning, aircraft controls, and other functional aspects of certain systems and subsystems (and the individual operating components thereof) may not be described in detail herein. Furthermore, the connecting lines shown in the various figures contained herein are intended to represent exemplary functional relationships and/or physical couplings between the various elements. It should be noted that many alternative or additional functional relationships or physical connections may be present in an embodiment of the subject matter.
- Referring to
FIG. 2 and in accordance with an exemplary embodiment, like elements inFIG. 2 are identified with like reference numerals of those inFIG. 1 . Thestereoscopic display 102 may be implemented using any one of numerous suitable stereoscopic display devices now known or developed in the future. Thestereoscopic display 102 may also be implemented using either coplanar display media or non-coplanar display media. Asensor 222 is positioned with respect to theeyes viewer 104 for determining the amount, or degree, of vergence, typically convergence which is an inward viewing angle, of the eyes towards one another. Thesensor 222 could take any form capable of detecting the relative directions the twoeyes lenses sensor 222 could sense vergence via analysis of sensor imagery, or alternately could sense vergence by mechanical, electrical or any other means possible. Thelens 212 is positioned between theleft eye 106 and thestereoscopic display 102 and thelens 214 is positioned between theright eye 108 and thestereoscopic display 102. Theselenses -
FIG. 4 depicts a block diagram of asystem 400 in accordance with the present embodiments. Aprocessor 420 is coupled to thelenses sensor 222 regarding the degree of vergence and, in response thereto, adjust the strength of thelenses sensor 222 determines the eyes have rotated outward (away from one another, such that they are less converged), thelenses eyes FIG. 2 ) from the display screen 102 (where the eyes are focused without adjustment) to a focus plane 226 (FIG. 2 ) further from theeyes 106, 108 (the maximum line of sight would be infinity). Alternatively, if thesensor 222 senses the eyes have turned more inward (FIG. 3 ) towards one another (more converged), thelenses eyes convergence plane 332 closer to theeyes - This method (
FIG. 5 ) of adjusting the visual focus for viewing a stereoscopic display includes the step of altering the focus plane distance between a stereoscopic display focus plane and first and second eyes of a viewer in response to vergence of the first and second eyes, wherein changes in the focus plane distance are positively correlated with changes in the convergence distance for the first and second eyes' lines of sight. - The adjustment of the visual focus for a stereoscopic display may be accomplished in several types of systems, for example, the
vergence sensor 222 and thelenses lenses FIG. 6 ). Thelens system 632 is a type of head worn lens system which uses a visor, a helmet, goggles or a cap to place thelenses channel selection mechanisms eyes viewer 104. As shown, aheadband 634 positions thelens eyes sensors 222 are positioned on theheadband 634 so they may detect movement of the eyes. While foursensors 222 are shown inFIG. 6 , any number from one or more may be used, and other components and processing algorithms may be applied. In some applications it may be desirable to calibrate the variable focus lens system such that the optical power provided by the lenses is substantially zero at a viewer-preferred focus plane, for example when the vergence of the eyes is consistent with viewing the physical display device. Another example could be to adjust the zero power plane such that both near and distant stereoscopic distances are comfortable for the viewer. - Head-worn
vision system 632 may also comprise one or more light emitting diodes (LED), not shown, which may be placed along withsensors 222, to enable monitoring the head position ofoperator 104 by monitoring the position and orientation of the head-wornvision system 632. In this manner, the operator's direction and location of gaze at any point in time can be sensed for enabling thedynamic lenses operator 104 is viewing the stereoscopic 3D display or disable thedynamic lenses operator 104 is not viewing the stereoscopic 3D display. The LEDs are preferably infrared in order to emit wavelengths not visible to theoperator 109 and thereby not interfere with, e.g., operation of an aircraft and/or the view of theoperator 109. The present embodiment, however, is not limited to the use of infrared LEDs or, in fact, is not limited to the use of LEDs, and may include any reflective surface or emissive device attachable to the head-wornvision system 632 that would allow sensing of the position and orientation of the head-wornvision system 632 and, consequently, determination of the direction of gaze or focus of the pilot. The sensor (not shown) for sensing the emissions from the LEDs on the head-wornvision system 632 may be positioned on a stationary nearby object. Other head-tracking configurations may also be used. In one other exemplary embodiment, one or more (but not all) ofsensors 222 face forward to collect imagery of the forward scene. The forward scene is then analyzed in conjunction with the binocular gaze angles and focus plane distance detected as described above to determine the spatial location of binocular foveal interest. - In another embodiment, this detected location of interest is used to determine whether the operator is looking at the 3D display or not. This information is then used to enable or disable the variable focus 3D display functionality. One mode of operation when the 3D display content is not being viewed foveally is to switch the variable focus back to a nominal optical power setting. The preferred optical power setting in this case is zero optical power, but other nominal power settings can be used. In yet another embodiment, the optical power of the variable focus eyewear continues to be adjusted based on vergence, but the optical power is actively increased as the convergence distance is decreased over a certain range when not viewing the 3D display or when no 3D display is present. This is analogous to providing reading glasses which automatically adjust their optical power based on convergence of the eyes. It is important to note that changes, if any, in response to convergence distance in this non-3D mode are generally in the opposite direction of those provided when viewing the 3D display, in other words optical power is increased rather than decreased as the convergence distance is decreased.
- As previously mentioned, many applications exist for the use of the variable focus stereoscopic display system and method described herein. Such a display system would be especially of benefit in an avionics environment such as a flight deck display system 700 (
FIG. 7 ) including auser interface 702, aprocessor 704, one or more terrain databases 706 (including runway and taxiway information), one ormore navigation databases 708,sensors 712,external data sources 714, one ormore display devices 716 including the stereoscopic display (FIG. 2 ), and the variablefocus lens system 717 previously discussed. Theuser interface 702 is in operable communication with theprocessor 704 and is configured to receive input from a user 709 (e.g., a pilot) and, in response to the user input, supplies command signals to theprocessor 704. Theuser interface 702 may be any one, or combination, of various known user interface devices including, but not limited to, one or more buttons, switches, knobs, and touch panels (not shown). - The
processor 704 may be implemented or realized with a general purpose processor, a content addressable memory, a digital signal processor, an application specific integrated circuit, a field programmable gate array, any suitable programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination designed to perform the functions described herein. A processor device may be realized as a microprocessor, a controller, a microcontroller, or a state machine. Moreover, a processor device may be implemented as a combination of computing devices, e.g., a combination of a digital signal processor and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a digital signal processor core, or any other such configuration. In the depicted embodiment, theprocessor 704 includes on-board RAM (random access memory) 703, and on-board ROM (read-only memory) 705. The program instructions that control theprocessor 704 may be stored in either or both theRAM 703 and theROM 705. For example, the operating system software may be stored in theROM 705, whereas various operating mode software routines and various operational parameters may be stored in theRAM 703. The software executing the exemplary embodiment is stored in either theROM 705 or theRAM 703. It will be appreciated that this is merely exemplary of one scheme for storing operating system software and software routines, and that various other storage schemes may be implemented. - The
memory memory processor 704 such that theprocessor 704 can be read information from, and write information to, thememory memory processor 704. As an example, theprocessor 704 and thememory display system 700 might be realized using program code that is maintained in thememory memory display system 700, as will become apparent from the following description. - No matter how the
processor 704 is specifically implemented, it is in operable communication with theterrain databases 706, thenavigation databases 708, and thedisplay devices 716, and is coupled to receive various types of inertial data from thesensors 712, and various other avionics-related data from theexternal data sources 714. Theprocessor 704 is configured, in response to the inertial data and the avionics-related data, to selectively retrieve terrain data from one or more of theterrain databases 706 and navigation data from one or more of thenavigation databases 708, and to supply appropriate display commands to thedisplay devices 716. Thedisplay devices 716, in response to the display commands, selectively render various types of textual, graphic, and/or iconic information. - The
terrain databases 706 include various types of data representative of the taxiways and runways over which the aircraft is taxing, and thenavigation databases 708 include various types of navigation-related data. Thesensors 712 may be implemented using various types of inertial sensors, systems, and or subsystems, now known or developed in the future, for supplying various types of inertial data, for example, representative of the state of the aircraft including aircraft speed, heading, altitude, and attitude. In at least one described embodiment, thesensors 712 include an Infrared camera. Theother avionics receivers 718 include, for example, an ILS receiver and a GPS receiver. The ILS receiver provides aircraft with horizontal (or localizer) and vertical (or glide slope) guidance just before and during landing and, at certain fixed points, indicates the distance to the reference point of landing on a particular runway. The ILS receiver may also give ground position. The GPS receiver is a multi-channel receiver, with each channel tuned to receive one or more of the GPS broadcast signals transmitted by the constellation of GPS satellites (not illustrated) orbiting the earth. - The
display devices 716, as noted above, in response to display commands supplied from theprocessor 704, selectively render various textual, graphic, and/or iconic information, and thereby supplies visual feedback to theuser 709. It will be appreciated that some of thedisplay devices 716 may be implemented using any one of numerous known display devices suitable for rendering textual, graphic, and/or iconic information in a format viewable by theuser 709. Non-limiting examples of such display devices include various flat panel displays such as various types of LCD (liquid crystal display), TFT (thin film transistor) displays, and projection display LCD light engines. Thedisplay devices 716 may additionally be implemented as a panel mounted display, or any one of numerous known technologies. One or more of the display devices may be a stereoscopic 3D display as described herein. - The
display devices 716 may additionally be implemented as a panel mounted display, a HUD (head-up display) projection, or any one of numerous known technologies. It is additionally noted that thedisplay devices 716 may be configured as any one of numerous types of aircraft flight deck displays. For example, it may be configured as a multi-function display, a horizontal situation indicator, a vertical situation indicator, or a primary flight display. - The variable focus
stereoscopic display system 717 preferably includes a variablefocus lens system 632. The preferred exemplary embodiment also includes theoperator 709 of a vehicle, such as a flight crew member of an aircraft, wearing a variablefocus lens system 632. - Referring to
FIG. 8 , the first exemplary passive variable focus embodiment includes thelens 812 positioned between theleft eye 106 and thestereoscopic display 102, and thelens 814 positioned between theright eye 108 and thestereoscopic display 102. A frontal view of thelenses FIG. 9 . Aninner portion 942 of each of thelenses 812, 814 (adjacent to one another) is constructed with a lower (e.g., negative) optical power than acenter portion 944 and optionally an outer portion as well. Therefore, as the stereoscopic binocular disparity causes theviewer 104 to look more inward through theportions 942, the lower optical power causes the effective focus plane to adjust closer to theviewer 104 from thephysical focus plane 109 of thestereoscopic display 102. Conversely, as the three dimensional view causes theviewer 104 to look less inward and more forward, with reduced convergence, through theportions 944, the higher optical power causes the effective focus plane to adjust further from theviewer 104, for example from thephysical focus plane 109 of thestereoscopic display 102 to the vergence-related convergence plane 826 (FIG. 8 ). The progression between regions of differing optical power can for example vary smoothly or via one or more discrete steps. - The degree of focus compensation to be used may vary with the intended usage or individual preferences. This is true for both passive and active embodiments, as well as combinations of passive and active variable focus techniques wherein the stereoscopic 3D system would include both the dynamic and passive focus lenses. Some viewers may do best with a strong progressive variation, while others may prefer less compensation. This might be based on many factors, including but not limited to the presence of age-related presbyopia, details of the intended application, or level of prior experience with stereoscopic 3D displays (and perhaps a correspondingly higher tolerance of the vergence-accommodation mismatch). The vergence-dependent correction can be combined with appropriate individual optics or prescription and/or stereoscopic selection optics, as desired. In the passive eyewear example, best compensation will be achieved when the head (and not just the eyes) is aimed toward the displayed object or feature of interest, for extended viewing of specific features in the displayed image. Some additional benefit may possibly be obtained by extending the distance from the eyes to the lenses, thereby spreading the progressive power across a larger portion of the lens area. In one exemplary embodiment, the lenses are positioned 50 mm or more from the eyes.
- A second exemplary passive variable focus embodiment (
FIG. 10 ) includes thelens 1012 positioned between theleft eye 106 and thestereoscopic display 102, and thelens 1014 positioned between theright eye 108 and thestereoscopic display 102. A lowerinner portion 1042 of each of thelenses outer portion 1044. Therefore, when theviewer 104 shifts his vision down and inward through theportions 1042, the lower optical power causes the focus plane to adjust closer (not shown) to theviewer 104 from thephysical focus plane 109 of thestereoscopic display 102. Conversely, as theviewer 104 shifts his view more outward and up through theportions 1044, the higher optical power causes the focus plane to adjust further from theviewer 104 from thefocus plane 109 of thestereoscopic display 102 to the perceived depth or convergence plane 826 (FIG. 8 ). In a manner similar to the use of traditional bifocal or progressive lens eyewear, the wearer can adjust the orientation to maximize the viewing comfort for the object or feature of interest by moving his head, and therefore the lenses, up or down. Due to the inclusion of the user repositioning, this variant may be best suited for applications which involve familiarity of use and deliberate emphasis on detail in particular portions of the stereoscopic space, such as remote manipulation, monitoring, modeling or analysis. This approach may be less suitable for applications such as entertainment where the region of emphasis is less predictable. The variation of optical power is largely inverted relative to traditional bifocal progression, but is still consistent with viewing near objects through the lower portion and more distant stereoscopic objects through the central or upper portions. Other arrangements can certainly be substituted. - In summary, several exemplary embodiments have been described, including both active and passive devices, of a variable focus stereoscopic display apparatus for varying the focus in response to changing vergence of the viewer. Active devices include adjusting the optical power of lenses while the passive devices have lenses constructed of spatially varying optical power.
- While at least one exemplary embodiment has been presented in the foregoing detailed description, it should be appreciated that a vast number of variations exist. It should also be appreciated that the exemplary embodiment or exemplary embodiments are only examples, and are not intended to limit the scope, applicability, or configuration of the invention in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient road map for implementing an exemplary embodiment of the invention, it being understood that various changes may be made in the function and arrangement of elements described in an exemplary embodiment without departing from the scope of the invention as set forth in the appended claims.
Claims (15)
1. A variable focus stereoscopic display system modifying a focus distance for viewing a stereoscopic display receiving image data, the variable focus stereoscopic display system comprising:
a first lens positioned between a first eye and the stereoscopic display;
a second lens positioned between a second eye and the stereoscopic display; and
wherein the first and second lenses are configured to modify the optical power for the variable focus stereoscopic display system and therefore the focus distance, the modification of the focus distance comprising being based on a vergence of the first and second eyes, changes in the focus distance are positively correlated with changes in a convergence distance of lines of sight of the first and second eyes, and the changes in the focus distance are determined independently from the image data.
2. The variable focus stereoscopic display system of claim 1 further comprising:
a sensor configured to sense an amount of the vergence; and
a controller configured to modify the optical power of the first and second lenses in response to the amount of the vergence.
3. The variable focus stereoscopic display system of claim 1 wherein each of the first and second lenses comprise:
a first portion having a first optical power; and
a second portion having a second optical power greater than the first optical power.
4. The variable focus stereoscopic display system of claim 3 wherein the first portions of the first and second lenses are adjacent to one another.
5. The variable focus stereoscopic display system of claim 3 wherein the first portions of the first and second lenses are offset from the second portions with respect to a line between the first and second eyes.
6. The variable focus stereoscopic display system of claim 1 further comprising:
a sensor configured to sense an amount of the vergence;
a controller configured to modify the optical power of the first and second lenses in response to the amount of the vergence;
a third lens positioned between the first eye and the stereoscopic display; and
a fourth lens positioned between the second eye and the stereoscopic display;
wherein each of the third and fourth lenses comprise:
a first portion having a first optical power; and
a second portion having a second optical power greater than the first optical power.
7. The variable focus stereoscopic display system of claim 1 further comprising:
an apparatus configured to track a direction of a gaze of the eyes and enable the variable focus stereoscopic display system when the eyes are viewing the stereoscopic display and disable the variable focus stereoscopic display system when the eyes are not viewing the stereoscopic display.
8. The variable focus stereoscopic display system of claim 1 wherein the first and second lenses are calibrated to provide about a zero optical power at a viewer preferred focus distance.
9. The variable focus stereoscopic display system of claim 1 further comprising:
a flight deck display system of an aircraft including the stereoscopic display.
10. A method for adjusting a focus plane for viewing a stereoscopic display, comprising:
sensing an amount of the vergence;
altering a distance of the focus plane from first and second eyes in response to vergence of the first and second eyes, wherein changes in the focus plane distance are correlated with changes in the vergence such that the disparity between focus plane and a plurality of cues associated with the vergence are reduced from prior to the distance being altered;
modifying, in response to the amount of the vergence, an optical power of a first lens and a second lens positioned between the stereoscopic display and the first and second eyes, respectively; and
generating image data to be displayed, wherein generation of the image data is independent of the sensed amount of vergence, and sensing the amount of vergence is independent of the image data.
11. The method of claim 10 wherein the altering step comprises changing the view of the stereoscopic display from a first portion of each of the first and second lenses to a second portion of each of the first and second lenses in response to a line of sight of the first and second eyes, the second portion having an optical power different than the first portion such that changes in the focus plane distance are positively correlated with changes in a convergence distance associated with the cues.
12. The method of claim 10 wherein the first and second lenses comprise a single lens region.
13. The method of claim 10 further comprising:
tracking the direction of the gaze of the eyes; and
disabling the altering step when the first and second eyes are not viewing the stereoscopic display.
14. The method of claim 13 further comprising:
switching the focus plane to a nominal optical power setting when the altering step is disabled.
15. The method of claim 13 further comprising:
increasing the optical power as a convergence distance associated with the cues is decreased when the altering step is disabled.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/506,849 US20150022887A1 (en) | 2011-03-31 | 2014-10-06 | Variable focus stereoscopic display system and method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/077,197 US8953242B2 (en) | 2011-03-31 | 2011-03-31 | Varible focus stereoscopic display system and method |
US14/506,849 US20150022887A1 (en) | 2011-03-31 | 2014-10-06 | Variable focus stereoscopic display system and method |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/077,197 Continuation US8953242B2 (en) | 2011-03-31 | 2011-03-31 | Varible focus stereoscopic display system and method |
Publications (1)
Publication Number | Publication Date |
---|---|
US20150022887A1 true US20150022887A1 (en) | 2015-01-22 |
Family
ID=46926935
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/077,197 Active 2032-03-14 US8953242B2 (en) | 2011-03-31 | 2011-03-31 | Varible focus stereoscopic display system and method |
US14/506,849 Abandoned US20150022887A1 (en) | 2011-03-31 | 2014-10-06 | Variable focus stereoscopic display system and method |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/077,197 Active 2032-03-14 US8953242B2 (en) | 2011-03-31 | 2011-03-31 | Varible focus stereoscopic display system and method |
Country Status (1)
Country | Link |
---|---|
US (2) | US8953242B2 (en) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018027015A1 (en) * | 2016-08-04 | 2018-02-08 | Dolby Laboratories Licensing Corporation | Single depth tracked accommodation-vergence solutions |
US10890759B1 (en) | 2019-11-15 | 2021-01-12 | Microsoft Technology Licensing, Llc | Automated variable-focus lens control to reduce user discomfort in a head-mounted display |
US10943359B2 (en) | 2016-08-04 | 2021-03-09 | Dolby Laboratories Licensing Corporation | Single depth tracked accommodation-vergence solutions |
US11006101B2 (en) | 2016-01-29 | 2021-05-11 | Hewlett-Packard Development Company, L.P. | Viewing device adjustment based on eye accommodation in relation to a display |
US11051006B2 (en) * | 2018-02-27 | 2021-06-29 | Looking Glass Factory, Inc. | Superstereoscopic display with enhanced off-angle separation |
US11388388B2 (en) | 2020-12-01 | 2022-07-12 | Looking Glass Factory, Inc. | System and method for processing three dimensional images |
US11415935B2 (en) | 2020-06-23 | 2022-08-16 | Looking Glass Factory, Inc. | System and method for holographic communication |
US11415728B2 (en) | 2020-05-27 | 2022-08-16 | Looking Glass Factory, Inc. | System and method for holographic displays |
US11449004B2 (en) | 2020-05-21 | 2022-09-20 | Looking Glass Factory, Inc. | System and method for holographic image display |
US11758119B2 (en) | 2022-01-19 | 2023-09-12 | Rockwell Collins, Inc. | Low cost HUD using stereo and head tracking |
Families Citing this family (134)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8668334B2 (en) * | 2006-02-27 | 2014-03-11 | Vital Art And Science Incorporated | Vision measurement and training system and method of operation thereof |
EP3836539B1 (en) | 2007-10-10 | 2024-03-13 | Gerard Dirk Smits | Image projector with reflected light tracking |
US9158116B1 (en) | 2014-04-25 | 2015-10-13 | Osterhout Group, Inc. | Temple and ear horn assembly for headworn computer |
US9952664B2 (en) | 2014-01-21 | 2018-04-24 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US20150277120A1 (en) | 2014-01-21 | 2015-10-01 | Osterhout Group, Inc. | Optical configurations for head worn computing |
US20150205111A1 (en) | 2014-01-21 | 2015-07-23 | Osterhout Group, Inc. | Optical configurations for head worn computing |
US9366867B2 (en) | 2014-07-08 | 2016-06-14 | Osterhout Group, Inc. | Optical systems for see-through displays |
US9965681B2 (en) | 2008-12-16 | 2018-05-08 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9298007B2 (en) | 2014-01-21 | 2016-03-29 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9400390B2 (en) | 2014-01-24 | 2016-07-26 | Osterhout Group, Inc. | Peripheral lighting for head worn computing |
US9229233B2 (en) | 2014-02-11 | 2016-01-05 | Osterhout Group, Inc. | Micro Doppler presentations in head worn computing |
US9715112B2 (en) | 2014-01-21 | 2017-07-25 | Osterhout Group, Inc. | Suppression of stray light in head worn computing |
SI2427095T1 (en) | 2009-05-09 | 2023-11-30 | Genentech, Inc., | Shape discrimination vision assessment and tracking system |
US9946076B2 (en) * | 2010-10-04 | 2018-04-17 | Gerard Dirk Smits | System and method for 3-D projection and enhancements for interactivity |
US8594381B2 (en) * | 2010-11-17 | 2013-11-26 | Eastman Kodak Company | Method of identifying motion sickness |
US8754929B1 (en) * | 2011-05-23 | 2014-06-17 | John Prince | Real time vergence control for 3D video capture and display |
KR20130008334A (en) * | 2011-07-12 | 2013-01-22 | 삼성전자주식회사 | Vergence control method for stereo-scopic image control and portable device supporting the same |
US8952958B1 (en) * | 2012-07-31 | 2015-02-10 | Dreamworks Animation Llc | Stereoscopic computer-animation techniques based on perceptual constraints |
US9129436B2 (en) | 2012-08-01 | 2015-09-08 | Dreamworks Animation Llc | Techniques for smoothing scripted stereo curves for stereoscopic computer animation |
US8971568B1 (en) | 2012-10-08 | 2015-03-03 | Gerard Dirk Smits | Method, apparatus, and manufacture for document writing and annotation with virtual ink |
US9483111B2 (en) * | 2013-03-14 | 2016-11-01 | Intel Corporation | Techniques to improve viewing comfort for three-dimensional content |
US9398847B2 (en) * | 2013-10-19 | 2016-07-26 | Valve Corporation | Device for measuring interpupillary distance in a head-mounted display unit |
US20150187115A1 (en) * | 2013-12-27 | 2015-07-02 | Mark A. MacDonald | Dynamically adjustable 3d goggles |
JP6608137B2 (en) * | 2014-01-03 | 2019-11-20 | ハーマン インターナショナル インダストリーズ インコーポレイテッド | Detection of binocular transduction on display |
US20150228119A1 (en) | 2014-02-11 | 2015-08-13 | Osterhout Group, Inc. | Spatial location presentation in head worn computing |
US20160019715A1 (en) | 2014-07-15 | 2016-01-21 | Osterhout Group, Inc. | Content presentation in head worn computing |
US9746686B2 (en) | 2014-05-19 | 2017-08-29 | Osterhout Group, Inc. | Content position calibration in head worn computing |
US10254856B2 (en) | 2014-01-17 | 2019-04-09 | Osterhout Group, Inc. | External user interface for head worn computing |
US9366868B2 (en) | 2014-09-26 | 2016-06-14 | Osterhout Group, Inc. | See-through computer display systems |
US20150277118A1 (en) | 2014-03-28 | 2015-10-01 | Osterhout Group, Inc. | Sensor dependent content position in head worn computing |
US10649220B2 (en) | 2014-06-09 | 2020-05-12 | Mentor Acquisition One, Llc | Content presentation in head worn computing |
US9810906B2 (en) | 2014-06-17 | 2017-11-07 | Osterhout Group, Inc. | External user interface for head worn computing |
US10684687B2 (en) | 2014-12-03 | 2020-06-16 | Mentor Acquisition One, Llc | See-through computer display systems |
US9448409B2 (en) | 2014-11-26 | 2016-09-20 | Osterhout Group, Inc. | See-through computer display systems |
US9575321B2 (en) | 2014-06-09 | 2017-02-21 | Osterhout Group, Inc. | Content presentation in head worn computing |
US9829707B2 (en) | 2014-08-12 | 2017-11-28 | Osterhout Group, Inc. | Measuring content brightness in head worn computing |
US10191279B2 (en) | 2014-03-17 | 2019-01-29 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9671613B2 (en) | 2014-09-26 | 2017-06-06 | Osterhout Group, Inc. | See-through computer display systems |
US11227294B2 (en) | 2014-04-03 | 2022-01-18 | Mentor Acquisition One, Llc | Sight information collection in head worn computing |
US9939934B2 (en) | 2014-01-17 | 2018-04-10 | Osterhout Group, Inc. | External user interface for head worn computing |
US9841599B2 (en) | 2014-06-05 | 2017-12-12 | Osterhout Group, Inc. | Optical configurations for head-worn see-through displays |
US9529195B2 (en) | 2014-01-21 | 2016-12-27 | Osterhout Group, Inc. | See-through computer display systems |
US9299194B2 (en) * | 2014-02-14 | 2016-03-29 | Osterhout Group, Inc. | Secure sharing in head worn computing |
US11103122B2 (en) | 2014-07-15 | 2021-08-31 | Mentor Acquisition One, Llc | Content presentation in head worn computing |
US9594246B2 (en) | 2014-01-21 | 2017-03-14 | Osterhout Group, Inc. | See-through computer display systems |
US11892644B2 (en) | 2014-01-21 | 2024-02-06 | Mentor Acquisition One, Llc | See-through computer display systems |
US9494800B2 (en) | 2014-01-21 | 2016-11-15 | Osterhout Group, Inc. | See-through computer display systems |
US9523856B2 (en) | 2014-01-21 | 2016-12-20 | Osterhout Group, Inc. | See-through computer display systems |
US11737666B2 (en) | 2014-01-21 | 2023-08-29 | Mentor Acquisition One, Llc | Eye imaging in head worn computing |
US9811159B2 (en) | 2014-01-21 | 2017-11-07 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US11669163B2 (en) | 2014-01-21 | 2023-06-06 | Mentor Acquisition One, Llc | Eye glint imaging in see-through computer display systems |
US9532714B2 (en) | 2014-01-21 | 2017-01-03 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US20150205135A1 (en) | 2014-01-21 | 2015-07-23 | Osterhout Group, Inc. | See-through computer display systems |
US11487110B2 (en) | 2014-01-21 | 2022-11-01 | Mentor Acquisition One, Llc | Eye imaging in head worn computing |
US9836122B2 (en) | 2014-01-21 | 2017-12-05 | Osterhout Group, Inc. | Eye glint imaging in see-through computer display systems |
US9766463B2 (en) | 2014-01-21 | 2017-09-19 | Osterhout Group, Inc. | See-through computer display systems |
US9753288B2 (en) | 2014-01-21 | 2017-09-05 | Osterhout Group, Inc. | See-through computer display systems |
US9651784B2 (en) | 2014-01-21 | 2017-05-16 | Osterhout Group, Inc. | See-through computer display systems |
US9310610B2 (en) | 2014-01-21 | 2016-04-12 | Osterhout Group, Inc. | See-through computer display systems |
US9846308B2 (en) | 2014-01-24 | 2017-12-19 | Osterhout Group, Inc. | Haptic systems for head-worn computers |
US9852545B2 (en) | 2014-02-11 | 2017-12-26 | Osterhout Group, Inc. | Spatial location presentation in head worn computing |
US20150241963A1 (en) | 2014-02-11 | 2015-08-27 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9401540B2 (en) | 2014-02-11 | 2016-07-26 | Osterhout Group, Inc. | Spatial location presentation in head worn computing |
US9377626B2 (en) * | 2014-02-18 | 2016-06-28 | Merge Labs, Inc. | Remote control augmented motion data capture |
WO2015145933A1 (en) * | 2014-03-26 | 2015-10-01 | パナソニックIpマネジメント株式会社 | Virtual image display device, head-up display system, and vehicle |
US9810913B2 (en) | 2014-03-28 | 2017-11-07 | Gerard Dirk Smits | Smart head-mounted projection system |
US20160187651A1 (en) | 2014-03-28 | 2016-06-30 | Osterhout Group, Inc. | Safety for a vehicle operator with an hmd |
US9423842B2 (en) | 2014-09-18 | 2016-08-23 | Osterhout Group, Inc. | Thermal management for head-worn computer |
US20150309534A1 (en) | 2014-04-25 | 2015-10-29 | Osterhout Group, Inc. | Ear horn assembly for headworn computer |
US9651787B2 (en) | 2014-04-25 | 2017-05-16 | Osterhout Group, Inc. | Speaker assembly for headworn computer |
US9672210B2 (en) | 2014-04-25 | 2017-06-06 | Osterhout Group, Inc. | Language translation with head-worn computing |
US10853589B2 (en) | 2014-04-25 | 2020-12-01 | Mentor Acquisition One, Llc | Language translation with head-worn computing |
US20160137312A1 (en) | 2014-05-06 | 2016-05-19 | Osterhout Group, Inc. | Unmanned aerial vehicle launch system |
KR102262086B1 (en) * | 2014-05-28 | 2021-06-09 | 삼성전자 주식회사 | Apparatus and method for processing image |
US10663740B2 (en) | 2014-06-09 | 2020-05-26 | Mentor Acquisition One, Llc | Content presentation in head worn computing |
US9880401B2 (en) * | 2014-06-13 | 2018-01-30 | Verily Life Sciences Llc | Method, device and system for accessing an eye-mountable device with a user interface |
US9377533B2 (en) | 2014-08-11 | 2016-06-28 | Gerard Dirk Smits | Three-dimensional triangulation and time-of-flight based tracking systems and methods |
US9699436B2 (en) * | 2014-09-16 | 2017-07-04 | Microsoft Technology Licensing, Llc | Display with eye-discomfort reduction |
US9910286B2 (en) | 2014-11-21 | 2018-03-06 | Colleen Woolpert | TwinScope 3-D viewer |
US9684172B2 (en) | 2014-12-03 | 2017-06-20 | Osterhout Group, Inc. | Head worn computer display systems |
USD743963S1 (en) | 2014-12-22 | 2015-11-24 | Osterhout Group, Inc. | Air mouse |
USD751552S1 (en) | 2014-12-31 | 2016-03-15 | Osterhout Group, Inc. | Computer glasses |
USD753114S1 (en) | 2015-01-05 | 2016-04-05 | Osterhout Group, Inc. | Air mouse |
US10878775B2 (en) | 2015-02-17 | 2020-12-29 | Mentor Acquisition One, Llc | See-through computer display systems |
US20160239985A1 (en) | 2015-02-17 | 2016-08-18 | Osterhout Group, Inc. | See-through computer display systems |
WO2016154026A2 (en) | 2015-03-20 | 2016-09-29 | Castar, Inc. | Retroreflective light field display |
WO2016168378A1 (en) | 2015-04-13 | 2016-10-20 | Gerard Dirk Smits | Machine vision for ego-motion, segmenting, and classifying objects |
US10139966B2 (en) | 2015-07-22 | 2018-11-27 | Osterhout Group, Inc. | External user interface for head worn computing |
US9753126B2 (en) | 2015-12-18 | 2017-09-05 | Gerard Dirk Smits | Real time position sensing of objects |
US9813673B2 (en) | 2016-01-20 | 2017-11-07 | Gerard Dirk Smits | Holographic video capture and telepresence system |
US10591728B2 (en) | 2016-03-02 | 2020-03-17 | Mentor Acquisition One, Llc | Optical systems for head-worn computers |
US10850116B2 (en) | 2016-12-30 | 2020-12-01 | Mentor Acquisition One, Llc | Head-worn therapy device |
US10667981B2 (en) | 2016-02-29 | 2020-06-02 | Mentor Acquisition One, Llc | Reading assistance system for visually impaired |
US9880441B1 (en) | 2016-09-08 | 2018-01-30 | Osterhout Group, Inc. | Electrochromic systems for head-worn computer systems |
US9826299B1 (en) | 2016-08-22 | 2017-11-21 | Osterhout Group, Inc. | Speaker systems for head-worn computer systems |
US10684478B2 (en) | 2016-05-09 | 2020-06-16 | Mentor Acquisition One, Llc | User interface systems for head-worn computers |
US10824253B2 (en) | 2016-05-09 | 2020-11-03 | Mentor Acquisition One, Llc | User interface systems for head-worn computers |
US9910284B1 (en) | 2016-09-08 | 2018-03-06 | Osterhout Group, Inc. | Optical systems for head-worn computers |
US10466491B2 (en) | 2016-06-01 | 2019-11-05 | Mentor Acquisition One, Llc | Modular systems for head-worn computers |
US20170351107A1 (en) * | 2016-06-03 | 2017-12-07 | GM Global Technology Operations LLC | Display system and method of creating an apparent three-dimensional image of an object |
CN106257321B (en) * | 2016-06-28 | 2021-11-30 | 京东方科技集团股份有限公司 | 3D head-up display system and method |
US10690936B2 (en) | 2016-08-29 | 2020-06-23 | Mentor Acquisition One, Llc | Adjustable nose bridge assembly for headworn computer |
JP6732617B2 (en) * | 2016-09-21 | 2020-07-29 | 株式会社ソニー・インタラクティブエンタテインメント | Information processing apparatus and image generation method |
US10338409B2 (en) | 2016-10-09 | 2019-07-02 | eyeBrain Medical, Inc. | Lens with off-axis curvature center |
USD840395S1 (en) | 2016-10-17 | 2019-02-12 | Osterhout Group, Inc. | Head-worn computer |
CN110073243B (en) | 2016-10-31 | 2023-08-04 | 杰拉德·迪尔克·施密茨 | Fast scanning lidar using dynamic voxel detection |
CN108062487A (en) * | 2016-11-09 | 2018-05-22 | 英业达科技有限公司 | For the electronic device of peep-proof and varifocal glasses and peep-proof vision method |
CN110226184B (en) | 2016-12-27 | 2023-07-14 | 杰拉德·迪尔克·施密茨 | System and method for machine perception |
USD864959S1 (en) | 2017-01-04 | 2019-10-29 | Mentor Acquisition One, Llc | Computer glasses |
WO2018200993A1 (en) | 2017-04-28 | 2018-11-01 | Zermatt Technologies Llc | Video pipeline |
US10979685B1 (en) * | 2017-04-28 | 2021-04-13 | Apple Inc. | Focusing for virtual and augmented reality systems |
JP7246322B2 (en) | 2017-05-10 | 2023-03-27 | ジェラルド ディルク スミッツ | Scanning mirror system and method |
US11409105B2 (en) | 2017-07-24 | 2022-08-09 | Mentor Acquisition One, Llc | See-through computer display systems |
US10578869B2 (en) | 2017-07-24 | 2020-03-03 | Mentor Acquisition One, Llc | See-through computer display systems with adjustable zoom cameras |
US10422995B2 (en) | 2017-07-24 | 2019-09-24 | Mentor Acquisition One, Llc | See-through computer display systems with stray light management |
US10969584B2 (en) | 2017-08-04 | 2021-04-06 | Mentor Acquisition One, Llc | Image expansion optic for head-worn computer |
US11589745B2 (en) | 2017-09-05 | 2023-02-28 | Neurolens, Inc. | Method and system for measuring binocular alignment |
US10420467B2 (en) * | 2017-09-05 | 2019-09-24 | eyeBrain Medical, Inc. | Method and system for measuring binocular alignment |
US10591605B2 (en) | 2017-10-19 | 2020-03-17 | Gerard Dirk Smits | Methods and systems for navigating a vehicle including a novel fiducial marker system |
US10921614B2 (en) | 2017-12-31 | 2021-02-16 | Neurolens, Inc. | Low-convergence negative power spectacles |
US11360329B2 (en) | 2017-12-31 | 2022-06-14 | Neurolens, Inc. | Negative power eye-strain reducing lens |
US10908434B2 (en) | 2018-01-01 | 2021-02-02 | Neurolens, Inc. | Negative power lens with off-axis curvature center |
US10379220B1 (en) | 2018-01-29 | 2019-08-13 | Gerard Dirk Smits | Hyper-resolved, high bandwidth scanned LIDAR systems |
KR102065636B1 (en) * | 2018-07-17 | 2020-01-13 | 한국기술교육대학교 산학협력단 | An optical lens system capable of adjusting variable focal length and variable focal direction, a control method therefor, and glasses having the same |
CN112771439A (en) * | 2018-09-27 | 2021-05-07 | 三井化学株式会社 | Eyewear and program |
CN111328380B (en) | 2018-10-15 | 2023-04-04 | 国立大学法人东京农工大学 | Head-mounted display and method for designing wide-focus lens used in head-mounted display |
WO2021174227A1 (en) | 2020-02-27 | 2021-09-02 | Gerard Dirk Smits | High resolution scanning of remote objects with fast sweeping laser beams and signal recovery by twitchy pixel array |
GB2594966A (en) * | 2020-05-13 | 2021-11-17 | Sony Interactive Entertainment Inc | Gaze tracking apparatus and systems |
JP2020175889A (en) * | 2020-06-29 | 2020-10-29 | 株式会社リコー | Information providing device, information providing method, and control program for providing information |
CN112748768B (en) * | 2020-12-25 | 2022-07-12 | 深圳市创族智能实业有限公司 | Tablet personal computer capable of correcting presbyopia for the elderly |
CN113268785B (en) * | 2021-07-19 | 2022-05-24 | 军事科学院系统工程研究院网络信息研究所 | Peep-proof display method based on target identification and automatic focusing |
US20230185090A1 (en) * | 2021-12-13 | 2023-06-15 | Miller Schuck | Eyewear including a non-uniform push-pull lens set |
US11586286B1 (en) | 2022-05-18 | 2023-02-21 | Bank Of America Corporation | System and method for navigating on an augmented reality display |
US11720380B1 (en) | 2022-05-18 | 2023-08-08 | Bank Of America Corporation | System and method for updating augmented reality navigation instructions based on a detected error |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5886822A (en) * | 1996-10-08 | 1999-03-23 | The Microoptical Corporation | Image combining system for eyeglasses and face masks |
Family Cites Families (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR1509090A (en) | 1966-11-29 | 1968-01-12 | Lunetiers Cottet Poichet Soc D | Improvements to ophthalmic lenses with progressively variable focal power |
JPH0685590B2 (en) * | 1985-11-15 | 1994-10-26 | 株式会社日立製作所 | Stereoscopic display system |
US4830482A (en) | 1987-08-21 | 1989-05-16 | Resnikoff Howard L | True-focus bifocal eyeglasses |
US5175616A (en) | 1989-08-04 | 1992-12-29 | Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of National Defence Of Canada | Stereoscopic video-graphic coordinate specification system |
JPH03292093A (en) * | 1990-04-10 | 1991-12-24 | Seiko Epson Corp | Three-dimensional display device |
US5293187A (en) | 1992-02-05 | 1994-03-08 | Biocontrol Systems, Inc. | Method and apparatus for eye tracking for convergence and strabismus measurement |
US5422653A (en) | 1993-01-07 | 1995-06-06 | Maguire, Jr.; Francis J. | Passive virtual reality |
US6778150B1 (en) | 1993-09-14 | 2004-08-17 | Francis J. Maguire, Jr. | Method and apparatus for eye tracking |
EP0644701B1 (en) * | 1993-09-20 | 1999-12-01 | Canon Kabushiki Kaisha | Image taking and/or displaying system |
JP3478606B2 (en) | 1994-10-12 | 2003-12-15 | キヤノン株式会社 | Stereoscopic image display method and apparatus |
JPH08322004A (en) * | 1995-05-24 | 1996-12-03 | Olympus Optical Co Ltd | Stereoscopic display device |
EP0785457A3 (en) * | 1996-01-17 | 1998-10-14 | Nippon Telegraph And Telephone Corporation | Optical device and three-dimensional display device |
JP3771964B2 (en) | 1996-03-12 | 2006-05-10 | オリンパス株式会社 | 3D image display device |
US6072443A (en) * | 1996-03-29 | 2000-06-06 | Texas Instruments Incorporated | Adaptive ocular projection display |
GB9623682D0 (en) * | 1996-11-14 | 1997-01-08 | Philips Electronics Nv | Autostereoscopic display apparatus |
JPH11155152A (en) | 1997-11-21 | 1999-06-08 | Canon Inc | Method and system for three-dimensional shape information input, and image input device thereof |
JP2000013818A (en) | 1998-06-23 | 2000-01-14 | Nec Corp | Stereoscopic display device and stereoscopic display method |
US6186626B1 (en) | 1998-10-16 | 2001-02-13 | Essilor International | Pair of multifocal progressive spectacle lenses |
US6454411B1 (en) * | 1998-11-17 | 2002-09-24 | Entertainment Design Workshop Llc | Method and apparatus for direct projection of an image onto a human retina |
US6619799B1 (en) * | 1999-07-02 | 2003-09-16 | E-Vision, Llc | Optical lens system with electro-active lens having alterably different focal lengths |
EP1083755A3 (en) | 1999-09-07 | 2003-11-12 | Canon Kabushiki Kaisha | Image input apparatus and image display apparatus |
DE60029625T2 (en) | 1999-12-23 | 2007-07-12 | Shevlin Technologies Ltd. | INDICATOR |
US6478425B2 (en) | 2000-12-29 | 2002-11-12 | Koninlijke Phillip Electronics N. V. | System and method for automatically adjusting a lens power through gaze tracking |
US7850304B2 (en) | 2001-01-23 | 2010-12-14 | Kenneth Martin Jacobs | Continuous adjustable 3Deeps filter spectacles for optimized 3Deeps stereoscopic viewing and its control method and means |
US7190825B2 (en) | 2001-08-17 | 2007-03-13 | Geo-Rae Co., Ltd. | Portable communication device for stereoscopic image display and transmission |
WO2003079272A1 (en) | 2002-03-15 | 2003-09-25 | University Of Washington | Materials and methods for simulating focal shifts in viewers using large depth of focus displays |
US6919907B2 (en) | 2002-06-20 | 2005-07-19 | International Business Machines Corporation | Anticipatory image capture for stereoscopic remote viewing with foveal priority |
GB2398130A (en) * | 2003-02-05 | 2004-08-11 | Ocuity Ltd | Switchable active lens for display apparatus |
JP2004309930A (en) | 2003-04-09 | 2004-11-04 | Olympus Corp | Stereoscopic observation system |
US9030532B2 (en) | 2004-08-19 | 2015-05-12 | Microsoft Technology Licensing, Llc | Stereoscopic image display |
FR2874709B1 (en) | 2004-08-27 | 2006-11-24 | Essilor Int | METHOD FOR DETERMINING A PAIR OF PROGRESSIVE OPHTHALMIC LENSES |
US8016420B2 (en) * | 2007-05-17 | 2011-09-13 | Amo Development Llc. | System and method for illumination and fixation with ophthalmic diagnostic instruments |
US8531509B2 (en) | 2007-12-27 | 2013-09-10 | Texas Instruments Incorporated | Method and system for three-dimensional displays |
JP5490664B2 (en) | 2009-11-18 | 2014-05-14 | パナソニック株式会社 | Electrooculogram estimation device, electrooculogram calculation method, eye gaze detection device, wearable camera, head mounted display, and electronic glasses |
-
2011
- 2011-03-31 US US13/077,197 patent/US8953242B2/en active Active
-
2014
- 2014-10-06 US US14/506,849 patent/US20150022887A1/en not_active Abandoned
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5886822A (en) * | 1996-10-08 | 1999-03-23 | The Microoptical Corporation | Image combining system for eyeglasses and face masks |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11006101B2 (en) | 2016-01-29 | 2021-05-11 | Hewlett-Packard Development Company, L.P. | Viewing device adjustment based on eye accommodation in relation to a display |
WO2018027015A1 (en) * | 2016-08-04 | 2018-02-08 | Dolby Laboratories Licensing Corporation | Single depth tracked accommodation-vergence solutions |
US10943359B2 (en) | 2016-08-04 | 2021-03-09 | Dolby Laboratories Licensing Corporation | Single depth tracked accommodation-vergence solutions |
US20210264631A1 (en) | 2016-08-04 | 2021-08-26 | Dolby Laboratories Licensing Corporation | Single depth tracked accommodation-vergence solutions |
US11694353B2 (en) | 2016-08-04 | 2023-07-04 | Dolby Laboratories Licensing Corporation | Single depth tracked accommodation-vergence solutions |
US11051006B2 (en) * | 2018-02-27 | 2021-06-29 | Looking Glass Factory, Inc. | Superstereoscopic display with enhanced off-angle separation |
US11683472B2 (en) | 2018-02-27 | 2023-06-20 | Looking Glass Factory, Inc. | Superstereoscopic display with enhanced off-angle separation |
US10890759B1 (en) | 2019-11-15 | 2021-01-12 | Microsoft Technology Licensing, Llc | Automated variable-focus lens control to reduce user discomfort in a head-mounted display |
US11449004B2 (en) | 2020-05-21 | 2022-09-20 | Looking Glass Factory, Inc. | System and method for holographic image display |
US11754975B2 (en) | 2020-05-21 | 2023-09-12 | Looking Glass Factory, Inc. | System and method for holographic image display |
US11415728B2 (en) | 2020-05-27 | 2022-08-16 | Looking Glass Factory, Inc. | System and method for holographic displays |
US11415935B2 (en) | 2020-06-23 | 2022-08-16 | Looking Glass Factory, Inc. | System and method for holographic communication |
US11388388B2 (en) | 2020-12-01 | 2022-07-12 | Looking Glass Factory, Inc. | System and method for processing three dimensional images |
US11849102B2 (en) | 2020-12-01 | 2023-12-19 | Looking Glass Factory, Inc. | System and method for processing three dimensional images |
US11758119B2 (en) | 2022-01-19 | 2023-09-12 | Rockwell Collins, Inc. | Low cost HUD using stereo and head tracking |
Also Published As
Publication number | Publication date |
---|---|
US8953242B2 (en) | 2015-02-10 |
US20120250152A1 (en) | 2012-10-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8953242B2 (en) | Varible focus stereoscopic display system and method | |
US11009765B1 (en) | Focus adjusting pancharatnam berry phase liquid crystal lenses in a head-mounted display | |
US10650605B2 (en) | Apparatuses, methods and systems coupling visual accommodation and visual convergence to the same plane at any depth of an object of interest | |
JP7036773B2 (en) | Virtual and augmented reality systems and methods | |
US10539829B1 (en) | Method of selecting a state of a switchable half waveplate and selecting an optical power of a liquid lens structure in optical series with a liquid crystal lens in a head-mounted display | |
US10192358B2 (en) | Auto-stereoscopic augmented reality display | |
US20170171538A1 (en) | Ar display with adjustable stereo overlap zone | |
WO2019060209A1 (en) | Multiple layer projector for a head-mounted display | |
CN105702171A (en) | Display device and display method | |
EP4033290A1 (en) | Multifocal system using adaptive lenses | |
US11860471B2 (en) | Optical system using segmented phase profile liquid crystal lenses | |
US11567326B1 (en) | Accommodation bifocal optical assembly and optical system including same | |
EP3460785A1 (en) | Multiple layer projector for a head-mounted display | |
WO2020027870A1 (en) | Varifocal system using hybrid tunable liquid crystal lenses | |
KR102043389B1 (en) | Three dimentional head-up display using binocular parallax generated by image separation at the conjugate plane of the eye-box location and its operation method | |
KR101943479B1 (en) | Image display device including liquid crystal lens and method of driving the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |