WO2011114149A1 - Augmented reality system - Google Patents

Augmented reality system Download PDF

Info

Publication number
WO2011114149A1
WO2011114149A1 PCT/GB2011/050516 GB2011050516W WO2011114149A1 WO 2011114149 A1 WO2011114149 A1 WO 2011114149A1 GB 2011050516 W GB2011050516 W GB 2011050516W WO 2011114149 A1 WO2011114149 A1 WO 2011114149A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
augmented reality
reality system
visual
user
Prior art date
Application number
PCT/GB2011/050516
Other languages
French (fr)
Inventor
Christopher Davies
Original Assignee
Belron Hungary Kft - Zug Branch
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Belron Hungary Kft - Zug Branch filed Critical Belron Hungary Kft - Zug Branch
Publication of WO2011114149A1 publication Critical patent/WO2011114149A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1626—Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]

Definitions

  • the present invention relates to an augmented reality system and particularly but not exclusively to an augmented reality glazing panel replacement technique and system which can be used for training or real jobs.
  • Augmented reality systems have been proposed for providing instruction to a user, for example for repair or maintenance purposes.
  • Such a system is disclosed in, for example WO00/63763.
  • the present invention provides an augmented reality system for job related instructional purposes, particularly for glazing panel repair or replacement, the system comprising: a portable electronic device for storing information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken; the electronic device including a display screen for visual display, and input means to enable user interaction to control operation of the electronic device; an eye level user mounted display device in communication with the electronic device for displaying visual instructional content.
  • the electronic device is a portable electronic device arranged to be user- borne (i.e. carried or worn by the user).
  • the invention requires the provision of two visual display screens, a first one on the portable electronic device and a second one on the eye level user mounted display device.
  • An advantage of this arrangement is realised in the flexibility of the system. For example if an operative is not familiar with glazing panel replacement for a particular manufacturer or model of vehicle it will be possible to run video footage of training material to provide clear instruction on procedures to be followed. This can be done prior to commencing the job by interacting and viewing the instructional material on the screen of the portable electronic device, and additionally or alternatively whilst actually performing the job by viewing on the eye level user mounted display.
  • This facility for the instructional visual content to be displayed on the display of the portable electronic device and separately on the eye level mounted display enhances the versatility of use of the system.
  • the user may watch a complete and thorough
  • the electronic device stores visual (preferably video) content which is arranged to be displayed on the electronic device display screen and by the eye level mounted display device.
  • An additional benefit is that the interaction concerning the job issues other that watching instructional content, can be undertaken whilst viewing the display screen of the device rather that it being necessary to view via the eye level display.
  • the eye level user mounted display device is head mounted and may be mounted to eyewear such as glasses, goggles or a visor.
  • the eye level user mounted display device is mounted to be viewed by one eye only.
  • the system further comprises voice input means to enable user interaction to control operation of the electronic device.
  • the voice input means may comprise a microphone worn by the user and communicating with the electronic device.
  • the system includes audio output means for outputting audio content to be audible to the user.
  • the audio output means may comprise an earpiece or headphone(s) arrangement to be worn by the user.
  • system further comprises a remote server arranged to communicate with the user's electronic device, such that job information and instructional audio and/or visual content relating to the job is downloaded from the remote server to the user's electronic device.
  • the invention provides an augmented reality system for job related instructional purposes the system comprising: an electronic device for storing information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken; the electronic device including a display screen for visual display, and input means to enable user interaction to control operation of the electronic device; an eye level user mounted display device in communication with the electronic device for displaying visual instructional content.
  • the invention provides a glazing panel repair or replacement technique using an augmented reality system, wherein information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken is stored on a users electronic device; the user interacting with the device including viewing the job information or instructional content on a display screen of the device, wherein the user can also view the visual instructional content on an eye level user mounted display device in communication with the electronic device is.
  • the invention provides a glazing panel repair or replacement technique using an augmented reality system, wherein information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken is stored on a users electronic device; the user interacting with the device including viewing the job
  • Figure 1 is a schematic perspective representation of an operative kitted out to use the augmented reality glazing panel replacement system of the invention
  • Fig 1 a is an enlarged view of the electronic device 2 of figure 1 ;
  • Figure 2 is a view of the interactive electronic device of the invention being mounted to the operative;
  • Figure 3 is an alternative view of the operative using the augmented reality glazing panel replacement system of the invention.
  • Figure 4 is a view of the operative using the augmented reality glazing panel replacement system of the invention whilst lifting a glazing panel for replacement.
  • an augmented reality glazing panel replacement system comprising a head mounted unit lused in combination with an interactive portable electronic device 2 which is in wireless communication with the head mounted unit 1.
  • the portable electronic device 2 (shown enlarged in figure 1 A) may be a computer device which has a means, such as a display screen 9 and audio output for outputting visual display and audio content.
  • the device has electronic input means such as a keypad or touch pad or touch screen 9 for interacting with computer files and software applications stored or running on the device 2.
  • the portable computer device 2 preferably has electronic storage means, such as memory, for storing electronic information relating to the operatives schedule or activities.
  • the head mounted unit 1 comprises a pair of safety glasses 3 having an integrally mounted microphone 4, audio earpiece 5 and display screen 6.
  • the head mounted unit 1 is arranged to deliver coordinated visual and audio content on demand to the user which relates to the vehicle glazing panel replacement task being scheduled to be undertaken by the operative.
  • the content may be delivered from a remote source for example by wireless means.
  • the content may be stored on the portable interactive electronic device 2 which is in connection communication with the head mounted unit 1.
  • the connection may be means of cable such as optical cable, or wireless. Currently video content may best be supplied via a cable connection.
  • the portable electronic device 2 is beneficially configured to receive input commands from the operative via physical interaction such as with a keypad, touch screen 9 or the like and also via voice commands through the microphone 4, via a wireless connection such as via a Bluetooth connection to the device 2.
  • a Bluetooth earpiece 5 and microphone 4 may be used, to be in Bluetooth wireless communication with the portable electronic device 2.
  • the electronic device 2 may be body mounted to be portable with the operative whilst leaving the operatives hands free for other activities.
  • figure 2 shows the electronic device being attached on the operative's belt.
  • the electronic device 2 is beneficially loaded with content related to the operative's specific intended tasks.
  • the device 2 may be loaded with a schedule of jobs for the operative to complete in a particular session. The operator will be prompted to input the specific job that he is to begin and it will be possible for the operative to select the augmented reality glazing panel replacement system to run audio and/or visual content relating to that specific job. If an operative is not familiar with glazing panel replacement for a particular make model vehicle it will be possible to run video footage of training material to provide clear instruction on procedures to be followed.
  • This facility for the instructional visual content to be displayed on the display 9 of the electronic device 2 and also on the glasses mounted display enhances the versatility of use of the system. For example, by means of this, the operative may watch a complete and thorough demonstration on the display 9 of the portable electronic device 2 and importantly re-run key portions of the instruction at key points during the actual procedure whilst viewing the display screen 6 with hands free to undertake the job.
  • the display screen 6 is mounted to the outer periphery of one eye lens of the safety glasses 3 in order to enable the operative to view through the glasses without significant distraction, but shift gaze easily to view the image display screen 6 when desired. Indeed the screen can be pivoted away from the goggles if desired in order to give a greater unimpaired field of view.
  • a glasses mounted display suitable for this purpose is commercially available at the present time under the registered trade mark TAC-EYE LT from Vuzix Corporation.
  • the system is flexible in that it allows an operative to play and replay content in situations where guidance and instruction is requested. Alternatively commands may be input to skip instructional steps or instructions for entire jobs where the job is one that is commonplace for the operative.
  • the device 2 is beneficial in that it can act as a work flow scheduler and a record log of jobs undertaken in addition to acting to implement an augmented reality glazing panel replacement system.
  • the device 2 can be used to interact with a primary server or computer which may be located in a remote location.
  • a main server may communicate, wirelessly or otherwise, with the operative's electronic device 2 in order to download or upload information and content appropriately. For example, each day job information and audio/visual instructional content may be downloaded to the device 2, related specifically to the jobs to be undertaken that day.
  • FIG. 4 shows a vehicle glass replacement operative 10 wearing the head mounted unit 1 of the system and preparing to lift a glazing panel 11 for fitment to a vehicle 12.

Abstract

The present invention relates to an augmented reality system and particularly but not exclusively to an augmented reality glazing panel replacement technique and system which can be used for training or real jobs. There is benefit in improving repair and maintenance procedures in the automotive arena, for example in vehicle glazing panel replacement. Best practice standardisation of techniques and tips specific to different vehicle models can be usefully passed on to operatives in a convenient manner by means of instruction. In one aspect of the present invention there is an augmented reality system for job related instructional purposes, comprising, an electronic device for storing information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken; the electronic device including a display screen for visual display, and input means to enable user interaction to control operation of the electronic device; an eye level user mounted display device in communication with the electronic device for displaying visual instructional content. There is also provided glazing panel repair or replacement techniques.

Description

Augmented Reality System
The present invention relates to an augmented reality system and particularly but not exclusively to an augmented reality glazing panel replacement technique and system which can be used for training or real jobs.
There is benefit in improving repair and maintenance procedures in the automotive arena, for example in vehicle glazing panel replacement. Best practice standardisation of techniques and tips specific to different vehicle models can be usefully passed on to operatives in a convenient manner by means of instruction.
Augmented reality systems have been proposed for providing instruction to a user, for example for repair or maintenance purposes. Such a system is disclosed in, for example WO00/63763.
An improved arrangement has now been devised.
According to a first aspect, the present invention provides an augmented reality system for job related instructional purposes, particularly for glazing panel repair or replacement, the system comprising: a portable electronic device for storing information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken; the electronic device including a display screen for visual display, and input means to enable user interaction to control operation of the electronic device; an eye level user mounted display device in communication with the electronic device for displaying visual instructional content.
It is preferred that the electronic device is a portable electronic device arranged to be user- borne (i.e. carried or worn by the user). The invention requires the provision of two visual display screens, a first one on the portable electronic device and a second one on the eye level user mounted display device. An advantage of this arrangement is realised in the flexibility of the system. For example if an operative is not familiar with glazing panel replacement for a particular manufacturer or model of vehicle it will be possible to run video footage of training material to provide clear instruction on procedures to be followed. This can be done prior to commencing the job by interacting and viewing the instructional material on the screen of the portable electronic device, and additionally or alternatively whilst actually performing the job by viewing on the eye level user mounted display.
This facility for the instructional visual content to be displayed on the display of the portable electronic device and separately on the eye level mounted display enhances the versatility of use of the system. The user may watch a complete and thorough
demonstration on the display of the portable electronic device and importantly re-run key portions of the instruction at key points during the actual procedure whilst viewing the eye level mounted display with hands free to undertake the job.
It is therefore preferred that the electronic device stores visual (preferably video) content which is arranged to be displayed on the electronic device display screen and by the eye level mounted display device.
An additional benefit is that the interaction concerning the job issues other that watching instructional content, can be undertaken whilst viewing the display screen of the device rather that it being necessary to view via the eye level display.
Beneficially, the eye level user mounted display device is head mounted and may be mounted to eyewear such as glasses, goggles or a visor.
It is preferred that the eye level user mounted display device is mounted to be viewed by one eye only. Beneficially, the system further comprises voice input means to enable user interaction to control operation of the electronic device. The voice input means may comprise a microphone worn by the user and communicating with the electronic device. Beneficially, the system includes audio output means for outputting audio content to be audible to the user. The audio output means may comprise an earpiece or headphone(s) arrangement to be worn by the user.
In a preferred realisation, the system further comprises a remote server arranged to communicate with the user's electronic device, such that job information and instructional audio and/or visual content relating to the job is downloaded from the remote server to the user's electronic device.
According to a broader aspect, the invention provides an augmented reality system for job related instructional purposes the system comprising: an electronic device for storing information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken; the electronic device including a display screen for visual display, and input means to enable user interaction to control operation of the electronic device; an eye level user mounted display device in communication with the electronic device for displaying visual instructional content. According to an alternative aspect, the invention provides a glazing panel repair or replacement technique using an augmented reality system, wherein information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken is stored on a users electronic device; the user interacting with the device including viewing the job information or instructional content on a display screen of the device, wherein the user can also view the visual instructional content on an eye level user mounted display device in communication with the electronic device is. Most broadly, the invention provides a glazing panel repair or replacement technique using an augmented reality system, wherein information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken is stored on a users electronic device; the user interacting with the device including viewing the job
information or instructional content on a display screen.
The invention will now be further described in a specific embodiment, by way of example only and with reference to the accompanying drawings, in which: Figure 1 is a schematic perspective representation of an operative kitted out to use the augmented reality glazing panel replacement system of the invention;
Fig 1 a is an enlarged view of the electronic device 2 of figure 1 ; Figure 2 is a view of the interactive electronic device of the invention being mounted to the operative;
Figure 3 is an alternative view of the operative using the augmented reality glazing panel replacement system of the invention;
Figure 4 is a view of the operative using the augmented reality glazing panel replacement system of the invention whilst lifting a glazing panel for replacement.
Referring to the drawings, there is shown an augmented reality glazing panel replacement system comprising a head mounted unit lused in combination with an interactive portable electronic device 2 which is in wireless communication with the head mounted unit 1. The portable electronic device 2 (shown enlarged in figure 1 A) may be a computer device which has a means, such as a display screen 9 and audio output for outputting visual display and audio content. Beneficially the device has electronic input means such as a keypad or touch pad or touch screen 9 for interacting with computer files and software applications stored or running on the device 2. The portable computer device 2 preferably has electronic storage means, such as memory, for storing electronic information relating to the operatives schedule or activities.
The head mounted unit 1 comprises a pair of safety glasses 3 having an integrally mounted microphone 4, audio earpiece 5 and display screen 6. The head mounted unit 1 is arranged to deliver coordinated visual and audio content on demand to the user which relates to the vehicle glazing panel replacement task being scheduled to be undertaken by the operative. The content may be delivered from a remote source for example by wireless means. The content may be stored on the portable interactive electronic device 2 which is in connection communication with the head mounted unit 1. The connection may be means of cable such as optical cable, or wireless. Currently video content may best be supplied via a cable connection.
The portable electronic device 2 is beneficially configured to receive input commands from the operative via physical interaction such as with a keypad, touch screen 9 or the like and also via voice commands through the microphone 4, via a wireless connection such as via a Bluetooth connection to the device 2. In a practical realisation of the invention a Bluetooth earpiece 5 and microphone 4 may be used, to be in Bluetooth wireless communication with the portable electronic device 2.
The electronic device 2 may be body mounted to be portable with the operative whilst leaving the operatives hands free for other activities. For example figure 2 shows the electronic device being attached on the operative's belt. The electronic device 2 is beneficially loaded with content related to the operative's specific intended tasks. For example the device 2 may be loaded with a schedule of jobs for the operative to complete in a particular session. The operator will be prompted to input the specific job that he is to begin and it will be possible for the operative to select the augmented reality glazing panel replacement system to run audio and/or visual content relating to that specific job. If an operative is not familiar with glazing panel replacement for a particular make model vehicle it will be possible to run video footage of training material to provide clear instruction on procedures to be followed. This can be done prior to commencing the job by interacting and viewing the instructional material on the screen of the device 2, and subsequently, or alternatively whilst actually performing the job by viewing on the safety glasses mounted display screen 6 on the safety glasses 3. This facility for the instructional visual content to be displayed on the display 9 of the electronic device 2 and also on the glasses mounted display enhances the versatility of use of the system. For example, by means of this, the operative may watch a complete and thorough demonstration on the display 9 of the portable electronic device 2 and importantly re-run key portions of the instruction at key points during the actual procedure whilst viewing the display screen 6 with hands free to undertake the job. The display screen 6 is mounted to the outer periphery of one eye lens of the safety glasses 3 in order to enable the operative to view through the glasses without significant distraction, but shift gaze easily to view the image display screen 6 when desired. Indeed the screen can be pivoted away from the goggles if desired in order to give a greater unimpaired field of view. A glasses mounted display suitable for this purpose is commercially available at the present time under the registered trade mark TAC-EYE LT from Vuzix Corporation.
It is possible for the user to control the playing of the instructional content whilst keeping the hands free by means of voice commands into the microphone 4 which are wirelessly directed to control operation of the electronic device 2.
The system is flexible in that it allows an operative to play and replay content in situations where guidance and instruction is requested. Alternatively commands may be input to skip instructional steps or instructions for entire jobs where the job is one that is commonplace for the operative. The device 2 is beneficial in that it can act as a work flow scheduler and a record log of jobs undertaken in addition to acting to implement an augmented reality glazing panel replacement system. The device 2 can be used to interact with a primary server or computer which may be located in a remote location. For example a main server may communicate, wirelessly or otherwise, with the operative's electronic device 2 in order to download or upload information and content appropriately. For example, each day job information and audio/visual instructional content may be downloaded to the device 2, related specifically to the jobs to be undertaken that day. Following completion of the jobs information may be uploaded from the device 2 to the remote server. Such information may relate for example to the duration of a specific job, whether instructional content was used for a specific job, and the like. Figure 4 shows a vehicle glass replacement operative 10 wearing the head mounted unit 1 of the system and preparing to lift a glazing panel 11 for fitment to a vehicle 12.

Claims

Claims:
An augmented reality system for job related instructional purposes, particularly for glazing panel repair or replacement, the system comprising: an electronic device for storing information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken; the electronic device including a display screen for visual display, and input means to enable user interaction to control operation of the electronic device; an eye level user mounted display device in communication with the electronic device for displaying visual instructional content.
An augmented reality system according to claim 1, wherein the electronic device is a portable electronic device arranged to be user-borne (carried or worn by the user). an augmented reality system according to claim 1 or claim 2 wherein the electronic device stores visual content which is arranged to be displayed on the electronic device display screen and by the eye level mounted display device. an augmented reality system according to any preceding claim wherein the visual content comprises video content. an augmented reality system according to any preceding claim, wherein the eye level user mounted display device is head mounted. an augmented reality system according to any preceding claim wherein the eye
Figure imgf000009_0001
level user mounted display device is mounted to eyewear such as glasses goggles or a visor.
7. an augmented reality system according to any preceding claim, wherein the eye level user mounted display device is mounted to be viewed by one eye only.
8. an augmented reality system according to any preceding claim wherein the
system further comprises voice input means to enable user interaction to control operation of the electronic device.
9. an augmented reality system according to claim 8, wherein the voice input means comprises a microphone worn by the user and communicating with the electronic device.
10. an augmented reality system according to any preceding claim wherein the
system includes audio output means for outputting audio content to be audible to the user.
11. an augmented reality system according to claim 10, wherein the audio output means comprises an earpiece or headphone(s) arrangement to be worn by the user.
12. an augmented reality system according to any preceding claim, further
comprising a remote server arranged to communicate with the users electronic device, such that job information and instructional audio and/or visual content relating to the job is downloaded from the remote server to the users electronic device. 13. An augmented reality system for job related instructional purposes the system
comprising: an electronic device for storing information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken; the electronic device including a display screen for visual display, and input means to enable user interaction to control operation of the electronic device; an eye level user mounted display device in communication with the electronic device for displaying visual instructional content.
14. A glazing panel repair or replacement technique using an augmented reality
system, wherein information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken is stored on a users electronic device; the user interacting with the device including viewing the job information or instructional content on a display screen of the device, wherein the user can also view the visual instructional content on an eye level user mounted display device in communication with the electronic device is.
15. A glazing panel repair or replacement technique using an augmented reality
system, wherein information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken is stored on a users electronic device; the user interacting with the device including viewing the job information or instructional content on a display screen.
PCT/GB2011/050516 2010-03-16 2011-03-16 Augmented reality system WO2011114149A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB1004332.1 2010-03-16
GB201004332A GB2478738A (en) 2010-03-16 2010-03-16 Eye level display in communication with electronic device

Publications (1)

Publication Number Publication Date
WO2011114149A1 true WO2011114149A1 (en) 2011-09-22

Family

ID=42261642

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2011/050516 WO2011114149A1 (en) 2010-03-16 2011-03-16 Augmented reality system

Country Status (4)

Country Link
AR (1) AR080523A1 (en)
GB (1) GB2478738A (en)
TW (1) TW201205517A (en)
WO (1) WO2011114149A1 (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013101438A1 (en) * 2011-12-29 2013-07-04 Kopin Corporation Wireless hands-free computing head mounted video eyewear for local/remote diagnosis and repair
US8625200B2 (en) 2010-10-21 2014-01-07 Lockheed Martin Corporation Head-mounted display apparatus employing one or more reflective optical surfaces
CN103677235A (en) * 2012-08-28 2014-03-26 华宝通讯股份有限公司 Interactive augmented reality system, portable communication device and interaction method
US8781794B2 (en) 2010-10-21 2014-07-15 Lockheed Martin Corporation Methods and systems for creating free space reflective optical surfaces
US8855719B2 (en) 2009-05-08 2014-10-07 Kopin Corporation Wireless hands-free computing headset with detachable accessories controllable by motion, body gesture and/or vocal commands
US9122307B2 (en) 2010-09-20 2015-09-01 Kopin Corporation Advanced remote control of host application using motion and voice commands
US9235262B2 (en) 2009-05-08 2016-01-12 Kopin Corporation Remote control of host application using motion and voice commands
US9301085B2 (en) 2013-02-20 2016-03-29 Kopin Corporation Computer headset with detachable 4G radio
US9442290B2 (en) 2012-05-10 2016-09-13 Kopin Corporation Headset computer operation using vehicle sensor feedback for remote control vehicle
US9507772B2 (en) 2012-04-25 2016-11-29 Kopin Corporation Instant translation system
US9632315B2 (en) 2010-10-21 2017-04-25 Lockheed Martin Corporation Head-mounted display apparatus employing one or more fresnel lenses
US9720228B2 (en) 2010-12-16 2017-08-01 Lockheed Martin Corporation Collimating display with pixel lenses
US9939650B2 (en) 2015-03-02 2018-04-10 Lockheed Martin Corporation Wearable display system
US9995936B1 (en) 2016-04-29 2018-06-12 Lockheed Martin Corporation Augmented reality systems having a virtual image overlaying an infrared portion of a live scene
US10013976B2 (en) 2010-09-20 2018-07-03 Kopin Corporation Context sensitive overlays in voice controlled headset computer displays
US10359545B2 (en) 2010-10-21 2019-07-23 Lockheed Martin Corporation Fresnel lens with reduced draft facet visibility
US10474418B2 (en) 2008-01-04 2019-11-12 BlueRadios, Inc. Head worn wireless computer having high-resolution display suitable for use as a mobile internet device
US10627860B2 (en) 2011-05-10 2020-04-21 Kopin Corporation Headset computer that uses motion and voice commands to control information display and remote devices
US10684476B2 (en) 2014-10-17 2020-06-16 Lockheed Martin Corporation Head-wearable ultra-wide field of view display device
US10754156B2 (en) 2015-10-20 2020-08-25 Lockheed Martin Corporation Multiple-eye, single-display, ultrawide-field-of-view optical see-through augmented reality system

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102591015A (en) * 2011-11-25 2012-07-18 张志达 Clairvoyance spectacles
CN105242401B (en) * 2015-09-28 2018-08-10 大连楼兰科技股份有限公司 The method that intelligent glasses share the other equipment data for automobile maintenance
US10460431B2 (en) 2018-01-15 2019-10-29 Otis Elevator Company Part recognition and damage characterization using deep learning
TWI709118B (en) * 2019-06-17 2020-11-01 巨匠電腦股份有限公司 Interactive experiment teaching system and electronic device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5873070A (en) * 1995-06-07 1999-02-16 Norand Corporation Data collection system
US6304234B1 (en) * 1997-02-26 2001-10-16 Olympus Optical Co., Ltd. Information processing apparatus
US20010040590A1 (en) * 1998-12-18 2001-11-15 Abbott Kenneth H. Thematic response to a computer user's context, such as by a wearable personal computer
US20020089544A1 (en) * 2000-08-22 2002-07-11 Dirk Jahn System and method for combined use of different display/appliance types with system-controlled, context-dependent information display
DE10106072A1 (en) * 2001-02-09 2002-08-14 Deutsche Telekom Ag Representing visual information in telecommunications device involves projecting visual information into user's field of view with separate portable display device
US20020126066A1 (en) * 1993-08-12 2002-09-12 Seiko Epson Corporation Head-mounted image display device and data processing apparatus including the same

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5781913A (en) * 1991-07-18 1998-07-14 Felsenstein; Lee Wearable hypermedium system
US6853293B2 (en) * 1993-05-28 2005-02-08 Symbol Technologies, Inc. Wearable communication system
US6415792B1 (en) * 1995-04-11 2002-07-09 Schoolman Scientific Corporation Anesthesia machine with head worn display
AU6358798A (en) * 1996-09-26 1998-04-17 Mcdonnell Douglas Corporation Head mounted display with fibre optic image transfer from flat panel
WO1999048082A1 (en) * 1998-03-20 1999-09-23 Inroad, Inc. Wireless, wearable network computer system
WO2000063763A1 (en) * 1999-03-29 2000-10-26 Siemens Electrocom, L.P. System, apparatus and method for providing a portable customizable maintenance support instruction system
JP2002032212A (en) * 2000-07-14 2002-01-31 Toshiba Corp Computer system and headset type display device
US20030090437A1 (en) * 2001-11-12 2003-05-15 Adams Michael Dewayne Display system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020126066A1 (en) * 1993-08-12 2002-09-12 Seiko Epson Corporation Head-mounted image display device and data processing apparatus including the same
US5873070A (en) * 1995-06-07 1999-02-16 Norand Corporation Data collection system
US6304234B1 (en) * 1997-02-26 2001-10-16 Olympus Optical Co., Ltd. Information processing apparatus
US20010040590A1 (en) * 1998-12-18 2001-11-15 Abbott Kenneth H. Thematic response to a computer user's context, such as by a wearable personal computer
US20020089544A1 (en) * 2000-08-22 2002-07-11 Dirk Jahn System and method for combined use of different display/appliance types with system-controlled, context-dependent information display
DE10106072A1 (en) * 2001-02-09 2002-08-14 Deutsche Telekom Ag Representing visual information in telecommunications device involves projecting visual information into user's field of view with separate portable display device

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10579324B2 (en) 2008-01-04 2020-03-03 BlueRadios, Inc. Head worn wireless computer having high-resolution display suitable for use as a mobile internet device
US10474418B2 (en) 2008-01-04 2019-11-12 BlueRadios, Inc. Head worn wireless computer having high-resolution display suitable for use as a mobile internet device
US9235262B2 (en) 2009-05-08 2016-01-12 Kopin Corporation Remote control of host application using motion and voice commands
US8855719B2 (en) 2009-05-08 2014-10-07 Kopin Corporation Wireless hands-free computing headset with detachable accessories controllable by motion, body gesture and/or vocal commands
US10013976B2 (en) 2010-09-20 2018-07-03 Kopin Corporation Context sensitive overlays in voice controlled headset computer displays
US9122307B2 (en) 2010-09-20 2015-09-01 Kopin Corporation Advanced remote control of host application using motion and voice commands
US10495790B2 (en) 2010-10-21 2019-12-03 Lockheed Martin Corporation Head-mounted display apparatus employing one or more Fresnel lenses
US8781794B2 (en) 2010-10-21 2014-07-15 Lockheed Martin Corporation Methods and systems for creating free space reflective optical surfaces
US8625200B2 (en) 2010-10-21 2014-01-07 Lockheed Martin Corporation Head-mounted display apparatus employing one or more reflective optical surfaces
US10359545B2 (en) 2010-10-21 2019-07-23 Lockheed Martin Corporation Fresnel lens with reduced draft facet visibility
US9632315B2 (en) 2010-10-21 2017-04-25 Lockheed Martin Corporation Head-mounted display apparatus employing one or more fresnel lenses
US9720228B2 (en) 2010-12-16 2017-08-01 Lockheed Martin Corporation Collimating display with pixel lenses
US11947387B2 (en) 2011-05-10 2024-04-02 Kopin Corporation Headset computer that uses motion and voice commands to control information display and remote devices
US11237594B2 (en) 2011-05-10 2022-02-01 Kopin Corporation Headset computer that uses motion and voice commands to control information display and remote devices
US10627860B2 (en) 2011-05-10 2020-04-21 Kopin Corporation Headset computer that uses motion and voice commands to control information display and remote devices
US9369760B2 (en) 2011-12-29 2016-06-14 Kopin Corporation Wireless hands-free computing head mounted video eyewear for local/remote diagnosis and repair
WO2013101438A1 (en) * 2011-12-29 2013-07-04 Kopin Corporation Wireless hands-free computing head mounted video eyewear for local/remote diagnosis and repair
US9507772B2 (en) 2012-04-25 2016-11-29 Kopin Corporation Instant translation system
US9442290B2 (en) 2012-05-10 2016-09-13 Kopin Corporation Headset computer operation using vehicle sensor feedback for remote control vehicle
CN103677235A (en) * 2012-08-28 2014-03-26 华宝通讯股份有限公司 Interactive augmented reality system, portable communication device and interaction method
US9301085B2 (en) 2013-02-20 2016-03-29 Kopin Corporation Computer headset with detachable 4G radio
US10684476B2 (en) 2014-10-17 2020-06-16 Lockheed Martin Corporation Head-wearable ultra-wide field of view display device
US9939650B2 (en) 2015-03-02 2018-04-10 Lockheed Martin Corporation Wearable display system
US10754156B2 (en) 2015-10-20 2020-08-25 Lockheed Martin Corporation Multiple-eye, single-display, ultrawide-field-of-view optical see-through augmented reality system
US9995936B1 (en) 2016-04-29 2018-06-12 Lockheed Martin Corporation Augmented reality systems having a virtual image overlaying an infrared portion of a live scene

Also Published As

Publication number Publication date
GB201004332D0 (en) 2010-04-28
AR080523A1 (en) 2012-04-11
GB2478738A (en) 2011-09-21
TW201205517A (en) 2012-02-01

Similar Documents

Publication Publication Date Title
WO2011114149A1 (en) Augmented reality system
US11231897B2 (en) Display system, display device, information display method, and program
EP3161546B1 (en) Glasses-type mobile terminal
US9597807B2 (en) Robot teaching device
US9965897B2 (en) Eyewear operational guide system and method
US20190050191A1 (en) Display system, display device, information display method, and program
KR101988110B1 (en) Virtual Reality Education System and Method based on Bio Sensors
US20160246057A1 (en) Image display device and image display method, image output device and image output method, and image display system
EP2025374A3 (en) Computer-readable storage medium having game program stored therein, and game apparatus
KR101792715B1 (en) Exercise management system simulating real environment
US20220392361A1 (en) Learning system and learning method
JP6590050B2 (en) Display device, display system, display device control method, and program
US20180196262A1 (en) Virtual reality system
WO2016081830A1 (en) Methods, systems, and computer readable media for providing patient tailored stroke or brain injury rehabilitation using wearable display
CA3130748A1 (en) Systems for simulating joining operations using mobile devices
EP2068238A3 (en) Display control method and display system
KR102068414B1 (en) Head mounted display system for correction of user eyesight
US11696073B2 (en) Refractive eye examination system
KR20170084443A (en) Method for controlling head mount display device
JP2020149138A (en) Work support system, work support method, and program
US20100066802A1 (en) Remote communications device and method for facilitating manual operations
WO2022124326A1 (en) Head-mounted display and adjusting method therefor
JP2007212548A (en) Wearable display
CN111373449B (en) Auxiliary method and auxiliary system for assisting in executing tasks on products
JP5494731B2 (en) Head-mounted display

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11710246

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11710246

Country of ref document: EP

Kind code of ref document: A1