CN101809651B - Mobile wireless display providing speech to speech translation and avatar simulating human attributes - Google Patents
Mobile wireless display providing speech to speech translation and avatar simulating human attributes Download PDFInfo
- Publication number
- CN101809651B CN101809651B CN2008801083447A CN200880108344A CN101809651B CN 101809651 B CN101809651 B CN 101809651B CN 2008801083447 A CN2008801083447 A CN 2008801083447A CN 200880108344 A CN200880108344 A CN 200880108344A CN 101809651 B CN101809651 B CN 101809651B
- Authority
- CN
- China
- Prior art keywords
- main frame
- speech
- calculation element
- voice
- sound signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
An apparatus includes a monocular display with a wireless communications interface, user input device, transmitter, and controller, and may provide a video link to and control and management of a host device and other devices, such as a cell phone, computer, laptop, or media player. The apparatus may receive speech and digitize it. The apparatus may compare the digitized speech in a first language to a table of digitized speech in a second language to provide translation or, alternatively, may compare the digitized speech to a table of control commands. The control commands allow user interaction with the apparatus or other remote devices in a visual and audio manner. The control signals control a recognized persona or avatar stored in a memory to provide simulated human attributes to the apparatus, network or third party communication device. The avatar may be changed or upgraded according to user choice.
Description
Related application
The application's case is the 12/152nd of application on May 14th, 2008; The part of No. 462 patent application application case that continues; And advocate the 60/962nd of application on July 31st, 2007; The right of priority of the 60/994th, No. 989 U.S. Provisional Application case of the 60/966th, No. 704 U.S. Provisional Application case of No. 686 U.S. Provisional Application cases, application on August 29th, 2007 and application on September 24th, 2007.The application's case also relates to the 12/008th, No. 114 patent application of application on January 8th, 2008 and the 12/008th, No. 104 patent application of application on January 8th, 2008.Whole teachings of above application case are incorporated herein by reference.
Technical field
The present invention relates to mobile wireless display.Particularly, the present invention relates to provide the mobile wireless display of the incarnation of speech to speech translation and simulating human attribute.
Background technology
Also known mobile communications device in this technology.Technological incorporation recently between mobile honeycomb phone and the digital media player (iPhone for example
TM) constantly bring the Miniature Portable Unit that can store multitude of video and other content to the consumer.Although these handheld apparatus generally include video screen, forever can't the visual experience (that is, giant display) of copying high-resolution in this type of device, only be because the physical size limitations that the handheld unit expection is had.In addition, the long-range individual who in daily routines, carries out calculates constantly and increases sharply.The user for example will use, and remote computing devices such as personal digital assistant, smart phone or
communicator come browsing internet; And will carry out commercial affairs with remote mode, will listen to the music and participate in other activity (take pictures, transmission and retrieving electronic mail, transmission and retrieval instant message or the like).
Usually, to move it communicator individualized many user effort plenty of time.The user of mobile communications device (for example mobile phone) will paste jewelry to said device; Purchase has the device of certain color, and will download to communication device memories to particular software application so that particular ringtone to be provided when receiving the caller's (for example auntie or uncle) who likes calling.Usually because this is individualized, the user will dote in said handheld apparatus, and will prefer using said device owing to said unique individualization.
In addition, known head head mounted displays device in this technology.This class display comprises vision and audio devices.These devices provide the demonstration with sound and image to wearer.Usually, said display is for through arranging to present the small sized colour monitor of image to user's left eye, right eye or both.These devices surround user's face or head usually, and therefore not only heavy, and hinder in fact all user's visions.In other words, when dressing said display, the user can't easily watch other object that is in the normal peripheral vision of user usually, or loses the quite most of of normal peripheral vision during use.Other head mounted display can comprise two independent displays, and display of every eyes, said display also are supported on the heavy framework.
Thereby the consumer is seeking high-quality portable color monitor at present and is strengthening its handheld video device.A kind of this class display is similar to face or the head that a pair of glasses or headphone are worn on the user.Through the huge recently exploitation of optical technology, these devices can provide the appearance of large-scale high resolution display.An instance of this type of device is given interior rattan people such as (Naito) and is transferred the 7th, 088, No. 234 United States Patent (USP)s of Matsushita Electric Industries (Matsushita Electrical Industries) referring to promulgation.Wearable massaging device described in the said patent can show that some information is to inform that user's (for example) is about receiving the information of Email etc.Another this type of unit describe is in issuing to Spitzer (Spitzer) and transferring in the 7th, 158, No. 096 United States Patent (USP) of MyVu company.Said device comprises projection type display, but it is attached to the end that head is installed support member.The eyepiece subassembly is attached to second end of said support member.Said support member is kept optical projection system and is aimed at along optical path with the eyepiece subassembly.
Although these devices can provide the high resolving power of image and sound to show that the normal viewing space or its major part that hinder the user possibly be problematic.The user will be usually only in the user feels safe minority select location (for example, in the parlor, at home other places, in the operating room) when being seated or standing or being in the almost fixed position, use said display.The user can't carry out many other daily tasks effectively when dressing the obstruction property display equipment.These tasks comprise in the participation needs the frequent depth perception adjustment of highly individual mobility by the time, needs, move through zone with irregular and uneven surface or needs initiatively collision avoid (that is, move through zone or incident in person, avoid the rapid moving object that possibly run into, the use of negotiation public transportation in the operation vehicles) with changing barrier or crowd activity or personal security's possibility owing to losing any situation that normal peripheral vision is sacrificed.
Secondly, this type of prior art head mounted display is restricted in some limited task.This generic task can comprise watches image, figure or the film with audio frequency.This can be from playing games purpose or watch image from television broadcasting or video entertainment property.This type of prior art head mounted display is dailyly wanting strict limited in the combining of functional calculation task with other.For instance; Display is used in the move that the user possibly need combine communication task, operation business applications, active homing task, have a real-time update, or uses display other device with wireless mode control regular use of user or daily contact.These devices can comprise for example personal digital assistant, notebook, desk-top computer, mobile phone, the vehicles, wireless network, wireless service focus, thin-client, other electronic installation or utensil.This type of prior art head mounted display often can't with this type of device interface or control automatically this type of device with initial and control working procedure, the functional change of initial real-time clock, change real-time clock operating parameter, launch and the Local or Remote radio communication of mobile device and/or participate in wireless network and service.
The 3rd, this type of prior-art devices can't be upgraded with other function that provides the user to need easily.The user possibly need have some functional attributes of one or more software application or one or more particular hardware configuration in some positions, and the user maybe not need have those software applications or Hardware configuration in other position.In fact, the user possibly not use this type of heavy display equipment with a plurality of software applications or Hardware configuration, but possibly hope to remove unnecessary software and hardware from said device, makes device keep extremely light.
In addition; But the user will like the access significant data than the close-coupled mobile device; Said mobile device is light-duty and does not need the user to carry relatively large and heavy computing machine (for example, notebook, laptop computer, dull and stereotyped calculation element or relatively large media player).In addition, the user often must open said laptop computer and then start the machine this spended time when carrying laptop computer.This is unwelcome when wanting to obtain fast customizing messages (for example address, Email or from the related text of e-mail attachment) in especially in the user is advancing.
Microsoft Windows
is the software program of the secondary screen on the support mobile personal computer (for example laptop computer) in the operating system (OS), and said secondary screen is placed on the dorsal part that laptop computer renovates usually.Through this additional secondary display, the user can insert Microsoft Windows
software application be in park mode or unlatching at computing machine or when closing on said secondary display display image.Microsoft Windows
uses and is called gadgety convenient small routine.These gadget programs will extend to other device from the information of laptop computer.Gadget can move on the computing machine of operating with Microsoft Windows
compatible device, and uses from the said device of the information updating of computing machine.Gadget can allow to watch the information from computing machine, and is that open, that close or is in park mode regardless of it.This has saved power and user time through not starting computing machine.These gadget software programs are restrictive, and the user need permit using any input media to come the software gadget of wireless access laptop computer under the situation of persistent surveillance.In addition, when laptop computer or PC were opened, closed or be in park mode, the user need be from the bulk information of computing machine.
Summary of the invention
The user often has to carry relatively large calculation element so that carry out these tasks.The user has a kind of ANTENNAUDIO vision head installing type communicator with needs; Said device is unobtrusive and without hand, and said device can be in order to avoid be connected to the light-duty wireless format of heavy calculation element and come mutual with wireless mode and other calculation element.In addition, the user abandons keyboard, input media or touch-screen with needs, and will prefer and use voice to recognize to accomplish these input and output computer tasks.In addition, the user also has needs to like mode mutual or with highly individualized mode and the mutual ability of device with device.The personalized software application of height that the user need download in advance on the device or can wireless mode buy.Also need a kind ofly except watching image or the device of other function also is provided figure in this technology, said device can be by customer upgrade, makes the user to select and selected user needs which hardware or component software to come and said device interface.
In addition, need in this technology to inquire that other calculation element is to form Radio Link and can receive data and the light-duty device of swap data between simple eye display equipment and calculation element.Also need a kind of simple eye display equipment in this technology; The auxiliary simple eye indicator screen of redundancy that it can serve as calculation element makes the user principal and subordinate's relation of networking to use input media from the data of redundant secondary monitor screen access from said calculation element.
According to the first instance embodiment of the present invention, a kind of simple eye display equipment can comprise wave point, and it is communicated by letter with host computing system with wireless mode through being configured to.Host computing system has elementary display, and it receives the control signal in order to display image from host computing system.Said control signal is sent to the second main frame wave point.Said control signal is transmitted into wave point from the said second wireless host interface.Then said signal is transmitted into simple eye display with display image on said simple eye display.Simple eye display is positioned at away from the host computing system place.Said equipment has the controller that is connected to storer, and wherein said controller and said storer are connected to bus.Display, microphone and loudspeaker are connected to bus with mode of operation.Controling appliance is useful on from microphone and receives voice command and the programmed instruction that is used for voice command is converted into digital data packet.
In one embodiment, microphone receives the sound signal of the voice of the individual said first language that is adjacent to wearer or source.Microphone is connected to converter, and said converter converts sound signal into the numeral of sound signal.Controller compares the numeral of sound signal with the language table that is stored in the storer, numeral is converted into second numeral.This of sound signal second numeral is the translation of first language to second language.Controller converts second numeral of sound signal into the speech audio signal modulation of second language.The controller control loudspeaker, said loudspeaker outputs to wearer with the speech audio signal modulation of second language, makes wearer can understand the voice of first language and hears said translation with the speech modulation system.
In another embodiment, the speech audio signal modulation can aesthstic desirable mode and outputs to wearer and be associated with prerecord speech in being stored in storer.Controller can convert sound signal into videotex in addition except said voice.Said text can show on the screen of display with the speech audio signal modulation simultaneously and with second language.The speech audio signal modulation can be associated with famous person's recording of voice, and the speech audio signal modulation of second language can be the translation of the foreign voice of real-time generation.
Controller also has and is used for receiving packet and packet and the look-up table that is stored in storer are compared packet is converted into the programmed instruction of control command.Controller outputs to assembly to permit carrying out peripheral assembly mutual and the confession user control device with the assembly of equipment with control command.Controling appliance is useful in response to control command with vision and audio frequency mode and the mutual programmed instruction of wearer.Controller be stored in storer in " identification personage " software format output Interactive control signal of being associated.Software outputs to display with control command so that show " personage " with the form of the simulated human video outward appearance that is associated with famous person or other " identification personage ".Also envision independent " audio frequency personage ", it comprises the programmed instruction that is used for reading aloud with the certain records speech menu option of voice command.The identification personage provides simulated human attributes carrying out mutual and opertaing device, and permits user and emulation video or audio frequency " personage " alternately with control device.
Description of drawings
To understand aforementioned content from following to more clearly the describing of instance embodiment of the present invention, said instance embodiment explains in the accompanying drawings, and the same reference character runs through different views and refers to same section all the time in the accompanying drawings.Said graphic may not the drafting in proportion, but focus on the explanation embodiments of the invention.
Fig. 1 is the skeleton view of the simple eye display equipment of explanation embodiment according to the present invention embodiment and the figure of the radio communication between simple eye display equipment of said instance embodiment and the main frame calculation element.
Fig. 2 be the simple eye display equipment of illustrated example embodiment with the main frame calculation element between communicate by letter and main frame calculation element and other external data base and the Internet between in order to content of multimedia is delivered to the network chart of communicating by letter of simple eye display equipment.
Fig. 3 to 4 is the simple eye display equipments of illustrated example embodiment and is suitable for via the block diagram of two-way communication path with the rough schematic view of the intraware of the main frame calculation element of wireless mode emission data.
Fig. 5 is the process flow diagram of the operation of the simple eye display equipment of illustrated example embodiment.
Fig. 6 is how the simple eye display equipment of indication is can be in order to control and to manage the figure of high-level software of various main frames through user interface.
Fig. 7 is the figure of the example hardware interface of the simple eye display equipment of illustrated example embodiment.
Fig. 8 to 10 is that explanation is used for the block diagram via the bluetooth agency of two-way communication path carry data bag.
Figure 11 is the block diagram of explanation device driver.
Figure 12 is the block diagram of explanation device context.
Figure 13 to 15 shows the embodiment as the head installing type display of the translater device with speech modulation.
Figure 16 shows the synoptic diagram of head installing type radio communication device, and said device comprises the storer that is used for stored program instruction, and said programmed instruction can provide emulation video famous person human interface to be used for coming and user interactions with Voice & Video;
Figure 17 shows the synoptic diagram of the audio/visual head installing type radio communication device with audio frequency output;
Figure 18 shows the view of display, and its displaying comprises identifiable desirable on the aesthetics human facial image of emulation and some menu options that displaying is used to use input media control audio/vision head installing type radio communication device;
Figure 19 shows the synoptic diagram of audio/visual head installing type radio communication device, and said communicator has wave point to be used to obtain to be used for the new software program with new " the software personage " of user interactions;
Figure 20 shows the synoptic diagram of head installing type display, and said displaying appliance has wave point to be used for buying new software program with the payable expense of payment provider of giving from software provider;
Figure 21 to 27 shows the wireless dummy personage serve as the assistant who is used to receive incoming call, and it can make the caller hang on to wait for the wearer of simple eye communicator, simultaneously for the caller on mobile device playing advertisements.
Embodiment
Hereinafter is the description to instance embodiment of the present invention.
Fig. 1 explains the simple eye display equipment 100 of embodiment according to the present invention embodiment, its playback content of multimedia and can wireless mode from being in the remote computing device operation business applications of principal and subordinate's relation of networking.This simple eye display equipment 100 is light-duty mobile devices; It comprises the main part 105 that is connected to display device 110 through telescopic arm 115; Said main part 105 is taken in one or more intrawares of said device 100, comprises the assembly of hardware interface 120 and blue teeth wireless hardware (not shown).
In one embodiment, display device 110 is wide Video Graphics Array (WVGA) displays with trade mark "
WVGA LV " sale of being made by this assignee.It is 854 * 480 the wide type AMLCD of colour filter that display device 110 can be resolution.In this embodiment, display device 110 can be 0.58 inch on Diagonal Dimension.In another embodiment, display device 110 alternately comprises SVGA (SVGA) display of also being made by this assignee with trade mark "
SVGA LVS " sale.It is 800 * 600 colour filter AMLCD that display device 110 can be resolution.In this embodiment, display device 110 can be about 0.44 inch and light-duty on Diagonal Dimension.Expect other display device 110; For example the 12/008th of on January 8th, 2008 application the; The 12/007th of No. 114 patent application and application on January 8th, 2008; The display device of describing in detail in No. 104 patent application, the full text of said two application cases is incorporated herein by reference.This device 100 does not receive 110 restrictions of any particular display element, and knownly in the technology therewith uses together through any light-duty display that is configured to carry out move operation.
Preferably; Telescopic arm 115 is elasticity bar-like member of being processed by two that are connected to pivot cylindrical flexible sections; Said flexible section is adjustable; And the user can extend display device 110 and be pivoted to the comfortable viewing location with respect to main part 105, makes display device 110 not in user's dead ahead or do not hinder user's vision, but is arranged in user's peripheral vision.Preferably, main part 105 is elastomeric elements and can comprises hook or similar connector and be connected to the glasses of wearer or be supported on the wearer.Display device 115 is preferably through being configured to remain on the outside of beholder's normal vision, and do not hinder beholder's eyes, but is positioned at the outside of beholder's peripheral vision.In this regard, the user can (for example during running, walking or participating in recreation) dress simple eye display equipment 100 with comfortable mode in user's daily routines.In one embodiment, main part 105 can comprise independent anchor clamps or separately connector with the glasses, clothes, cap or another stayed surface that are gripping into the user to support the display device 115 of the outside that is positioned at beholder's peripheral vision rightly.
The simple eye display equipment 100 of instance embodiment preferably can be set up two-way or the two-way wireless communication link 135 with calculation element 125, and after this installs 100 and can send data and receive data from host apparatus 125 to host apparatus 125 with high data transfer rate via Radio Link 135.After this; Monocular device 100 can be to comprise that the multimedia of graphics video data is with display image on simple eye display device 110 via the data-switching that Radio Link receives; Said data can originate from main frame calculation element 125 or alternatively originate from another remote data base or source, for example remote memory.
In one embodiment, wireless communication link 135 is using short range or remote radio frequency signal between device, to transmit data to install 125,100 both known agreements on the specified channel.Preferably, radiofrequency signal be lower powered and in about 1.0 milliwatts in the scope of 100 milliwatts so that via want range transmission radiofrequency signal, said institute will be apart from can be some feet or greater than 20 feet on length.
In one embodiment, simple eye display equipment 100 uses
communication standard to communicate by letter with main frame calculation element 125.In one embodiment,
techniques permit frequency of using 2.4 kilo-mega cycles per seconds is carried out data communication with data transfer rate and another about 10 meters far away calculation element of about 1Mbps.
In another embodiment, wireless communication link 135 can use institute of electrical and electronic engineers (IEEE) 802.11 (b) or IEEE 802.11 (g) or another standard.In another embodiment, wireless communication link 135 can comprise that data transfer rate is any other high-speed digital communication standard known in
3.0, ultra broadband (UWB), radio universal serial bus (WUSB), wireless high-definition degree (WirelessHD), wireless high-definition degree multimedia interface (WHDMI), WiFi or this technology of about 480Mbps.In another alternate embodiment, simple eye display equipment 100 can use wired connection (for example serial port or USB (USB) cable or other wired connection) but not link 135 is communicated by letter with host computing system 125.Perhaps, wireless communication link 135 can comprise that any other frequency hopping standard in the spread spectrum communication known in CDMA (CDMA) standard, time division multiple access (TDMA) (TDMA) standard or frequency division multiple access (FDMA) standard or this technology transmits data.Become known for wired in this technology and variety of protocol standard radio communication, and this device 100 is not limited to any particular link or radio frequency protocol.
This simple eye display equipment 100 uses two-way or two-way wireless communication link 135 playback of video and the audio frequency on simple eye display device 115 with calculation element 125.Simple eye display equipment 100 for example also control main frame calculation element 125 such as wireless laptop computers 125a with via Radio Link 135 from laptop computer 125a operation business applications, retrieving electronic mail and operation executable code or application program.In this, simple eye display equipment 100 can comprise input media 120 (for example, the input media 335 of Fig. 3), and it can be transferred to main frame calculation element 125 with wireless input signal.Input signal may command main frame calculation element 125 runs application on main frame calculation element 125 so that control signal to be provided.After this; Main frame calculation element 125 outputs to display device 110 to be used for the long-range main frame calculation element 125 place's application program operating that are presented at simple eye display 100 places with figure, and said simple eye display 100 can be positioned at the distance away from main frame calculation element 125.The various types of contents 150 of main frame 125 supplies are on display 110, watching; The information that comprises video 150a, audio frequency 150b, computer data 150c and other type, for example calendar 150d, Email and with the data of the type of the regular any number that finds from main frame 125.
In addition, the application programming person can use software system development external member (SDK) 160 to specify the interface that is used for main frame 125, and then permits displaying contents 150 on display 110.For many reasons, device 100 may not show the content of existing webpage or other type simply.In particular, content 150 need and be implemented to cooperate display 110 through particular design.In order to encourage this situation, developer SDK 160 makes that the developer can be apace and easily develop the visuals of its application program.The rear end of these same application domain then is encoded as the programmer language of selecting to specific device 100, will more describe in detail like hereinafter.
Through using two-way wireless communication link 135, mobile device 100 can insert MicrosoftWindows
to provide data for mobile device 100 accesses via link 135.Preferably; Microsoft Windows
program can be inserted through wireless blue tooth, 802.11 (b), 802.11 (c) or 802.11 (g) by mobile device, and mobile device 100 can be positioned on away from main frame calculation element 125 places.Preferably, mobile device 100 can be connected to main frame calculation element 125 with wireless mode via the Internet.Therefore, mobile device 100 can connect from the world Anywhere, and can be from be connected to the storage access data of distance host calculation element 125 with mode of operation.
In addition, the pc user can use Microsoft Windows
to come content, application program and the PC service of long-range driving, access and order PC or server and the PC that needn't contact dormancy or revive through RDP (RDP), virtual network computing (vnc), GoToMyPC (commercial long-range access PC order and control are served) etc.
Should be appreciated that simple eye display equipment 100 is not limited to use any particular host calculation element 125, and should be appreciated that, only is illustrative and nonrestrictive about the argumentation of laptop computer 125.This simple eye display equipment 100 can change into and other mobile portable device or information database (for example mobile phone); PDA(Personal Digital Assistant) (for example
compatible device); Desktop PC; Flat computer; Mobile E-mail communicator (for example
device or Good
compatible device) or individual digital music or video player (Apple
video and audio player for example; Microsoft
multimedia player and other motion picture expert group (MPEG)-1 video layer 3 (MP3) music player; Video frequency player or driver) communication.Main frame calculation element 125 also can comprise automotive system, global positioning system apparatus, satellite radio receiver or player, for example XM Satellite
device or SiriusSatellite
compatible device.Main frame calculation element 125 also can comprise known any other numeral or analogue means in principal computer calculation element, digital test device, diagnostic device,
or other digital video recorder, machine top cable box or this technology.
Should be appreciated that; Simple eye display equipment 100 should have suitable procedure, and to instruct from first format conversion be second form; The main frame calculation element 125 of wanting can receive and operate to transmit control signal rightly by said second form; And in this, simple eye display equipment 100 preferably includes converter (not shown), and it is changed between form according to the particular host calculation element.Various format configuration are possible and belong in the scope of the present invention, and the simple eye display 100 of this assist type is not limited to any particular host or communication format.
Main frame calculation element 125 can be communicated by letter with remote data base and can be served as the intermediary between simple eye display equipment 100 and content of multimedia source or the website, make the user can the heavy calculation element that is not associated with obtain situation that network that content of multimedia is associated is connected under watch multimedia (in the peripheral vision at wearer).It is very light envisioning said device 100, about several ounces, and, make wearer unimpeded mode to move to participate in normal daily routines by the wearer support.
Main frame calculation element 125 can be personal computing device; The desktop type or the laptop computer that for example comprise operating system (OS), said operating system (OS) for example for the compatible operating system of Microsoft Windows
OS, Microsoft Windows
Apple Mac
OS, Symbian OS, to associate compatible operating system, (SuSE) Linux OS, UNIX operating system or the Internet ready and be configured for use in the known proper operation of another of wireless move operation system.
Fig. 2 is the figure of explanation with the simple eye display equipment 100 of instance embodiment of host computing system 125 interactions.Main frame 125 is directed against said the Internet 250 or associated database 255 displaying contents along two-way communication path (for example cellular services 200a, Wi-Fi 200b, satellite service 200c, radio and television 200d and the closed-circuit signalling 200e) acquired information that leads to the Internet 250 or associated database 255 on the display device 115 of simple eye display equipment 100.
In one embodiment, communication path 200a can be the cellular mobile communication wireless path, and each path can be similar and different to 200e with respect to residue two-way communication path 200b.In one embodiment; Host computer 125 can use
EV-DO WiMAX to connect to come acquired information, and then uses
wireless connections 135 to communicate by letter with monocular device 100.
In another embodiment, communication path 200b can be Wi-Fi communication path or similar radiofrequency signal communication link.Host computer system 125 can use path 200c, 200d or 200e to communicate by letter with satellite service supplier, digital video recorder, radio and television supplier or closed-circuit signalling device respectively.Path 200a also can be associated with public access hotspot to 200e.
Should be appreciated that, this simple eye display equipment 100 can with in order to the NASCAR Nextel Fan View of the closed-circuit television of watching sport event and/or be used to show that the kangaroo.tv broadcaster of closed-circuit television incident is compatible.This simple eye display equipment 100 can receive a plurality of different broadcasting view, statistical information and the voice datas of sport event (identical or different incident) in real time through being configured to receive Live Audio.
In addition, this simple eye display equipment 100 can be through the Email that is configured to receive push email, extract Email or periodically transmit from electronic mail account (for example known any other Email supplier or internet site
Hotmail,
G-Mail,
mail,
Mail or this technology) along path 200a to 200e.In one embodiment; Radio Link 135 or communication path 200a can be compatible with Staccato
ultra broadband (UWB) USB to 200e and use; Said USB comprises radio frequency (RF) transceiver, digital baseband and in order to the interface up to the wireless connectivity of 480Mbps to be provided on single chip covering, said USB can be arranged in simple eye display equipment 100 or main frame calculation element 125.
Should be appreciated that in one embodiment, main frame calculation element 125 forms master-slave relationship each other with simple eye display equipment 100.Main frame calculation element 125 can comprise Microsoft
OS, and it is recognized as the secondary secondary monitor with respect to primary host computer calculation element 125 and elementary display with simple eye display equipment 100.Main frame 125 can use said operating system to control secondary simple eye display equipment 100 with wireless mode.
Should be appreciated that simple eye display equipment 100 roughly simultaneous system connects with wireless mode and two or more host apparatus 125 (for example first calculation element and second calculation element) Jie via at least two independent wireless communications paths 135.In this regard, simple eye display equipment 100 can be synchronous with first calculation element, second calculation element and other device, makes simple eye display equipment 100 serve as central hub.
In this regard, simple eye display equipment 100 can be initial and first wireless communications path of first device, and second wireless communications path also simultaneously initial and second device.First and second communication paths can be identical or different, and can connect via
or modified form
connects or another agreement disposes.In one aspect; 2.0 or 3.0 connections that communication path can be
, IEEE 802.11 or IEEE 802.15 wireless communication protocols, and said connection can be suitable for communicating by letter via some channels simultaneously with variable-digit speed and variable buffering device.In alternate embodiment; Communication path can be
to be connected, and said connection can be suitable for communicating by letter via all channels simultaneously with the variable buffering device with variable-digit speed.
First calculation element and second calculation element can be any previously mentioned calculation element; For example laptop computer, server, the Internet, desktop PC, smart phone, mobile phone, music player or any other move or non-moving device, and various calculation element is possible and belongs in the scope of the present invention.Preferably; Through using simple eye display equipment 100, beholder's controllable device 100 is remotely to inquire first calculation element via being connected in order to wireless
with the pairing of first calculation element.After this, device 100 can output to first calculation element to carry out function at device 100 places with the control program instruction.In one aspect; Communication path can be
to be connected, and said connection can be suitable for communicating by letter via some channels simultaneously with the variable buffering device with variable-digit speed.Said path can be suitable for transmitting video, audio frequency, figure or any data.
After this, device 100 (when communicating by letter with first calculation element) also can be inquired second calculation element via being connected in order to wireless
with the pairing of second calculation element.This can use similar and different wave point to accomplish.After this, device 100 can output to second calculation element with the control program instruction.In one aspect; Communication path can be
to be connected, and said connection can be suitable for communicating by letter via some channels simultaneously with the variable buffering device with variable-digit speed.Said path can be suitable for transmitting video, audio frequency, figure or any data.
Various compunications configuration is possible and belongs in the scope of the present invention, and install 100 can be through being configured to control other calculation element and/or the peripheral unit of any number, for example wireless head-band receiver, radio memory, wireless speaker etc.For instance, device 100 can match with two mobile phones independently simultaneously.In this way, wearer can use from the programmed instruction of simple eye display equipment 100 transmission and use said two mobile phones to carry out independent call.
Perhaps; Device 100 can use mobile phone to call out to use device 100 with mobile phone and the laptop computer pairing with radio modem; Control the laptop computer displaying video simultaneously, said video is to connect transmission on device 100, showing via bluetooth.Various configurations are possible and belong in the scope of the present invention, and should be appreciated that, device 100 can be controlled device or more devices more than three or three through setting up an above wireless communication link.
Fig. 3 explains the simplified block diagram of the limiting examples embodiment of this monocular device 100 for purposes of illustration.Simple eye display equipment 100 comprises the display device 110 that is connected to display controller 300; Said display controller 300 digital signal processor that
Freescale
or Advanced Micro-Devices
are done of can serving as reasons, or be connected to another controller of bus 305 (for example periphery component interconnection (PCI) bus).In one embodiment, display 110 can be connected to video graphic card (not shown), and it is connected to bus 305.Video graphic card can be AGP (AGP) video card, and it is coupled to the AGP video card slot in the device 100.Monocular device 100 also comprises storer 310, random-access memory (ram) 315 and ROM (read-only memory) (ROM) 320 for example, and it preserves executable program instructions, and through bus 305 programmed instruction is sent to controller 300.Preferably, monocular device 100 further comprises transmitter 325 and receiver 330 and/or combined type transceiver (not shown), and both are connected to bus 305 with the wave point of formation with main frame calculation element 125 for it.Transmitter 325 is also connected to display controller 300 and receives the instruction that is used for its control with receiver 330.
Simple eye display equipment 100 also comprises input media 335; It can be wireless mouse, tracking ball or keyboard or can be connected to other similar wireless device of pci bus 305 with wireless mode through Radio Link 340, and said Radio Link 340 is received by receiver 330.Perhaps, input media 335 can wired mode (not shown) be connected to bus 305 input signal is provided to controller 300.The simple eye display equipment of input media 335 may command 100, host apparatus 125 or simple eye display equipment 100 and host apparatus 125 screen prompt on both, wherein 125 one-tenth master/slave networkings of monocular device 100 and main frame concern.
Main frame calculation element 125 comprises CPU 345, has RAM 350, ROM 355 and also comprise the storer of cache memory 360.Calculation element 125 further comprises transmitter 365 and receiver 370 and/or combined type transceiver (not shown).Host apparatus 125 also can comprise elementary display 375 and input media 380, and it all is connected to bus 390, and for example pci bus is as shown in the figure.Should be appreciated that bus 390 can be connected to cable broadband and connect (not shown) or WiMAX connection 385, DSL circuit, cable modem, media player, music or video player or any other appropriate link to receive data from database.
During initial activation phase, between the receiver of the transmitter of simple eye display equipment 325 and host apparatus 370, set up bidirectional wireless link 135, and proof procedures take place via wireless communications path 135.After this, monocular device 100 can be communicated by letter with main frame receiver 370 with wireless mode via wireless communication link 135, and main frame transmitter 365 can be transmitted into monocular device receiver 330 with signal.In one embodiment, simple eye display equipment 100 can use
2.0 or 3.0 less radio-frequency standards to communicate by letter with main frame receiver 370 with wireless mode from its transmitter 325.In another embodiment, monocular device 100 can use wireless ultra wideband communications link 135 or use short-range radio frequency signal 135 with wireless mode communication.
In a non-limiting example; Central processing unit 345 execution of program instructions that are associated with host computing system 125, and use Microsoft Windows
to inquire that simple eye display equipment 100 is to allow the cache memory 360 of simple eye display equipment 100 transmitters 325 and receiver 330 access main frame calculation elements 125.The content of cache memory 360 then is sent to bus 390 and transmitter 365.Controller 345 output control signals with from transmitter 365 with data transmission to simple eye display equipment 100, and when main frame calculation element 125 cuts out or do not have power, on simple eye display 115, show multimedia.After being received by receiver 330, receiver 330 is communicated by letter with bus 305 so that the data transmission that is received is arrived display controller 300.
Microsoft Windows
through be configured to recognize separate with main frame calculation element 125 or away from a plurality of other secondary display 100.The display device 110 of simple eye display equipment 100 can be in order to watch multimedia, operation executable code, run application, watch Email, to watch calendar applications and other main frame computational data; It is transmitted into simple eye display equipment 100 via Radio Link 135, also is like this even main frame calculation element 125 cuts out or do not have power.
Perhaps, simple eye display equipment 100 can be through being configured in networked deployment as secondary display with host computer 125 and use simultaneously.Therefore; Through the input media 335 and display device 115 that uses simple eye display equipment 100; But the processor 345 of data on user's access host computer storer 360 and use host computer 125 runs application; This all carries out from the secondary display element 110 of the simple eye display equipment 100 that becomes master-slave relationship, and said secondary display element 110 can show different demonstrations with respect to the elementary display of host computer 125.
Fig. 4 provide the electronic package that is incorporated in the wireless head-band receiver display equipment 100 than detailed view, said device 100 is connected to host computer system 125 to connect the receiving digital video signal via bluetooth.These assemblies are the 61/010th of being entitled as of on January 4th, 2008 application " agreement (PROTOCOL FOR TRANSPORTING VIDEO SIGNAL OVERBLUETOOTH WIRELESS INTERFACE) that is used for carrying via bluetooth wireless interface vision signal " the; More describe in detail in No. 177 co-pending patent application cases (attorney docket is 0717.2082-000), the full text of said patent application case is incorporated herein by reference.
In a preferred embodiment; Head phone 100 comprises that (it can be open type multimedia application platform (OMAP) 3500 series processors to advanced RISC machines (RISC) machine (ARM)/digital signal processor (DSP) 412; It can be from the Dallas, Texas (the Texas Instruments of Dallas of city Texas Instruments; Texas) obtain), (it can be by can be from (CambridgeSilicon Radio (CSR) of Cambridge of cambridge silicon radio (CSR) company of Britain Camb for storer 414, blue tooth interface 416; England) 2 grades of blue tooth interfaces that obtain provide), display driver 419 (its can be for example for can be from the Vista, Massachusetts Blang's cruel article companies (Kopin Corporation of Westborough, the SSD1508 display driver that MA) obtains), videl stage shifter circuit 420, power supply 422, general receiver transmitter (UART) 426 (for example can be used for debugging) and the storer of supporting by battery 424 415.Secure digital (SD), extreme digital (xD), USB SD (uSD) storer 417 or other similar interface can be in order to application storing, kernel instruction property file or configuration datas, and/or be connected to for example device such as digital camera.Some buttons 430 can be associated with device (for example, switch 1/ switch, 2/ switch 3 and the input that resets) and LED output 432 (led1).VGA or better quality display 110 and audio frequency input-output device 460 also are provided, and it can comprise microphone input 462 and stereo output 464.
Signal can connect to send to main frame 125 from installing 100 via the blue teeth wireless that uses serial port profile (SPP) to set up; This with use in " senior " bluetooth mode any one opposite, its provide than this type of fine mode force come to light this use in the high larger process amount of unwanted higher level protocol.In bluetooth radio 416, connect the vision signal that receives via bluetooth and come to send to ARM/DSP 412 from interface 416 via USB connection 418.
A design considers it is under the situation of given data buffer sizes, to optimize data packet format.In CSR chip 416 inside is that default size is the bag impact damper of 1000 bytes.This can be through revising to force the crossfire vision signal only to use the buffer sizes of about 990 bytes.
In a preferred embodiment, ARM/DSP processor 412 can use the multitask embedded OS.Processor 412 is operated the vision signal that is received as follows.Make that mpeg format container file (for example .MP4 file) is available.In a preferred embodiment, this can be the proprietary file form, but the specific detail of selected input .MP4 file layout is unimportant herein, as long as DSP 412 is through programming rightly it is handled.Processor 412 is then opened towards the COM1 of host computer system 125 and via the bluetooth transceiver of USB interface 418 from CSR chip 416 and is received file.
MP4 demoder among the DSP 412 is separated into corresponding audio and video stream with file.More particularly, DSP 412 with input file H.264 compressed digital video signals be decoded as YCbCr base band component vision signal.ARM/DSP 412 also can be divided into the base band stereo audio with the compressed audio that is associated (being formatted as Advanced Audio Coding (AAC) format signal).
ARM/DSP 412 can output to display driver 118 with video by any suitable form, and said form for example is that BT.656 or motion picture and 16 gradual scannings of YUV of the 293M of Television Engineer association (SMPTE) with independent synchronizing signal are advised by 8 wireless communication departments of International Telecommunications Union (ITU) (ITU-R).
Vision signal through decompressing can be transmitted via the inside ARM bus of processor 416.The ARM bus then directly sends to display driver 419 via SMPTE 293M interface with said content.Intelligence interface controller (I2C) interface 447 is in order to configuration display 110.
Fig. 5 is the process flow diagram according to the method for operating 500 of the embodiment of simple eye display equipment.Said method begins (505).After this, simple eye display equipment waits for that (507) user imports request.This input can be any signal from input media output, for example from radio tracking ball, wireless mouse or wireless keypads or be positioned at the output of the button on the shell (for example, the shell 105 of Fig. 1) of simple eye display equipment.In one embodiment; Through (for example using operating system; Microsoft Windows
operating system) and use wireless mouse; The icon that the user can double-click on the simple eye display equipment screen (for example, the screen 110 of Fig. 1) is opened email message or is opened application program with indication.After this; Method 500 attempts in response to described request receiving data from content source, and said method will confirm whether (510) content source (for example is positioned in the storer (for example, the storer 310 of Fig. 3) on the simple eye display equipment; In camera output); Or whether said source be positioned at another remote location, for example on host computer (for example, the main frame 125 of Fig. 1).If data are to be stored in this locality (512) and not need Radio Link really, access local storage (515) and said data are retrieved and load on display device, showing subsequently through being configured to so.In case just returning, method 500 access local storages (515), method 500 wait for that new user imports request (507).
Yet; If data are arranged on the remote memory or be not the storer (513) that is positioned on the simple eye display equipment, begin so that (520)
connects or the data of (507) are asked in other previous wireless connections of describing to obtain.Should be appreciated that, also can use other wireless communication format, like previous argumentation, and this method 500 only is used for illustration purpose.
The transmitter (for example, the transmitter 325 of Fig. 3) of device can be through activating with inquiry (525) main frame calculation element, and the initial configuration signal is sent to the receiver (for example, the receiver 370 of Fig. 3) of main frame calculation element.Main frame confirms that whether
signal is through fully charging and receiving (530) from simple eye display equipment 100.In case receive signal, main frame transmitter (for example, the transmitter 365 of Fig. 3) just will send to monocular device receiver (for example, the receiver 330 of Fig. 3) with confirmation signal through using second prearranged signals.If do not receive signal (532), so simple eye display equipment continues inquiry main frame (525).With sending strong or than the signal of tool directivity.If the main frame calculation element receives signal (534) rightly, form (535) two-way communication data routing via Radio Link (for example, the Radio Link 135 of Fig. 3) so.Up-link can (for example be sent to device via the two-way data routing that is connected with down link signal; Simple eye display equipment 100 and the main frame 125 of Fig. 3) and from said device transmission; This method only is illustrative; Because except the non-limiting method of Fig. 5, can send various diagnostic utility application and signal along Radio Link.
In case form (535) two-way communication data routing, just can multimedia data file be sent to simple eye display equipment from the main frame calculation element.In a non-limiting example; The bandwidth of communication path is at the bits per second epipodium so that when at the host computing system place during operating Microsoft Windows
operating system; The host display output screen (for example; The host display 375 of Fig. 3) figure output can be in real time at display device (for example; The display 110 of Fig. 3) locates to watch; If make two displays fixing side by side, cursor moves on two screens, roughly taking place so that can be at simple eye display equipment place's operated from a distance host computing system simultaneously so.
Display controller (for example, the controller 300 of Fig. 3) sends (540) to the request from the vision signal of calculation element.Described request is sent to bus 305 and transmitter, and then sends via link.After this, simple eye display equipment confirms whether (545) vision signal receives from host computing system with wireless mode.If signal receives (547), so simple eye display equipment request audio frequency (550) with wireless mode.If signal does not receive (548) with wireless mode, so simple eye display equipment returns another request (540) of sending.
Display controller sends the request (550) from the sound signal of main frame calculation element.The Voice & Video signal can be used as a continuous signal and sends, and the present invention is not limited by any this type of dual signal embodiment.Described request is sent to bus (for example, the bus 305 of Fig. 3), is sent to transmitter and then sends via link.
Simple eye display equipment confirms then whether (555) sound signal receives from host computing system with wireless mode.If sound signal receives (547), so simple eye display equipment display video (560) with wireless mode.If voice data or signal do not receive (548) with wireless mode, so simple eye display equipment returns another request (550) of sending.
Programmed instruction causes simple eye display equipment to pass through the preferably display video (560) on display of the display controller in user's peripheral vision, and uses audio devices (for example, the audio devices 395 of Fig. 3) audio plays (565).After this, transmission is to the request (570) of another input signal.Confirm then whether (575) said process is accomplished.If said process is accomplished (577), method finishes (580) so.If said process is not accomplished (578), wait for that so another user imports request (507).Various controls configuration is possible and belongs in the scope of the present invention, and this configuration only is used for illustrative purposes, and envisions a plurality of steps that other is used to encrypt, and also anticipation cracks main frame calculating or other external computing device form.
How Fig. 6 can use simple eye display equipment 100 for indication to control and manage through user interface the figure of high-level software of various main frames 125.Software stack 600 comprises: device application program browser 601, and it can move on the core (for example the Linux core 602) of operating system (OS); Draw primitive, for example pile up 603 primitives that provide by direct FB (DirectFB); With graphical tool external member (for example Gimp suite of tools (GTK) window suite of tools 604).Device application program browser 601 allows the user to insert the application software that is used for wireless video head phone 100 through icon and menu interface.This is made up of the self-defined code of writing to said specific device 100 usually.
The application program of in the context of device application program browser 601, moving can comprise phonetic entry 621, virtual (desktop) networking client 622 and web browser 623.Virtual network is the system that allows Long-distance Control personal computer (PC).Through being outputed to another device with the form of bitmap, whole screen display carries out this operation.This bitmap is packed with procotol and is received and demonstration simply by said device.Similarly, the detected any mouse of local device is moved or key in data is directly delivered to long-range PC with according to its action.
Numeral input (switch) also can be in order to navigation and choice menus function, and said menu function allows control comprehensively and editing application program and the data that are associated.
As will understand at once, find that application program 611 not only allows to find adjacent Bluetooth
TMDevice, and allow to be connected to the application program browser level.What showed in the instance user display 610 for instance, is the fact of two institutes of current existence coupling arrangement (comprising desk-top computer 627 and Blackberry628).Find device 627,628 through the operation of finding application program 611.This is can be for example initial or through the manual initial Bluetooth of user when power on the first time of wireless head-band receiver device 100
TMDiscovery procedure comes initial.Bluetooth
TMDevice is found according to Bluetooth
TMStandard is carried out, at any new Bluetooth
TMWhen being connected the Physical layer place, reports bed device said Bluetooth
TMBed device.
Yet, in this, provide additional functionality to permit at network level place and Bluetooth
TMDevice communication.In particular, client 627,628 is apprised of and on local host, is opened particular port: the address in this locality of wireless head-band receiver device.This device port is served as the agency, seeks this type of request all the time.When receiving when request, it is reported back that available network level address (that is, for example TCP/IP address) makes for individual device 627,628 and is used for carrying out network level communication.
The hardware interface that Fig. 7 explanation is also provided by the browser application 601 of Fig. 6 is functional 700, its can receive and/or control device 100 on various hardware capabilitys.This type of function can comprise head phone detection 701, battery status 702, output unit adjustment (for example head phone button 703, speaker volume 704, microphone volume 705), media stream function 706, frame buffer switch 707, device driver and similar functions.
The standard bluetooth protocol stack of being implemented in the Bluetooth link 137 of Fig. 8 key diagram 1 wherein is added with special agent functionality.Bluetooth
TMLayer provides Bluetooth
TMFind device 800, as at any standard Bluetooth
TMIn the device.Yet, the protocol information of permitting carrying out with this type of device exchanges data 812 also will be provided through the head phone device 100 of connection 810.It also can be connected to the head phone device 820 of other type, phone head phone device for example, and it can provide disposes incoming call 822 and spreads out of with disposal and call out 824.
Fig. 9 A shows Bluetooth to 9B and Figure 10
TMThe more details of the proxy functionality that interface 137 is provided.
Fig. 9 A explanation relates to the classical pathway that is connected with a plurality of direct TCP layer of data source.For instance, one or more TCP of the data source that each application program of in the context of the application program browser 601 of Fig. 6, moving (for example voice identification application program 621, virtual network client 622 and web browser client 623) maybe be separately need provide with main frame 125 ' are connected.Legacy system relates to a plurality of direct TCP of data source and being connected.
Fig. 9 B explanation can be how be supported being connected between simple eye display equipment 100 and the Internet 250 through acting on behalf of 930 via the device with Internet function 125, but Bluetooth
TMItself do not provide with any of the Internet 250 or other upper layer network and directly be connected.Bluetooth can't be directly connected to the Internet; It must be acted on behalf of via the device with Internet function.Therefore, for instance, for example application program such as web browser 623 needs host apparatus 125 ' to serve as the networking agency usually.
The wherein single Bluetooth link 137 of Figure 10 explanation is supported the preferred arrangements of a plurality of application programs 621 to 623.A plurality of application programs 621 to 623 need single Bluetooth
TMConnect 137 and support a plurality of sockets, for example transmission control protocol (TCP) connects.For instance, although each application program 621 to 623 possibly need a plurality of TCP to connect standard Bluetooth in addition
TMThe Bluetooth that is added between layer and the rule T CP protocol layer
TMAgent layer 1010 is sent to a plurality of TCP connections of asking on the single socket.Bluetooth
TMThe single socket that link 137 is provided then is transported to main frame with said a plurality of connections.
Provide similar reverse function 1018 bag is taken apart its corresponding connection 621 ' to 623 ' on the host computer side 125.
Although Bluetooth
TMItself allow a plurality of sockets that are connected between main frame and the client, but many mobile phone operators force single restriction that connects.Therefore, must observe single restriction that connects in many cases.This not only permits higher-security, and avoids making wireless device to be busy with Bluetooth
TMThe possibility of connection request.
This approach is also permitted standard web browser application program 623 (for example) and under situation about need not make amendment to its TCP socket use, is operated.Therefore; The operation of the agent functionality 1018 that provides on bluetooth agency 1010 who provides on the client 100 and the main frame 125 makes the application program 621 to 623 and the functional isolation of this type of modified socket of operation in application program browser 601, and also makes the application program and the functional isolation of this type of modified socket of operation on main frame 125.For instance, the virtual network of operation does not need to revise now on main frame 125.
Figure 11 explains through providing so that install the device driver that application program browser 601 needn't be known the specific detail of the content format that is used for the particular host device.Therefore, for instance, 125b provides blackberry, blueberry server 1101 to the blackberry, blueberry main frame, and to Windows machine main frame 125c Windows Vista server 1102 is provided.This allows the user interface specific detail of particular host 125 is appeared to wireless head-band receiver device 100 as generic interface.Server 1101,1102 provide at least two functional, comprise the Bluetooth of Figure 10
TMProxy functionality 1118 (that is, the TCP channel data is unpacked be a plurality of required channels) and content server.
Figure 12 explains the device context processing that server 1101,1102 is done.These can comprise the content format sheet of the corresponding contents of each type that is used to comprise email INBOX 1201, contacts list 1202, stock ticker 1203, Media Browser 1204 etc.In these server functionalities 1201 to 1204 each uses the page marker language to come its content is carried out reformatting.The page marker language can be then by elements browser 601 deciphers on the video head phone device.Elements browser 601 now usually decipher page marker language to cooperate the various requirement of video head phone device 100.
In alternate embodiment, for example function such as Windows Sideshow server can be obtained through formatting component from the Windows device, and requires according to Sideshow it is formatd.WindowsSideshow is the technology of introducing with the Windows Vista version of
operating system, and it makes Windows PC to drive to be connected to the various secondary monitor devices of main PC.These devices can separate with display etc. on being embedded in the outside that laptop computer renovates with main PC (for example) or be integrated in the said device.
Through virtual network and/or side display function property, wireless head-band receiver device also can become " chameleon ", thereby in fact presents the same subscriber screen of host apparatus, identical graphical user interface and familiar user's control.Accept several host (that is, blackberry, blueberry, mobile phone and PC) simultaneously even install 100, also permit the user and between host apparatus, switch.Whenever the user carries out this type of when switching, the user can see and still recognize familiar slave unit or main frame and device users screen, identical graphical user interface (GUI) and is familiar with control and order with identical.
Therefore, understand portable video head phone 100 now and can how to watch content by different way, said mode all can be selected by the user, comprising:
-new the application program of being write to device itself; Device application program, Web page application program, web browser etc.; And
-
Sideshow application program or the native applications program that connects via virtual network.
The agency supports through bluetooth, the impetus that can pass original trustship device GUI interface, screen, order and control interface to the multiple arrangement support simultaneously.
Turn to Figure 13 now, show the alternate embodiment of multi-functional simple eye display equipment 100, the diagram of the assembly of its exhibiting device 100.The assembly of envisioning various assemblies and being showed forms the non-full list of said assembly and is not restrictive.In this embodiment, simple eye display equipment 100 preferably can be used as and is used for the said a kind of foreign language 1300a of the first entity 1300b is translated as the second language that wearer W understands or the translater device of auxiliary said translation.Simple eye display equipment 100 can receive the audio frequency input 1300a from the first source 1300b (for example natural speaker, audio-source, communicator, Email, video source or phone).As response, simple eye display equipment 100 can convert this audio frequency 1300a into the different second language of the form with wearer W understanding.This then launches with the text formatting demonstration or with audio format for the wearer W of simple eye display equipment 100 through the translation audio frequency through conversion.
In the another embodiment of this device 100, device 100 can not only be exported through cypher text from loudspeaker 1345 with the form that can listen voice, and installs 100 and also can export through cypher text from external device (ED).For instance, wearer W possibly arrive foreign country and need to use said device 100 as translation tool to speak with foreign taxi driver.Replacement is from installing 100 outputs through cypher text or voice; Device 100 will be controlled second peripheral unit 1350 that is associated with the driver; And then from said second device 1350 (for example, taxi driver's the mobile phones 1350) but not device 100 outputs of being dressed through cypher text.
In this embodiment, device 100 can via radiofrequency signal communicate by letter with external device (ED) 1350 pairing, and will output to external device (ED) 1350 through cypher text in real time for foreign speaker 1300b.This second external device (ED) 1350 can be associated with foreign speaker 1300b.For instance; At the initial beginning place that uses, device 100 can comprise in order to the inquiry external device (ED) (for example monitor, personal digital assistant, notebook, portable music player, remote speaker, mobile phone, intelligent movable phone have transceiver or receiver and can carry out any other device of RFDC) programmed instruction.Device 100 for example can use known protocol standards such as any other wireless communication protocol known in
1.1,1.2 or this technology to come and the external device (ED) pairing.After this, device 100 can be then be delivered to external device (ED) with radiofrequency signal and uses said peripheral unit 1350 with the control external device (ED) but not use loudspeaker 1345 to output to foreign speaker 1300b through translated speech (it is imported into device 100).
In another embodiment, device 100 can and then use said external device (ED) 1350 to handle or export through translated speech or text with the external device (ED) pairing.Device 100 can be with the reception voice output to remote-control device; And translation itself can externally be installed 1350 places and taken place; And can export from the loudspeaker 1345 that is associated with device 100, or can be from loudspeaker 1355 or the 3rd device (not shown) output that is associated with external device (ED) 1350 through translated speech through translated speech.In this way, wearer W available peripheral unit capable of using uses with device 100, and can provide from one or more a plurality of peripheral units 100,1350 through translated speech.
In general, multi-functional simple eye display equipment 100 will convert data into from the initial audio input 1300a of the foreign speaker or the first source 1300b.After this, device 100 uses the comparison between the reference data of being stored in voice data that calculation elements 1325 (long range positioning or directly be positioned in the device 100) carry out being received and the storer 310.
In one embodiment, use comparer 1320 to come query translation look-up table 1330.Comparer 1320 can be software program or discrete digital device.Translation look-up table 1330 has in order to audio input data is converted into the programmed instruction of second language from first language together with comparer 1320.This translation look-up table 1330 can be any translation software known in this technology; For example with Massachusetts Burlinton NUANCE COMMUNICATIONS, the translation software that
BABEL FISH
SOFTWARE is associated, the software that is associated with GOOGLE
WEBSPHERE
or have any other software translation that is used at the programmed instruction of translating between two or more language at least.
Corresponding to then preferably outputing to one or more peripheral units through interpretive language (it is through conversion) from the voice data of foreign speaker 1300b.These peripheral units are associated with simple eye display equipment 100.These peripheral units can be one or more devices of being configured for use in vision output (in screen, showing), data output or are associated with the device (loudspeaker) that is configured for use in audio frequency output.Anticipation output can show by more than one forms.Randomly, output can use the storer 310 that is associated with simple eye display equipment 100 to write down for retrieving after a while and resetting.In another embodiment, the output of foreign language or translation can come concise and modulation with desirable audio format for the wearer of the simple eye display equipment 100 of multifunctionality.
Figure 13 shows the graphic explanatory view of some assemblies that device 100 is described, its median ocellus display equipment 100 preferably includes microphone 462 and loudspeaker 464, and both are connected to pci bus 305 with mode of operation for it.Controller 300 is operatively coupled to bus 305 to various assemblies steering order to be provided with storer 310.Preferably, install 100 accesses in order to suitable procedure instruction from microphone 462 received audio signal 1300a.Controller 300 uses A/D converter 1310 to convert sound signal 1300a into numerical data.
From the translation look-up table 1330 then output to storer 310 through translation data.It will be second sound signal through the code-switching data-switching from what translate look-up table 1330 receptions that controller 300 can further use audio converter 1340.Second sound signal can then output to loudspeaker 464 by controller 300.Loudspeaker 464 can be then through using earphone or earplug or will outputing to the user through switching signal like Figure 13 displaying or like the previous discrete loudspeaker assembly of describing.
In this regard, simple eye display equipment 100 can be used as the translater device, says that wherein first people 1300b of first language 1300a can be positioned at the position identical with wearer W, and is saying the for example first language 1300a such as Japanese.In this embodiment, wearer W can be from loudspeaker 464 with different language (for example with English) and preferably hear the sound signal 1300a from foreign speaker 1300b in real time.In another embodiment, sound signal 1300a is received by microphone 462, can convert digital document into through A/D converter 1310, is then translated and also is stored in the storer 310 for retrieving after a while and checking.
Turn to Figure 14, in an embodiment again, can the said translation of Visual Display on the indicator screen 110 of simple eye display equipment 100.In this regard, translation can be as before taking place about the described similar fashion of Figure 13.Simple eye display equipment 100 comprises storer 310, and controller 300 can be then through using comparer 1320 that digital document that is received (corresponding to sound signal 1300a) and translation look-up table are compared.Controller 300 can use translation look-up table 1330 that digital document is converted into corresponding to second digital document through the translation digital document.
Then can be with being stored in the storer 310 through the translation digital document.In case by controller 300 instruction, just can be with said file from storer 310 outputs, and further by converter 1440 be converted into have appropriate video/graphics form suitable digital file with display 110 display images to device 100.Be the known any acceptable form that is used for display image in this technology through the converting digital file.Show clear sight output to indicator screen 110, for example check for the beholder as English, German or japanese character, shown in figure 14.
In another embodiment, can then export and further convert into suitable digital document through the translation digital document from storer 310.This file is suitable for respectively from video and the audio frequency of display 110 with loudspeaker 464 outputs.Therefore, the user can be acceptable through format translation and hear and see the translation of foreign language in real time.
In an embodiment more shown in Figure 15, the translation of the voice 1300a of foreign speaker 1300b can audio format but with select in advance by wearer specific and on aesthetics desirable record carry out.As above embodiment shown in Figure 13, simple eye display equipment 100 comprises microphone 462 and loudspeaker 464, and both are connected to storer 310 and controller 300 through peripheral component interface bus 305 with mode of operation like previous argumentation for it.
Data corresponding to second sound signal output to digital voice record converter 1555 through controller 300 from storer 310.Digital voice record converter 1555 is changed into the booking situation speech with digital audio file (it is suitable for from loudspeaker 464 emissions), and it is said through cypher text with emulation mode.In another embodiment, controller 300 can be through modulation file 1550 with the data-switching from comparer 1320 simply, and is not limited to any certain translation software or interpretation method.
In one embodiment, through translated speech can famous individual, famous actor's artificial voice or for example comfortable sounding speech such as movie star or professional announcer come from loudspeaker 464 outputs.In one embodiment, the speech of performer (for example well-known famous person) record can be in real time with exporting from loudspeaker 464 through translated speech from source 1300a.Storer 310 preferably includes the data that have corresponding to the audio format of speech modulation sound.Various storeies record voice configuration are possible and belong in the scope of the present invention, and this device 100 is not limited to any certain records speech.Should be appreciated that some recording of voice can be recorded in the storer, male sex's speech, women's speech, automatic voice maybe can use any other possible recording of voice of converter 1555 conversions.In another embodiment, device 100 can have an above recording of voice, and it can each in the default recording of voice obtain to realize accessibility after a while in storer 310.During initial start or configuration, the user can use input media or menu to select the speech of wanting.Digital-to-Voice Translator 1555 possibly convert digital document into one or more different artificial voices through using input media (not shown) and using display 110 to select optionally simply.
This simple eye display equipment 100 is not limited to translation or shows translation, but can foreign voice be translated into can recognizing the text understood of language through being configured to, and then writes down said translation for using in the future.Simple eye display equipment 100 can be through being configured to simply voiced translation to be become text, and with said text entry in the storer 310 of simple eye display equipment 100.
In another embodiment, simple eye display equipment 100 also can be through configuration for using with mobile phone (125b of Fig. 1) or other communicator.Simple eye display equipment 100 can comprise wireless communication interface and have transceiver (Fig. 3 327) with from mobile phone or other communicator (Fig. 1 125) but not microphone 462 receives the data that are associated with caller's speech.Here, device 100 can be with translating into from foreign caller's sound signal through the translation audio file, and it can or can show at indicator screen 110 from loudspeaker 464 output, as shown in Figure 15.Various translations output configuration is possible and belongs in the scope of the present invention, and this simple eye display equipment 100 is not limited to any this type of face-to-face configuration.
In another instance embodiment, simple eye display equipment 100 can adopt so-called computer program " software personage " or incarnation to carry out head installing type audio/visual radio communication.Incarnation is to permit carrying out the mutual two-dimensional character or the expression of model between assembly and the wearer of head installing type audio/visual Wireless Telecom Equipment." software personage " be can form specific for to make the data of personalized set of diagrams picture of head installing type audio/visual Wireless Telecom Equipment and/or sound according to wearer interest.In one embodiment, " software personage " adopts immediately the form by the emulation personnel of wearer identification.In another embodiment, video is not provided, and " software personage " can only comprise audio element, for example read some orders or menu option with the audio frequency in the predetermined speech.Through using this simulated human interface, its PDA of user's may command, mobile phone, desk-top computer or have any other remote-control device of wave point.This simulated human can be famous person, actor, actress, famous individual, notorious individual, statesman, world leader or imaginary role, cartoon, mythical personage or any other true or imaginary figure role or figure output.In addition, the software personage can receive and message playback, and forwarding telephone calls gives the alarm, and confirms user's availability, distinguishes the priority of message, and carries out other automation function.
" software personage " but preferably emulation receive the control of voice command from wearer with emulation head installing type device assembly." software personage " but preferably emulation wearer is spoken with mutual with wearer.In addition, said personage or software are not permanent, and wearer can use the simple relatively automation process that can on said device, operate to exchange new " software personage " with said personage easily.In another embodiment, " software personage " can be the software application that available less expense is bought, or can permit in batch and buy some " software personages ".
" software personage " can be rendered as speech, sing or with other mode emulation voice; And wearer can with display that head installing type display is associated on watch said personage, for example through watching high graphics with the form output of emulation individual or famous person's face.Preferably, " software personage " or simulated human voice and figure make wearer happy on aesthetics, and wearer likes said mutual, and with through personalized personage or simulated human image and sound alternately with control device fast and easily.Anticipation replaces use to input or output device; Head installing type display have voice identification capacity and software receive with process voice commands further control command being provided to device, said control command is again in order to one or more peripheral assemblies of control head installing type device." software personage " can long-range or local storage, and software can be carried out on the processor of Local or Remote.In one embodiment, " software personage " can be rendered as imitation with famous person's speech (for example famous actor) read menus option.
Turn to Figure 16, show the synoptic diagram of the embodiment of audio/visual head installing type radio communication device 100.Audio/visual head installing type radio communication device 100 is through being shown as simple eye display equipment, but it is not limited thereto configuration, and can have different head installing type configuration (for example eyes etc.) and can be attached to secondary reading glasses or a sunglasses.Audio/visual head installing type radio communication device 100 is through being shown as general non-limiting computer configuration, but can have other configuration.In one embodiment, device 100 can have suspension rod, and it has the connector of snap-on on the part of cap or sunglasses etc.Audio/visual head installing type radio communication device 100 preferably includes supporting construction 5; And can comfortable mode be supported on around the head H of wearer W, be supported on around the E of ear of wearer W, or be supported on overcoat G (for example cap) that wearer W worn on every side.
Various monocular device supported configurations are possible and belong in the scope of the present invention; And some in these configurations are configured in the following patent application case to be described in detail: the gloomy people's such as (Jacobsen) of Jack's cloth of application on January 12nd, 2007 the 60/880th, No. 270 U.S. Provisional Patent Application case; The gloomy people's such as (Jacobsen) of Jack's cloth of application on May 14th, 2007 the 60/930th, No. 232 U.S. Provisional Patent Application case; The 60/930th, No. 275 U.S. Provisional Patent Application case of Jack's cloth gloomy (Jacobsen) of application on May 14th, 2007; And the gloomy people's such as (Jacobsen) of Jack's cloth of application on May 15th, 2007 the 60/930th, No. 242 U.S. Provisional Patent Application case.The full text of all these patent application cases all is incorporated herein by reference.
Figure 16 shows some assemblies of audio/visual head installing type radio communication device 100, and this device 100 can comprise different hardware or component software, and is not limited to any certain computer configuration, because this only shows for purpose of explanation.Audio/visual head installing type radio communication device 100 preferably includes controller 300, storer 310 (for example minimum 256 megabyte solid-state memories or more) and bus 305.Should be appreciated that, depend on the ability of device 100, storer 310 can comprise different amounts (1.5GB arrives greater than 10GB), and this depends on the complexity level of device 100.This device 100 is not limited to any particular memory tolerance, and can comprise be suitable for the look-up table function relatively than small memory, can comprise that maybe this depends on device 100 than multi-memory.In the assembly of computer equipment 100 each uses suitable lead-in wire to be connected to bus 305 with mode of operation.Audio/visual head installing type radio communication device 100 preferably also has display 110, and it is connected to bus 305 with mode of operation.Display 110 can have various configurations and can be suitable for VGA or high-resolution, high-definition television for example, or be suitable for the display of high resolution video image.Said display can for known in this technology or as the configuration of before having quoted described in any display, the full text of said configuration of before having quoted is incorporated herein by reference.Controller 300 is preferably CPU, and is connected to bus 305.Storer 310 is also connected to bus 305, and anticipation storer 310 can comprise the solid-state memory configuration and can further comprise long-range or the local hardware driver.In one embodiment, storer 310 can be enough greatly with keep supporting MP3, MP4, H.263, H.264, WAV, AAC, AIFF, apple harmless (Apple Lossless) and can listen (Audible) 2,3 and the digital document of 4 audio files and other form.
Preferably, audio/visual head installing type radio communication device 100 further comprises the audio devices 464 with Audio-Frequency Transformer, and it is connected to bus 305.Audio devices 464 can comprise Audio-Frequency Transformer element, tweeter, intermediate frequency or fundamental frequency loudspeaker or some groups of loudspeakers (THK, DOLBYDIGITAL etc.), and is suitable for ready-made mode from storer 310 emission sound and playback quality digital file, song, the tinkle of bells, stroke or other audio files.Audio devices 464 can further comprise earplug or headphone.
Audio/visual head installing type radio communication device 100 also has microphone 462, and it is connected to bus 305 with mode of operation.Microphone 462 preferably receives voice command and uses A/D converter 1310 that this data-switching is digital format.Then numerical data is sent to bus 305, and can said data be written to storer 310.Device 100 can further comprise input media 335, and for example button, wireless mouse, tracking ball, roller or keyboard are to select from some menu options.Yet input media 335 is optional, and installs 100 and preferably use voice identification order to control.
Audio/visual head installing type radio communication device 100 also comprises wave point 327; Rf receiver and transmitter for example, it can use wireless format or any other wireless format of Wi-Fi,
(for example via Fig. 1 connection 135) to transmit and receive radio frequency signal numerical information be transmitted into remote-control device or network and receive numerical information from remote-control device or network.Interface 327 is suitable for 802.11b/g/n, Wi-Fi and Bluetooth 1.1,1.2,1.5,2.0 enhanced data rates and 3.0 wireless capabilities; Yet interface 327 is not limited to these; And depend on the geographic position; Interface 327 can comprise like other wireless format described in the following patent application case: the gloomy people's such as (Jacobsen) of Jack's cloth of application on January 12nd, 2007 the 60/880th, No. 270 U.S. Provisional Patent Application case; The gloomy people's such as (Jacobsen) of Jack's cloth of application on May 14th, 2007 the 60/930th, No. 232 U.S. Provisional Patent Application case; The gloomy people's such as (Jacobsen) of Jack's cloth of application on May 14th, 2007 the 60/930th, No. 275 U.S. Provisional Patent Application case; And the gloomy people's such as (Jacobsen) of Jack's cloth of application on May 15th, 2007 the 60/930th, No. 242 U.S. Provisional Patent Application case.
Preferably, use voice recognition techniques (for example from Massachusetts Burlinton
voice recognition software) to come control audio/vision head installing type radio communication device 100.In operation, the voice command 1600 from wearer W is received by microphone 462 with analog format.Use A/D converter 1310 to convert simulated data into numerical data.With the numerical data route through bus 305 and be stored on the storer 310 for access.Controller 300 comprises in order to this storer 310 of access and uses and is stored in the storer 310 or to be stored in storer outside or even to install the data-switching that the look-up table 1610 of 100 outsides (through using wave point 327 and remote memory (for example, Fig. 1 remote-control device 125) communication) received microphone 462 be the programmed instruction of control command.Control command can be through exporting with the software application of logout in storer 310 to open Email, to watch film etc.Various operation system of software are known to control various peripheral units in this technology, for example known any other operating system in
MOBILE,
WINDOWS
operating system,
APPLE
or this technology.In one embodiment; Look-up table 1610 can be associated with voice recognition software program, and said software program for example is NUANCE DRAGON NATURALLY SPEAKING
or any other suitable voice recognition software program.
Preferably, audio/visual head installing type radio communication device 100 comprises software program 1620, and it is provided to audio/visual head installing type radio communication device 100 with video desirable on the aesthetics and/or " audio frequency personage " or simulated human attributes.These attributes can be the form of image (simulated human that is for example shown on the display 110 is facial) or be the form of audio frequency (emulation, modulation or the recording of voice for example launched from audio devices 464).This audio/visual head installing type radio communication device 100 also is not limited to simulated human appearance or simulated human speech; And software program 1620 preferably can provide other desirable stimulation to the user, for example except " personage ", also forms the musical recording or the desirable picture of desirable theme.Software program 1620 also can provide " artificial personage " or theme during mutual.This provides highly individualized and desirable experience to the user, and the user likes using said audio/visual head installing type radio communication device 100.
In an embodiment of the present invention, audio/visual head installing type radio communication device 100 preferably provides the audio frequency personage and the non-video personage.In this, audio/visual head installing type radio communication device 100 comprises software program 1620, and its modulation is from the audio frequency of the device of one or more transducers (not shown) emission of audio devices 464.Preferably, audio frequency personage 1620 provides speech modulation record desirable on the aesthetics from audio devices 464 one or more menu options of output the time.This aesthstic desirable speech modulation record can be read some menu options to the user and use input media to select or select through the voice commands that uses the voice identification for the user.
For instance; Audio/visual head installing type radio communication device 100 is exportable to be stored in record in the storer 310 to export some voice commands; For example " open Email, say Email, call out, say phone, watch video, say and watch video " etc.Through using this simulated human interface, its PDA of user's may command, mobile phone, desk-top computer or have any other device (for example, the device 125 of Fig. 1) of wave point, and menu option can change according to there being which other peripheral device.All these menu options can specific prerecorded famous person's speech be exported and are no video by customization.This specific prerecorded speech or sound can have predetermined tone color, sequential and the sound of actor, actress, stress or other desirable entity (for example authoritative or pleasant speech pattern).In addition, being rendered as these records of reading some menu options can use wave point 327 and suitable computer program to install, exchange and replace with small expense by the user in an easy manner.Preferably, audio/visual head installing type radio communication device 100 can comprise the integrated chip that is used for this purpose.
In another embodiment of the present invention, audio/visual head installing type radio communication device 100 preferably provides the personage who comprises audio element and video elementary, and can comprise multimedia.In this, device 100 comprises software program 1620, and its modulation is from the audio frequency of the device of one or more transducers (not shown) emission of audio devices 464, and display image on video display 110 also.Preferably; The Voice & Video personage is providing speech modulation record and video desirable on the aesthetics during with video display 110 one or more menu options of output from audio devices 464, to imitate mutual with the user of audio/visual head installing type radio communication device 100.But this is aesthstic desirable speech modulating audio frequency digital recording and video emulation individual and reads the look and feels of some menu options to the user, and wherein the user can see and hear the video personage.This can impel the user to use video and audio frequency to imitate and said personage's voice are controlled said device for the user through the voice commands or the optional input media 335 that use the voice identification.Through using this simulated human interface, the user can through say voice command to microphone 462 and imitate and show the personage voice control its PDA, mobile phone, desk-top computer or have any other device of wave point.
In addition; Software personage 1620 can comprise in order to when serving as the programmed instruction of digital assistants when being associated with mobile phone or other communicator (for example
peer-to-peer communications device, mobile phone, E-mail device, PDA etc., shown in Figure 21 to 27).In one embodiment, the user can receive call from mobile device (for example mobile phone or PDA, smart phone).Audio/visual head installing type radio communication device 100 can pick up said calling, makes said calling can use audio/visual head installing type radio communication device 100 to replace answering through picking up phone via bluetooth or the connection of similar radio frequency.In this, wearer possibly be busy with carrying out other function, for example verifies Email or uses finger-impu system 335 to participate in the word processing.Here, personage's software program 1620 can provide some menu prompts under the absent situation of wearer, to select (that is, staying message, wait etc.) for the caller to the caller with desirable audio or video image.In addition, prerecorded message can be rendered as roughly true to nature, and commutative or different to different callers, and the user can buy Different software personage 1620 for this purpose.
In another embodiment; Software personage 1620 can comprise the computational intelligence program; It allows controller 300 that formal analysis and/or statistical study from the user's input that is received are provided, and since from the video of video display 110 and/or from the form output reasoning conclusion of the audio frequency of audio devices 464.In one embodiment, " software personage " 1620 can comprise neural network or other artificial intelligence program.Suppose that storer 310 can comprise that computational intelligence program 1620 can be operated in every way so based on the restriction of the mobile character of audio/visual head installing type radio communication device 100.Program 1620 can this locality be stored on the storer 310 or be stored on the remote system (for example, the device 125 of Fig. 1), and program 1620 can be speciallyyed permit, buy, rent etc.Perhaps, program 1620 can be stored on the network, and on telecommunication network, moves, and the output of wherein said network is to use wave point 327 to be sent to audio/visual head installing type radio communication device 100 with wireless mode.In addition, the computational intelligence program can be at the running background of audio/visual head installing type radio communication device 100.
Turn to Figure 17 to 18 at present, show an embodiment of the audio/visual head installing type radio communication device 100 with specific " personage ", said specific " personage " uses the software program 1620 that is stored in the storer 310 to originate from.In this embodiment, device 100 uses from audio devices 464 outputs and the audio frequency supported by the shell 5 of device 100 to come and user interactions.Here, but the particular software application 1620 in controller 300 execute stores 310, and software program 1620 can comprise the digital audio file of emulation to wearer W read menus option selection 1705.Yet software program 1620 can comprise programmed instruction, makes on aesthetics, to make desirable booking situation voice of wearer W or individualized tone 1705 read said audio frequency.
In one embodiment, booking situation voice 1705 are emulation voice of famous person or famous individual's speech (for example performer (Silvester Shi Tailong (SYLVESTER STALLONE)), cartoon character, portrait, imaginary or true role or historical personage (for example former US President) etc.).In a non-limiting example, voice 1705 can be read options menu 1705 and select through use input media 335 or through the appropriate voice command that reception microphone 462 is received for the user.Preferably, " the software personage " 1620 who is stored in the storer 310 will comprise one or more digital documents, and it supports MP3 or WAV or another form.Audio file preferably is associated with famous individual's speech.With the 300 selected appropriate time intervals of controller from audio devices 464 emission records.For instance; Famous individual software, role or incarnation can the recording of voice launching simulation voice of wanting; It comprises " from the following option, selecting: open email application, say ' Email ', listen to the music, say ' music ', see a film, say ' film ' " or the like.Envision other menu option, and this does not form restriction to the present invention.
Turn to Figure 18 at present, show separate with display 110 for purpose of explanation and another instance of " the software personage " that show with zoomed-in view.In this embodiment, audio/visual head installing type radio communication device 100 also uses and utilizes high graphics to show and come and user interactions at the video that the shell 5 of audio/visual head installing type radio communication device 100 shows from video display 110.Here, but the software program 1620 in controller 300 run memories 310, and software program 1620 can comprise the data file that is associated with video.Video 110 shows the simulated human image 1815 of presenting to wearer W, and said simulated human image 1815 is gone up output at display (zoomed-in view of wherein showing display 110), and in the peripheral vision of wearer and do not hinder the normal viewing space of wearer.
In a non-limiting example, the video and graphic that is shown can further comprise instruction 1820, some options menus 1825 and cursor 1730.The user can click or select through the appropriate voice command that reception microphone 462 is received through using input media 335 (for example, wireless mouse).Preferably, show famous individual portrait 1815 with the 300 selected appropriate time intervals of controller.For instance, famous individual 1815 can show face or its part or whole simulation personnel.Together with individual's's 1815 (for example performer, famous person or famous/notorious personnel, cartoon or portraits) portrait, but videotex instruction 1820 " from the following option, selecting " replace said image to come emulation to read said instruction.Also envision other instruction.This allowance impels the user to use input media 335 (for example wireless mouse) to select control command.Also can show control icon or hyperlink, it comprises " turning on email application ", " seeing TV " and " acquisition Weather information " etc.In another embodiment, audio/visual head installing type radio communication device 100 can comprise the video and the audio attribute of " artificial figure ", and artificial figure 1815 can be rendered as and reads said option to wearer and replace showing said option one 825.Preferably, personage 1815 can be the part of automated system, and its any other of paying close attention to notice, alarm, warning or wearer is indicated and pointed out the user.
Preferably, personage 1815 can to allow wearer be that it is own and stay speech information for playback after a while.In addition, incarnation 1815 can stay to the prerecorded message of extraneous caller, and the system scope message of separating with computing machine maybe can be provided.Preferably, audio/visual head installing type radio communication device 100 will be provided to remote computing device or mobile phone to be linked to remote-control device in depositing synchronizing signal when needed.Preferably, during hanging up, the caller can receive interesting video messaging.Preferably, video messaging can be short commerce or animation montage, and can buy and sell from publisher or similar third party by move mode.In another embodiment, video messaging can comprise the advertisement or promotion that the third party initiates, and the payable expense of advertiser comes during the caller hangs up mobile device or smart phone, to show its advertisement.Here, can be during hanging up optionally with a certain cost by advertisement third party playing advertisements.Perhaps, incarnation 1815 can receive input information to pass to the individual who is associated with audio/visual head installing type radio communication device 100 from the caller.
Turn to Figure 19 at present, show another embodiment of this device 100.In this embodiment, audio/visual head installing type radio communication device 100 can preferably be communicated by letter so that obtain different " software personage " 1620a, 1620b, 1620c etc. with remote computing device 1900.In addition, audio/visual head installing type radio communication device 100 can with second device, network, the Internet or internal network or public arena network service.Wearer can provide control signal radiofrequency signal 1950a is transmitted into second wave point 1945 or the Internet to the wave point 1945 of audio/visual head installing type radio communication device 100.Control signal 1950a, 1950b are suitable for creating between audio/visual head installing type radio communication device 100 and another second device 1900 or lead to the bidirectional communication link of the Internet.Wearer uses one group of menucommand can be from the Internet or obtain second individualized " software personage " 1620b from remote computing device 1900 (for example server or have other calculation element of storer 1910).Wearer can be selected incarnation or two dimensional image from some options, or imports famous individual's name simply or from some options, select the audio frequency personage.Wearer can use character 1815 to control wave point 1945 to be written to storer 310 from the wireless rf link 1950b received RF signal and the software program 1920b that will be derived from remote memory 1910.
In this way, wearer uses input media or voice identification can select new two dimension " personage " or incarnation 1620b mutual to be used for, and it is different from first " software personage " program 1620a.Second " software personage " 1620b can be stored and first " software personage " 1620a can be wiped.Equally, with payable expense of giving the third party subscriber, available the 3rd " software personage " program 1620b, 1620c wait the second personage's program of replacing.Should be appreciated that some incarnation 1815 (it is desirable and depends on popularity) maybe be more expensive than other incarnation.
In an embodiment again, storer 310 can comprise a plurality of hybrid " software personage " two-dimentional incarnation program, for example first performer's image, 1815, second different famous person's speeches and form the 3rd cartoon or the animated graphics of health.In this embodiment; Through using wave point 327; The user can use input media 335 to control controller 330 provides steering order so that the program be associated with a plurality of or hybrid " software personages " to be installed, said " software personage " be different from install or first " software personage " program 1620a.Preferably, wave point 327 with high data rate communication so that in the mobile wireless environment, receive big video file and audio file with wireless mode.
Turn to Figure 20, show another embodiment of the present invention.In this embodiment; Audio/visual head installing type radio communication device 100 can be used as the platform that is used for buying and selling the extra software programs that is associated with second " software personage " 1620b, and said second " software personage " 1620b is used for carrying out user interactions with audio/visual head installing type radio communication device 100.In this embodiment, audio/visual head installing type radio communication device 100 is through being configured to and can in the commercial electronic business transaction, coming with new " software personage " 1620b exchange, replace or augment " software personage " program 1620a with a certain expense.Audio/visual head installing type radio communication device 100 can be preferably along link 1950a and remote computing device (not shown) or Internet traffic so that obtain different or second " software personage " 1620b.The second personage 1620b can be associated with digital document, and said digital document can use radio modem, wired or wireless interface to transmit and receive and maybe can be stored on the recordable media (for example Zip disk maybe can load and unload flash memory).
Wearer can be chosen in audio/visual head installing type radio communication device 100 associated operating system on the icon that moves, or otherwise control signal is provided to wave point 327 to obtain the second software program 1620b.Wearer uses input media 335 also can import the data that are associated with payment information, and said data can be delivered to payment provider 2005 in road 2007 encrypted and along the line.Controller 300 then will be controlled wave point 327 radiofrequency signal 1950a is transmitted into second wave point (not shown) or the Internet second software program 1620b that wanted to obtain to be associated with second " software personage ".Be suitable for creating between audio/visual head installing type radio communication device 100 and another second device (not shown) or lead to the bidirectional communication link of the Internet along the control signal of path 1950a.The data that are associated with payment information can be routed to payment provider 2005 with validation of payment through the Internet.In case 2009 couples of suppliers 2005 in road along the line have verified payment, just along link 1950a software program 1620b is delivered to the storer 310 of audio/visual head installing type radio communication device 100 from software provider 2011 with allowance to software provider 2011 transmission information.Envision this equipment 100 and comprise equity transaction and peer-to-peer communications network, for example
etc.Audio/visual head installing type radio communication device 100 can (for example PAY
remote bank be professional through being configured to use wave point 327 and payment provider or service; Electronic banking account) buys; Sell two-dimentional incarnation or exchange two-dimentional incarnation with another monocular device.
Turn to Figure 21 at present, show another embodiment of the present invention.Here, the wave point of communicator 100 (for example, the interface 327 of Figure 18) is through Bluetooth communication protocol (bluetooth 137 via link 135 of Fig. 1) and the link of for example cellular phone remote communication devices (for example, the device 125 of Fig. 1) such as (not shown).Wearer W can use head installing type audio/visual radio communication device 100 to call out or receive from the calling that is positioned at a distance of the individual 2102 of use smart phone 2105, PDA or the mobile phone of certain segment distance or other calculation element.Preferably, in this embodiment, personage 1815 serves as the assistant and serves as the intermediary between wearer W and the caller.
In addition, incarnation 1815 can be collected data and comprised that one or more have the prerecord greeting about wearer W or caller's particular data.Through using caller's recognition data, incarnation 1815 can be rendered as imitates the understanding caller, and can the name of particular caller and the time that since call caller's last time, has passed be inserted in the pre-recorded message.For instance, incarnation 1815 can be at first as follows in response to the caller: " you are good the Bob, since you made a phone call last time 4 days again 3 week ", and after this can state " I look at whether the take over party is free ".If it is free; Incarnation 1815 will be imitated call, Email or instant message will be switched to wearer W so; And if wearer W is not free, incarnation 1815 can respond in a certain inquiry so, and for example " is this calling urgent? please answer and be or not." perhaps, incarnation 1815 can be implored the input from caller's mobile device keypad.
Turn to Figure 21, incarnation 1815 can be supplied some options 2120 to the caller at present.Option 2120 can comprise: (i) send SMS message to wearer W and have time determining whether; The calling of (ii) sending said caller to wearer W is urgent message; (iii) send the not urgent message of said calling to wearer W; Or some answer communications option (iv) are provided, make wearer W to wire back to the caller.Also envision other option 2120.
For instance, wearer W can be to communicator 100 input informations, wherein permit some call through immediately and disapprove other call through but change message or the video/audio/text message of reception into from incarnation 1815, like hereinafter referring to shown in Figure 22.Incarnation 1815 also can point out caller 2102 during hanging up, on smart phone 2105, to watch video messaging or advertisement/commercial movie for caller 2108 or for the financial gain of wearer.It is urgent and can not be held the input information of hang-up that incarnation 1815 can further receive about contact details (showing referring to Figure 27 like hereinafter) or the said calling that can be where reaches the caller through Email, through phone and telephone number or e-mail address.
In addition, incarnation 1815 can be in response to incoming call, affirmation and caller's agreement, or propose other call time, or whether free inform simply.Shown on the display 2110 of smart phone 2105, incarnation 1815 can receive the input that interrupts wearer W from the caller, and in this non-limiting example, incarnation 1815 can be instructed the caller to dial 1 and interrupted, shown in reference number 2220.Also envision other order.
When incarnation 1815 sets about interrupting take over party W (shown in figure 23), incarnation 1815 can be for caller 2102 on the display 2110 of smart phone 2105 display ads 2322 or short film 2322.This can be interesting advertisement 2322, and it is individualized by wearer W.In addition, wearer W can obtain the payment (by third party promoter or advertiser) show from said third-party this series advertisements 2322.Perhaps, wearer W can download song, film editing or other message of liking.Various media arrangement are possible and belong in the scope of the present invention.
Turn to Figure 24 at present; Because device 100 is multi-functional; So wearer W can use input media (for example keyboard (not shown)) to use word processing program application program 2423 to prepare letter, said application program 2423 goes up operation and demonstration on video display 110 at teleprocessing unit (not shown).As can understand, when wearer W was operating business software application program (for example word processor 2423, electrical form etc.), incarnation 1815 was minimized and is not showed.Perhaps, device 100 can be closed.
Turn to Figure 25, if urgent, incarnation 1815 will be pointed out wearer W, and " this calling is urgent, you want to answer said calling? at present "Can present some options 2525 to confirm wearer W wants how to dispose incoming call to wearer W.These options can comprise that wearer W needs (1) answer that said calling is not answered in said calling, (2), (3) provide pre-recorded message and (4) to ignore the indication of said calling to the caller.
Turn to Figure 26, if wearer W does not want to answer the call, wearer W can import voice commands to incarnation 1815 so, and incarnation 1815 can then " please be quoted your number, because the take over party can not arrive through saying now." the next contact details that obtain the caller with the voice identification.Preferably; Incarnation 1815 also can comprise the voice identification capacity; Wherein audio/visual head installing type radio communication device 1000 can use verbal identification to receive the telephone number information about caller's device, and will offer wearer W about caller's data.
Once more, during the stand-by period, incarnation 1815 can be play the second desirable audio or video file for the caller, and it is interesting or joyful.In an embodiment again, incarnation 1815 can exchange to some caller or to the different phase of hang-up process.Incarnation 1815 also can provide during latent period shown in Figure 23 alternately, data, program, recreation or other similar computer program.
Shown in figure 27, caller 2102 contact details 2730 on video display 110, and wearer W after a while operative installations 100 call out the caller.Various other incarnation 1815 auxiliary configurations are possible and belong in the scope of the present invention, and previous mentioned configuration is used to explain an embodiment.
Although come to show clearly and described the present invention referring to instance embodiment of the present invention; But those skilled in the art will appreciate that, can under the situation that does not break away from the scope of the invention that appended claims contains, make the change on various forms and the details therein.
Claims (33)
1. equipment that is used to show content of multimedia is characterized in that it comprises:
Storer;
The portable minisize display, it is through being configured to show content of multimedia;
Wave point; It is through being configured to set up the wireless connections between said equipment and at least one the main frame calculation element; Said wave point is through being configured to the request that becomes available at the host display interface content of multimedia is transmitted into said at least one main frame calculation element, and in response to said to content of multimedia request and from said at least one main frame calculation element receiving multimedia content;
Loudspeaker;
Microphone, it is through being configured to receive the sound signal that comprises voice;
Converter, it is through being configured to said sound signal is converted into first numeral of said sound signal; And
Controller; It compares the said numeral of said sound signal and the look-up table that is stored in the said storer through being configured to; Convert said first numeral of said sound signal into control output based on said comparison; And the assembly that said control is outputed to said equipment with realize with said equipment, said at least one main frame calculation element and external device (ED) at least one mutual; Wherein said control output is second numeral of said sound signal; It comprises the language translation of voice included in the represented said sound signal of said first numeral to second language; Said controller is further through being configured to convert said second numeral of said sound signal into comprise the voice that are said second language speech audio signal modulation; Wherein said control output is further for making it possible to control at least one the control command in the said assembly of said equipment, said at least one main frame calculation element and the external device (ED); Further to be used for vision and the mutual form of audio frequency mode steering order being provided to said display, said microphone and said loudspeaker, said form is associated with incarnation said controller in response to said input voice command through being configured to;
Wherein said incarnation is through being configured to that simulated human attributes is provided to said equipment, and said simulated human attributes comprises the visual pattern element that is shown on the said display.
2. equipment according to claim 1, the prerecord speech in it is characterized in that wherein said speech audio signal modulation and being stored in said storer is associated.
3. equipment according to claim 2, the said prerecord speech that it is characterized in that wherein being stored in the said storer is associated with famous person's speech.
4. equipment according to claim 1 is characterized in that wherein said controller is further through being configured to after said microphone receives said sound signal, roughly to carry out said translation immediately so that roughly real-time language translation to be provided.
5. equipment according to claim 1; It is characterized in that wherein said controller further through being configured to convert said second numeral of said sound signal into text, and synchronously said text is shown on the said display as content of multimedia with the said speech audio signal modulation that comprises the voice that are said second language.
6. equipment according to claim 1 is characterized in that wherein said incarnation further is included in the audio element of playing on the said loudspeaker.
7. equipment according to claim 6 is characterized in that wherein said audio element comprises the human speech of record.
8. equipment according to claim 7 is characterized in that the speech of wherein said record comprises famous person's speech.
9. equipment according to claim 1 is characterized in that wherein said incarnation comprises content of multimedia.
10. equipment according to claim 1 is characterized in that wherein said incarnation is further through being configured to recognize voice and in response to user speech, in the voice included in the call at least one of importing into of said at least one main frame calculation element or another device.
11. equipment according to claim 1 is characterized in that wherein said incarnation further can select the menu of option through being configured to explicit user.
12. equipment according to claim 1 is characterized in that wherein said wave point further comprises the software application of at least one different incarnation through being configured to communicate by letter with at least one remote-control device with reception.
13. equipment according to claim 12 is characterized in that wherein said at least one different incarnation are in return to receive with a certain expense.
14. equipment according to claim 1 is characterized in that wherein said incarnation comprises the vision that is associated with the regioselective known famous person of identification of wearer and can listen element.
15. equipment according to claim 1 is characterized in that wherein said wave point further is used at least one the mutual programmed instruction with wearer, the remote-control device that is associated with said wearer or the remote-control device that is not associated with said wearer through being configured to remote access.
16. equipment according to claim 15, it is characterized in that wherein said programmed instruction comprise be used for voice command be provided to said wearer or with the instruction of the remote-control device of individual except said wearer or entity associated.
17. one kind be used for letting show content of multimedia equipment can with at least one mutual method of at least one main frame calculation element or external device (ED), it is characterized in that said method comprises:
Set up the wave point at said equipment place and the wireless connections between at least one main frame calculation element;
To be transmitted into said at least one main frame calculation element to the request that becomes available at the host display interface content of multimedia;
In response to said to content of multimedia request and from said at least one main frame calculation element receiving multimedia content;
Reception comprises the sound signal of voice;
Said sound signal is converted into first numeral of said sound signal;
The said numeral of said sound signal is compared with the look-up table that is stored in the storer;
Convert said first numeral of said sound signal into control output based on said comparison; And
The assembly that said control is outputed to said equipment with realize with said equipment, said at least one main frame calculation element and external device (ED) at least one mutual; Wherein said control output is second numeral of said audio frequency, and it comprises the language translation of voice included in the represented said sound signal of said first numeral to second language;
Convert said second numeral of said sound signal into comprise the voice that are said second language speech audio signal modulation; And
Play the said speech audio signal modulation that comprises the voice that are said second language at the loudspeaker place;
Further for making it possible to control at least one the control command in the said assembly of said equipment, said at least one main frame calculation element and the external device (ED), said method further comprises in response to the said voice command that receives mutual with vision and audio frequency mode with the form that is associated with incarnation in wherein said control output;
Wherein further comprise alternately with vision and audio frequency mode with the said form that is associated with said incarnation in response to the said voice command that receives simulated human attributes is provided to said equipment, said simulated human attributes comprises the visual pattern element that is shown on the said display.
18. method according to claim 17, the prerecord speech in it is characterized in that wherein said speech audio signal modulation and being stored in said storer is associated.
19. method according to claim 18, the said prerecord speech that it is characterized in that wherein being stored in the said storer is associated with famous person's speech.
20. method according to claim 17 is characterized in that it further is included in to receive roughly to carry out said translation immediately after the said sound signal, and then roughly real-time language translation is provided.
21. method according to claim 17 is characterized in that it further comprises:
Convert said second numeral of said sound signal into text; And
Synchronously said text is shown in through being configured to as content of multimedia with the said speech audio signal modulation that comprises the voice that are said second language and shows on the portable minisize display of content of multimedia.
22. method according to claim 17 is characterized in that wherein alternately further being included in loudspeaker on audio plays element with the said form that is associated with said incarnation with vision and audio frequency mode in response to the said voice command that receives.
23. method according to claim 22 is characterized in that wherein said audio element comprises the human speech of record.
24. method according to claim 23, the speech that it is characterized in that wherein said record are famous person's speeches.
25. method according to claim 17 is characterized in that wherein said incarnation comprises content of multimedia.
26. method according to claim 17 is characterized in that wherein further comprising the identification voice with the said form that is associated with said incarnation alternately with vision and audio frequency mode and in response to user speech, in the voice included in the call at least one of importing into of said at least one main frame calculation element or another device in response to the said voice command that receives.
27. method according to claim 17 is characterized in that wherein further comprising that with vision and audio frequency mode explicit user can select the menu of option with the said form that is associated with said incarnation alternately in response to the said voice command that receives.
28. method according to claim 17 is characterized in that it further comprises to communicate by letter with at least one remote-control device and comprises the software application of at least one different incarnation with reception.
29. method according to claim 28 is characterized in that it further comprises defrayment to exchange said at least one different incarnation.
30. method according to claim 17 is characterized in that it further comprises the vision that is associated with the known famous person of identification to said incarnation selection and can listen element.
31. method according to claim 17 is characterized in that it further comprises remote access and is used at least one the mutual programmed instruction with wearer, the remote-control device that is associated with said wearer or the remote-control device that is not associated with said wearer.
32. method according to claim 31, it is characterized in that wherein said programmed instruction comprise be used for voice command be provided to said wearer or with the instruction of the remote-control device of individual except said wearer or entity associated.
33. a system that is used for content of multimedia is offered the user is characterized in that said system comprises:
At least one main frame calculation element; It comprises the host display interface and first wave point; Said first wave point is through being configured to set up the wireless connections between said at least one main frame calculation element and the external device (ED); Said at least one main frame calculation element is through being configured to be provided at the content of multimedia that the said host display interface of said at least one main frame calculation element becomes available to said external device (ED), and said first wave point further through be configured to from said external device (ED) receive to the request of content of multimedia and in response to said to content of multimedia request and content of multimedia is transmitted into said external device (ED); And
Equipment, it comprises: the portable minisize display, it is through being configured to show content of multimedia; Second wave point; It is through being configured to set up the wireless connections between said equipment and at least one the main frame calculation element; Said second wave point is further through being configured to that the said request that said host display interface at said at least one main frame calculation element is become available content of multimedia is transmitted into said at least one main frame calculation element, and in response to said to content of multimedia request and from said at least one main frame calculation element receiving multimedia content; Loudspeaker; Microphone, it is through being configured to receive the sound signal that comprises voice; Converter, it is through being configured to said sound signal is converted into first numeral of said sound signal; And controller; It compares said first numeral of said sound signal and the look-up table that is stored in the storer through being configured to; Convert said first numeral of said sound signal into control output based on said comparison; And the assembly that said control is outputed to said equipment with realize with said equipment, said at least one main frame calculation element and external device (ED) at least one mutual; Wherein said control output is second numeral of said sound signal; It comprises the language translation of voice included in the represented said sound signal of said first numeral to second language; Said controller is further through being configured to convert said second numeral of said sound signal into comprise the voice that are said second language speech audio signal modulation; And said control output is further for making it possible to control at least one the control command in the said assembly of said equipment, said at least one main frame calculation element and the external device (ED); Further to be used for vision and the mutual form of audio frequency mode steering order being provided to said display, said microphone and said loudspeaker, said form is associated with incarnation said controller in response to said input voice command through being configured to;
Wherein said incarnation is through being configured to that simulated human attributes is provided to said equipment, and said simulated human attributes comprises the visual pattern element that is shown on the said display.
Applications Claiming Priority (9)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US96268607P | 2007-07-31 | 2007-07-31 | |
| US60/962,686 | 2007-07-31 | ||
| US96670407P | 2007-08-29 | 2007-08-29 | |
| US60/966,704 | 2007-08-29 | ||
| US99498907P | 2007-09-24 | 2007-09-24 | |
| US60/994,989 | 2007-09-24 | ||
| US12/152,462 | 2008-05-14 | ||
| US12/152,462 US9116340B2 (en) | 2007-05-14 | 2008-05-14 | Mobile wireless display for accessing data from a host and method for controlling |
| PCT/US2008/009267 WO2009017797A2 (en) | 2007-07-31 | 2008-07-30 | Mobile wireless display providing speech to speech translation and avatar simulating human attributes |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101809651A CN101809651A (en) | 2010-08-18 |
| CN101809651B true CN101809651B (en) | 2012-11-07 |
Family
ID=42610048
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008801083447A Active CN101809651B (en) | 2007-07-31 | 2008-07-30 | Mobile wireless display providing speech to speech translation and avatar simulating human attributes |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101809651B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102016975A (en) | 2008-03-28 | 2011-04-13 | 寇平公司 | Handheld wireless display device having high-resolution display suitable for use as a mobile internet device |
| EP2712432A4 (en) | 2011-05-10 | 2014-10-29 | Kopin Corp | Headset computer that uses motion and voice commands to control information display and remote devices |
| US8929954B2 (en) * | 2012-04-25 | 2015-01-06 | Kopin Corporation | Headset computer (HSC) as auxiliary display with ASR and HT input |
| CN104303177B (en) * | 2012-04-25 | 2018-08-17 | 寇平公司 | Execute the method and earphone computing device of real-time phonetic translation |
| US9966075B2 (en) | 2012-09-18 | 2018-05-08 | Qualcomm Incorporated | Leveraging head mounted displays to enable person-to-person interactions |
| CN105190606A (en) * | 2013-03-13 | 2015-12-23 | 日本电气株式会社 | Terminal device, translation system, communication control method, and program |
| TWI500023B (en) | 2013-04-11 | 2015-09-11 | Univ Nat Central | Hearing assisting device through vision |
| CN104706422A (en) * | 2013-12-13 | 2015-06-17 | Ge医疗系统环球技术有限公司 | Head-worn type medical device, medical system and operation method of medical system |
| JP6114249B2 (en) * | 2014-11-20 | 2017-04-12 | ヤマハ株式会社 | Information transmitting apparatus and information transmitting method |
| US20170060850A1 (en) * | 2015-08-24 | 2017-03-02 | Microsoft Technology Licensing, Llc | Personal translator |
| CN111787986A (en) * | 2018-02-28 | 2020-10-16 | 苹果公司 | Voice effects based on facial expressions |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5815126A (en) * | 1993-10-22 | 1998-09-29 | Kopin Corporation | Monocular portable communication and display system |
| CN1762145A (en) * | 2002-12-12 | 2006-04-19 | 皇家飞利浦电子股份有限公司 | Avatar database for mobile video communications |
| CN1991982A (en) * | 2005-12-29 | 2007-07-04 | 摩托罗拉公司 | Method of activating image by using voice data |
-
2008
- 2008-07-30 CN CN2008801083447A patent/CN101809651B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5815126A (en) * | 1993-10-22 | 1998-09-29 | Kopin Corporation | Monocular portable communication and display system |
| CN1762145A (en) * | 2002-12-12 | 2006-04-19 | 皇家飞利浦电子股份有限公司 | Avatar database for mobile video communications |
| CN1991982A (en) * | 2005-12-29 | 2007-07-04 | 摩托罗拉公司 | Method of activating image by using voice data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101809651A (en) | 2010-08-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101809651B (en) | Mobile wireless display providing speech to speech translation and avatar simulating human attributes | |
| US8825468B2 (en) | Mobile wireless display providing speech to speech translation and avatar simulating human attributes | |
| EP2207164B1 (en) | Apparatus for providing language translation and avatar simulating human attributes, and method thereof | |
| US11158102B2 (en) | Method and apparatus for processing information | |
| JP6419262B2 (en) | Headset computer (HSC) as an auxiliary display with ASR and HT inputs | |
| CN104303177B (en) | Execute the method and earphone computing device of real-time phonetic translation | |
| CN110400251A (en) | Method for processing video frequency, device, terminal device and storage medium | |
| CN101755299A (en) | Mobile wireless display for accessing data from a host and method for controlling | |
| US11032532B2 (en) | Electronic device and method for providing virtual device via at least portion of content | |
| CN102664009B (en) | System and method for implementing voice control over video playing device through mobile communication terminal | |
| CN107422862A (en) | A kind of method that virtual image interacts in virtual reality scenario | |
| CN105025349B (en) | The throwing screen of encryption | |
| US20210304020A1 (en) | Universal client api for ai services | |
| JP2018032440A (en) | Controllable headset computer displays | |
| CN105721904B (en) | The method of the content output of display device and control display device | |
| KR20200144702A (en) | System and method for adaptive streaming of augmented reality media content | |
| ES2382747B1 (en) | MULTIMODAL INTERACTION ON DIGITAL TELEVISION APPLICATIONS | |
| JP6980150B1 (en) | 3D virtual real space providing server, 3D virtual real space providing method, 3D virtual real space providing program, 3D virtual real space display control device, 3D virtual real space display control method, 3D virtual real space display control program And 3D virtual reality space provision system | |
| CN113157241A (en) | Interaction equipment, interaction device and interaction system | |
| WO2021202605A1 (en) | A universal client api for ai services | |
| CN115066908A (en) | User terminal and control method thereof | |
| KR20200122726A (en) | VR Device representing real time Public Transportation Information | |
| CN117198293B (en) | Digital human voice interaction method, device, computer equipment and storage medium | |
| KR20180122802A (en) | System for proxy experience through agent and the method using the same | |
| JP2022129633A (en) | Information processing device, information processing system, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |