WO2001005155A1 - Internet shopping system utilizing set top box and voice recognition - Google Patents

Internet shopping system utilizing set top box and voice recognition Download PDF

Info

Publication number
WO2001005155A1
WO2001005155A1 PCT/US2000/018031 US0018031W WO0105155A1 WO 2001005155 A1 WO2001005155 A1 WO 2001005155A1 US 0018031 W US0018031 W US 0018031W WO 0105155 A1 WO0105155 A1 WO 0105155A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
remote control
control unit
top box
input
Prior art date
Application number
PCT/US2000/018031
Other languages
French (fr)
Inventor
Nobuo Ogasawara
Original Assignee
Fujitsu Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujitsu Limited filed Critical Fujitsu Limited
Priority to JP2001510242A priority Critical patent/JP2003529959A/en
Priority to GB0200160A priority patent/GB2368996B/en
Publication of WO2001005155A1 publication Critical patent/WO2001005155A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2542—Management at additional data server, e.g. shopping server, rights management server for selling goods, e.g. TV shopping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/47815—Electronic shopping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4782—Web browsing, e.g. WebTV
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309—Transmission or handling of upstream communications
    • H04N7/17318—Direct or substantially direct transmission and handling of requests

Definitions

  • the present invention relates generally to electronic shopping systems, and more particularly, to an Internet shopping system hosted on a television-set-top-box combination including a remote controller with voice recognition capabilities.
  • PCs personal computers
  • Internet shopping The expansion of personal computers (PCs) into homes of average consumers has also expanded the usage of the Internet by such consumers, and with it, has opened a new avenue of shopping, specifically, Internet shopping.
  • computers are the main source of Internet access.
  • U.S. Pat.No. 5,512,935 to Majeti etal. also discloses a set-top box connected to a home controller and personal computer combination.
  • the home based equipment in Majeti is able to communicate with an Internet service provider through a variety of cable distribution means including a public switched telephone network via a modem.
  • the television-set-top-box combination may be easier to operate than a PC, it 4 - may nonetheless require a substantive amount of time and effort to learn the operations of the set- top box, especially the operation of the remote controller working the set-top box.
  • the learning of all the functions in the remote controller keypad might be a laborious task for the user. Even if the user has learned the functions of all the keys, the maneuvering between various keys on the remote controller during Internet shopping is inefficient and cumbersome.
  • an optional wireless keyboard and/or a virtual keyboard is often used when alphabetical data or complicated input is required.
  • a virtual keyboard is a full keyboard display on a CRT screen which is operated by the remote control unit by designating key positions with o r arrow and enter keys.
  • the use of such wireless keyboards or virtual keyboards makes data input more laborious for the user.
  • the use and learning of remote control functions become even more cumbersome when the user must learn to use other keypads, buttons, switches, and/or dials to work other household devices such as the VCR, interphone, video camera, printer, fax, and so on.
  • a remote controller which is able to communicate with a set-top box by means other than the keypad. Because voice input is easier and more efficient than keypad input, such remote controller should have voice recognition capabilities to allow users to provide oral commands during Internet shopping.
  • the user should also have access to other household devices directly through the set-top
  • an TM electronic shopping system hosted on a television-set-top-box combination controlled by a remote control unit which provides additional functionalities to the system.
  • the electronic shopping system includes a remote control unit with at least a keypad and a microphone for providing keypad data and voice data to the set-top box (STB).
  • the STB comprises means for connecting to an Internet ⁇ service provider and a Web browser configured to receive input data from the remote control unit.
  • the Web browser generates an audio-visual display on a display unit in response to the input data, allowing the user to effectuate the electronic shopping.
  • the remote control unit comprises a digital visual image recording means for providing videographic data to the STB. This allows bar code TM images to be transmitted to the STB for identifying an item to be purchased.
  • a voice generator coupled to the Web browser converts character data to output voice data.
  • the output voice data is transmitted to a speaker in the remote control unit for providing audio output to the user.
  • the speaker also allows the remote control unit to function as a wireless phone or as a handset for an interphone or or videophone.
  • the STB comprises an external interface with a household peripheral device such as an intercom, interphone, videophone, VCR, video camera, printer, fax, and the like.
  • a household peripheral device such as an intercom, interphone, videophone, VCR, video camera, printer, fax, and the like.
  • FIG. 1 is an exemplary, simplified, semi-schematic block diagram of an electronic shopping system including a television set, a set-top box, and a remote control unit in accordance with the present invention; , r .
  • FIG. 2 is a simplified, semi-schematic illustration of an exemplary implementation of the remote control unit of FIG. 1;
  • FIG. 3 is an exemplary, semi-schematic functional block diagram of the remote control unit of FIGS. 1 and 2;
  • FIG. 4 is an exemplary, semi-schematic block diagram of the set top box of FIG. 1; and , r FIGS. 5 A and 5B are exemplary flow diagrams of an Internet shopping transaction using the set-top box and the remote control unit in accordance with the present invention.
  • the present invention is directed to an Internet-based electronic shopping jr , system hosted on a television-set-top-box combination controlled by a remote control unit which provides additional functionality to the system.
  • the set-top box includes a tuner and audio visual output functions for television reception capability.
  • the tuner is configured to communicate with an Internet service provider over either satellite or through a cable medium and the STB also includes a modem capability for Internet service provider communication over
  • the STB includes an external interface such as an IEEE1394 interface, USB, RS232C, SCSI, and the like, for connection to a multiplicity of external peripheral devices, such as an interphone. VCR, video camera, printer, and the like.
  • the STB is configured to provide a user with Internet access in a manner such as currently , provided by Web TV and further includes purpose-type application software such as voice recognition software and bar code recognition software to support an electronic shopping system.
  • Application programs are either hosted on and loaded from a mass storage media such as a hard disk drive or are downloaded from an external server via a telephone modem connection, a cable or satellite connection and/or wireless broadcast means.
  • the remote control unit is configured to include a conventional keypad and further includes a microphone, an optional speaker, an optional digital camera, and a provision for wireless transmission capability in order to send data to the STB.
  • an Internet shopping Web program or HTML text may be accessed through the STB's Web browser and data input may be made by either voice, the remote control unit's keypad, a virtual keyboard displayed on the CRT, or by an optional wireless keyboard. Voice input is recognized by the voice recognition software and recognized data is transferred to the Internet shopping Web program.
  • bar code information may be scanned by the remote and bar code video data may be transmitted to the STB and recognized as bar code data by bar code recognition software.
  • Merchandise information ⁇ ⁇ is transmitted to a store's web server via any one of the Internet links described above.
  • the remote control unit When the remote control unit is configured with microphone, speaker and digital camera, it is also able to be used as a cordless telephone or video phone and might also function as a handset for an interphone when the appropriate communication links are connected to the set top box through its external interface.
  • videographic ⁇ ⁇ - images of a party on the other end of the line may be displayed on the TV screen via a pop-up window.
  • FIG. 1 depicts a simplified, semi-schematic block diagram of an exemplary electronic shopping system including a STB 10, television 12, and remote control unit 14.
  • STB television
  • remote control unit 14 The
  • TM STB 10 receives television signals from satellite 16, over-the-air broadcast 18 (also referred as aerial broadcast), or via cable through a cable provider 20, for performing conventional television reception functions.
  • the STB also communicates with an Internet Service Provider (ISP) 22 over the satellite 16 medium or via cable through the cable provider 20.
  • ISP Internet Service Provider
  • the STB 10 allows for ISP 22 communication over a telephone subscriber line 24 interface.
  • peripheral devices 26 are also controlled through the STB 10. Such devices might include an interphone, VCR, video phone, printer, fax, and the like. The centralized control of such devices 26 through the STB 10 helps facilitate their access and management.
  • the television 12 set is coupled to the STB 10 and permits audio and display functions to the system.
  • the display function is provided by the television screen and may include display
  • the audio function is provided by one or more speakers 28 either resident within the television 12 set, or externally coupled to the television set.
  • the television 12 unit may be an analog TV, a digital TV, or the like.
  • the remote control unit 14 is also in communication with the STB 10 and provides o ⁇ - additional functionalities to the system.
  • FIG. 2 is an exemplary illustration of the remote control unit 14 and FIG. 3 is its functional block diagram in an exemplary, semi-schematic form.
  • the remote control unit 14 illustrated in FIG. 2 includes a 1 keypad 30 for allowing input of keypad data to the STB 10.
  • the keypad 30 in the described embodiment comprises a power key, various numeric or alpha character keys, function keys
  • buttons key, clear key, enter key, etc. A user depresses the keys on the keypad 30 to specify a particular operation the user wants to perform. For instance, up and down arrow keys along with the enter key might be used to select data displayed on the television screen.
  • the remote control unit 14 also includes a microphone 32 for capturing voice data upon an utterance by the user.
  • a user may provide oral commands to the system during Internet shopping instead of keypad commands, making it easier and more pleasant for an average user ⁇ ⁇ to use the system.
  • voice recognition unlike other situations, should be more efficient and more accurate for Internet shopping because it entails simple selection operations which require the utterance of only short phrases for recognition purposes.
  • the remote control unit 14 also includes a speaker 34 for output of voice messages to the user upon receipt of voice data from the STB 10.
  • voice ⁇ _- messages may include operation guidance, error messages, and the like.
  • the speaker 34 can be operational either alone or in conjunction with the television speakers 28. Alternatively, the speaker 34 in the remote control unit 14 can be disabled and the television speakers 28 used in its place. The inclusion of the speaker 34 along with the microphone 32 also allows the remote control unit 14 to operate as a handset for cordless phone, interphone, and/or video phone functions that might be available through the STB 10.
  • a digital visual image recording means such as a digital video camera 36 is also incorporated into the remote control unit 14 for providing additional functionalities to the system to promote easier Internet shopping.
  • the camera 36 might comprise either gray scale or color video data.
  • the video image data will be in color to adequately represent the user's yr personal appearance, i.e., hair color, clothing color, and the like, when the camera 36 is used for video phone or interphone purposes.
  • the camera is described as a digital video camera 36, it should be understood by those having skill in the art that an apparatus for capturing still images rather than a full-motion video image can be used to implement the system according to the invention.
  • the camera 36 might comprise a digital still camera, a video camera
  • the camera 36 is preferably mounted on a hinge on one end of the remote control unit 14 for allowing the camera 36 to be rotated at a 90 or 180 degree angle.
  • the rotation of the camera not only facilitates video capture for video phone or interphone functions, but also eases the capture of barcode images when ordering groceries or other barcoded items via the
  • user input from the keypad 30, microphone 32, or digital camera 36 is processed by the remote control unit 14 before transmission to the STB 10.
  • Input from the keypad 30 is sent to a keypad data encoder 40 for translation of the keypad data into a keypad code.
  • the keypad data encoder 40 encodes the depressed keypad position information to a binary keypad code, such as an ASCII character data or a hexadecimal code for transmission to the STB 10.
  • Input from the microphone 32 is sent to an analog to digital converter 42 for converting voice data from analog data to digital data according to well known principles.
  • Video images captured by the digital camera 36 are sent to a video signal processor 44 for generating videographic data also according to well known principles.
  • the input data from the three input media i.e. the keypad code from the keypad data encoder 40, voice data from the analog to digital converter 42, and videographic data from the video signal processor 44, are then sent to a channel coder 46 in the remote control unit 14.
  • the channel coder 46 combines the input data from the three input media by a predetermined coding method and transmits the coded data to the STB 10 through a transmitter 48.
  • r coding method allows the STB 10 to recognize and decode the data received from the different input media of the remote control unit 14.
  • the coding method entails placing a header and a delimeter for demarcating the beginning and end of particular types of input data.
  • the channel coder 46 transmits the input data along with the corresponding header and delimeter, for decoding by the STB 10. .r>
  • the transmitter 48 in the remote control unit 14 allows for wireless transmission of the coded data to the STB 10. Infra Red (IR), radio frequency (RF), Ultra High Frequency (UHF), or any other wireless technology may be used for the wireless transmission. If IR technology is used, the transmitter 48 may generally be equipped with an LED.
  • the transmitter 48 may generally be equipped with an antenna or the like.
  • the remote control unit 14 also includes a receiver 50 for wireless receipt of data from the STB 10. The data is then sent to a channel decoder 52 for decoding and extracting the data received for a particular medium.
  • the remote control unit 14 is equipped to receive voice data from the STB 10. The voice data, once extracted by the channel decoder 52, is transmitted to a digital to analog
  • the STB 10 might send video images to the receiver 50 and the receiver
  • the channel decoder 52 might submit them to the channel decoder 52 for extracting the video images. From there. 1 the video images might be submitted to a video signal processor (not shown) for converting the extracted video images to videographic data to be displayed on the display unit.
  • the remote control unit 14 receives only one type of data from the STB 10 (e.g. voice
  • the channel decoder 52 is no longer necessary for deciphering the type of data received given that the inputted data will always be of the same type. In such instance, the channel decoder 52 may be eliminated from the remote control unit 14.
  • FIG. 4 is an exemplary, semi-schematic block diagram of the STB 10 of FIG. 1.
  • the tuner 82 comprises a tuner 82 and an audio visual output unit 84 for conventional television reception capabilities.
  • the tuner 82 is further configured to provide Internet connection with a Web server 72 via the ISP 42, through the satellite 16 medium or via cable through the cable provider 20.
  • the STB 10 is also equipped with a modem (not shown) for communicating with the Web server 72 via the ISP 22, through telephone subscriber lines 24.
  • the Web server 72 provides various software programs 76, such as HTML pages. Internet shopping Web programs, and other application software programs to a Web browser 70 through the Internet connection.
  • the software programs 76 may be downloaded and stored in a local storage 74 unit.
  • the local storage 74 may suitably comprise a hard disk drive or drive array, a PCMCIA programmable memory card, a high-capacity flexible media cartridge and floppy drive
  • the local storage 74 may also store electronic program guide data including scheduling information of television programs, as well as miscellaneous user-specific information, such as the user's e-mail address, shopping list information, personal notes, etc.
  • the local storage 74 may further store software and data for a voice recognizer, video data recognizer, voice generator, remote control unit driver, Web Browser, and any other type of application. These types of software and data can be pre-loaded, downloaded, and/or modified. Modification can be made by downloading or loading the software and/or data from a local medium such as an IC card, a floppy disk, or the like.
  • the STB 10 also includes a remote control unit driver 58 having an STB receiver 60, STB channel decoder 62, STB transmitter 64, and STB channel coder 66.
  • the STB receiver 60 receives input data from the remote control unit 14 via wireless means.
  • the STB receiver 60 also receives keyboard data from a wireless keyboard 68.
  • the wireless keyboard 68 is operational through IR, RF, UHF, or any other wireless technology o applicable to the remote control unit 14.
  • the STB receiver 60 submits the received input data to the STB channel decoder 62 for decoding the multiple medium data to a keypad code, voice data, and/or videographic data.
  • the STB channel decoder 62 examines the header preceding the input data for identifying the input medium of the data. The channel decoder then extracts the data between the header and the delimiter and transmits the extracted data for further processing,
  • the keypad code is extracted by the STB channel decoder 62 and submitted to the downloaded software program 76 through the Web browser 70.
  • the extracted voice is the microphone 32 or digital camera 36.
  • Voice data is submitted to a voice recognizer 78 configured with voice recognition software for converting the voice data to character data according to a number of conventional voice recognition algorithms.
  • voice recognizer is included in the remote control unit.
  • the remote control unit converts the voice data to character data and transfers the ⁇ r character data to the set top box.
  • Videographic data is submitted to a video data recognizer 80 which, in the described embodiment, is configured with barcode recognition software.
  • the barcode recognition software further includes pattern recognition and barcode decode capabilities for deciphering barcode images inputted to the system via the digital camera 36 (FIG. 3).
  • UPC Universal Product Code
  • the barcode might include an item's Stock Keeping Unit (SKU) code as well as other additional information pertaining to a specific item of merchandise.
  • SKU Stock Keeping Unit
  • the barcode data is converted to a UPC or SKU code by the barcode recognition software and transmitted to a downloaded purchase transaction program through the Web browser 70.
  • a user can transmit an order for an item via the Internet by simply transmitting the barcode image of the item.
  • the barcode image should be available to the user if the user has the packaging of the item on hand.
  • Barcode data may also be available in catalogues or in old receipts from retailers offering the desired merchandise.
  • the video data recognizer is included in the remote control
  • the remote control unit recognizes captured bar code image data and converts it to a bar code, such as UPC, SKU or the like, and transfers the bar code data to the set-top box.
  • a bar code such as UPC, SKU or the like
  • the visual data recognizer 80 is configured with other types of image recognition software, such as an optical character recognition (OCR) program. If the 1 visual data recognizer 80 is configured with an OCR program, handwritten notes (e.g. a handwritten shopping list) can be converted into text character codes for either input to the downloaded software program 76 through the Web browser 70, or for storage in the local storage s - 74 unit for later use.
  • OCR optical character recognition
  • a downloaded software program 76 can therefore receive input from the remote control unit 14 and/or the wireless keyboard 62.
  • the downloaded program 76 has access to the local storage unit 74, an IC card interface 88 unit, and an external interface 90, if needed. Details of the IC card interface 88 unit and the external interface 90 are provided below.
  • the downloaded software program 76 in response to input data, outputs graphic and character display data through the Web browser 70 for conveyance to an audio visual output unit 84.
  • the audio visual output unit 84 transfers the graphic and character display data to the television 12 for display thereon.
  • the audio data from the downloaded software program is transferred to a voice generator
  • ⁇ - 86 configured with a voice generating program that converts the audio data to digital voice data.
  • the digital voice data is transferred to the STB channel coder 66 which, as the channel coder 46 (FIG. 3) in the remote control unit, combines all the output data by a predetermined coding method and transmits the coded data to the speaker 34 in the remote control unit 14 through the STB transmitter 64.
  • the STB 10 of FIG. 4 only illustrates voice data as being output
  • the channel coder 68 like the channel decoder 52 (FIG. 3) in the remote control unit, becomes unnecessary and may be eliminated if desired.
  • the voice data created by the voice generator 86 may optionally be transferred to the television speakers 28 through the audio visual output unit 84.
  • the television speakers 28 may be made operational alone or in conjunction with the remote control speakers 34.
  • the STB 10 includes an IC card interface 88 configured to read information from and write information to an IC, or smart card.
  • the IC card and IC card are configured to read information from and write information to an IC, or smart card.
  • the IC card can also provide secured payment methods (credit card, prepaid electronic cash, etc.), storage of personal information, personal identification, and the like. While referred to as an IC card, the card is a personal memory card or data card which looks and feels much like an ordinary credit card.
  • the IC card may be either
  • a contact or contactless IC card may comprise a microprocessor, an electrically erasable field-programmable read-only 1 memory (EEPROM), a Flash ROM (FROM) and, optionally, circuitry for inductively receiving an RF power signal.
  • EEPROM electrically erasable field-programmable read-only 1 memory
  • FROM Flash ROM
  • the IC card is capable of capacitively transferring data signals between the card and the IC card interface 88 and may be interrogated
  • An additional I/O device is provided in the STB 10 in the form of an external interface 90 for centralized access of various peripheral devices 26 (FIG. 1).
  • the external interface 90 allows communication between the peripheral devices 26 and the STB 10. As a result, a two-way exchange of information is made possible between the peripheral devices 26 and the STB 10. ⁇ Q
  • This information can include video signals, data signals, voice signals, audio signals, image signals, and control signals.
  • the external interface 90 might comprise an IEEE 1394 interface, USB, RS232C, SCSI (small computer system interface), LAN, IrDA, and the like.
  • the peripheral devices 26 might comprise an intercom, interphone, VCR, video camera, video phone, printer, fax machine, and the like.
  • an interphone outside the user's front gate should include video-camera capabilities.
  • the interphone is connected to the STB 10 through the external interface 90. Control of the interphone is made by an interphone application software in the STB 10.
  • the application software might be loaded from the local storage 74 unit, downloaded from the Web server 72 through the Web browser 76, j . or preloaded into the STB 10.
  • the videographic picture captured by the interphone outside the user's door is displayed on the television 12 via a pop-up window.
  • Voice capabilities are provided by the microphone 32 in the remote control unit 14. Audio capabilities are provided by the remote control speaker 34, television speakers 28, or both.
  • access to the interphone through the STB 10 facilitates such access by allowing j - the user to receive an interphone call from a visitor outside the home without having to move away from a television program that he or she might be watching.
  • the user is spared from having a separate interphone receiving unit since the television-STB combination, along with the remote control unit 14, acts as the receiving unit.
  • An Internet shopping transaction starts by selecting a
  • Web browser function 100 from a menu of functions available through the STB 10.
  • the menu is displayed on the television screen and selection is made via the keypad 30 on the remote control unit 14. Alternatively, selection may be made through the microphone 32 by orally voicing the selection. Selection of the Web browser function causes display of the Web browser
  • the user selects a Web site from the browser 102 by directly keying-in a web site address or selecting a site from a menu of available Internet shopping sites.
  • the menu may be customized by the user based on his or her favorite Internet shopping sites, or may reflect a list of the Internet sites most recently accessed by the user.
  • the Web server downloads the t- corresponding client purchase transaction program and/or HTML text 104 to the STB through the Web browser.
  • needed programs such as a voice recognition program, video data recognition program, voice generating program, and IC card interface program, if not already preloaded in the STB, are loaded from the local storage unit 74 or downloaded from the Web server 72.
  • the downloaded client purchase transaction program displays an initial display on the television screen along with introductory visual and/or audio guidance, and requests for user selection of a purchase item 106.
  • the audio guidance is effectuated through the remote control speaker 34, television speakers 28, or both.
  • Detection of a camera input 1 18 causes, in the illustrated embodiment, the running of the barcode recognition program 120. In alternative embodiments, other video r, data recognition programs such as an OCR program may be run if applicable. Barcode recognition causes the corresponding UPC or SKU numeric data to be transferred to the transaction program as an input 122. If no input is received, or an erroneous input is received, an error message or operation guidance is provided 124 to the user via the television screen and speakers 28, and/or via the remote control speaker 34. r The data input process continues until all necessary selections have been made by the user to complete an item selection 126.
  • the client purchase transaction program in the STB 10 is in communication with the server purchase transaction program on the Web server 72.
  • the server program retrieves information corresponding to the selected item from a Price Lookup
  • the PLU Table is, in turn, stored and maintained in the Web server 72 database.
  • the PLU Table suitably comprises a merchandise specific information set.
  • the merchandise specific information set may be arranged in a variety of ways, but is most advantageously configured as sequential entries, with each entry specific to a particular piece of merchandise.
  • a merchandise entry might include the store's SKU number which is identified to a particular product's UPC by a suitable conversion routine.
  • a merchandise entry might further include a text string giving the brand or trade name of the product and including a generic description of the product.
  • each item entry also might include a price field.
  • the user Upon review of the selected merchandise information, and after a decision to purchase the merchandise, the user proceeds to payment processing 127.
  • the user has the option of using the IC card for making payment for the item 128. If the IC card is to be used, the card is processed 130 by the IC card interface 88.
  • the processing might include extracting a customer ID number stored in the card and transmitting the ID to the Web server 72 for determining whether the user is a preferred customer participating in a preferred customer plan which might allow him or her
  • the purchase amount might then be charged to the user's account for being billed at a later time.
  • the purchase order information can be printed 132 on a printer coupled to the STB 10 through the external interface 10 for record-keeping purposes, if a printer is connected to the set top box 10.

Abstract

An Internet-based electronic shopping system hosted on a television set-top-box (10) combination controlled by a remote control unit (14). The set-top box (STB) includes a tuner (82) an internal or external modem and/or cable modem, configured to communicate with an Internet service provider (24, 42) over the appropriate transmission media. The STB also includes purpose type application software such as voice recognition software (78) and bar code recognition software (80) to support an electronic shopping system. The remote control (14) includes a keypad (30), microphone (32), speaker (34) and an optional camera (36). Data input to an Internet shopping Web program accessed through the STB, Web browser (70) may thus be made through the microphone, keypad, and the camera. If the remote control unit includes the camera, bar code information may be scanned by the remote control unit and transmitted to the STB for identifying an item to be purchased.

Description

INTERNET SHOPPING SYSTEM UTILIZING SET TOP BOX AND VOICE RECOGNITION
FIELD OF THE INVENTION
The present invention relates generally to electronic shopping systems, and more particularly, to an Internet shopping system hosted on a television-set-top-box combination including a remote controller with voice recognition capabilities.
10 BACKGROUND OF THE INVENTION
The expansion of personal computers (PCs) into homes of average consumers has also expanded the usage of the Internet by such consumers, and with it, has opened a new avenue of shopping, specifically, Internet shopping. Currently, computers are the main source of Internet access. However, there are still many families who do not own a PC or find PC operation to be
, difficult. For those people, alternate means must be made available to allow them to reap the benefits of the Internet without having to interact with a computer.
To solve the above problem, efforts have been made in the prior art to provide Internet access through common household electronics equipment such as a television and set-top box combination. For instance, Philips-Magnavox and Sony market a set-top box with Internet
™ capabilities under the trademark WebTV®. U.S. Pat.No. 5,512,935 to Majeti etal., also discloses a set-top box connected to a home controller and personal computer combination. The home based equipment in Majeti is able to communicate with an Internet service provider through a variety of cable distribution means including a public switched telephone network via a modem.
Although the television-set-top-box combination may be easier to operate than a PC, it 4- may nonetheless require a substantive amount of time and effort to learn the operations of the set- top box, especially the operation of the remote controller working the set-top box. The more the functions provided by the set-top box, the more keys there will be on the remote controller for the user to learn. The learning of all the functions in the remote controller keypad might be a laborious task for the user. Even if the user has learned the functions of all the keys, the maneuvering between various keys on the remote controller during Internet shopping is inefficient and cumbersome.
In addition, an optional wireless keyboard and/or a virtual keyboard is often used when alphabetical data or complicated input is required. A virtual keyboard is a full keyboard display on a CRT screen which is operated by the remote control unit by designating key positions with o r arrow and enter keys. The use of such wireless keyboards or virtual keyboards makes data input more laborious for the user. The use and learning of remote control functions become even more cumbersome when the user must learn to use other keypads, buttons, switches, and/or dials to work other household devices such as the VCR, interphone, video camera, printer, fax, and so on.
Accordingly, there is a need for a remote controller which is able to communicate with a set-top box by means other than the keypad. Because voice input is easier and more efficient than keypad input, such remote controller should have voice recognition capabilities to allow users to provide oral commands during Internet shopping.
The user should also have access to other household devices directly through the set-top
10 box and remote controller so as to provide a central means for accessing those devices. In this way, the user does not have to learn other mechanisms for controlling the devices. Although efforts have been made in the prior art to provide a universal multimedia access device adapted for communicating multimedia information between the device and various application specific modules as disclosed in U.S. Pat. No. 5,636,211 to Newlin et al., the prior art does not disclose ι or suggest operating a set-top box with interface means to other household devices via voice commands.
SUMMARY OF THE INVENTION
These and other objects are accomplished in accordance with the present invention by an ™ electronic shopping system hosted on a television-set-top-box combination controlled by a remote control unit which provides additional functionalities to the system.
In accordance with one aspect of the invention, the electronic shopping system includes a remote control unit with at least a keypad and a microphone for providing keypad data and voice data to the set-top box (STB). The STB comprises means for connecting to an Internet ^ service provider and a Web browser configured to receive input data from the remote control unit. The Web browser generates an audio-visual display on a display unit in response to the input data, allowing the user to effectuate the electronic shopping.
In a second aspect of the present invention, the remote control unit comprises a digital visual image recording means for providing videographic data to the STB. This allows bar code ™ images to be transmitted to the STB for identifying an item to be purchased.
In a third aspect of the present invention, a voice generator coupled to the Web browser converts character data to output voice data. The output voice data is transmitted to a speaker in the remote control unit for providing audio output to the user. The speaker also allows the remote control unit to function as a wireless phone or as a handset for an interphone or or videophone. 1
In a fourth aspect of the present invention, the STB comprises an external interface with a household peripheral device such as an intercom, interphone, videophone, VCR, video camera, printer, fax, and the like.
5
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is an exemplary, simplified, semi-schematic block diagram of an electronic shopping system including a television set, a set-top box, and a remote control unit in accordance with the present invention; , r. FIG. 2 is a simplified, semi-schematic illustration of an exemplary implementation of the remote control unit of FIG. 1;
FIG. 3 is an exemplary, semi-schematic functional block diagram of the remote control unit of FIGS. 1 and 2;
FIG. 4 is an exemplary, semi-schematic block diagram of the set top box of FIG. 1; and , r FIGS. 5 A and 5B are exemplary flow diagrams of an Internet shopping transaction using the set-top box and the remote control unit in accordance with the present invention.
DETAILED DESCRIPTION OF THE INVENTION
In general terms, the present invention is directed to an Internet-based electronic shopping jr, system hosted on a television-set-top-box combination controlled by a remote control unit which provides additional functionality to the system. The set-top box (STB) includes a tuner and audio visual output functions for television reception capability. The tuner is configured to communicate with an Internet service provider over either satellite or through a cable medium and the STB also includes a modem capability for Internet service provider communication over
JΓ a telephone subscriber line interface. In addition to its conventional functions, the STB includes an external interface such as an IEEE1394 interface, USB, RS232C, SCSI, and the like, for connection to a multiplicity of external peripheral devices, such as an interphone. VCR, video camera, printer, and the like.
The STB is configured to provide a user with Internet access in a manner such as currently , provided by Web TV and further includes purpose-type application software such as voice recognition software and bar code recognition software to support an electronic shopping system. Application programs are either hosted on and loaded from a mass storage media such as a hard disk drive or are downloaded from an external server via a telephone modem connection, a cable or satellite connection and/or wireless broadcast means. r The remote control unit is configured to include a conventional keypad and further includes a microphone, an optional speaker, an optional digital camera, and a provision for wireless transmission capability in order to send data to the STB. When the STB is configured
- 1 with voice recognition software, an Internet shopping Web program or HTML text may be accessed through the STB's Web browser and data input may be made by either voice, the remote control unit's keypad, a virtual keyboard displayed on the CRT, or by an optional wireless keyboard. Voice input is recognized by the voice recognition software and recognized data is transferred to the Internet shopping Web program.
When the remote control unit is configured to include a digital camera, bar code information may be scanned by the remote and bar code video data may be transmitted to the STB and recognized as bar code data by bar code recognition software. Merchandise information ι ^ is transmitted to a store's web server via any one of the Internet links described above.
When the remote control unit is configured with microphone, speaker and digital camera, it is also able to be used as a cordless telephone or video phone and might also function as a handset for an interphone when the appropriate communication links are connected to the set top box through its external interface. When the system is used as a videophone, videographic ι <- images of a party on the other end of the line may be displayed on the TV screen via a pop-up window.
Considering the foregoing summary of the features of the system and method of the present invention, FIG. 1 depicts a simplified, semi-schematic block diagram of an exemplary electronic shopping system including a STB 10, television 12, and remote control unit 14. The
™ STB 10 receives television signals from satellite 16, over-the-air broadcast 18 (also referred as aerial broadcast), or via cable through a cable provider 20, for performing conventional television reception functions. The STB also communicates with an Internet Service Provider (ISP) 22 over the satellite 16 medium or via cable through the cable provider 20. In addition, the STB 10 allows for ISP 22 communication over a telephone subscriber line 24 interface. r. r Various peripheral devices 26 are also controlled through the STB 10. Such devices might include an interphone, VCR, video phone, printer, fax, and the like. The centralized control of such devices 26 through the STB 10 helps facilitate their access and management.
The television 12 set is coupled to the STB 10 and permits audio and display functions to the system. The display function is provided by the television screen and may include display
™ of television programs, HTML pages, and video images created by the peripheral devices 26.
The audio function is provided by one or more speakers 28 either resident within the television 12 set, or externally coupled to the television set. The television 12 unit may be an analog TV, a digital TV, or the like.
The remote control unit 14 is also in communication with the STB 10 and provides o <- additional functionalities to the system. FIG. 2 is an exemplary illustration of the remote control unit 14 and FIG. 3 is its functional block diagram in an exemplary, semi-schematic form. As in a conventional remote controller, the remote control unit 14 illustrated in FIG. 2 includes a 1 keypad 30 for allowing input of keypad data to the STB 10. The keypad 30 in the described embodiment comprises a power key, various numeric or alpha character keys, function keys
(menu key, clear key, enter key, etc.), and arrow keys. A user depresses the keys on the keypad 30 to specify a particular operation the user wants to perform. For instance, up and down arrow keys along with the enter key might be used to select data displayed on the television screen.
The remote control unit 14 also includes a microphone 32 for capturing voice data upon an utterance by the user. Thus, a user may provide oral commands to the system during Internet shopping instead of keypad commands, making it easier and more pleasant for an average user ι β to use the system. The use of voice recognition, unlike other situations, should be more efficient and more accurate for Internet shopping because it entails simple selection operations which require the utterance of only short phrases for recognition purposes.
In an alternative embodiment, the remote control unit 14 also includes a speaker 34 for output of voice messages to the user upon receipt of voice data from the STB 10. Such voice ι _- messages may include operation guidance, error messages, and the like. The speaker 34 can be operational either alone or in conjunction with the television speakers 28. Alternatively, the speaker 34 in the remote control unit 14 can be disabled and the television speakers 28 used in its place. The inclusion of the speaker 34 along with the microphone 32 also allows the remote control unit 14 to operate as a handset for cordless phone, interphone, and/or video phone functions that might be available through the STB 10.
A digital visual image recording means such as a digital video camera 36 is also incorporated into the remote control unit 14 for providing additional functionalities to the system to promote easier Internet shopping. The camera 36 might comprise either gray scale or color video data. Preferably, the video image data will be in color to adequately represent the user's yr personal appearance, i.e., hair color, clothing color, and the like, when the camera 36 is used for video phone or interphone purposes. Although the camera is described as a digital video camera 36, it should be understood by those having skill in the art that an apparatus for capturing still images rather than a full-motion video image can be used to implement the system according to the invention. Accordingly, the camera 36 might comprise a digital still camera, a video camera
O or any other type of device that outputs a digital image.
In addition, the camera 36 is preferably mounted on a hinge on one end of the remote control unit 14 for allowing the camera 36 to be rotated at a 90 or 180 degree angle. The rotation of the camera not only facilitates video capture for video phone or interphone functions, but also eases the capture of barcode images when ordering groceries or other barcoded items via the
J Internet, as described in further detail below.
Referring now to FIG. 3, user input from the keypad 30, microphone 32, or digital camera 36 is processed by the remote control unit 14 before transmission to the STB 10. Input from the keypad 30 is sent to a keypad data encoder 40 for translation of the keypad data into a keypad code. Specifically, when a user depresses a key on the keypad 30, the keypad data encoder 40 encodes the depressed keypad position information to a binary keypad code, such as an ASCII character data or a hexadecimal code for transmission to the STB 10.
Input from the microphone 32, on the other hand, is sent to an analog to digital converter 42 for converting voice data from analog data to digital data according to well known principles. Video images captured by the digital camera 36 are sent to a video signal processor 44 for generating videographic data also according to well known principles.
10 The input data from the three input media, i.e. the keypad code from the keypad data encoder 40, voice data from the analog to digital converter 42, and videographic data from the video signal processor 44, are then sent to a channel coder 46 in the remote control unit 14. The channel coder 46 combines the input data from the three input media by a predetermined coding method and transmits the coded data to the STB 10 through a transmitter 48. The predetermined
, r coding method allows the STB 10 to recognize and decode the data received from the different input media of the remote control unit 14. The coding method, according to one embodiment, entails placing a header and a delimeter for demarcating the beginning and end of particular types of input data. In this scenario, the channel coder 46 transmits the input data along with the corresponding header and delimeter, for decoding by the STB 10. .r> The transmitter 48 in the remote control unit 14 allows for wireless transmission of the coded data to the STB 10. Infra Red (IR), radio frequency (RF), Ultra High Frequency (UHF), or any other wireless technology may be used for the wireless transmission. If IR technology is used, the transmitter 48 may generally be equipped with an LED. If RF or UHF technology is used, the transmitter 48 may generally be equipped with an antenna or the like. c- According to one embodiment, the remote control unit 14 also includes a receiver 50 for wireless receipt of data from the STB 10. The data is then sent to a channel decoder 52 for decoding and extracting the data received for a particular medium. In the illustrated embodiment, the remote control unit 14 is equipped to receive voice data from the STB 10. The voice data, once extracted by the channel decoder 52, is transmitted to a digital to analog
,Q converter 54 and the converted analog voice data is sent to the speaker for generating corresponding sound waves to the user. It should be appreciated by those having skill in the art, that necessary variations can be made to the remote control unit without departing from the spirit and scope of the invention should other types of data other than voice data be sent by the STB 10 to the remote control unit 14. For instance, if the remote control unit 14 is equipped with a
■, r display unit (not shown), the STB 10 might send video images to the receiver 50 and the receiver
50 might submit them to the channel decoder 52 for extracting the video images. From there. 1 the video images might be submitted to a video signal processor (not shown) for converting the extracted video images to videographic data to be displayed on the display unit.
If the remote control unit 14 receives only one type of data from the STB 10 (e.g. voice
<- data or video data) as is described in the current embodiment, the channel decoder 52 is no longer necessary for deciphering the type of data received given that the inputted data will always be of the same type. In such instance, the channel decoder 52 may be eliminated from the remote control unit 14.
FIG. 4 is an exemplary, semi-schematic block diagram of the STB 10 of FIG. 1. The STB
, 10 comprises a tuner 82 and an audio visual output unit 84 for conventional television reception capabilities. The tuner 82 is further configured to provide Internet connection with a Web server 72 via the ISP 42, through the satellite 16 medium or via cable through the cable provider 20. The STB 10 is also equipped with a modem (not shown) for communicating with the Web server 72 via the ISP 22, through telephone subscriber lines 24.
, , The Web server 72 provides various software programs 76, such as HTML pages. Internet shopping Web programs, and other application software programs to a Web browser 70 through the Internet connection. The software programs 76 may be downloaded and stored in a local storage 74 unit. The local storage 74 may suitably comprise a hard disk drive or drive array, a PCMCIA programmable memory card, a high-capacity flexible media cartridge and floppy drive
2 combination, ROM, FROM (Flash ROM), SRAM or DRAM memory chips, or the like. In addition to downloaded software programs, the local storage 74 may also store electronic program guide data including scheduling information of television programs, as well as miscellaneous user-specific information, such as the user's e-mail address, shopping list information, personal notes, etc.
~ The local storage 74 may further store software and data for a voice recognizer, video data recognizer, voice generator, remote control unit driver, Web Browser, and any other type of application. These types of software and data can be pre-loaded, downloaded, and/or modified. Modification can be made by downloading or loading the software and/or data from a local medium such as an IC card, a floppy disk, or the like.
~r. The STB 10 also includes a remote control unit driver 58 having an STB receiver 60, STB channel decoder 62, STB transmitter 64, and STB channel coder 66. The STB receiver 60 receives input data from the remote control unit 14 via wireless means. In an alternative embodiment, the STB receiver 60 also receives keyboard data from a wireless keyboard 68. The wireless keyboard 68 is operational through IR, RF, UHF, or any other wireless technology o applicable to the remote control unit 14.
The STB receiver 60 submits the received input data to the STB channel decoder 62 for decoding the multiple medium data to a keypad code, voice data, and/or videographic data. 1
According to one embodiment, the STB channel decoder 62 examines the header preceding the input data for identifying the input medium of the data. The channel decoder then extracts the data between the header and the delimiter and transmits the extracted data for further processing,
<- if required, based on the identified medium.
During Internet shopping, if the identified medium is the keypad 30, the keypad code is extracted by the STB channel decoder 62 and submitted to the downloaded software program 76 through the Web browser 70.
If the identified medium is the microphone 32 or digital camera 36, the extracted voice
, data or videographic data undergoes further processing. Voice data is submitted to a voice recognizer 78 configured with voice recognition software for converting the voice data to character data according to a number of conventional voice recognition algorithms.
In the alternative embodiment, voice recognizer is included in the remote control unit. In this case, the remote control unit converts the voice data to character data and transfers the ι r character data to the set top box.
Videographic data is submitted to a video data recognizer 80 which, in the described embodiment, is configured with barcode recognition software. The barcode recognition software further includes pattern recognition and barcode decode capabilities for deciphering barcode images inputted to the system via the digital camera 36 (FIG. 3). Most retailers today attach a r. Universal Product Code (UPC) which is printed or tagged on each item of merchandise to be sold, as a barcode. Conventionally, the barcode might include an item's Stock Keeping Unit (SKU) code as well as other additional information pertaining to a specific item of merchandise. The barcode data is converted to a UPC or SKU code by the barcode recognition software and transmitted to a downloaded purchase transaction program through the Web browser 70. With jr this capability, a user can transmit an order for an item via the Internet by simply transmitting the barcode image of the item. The barcode image should be available to the user if the user has the packaging of the item on hand. Barcode data may also be available in catalogues or in old receipts from retailers offering the desired merchandise.
In an alternative embodiment, the video data recognizer is included in the remote control
™ unit. The remote control unit recognizes captured bar code image data and converts it to a bar code, such as UPC, SKU or the like, and transfers the bar code data to the set-top box.
It should be noted, at this point, that those skilled in the art will appreciate various other codes, indicia, text, and the like, being used instead of the barcode for item identification purposes. Thus, the barcode recognition software may suitably be modified, without departing
, from the spirit or scope of the invention, to decipher any other types of item identifiers.
In an alternative embodiment, the visual data recognizer 80 is configured with other types of image recognition software, such as an optical character recognition (OCR) program. If the 1 visual data recognizer 80 is configured with an OCR program, handwritten notes (e.g. a handwritten shopping list) can be converted into text character codes for either input to the downloaded software program 76 through the Web browser 70, or for storage in the local storage s- 74 unit for later use.
A downloaded software program 76 can therefore receive input from the remote control unit 14 and/or the wireless keyboard 62. In addition, the downloaded program 76 has access to the local storage unit 74, an IC card interface 88 unit, and an external interface 90, if needed. Details of the IC card interface 88 unit and the external interface 90 are provided below.
1 r. The downloaded software program 76, in response to input data, outputs graphic and character display data through the Web browser 70 for conveyance to an audio visual output unit 84. The audio visual output unit 84 transfers the graphic and character display data to the television 12 for display thereon.
The audio data from the downloaded software program is transferred to a voice generator
, <- 86 configured with a voice generating program that converts the audio data to digital voice data.
The digital voice data is transferred to the STB channel coder 66 which, as the channel coder 46 (FIG. 3) in the remote control unit, combines all the output data by a predetermined coding method and transmits the coded data to the speaker 34 in the remote control unit 14 through the STB transmitter 64. Although the STB 10 of FIG. 4 only illustrates voice data as being output
.-,0 to the remote control unit, a person skilled in the art, as described above in conjunction with FIG.
3, should appreciate other types of data being transmitted to the remote control unit 14. However, in the instance where only one type of data is capable of being output to the remote control unit 14, the channel coder 68, like the channel decoder 52 (FIG. 3) in the remote control unit, becomes unnecessary and may be eliminated if desired. <- The voice data created by the voice generator 86 may optionally be transferred to the television speakers 28 through the audio visual output unit 84. The television speakers 28 may be made operational alone or in conjunction with the remote control speakers 34.
In addition to the above, the STB 10 includes an IC card interface 88 configured to read information from and write information to an IC, or smart card. The IC card and IC card
-5 interface 88, in combination, provide a suitable means for authenticating an STB 10 as a valid receiver of particular TV services. The IC card can also provide secured payment methods (credit card, prepaid electronic cash, etc.), storage of personal information, personal identification, and the like. While referred to as an IC card, the card is a personal memory card or data card which looks and feels much like an ordinary credit card. The IC card may be either
-, c contact based or contactless. The simplest contact-type card might be a magnetic tape storage stripe affixed in a particular location on its reverse side. Alternatively, a contact or contactless IC card may comprise a microprocessor, an electrically erasable field-programmable read-only 1 memory (EEPROM), a Flash ROM (FROM) and, optionally, circuitry for inductively receiving an RF power signal. In its second configuration, the IC card is capable of capacitively transferring data signals between the card and the IC card interface 88 and may be interrogated,
_- programmed or reprogrammed by read/write circuitry comprising the card interface 88.
An additional I/O device is provided in the STB 10 in the form of an external interface 90 for centralized access of various peripheral devices 26 (FIG. 1). The external interface 90 allows communication between the peripheral devices 26 and the STB 10. As a result, a two-way exchange of information is made possible between the peripheral devices 26 and the STB 10. ι Q This information can include video signals, data signals, voice signals, audio signals, image signals, and control signals. The external interface 90 might comprise an IEEE 1394 interface, USB, RS232C, SCSI (small computer system interface), LAN, IrDA, and the like. The peripheral devices 26 might comprise an intercom, interphone, VCR, video camera, video phone, printer, fax machine, and the like.
, As an example, to accomplish interphone functionalities through the STB 10, an interphone outside the user's front gate should include video-camera capabilities. The interphone is connected to the STB 10 through the external interface 90. Control of the interphone is made by an interphone application software in the STB 10. The application software might be loaded from the local storage 74 unit, downloaded from the Web server 72 through the Web browser 76, j . or preloaded into the STB 10. The videographic picture captured by the interphone outside the user's door is displayed on the television 12 via a pop-up window. Voice capabilities are provided by the microphone 32 in the remote control unit 14. Audio capabilities are provided by the remote control speaker 34, television speakers 28, or both. It can be appreciated, therefore, that access to the interphone through the STB 10 facilitates such access by allowing j - the user to receive an interphone call from a visitor outside the home without having to move away from a television program that he or she might be watching. In addition, the user is spared from having a separate interphone receiving unit since the television-STB combination, along with the remote control unit 14, acts as the receiving unit.
Referring now to FIGS. 5 A and 5B, operation of the electronic shopping system of the n, present invention is discussed in detail. An Internet shopping transaction starts by selecting a
Web browser function 100 from a menu of functions available through the STB 10. The menu is displayed on the television screen and selection is made via the keypad 30 on the remote control unit 14. Alternatively, selection may be made through the microphone 32 by orally voicing the selection. Selection of the Web browser function causes display of the Web browser
, , 70 on the television set. The user then selects a Web site from the browser 102 by directly keying-in a web site address or selecting a site from a menu of available Internet shopping sites. 1
The menu may be customized by the user based on his or her favorite Internet shopping sites, or may reflect a list of the Internet sites most recently accessed by the user.
Once a shopping Internet site has been specified, the Web server downloads the t- corresponding client purchase transaction program and/or HTML text 104 to the STB through the Web browser. In addition, needed programs such as a voice recognition program, video data recognition program, voice generating program, and IC card interface program, if not already preloaded in the STB, are loaded from the local storage unit 74 or downloaded from the Web server 72.
1 r. The downloaded client purchase transaction program displays an initial display on the television screen along with introductory visual and/or audio guidance, and requests for user selection of a purchase item 106. The audio guidance is effectuated through the remote control speaker 34, television speakers 28, or both.
If keypad input is detected 108, the corresponding keypad code is extracted by the STB
, channel decoder and transferred to the transaction program 1 10 through the Web browser. If microphone input is detected 112, voice recognition is performed by converting the voice data to the corresponding character data. The extracted character data is then transferred to the transaction program 116. Detection of a camera input 1 18 causes, in the illustrated embodiment, the running of the barcode recognition program 120. In alternative embodiments, other video r, data recognition programs such as an OCR program may be run if applicable. Barcode recognition causes the corresponding UPC or SKU numeric data to be transferred to the transaction program as an input 122. If no input is received, or an erroneous input is received, an error message or operation guidance is provided 124 to the user via the television screen and speakers 28, and/or via the remote control speaker 34. r The data input process continues until all necessary selections have been made by the user to complete an item selection 126.
The client purchase transaction program in the STB 10 is in communication with the server purchase transaction program on the Web server 72. Upon client selection of an item, the server program retrieves information corresponding to the selected item from a Price Lookup
■5 (PLU) Table. In the described embodiment, all merchandise information is maintained in the
PLU Table. The PLU Table is, in turn, stored and maintained in the Web server 72 database. The PLU Table suitably comprises a merchandise specific information set. The merchandise specific information set may be arranged in a variety of ways, but is most advantageously configured as sequential entries, with each entry specific to a particular piece of merchandise. o A merchandise entry might include the store's SKU number which is identified to a particular product's UPC by a suitable conversion routine. A merchandise entry might further include a text string giving the brand or trade name of the product and including a generic description of the product. In addition to the SKU number and identifying string, each item entry also might include a price field.
Upon review of the selected merchandise information, and after a decision to purchase the merchandise, the user proceeds to payment processing 127. The user has the option of using the IC card for making payment for the item 128. If the IC card is to be used, the card is processed 130 by the IC card interface 88. The processing might include extracting a customer ID number stored in the card and transmitting the ID to the Web server 72 for determining whether the user is a preferred customer participating in a preferred customer plan which might allow him or her
10 reward points or discounted prices. The purchase amount might then be charged to the user's account for being billed at a later time.
Whether or not the IC card is used as a method of payment, the purchase order information can be printed 132 on a printer coupled to the STB 10 through the external interface 10 for record-keeping purposes, if a printer is connected to the set top box 10.
, . Accordingly, there has been brought to the art of electronic shopping systems, a system and method that allows Internet shopping by utilizing a television-set-top-box combination in conjunction with a remote control unit with voice recognition capabilities. Internet shopping is facilitated by allowing users to input voice commands through the microphone in the remote control unit. The optional camera also facilitates Internet shopping by allowing users to simply yr, input the barcode image of the item to be purchased. The external interface in the STB and the optional speaker in the remote control unit also facilitate the operation of peripheral devices by providing a centralized access to those devices.
While the invention has been described with respect to particular illustrated embodiments, those skilled in the art and technology to which the invention pertains will have no difficulty r devising variations which in no way depart from the scope and spirit of the present invention.
For example, while the illustrated embodiments have been described in connection with a set-top box, it will be appreciated that the present system and method may be devised within the television set itself, without the need of a separate set-top box. Accordingly, the present invention is not limited to the specific embodiments described above, but rather, is defined by on the scope of the appended claims.
35

Claims

1CLAIMS:
1. In an electronic shopping system including a television set coupled to a set-top box, the set-top box being configured to access the Internet through a Web browser resident in the set- top box, the set-top box further being configured to communicate with a remote control unit, the remote control unit comprising: a first input medium including a keypad for providing keypad data; a second input medium including a microphone for providing voice data; and a transmitter coupled to the first input medium and the second input medium for ι transmitting the keypad data and the voice data to the set-top box.
2. The remote control unit of claim 1 further comprising a third input medium including a digital visual image recording means for providing videographic data, the third input medium being coupled to the transmitter for transmitting the videographic data to the set-top box.
15
3. The remote control unit of claim 1 further comprising: a receiver for receiving output voice data from the set-top box; and a speaker coupled to the receiver for generating sound waves corresponding to the received output voice data.
20
4. The remote control unit of claim 1 further comprising a voice recognizer for converting voice data to character data, the character data being transmitted by the transmitter to the set-top-box.
jr 5. In an electronic shopping system including a television set and a remote control unit configured with a microphone, the remote control unit providing input data to a set-top box coupled to the television set, the set-top box comprising: a receiver for receiving the input data from the remote control unit, the input data including voice data from the microphone; ™ a voice recognizer for converting voice data to character data; means for connecting to an Internet service provider; a Web browser coupled to the means for connecting, the Web browser being configured to receive the input data from the remote control unit; and an audio-visual output unit coupled to the Web browser for generating an audio-visual -, r display on a display unit in response to the input data.
6. The set-top box of claim 5 further comprising: a voice generator coupled to the Web browser for converting character data to output voice data; and a transmitter for transmitting the output voice data.
7. The set-top box of claim 5 further comprising an external interface with a household peripheral device.
10 8. The set-top box claim 5 further comprising an interface with a customer ID card.
9. The set-top box of claim 5 further comprising a local storage unit for storing and retrieving application software programs.
, c 10. The electronic shopping system of claim 5, wherein the display unit is a television monitor.
1 1. An electronic shopping system comprising: a remote control unit comprising: 0 at least two input media for providing input data, the first input medium including a keypad for providing keypad data, and the second input medium including a microphone for providing voice data; and a transmitter coupled to the input media for transmitting the input data; a set-top box in communication with the remote control unit, the set-top box comprising: 2<r a receiver for receiving the input data from the transmitter in the remote control unit; means for connecting to an Internet service provider; a Web browser coupled to the means for connecting, the Web browser being configured to receive the input data; and T Λ an audio-visual output unit coupled to the Web browser for generating an audiovisual display on a display unit in response to the input data.
12. The electronic shopping system of claim 11 , wherein the remote control unit further comprises a third input medium including a digital visual image recording means for providing o r videographic data to the set-top box. 1
13. The electronic shopping system of claim 12, wherein the remote control unit comprises means for bar code recognition.
r 14. The electronic shopping system of claim 12, wherein the set-top box comprises means for bar code recognition.
15. The electronic shopping system of claim 11, wherein the set-top box further comprises:
, Q a voice generator coupled to the Web browser for converting character data to output voice data; and a transmitter for transmitting the output voice data; and the remote control unit further comprises: a receiver for receiving the output voice data; and , a speaker coupled to the receiver for generating sound waves corresponding to the received output voice data.
16. The electronic shopping system of claim 11, wherein the set-top box further comprises an external interface with a household peripheral device.
20
17. The electronic shopping system of claim 11, wherein the set-top box further comprises an interface with a customer ID card.
18. The electronic shopping system of claim 11 , wherein the set-top box is coupled to a local storage unit for storing and retrieving application software programs.
19. The electronic shopping system of claim 1 1. wherein the display unit is a television monitor.
on 20. The electronic shopping system of claim 11 further including a wireless keyboard system for communicating with the set-top box.
21. The electronic shopping system of claim 11, wherein the remote control unit is further configured with a speaker and is capable of functioning as a wireless phone.
35
22. The electronic shopping system of claim 11, wherein the remote control unit is further configured with a speaker and is capable of functioning as a handset for an interphone.
23. The electronic shopping system of claim 11, wherein the remote control unit is further configured with a speaker and is capable of functioning as a handset for a videophone.
24. An electronic shopping method comprising the steps of: accessing an Internet service provider through a set-top box;
10 entering input data through a remote control unit having at least a keypad for entering keypad data and a microphone for entering voice data; converting the voice data to character data; transmitting the input data from the remote control unit to a Web browser resident in the set-top box; 1 receiving audio-visual data from the Web browser in response to the input data; and displaying the audio-visual data on a display unit.
25. The method of claim 24, wherein the step of entering input data comprises the step of entering videographic data through the remote control unit further including a digital visual
20 image recording means.
26. The method of claim 25, wherein the videographic data comprises bar code data.
27. The method of claim 24 further comprising the steps of: jc receiving character data from the Web browser; converting the character data to output voice data; transmitting the output voice data to a remote control unit having a speaker; and generating sound waves corresponding to the received output voice data.
n 28. The method of claim 24 further comprising the step of interfacing with a household peripheral device through the set-top box.
29. The method of claim 24 further comprising the step of interfacing with a customer ID card through the set-top box.
35
30. The method of claim 24 further comprising the step of interfacing with a local storage unit for storing and retrieving application software programs.
31. The method of claim 24 further comprising the step of entering input data through a wireless keyboard system.
PCT/US2000/018031 1999-07-09 2000-06-29 Internet shopping system utilizing set top box and voice recognition WO2001005155A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2001510242A JP2003529959A (en) 1999-07-09 2000-06-29 Internet shopping system using set-top box and voice recognition
GB0200160A GB2368996B (en) 1999-07-09 2000-06-29 Internet shopping system utilizing set top box and voice recognition

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/350,784 US6543052B1 (en) 1999-07-09 1999-07-09 Internet shopping system utilizing set top box and voice recognition
US09/350,784 1999-07-09

Publications (1)

Publication Number Publication Date
WO2001005155A1 true WO2001005155A1 (en) 2001-01-18

Family

ID=23378166

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/018031 WO2001005155A1 (en) 1999-07-09 2000-06-29 Internet shopping system utilizing set top box and voice recognition

Country Status (4)

Country Link
US (1) US6543052B1 (en)
JP (1) JP2003529959A (en)
GB (1) GB2368996B (en)
WO (1) WO2001005155A1 (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002017625A1 (en) * 2000-08-21 2002-02-28 Koninklijke Philips Electronics N.V. A voice controlled remote control with downloadable set of voice commands
DE10128925A1 (en) * 2001-06-15 2002-12-19 Deutsche Telekom Ag Terminal and method for using various services offered over a telecommunications network
JP2003044756A (en) * 2001-07-26 2003-02-14 Kenichi Omae On-line shopping method, shopping site, voice recognizing device and voice recognition supporting device
JP2003178272A (en) * 2001-12-11 2003-06-27 Sony Corp Electronic equipment and operation control method
JP2005527905A (en) * 2002-05-28 2005-09-15 シンビアン　リミテッド Tamper evident removable media for storing executable code
EP1739534A2 (en) * 2005-06-30 2007-01-03 Sony Corporation Graphical user interface device, operating input processing method, and two-way communication apparatus
EP1922857A2 (en) * 2005-08-19 2008-05-21 Robert Stephanian Tethered digital butler consumer electronic device and method
CN103235736A (en) * 2013-03-27 2013-08-07 四川长虹电器股份有限公司 Android-platform-based method and system for supporting virtual audio equipment
EP2945157A3 (en) * 2014-05-13 2015-12-09 Panasonic Intellectual Property Corporation of America Information provision method using voice recognition function and control method for device
US9311394B2 (en) 2006-10-31 2016-04-12 Sony Corporation Speech recognition for internet video search and navigation
CN105554284A (en) * 2015-12-22 2016-05-04 福建星网智慧科技股份有限公司 Method and system for improving Android mobile phone call tone quality
US9614964B2 (en) 2005-08-19 2017-04-04 Nextstep, Inc. Consumer electronic registration, control and support concierge device and method
US9866697B2 (en) 2005-08-19 2018-01-09 Nexstep, Inc. Consumer electronic registration, control and support concierge device and method

Families Citing this family (209)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8352400B2 (en) 1991-12-23 2013-01-08 Hoffberg Steven M Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore
US7188352B2 (en) 1995-07-11 2007-03-06 Touchtunes Music Corporation Intelligent digital audiovisual playback system
ES2143556T3 (en) 1994-10-12 2000-05-16 Touchtunes Music Corp INTELLIGENT DIGITAL AUDIOVISUAL REPRODUCTION SYSTEM.
US7424731B1 (en) 1994-10-12 2008-09-09 Touchtunes Music Corporation Home digital audiovisual information recording and playback system
US8661477B2 (en) 1994-10-12 2014-02-25 Touchtunes Music Corporation System for distributing and selecting audio and video information and method implemented by said system
FR2753868A1 (en) 1996-09-25 1998-03-27 Technical Maintenance Corp METHOD FOR SELECTING A RECORDING ON AN AUDIOVISUAL DIGITAL REPRODUCTION SYSTEM AND SYSTEM FOR IMPLEMENTING THE METHOD
FR2769165B1 (en) 1997-09-26 2002-11-29 Technical Maintenance Corp WIRELESS SYSTEM WITH DIGITAL TRANSMISSION FOR SPEAKERS
FR2781582B1 (en) 1998-07-21 2001-01-12 Technical Maintenance Corp SYSTEM FOR DOWNLOADING OBJECTS OR FILES FOR SOFTWARE UPDATE
FR2781593B1 (en) * 1998-07-22 2001-01-12 Technical Maintenance Corp REMOTE CONTROL FOR INTELLIGENT DIGITAL AUDIOVISUAL REPRODUCTION SYSTEM
FR2781591B1 (en) 1998-07-22 2000-09-22 Technical Maintenance Corp AUDIOVISUAL REPRODUCTION SYSTEM
US8028318B2 (en) 1999-07-21 2011-09-27 Touchtunes Music Corporation Remote control unit for activating and deactivating means for payment and for displaying payment status
FR2781580B1 (en) 1998-07-22 2000-09-22 Technical Maintenance Corp SOUND CONTROL CIRCUIT FOR INTELLIGENT DIGITAL AUDIOVISUAL REPRODUCTION SYSTEM
US7191247B1 (en) 1998-09-11 2007-03-13 Lv Partners, Lp Method for connecting a wireless device to a remote location on a network
US6868433B1 (en) 1998-09-11 2005-03-15 L.V. Partners, L.P. Input device having positional and scanning capabilities
US6823388B1 (en) 1998-09-11 2004-11-23 L.V. Parners, L.P. Method and apparatus for accessing a remote location with an optical reader having a programmable memory system
US7379901B1 (en) 1998-09-11 2008-05-27 Lv Partners, L.P. Accessing a vendor web site using personal account information retrieved from a credit card company web site
US7440993B1 (en) 1998-09-11 2008-10-21 Lv Partners, L.P. Method and apparatus for launching a web browser in response to scanning of product information
US6704864B1 (en) * 1999-08-19 2004-03-09 L.V. Partners, L.P. Automatic configuration of equipment software
US6636896B1 (en) 1998-09-11 2003-10-21 Lv Partners, L.P. Method and apparatus for utilizing an audibly coded signal to conduct commerce over the internet
US7392945B1 (en) 1998-09-11 2008-07-01 Lv Partners, L.P. Portable scanner for enabling automatic commerce transactions
US6745234B1 (en) 1998-09-11 2004-06-01 Digital:Convergence Corporation Method and apparatus for accessing a remote location by scanning an optical code
US7386600B1 (en) 1998-09-11 2008-06-10 Lv Partners, L.P. Launching a web site using a personal device
US7904187B2 (en) 1999-02-01 2011-03-08 Hoffberg Steven M Internet appliance system and method
US8726330B2 (en) 1999-02-22 2014-05-13 Touchtunes Music Corporation Intelligent digital audiovisual playback system
FR2796482B1 (en) 1999-07-16 2002-09-06 Touchtunes Music Corp REMOTE MANAGEMENT SYSTEM FOR AT LEAST ONE AUDIOVISUAL INFORMATION REPRODUCING DEVICE
US6930788B1 (en) * 1999-07-20 2005-08-16 Canon Kabushiki Kaisha Secure printing over cable network to home printer
US7084994B1 (en) * 1999-07-20 2006-08-01 Canon Kabushiki Kaisha Home printing from internet sources
US7234155B1 (en) * 1999-08-27 2007-06-19 Kay Matthew W Automating commerce on a broadcast programming distribution network
US20010027560A1 (en) * 1999-09-22 2001-10-04 Simon Rudy J. Cable/satellite/internet-ready multimedia television
JP2001119767A (en) 1999-10-19 2001-04-27 Sony Corp Information processing unit and method, information processing system and recording medium
KR20010093244A (en) * 1999-11-04 2001-10-27 요트.게.아. 롤페즈 Communication device for integrating voice mail services and TV functions
US6978475B1 (en) * 1999-11-24 2005-12-20 Ecable, Llc Method and apparatus for internet TV
US20030099456A1 (en) * 2000-01-06 2003-05-29 Nikon Corporation & Nikon Technologies Inc. Image recorder
US20010042029A1 (en) * 2000-02-01 2001-11-15 Galvez Julian M. Own-likeness virtual model
FR2805377B1 (en) 2000-02-23 2003-09-12 Touchtunes Music Corp EARLY ORDERING PROCESS FOR A SELECTION, DIGITAL SYSTEM AND JUKE-BOX FOR IMPLEMENTING THE METHOD
WO2001058121A1 (en) * 2000-02-04 2001-08-09 Homerelay Communications, Inc. Method and apparatus for conducting long distance telephone calls in association with an advertisement system
FR2805072B1 (en) 2000-02-16 2002-04-05 Touchtunes Music Corp METHOD FOR ADJUSTING THE SOUND VOLUME OF A DIGITAL SOUND RECORDING
FR2805060B1 (en) 2000-02-16 2005-04-08 Touchtunes Music Corp METHOD FOR RECEIVING FILES DURING DOWNLOAD
JP2001320291A (en) * 2000-02-29 2001-11-16 Sony Corp Receiver and method for receiving
US20020007321A1 (en) * 2000-03-22 2002-01-17 Burton Peter A. Methods and apparatus for on-line ordering
US20020055878A1 (en) * 2000-03-22 2002-05-09 Burton Peter A. Methods and apparatus for on-line ordering
CN1367990A (en) * 2000-04-24 2002-09-04 三菱电机株式会社 Cellular phone and remote control system
US7047551B2 (en) * 2000-04-28 2006-05-16 Canon Kabushiki Kaisha Information distributing method and information distributing system
FR2808906B1 (en) 2000-05-10 2005-02-11 Touchtunes Music Corp DEVICE AND METHOD FOR REMOTELY MANAGING A NETWORK OF AUDIOVISUAL INFORMATION REPRODUCTION SYSTEMS
US6618858B1 (en) * 2000-05-11 2003-09-09 At Home Liquidating Trust Automatic identification of a set-top box user to a network
US7269160B1 (en) 2000-05-26 2007-09-11 Buffalo International, Inc. Voice over internet call center integration
US7047196B2 (en) 2000-06-08 2006-05-16 Agiletv Corporation System and method of voice recognition near a wireline node of a network supporting cable television and/or video delivery
US7058356B2 (en) 2000-06-15 2006-06-06 Benjamin Slotznick Telephone device with enhanced audio-visual features for interacting with nearby displays and display screens
FR2811175B1 (en) 2000-06-29 2002-12-27 Touchtunes Music Corp AUDIOVISUAL INFORMATION DISTRIBUTION METHOD AND AUDIOVISUAL INFORMATION DISTRIBUTION SYSTEM
FR2811114B1 (en) 2000-06-29 2002-12-27 Touchtunes Music Corp DEVICE AND METHOD FOR COMMUNICATION BETWEEN A SYSTEM FOR REPRODUCING AUDIOVISUAL INFORMATION AND AN ELECTRONIC ENTERTAINMENT MACHINE
US6455421B1 (en) * 2000-07-31 2002-09-24 Applied Materials, Inc. Plasma treatment of tantalum nitride compound films formed by chemical vapor deposition
US6847357B2 (en) * 2000-08-18 2005-01-25 Hinics Co., Ltd. Remote control device having wheel and ball switches for controlling functions of an electronic machine
FR2814085B1 (en) 2000-09-15 2005-02-11 Touchtunes Music Corp ENTERTAINMENT METHOD BASED ON MULTIPLE CHOICE COMPETITION GAMES
US7028329B1 (en) * 2000-10-13 2006-04-11 Seiko Epson Corporation Remote accessible programming
US7680324B2 (en) * 2000-11-06 2010-03-16 Evryx Technologies, Inc. Use of image-derived information as search criteria for internet and other search engines
US20020054206A1 (en) * 2000-11-06 2002-05-09 Allen Paul G. Systems and devices for audio and video capture and communication during television broadcasts
US8224078B2 (en) * 2000-11-06 2012-07-17 Nant Holdings Ip, Llc Image capture and identification system and process
WO2002047390A1 (en) * 2000-12-04 2002-06-13 Isurftv E-mail, telephone number or url within tv frame
US20020087662A1 (en) * 2000-12-29 2002-07-04 Stephane Bouet System and method for selective updating of media files
US20030105679A1 (en) * 2001-01-03 2003-06-05 Aditya Krishnan Point of sale terminal arrangement using television set-top box
US8095370B2 (en) * 2001-02-16 2012-01-10 Agiletv Corporation Dual compression voice recordation non-repudiation system
US20040244056A1 (en) * 2001-02-21 2004-12-02 Lorenz Kim E. System and method for providing direct, context-sensitive customer support in an interactive television system
US20050039214A1 (en) * 2001-02-21 2005-02-17 Lorenz Kim E. System and method for providing direct, context-sensitive customer support in an interactive television system
US20020120635A1 (en) * 2001-02-27 2002-08-29 Joao Raymond Anthony Apparatus and method for providing an electronic book
US20020144282A1 (en) * 2001-03-29 2002-10-03 Koninklijke Philips Electronics N.V. Personalizing CE equipment configuration at server via web-enabled device
US20020141657A1 (en) * 2001-03-30 2002-10-03 Robert Novak System and method for a software steerable web Camera
WO2002080521A2 (en) * 2001-03-30 2002-10-10 Digeo, Inc. System and method for a software steerable web camera with multiple image subset capture
JP4759844B2 (en) * 2001-05-18 2011-08-31 ソニー株式会社 Information providing apparatus and method, information processing apparatus and method, recording medium, and program
US7346917B2 (en) * 2001-05-21 2008-03-18 Cyberview Technology, Inc. Trusted transactional set-top box
WO2003005719A2 (en) * 2001-05-24 2003-01-16 Vixs Systems Inc. Method and apparatus for managing resources and multiplexing a plurality of channels in a multimedia system
US6970854B2 (en) * 2001-05-25 2005-11-29 Hewlett-Packard Development Company, L.P. System for remote signature writing
US20020186329A1 (en) * 2001-06-07 2002-12-12 Ehometv [Hk] Ltd., Electronic content modules and display dock
US20020194604A1 (en) * 2001-06-19 2002-12-19 Sanchez Elizabeth C. Interactive television virtual shopping cart
US7003795B2 (en) * 2001-06-26 2006-02-21 Digeo, Inc. Webcam-based interface for initiating two-way video communication
US7272657B2 (en) * 2001-07-30 2007-09-18 Digeo, Inc. System and method for displaying video streams ranked by user-specified criteria
US6941575B2 (en) * 2001-06-26 2005-09-06 Digeo, Inc. Webcam-based interface for initiating two-way video communication and providing access to cached video
NZ530175A (en) * 2001-06-28 2007-03-30 Trek 2000 Int Ltd Method and devices for wireless data transfer between electronic devices via a transfer apparatus and data store
EP1442619A2 (en) * 2001-08-14 2004-08-04 Koninklijke Philips Electronics N.V. Method of and system for providing a programming information for programming a device
EP1422936B1 (en) * 2001-08-28 2012-03-21 Panasonic Corporation Broadcast reception method
US20030061033A1 (en) * 2001-09-26 2003-03-27 Dishert Lee R. Remote control system for translating an utterance to a control parameter for use by an electronic device
US7089578B2 (en) * 2001-09-29 2006-08-08 Koninklijke Philips Electronics N.V. Apparatus and method for dynamically updating a viewer profile in a digital television device
US7324947B2 (en) 2001-10-03 2008-01-29 Promptu Systems Corporation Global speech user interface
US20030071902A1 (en) * 2001-10-11 2003-04-17 Allen Paul G. System, devices, and methods for switching between video cameras
US20030126620A1 (en) * 2001-12-31 2003-07-03 Toshio Hayakawa Multimedia display system using display unit of portable computer, and signal receiver for television, radio, and wireless telephone
US6972787B1 (en) 2002-06-28 2005-12-06 Digeo, Inc. System and method for tracking an object with multiple cameras
US20040039648A1 (en) * 2002-08-20 2004-02-26 Sony Corporation Method and apparatus for downloading data to a set top box
US7822687B2 (en) 2002-09-16 2010-10-26 Francois Brillon Jukebox with customizable avatar
US10373420B2 (en) 2002-09-16 2019-08-06 Touchtunes Music Corporation Digital downloading jukebox with enhanced communication features
US11029823B2 (en) 2002-09-16 2021-06-08 Touchtunes Music Corporation Jukebox with customizable avatar
US8584175B2 (en) 2002-09-16 2013-11-12 Touchtunes Music Corporation Digital downloading jukebox system with user-tailored music management, communications, and other tools
US8151304B2 (en) 2002-09-16 2012-04-03 Touchtunes Music Corporation Digital downloading jukebox system with user-tailored music management, communications, and other tools
US8103589B2 (en) 2002-09-16 2012-01-24 Touchtunes Music Corporation Digital downloading jukebox system with central and local music servers
US9646339B2 (en) 2002-09-16 2017-05-09 Touchtunes Music Corporation Digital downloading jukebox system with central and local music servers
US8332895B2 (en) 2002-09-16 2012-12-11 Touchtunes Music Corporation Digital downloading jukebox system with user-tailored music management, communications, and other tools
US20040150713A1 (en) * 2003-01-31 2004-08-05 Cheng Y. P. Cordless IP video phone
US9092262B2 (en) 2003-06-27 2015-07-28 I-Rescue Technologies Llc Method and apparatus integrating navigation and saving the writable state of applications
US7346555B2 (en) * 2003-06-27 2008-03-18 Jan Rippingale Method and apparatus for client-in-charge business transaction processing
WO2005024780A2 (en) * 2003-09-05 2005-03-17 Grody Stephen D Methods and apparatus for providing services using speech recognition
KR100574505B1 (en) * 2003-12-23 2006-04-27 삼성전자주식회사 Open cable applying apparatus and method for providing function internet
US7734729B2 (en) * 2003-12-31 2010-06-08 Amazon Technologies, Inc. System and method for obtaining information relating to an item of commerce using a portable imaging device
US7432990B2 (en) * 2004-01-06 2008-10-07 Sharp Laboratories Of America, Inc. Open aquos remote control unique buttons/features
US7707039B2 (en) 2004-02-15 2010-04-27 Exbiblio B.V. Automatic modification of web pages
US8442331B2 (en) 2004-02-15 2013-05-14 Google Inc. Capturing text from rendered documents using supplemental information
US10635723B2 (en) 2004-02-15 2020-04-28 Google Llc Search engines and systems with handheld document data capture devices
US7812860B2 (en) 2004-04-01 2010-10-12 Exbiblio B.V. Handheld device for capturing text from both a document printed on paper and a document displayed on a dynamic display device
US20060104515A1 (en) * 2004-07-19 2006-05-18 King Martin T Automatic modification of WEB pages
US20060136629A1 (en) * 2004-08-18 2006-06-22 King Martin T Scanner having connected and unconnected operational behaviors
WO2008028674A2 (en) 2006-09-08 2008-03-13 Exbiblio B.V. Optical scanners, such as hand-held optical scanners
US9143638B2 (en) 2004-04-01 2015-09-22 Google Inc. Data capture from rendered documents using handheld device
US20060098900A1 (en) 2004-09-27 2006-05-11 King Martin T Secure data gathering from rendered documents
US8081849B2 (en) 2004-12-03 2011-12-20 Google Inc. Portable scanning and memory device
US7894670B2 (en) 2004-04-01 2011-02-22 Exbiblio B.V. Triggering actions in response to optically or acoustically capturing keywords from a rendered document
US7990556B2 (en) 2004-12-03 2011-08-02 Google Inc. Association of a portable scanner with input/output and storage devices
US9116890B2 (en) 2004-04-01 2015-08-25 Google Inc. Triggering actions in response to optically or acoustically capturing keywords from a rendered document
US8146156B2 (en) 2004-04-01 2012-03-27 Google Inc. Archive of text captures from rendered documents
US20060081714A1 (en) 2004-08-23 2006-04-20 King Martin T Portable scanning device
US9008447B2 (en) 2004-04-01 2015-04-14 Google Inc. Method and system for character recognition
US8713418B2 (en) 2004-04-12 2014-04-29 Google Inc. Adding value to a rendered document
US8489624B2 (en) 2004-05-17 2013-07-16 Google, Inc. Processing techniques for text capture from a rendered document
US8620083B2 (en) 2004-12-03 2013-12-31 Google Inc. Method and system for character recognition
US8874504B2 (en) 2004-12-03 2014-10-28 Google Inc. Processing techniques for visual capture data from a rendered document
KR101046586B1 (en) * 2004-05-28 2011-07-06 삼성전자주식회사 Display device and display system using same
US7461012B2 (en) * 2004-06-08 2008-12-02 Elbex Video Ltd. Method and apparatus for simplified e-commerce shopping via home shopping terminals
US8346620B2 (en) 2004-07-19 2013-01-01 Google Inc. Automatic modification of web pages
WO2006022706A2 (en) * 2004-08-10 2006-03-02 Thomson Licensing S.A. Broadband home information center
EP1810496A4 (en) * 2004-09-27 2013-05-29 Google Inc Secure data gathering from rendered documents
US7647617B2 (en) * 2004-11-16 2010-01-12 Integra5 Communications, Inc. Method for association between telephony and television network equipment
US8706501B2 (en) * 2004-12-09 2014-04-22 Nuance Communications, Inc. Method and system for sharing speech processing resources over a communication network
TWI287787B (en) * 2004-12-14 2007-10-01 Delta Electronics Inc A remote control device and method with speech control
US20060178916A1 (en) * 2005-02-07 2006-08-10 Dmitry Domnin Method for automating task with portable device
US7835505B2 (en) * 2005-05-13 2010-11-16 Microsoft Corporation Phone-to-monitor connection device
WO2007025119A2 (en) * 2005-08-26 2007-03-01 Veveo, Inc. User interface for visual cooperation between text input and display device
US7788266B2 (en) 2005-08-26 2010-08-31 Veveo, Inc. Method and system for processing ambiguous, multi-term search queries
JP2007128166A (en) * 2005-11-01 2007-05-24 Nec Corp Network system, server, client, program, web browsing function achieving method
US8014542B2 (en) 2005-11-04 2011-09-06 At&T Intellectual Property I, L.P. System and method of providing audio content
KR100715682B1 (en) * 2005-12-07 2007-05-09 한국전자통신연구원 Room agent apparatus for receiving wireless multimedia data and home network system using the same
US8352323B2 (en) * 2007-11-30 2013-01-08 Blaze Mobile, Inc. Conducting an online payment transaction using an NFC enabled mobile communication device
US7739280B2 (en) 2006-03-06 2010-06-15 Veveo, Inc. Methods and systems for selecting and presenting content based on user preference information extracted from an aggregate preference signature
US8095423B2 (en) * 2006-03-17 2012-01-10 Grant Allen Lee Nichols Interactive international bulk trade television
WO2007124436A2 (en) 2006-04-20 2007-11-01 Veveo, Inc. User interface methods and systems for selecting and presenting content based on relationships between the user and other members of an organization
US8144266B2 (en) * 2007-02-27 2012-03-27 Sony Corporation Module system for permitting storage device interface with TV
WO2008045690A2 (en) 2006-10-06 2008-04-17 Veveo, Inc. Linear character selection display interface for ambiguous text input
US20080103875A1 (en) * 2006-10-31 2008-05-01 Michael Kokernak Methods and systems for an interactive data finder
WO2008063987A2 (en) 2006-11-13 2008-05-29 Veveo, Inc. Method of and system for selecting and presenting content based on user identification
US20080167992A1 (en) * 2007-01-05 2008-07-10 Backchannelmedia Inc. Methods and systems for an accountable media advertising application
US9330529B2 (en) 2007-01-17 2016-05-03 Touchtunes Music Corporation Game terminal configured for interaction with jukebox device systems including same, and/or associated methods
US9171419B2 (en) 2007-01-17 2015-10-27 Touchtunes Music Corporation Coin operated entertainment system
KR20080086262A (en) * 2007-03-22 2008-09-25 삼성전자주식회사 Method and apparatus for sharing digital contents, and digital contents sharing system using the method
US20080262968A1 (en) * 2007-03-26 2008-10-23 Infosys Technologies Ltd. Software licensing control via mobile devices
US9953481B2 (en) 2007-03-26 2018-04-24 Touchtunes Music Corporation Jukebox with associated video server
US20100166394A1 (en) * 2007-04-12 2010-07-01 Masayasu Ariyoshi Merchandise purchasing system, recording/reproducing apparatus, and computer program
US8797465B2 (en) * 2007-05-08 2014-08-05 Sony Corporation Applications for remote control devices with added functionalities
US20080313574A1 (en) * 2007-05-25 2008-12-18 Veveo, Inc. System and method for search with reduced physical interaction requirements
WO2008148012A1 (en) * 2007-05-25 2008-12-04 Veveo, Inc. System and method for text disambiguation and context designation in incremental search
US8296294B2 (en) 2007-05-25 2012-10-23 Veveo, Inc. Method and system for unified searching across and within multiple documents
US8590028B2 (en) 2007-07-09 2013-11-19 Infosys Limited Content licensing and conditional access using a mobile device
HK1111566A2 (en) * 2007-07-20 2008-08-08 Pccw Hkt Datacom Services Ltd An iptv trading system and method
US20110035662A1 (en) 2009-02-18 2011-02-10 King Martin T Interacting with rendered documents using a multi-function mobile device, such as a mobile phone
US8332887B2 (en) 2008-01-10 2012-12-11 Touchtunes Music Corporation System and/or methods for distributing advertisements from a central advertisement network to a peripheral device via a local advertisement server
US10290006B2 (en) 2008-08-15 2019-05-14 Touchtunes Music Corporation Digital signage and gaming services to comply with federal and state alcohol and beverage laws and regulations
US20090125813A1 (en) * 2007-11-09 2009-05-14 Zhongnan Shen Method and system for processing multiple dialog sessions in parallel
JP4556994B2 (en) * 2007-12-07 2010-10-06 ソニー株式会社 Remote control device
US8051455B2 (en) 2007-12-12 2011-11-01 Backchannelmedia Inc. Systems and methods for providing a token registry and encoder
US20090217335A1 (en) * 2008-02-27 2009-08-27 Richard Sai Kit Wong Apparatus and methods for network access
US9135809B2 (en) 2008-06-20 2015-09-15 At&T Intellectual Property I, Lp Voice enabled remote control for a set-top box
US20090320076A1 (en) * 2008-06-20 2009-12-24 At&T Intellectual Property I, L.P. System and Method for Processing an Interactive Advertisement
US8849435B2 (en) 2008-07-09 2014-09-30 Touchtunes Music Corporation Digital downloading jukebox with revenue-enhancing features
US20100037252A1 (en) * 2008-08-06 2010-02-11 Ravikiran Pasupuleti Sureshbabu Secured-tele-micro-browser for enabling internet browsing on a television
BRPI0804100A2 (en) * 2008-09-30 2010-07-06 Tqtvd Software Ltda digital file manager and method for digital data management in a digital tv reception apparatus
US20100098074A1 (en) * 2008-10-22 2010-04-22 Backchannelmedia Inc. Systems and methods for providing a network link between broadcast content and content located on a computer network
US8160064B2 (en) 2008-10-22 2012-04-17 Backchannelmedia Inc. Systems and methods for providing a network link between broadcast content and content located on a computer network
US9094721B2 (en) 2008-10-22 2015-07-28 Rakuten, Inc. Systems and methods for providing a network link between broadcast content and content located on a computer network
CN101489068B (en) * 2009-01-19 2013-10-16 深圳市同洲电子股份有限公司 Background sound and key pressing sound playing method and system based on built-in brower
US8447066B2 (en) 2009-03-12 2013-05-21 Google Inc. Performing actions based on capturing information from rendered documents, such as documents under copyright
CN102349087B (en) 2009-03-12 2015-05-06 谷歌公司 Automatically providing content associated with captured information, such as information captured in real-time
CN102449658A (en) 2009-03-18 2012-05-09 踏途音乐公司 Entertainment server and associated social networking services
US10564804B2 (en) 2009-03-18 2020-02-18 Touchtunes Music Corporation Digital jukebox device with improved user interfaces, and associated methods
US10719149B2 (en) 2009-03-18 2020-07-21 Touchtunes Music Corporation Digital jukebox device with improved user interfaces, and associated methods
US9292166B2 (en) 2009-03-18 2016-03-22 Touchtunes Music Corporation Digital jukebox device with improved karaoke-related user interfaces, and associated methods
US9152139B2 (en) * 2009-06-16 2015-10-06 Control4 Corporation Automation Control of Electronic Devices
KR101196410B1 (en) * 2009-07-07 2012-11-01 삼성전자주식회사 Method for auto setting configuration of television according to installation type of television and television using the same
US9407973B2 (en) 2009-12-02 2016-08-02 At&T Intellectual Property I, L.P. System and method to identify an item depicted when media content is displayed
US9081799B2 (en) 2009-12-04 2015-07-14 Google Inc. Using gestalt information to identify locations in printed information
US9323784B2 (en) 2009-12-09 2016-04-26 Google Inc. Image search using text-based elements within the contents of images
US20110154404A1 (en) * 2009-12-17 2011-06-23 At & T Intellectual Property I, L.P. Systems and Methods to Provide Data Services for Concurrent Display with Media Content Items
CA3034363C (en) 2010-01-26 2021-04-06 Touchtunes Music Corporation Digital jukebox device with improved user interfaces, and associated methods
US20110191330A1 (en) 2010-02-04 2011-08-04 Veveo, Inc. Method of and System for Enhanced Content Discovery Based on Network and Device Access Behavior
GB2481992A (en) * 2010-07-13 2012-01-18 Sony Europe Ltd Updating text-to-speech converter for broadcast signal receiver
US8631089B1 (en) 2010-12-14 2014-01-14 Brilliance Publishing, Inc. Previewing audio data associated with an item
WO2012142303A2 (en) * 2011-04-12 2012-10-18 Murray Maria Remote control for portable electronic devices
US9013489B2 (en) 2011-06-06 2015-04-21 Microsoft Technology Licensing, Llc Generation of avatar reflecting player appearance
US9055323B2 (en) * 2011-07-22 2015-06-09 Norma Hill Touchscreen remote with audible alert, voice prompting, and backlight activation buttons
KR101767301B1 (en) 2011-09-09 2017-08-10 라쿠텐 인코포레이티드 Systems and methods for consumer control over interactive television exposure
CA2970057C (en) 2011-09-18 2023-08-01 Touchtunes Music Corporation Digital jukebox device with karaoke and/or photo booth features, and associated methods
US8826340B2 (en) * 2011-10-14 2014-09-02 Symbol Shifters, LLC Method for more efficient collecting of information
US11151224B2 (en) 2012-01-09 2021-10-19 Touchtunes Music Corporation Systems and/or methods for monitoring audio inputs to jukebox devices
US8489469B1 (en) * 2012-08-30 2013-07-16 Elbex Video Ltd. Method and structure for simplified coding of display pages for operating a closed circuit E-commerce
CN103096140A (en) * 2013-01-28 2013-05-08 山东浪潮齐鲁软件产业股份有限公司 Method for achieving tobacco industry ordering at digital television terminal
JP6223713B2 (en) * 2013-05-27 2017-11-01 株式会社東芝 Electronic device, method and program
CN203563160U (en) * 2013-11-15 2014-04-23 余必春 Interactive intelligent set top box
WO2015070070A1 (en) 2013-11-07 2015-05-14 Touchtunes Music Corporation Techniques for generating electronic menu graphical user interface layouts for use in connection with electronic devices
KR101632221B1 (en) * 2014-02-27 2016-07-01 엘지전자 주식회사 Digital device and method for processing service thereof
KR102378718B1 (en) 2014-03-25 2022-03-24 터치튠즈 뮤직 코포레이션 Digital jukebox device with improved user interfaces, and associated methods
US9766811B1 (en) * 2016-04-29 2017-09-19 Netapp, Inc. Flash-based storage warehouse apparatuses and methods thereof
US9857982B1 (en) 2016-04-29 2018-01-02 Netapp, Inc. Storage warehouse systems and methods thereof
KR101969222B1 (en) * 2017-08-25 2019-04-15 케이티하이텔 주식회사 Method for providing interactive shopping data broadcasting based on voice recognition
CN109936773A (en) * 2017-12-19 2019-06-25 展讯通信（上海）有限公司 Implementation method, device and the user terminal of video shopping
CN109361890A (en) * 2018-12-12 2019-02-19 达州市志向科技外包服务有限公司 A kind of video call system
TWI754489B (en) * 2020-12-14 2022-02-01 中華電信股份有限公司 Shopping service system and voice control shopping method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5138649A (en) * 1990-11-16 1992-08-11 General Instrument Corporation Portable telephone handset with remote control
US5247580A (en) * 1989-12-29 1993-09-21 Pioneer Electronic Corporation Voice-operated remote control system
US5850218A (en) * 1997-02-19 1998-12-15 Time Warner Entertainment Company L.P. Inter-active program guide with default selection control
US5901366A (en) * 1995-05-02 1999-05-04 Sony Corporation Program selection method and apparatus using cordless telephone set

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5319454A (en) * 1990-11-13 1994-06-07 Scientific-Atlanta, Inc. CATV system enabling access to premium (pay per view) program events by bar code data entry
US5249218A (en) 1992-04-06 1993-09-28 Spectrum Information Technologies, Inc. Programmable universal interface system
US5621456A (en) * 1993-06-22 1997-04-15 Apple Computer, Inc. Methods and apparatus for audio-visual interface for the display of multiple program categories
US5512935A (en) 1994-03-31 1996-04-30 At&T Corp. Apparatus and method for diplaying an alert to an individual personal computer user via the user's television connected to a cable television system
US5640193A (en) * 1994-08-15 1997-06-17 Lucent Technologies Inc. Multimedia service access by reading marks on an object
US5774859A (en) * 1995-01-03 1998-06-30 Scientific-Atlanta, Inc. Information system having a speech interface
US5636211A (en) 1995-08-15 1997-06-03 Motorola, Inc. Universal multimedia access device
US5721583A (en) * 1995-11-27 1998-02-24 Matsushita Electric Industrial Co., Ltd. Interactive television system for implementing electronic polling or providing user-requested services based on identification of users or of remote control apparatuses which are employed by respective users to communicate with the system
JP3384429B2 (en) * 1995-11-30 2003-03-10 ソニー株式会社 Remote input device and method
US5973756A (en) * 1996-02-06 1999-10-26 Fca Corporation IR Transmitter with integral magnetic-stripe ATM type credit card reader & method therefor
US5886691A (en) * 1996-07-24 1999-03-23 Sony Corporation Display control method for display having buttons representing selectable voting items in which only marks assigned to selected items continue to be displayed upon selection
US5732216A (en) 1996-10-02 1998-03-24 Internet Angles, Inc. Audio message exchange system
US6188985B1 (en) * 1997-01-06 2001-02-13 Texas Instruments Incorporated Wireless voice-activated device for control of a processor-based host system
US6130726A (en) * 1997-03-24 2000-10-10 Evolve Products, Inc. Program guide on a remote control display
US6304573B1 (en) * 1997-04-03 2001-10-16 At&T Corp. Method and apparatus for transmitting and receiving electronic voice messages
US6069567A (en) * 1997-11-25 2000-05-30 Vlsi Technology, Inc. Audio-recording remote control and method therefor
WO1999050826A1 (en) * 1998-03-30 1999-10-07 Andrea Electronics Corporation Remote control system for controlling key-press and speech actuated on-line applications

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5247580A (en) * 1989-12-29 1993-09-21 Pioneer Electronic Corporation Voice-operated remote control system
US5138649A (en) * 1990-11-16 1992-08-11 General Instrument Corporation Portable telephone handset with remote control
US5901366A (en) * 1995-05-02 1999-05-04 Sony Corporation Program selection method and apparatus using cordless telephone set
US5850218A (en) * 1997-02-19 1998-12-15 Time Warner Entertainment Company L.P. Inter-active program guide with default selection control

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002017625A1 (en) * 2000-08-21 2002-02-28 Koninklijke Philips Electronics N.V. A voice controlled remote control with downloadable set of voice commands
DE10128925A1 (en) * 2001-06-15 2002-12-19 Deutsche Telekom Ag Terminal and method for using various services offered over a telecommunications network
US7793327B2 (en) 2001-06-15 2010-09-07 Deutsche Telekom Ag Terminal device and method for using different services offered via a telecommunications network
JP2003044756A (en) * 2001-07-26 2003-02-14 Kenichi Omae On-line shopping method, shopping site, voice recognizing device and voice recognition supporting device
JP2003178272A (en) * 2001-12-11 2003-06-27 Sony Corp Electronic equipment and operation control method
JP2010205270A (en) * 2002-05-28 2010-09-16 Nokia Corp Device for providing tamper evident property to executable code stored in removable medium
JP2005527905A (en) * 2002-05-28 2005-09-15 シンビアン　リミテッド Tamper evident removable media for storing executable code
US8205094B2 (en) 2002-05-28 2012-06-19 Nokia Corporation Tamper evident removable media storing executable code
EP1739534A2 (en) * 2005-06-30 2007-01-03 Sony Corporation Graphical user interface device, operating input processing method, and two-way communication apparatus
EP1739534A3 (en) * 2005-06-30 2009-01-14 Sony Corporation Graphical user interface device, operating input processing method, and two-way communication apparatus
US7907709B2 (en) 2005-08-19 2011-03-15 Nexstep, Inc. Tethered digital butler consumer electronic master device and method
US9614964B2 (en) 2005-08-19 2017-04-04 Nextstep, Inc. Consumer electronic registration, control and support concierge device and method
EP1922857A4 (en) * 2005-08-19 2009-11-25 Robert Stepanian Tethered digital butler consumer electronic device and method
EP1922857A2 (en) * 2005-08-19 2008-05-21 Robert Stephanian Tethered digital butler consumer electronic device and method
US8494132B2 (en) 2005-08-19 2013-07-23 Nexstep, Inc. Tethered digital butler consumer electronic remote control device and method
US11778100B2 (en) 2005-08-19 2023-10-03 Nexstep, Inc. Consumer electronic registration, control and support concierge device and method
US8885802B2 (en) 2005-08-19 2014-11-11 Nexstep, Inc. Tethered digital butler consumer electronic remote control device and method
US10798244B2 (en) 2005-08-19 2020-10-06 Nexstep, Inc. Consumer electronic registration, control and support concierge device and method
US9866697B2 (en) 2005-08-19 2018-01-09 Nexstep, Inc. Consumer electronic registration, control and support concierge device and method
US7907710B2 (en) 2005-08-19 2011-03-15 Nexstep, Inc. Tethered digital butler consumer electronic remote control device and method
US9311394B2 (en) 2006-10-31 2016-04-12 Sony Corporation Speech recognition for internet video search and navigation
CN103235736A (en) * 2013-03-27 2013-08-07 四川长虹电器股份有限公司 Android-platform-based method and system for supporting virtual audio equipment
EP2945157A3 (en) * 2014-05-13 2015-12-09 Panasonic Intellectual Property Corporation of America Information provision method using voice recognition function and control method for device
CN105554284A (en) * 2015-12-22 2016-05-04 福建星网智慧科技股份有限公司 Method and system for improving Android mobile phone call tone quality

Also Published As

Publication number Publication date
JP2003529959A (en) 2003-10-07
GB0200160D0 (en) 2002-02-20
GB2368996A (en) 2002-05-15
US6543052B1 (en) 2003-04-01
GB2368996B (en) 2003-10-29

Similar Documents

Publication Publication Date Title
US6543052B1 (en) Internet shopping system utilizing set top box and voice recognition
US5561708A (en) Method and apparatus for interactive television through use of menu windows
US5504519A (en) Method and apparatus for printing coupons and the like
US5461667A (en) Apparatus and method for electronic device for information services
EP0569311B1 (en) Method and system communication establishment utilizing captured and processed visually perceptible data within a broadcast video signal
US5995592A (en) Portable telephone unit and indication adapter
US6512919B2 (en) Electronic shopping system utilizing a program downloadable wireless videophone
US6036086A (en) Apparatus and method for initiating a telephone transaction using a scanner
CN100469195C (en) Method of and system for providing programming information for programming device
US5905521A (en) Television system in a digital or analog network
US5640193A (en) Multimedia service access by reading marks on an object
US6762773B2 (en) System and method for providing a context-sensitive instructional user interface icon in an interactive television system
CN100403792C (en) Control device, control method, electric apparatus, control method of electric apparatus, electric apparatus system, control method of electric apparatus sysetem, and transmission medium
CA2347840C (en) Apparatus for transmitting program information, communicating system, method of transmitting program information, method of instructing program recording operation, and method of instructing program purchasing operation
US20030028872A1 (en) System and method for real-time non-participatory user recognition and content provisioning
JP2001333414A (en) Program information distributor and method and terminal and system relating thereto
JP2002515700A (en) Personal navigator system
CN101795241A (en) Bulletin board system, terminal device of bulletin board system, and server device of bulletin board system
JP2003052032A (en) Information distributing system, information distributing method, information supplying device, and information supplying method
JPH11514462A (en) Coupon issue tracking system for communication networks
WO2006080228A1 (en) Terminal device, optical read code information providing method, and optical read code generation method
JP3780811B2 (en) Electronic shopping system using wireless videophone
US7142842B2 (en) Hyperkey access to network-based services
WO2001017247A1 (en) Video transceiver
JP2002015151A (en) Transaction method and device using television and portable radio terminal

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): GB JP US

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
ENP Entry into the national phase

Ref country code: GB

Ref document number: 200200160

Kind code of ref document: A

Format of ref document f/p: F