WO2001074036A9 - Speech interactive information system - Google Patents

Speech interactive information system

Info

Publication number
WO2001074036A9
WO2001074036A9 PCT/US2001/009667 US0109667W WO0174036A9 WO 2001074036 A9 WO2001074036 A9 WO 2001074036A9 US 0109667 W US0109667 W US 0109667W WO 0174036 A9 WO0174036 A9 WO 0174036A9
Authority
WO
WIPO (PCT)
Prior art keywords
speech
business
information
data
user
Prior art date
Application number
PCT/US2001/009667
Other languages
French (fr)
Other versions
WO2001074036A3 (en
WO2001074036A2 (en
Inventor
Ahmet Alpdemir
Original Assignee
Ahmet Alpdemir
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ahmet Alpdemir filed Critical Ahmet Alpdemir
Priority to AU2001249464A priority Critical patent/AU2001249464A1/en
Publication of WO2001074036A2 publication Critical patent/WO2001074036A2/en
Publication of WO2001074036A3 publication Critical patent/WO2001074036A3/en
Publication of WO2001074036A9 publication Critical patent/WO2001074036A9/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/12Hotels or restaurants
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/42Systems providing special services or facilities to subscribers
    • H04M3/487Arrangements for providing information services, e.g. recorded voice services or time announcements
    • H04M3/493Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/42Systems providing special services or facilities to subscribers
    • H04M3/487Arrangements for providing information services, e.g. recorded voice services or time announcements
    • H04M3/493Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
    • H04M3/4931Directory assistance systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/42Systems providing special services or facilities to subscribers
    • H04M3/487Arrangements for providing information services, e.g. recorded voice services or time announcements
    • H04M3/493Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
    • H04M3/4936Speech interaction details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2201/00Electronic components, circuits, software, systems or apparatus used in telephone systems
    • H04M2201/60Medium conversion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2242/00Special services or facilities
    • H04M2242/30Determination of the location of a subscriber
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/42Systems providing special services or facilities to subscribers
    • H04M3/487Arrangements for providing information services, e.g. recorded voice services or time announcements
    • H04M3/4872Non-interactive information services
    • H04M3/4878Advertisement messages

Definitions

  • This invention pertains generally to voice-based or speech-based interactive electronic commerce, and more particularly to systems, methods, and methods of doing business for providing automated interactive information from a business or organization to a consumer in need of goods and/or services.
  • the invention pertains even more particularly to systems, methods, and methods of doing business for providing automated speech driven query and response with business or event self- promotion features relative to businesses and events over ordinary wired or wireless telephone systems, PC systems, Personal Data Assistants (PDAs), and other communication and information appliances and devices.
  • PDAs Personal Data Assistants
  • Locating business establishments such as for example a restaurant satisfying the particular need, has hereto for generally required access to printed directory listings, or more recently access to the World Wide Web using a personal computer.
  • the availability of such references is frequently quite limited at the time the consumer desires to avail themselves of particular goods or services. For example, an out-of-town visitor driving in their automobile and approaching San Francisco might decide to stop and have dinner in a fine Italian restaurant and more particularly might like to have dinner in a fine Italian restaurant located in the particular area of the city. That visitor would likely not have a printed directory in their automobile or mobile access to the internet to search for a restaurant satisfying their current need. Therefore, the visitor would likely either have to stop and asked for recommendations or drive around until a restaurant satisfying their needs had been located. This is clearly inefficient, and the visitor may not have the dining experienced a expected if the restaurant they happen to see well driving turns out to have poor quality food, poor service, or both.
  • speech-to-text conversion has generally been limited to word processing and or computer or control applications as the has required fairly substantial processing power and memory within a computer device.
  • speech to text conversion products made by Dragon Systems generally require an Intel Pentium II or III microprocessor running in excess of 450 MHz and 128 MB of memory. This technology is not available in conventional or mold will telephones at this time.
  • Text- to-speech conversion has been known but has not been utilized to provide an interactive interface between consumers and consumer information from telephone systems.
  • the invention provides a system, method, and business model for an information system and service having business self-promotion features.
  • the inventive business model is directed to a business in which consumers call into a service using an ordinary telephone, PC, PDA, or other information appliance, and make requests in plain speech for information and positive referrals on goods and/or services, and the service provides responses to the request in plain speech in real-time over the same telephone, PC, PDA, or other information appliance.
  • the business model may further include providing a facility for a business to communicate a self-promotion of the business to the requestor, as well as providing an audio promotional coupon (or other promotional item) to a requestor when the requestor completes a call to a business using the service.
  • the invention provides an operating model for a telephone- based audio-interfaced goods and services information and referral service having merchant self-promotion features, comprising: an information database provider storing merchant information; a merchant interface for inputting merchant information into the database and for retrieving and editing the information; and a consumer interface for inputting voice commands and data and for receiving merchant information and processed information from the database in response to the input voice commands and data.
  • the operating method may provide that the consumer interface comprises a telephone handset, and/or that the consumer also inputs non- voice commands and data from a keypad on the telephone handset.
  • the operating model may also provide that the telephone handset comprises a mobile telephone.
  • the invention provides a system comprising: a speech-to-text conversion engine converting speech-based input commands and data received from an external device over a communication link into text-based commands and data; a data base storing a plurality of data items; a database search engine searching the database for a particular data item in response to the text-based command and data; a text-to- speech conversion engine generating a speech-based representation of the particular data item identified in the database search; and a speech server for communicating the speech-based representation of the particular data item to the external device.
  • the invention provides audio coupons that operate as incentives for consumers to use the inventive system.
  • the invention provides system and methods for submitting and retrieving ratings for goods and/or services.
  • the invention also provides methods, computer software, and computer software program products that interoperate with the inventive systems and methods.
  • FIG. 1 is a diagrammatic illustration showing an exemplary embodiment of the inventive system.
  • FIG. 2 is a diagrammatic illustration showing an exemplary embodiment of speech server functionality.
  • FIG. 3 is a diagrammatic illustration showing an exemplary embodiment of a new business user (merchant) interaction with the inventive system.
  • FIG. 4 is a diagrammatic illustration showing an exemplary embodiment of an existing registered business user interaction with the inventive system.
  • FIG. 5 is a diagrammatic illustration showing an embodiment of a general consumer user interaction with the inventive system.
  • FIG. 6 is a diagrammatic illustration showing an exemplary implementation of the inventive directory service on the Web DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION
  • FIG. 1 shows the high level system architecture 102 and consumer user (or caller) 101 access points for a preferred embodiment of the invention.
  • a cellular phone 106 (or other wireless device), standard telephone 118, either an analog (POTS) or digital, can be connected to the architecture 102 using a standard telecommunication link 120, such as a standard telephone line 122, ISDN line 124, cable 126 or DSL line 128.
  • POTS analog
  • a standard telecommunication link 120 such as a standard telephone line 122, ISDN line 124, cable 126 or DSL line 128.
  • POTS analog
  • the incoming call 130 from the cellphone 106 or the telephone 118 goes through a PSTN 112 and telephone switch 114 and gets picked up by the Speech server 116, which is connected on one side 117 to the telephone switch 115, and on the other side 119 to a computer network 130 such as for example the Internet.
  • the user (or caller) 101 can access the information or data 132 that resides in a database 134 within the Information Center 136 and the Web Site 138 through interactive voice commands 140 and/or through keypad presses 142 on the caller ' s 101 device, such as on the cellular telephone 106 or standard wired telephone 118.
  • the caller's voice commands 140 are recognized and translated into one of the variations of Voice Extensible Markup Language (VXML, VoiceXML, or VOXML) commands 144 by the Speech Server 116 using a speech-to-text conversion engine 146 and once translated into VXML are used to retrieve the information 132 from the Information Center 136 database 134.
  • VXML Voice Extensible Markup Language
  • VoiceXML VoiceXML
  • VOXML Voice Extensible Markup Language
  • VXML is an extension or elaboration on the XML (Extensible Markup Language) standard known to workers in the art and not described in greater detail here .
  • Information concerning the VXML Forum is available on the world- wide- web at http ://www. vxmlforum. or g/ and Version 1.0 of the VoiceXML specification dated 07 March 2000 which is hereby incorporated by reference is available in Adobe Acrobat format at http ://www. vxmlfomm.org/specs/VoiceXML- 100.pdf .
  • Speech server 116 Once the data 132 is retrieved and transmitted back to the Speech Server 116, the text information from the data 132 is converted to speech using a text-to-speech conversion engine 148 within the speech server 116 and played back to the caller 101 using the caller's device 106, 118. Speech server 116 also generates and plays back (presents) pre-recorded or synthesized menu commands 150 to the caller.
  • the system architecture connects 102 the information database 134 to the Internet 130 (or other local or global network of computers and/or information appliances) which can also be accessed with a display device 152 such as a personal computer (PC) equipped with a modem 154 (wired or wireless), a smart phone 156, a PDA or palmtop device 158 or any computer or other information appliance or device that can be connected to the Internet (or other local or global network) with the ability to display standard Hypertext Markup Language (HTML) pages or other formats interpretable by the computer 152.
  • a display device 152 such as a personal computer (PC) equipped with a modem 154 (wired or wireless), a smart phone 156, a PDA or palmtop device 158 or any computer or other information appliance or device that can be connected to the Internet (or other local or global network) with the ability to display standard Hypertext Markup Language (HTML) pages or other formats interpretable by the computer 152.
  • HTML Hypertext Markup Language
  • inventive structure and method are not limited to these particular formats and/or protocols or to the versions of these protocols in existence at the time the invention was made as those workers having ordinary skill in the art will appreciate the capabilities and features provided by these formats and protocols may be provided in other ways and that future versions of these formats and protocols will also support the inventive structure and method.
  • Embodiments of the inventive system may desirably incorporate and utilize natural language speech recognition.
  • the user can naturally speak and the system interprets the user's speech to extract the request or inquiry.
  • The provides additional flexibility for a user as that user does not need to know any particular commands or request rules or syntax.
  • Natural speech processing and artificial intelligence are known in the art and not described in greater detail here.
  • FIG. 2 shows an embodiment of Speech Server 116 and its functional connectivity to receive a switched telephone call and to interact with the internet 130.
  • Speech Server 116 performs several tasks such as the task of providing a Network Interface 160 to the analog or digital phone network that provides the switched phone call 162, Automatic Speech Recognition (ASR) 146 or speech-to-text conversion (STT), Text-to-Speech conversion (TTS) 148, runs the application or application program 164 that control and manages the phone calls 162 and the Interactive Voice Response (IVR) 166.
  • IVR refers to the interactive voice response which is conventionally a menu driven response provided in response to an input.
  • the Speech Server 116 is a personal computer equipped with Dialogic Antares automatic speech recognition boards and other products . Information regarding the Dialogic Antares boards are available from Dialogic Corporation, 1515 Route Ten, Parsippany, NJ 07054-4596 USA and on their web site at http ://www. dialogic . com/products/indx_abp .htm.
  • the incoming call 162 is answered by a network interface card 160, such as for example a Dialogic network interface card (analog or digital) .
  • a prompt is played to the caller 101 over the caller' s device 106, 118 asking the caller to say the selected item 170 from the available selections on a voice or audio menu.
  • the application 164 passes the voice data to the auto speech recognition block 146, such as may be provided by a Dialogic AntaresTM board loaded with an Automatic Speech Recognition (ASR) software.
  • ASR Automatic Speech Recognition
  • ASR software is available from several sources, including for example from Lernout & Hauspie (L&H) (LERNOUT & HAUSPIE Burlington, MA, Phone: 1-781-203-5000, Fax: 1-781-238-0986, http://www.lhs.com) or Speech Works (SpeechWorks International, Inc., 695 Atlantic Avenue, Boston, MA 02111, Tel: 617.428.4444, Fax: 617.428.1122, http://www.speechworks.com).
  • a Dialogic Antares board-based automatic speech recognizer (speech-to-text) 146 translates the voice data into ASCII text (or another code or symbols) that identifies the spoken words and returns a text or other symbolic representation of the results to the application 164.
  • the application 164 accesses, via for example a T-l line or faster Internet connection, the database 134 of the Information Center 136.
  • Real-time (or near- real-time) active vocabularies are generated at run-time using the database's 134 ASCII text or symbols.
  • the application uses the ASCII text from the database 134, passes it to a second Antares board 148 running a text-to-speech (TTS) algorithm.
  • TTS text-to-speech
  • FIG. 3 shows an example of the general flow of new business user (new merchant) 201 interaction with the inventive system and method according to one embodiment of the invention.
  • a business user 201 is a user that is providing goods or services to consumers 101 where consumers also refer to the previous caller 101.
  • the business user is desirous of having their goods and services made available to consumers over the inventive system and in promoting their goods and services to consumers.
  • the business user 201 calls, and gets identified as a new business user utilizing a business user registration procedure (see FIG. 5) the business user 201 is asked to say certain business registration information 202, including for example their name 204, name of the business 206, phone number 208, credit card number 210, and/or other pertinent business information 210.
  • the system 102 compares the information provided by the new business user 201 with the information that resides in the database 134.
  • the database includes information regarding business so that the authenticity of the attempted registration can be verified with reasonable assurances. In the even that the information does not match, the system 102 may connect to other databases in an attempt to verify the authenticity or otherwise complete the registration. If the information matches, the user registration is completed.
  • the user is notified with a message providing the new business user with additional options or information, or to recommend trying to say the information again.
  • the new business user is prompted with the audio message "Sorry, but the information you have provided does not seem to be correct, say 'again' to start over. You can also hang up and call again, say 'help', or register at our web site www.Talk411.com”.
  • Voice recognition can be used (in conjunction with a previously stored authentic voice print of the business user) to authenticate the business user 201 in addition to or instead of the password 212 depending on the quality of the speech recognition technologies used and the quality of the line or other communication ling connecting the business user to the system at the time. So called "caller identification" available in some areas may also assist in verifying the identity of the business user where the business user would then be required to call from a registered telephone number.
  • the recorded short message is published 216 then he or she is requested to provide an additional longer message 218 that may be or include a special promotion 220, directions to the business location 222, or any other information 224 that will provide additional information to the callers.
  • Both of these short message 214 and long message 218 are available for playback to callers (see FIG. 4) and can also be viewed in text form by those who visit the web site 138 and look up that particular business.
  • the new business user can change either message 214, 218 completely over the phone, or edit it word by word on the PC connected to the web site (see FIG. 4)
  • the messages provided by the business may either be a representation of the business representatives own speech which is preferred so that the quality and character of the voice is maintained, or the message may be computer synthesized speech. The later being necessary if the business chooses to provide or later modify the message using text input on a computer. As maintaining original speech may be somewhat cumbersome, additional fees may be levied on the business for providing actual speech as compared to synthetic speech.
  • the business user may be able to select from a set of available synthesized voice types so that the voice, even though not provided by the business directly, provides the intended feeling or emotion associated with the business. For example, a restaurant may wish to convey the feeling of romance.
  • Procedure is executed when a determination is made that the business user calling is not a registered business user and a new account needs to be established. As illustrated in FIG. 4, the business user calls the decision is made as to whether the calling business user is a new user or in existing user. Once it is determined that a new account needs to be established, registration of the new business account proceeds as described above wherein the calling business user provides certain business registration information register the new account (Step 302). The registration information provided by the registering new business user must be verified before the new business user interaction can continue.
  • Step 306 If verification cannot be made, then the interaction is terminated (Step 306), otherwise the business user is prompted to record a short message (Step 308).
  • the business user can then approve the recorded short message 214 or change the recorded short message until the business user is satisfied with the recorded short message an approves it for publication (Step 310) at which time the short message is published in a voice form and in text form on web site 134 (Step 312).
  • Business user 201 is then prompted to optional record either no message, and long message 218, or sponsor message 219 (Step 314). Event that the business user to record no additional messages, the business user is thanked for providing the information (Step 334) and the interaction terminates (Step 336). If the business user chooses to record a long message than the business user records the long message (Step 316) and a given on opportunity to approve the recorded message or change that message until the business user is satisfied with the recorded long message (Step 318). The long message is published (Step 320) and the business user is again the given opportunity to learn about category sponsorship (Step 322).
  • Step 336 If the business user declines the opportunity to learn about category sponsorship, the business user is thanked for providing the information (Step 334) and the interaction terminates (Step 336).
  • the business user indicates a desire to learn about category sponsorship he or she is provided with the description of the sponsorship service (Step 324) and again asked if he or she wishes to subscribe to the category sponsorship service (Step 326).
  • a category sponsorship message is a message will come up when the caller requests businesses in a category without a specific business name in mind. Then the system will play back the message of the sponsors in that category in a pre-determined order, random order or a dynamically defined order (see explanation relative to the general user interaction of FIG. 5).
  • Step 336 If the business user declines the opportunity to subscribe, the business user is thanked for providing the information (Step 334) and the interaction terminates (Step 336). If the business user indicates a desire to subscribe, he or she is given opportunity to record a category sponsorship message (Step 328) and further opportunities to either approve or change the message until he or she is satisfied with the recorded category sponsor message (Step 330). The category sponsor message is then published (Step 332) and the business user is thanked for providing the information (Step 334) and the interaction terminates (Step 336). As illustrated in the flow chart diagram of FIG. 4, the procedures associated with the repeat business user interaction are substantially the same as, though not identical to, those just described for a new business user interaction.
  • the system receives the business user call and determines if it is a new user or an existing registered user (Step 352). If the system determines that it is a new business user, than the procedure already described relative to FIG. 3 is executed. However, if the system determines that an existing registered business user is calling into the system, it presumed step the existing business user wishes to make changes to one or more of the items of registration information or to one or more of the recorded messages (Step 354).
  • Step 356 If the business user decides after placing the call that he or she does not wish to make changes than the interaction terminates (Step 356), otherwise the business user is asked whether he or she wishes to change the s tune hort message, the long message, or the sponsor message (Step 358) and given opportunity to change one or more of these messages.
  • These messages are the Long, Short and Sponsor messages that he may have already input into the system via a phone or a personal computer of other information appliance.
  • the process for recording, changing, approving, and publishing each of these messages is the same as already described relative to FIG.3 , and the business user it is similar given additional opportunities to learn about, subscribe to, and record messages pertinent to additional services provided by the system.
  • additional steps can be introduced or some of the shown steps can be deleted from the interaction flow.
  • the Business User makes changes to the short message, he can be prompted to see whether he wants to make any changes to the long or the sponsor messages.
  • An example of the deletion of a step can be where the user is initially prompted to find out whether he wants to make changes and gets told that he can say anytime "make changes" and trigger the menu options.
  • the amount of consolidation largely depends on the speech recognition technologies employed and the key words chosen for the speech recognition vocabulary.
  • embodiments of the invention may largely or entirely eliminae the particular command and data extraction procedure set forth in the above described procedures and replace them in all or in part by a natural language recognition and extraction procedure that either listens to the user's request in free form speech and extracts commands and/or data from the user's speech, or extracts the commands and/or data in part and intelligently asks additional questions of the user for any added information.
  • the inventive system and method provide logic for conducting a dialog or conversation with the caller. Essentially the same or substantially the same information is exchanged between the user and the system but with a more flexible interface that is more familiar and enjoyable to the user.
  • FIG. 5 shows an exemplary embodiment of the General User interaction 402.
  • a greeting message 382 is played back (Step 404) such as "This is TALK411, your best source for local information” followed by a sponsor message 384, such as for example "brought to you by Dialsurf, bringing the web to your phone” (Step 406).
  • This sponsor message is typically a paid message by a sponsor.
  • the voice menu 386 is played back to the caller (Step 408), such as "Please say your selection: Restaurants, Lawyers, Auto dealers, etc.”.
  • Step 412 a request message
  • This criteria 388 is pre-determined and varies according to the type of business. In the case of restaurants for example, it may be "type of cuisine, city and zip code”. In case of lawyers, it may be for example "type of practice, city and zip code”.
  • the system will play back a number of business names pre-determined by the system (Step 418). These names can be picked from the database 134, in the requested category, in a pre-determined fashion, randomly or based on a dynamically changing criteria or some fixed set of rules.
  • the inventive system, method, and business model or operating method is applicable to a broad variety of business and merchant types including but not limited in any way to : restaurants, physicians and surgeons, auto parts, auto repair and service, pizza, auto dealers, department stores, attorneys/lawyers, dentists, hospitals, insurance, beauty salons, banks, plumbing contractors, florists, as well as many other types of businesses and services.
  • One example of pre-determined way is for the subscribed businesses to pay the corresponding fees to be included in the top category (Category #1), second category (Category #2), and the like for a specific time period.
  • An example of random procedure can be, as the name implies, based on a random number generator that picks a database record in the category requested.
  • An example of dynamically changing criteria is when users rate the businesses on a real time or periodic basis and which ever business is rated highest gets to be heard as the #1 (first named), #2 (next named), #3 (third named), and the like down a hierarchical list.
  • Step 454 the caller is invited to say the 'number of the menu selection' or to say 'more" (Step 454), if the caller responds with the number of the selection, the number and a short message is played back (Step 450) and he or she gets prompted with a questions such as "Say connect or 'more' for additional information" (Step 452). If the caller says "connect”, the caller is connected to the phone number that was found (Step 444). If the caller says "more” (Step 436) then the pre-recorded Long Message is played back (Step 438) with a question such as "Say connect or just hang up your phone” (Step 440).
  • Step 444 the caller gets connected to the phone number
  • Step 446 the service
  • different rules may be applied to permit the user to input different choices, however, in some situations it is desirable to have a user call in again when they have rethought their need rather than to tie up the connection for an extended period of time.
  • the caller responds by saying 'more', then additional pre-selections are played back to give the caller more and different choices (Step 456).
  • the caller may then either say the number of one of the new selections (Step 458) or terminate (Step 446).
  • the caller may be permitted to keep repeating the request for more choices until all choices available in the data base (or a predetermined number of such choices) have been presented to the caller. In either event, if the caller does not like or select one of the available choices, the call terminates (Step 446). If there is no match (Step 420), an answer such as "sorry, but we cannot find this category in our list, try again" is played back (Step 422). After a predetermined number of tries (for example, after two tries) if there is no match, the system will say something like "sorry, we could not find a business that matches your request, please call us again” (Step 424) and terminate the call (Step 426). If there is a close match, the system will play back the match to verify the request for further action (Step 428).
  • Step 450 the number and a short message is played back (Step 450) and he or she gets prompted with a questions such as "Say connect or 'more' for additional information"
  • Step 452 If the caller says “connect”, the caller is connected to the phone number that was found (Step 444). If the caller says “more” (Step 436) then the pre-recorded Long Message is played back (Step 438) with a question such as "Say connect or just hang up your phone” (Step 440). Based on the caller's selection, either the caller gets connected to the phone number (Step 444), or gets disconnected to the service (Step 446). If the caller says the name of a particular business instead (Step 448), then the phone number and the Short Message (refer to FIG.
  • Step 450 will be played back (Step 450) with an additional prompt (Step 452), such as "Say 'connect' or 'more' for additional business information (the Long Message per FIG.3).
  • Step 452 an additional prompt
  • the user will be prompted once more whether the connect or terminate the call (Step 440).
  • FIG. 6 shows the implementation of the Directory Service of the info center 136 on the Web 130, where the Web Server 471 serves VXML or HTML/XML pages 470, the LD AP Server (Lightweight Directory Access Protocol Server) 472 runs over TCP/IP and provides quick response to high volume lookup to the Database 473.
  • the Middleware 474 is the layer of software that integrates operations of the Web Server, LDAP Server, and the Database (or any additional software such as Transaction Server). LDAP Servers and operation are known in the art, and is described, for example as of 23 March 2000, at: ht ⁇ ://www.u ⁇ jich.edu/ ⁇ dirsvcv ldap/doc/guides/slapd/l.hln_.
  • An example of a Web Server for high volume application such as TALK411 is the Microsoft Internet Information Server (IIS).
  • Microsoft IIS runs on Windows NT Server.
  • LDAP also runs on Windows NT® 4.0 using Service Pack 4 or later, Windows® 2000, or Windows 95/98. All systems desirably have TCP/IP (or an equivalent capability) installed.
  • TCP/IP or an equivalent capability
  • one desirable promotional feature involves issuing an audio coupon to a consumer user of the inventive system.
  • a consumer user is issued an audio coupon entitling the user to a promotion.
  • a promotion would entitle the user to a discount to be applied to the item or service purchased when the consumer user connects using the inventive system and method.
  • This discount for example 10 percent off, would only be available to the consumer user when using the inventive TALK411 system and is therefore an enticement for a consumer user to use the inventive system rather than dealing with the business through conventional means.
  • Other promotions might involve a buy one get one free offer, of free drink with order of food type offer, or any other the other variety of promotional offers typically made in the retail trade between merchants and consumers.
  • the audio coupon may be provided in a variety of ways.
  • the business would become aware that the consumer user contacted the business using the inventive TALK411 system and automatically give the consumer user a discount (or other promotional item) when the your was placed.
  • the consumer user might be given a coupon code which could only be available to a consumer user who ate utilize the inventive system, and a consumer user would provide this code to the merchant upon connection.
  • This code might be generic to the business or particularized to that specific transaction. Therefore, in addition to be self promotion aspects of the business model, the optional use of audio coupons also provides considerable business advantages.
  • the system inserts a message to the merchant after the call has been connected to identify the caller as a valid service user and to validate the audio coupon.
  • the use of audio coupons is integrated with the world wide web or internet in that the audio coupons may be identified, stored to, retrieved from, or otherwise processed using the businesses or the inventive services web site.
  • the consumer user is not limited to using the coupon at the time it was earned, but may instead be collected for later redemption. This also affords an opportunity to obtain a printed copy of the coupon for use at any later time.
  • the audio coupon or a coupon derived from that coupon may be delivered to a personal data assistant (such as for example, an email enabled PALM VII) so that the PDA stores the coupon and serves as a medium for displaying the coupon the business, merchant, or organization.
  • a personal data assistant such as for example, an email enabled PALM VII
  • one aspect of the inventive system, method, and business model is to collect money or other revenue in what ever form for each coupon delivered. It is also advantageous to collect money or other revenue for each coupon redeemed either as a fixed amount per coupon or as a portion (such as a percentage) of the sale, or both. Collection of revenue for each coupon delivered is separate from collection of revenue for each redemption or sale.
  • the system has geographical context provided by a known location of the caller.
  • a known location of the caller For example, it is expected that mobile or cellular telephones will have capability to self locate, either using internal satellite-based Geographical Positioning System (GPS) means or by using various schemes known in the art for determining (or estimating) the location of a cellular telephone based on proximity to cellular base stations, hand-off s to base stations, and similar techniques.
  • GPS Geographical Positioning System
  • theinventive system provides for geographically-based recommendations, geographically-based promotions, as well as for geographically based audio coupon delivery.
  • the geographic proximity may be established according to some set of rules which may for example depend upon the density of business establishments in the local area.
  • the geographically directed audio coupons pertain to business within one to a few blocks of the callers location, in other embodiments to a mile or two, and in still other embodiments to the region of the city or town.
  • consumer user's who call into the inventive service will be able to rate the particular business after they have utilized the businesses goods or services. For example, a consumer user having been referred to a restaurant using inventive system can later call in using a toll-free or free local phone number and provide feedback, such as in the form of a rating, relative to their experience. These ratings would then be compiled and made available to the local businesses.
  • these ratings were also serve as an additional information source for consumer user's and would be available either or telephone or on Internet based website.
  • the business establishment having demonstrated a particularly high-level of goods or service based on these ratings would be placed into a category of highly rated businesses, such as "BayHits", would be available to the consumer user during his or her call into the system. So for example, when the user calls in to request "Italian restaurant in Palo Alto", if in one of the candidate restaurant played back to the caller happens to be a "BayHit" then that restaurant would be indemnified as such.
  • the caller might receive a message "II Fornaio - a BayHit".
  • consumer user may be able to request "BayHit Restaurants” and receive only a list of restaurants satisfying the BayHit criteria.
  • the rating or BayHit feature may be provided free to the businesses while in an alternative preferred embodiment businesses falling within the highly rated or "BayHit” category would be charged the nominal fee.
  • the ratings may alternatively or additionally be provided on an Internet website (such as http://www.bayhits.com so that information obtained from caller's using inventive system method would be available to other individuals and businesses as well.

Abstract

The invention provides a system (102), method, and business model for an information system and server having business self-promotion, audio coupon, ratings and other features. A business or organization in which consumers call into a service using an ordinary telephone, PC, PDA, or other information appliance, and make requests in plain speech for information for goods and/or services, and the service provides responses to the request in plain speech in real-time. Provides an operating model for a telephone-based audio-interfaced goods and services information and referral service having merchant self-promotion features, including database provider storing merchant information; an interface for inputting merchant information in the database and for retrieving and editing the information; and an interface for inputting voice commands and data and for receiving merchant information and processed information from the database in response to the input voice commands and data.

Description

SPEECH INTERACTIVE INFORMATION SYSTEM
Field of Invention
This invention pertains generally to voice-based or speech-based interactive electronic commerce, and more particularly to systems, methods, and methods of doing business for providing automated interactive information from a business or organization to a consumer in need of goods and/or services. The invention pertains even more particularly to systems, methods, and methods of doing business for providing automated speech driven query and response with business or event self- promotion features relative to businesses and events over ordinary wired or wireless telephone systems, PC systems, Personal Data Assistants (PDAs), and other communication and information appliances and devices.
BACKGROUND
Locating business establishments, such as for example a restaurant satisfying the particular need, has hereto for generally required access to printed directory listings, or more recently access to the World Wide Web using a personal computer. The availability of such references is frequently quite limited at the time the consumer desires to avail themselves of particular goods or services. For example, an out-of-town visitor driving in their automobile and approaching San Francisco might decide to stop and have dinner in a fine Italian restaurant and more particularly might like to have dinner in a fine Italian restaurant located in the particular area of the city. That visitor would likely not have a printed directory in their automobile or mobile access to the internet to search for a restaurant satisfying their current need. Therefore, the visitor would likely either have to stop and asked for recommendations or drive around until a restaurant satisfying their needs had been located. This is clearly inefficient, and the visitor may not have the dining experienced a expected if the restaurant they happen to see well driving turns out to have poor quality food, poor service, or both.
An analogous dilemma arises for other goods and services, whether provided to the local residents or to a visitor. Frequently information is not available to a consumer when he or she needs such information, and with the proliferation of a fast mobile lifestyle, there exists and need to provide such consumer information with readily available information appliances, such as conventional telephones, site other phones, or other pocket or mobile devices that can provide connectivity to a service at minimum cost. Frequently such device will have only sparse input/output capabilities. For example, a cellular telephone will typically have only a few display lines presenting text or symbolic data to a user, but has substantial audio input and audio output capability that can be used by the consumer.
Heretofore, speech-to-text conversion has generally been limited to word processing and or computer or control applications as the has required fairly substantial processing power and memory within a computer device. For example, speech to text conversion products made by Dragon Systems generally require an Intel Pentium II or III microprocessor running in excess of 450 MHz and 128 MB of memory. This technology is not available in conventional or mold will telephones at this time. Text- to-speech conversion has been known but has not been utilized to provide an interactive interface between consumers and consumer information from telephone systems.
Furthermore, even for systems which provided some degree of consumer information over the telephone, such systems have either not attempted to generate business revenues through their operation, or have been unsuccessful in generating significant revenue in this manner. In part the lack of revenue success has been due to a low level of business participation in such systems, the inability of a business to control or modify their message in response to short-term business needs or to sell promote their businesses, as well as the lack of a particular incentive for a consumer to par take all of the information offered by the service. In fact, there may frequently have been a cost associated access to conventional information and referral services by consumers, even if only by virtue of the directory assistance by local telephone service providers. Some conventional systems and methods have been limited to playback of recorded audio or audio playback corresponding to the content of web pages; but such systems have not integrated internet or web-based interactions with voice or telephone based information provision. Therefore, there remains a need for a method of doing business, an information and referral service providing easy access by businesses and consumers, as well as providing business self promotion and consumer feedback features that encourage use, generate revenues, and provide incentives for use by both businesses and consumers.
SUMMARY
The invention provides a system, method, and business model for an information system and service having business self-promotion features. In one aspect, the inventive business model is directed to a business in which consumers call into a service using an ordinary telephone, PC, PDA, or other information appliance, and make requests in plain speech for information and positive referrals on goods and/or services, and the service provides responses to the request in plain speech in real-time over the same telephone, PC, PDA, or other information appliance. The business model may further include providing a facility for a business to communicate a self-promotion of the business to the requestor, as well as providing an audio promotional coupon (or other promotional item) to a requestor when the requestor completes a call to a business using the service.
In another aspect, the invention provides an operating model for a telephone- based audio-interfaced goods and services information and referral service having merchant self-promotion features, comprising: an information database provider storing merchant information; a merchant interface for inputting merchant information into the database and for retrieving and editing the information; and a consumer interface for inputting voice commands and data and for receiving merchant information and processed information from the database in response to the input voice commands and data. The operating method may provide that the consumer interface comprises a telephone handset, and/or that the consumer also inputs non- voice commands and data from a keypad on the telephone handset. The operating model may also provide that the telephone handset comprises a mobile telephone. In another aspect, the invention provides a system comprising: a speech-to-text conversion engine converting speech-based input commands and data received from an external device over a communication link into text-based commands and data; a data base storing a plurality of data items; a database search engine searching the database for a particular data item in response to the text-based command and data; a text-to- speech conversion engine generating a speech-based representation of the particular data item identified in the database search; and a speech server for communicating the speech-based representation of the particular data item to the external device.
In another aspect the invention provides audio coupons that operate as incentives for consumers to use the inventive system. In still another aspect, the invention provides system and methods for submitting and retrieving ratings for goods and/or services.
The invention also provides methods, computer software, and computer software program products that interoperate with the inventive systems and methods.
BRIEF DESCRIPTION OF THE DRAWINGS
Additional advantages and features of the invention will become readily apparent upon reading the following detailed description and appended claims when taken in conjunction with reference to the following drawings, in which: FIG. 1 is a diagrammatic illustration showing an exemplary embodiment of the inventive system.
FIG. 2 is a diagrammatic illustration showing an exemplary embodiment of speech server functionality.
FIG. 3 is a diagrammatic illustration showing an exemplary embodiment of a new business user (merchant) interaction with the inventive system.
FIG. 4 is a diagrammatic illustration showing an exemplary embodiment of an existing registered business user interaction with the inventive system.
FIG. 5 is a diagrammatic illustration showing an embodiment of a general consumer user interaction with the inventive system. FIG. 6 is a diagrammatic illustration showing an exemplary implementation of the inventive directory service on the Web DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION
FIG. 1 shows the high level system architecture 102 and consumer user (or caller) 101 access points for a preferred embodiment of the invention. A cellular phone 106 (or other wireless device), standard telephone 118, either an analog (POTS) or digital, can be connected to the architecture 102 using a standard telecommunication link 120, such as a standard telephone line 122, ISDN line 124, cable 126 or DSL line 128. For a cellular phone 106, it is understood that there is a cellular base station 108 and a cellular switch 110 interposed between the cellular telephone 106 and the PSTN 112. The incoming call 130 from the cellphone 106 or the telephone 118 goes through a PSTN 112 and telephone switch 114 and gets picked up by the Speech server 116, which is connected on one side 117 to the telephone switch 115, and on the other side 119 to a computer network 130 such as for example the Internet.
The user (or caller) 101 can access the information or data 132 that resides in a database 134 within the Information Center 136 and the Web Site 138 through interactive voice commands 140 and/or through keypad presses 142 on the caller ' s 101 device, such as on the cellular telephone 106 or standard wired telephone 118. In a preferred embodiment of the invention, only the caller' s voice commands are used. The caller's voice commands 140 are recognized and translated into one of the variations of Voice Extensible Markup Language (VXML, VoiceXML, or VOXML) commands 144 by the Speech Server 116 using a speech-to-text conversion engine 146 and once translated into VXML are used to retrieve the information 132 from the Information Center 136 database 134. VXML is an extension or elaboration on the XML (Extensible Markup Language) standard known to workers in the art and not described in greater detail here . Information concerning the VXML Forum is available on the world- wide- web at http ://www. vxmlforum. or g/ and Version 1.0 of the VoiceXML specification dated 07 March 2000 which is hereby incorporated by reference is available in Adobe Acrobat format at http ://www. vxmlfomm.org/specs/VoiceXML- 100.pdf .
Once the data 132 is retrieved and transmitted back to the Speech Server 116, the text information from the data 132 is converted to speech using a text-to-speech conversion engine 148 within the speech server 116 and played back to the caller 101 using the caller's device 106, 118. Speech server 116 also generates and plays back (presents) pre-recorded or synthesized menu commands 150 to the caller. The system architecture connects 102 the information database 134 to the Internet 130 (or other local or global network of computers and/or information appliances) which can also be accessed with a display device 152 such as a personal computer (PC) equipped with a modem 154 (wired or wireless), a smart phone 156, a PDA or palmtop device 158 or any computer or other information appliance or device that can be connected to the Internet (or other local or global network) with the ability to display standard Hypertext Markup Language (HTML) pages or other formats interpretable by the computer 152. It is noted that although reference is made to several current industry standard data and information formats and protocols, such as HTML, XML, and VXML, the inventive structure and method are not limited to these particular formats and/or protocols or to the versions of these protocols in existence at the time the invention was made as those workers having ordinary skill in the art will appreciate the capabilities and features provided by these formats and protocols may be provided in other ways and that future versions of these formats and protocols will also support the inventive structure and method.
Embodiments of the inventive system may desirably incorporate and utilize natural language speech recognition. In such implementations, the user can naturally speak and the system interprets the user's speech to extract the request or inquiry. The provides additional flexibility for a user as that user does not need to know any particular commands or request rules or syntax. Natural speech processing and artificial intelligence are known in the art and not described in greater detail here.
FIG. 2 shows an embodiment of Speech Server 116 and its functional connectivity to receive a switched telephone call and to interact with the internet 130. Speech Server 116 performs several tasks such as the task of providing a Network Interface 160 to the analog or digital phone network that provides the switched phone call 162, Automatic Speech Recognition (ASR) 146 or speech-to-text conversion (STT), Text-to-Speech conversion (TTS) 148, runs the application or application program 164 that control and manages the phone calls 162 and the Interactive Voice Response (IVR) 166. IVR refers to the interactive voice response which is conventionally a menu driven response provided in response to an input. A user is asked to say something (for example, "Press or say 1 for marketing, press or say 2 for research", etc.) However, the inventors are not aware of any such conventional systems that provide ASR or text-to-speech in connection with IVR. In one embodiment of the invention, the Speech Server 116 is a personal computer equipped with Dialogic Antares automatic speech recognition boards and other products . Information regarding the Dialogic Antares boards are available from Dialogic Corporation, 1515 Route Ten, Parsippany, NJ 07054-4596 USA and on their web site at http ://www. dialogic . com/products/indx_abp .htm.
Operation of the exemplary Speech Server in the system is now described. The incoming call 162 is answered by a network interface card 160, such as for example a Dialogic network interface card (analog or digital) . A prompt is played to the caller 101 over the caller' s device 106, 118 asking the caller to say the selected item 170 from the available selections on a voice or audio menu. When the caller responds to the request, the application 164 passes the voice data to the auto speech recognition block 146, such as may be provided by a Dialogic Antares™ board loaded with an Automatic Speech Recognition (ASR) software. ASR software is available from several sources, including for example from Lernout & Hauspie (L&H) (LERNOUT & HAUSPIE Burlington, MA, Phone: 1-781-203-5000, Fax: 1-781-238-0986, http://www.lhs.com) or Speech Works (SpeechWorks International, Inc., 695 Atlantic Avenue, Boston, MA 02111, Tel: 617.428.4444, Fax: 617.428.1122, http://www.speechworks.com).
A Dialogic Antares board-based automatic speech recognizer (speech-to-text) 146 translates the voice data into ASCII text (or another code or symbols) that identifies the spoken words and returns a text or other symbolic representation of the results to the application 164. The application 164 accesses, via for example a T-l line or faster Internet connection, the database 134 of the Information Center 136. Real-time (or near- real-time), active vocabularies are generated at run-time using the database's 134 ASCII text or symbols. The application uses the ASCII text from the database 134, passes it to a second Antares board 148 running a text-to-speech (TTS) algorithm. The TTS algorithm generates the final voice or audio information that is played to the caller 101.
FIG. 3 shows an example of the general flow of new business user (new merchant) 201 interaction with the inventive system and method according to one embodiment of the invention. A business user 201 is a user that is providing goods or services to consumers 101 where consumers also refer to the previous caller 101. The business user is desirous of having their goods and services made available to consumers over the inventive system and in promoting their goods and services to consumers.
Once the business user 201 calls, and gets identified as a new business user utilizing a business user registration procedure (see FIG. 5) the business user 201 is asked to say certain business registration information 202, including for example their name 204, name of the business 206, phone number 208, credit card number 210, and/or other pertinent business information 210. Once the registration information 202 is obtained, the system 102 compares the information provided by the new business user 201 with the information that resides in the database 134. The database includes information regarding business so that the authenticity of the attempted registration can be verified with reasonable assurances. In the even that the information does not match, the system 102 may connect to other databases in an attempt to verify the authenticity or otherwise complete the registration. If the information matches, the user registration is completed. If the information does not match, the user is notified with a message providing the new business user with additional options or information, or to recommend trying to say the information again. For example, in one embodiment of the invention, the new business user is prompted with the audio message "Sorry, but the information you have provided does not seem to be correct, say 'again' to start over. You can also hang up and call again, say 'help', or register at our web site www.Talk411.com".
Once the new business user 201 is registered and a password 212 is issued to the business user, then he or she is requested to record a short message 214 that will be heard by the callers 101 who request the business user's phone number 216. Voice recognition can be used (in conjunction with a previously stored authentic voice print of the business user) to authenticate the business user 201 in addition to or instead of the password 212 depending on the quality of the speech recognition technologies used and the quality of the line or other communication ling connecting the business user to the system at the time. So called "caller identification" available in some areas may also assist in verifying the identity of the business user where the business user would then be required to call from a registered telephone number.
Once the business user approves the short message 214 just recorded, the recorded short message is published 216 then he or she is requested to provide an additional longer message 218 that may be or include a special promotion 220, directions to the business location 222, or any other information 224 that will provide additional information to the callers. Both of these short message 214 and long message 218 are available for playback to callers (see FIG. 4) and can also be viewed in text form by those who visit the web site 138 and look up that particular business. The new business user can change either message 214, 218 completely over the phone, or edit it word by word on the PC connected to the web site (see FIG. 4)
In is noted that the messages provided by the business may either be a representation of the business representatives own speech which is preferred so that the quality and character of the voice is maintained, or the message may be computer synthesized speech. The later being necessary if the business chooses to provide or later modify the message using text input on a computer. As maintaining original speech may be somewhat cumbersome, additional fees may be levied on the business for providing actual speech as compared to synthetic speech. Alternatively, the business user may be able to select from a set of available synthesized voice types so that the voice, even though not provided by the business directly, provides the intended feeling or emotion associated with the business. For example, a restaurant may wish to convey the feeling of romance.
Having described the general operation of the system during a new business interaction, we now describe one particular exemplary embodiment of the new business interaction procedure relative to the flow chart in FIG. 3. Procedure is executed when a determination is made that the business user calling is not a registered business user and a new account needs to be established. As illustrated in FIG. 4, the business user calls the decision is made as to whether the calling business user is a new user or in existing user. Once it is determined that a new account needs to be established, registration of the new business account proceeds as described above wherein the calling business user provides certain business registration information register the new account (Step 302). The registration information provided by the registering new business user must be verified before the new business user interaction can continue. If verification cannot be made, then the interaction is terminated (Step 306), otherwise the business user is prompted to record a short message (Step 308). The business user can then approve the recorded short message 214 or change the recorded short message until the business user is satisfied with the recorded short message an approves it for publication (Step 310) at which time the short message is published in a voice form and in text form on web site 134 (Step 312).
Business user 201 is then prompted to optional record either no message, and long message 218, or sponsor message 219 (Step 314). Event that the business user to record no additional messages, the business user is thanked for providing the information (Step 334) and the interaction terminates (Step 336). If the business user chooses to record a long message than the business user records the long message (Step 316) and a given on opportunity to approve the recorded message or change that message until the business user is satisfied with the recorded long message (Step 318). The long message is published (Step 320) and the business user is again the given opportunity to learn about category sponsorship (Step 322). If the business user declines the opportunity to learn about category sponsorship, the business user is thanked for providing the information (Step 334) and the interaction terminates (Step 336). On the other hand, if the business user indicates a desire to learn about category sponsorship he or she is provided with the description of the sponsorship service (Step 324) and again asked if he or she wishes to subscribe to the category sponsorship service (Step 326). A category sponsorship message is a message will come up when the caller requests businesses in a category without a specific business name in mind. Then the system will play back the message of the sponsors in that category in a pre-determined order, random order or a dynamically defined order (see explanation relative to the general user interaction of FIG. 5). If the business user declines the opportunity to subscribe, the business user is thanked for providing the information (Step 334) and the interaction terminates (Step 336). If the business user indicates a desire to subscribe, he or she is given opportunity to record a category sponsorship message (Step 328) and further opportunities to either approve or change the message until he or she is satisfied with the recorded category sponsor message (Step 330). The category sponsor message is then published (Step 332) and the business user is thanked for providing the information (Step 334) and the interaction terminates (Step 336). As illustrated in the flow chart diagram of FIG. 4, the procedures associated with the repeat business user interaction are substantially the same as, though not identical to, those just described for a new business user interaction. The differences primarily concerned how the initial phase of the business user call to the system is handled. For in existing registered business user interaction, the system receives the business user call and determines if it is a new user or an existing registered user (Step 352). If the system determines that it is a new business user, than the procedure already described relative to FIG. 3 is executed. However, if the system determines that an existing registered business user is calling into the system, it presumed step the existing business user wishes to make changes to one or more of the items of registration information or to one or more of the recorded messages (Step 354). If the business user decides after placing the call that he or she does not wish to make changes than the interaction terminates (Step 356), otherwise the business user is asked whether he or she wishes to change the s tune hort message, the long message, or the sponsor message (Step 358) and given opportunity to change one or more of these messages. These messages are the Long, Short and Sponsor messages that he may have already input into the system via a phone or a personal computer of other information appliance. The process for recording, changing, approving, and publishing each of these messages is the same as already described relative to FIG.3 , and the business user it is similar given additional opportunities to learn about, subscribe to, and record messages pertinent to additional services provided by the system.
In order to make the user interface more satisfactory, additional steps can be introduced or some of the shown steps can be deleted from the interaction flow. For example, after the Business User makes changes to the short message, he can be prompted to see whether he wants to make any changes to the long or the sponsor messages. An example of the deletion of a step can be where the user is initially prompted to find out whether he wants to make changes and gets told that he can say anytime "make changes" and trigger the menu options. The amount of consolidation largely depends on the speech recognition technologies employed and the key words chosen for the speech recognition vocabulary.
In addition, other embodiments of the invention may largely or entirely eliminae the particular command and data extraction procedure set forth in the above described procedures and replace them in all or in part by a natural language recognition and extraction procedure that either listens to the user's request in free form speech and extracts commands and/or data from the user's speech, or extracts the commands and/or data in part and intelligently asks additional questions of the user for any added information. In this sense, the inventive system and method provide logic for conducting a dialog or conversation with the caller. Essentially the same or substantially the same information is exchanged between the user and the system but with a more flexible interface that is more familiar and enjoyable to the user.
Those workers having ordinary skill in the art in light of the description provided here will appreciate that the procedures described for existing registered users as well as for new business users may be modified to provide somewhat different options at each stage all the interaction or to provide different ordering of the options. Therefore, the interaction described here are merely exemplary of the type of business user to system interaction desirable in an implemented system, but does not limit the inventive system or method to these particular interaction schemes or procedures.
FIG. 5 shows an exemplary embodiment of the General User interaction 402. Once the consumer user 101 calls, a greeting message 382 is played back (Step 404) such as "This is TALK411, your best source for local information" followed by a sponsor message 384, such as for example "brought to you by Dialsurf, bringing the web to your phone" (Step 406). This sponsor message is typically a paid message by a sponsor. Then the voice menu 386 is played back to the caller (Step 408), such as "Please say your selection: Restaurants, Lawyers, Auto dealers, etc.". Once the consumer user says one of the menu items (Step 410), then he or she is prompted with a request message (Step 412), such as "Say the name of the business or say 'select'".
If the consumer user 101 says "select" or another word that indicates to the system that he or she (the consumer user) should be prompted with a list of pre-selected business names, he or she is prompted with a request to specify selection criteria (Step 414). This criteria 388 is pre-determined and varies according to the type of business. In the case of restaurants for example, it may be "type of cuisine, city and zip code". In case of lawyers, it may be for example "type of practice, city and zip code". Once the user says the criteria 388, then the system 102 tries to match the requested category or criteria 388 to the closest category or criteria stored in the database 134. If the match is good (according to some predefined rules or decision algorithm or procedure), then the system will play back a number of business names pre-determined by the system (Step 418). These names can be picked from the database 134, in the requested category, in a pre-determined fashion, randomly or based on a dynamically changing criteria or some fixed set of rules.
The inventive system, method, and business model or operating method is applicable to a broad variety of business and merchant types including but not limited in any way to : restaurants, physicians and surgeons, auto parts, auto repair and service, pizza, auto dealers, department stores, attorneys/lawyers, dentists, hospitals, insurance, beauty salons, banks, plumbing contractors, florists, as well as many other types of businesses and services.
One example of pre-determined way is for the subscribed businesses to pay the corresponding fees to be included in the top category (Category #1), second category (Category #2), and the like for a specific time period. An example of random procedure can be, as the name implies, based on a random number generator that picks a database record in the category requested. An example of dynamically changing criteria is when users rate the businesses on a real time or periodic basis and which ever business is rated highest gets to be heard as the #1 (first named), #2 (next named), #3 (third named), and the like down a hierarchical list.
After the pre-selections are played back, the caller is invited to say the 'number of the menu selection' or to say 'more" (Step 454), if the caller responds with the number of the selection, the number and a short message is played back (Step 450) and he or she gets prompted with a questions such as "Say connect or 'more' for additional information" (Step 452). If the caller says "connect", the caller is connected to the phone number that was found (Step 444). If the caller says "more" (Step 436) then the pre-recorded Long Message is played back (Step 438) with a question such as "Say connect or just hang up your phone" (Step 440). Based on the caller's selection, either the caller gets connected to the phone number (Step 444), or gets disconnected to the service (Step 446). Of course, different rules may be applied to permit the user to input different choices, however, in some situations it is desirable to have a user call in again when they have rethought their need rather than to tie up the connection for an extended period of time. If the caller responds by saying 'more', then additional pre-selections are played back to give the caller more and different choices (Step 456). The caller may then either say the number of one of the new selections (Step 458) or terminate (Step 446). In some instances, the caller may be permitted to keep repeating the request for more choices until all choices available in the data base (or a predetermined number of such choices) have been presented to the caller. In either event, if the caller does not like or select one of the available choices, the call terminates (Step 446). If there is no match (Step 420), an answer such as "sorry, but we cannot find this category in our list, try again" is played back (Step 422). After a predetermined number of tries (for example, after two tries) if there is no match, the system will say something like "sorry, we could not find a business that matches your request, please call us again" (Step 424) and terminate the call (Step 426). If there is a close match, the system will play back the match to verify the request for further action (Step 428).
Once the caller chooses the business by saying its name or menu number (Step
430), the number and a short message is played back (Step 450) and he or she gets prompted with a questions such as "Say connect or 'more' for additional information"
(Step 452). If the caller says "connect", the caller is connected to the phone number that was found (Step 444). If the caller says "more" (Step 436) then the pre-recorded Long Message is played back (Step 438) with a question such as "Say connect or just hang up your phone" (Step 440). Based on the caller's selection, either the caller gets connected to the phone number (Step 444), or gets disconnected to the service (Step 446). If the caller says the name of a particular business instead (Step 448), then the phone number and the Short Message (refer to FIG. 3) will be played back (Step 450) with an additional prompt (Step 452), such as "Say 'connect' or 'more' for additional business information (the Long Message per FIG.3). Once the Long Message is played back (Step 438), the user will be prompted once more whether the connect or terminate the call (Step 440).
FIG. 6 shows the implementation of the Directory Service of the info center 136 on the Web 130, where the Web Server 471 serves VXML or HTML/XML pages 470, the LD AP Server (Lightweight Directory Access Protocol Server) 472 runs over TCP/IP and provides quick response to high volume lookup to the Database 473. The Middleware 474 is the layer of software that integrates operations of the Web Server, LDAP Server, and the Database (or any additional software such as Transaction Server). LDAP Servers and operation are known in the art, and is described, for example as of 23 March 2000, at: htψ://www.uπjich.edu/~dirsvcv ldap/doc/guides/slapd/l.hln_. An example of a Web Server for high volume application such as TALK411 is the Microsoft Internet Information Server (IIS). Microsoft IIS runs on Windows NT Server. LDAP also runs on Windows NT® 4.0 using Service Pack 4 or later, Windows® 2000, or Windows 95/98. All systems desirably have TCP/IP (or an equivalent capability) installed. Additional information relative to Microsoft products, including Microsoft IIS is available on their website as of 23 March 2000 at http://msdn.microsoft.con-ι isapi/msdnlib.idc?theURL=/librarv/psdl /ldap/ld about 7euh.htm
Other optional but desirable features may also be provided. For example, one desirable promotional feature involves issuing an audio coupon to a consumer user of the inventive system. In one embodiment, a consumer user is issued an audio coupon entitling the user to a promotion. Typically, such promotion would entitle the user to a discount to be applied to the item or service purchased when the consumer user connects using the inventive system and method. This discount, for example 10 percent off, would only be available to the consumer user when using the inventive TALK411 system and is therefore an enticement for a consumer user to use the inventive system rather than dealing with the business through conventional means. Other promotions might involve a buy one get one free offer, of free drink with order of food type offer, or any other the other variety of promotional offers typically made in the retail trade between merchants and consumers.
The audio coupon may be provided in a variety of ways. For example, the business would become aware that the consumer user contacted the business using the inventive TALK411 system and automatically give the consumer user a discount (or other promotional item) when the your was placed. Alternatively, the consumer user might be given a coupon code which could only be available to a consumer user who ate utilize the inventive system, and a consumer user would provide this code to the merchant upon connection. This code might be generic to the business or particularized to that specific transaction. Therefore, in addition to be self promotion aspects of the business model, the optional use of audio coupons also provides considerable business advantages. In one embodiment of the invention, the system inserts a message to the merchant after the call has been connected to identify the caller as a valid service user and to validate the audio coupon.
In a preferred embodiment, the use of audio coupons is integrated with the world wide web or internet in that the audio coupons may be identified, stored to, retrieved from, or otherwise processed using the businesses or the inventive services web site. In this way, the consumer user is not limited to using the coupon at the time it was earned, but may instead be collected for later redemption. This also affords an opportunity to obtain a printed copy of the coupon for use at any later time.
In yet another embodiment, the audio coupon or a coupon derived from that coupon may be delivered to a personal data assistant (such as for example, an email enabled PALM VII) so that the PDA stores the coupon and serves as a medium for displaying the coupon the business, merchant, or organization.
Independent of how the coupon is delivered, one aspect of the inventive system, method, and business model is to collect money or other revenue in what ever form for each coupon delivered. It is also advantageous to collect money or other revenue for each coupon redeemed either as a fixed amount per coupon or as a portion (such as a percentage) of the sale, or both. Collection of revenue for each coupon delivered is separate from collection of revenue for each redemption or sale.
In a further embodiment, the system has geographical context provided by a known location of the caller. For example, it is expected that mobile or cellular telephones will have capability to self locate, either using internal satellite-based Geographical Positioning System (GPS) means or by using various schemes known in the art for determining (or estimating) the location of a cellular telephone based on proximity to cellular base stations, hand-off s to base stations, and similar techniques. In any event, theinventive system provides for geographically-based recommendations, geographically-based promotions, as well as for geographically based audio coupon delivery. Here the geographic proximity may be established according to some set of rules which may for example depend upon the density of business establishments in the local area. However, in one embodiment the geographically directed audio coupons pertain to business within one to a few blocks of the callers location, in other embodiments to a mile or two, and in still other embodiments to the region of the city or town. In yet another optional feature, consumer user's who call into the inventive service will be able to rate the particular business after they have utilized the businesses goods or services. For example, a consumer user having been referred to a restaurant using inventive system can later call in using a toll-free or free local phone number and provide feedback, such as in the form of a rating, relative to their experience. These ratings would then be compiled and made available to the local businesses. Hopefully such feedback would encourage the businesses to either maintain their high quality of service or to improve the quality of their service and/or goods in response to the consumer user's rating. In another embodiment, these ratings were also serve as an additional information source for consumer user's and would be available either or telephone or on Internet based website. The business establishment having demonstrated a particularly high-level of goods or service based on these ratings would be placed into a category of highly rated businesses, such as "BayHits", would be available to the consumer user during his or her call into the system. So for example, when the user calls in to request "Italian restaurant in Palo Alto", if in one of the candidate restaurant played back to the caller happens to be a "BayHit" then that restaurant would be indemnified as such. For example, the caller might receive a message "II Fornaio - a BayHit". Alternatively, consumer user may be able to request "BayHit Restaurants" and receive only a list of restaurants satisfying the BayHit criteria. In some embodiment of the invention, the rating or BayHit feature may be provided free to the businesses while in an alternative preferred embodiment businesses falling within the highly rated or "BayHit" category would be charged the nominal fee. Those workers having ordinary skill in the art in light of description provided here will appreciate that this rating and promotion scheme may be implement in a variety of ways and that the particular descriptions provided here are merely exemplary of the more general method. The ratings may alternatively or additionally be provided on an Internet website (such as http://www.bayhits.com so that information obtained from caller's using inventive system method would be available to other individuals and businesses as well. Some of the steps in this procedure can be changed, left out, or combined to make the user interaction to be a satisfying experience as will readily be understood by workers having ordinary skill in the art in light of the description provided here. The foregoing descriptions of specific embodiments of the present invention have been presented for purposes of illustration and description. They are not intended to be exhaustive or to limit the invention to the precise forms disclosed, and obviously many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and its practical application, to thereby enable others skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the claims appended hereto and their equivalents. All publications and patent applications cited in this specification are herein incorporated by reference as if each individual publication or patent application were specifically and individually indicated to be incorporated by reference.

Claims

1. An operating model for a telephone-based audio-interfaced goods and services information and referral service having merchant self-promotion features, comprising: an information database provider storing merchant information; a merchant interface for inputting merchant information into said database and for retrieving and editing said information; and a consumer interface for inputting voice commands and data and for receiving merchant information and processed information from said database in response to said input voice commands and data.
2. The operating method in claim 1, wherein said consumer interface comprises a telephone handset.
3. The operating model in claim 2, wherein said consumer also inputs non- voice commands and data from a keypad on said telephone handset.
4. The operating model in claim 2, wherein said telephone handset comprises a mobile telephone.
5. A system comprising: a speech-to-text conversion engine converting speech-based input commands and data received from an external device over a communication link into text-based commands and data; a data base storing a plurality of data items; a database search engine searching the database for a particular data item in response to said text-based command and data; a text-to-speech conversion engine generating a speech-based representation of said particular data item identified in said database search; and a speech server for communicating said speech-based representation of said particular data item to said external device.
6. The system in claim 5, further comprising the external device, wherein said external device comprises a voice/speech input device.
7. The system in claim 5, further comprising the external device, wherein said external device comprises a telephone.
8. The system in claim 5, further comprising the external device, wherein said external device comprises a device selected from the group consisting of a personal computer, notebook computer, personal data assistant (PDA), information appliance, or combination thereof.
9. The system in claim 5 , wherein said communication link comprises the internet.
10. The system in claim 5, further comprising means for communicating and validating a promotional audio coupon.
11. The system in claim 5, further comprising means for receiving rating inputs from users and for providing processed ratings inputs to consumers.
12. A business model for a business in which consumers call into a service using an ordinary telephone and make requests in plain speech for information and positive referrals on goods and/or services, and the service provides responses to the request in plain speech in real-time over the same telephone.
13. The business model in claim 12, further including providing a facility for a business to communicate a self-promotion of the business to the requestor.
14. The business model in claim 12, further including providing an audio promotional coupon to a requestor when the requestor completes a call to a business using the service.
15. The business model in claim 12, further including providing an audio promotional coupon to a requestor when the requestor completes a call to a business using the service.
16. A method comprising: receiving a speech utterance from a user from a communication device; converting the speech utterance to text and extracting commands and optional data from said converted text; searching a database for a particular data item in response to said text-based command and data; generating a speech-based representation of said particular data item identified in said database search; and serving said speech-based representation of said particular data item to said communication device.
17. The method in claim 16, wherein said communication device comprises a voice/speech input device.
18. The method in claim 16, further comprising communicating and validating a promotional audio coupon to the user at the time said speech-based representation is served to said communication device.
19. The method in claim 16, further comprising receiving rating inputs from users and for providing processed ratings users in response to said speech utterances..
20. The method in claim 16, wherein said received speech utterance comprises natural human speech, and said converting comprises natural language speech processing to extract said commands and data.
PCT/US2001/009667 2000-03-24 2001-03-26 Speech interactive information system WO2001074036A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2001249464A AU2001249464A1 (en) 2000-03-24 2001-03-26 Speech interactive information system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/534,700 US6658389B1 (en) 2000-03-24 2000-03-24 System, method, and business model for speech-interactive information system having business self-promotion, audio coupon and rating features
US09/534,700 2000-03-24

Publications (3)

Publication Number Publication Date
WO2001074036A2 WO2001074036A2 (en) 2001-10-04
WO2001074036A3 WO2001074036A3 (en) 2002-02-14
WO2001074036A9 true WO2001074036A9 (en) 2002-12-19

Family

ID=24131160

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/009667 WO2001074036A2 (en) 2000-03-24 2001-03-26 Speech interactive information system

Country Status (3)

Country Link
US (1) US6658389B1 (en)
AU (1) AU2001249464A1 (en)
WO (1) WO2001074036A2 (en)

Families Citing this family (288)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6985943B2 (en) 1998-09-11 2006-01-10 Genesys Telecommunications Laboratories, Inc. Method and apparatus for extended management of state and interaction of a remote knowledge worker from a contact center
USRE46528E1 (en) 1997-11-14 2017-08-29 Genesys Telecommunications Laboratories, Inc. Implementation of call-center outbound dialing capability at a telephony network level
US6779358B2 (en) * 1997-12-30 2004-08-24 International Water Makers, Inc. Water collection and dispensing machine
US6131811A (en) 1998-05-29 2000-10-17 E-Micro Corporation Wallet consolidator
US6405159B2 (en) * 1998-06-03 2002-06-11 Sbc Technology Resources, Inc. Method for categorizing, describing and modeling types of system users
US6223165B1 (en) 1999-03-22 2001-04-24 Keen.Com, Incorporated Method and apparatus to connect consumer to expert
US7716080B2 (en) * 1999-06-23 2010-05-11 Signature Systems, Llc Method and system for using multi-function cards for storing, managing and aggregating reward points
US8271316B2 (en) 1999-12-17 2012-09-18 Buzzmetrics Ltd Consumer to business data capturing system
NZ520441A (en) * 2000-01-31 2005-12-23 Grape Technology Group Inc Communication assistance system and method
US8645137B2 (en) 2000-03-16 2014-02-04 Apple Inc. Fast, language-independent method for user authentication by voice
US20030125958A1 (en) * 2001-06-19 2003-07-03 Ahmet Alpdemir Voice-interactive marketplace providing time and money saving benefits and real-time promotion publishing and feedback
US6934684B2 (en) 2000-03-24 2005-08-23 Dialsurf, Inc. Voice-interactive marketplace providing promotion and promotion tracking, loyalty reward and redemption, and other features
US20020035474A1 (en) * 2000-07-18 2002-03-21 Ahmet Alpdemir Voice-interactive marketplace providing time and money saving benefits and real-time promotion publishing and feedback
US20020007315A1 (en) * 2000-04-14 2002-01-17 Eric Rose Methods and apparatus for voice activated audible order system
US8355912B1 (en) * 2000-05-04 2013-01-15 International Business Machines Corporation Technique for providing continuous speech recognition as an alternate input device to limited processing power devices
US7228327B2 (en) * 2000-05-08 2007-06-05 Hoshiko Llc Method and apparatus for delivering content via information retrieval devices
US7219136B1 (en) * 2000-06-12 2007-05-15 Cisco Technology, Inc. Apparatus and methods for providing network-based information suitable for audio output
US20020046041A1 (en) * 2000-06-23 2002-04-18 Ken Lang Automated reputation/trust service
US7308484B1 (en) * 2000-06-30 2007-12-11 Cisco Technology, Inc. Apparatus and methods for providing an audibly controlled user interface for audio-based communication devices
EP1172741A3 (en) * 2000-07-13 2004-09-01 Sony Corporation On-demand image delivery server, image resource database, client terminal, and method of displaying retrieval result
JP2002063387A (en) * 2000-08-23 2002-02-28 Nec Corp System and method for contents disclosure assistance and recording medium with contents disclosure assistance control program recorded thereon
MXPA03002206A (en) 2000-09-15 2004-12-03 Grape Technology Inc Enhanced directory assistance system.
US7216080B2 (en) * 2000-09-29 2007-05-08 Mindfabric Holdings Llc Natural-language voice-activated personal assistant
US7454346B1 (en) * 2000-10-04 2008-11-18 Cisco Technology, Inc. Apparatus and methods for converting textual information to audio-based output
US7185065B1 (en) 2000-10-11 2007-02-27 Buzzmetrics Ltd System and method for scoring electronic messages
US7197470B1 (en) 2000-10-11 2007-03-27 Buzzmetrics, Ltd. System and method for collection analysis of electronic discussion methods
US6636590B1 (en) * 2000-10-30 2003-10-21 Ingenio, Inc. Apparatus and method for specifying and obtaining services through voice commands
US9310892B2 (en) 2000-11-06 2016-04-12 Nant Holdings Ip, Llc Object information derived from object images
US7680324B2 (en) 2000-11-06 2010-03-16 Evryx Technologies, Inc. Use of image-derived information as search criteria for internet and other search engines
US7899243B2 (en) 2000-11-06 2011-03-01 Evryx Technologies, Inc. Image capture and identification system and process
US8224078B2 (en) 2000-11-06 2012-07-17 Nant Holdings Ip, Llc Image capture and identification system and process
US7565008B2 (en) 2000-11-06 2009-07-21 Evryx Technologies, Inc. Data capture and identification system and process
JP2002150123A (en) * 2000-11-10 2002-05-24 Sony Corp Device for inputting condition in requesting cosponsor, server for mediating cosponsor transaction, and device for receiving request for cosponsor
US6961953B2 (en) * 2000-12-29 2005-11-01 Nokia Corporation System and method for broadcasting advertisements
US7289623B2 (en) 2001-01-16 2007-10-30 Utbk, Inc. System and method for an online speaker patch-through
US20020116270A1 (en) * 2001-02-22 2002-08-22 Lowell Potiker Voice response certificate redemption system
US7240125B2 (en) * 2001-03-06 2007-07-03 International Business Machines Corporation Apparatus and method for using a directory service for a user registry
US7024364B2 (en) * 2001-03-09 2006-04-04 Bevocal, Inc. System, method and computer program product for looking up business addresses and directions based on a voice dial-up session
US20020133402A1 (en) 2001-03-13 2002-09-19 Scott Faber Apparatus and method for recruiting, communicating with, and paying participants of interactive advertising
US7054939B2 (en) 2001-06-28 2006-05-30 Bellsouth Intellectual Property Corportion Simultaneous visual and telephonic access to interactive information delivery
US7467089B2 (en) 2001-09-05 2008-12-16 Roth Daniel L Combined speech and handwriting recognition
US7809574B2 (en) 2001-09-05 2010-10-05 Voice Signal Technologies Inc. Word recognition using choice lists
US7505911B2 (en) 2001-09-05 2009-03-17 Roth Daniel L Combined speech recognition and sound recording
US7444286B2 (en) 2001-09-05 2008-10-28 Roth Daniel L Speech recognition using re-utterance recognition
US7526431B2 (en) 2001-09-05 2009-04-28 Voice Signal Technologies, Inc. Speech recognition using ambiguous or phone key spelling and/or filtering
US6704403B2 (en) 2001-09-05 2004-03-09 Ingenio, Inc. Apparatus and method for ensuring a real-time connection between users and selected service provider using voice mail
DE10151718A1 (en) * 2001-10-19 2003-04-30 Siemens Ag Domain name system for voice-based services
US7089280B1 (en) 2001-11-02 2006-08-08 Sprint Spectrum L.P. Autonomous eclone
US7580850B2 (en) 2001-12-14 2009-08-25 Utbk, Inc. Apparatus and method for online advice customer relationship management
US20030120626A1 (en) * 2001-12-20 2003-06-26 Koninklijke Philips Electronics N.V. Voice-enabled, consumer transaction system
US7937439B2 (en) 2001-12-27 2011-05-03 Utbk, Inc. Apparatus and method for scheduling live advice communication with a selected service provider
US7305070B2 (en) * 2002-01-30 2007-12-04 At&T Labs, Inc. Sequential presentation of long instructions in an interactive voice response system
US6914975B2 (en) 2002-02-21 2005-07-05 Sbc Properties, L.P. Interactive dialog-based training method
US20040203629A1 (en) * 2002-03-04 2004-10-14 Dezonno Anthony J. Intelligent interactive voice response unit
US20030216960A1 (en) * 2002-05-16 2003-11-20 Richard Postrel System and method for offering geocentric-based incentives and executing a commercial transaction via a wireless device
US20080212765A1 (en) * 2002-05-31 2008-09-04 Jingle Networks, Inc. Directory assistance with advertisement from category related to request category
US7212615B2 (en) 2002-05-31 2007-05-01 Scott Wolmuth Criteria based marketing for telephone directory assistance
US20040054534A1 (en) * 2002-09-13 2004-03-18 Junqua Jean-Claude Client-server voice customization
US7698183B2 (en) 2003-06-18 2010-04-13 Utbk, Inc. Method and apparatus for prioritizing a listing of information providers
US7886009B2 (en) 2003-08-22 2011-02-08 Utbk, Inc. Gate keeper
US7366683B2 (en) 2003-10-06 2008-04-29 Utbk, Inc. Methods and apparatuses for offline selection of pay-per-call advertisers
US8121898B2 (en) 2003-10-06 2012-02-21 Utbk, Inc. Methods and apparatuses for geographic area selections in pay-per-call advertisement
US7428497B2 (en) 2003-10-06 2008-09-23 Utbk, Inc. Methods and apparatuses for pay-per-call advertising in mobile/wireless applications
US8140389B2 (en) 2003-10-06 2012-03-20 Utbk, Inc. Methods and apparatuses for pay for deal advertisements
US8837698B2 (en) 2003-10-06 2014-09-16 Yp Interactive Llc Systems and methods to collect information just in time for connecting people for real time communications
US7424442B2 (en) 2004-05-04 2008-09-09 Utbk, Inc. Method and apparatus to allocate and recycle telephone numbers in a call-tracking system
US8024224B2 (en) 2004-03-10 2011-09-20 Utbk, Inc. Method and apparatus to provide pay-per-call advertising and billing
US8027878B2 (en) * 2003-10-06 2011-09-27 Utbk, Inc. Method and apparatus to compensate demand partners in a pay-per-call performance based advertising system
US9202220B2 (en) * 2003-10-06 2015-12-01 Yellowpages.Com Llc Methods and apparatuses to provide application programming interface for retrieving pay per call advertisements
US9984377B2 (en) 2003-10-06 2018-05-29 Yellowpages.Com Llc System and method for providing advertisement
US20050108097A1 (en) * 2003-11-19 2005-05-19 Simpledine, Inc. Web-based food ordering system utilizing a text-to-speech engine
US7437294B1 (en) * 2003-11-21 2008-10-14 Sprint Spectrum L.P. Methods for selecting acoustic model for use in a voice command platform
US8965771B2 (en) * 2003-12-08 2015-02-24 Kurzweil Ainetworks, Inc. Use of avatar with event processing
US7027586B2 (en) 2003-12-18 2006-04-11 Sbc Knowledge Ventures, L.P. Intelligently routing customer communications
US7386443B1 (en) 2004-01-09 2008-06-10 At&T Corp. System and method for mobile automatic speech recognition
US7864929B2 (en) * 2004-02-13 2011-01-04 Nuance Communications, Inc. Method and systems for accessing data from a network via telephone, using printed publication
US7725414B2 (en) 2004-03-16 2010-05-25 Buzzmetrics, Ltd An Israel Corporation Method for developing a classifier for classifying communications
US7570746B2 (en) * 2004-03-18 2009-08-04 Sony Corporation Method and apparatus for voice interactive messaging
US20050234742A1 (en) * 2004-04-08 2005-10-20 Hodgdon Darren W Incentive based health care insurance program
US20050228692A1 (en) * 2004-04-08 2005-10-13 Hodgdon Darren W Incentive based health care insurance program
US9002730B2 (en) 2004-04-28 2015-04-07 Richard Postrel Method and system for generating location based purchase incentives based on predicted route of travel
US20050261923A1 (en) * 2004-05-21 2005-11-24 International Business Machines Corporation Method and apparatus for model based subscriptions for a publish/subscribe messaging system
US7590232B2 (en) * 2004-07-21 2009-09-15 Carter John A System and method for tracking individuals
US7523085B2 (en) 2004-09-30 2009-04-21 Buzzmetrics, Ltd An Israel Corporation Topical sentiments in electronically stored communications
US9367846B2 (en) 2004-11-29 2016-06-14 Jingle Networks, Inc. Telephone search supported by advertising based on past history of requests
JP4802489B2 (en) * 2004-12-07 2011-10-26 日本電気株式会社 Sound data providing system and method
US7933388B1 (en) 2005-01-20 2011-04-26 Andre Denis Vanier Method and system for providing information and advertising content in a telephone system
US20060166684A1 (en) * 2005-01-26 2006-07-27 Jeyhan Karaoguz GPS coordinates downloaded to GPS enabled cell phone in response to information request
US9202219B2 (en) 2005-02-16 2015-12-01 Yellowpages.Com Llc System and method to merge pay-for-performance advertising models
US8538768B2 (en) 2005-02-16 2013-09-17 Ingenio Llc Methods and apparatuses for delivery of advice to mobile/wireless devices
US8934614B2 (en) * 2005-02-25 2015-01-13 YP Interatcive LLC Systems and methods for dynamic pay for performance advertisements
US7979308B2 (en) 2005-03-03 2011-07-12 Utbk, Inc. Methods and apparatuses for sorting lists for presentation
US20060206381A1 (en) * 2005-03-12 2006-09-14 Felix Frayman Method and system for creating interactive guides and information exchange services
DE112006000618T5 (en) 2005-03-15 2008-02-07 Trapeze Networks, Inc., Pleasanton System and method for distributing keys in a wireless network
US9158855B2 (en) 2005-06-16 2015-10-13 Buzzmetrics, Ltd Extracting structured data from weblogs
TWI270052B (en) * 2005-08-09 2007-01-01 Delta Electronics Inc System for selecting audio content by using speech recognition and method therefor
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
US8073700B2 (en) 2005-09-12 2011-12-06 Nuance Communications, Inc. Retrieval and presentation of network service results for mobile device using a multimodal browser
US8761154B2 (en) 2005-09-28 2014-06-24 Ebbe Altberg Methods and apparatuses to access advertisements through voice over internet protocol (VoIP) applications
US8599832B2 (en) 2005-09-28 2013-12-03 Ingenio Llc Methods and apparatuses to connect people for real time communications via voice over internet protocol (VOIP)
US8638762B2 (en) 2005-10-13 2014-01-28 Trapeze Networks, Inc. System and method for network integrity
WO2007044986A2 (en) 2005-10-13 2007-04-19 Trapeze Networks, Inc. System and method for remote monitoring in a wireless network
US7724703B2 (en) 2005-10-13 2010-05-25 Belden, Inc. System and method for wireless network monitoring
US7573859B2 (en) 2005-10-13 2009-08-11 Trapeze Networks, Inc. System and method for remote monitoring in a wireless network
US7697827B2 (en) 2005-10-17 2010-04-13 Konicek Jeffrey C User-friendlier interfaces for a camera
US9008075B2 (en) 2005-12-22 2015-04-14 Genesys Telecommunications Laboratories, Inc. System and methods for improving interaction routing performance
US8125931B2 (en) 2006-01-10 2012-02-28 Utbk, Inc. Systems and methods to provide availability indication
US8681778B2 (en) 2006-01-10 2014-03-25 Ingenio Llc Systems and methods to manage privilege to speak
US9197479B2 (en) 2006-01-10 2015-11-24 Yellowpages.Com Llc Systems and methods to manage a queue of people requesting real time communication connections
US7720091B2 (en) 2006-01-10 2010-05-18 Utbk, Inc. Systems and methods to arrange call back
US7558266B2 (en) 2006-05-03 2009-07-07 Trapeze Networks, Inc. System and method for restricting network access using forwarding databases
US8966018B2 (en) 2006-05-19 2015-02-24 Trapeze Networks, Inc. Automated network device configuration and network deployment
US9258702B2 (en) 2006-06-09 2016-02-09 Trapeze Networks, Inc. AP-local dynamic switching
US8818322B2 (en) 2006-06-09 2014-08-26 Trapeze Networks, Inc. Untethered access point mesh system and method
US9191799B2 (en) 2006-06-09 2015-11-17 Juniper Networks, Inc. Sharing data between wireless switches system and method
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US20080077454A1 (en) * 2006-09-08 2008-03-27 Opentable, Inc. Verified transaction evaluation
US8340110B2 (en) 2006-09-15 2012-12-25 Trapeze Networks, Inc. Quality of service provisioning for wireless networks
US7660783B2 (en) 2006-09-27 2010-02-09 Buzzmetrics, Inc. System and method of ad-hoc analysis of data
US9317855B2 (en) 2006-10-24 2016-04-19 Yellowpages.Com Llc Systems and methods to provide voice connections via local telephone numbers
US20080154724A1 (en) * 2006-12-21 2008-06-26 Yuval Machlin Device, system, and method of recommendation-based rewarding
US7873061B2 (en) 2006-12-28 2011-01-18 Trapeze Networks, Inc. System and method for aggregation and queuing in a wireless network
US9031214B2 (en) * 2007-01-03 2015-05-12 Foncloud, Inc. System and method of use for indexing automated phone systems
US20080170676A1 (en) * 2007-01-17 2008-07-17 Sony Corporation Voice recognition advertisements
US8451825B2 (en) 2007-02-22 2013-05-28 Utbk, Llc Systems and methods to confirm initiation of a callback
US8843376B2 (en) 2007-03-13 2014-09-23 Nuance Communications, Inc. Speech-enabled web content searching using a multimodal browser
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US20080262995A1 (en) * 2007-04-19 2008-10-23 Microsoft Corporation Multimodal rating system
US20080262910A1 (en) * 2007-04-20 2008-10-23 Utbk, Inc. Methods and Systems to Connect People via Virtual Reality for Real Time Communications
AU2008246099A1 (en) * 2007-04-27 2008-11-06 Grape Technology Group Inc. System and method for generating and utilizing organically grown content in a directory assistance environment
US20080273672A1 (en) * 2007-05-03 2008-11-06 Microsoft Corporation Automated attendant grammar tuning
US9277019B2 (en) 2007-06-18 2016-03-01 Yellowpages.Com Llc Systems and methods to provide communication references to connect people for real time communications
US8902904B2 (en) 2007-09-07 2014-12-02 Trapeze Networks, Inc. Network assignment based on priority
US8838476B2 (en) * 2007-09-07 2014-09-16 Yp Interactive Llc Systems and methods to provide information and connect people for real time communications
US8238942B2 (en) 2007-11-21 2012-08-07 Trapeze Networks, Inc. Wireless station location detection
US9202222B2 (en) * 2007-12-13 2015-12-01 Mitesh Thakker Method and system of dispatching non-digital merchandise and/or allied services related code via a device operable on a mobile communication network
US8347326B2 (en) 2007-12-18 2013-01-01 The Nielsen Company (US) Identifying key media events and modeling causal relationships between key events and reported feelings
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
US8682960B2 (en) * 2008-03-14 2014-03-25 Nokia Corporation Methods, apparatuses, and computer program products for providing filtered services and content based on user context
US8150357B2 (en) 2008-03-28 2012-04-03 Trapeze Networks, Inc. Smoothing filter for irregular update intervals
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
US10496753B2 (en) 2010-01-18 2019-12-03 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US8978105B2 (en) 2008-07-25 2015-03-10 Trapeze Networks, Inc. Affirming network relationships and resource access via related networks
US20100030549A1 (en) 2008-07-31 2010-02-04 Lee Michael M Mobile device having human language translation capability with positional feedback
US8238298B2 (en) 2008-08-29 2012-08-07 Trapeze Networks, Inc. Picking an optimal channel for an access point in a wireless network
US9959870B2 (en) 2008-12-11 2018-05-01 Apple Inc. Speech recognition involving a mobile device
US9349046B2 (en) * 2009-02-10 2016-05-24 Kofax, Inc. Smart optical input/output (I/O) extension for context-dependent workflows
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US10255566B2 (en) 2011-06-03 2019-04-09 Apple Inc. Generating and processing task items that represent tasks to perform
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US9431006B2 (en) 2009-07-02 2016-08-30 Apple Inc. Methods and apparatuses for automatic speech recognition
US20110099116A1 (en) * 2009-09-25 2011-04-28 Medlegal Network, Inc. Systems and methods for managing data communications across disparate systems and devices
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US10553209B2 (en) 2010-01-18 2020-02-04 Apple Inc. Systems and methods for hands-free notification summaries
US10705794B2 (en) 2010-01-18 2020-07-07 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US10679605B2 (en) 2010-01-18 2020-06-09 Apple Inc. Hands-free list-reading by intelligent automated assistant
US8687777B1 (en) 2010-02-03 2014-04-01 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8548135B1 (en) 2010-02-03 2013-10-01 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8594280B1 (en) 2010-02-03 2013-11-26 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US8553859B1 (en) 2010-02-03 2013-10-08 Tal Lavian Device and method for providing enhanced telephony
US8903073B2 (en) 2011-07-20 2014-12-02 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US8572303B2 (en) 2010-02-03 2013-10-29 Tal Lavian Portable universal communication device
US8681951B1 (en) 2010-02-03 2014-03-25 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8879698B1 (en) 2010-02-03 2014-11-04 Tal Lavian Device and method for providing enhanced telephony
US8625756B1 (en) 2010-02-03 2014-01-07 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8548131B1 (en) 2010-02-03 2013-10-01 Tal Lavian Systems and methods for communicating with an interactive voice response system
US8537989B1 (en) 2010-02-03 2013-09-17 Tal Lavian Device and method for providing enhanced telephony
US8406388B2 (en) 2011-07-18 2013-03-26 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US9001819B1 (en) 2010-02-18 2015-04-07 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
US8874727B2 (en) 2010-05-31 2014-10-28 The Nielsen Company (Us), Llc Methods, apparatus, and articles of manufacture to rank users in an online social network
US10762293B2 (en) 2010-12-22 2020-09-01 Apple Inc. Using parts-of-speech tagging and named entity recognition for spelling correction
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
US8994660B2 (en) 2011-08-29 2015-03-31 Apple Inc. Text correction processing
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US8867708B1 (en) 2012-03-02 2014-10-21 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8731148B1 (en) 2012-03-02 2014-05-20 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US9483461B2 (en) 2012-03-06 2016-11-01 Apple Inc. Handling speech synthesis of content for multiple languages
US9280610B2 (en) 2012-05-14 2016-03-08 Apple Inc. Crowd sourcing information to fulfill user requests
US9524713B2 (en) * 2012-05-30 2016-12-20 Sap Se Business platform voice interactions
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
US9495129B2 (en) 2012-06-29 2016-11-15 Apple Inc. Device, method, and user interface for voice-activated navigation and browsing of a document
US9809185B2 (en) 2012-09-04 2017-11-07 Ford Global Technologies, Llc Method and apparatus for subjective command control of vehicle systems
US9576574B2 (en) 2012-09-10 2017-02-21 Apple Inc. Context-sensitive handling of interruptions by intelligent digital assistant
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
EP2954514B1 (en) 2013-02-07 2021-03-31 Apple Inc. Voice trigger for a digital assistant
US10652394B2 (en) 2013-03-14 2020-05-12 Apple Inc. System and method for processing voicemail
US9368114B2 (en) 2013-03-14 2016-06-14 Apple Inc. Context-sensitive handling of interruptions
WO2014144579A1 (en) 2013-03-15 2014-09-18 Apple Inc. System and method for updating an adaptive speech recognition model
AU2014233517B2 (en) 2013-03-15 2017-05-25 Apple Inc. Training an at least partial voice command system
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
WO2014197334A2 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
WO2014197336A1 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
WO2014200728A1 (en) 2013-06-09 2014-12-18 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
AU2014278595B2 (en) 2013-06-13 2017-04-06 Apple Inc. System and method for emergency calls initiated by voice command
KR101749009B1 (en) 2013-08-06 2017-06-19 애플 인크. Auto-activating smart responses based on activities from remote devices
US9866673B2 (en) 2013-12-18 2018-01-09 Medlegal Network, Inc. Methods and systems of managing accident communications over a network
US9877176B2 (en) 2013-12-18 2018-01-23 Medlegal Network, Inc. Methods and systems of managing accident communications over a network
US9946985B2 (en) * 2014-04-15 2018-04-17 Kofax, Inc. Touchless mobile applications and context-sensitive workflows
GB201408302D0 (en) * 2014-05-12 2014-06-25 Jpy Plc Unifying text and audio
US9620105B2 (en) 2014-05-15 2017-04-11 Apple Inc. Analyzing audio input for efficient speech and music recognition
US10592095B2 (en) 2014-05-23 2020-03-17 Apple Inc. Instantaneous speaking of content on touch devices
US9502031B2 (en) 2014-05-27 2016-11-22 Apple Inc. Method for supporting dynamic grammars in WFST-based ASR
US9760559B2 (en) 2014-05-30 2017-09-12 Apple Inc. Predictive text input
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US9785630B2 (en) 2014-05-30 2017-10-10 Apple Inc. Text prediction using combined word N-gram and unigram language models
US9966065B2 (en) 2014-05-30 2018-05-08 Apple Inc. Multi-command single utterance input method
US9734193B2 (en) 2014-05-30 2017-08-15 Apple Inc. Determining domain salience ranking from ambiguous words in natural speech
US10289433B2 (en) 2014-05-30 2019-05-14 Apple Inc. Domain specific language for encoding assistant dialog
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US10078631B2 (en) 2014-05-30 2018-09-18 Apple Inc. Entropy-guided text prediction using combined word and character n-gram language models
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US10659851B2 (en) 2014-06-30 2020-05-19 Apple Inc. Real-time digital assistant knowledge updates
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US10446141B2 (en) 2014-08-28 2019-10-15 Apple Inc. Automatic speech recognition based on user feedback
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US10789041B2 (en) 2014-09-12 2020-09-29 Apple Inc. Dynamic thresholds for always listening speech trigger
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US10552013B2 (en) 2014-12-02 2020-02-04 Apple Inc. Data detection
US9711141B2 (en) 2014-12-09 2017-07-18 Apple Inc. Disambiguating heteronyms in speech synthesis
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10186254B2 (en) 2015-06-07 2019-01-22 Apple Inc. Context-based endpoint detection
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US10255907B2 (en) 2015-06-07 2019-04-09 Apple Inc. Automatic accent detection using acoustic models
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US10282417B2 (en) 2016-02-19 2019-05-07 International Business Machines Corporation Conversational list management
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
DK179309B1 (en) 2016-06-09 2018-04-23 Apple Inc Intelligent automated assistant in a home environment
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
DK179343B1 (en) 2016-06-11 2018-05-14 Apple Inc Intelligent task discovery
DK179049B1 (en) 2016-06-11 2017-09-18 Apple Inc Data driven natural language event detection and classification
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
US10412536B2 (en) 2016-06-23 2019-09-10 Minutepros.Com Corp. Providing secure service provider reverse auctions using certification identifiers, symmetric encryption keys and encrypted uniform resource locators
US9763271B1 (en) 2016-06-23 2017-09-12 Minutepros.Com Corp. Networked Wi-Fi stations having multi-level displays and multiple antennas
US10853761B1 (en) 2016-06-24 2020-12-01 Amazon Technologies, Inc. Speech-based inventory management system and method
US11315071B1 (en) * 2016-06-24 2022-04-26 Amazon Technologies, Inc. Speech-based storage tracking
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
DK201770439A1 (en) 2017-05-11 2018-12-13 Apple Inc. Offline personal assistant
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
DK179745B1 (en) 2017-05-12 2019-05-01 Apple Inc. SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT
DK201770431A1 (en) 2017-05-15 2018-12-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
DK201770432A1 (en) 2017-05-15 2018-12-21 Apple Inc. Hierarchical belief states for digital assistants
DK179560B1 (en) 2017-05-16 2019-02-18 Apple Inc. Far-field extension for digital assistant services
US11099540B2 (en) 2017-09-15 2021-08-24 Kohler Co. User identity in household appliances
US11314214B2 (en) 2017-09-15 2022-04-26 Kohler Co. Geographic analysis of water conditions
US10887125B2 (en) 2017-09-15 2021-01-05 Kohler Co. Bathroom speaker
US11093554B2 (en) 2017-09-15 2021-08-17 Kohler Co. Feedback for water consuming appliance
US10448762B2 (en) 2017-09-15 2019-10-22 Kohler Co. Mirror
AU2019357272A1 (en) * 2018-10-11 2021-04-29 Spetz Tech Ltd Online connecting of service providers
CN111627433B (en) * 2020-06-16 2023-11-28 北京云迹科技股份有限公司 Robot voice order processing method and device
US11880645B2 (en) 2022-06-15 2024-01-23 T-Mobile Usa, Inc. Generating encoded text based on spoken utterances using machine learning systems and methods

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4674041A (en) 1983-09-15 1987-06-16 James K. Appleton Method and apparatus for controlling the distribution of coupons
US4882675A (en) 1984-11-26 1989-11-21 Steven Nichtberger Paperless system for distributing, redeeming and clearing merchandise coupons
US4791281A (en) 1986-10-16 1988-12-13 C.P.C. Investment Trust Encoding and decoding system
US5185695A (en) 1988-07-14 1993-02-09 Pruchnicki Michael A Method and system for handling discount coupons by using centrally stored manufacturer coupons in place of paper coupons
US5117355A (en) 1989-01-27 1992-05-26 Mccarthy Patrick D Centralized consumer cash valve accumulation system for multiple merchants
US5202826A (en) 1989-01-27 1993-04-13 Mccarthy Patrick D Centralized consumer cash value accumulation system for multiple merchants
US5193056A (en) 1991-03-11 1993-03-09 Signature Financial Group Inc. Data processing system for hub and spoke financial services configuration
US5237499A (en) 1991-11-12 1993-08-17 Garback Brent J Computer travel planning system
US5557518A (en) 1994-04-28 1996-09-17 Citibank, N.A. Trusted agents for open electronic commerce
US5502636A (en) 1992-01-31 1996-03-26 R.R. Donnelley & Sons Company Personalized coupon generating and processing system
US5305195A (en) 1992-03-25 1994-04-19 Gerald Singer Interactive advertising system for on-line terminals
US5249044A (en) 1992-05-05 1993-09-28 Kohorn H Von Product information storage, display, and coupon dispensing system
US5353218A (en) 1992-09-17 1994-10-04 Ad Response Micromarketing Corporation Focused coupon system
US5305197A (en) 1992-10-30 1994-04-19 Ie&E Industries, Inc. Coupon dispensing machine with feedback
US5420606A (en) 1993-09-20 1995-05-30 Begum; Paul G. Instant electronic coupon verification system
US5380991A (en) 1993-11-16 1995-01-10 Valencia; Luis Paperless coupon redemption system and method thereof
US5515098A (en) 1994-09-08 1996-05-07 Carles; John B. System and method for selectively distributing commercial messages over a communications network
US5995155A (en) * 1995-07-17 1999-11-30 Gateway 2000, Inc. Database navigation system for a home entertainment system
US5761648A (en) 1995-07-25 1998-06-02 Interactive Coupon Network Interactive marketing network and process using electronic certificates
US5884262A (en) 1996-03-28 1999-03-16 Bell Atlantic Network Services, Inc. Computer network audio access and conversion system
US5799063A (en) 1996-08-15 1998-08-25 Talk Web Inc. Communication system and method of providing access to pre-recorded audio messages via the Internet
US5915001A (en) * 1996-11-14 1999-06-22 Vois Corporation System and method for providing and using universally accessible voice and speech data files
US5903652A (en) * 1996-11-25 1999-05-11 Microsoft Corporation System and apparatus for monitoring secure information in a computer network
US5884266A (en) * 1997-04-02 1999-03-16 Motorola, Inc. Audio interface for document based information resource navigation and method therefor
US5991739A (en) * 1997-11-24 1999-11-23 Food.Com Internet online order method and apparatus
US6055513A (en) * 1998-03-11 2000-04-25 Telebuyer, Llc Methods and apparatus for intelligent selection of goods and services in telephonic and electronic commerce
US6101483A (en) * 1998-05-29 2000-08-08 Symbol Technologies, Inc. Personal shopping system portable terminal
US6134548A (en) * 1998-11-19 2000-10-17 Ac Properties B.V. System, method and article of manufacture for advanced mobile bargain shopping
US6446076B1 (en) * 1998-11-12 2002-09-03 Accenture Llp. Voice interactive web-based agent system responsive to a user location for prioritizing and formatting information

Also Published As

Publication number Publication date
WO2001074036A3 (en) 2002-02-14
WO2001074036A2 (en) 2001-10-04
US6658389B1 (en) 2003-12-02
AU2001249464A1 (en) 2001-10-08

Similar Documents

Publication Publication Date Title
US6658389B1 (en) System, method, and business model for speech-interactive information system having business self-promotion, audio coupon and rating features
US6934684B2 (en) Voice-interactive marketplace providing promotion and promotion tracking, loyalty reward and redemption, and other features
US20020035474A1 (en) Voice-interactive marketplace providing time and money saving benefits and real-time promotion publishing and feedback
US20030125958A1 (en) Voice-interactive marketplace providing time and money saving benefits and real-time promotion publishing and feedback
EP1391127B1 (en) Location-based services
US7457397B1 (en) Voice page directory system in a voice page creation and delivery system
US6895084B1 (en) System and method for generating voice pages with included audio files for use in a voice page delivery system
US6400806B1 (en) System and method for providing and using universally accessible voice and speech data files
EP2372698B1 (en) Routing call failures in a location-based services system
US20080019496A1 (en) Method And System For Providing Directory Assistance
US20090304161A1 (en) system and method utilizing voice search to locate a product in stores from a phone
AU2002256369A1 (en) Location-based services
WO2001029742A2 (en) Method and apparatus for electronic commerce using a telephone interface
JP2003169147A (en) Client response system and method
WO2001073750A2 (en) Voice-interactive marketplace providing time and money saving benefits and real-time promotion publishing and feedback
US20040236679A1 (en) Method and system for performing automated prepaid account renewal
AU2006203598B2 (en) Advertising and business listing management for a location-based services system
AU2008201023B2 (en) Location-based services

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

AK Designated states

Kind code of ref document: C2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: C2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

COP Corrected version of pamphlet

Free format text: PAGES 1/6-6/6, DRAWINGS, REPLACED BY NEW PAGES 1/6-6/6; DUE TO LATE TRANSMITTAL BY THE RECEIVING OFFICE

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP