|Publication number||US7865362 B2|
|Application number||US 11/051,825|
|Publication date||4 Jan 2011|
|Filing date||4 Feb 2005|
|Priority date||4 Feb 2005|
|Also published as||US8756059, US20060178882, US20110093269, US20140288933|
|Publication number||051825, 11051825, US 7865362 B2, US 7865362B2, US-B2-7865362, US7865362 B2, US7865362B2|
|Inventors||Keith Braho, Amro El-Jaroudi, Jeffrey Pike|
|Original Assignee||Vocollect, Inc.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (145), Non-Patent Citations (30), Referenced by (25), Classifications (5), Legal Events (4)|
|External Links: USPTO, USPTO Assignment, Espacenet|
The present invention relates to speech recognition and, more particularly, to speech recognition systems for addressing likely or expected responses.
Speech recognition has simplified many tasks in the workplace by permitting hands-free communication with a computer as a convenient alternative to communication via conventional peripheral input/output devices. A worker may enter data by voice using a speech recognizer and commands or instructions may be communicated to the worker by a speech synthesizer. Speech recognition finds particular application in mobile computing devices in which interaction with the computer by conventional peripheral input/output devices is restricted.
For example, wireless wearable terminals can provide a worker performing work-related tasks with desirable computing and data-processing functions while offering the worker enhanced mobility within the workplace. One particular area in which workers rely heavily on such wireless wearable terminals is inventory management. Inventory-driven industries rely on computerized inventory management systems for performing various diverse tasks, such as food and retail product distribution, manufacturing, and quality control. An overall integrated management system involves a combination of a central computer system for tracking and management, and the people who use and interface with the computer system in the form of order fillers, pickers and other workers. The workers handle the manual aspects of the integrated management system under the command and control of information transmitted from the central computer system to the wireless wearable terminal.
As the workers complete their assigned tasks, a bi-directional communication stream of information is exchanged over a wireless network between wireless wearable terminals and the central computer system. Information received by each wireless wearable terminal from the central computer system is translated into voice instructions or text commands for the corresponding worker. Typically, the worker wears a headset coupled with the wearable device that has a microphone for voice data entry and an ear speaker for audio output feedback. Responses from the worker are input into the wireless wearable terminal by the headset microphone and communicated from the wireless wearable terminal to the central computer system. Through the headset microphone, workers may pose questions, report the progress in accomplishing their assigned tasks, and report working conditions, such as inventory shortages. Using such wireless wearable terminals, workers may perform assigned tasks virtually hands-free without equipment to juggle or paperwork to carry around. Because manual data entry is eliminated or, at the least, reduced, workers can perform their tasks faster, more accurately, and more productively.
An illustrative example of a set of worker tasks suitable for a wireless wearable terminal with voice capabilities may involve initially welcoming the worker to the computerized inventory management system and defining a particular task or order, for example, filling a load for a particular truck scheduled to depart from a warehouse. The worker may then answer with a particular area (e.g., freezer) that they will be working in for that order. The system then vocally directs the worker to a particular aisle and bin to pick a particular quantity of an item. The worker then vocally confirms a location and the number of picked items. The system may then direct the worker to a loading dock or bay for a particular truck to receive the order. As may be appreciated, the specific communications exchanged between the wireless wearable terminal and the central computer system can be task-specific and highly variable.
To perform speech recognition, speech recognizer algorithms analyze the received speech input using acoustic modeling and determine the likely word, or words, that were spoken (also known as the hypothesis). As part of the analysis and determination, the speech recognizer assigns confidence factors that quantitatively indicate how closely each word of the hypothesis matches the acoustic models. If the confidence factor is above the acceptance threshold, then the speech recognizer accepts the hypothesis as correctly recognized speech. If, however, the confidence factor is below the acceptance threshold, then the speech recognizer rejects or ignores the speech input. This rejection may require the user to repeat the speech input. By rejecting the hypothesis and requiring repetition of speech that was otherwise correctly recognized, this type of speech recognizer may reduce productivity and efficiency and, thereby, may waste time and money.
Accordingly, there is a need, unmet by current speech recognizer systems, for a speech recognizer that reduces unnecessary repetition. There is further a need for a speech recognizer that can accept speech input, under certain circumstances, even if the confidence factor is below the normal acceptance threshold, without sacrificing accuracy.
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and, together with the detailed description of the embodiments given below, serve to explain the principles of the invention.
In particular, the signal processor 104 divides the digital stream of data that is created into a sequence of time-slices, or frames 105, each of which is then processed by a feature generator 106, thereby producing a vector, matrix, or otherwise organized set of numbers 107 representing the acoustic features of the frames. Further explanation of an exemplary speech signal processor system is provided in U.S. Pat. No. 4,882,757, entitled SPEECH RECOGNITION SYSTEM, the disclosure of which is incorporated herein, by reference, in its entirety. This patent discloses Linear Predictive Coding (LPC) coefficients to represent speech; however, other functionally equivalent methods are contemplated within the scope of the present invention as well.
A speech recognition search algorithm function 108, realized by an appropriate circuit or software in the system 100 analyzes the feature vectors 107 in an attempt to determine what hypothesis to assign to the speech input captured by input device 102. As is known in the art in one recognition algorithm, the recognition search 108 relies on probabilistic models from a library of suitable models 110 to recognize the speech input 102. Some of the models in the library 110 may be customized to a user via templates or other means, while some models may be generic to all users.
When in operation, the search algorithm 108, in essence, compares the features 107 generated in the generator 106 with reference representations of speech, or speech models, in library 110 in order to determine the word or words that best match the speech input from device 102. Part of this recognition process is to assign a confidence factor for the speech to indicate how closely the sequence of features from the search algorithm 106 matches the closest or best-matching models in library 110. As such, a hypothesis, consisting of one or more vocabulary items and associated confidence factors 111 is directed to an acceptance algorithm 112. If the confidence factor is above a defined acceptance threshold, then the recognized speech is accepted by the acceptance algorithm 112. Acceptance algorithm 112 may also be realized by an appropriate circuit or software component of the system 100. If, however, the confidence factor is not above the acceptance threshold, as utilized by the acceptance algorithm, then the acceptance algorithm 112 ignores or rejects the recognized speech or prompts the user to repeat the speech. In this instance, the user may repeat the speech to input device 102.
One common modeling technique utilized for speech recognition includes Hidden Markov Models (HMM). In speech recognition, these models use sequences of states to describe vocabulary items, which may be words, phrases, or subword units. Each state represents one or more acoustic events and serves to assign a probability to each observed feature vector. Accordingly, a path through the HMM states produce a probabilistic indication of a series of acoustic feature vectors. The model is searched such that different, competing hypotheses (or paths) are scored; a process known as acoustic matching or acoustic searching. A state S can be reached at a time T via a number of different paths. For each path reaching a particular state at a particular time, a path probability is calculated. Using the Viterbi algorithm, each path through the HMM can be assigned a probability. In particular, the best path can be assigned a probability. Furthermore, each vocabulary item or word in the best path can be assigned a probability. Each of these probabilities can be used as a confidence factor or combined with other measurements, estimates or numbers to derive a confidence factor. The path with the highest confidence factor, the hypothesis, can then be further analyzed. The confidence factor of the hypothesis or the confidence factors of each vocabulary item in the hypothesis can be compared with an acceptance threshold. As used herein, the term “word” is used to denote a vocabulary item, and thus may mean a word, a segment or part of a word, or a compound word, such as “next slot” or “say again.” Therefore, the term “word” is not limited to just a single word. It should be understood that other speech recognition models are also contemplated within the scope of the present invention; for example, template matching dynamic time warping (DTW) and neural networks are two such exemplary, alternative modeling techniques.
While existing speech recognition systems adequately address the task of determining the spoken input and recognizing the speech, there are still some drawbacks in such systems as noted above. For example, all of the hypotheses generated by the system, even the best-scoring hypothesis, may have confidence factors that fall below the acceptance threshold. In such a situation, the speech is rejected and may have to be repeated. As noted, this reduces productivity and efficiency. The present invention addresses such issues and improves upon the recognition efficiency by using expected speech to modify the acceptance threshold.
More specifically, in certain environments utilizing speech recognition systems, the expected speech or expected response to be received from a user is known beforehand or can be determined. For example, when picking a part from a bin, or placing an item in a warehouse location, there can be a check-digit that verifies the location of the user or the operation being performed by the user. During the operation, the user is prompted to go to a location and speak the check-digit (or check-phrase) displayed at and associated with the location. The speech recognition system attempts to recognize the user's spoken response and compare it with this check-digit or check-phrase to confirm that the user is at the correct location before prompting the user to perform an operation, such as picking a case of product. As used herein, “check-digit” refers to the set of one or more words that are associated with a location, bin or slot for the purpose of verifying a user's location. A “check-digit” may, for example, be a three-digit number or could be non-digit words. In addition to this exemplary environment, there may be other scenarios in which a particular response or series of responses is expected from the user. Other such examples are described in US patent application 2003/0154075 and include password verification, quantity verification, and repeat/acknowledge messages. The exemplary embodiments of the present invention described below involve situations wherein one or more known expected response(s) are utilized to improve speech recognition systems. In addition to these exemplary environments, an expected response may be known in other situations when a recognizer is waiting for a response from the user. As recognized by one of ordinary skill, the principles of the present invention can be advantageous within these situations as well.
In embodiments of the present invention, this knowledge about the response that is expected from the user is utilized to modify and refine a speech recognition system to increase efficiency and productivity. In particular, the speech recognizer, as described herein, uses the information about the expected response in addition to the conventional models and probabilistic determination methods in order to accurately determine what a user has said.
In accordance with the principles of the present invention, this most probable sequence, or the hypothesis with the highest confidence factor, is compared, in step 210, to an expected response that was known beforehand. Then, based upon such a comparison, the acceptance algorithm is modified. If the comparison shows that the most probable speech hypothesis matches an expected response, the hypothesis is more favorably treated. Specifically, the acceptance threshold is modified by being downwardly adjusted or lowered in order to allow speech that may otherwise be rejected to be accepted and output as recognized by system 100. In one embodiment of the invention, as discussed herein, the assumption is that the recognizer uses higher or increased confidence scores to represent a higher confidence that the speech input 102 actually matches the recognizer's hypothesis. In such a case the invention would operate to decrease the acceptance threshold based upon knowledge of an expected response to allow recognition of the spoken input. The present invention also contemplates however that the confidence scale could be inverted. That is, the recognizer would use lower or low scores to represent higher confidence. In such a case, the confidence scores must be below a defined acceptance threshold for the recognizer to accept the speech input. In this case, in accordance with aspects of the invention, the acceptance threshold would then be increased (not decreased) to yield the same effect; namely, that the hypothesis or components of the hypothesis are more likely to be accepted by the system.
An example of the invention is useful to illustrate its features. For example, a user may be directed to a particular bin or slot and asked to speak the check-digits assigned to that bin or slot to verify his location in a warehouse. For the purpose of this example, we assume that the check-digit is “one one”. The acceptance threshold for the system is set to 1.5. Various scenarios may arise in this situation.
In the first scenario, the user speaks the correct check-digits and the search algorithm produces “one one” as the top hypothesis, with a confidence factor of 2. In this case, the check-digits are accepted because the confidence factor exceeds the acceptance threshold and the user continues with the task.
In the second scenario, the user speaks the correct check-digits and the search algorithm again produces “one one” as the top hypothesis. However, in this later scenario, the hypothesis is only assigned a confidence factor of 1. Without the invention, this hypothesis would normally be rejected because the confidence factor is lower than the acceptance threshold of 1.5. The user would then be asked to repeat the speech causing delay or inefficiency.
With the invention, the system adapts. Specifically, the system may know the expected check-digit response from the user based on knowledge of the bin or slot. The invention makes a comparison of the top hypothesis to the expected response for the user. If the hypothesis matches the expected check-digit response for the user's location, the acceptance threshold is lowered, such as to 0.5 for example. Now the confidence factor (1) exceeds the acceptance threshold (0.5). The check-digit response of “one one” is then accepted and the user continues with the task without having to repeat the check-digits. This change constitutes savings of time leading to higher efficiency and productivity.
In a third scenario, the search algorithm produces incorrect check-digits as its top hypothesis (either the user said the wrong check-digits or the speech was recognized incorrectly or the hypothesis was produced due to background noise and not user speech), e.g. “one two”, with a confidence factor of 1. Since the hypothesis does not match the expected check-digits at the user's location (i.e., bin/slot), the acceptance threshold is not adjusted or lowered. Therefore, since the confidence factor is below the acceptance threshold, the hypothesis is rejected. Therefore, the invention does not cause acceptance of the wrong response.
In a fourth scenario, the search algorithm produces incorrect check-digits as its top hypothesis (either the user said the wrong check-digits or the speech was recognized incorrectly or the hypothesis was produced due to background noise and not user speech), e.g. “one two.” However, now the hypothesis has a confidence factor of 2. Since the confidence factor exceeds the rejection threshold (1.5), the hypothesis is accepted and the user is alerted that the check-digits are incorrect. As may be appreciated, there are numerous other situations where there is an expected response that would lead to adjusting the acceptance threshold. The example provides a single illustration of the invention and is not meant to limit the situations where it may be useful.
Thus, according to the method detailed in
There are a variety of ways to include knowledge about an expected result within a speech recognition application for the purposes of the invention. For example, when developing the software, the developer may include this information in tables or other data structures that are referenced at different points in the execution of the application. For example, the program may know where in its execution it is to look for a “YES” or “NO” answer. Additionally, or alternatively, the information about the expected result can be calculated dynamically using programming logic included in the speech recognition application. For example, it is well known that the accuracy of a credit card number can be calculated based on a particular checksum algorithm. In such an example, the speech recognition program would not need to have all the checksums precalculated beforehand, but can implement the checksum algorithm dynamically to calculate a value on-the-fly as needed. In another example, the program may know the location (bin/slot) that a user has been sent to and may then know the specific check-digits to look for in the expected response. This on-the-fly information is still available as “prior knowledge” with which to evaluate the speech received by a user, and thus the present invention may use pre-stored expected responses or dynamically developed expected responses. Referring to
The amount by which the acceptance threshold is adjusted can be determined in various ways according to embodiments of the invention. In one embodiment, the voice development tool or API used to implement system 100 can provide a means for the application developer to specify the adjustment amount. For example, a fixed amount of threshold adjustment 116 may be built into the system 100 and used by acceptance algorithm 112 as shown in
For example, in one embodiment, to guard against the expected response being accidentally produced and accepted by the recognition system, the adjustment of the acceptance threshold may be dynamically controlled by an algorithm that takes into account the likelihood of the recognition system accidentally producing the expected response. For example, in one such embodiment, the present invention contemplates at least two independent components of such a threshold adjustment algorithm: the number of vocabulary items at the point in the application where the expected response is used (the breadth of the search), and the number of vocabulary items in the expected response (the depth). For example, if there are only two possible responses (e.g., a “yes” or “no” response) with one being the expected response, then the adjustment to the acceptance threshold could be made very small because the recognizer is looking for a single word answer (depth=1) from only two possibilities (breadth=2).
Alternatively, in such a scenario, the system 100 could be configured to provide no adjustment to the acceptance threshold, because with such a low depth and low breadth, there is a higher chance of the system producing the expected response by accident.
However, in another recognition scenario, if there are a hundred possible responses (e.g., a two-digit check-digit), then the probability of producing the expected response by accident would be smaller and the adjustment to the acceptance threshold therefore may be made more significant. For example, two check-digits will have a hundred possible responses (10 possibilities×10 possibilities) making a breadth 100 and a depth of 2 for the two check-digits. This would allow a more significant threshold adjustment to be used.
In another embodiment, the threshold adjustment may depend on how likely the user is to say the expected response. If, in a particular application, the user says the expected response 99% of the time, the threshold adjustment may be greater than in applications where the user's response is not as predictable. For example, if the user goes to the proper spot or location in a warehouse most of the time or is asked to speak a password, it may be desirable for the system to use a greater adjustment, because the response will usually be correct. However, if the system is less sure of the response to be received, less adjustment to the threshold will be used to prevent improper acceptance of a response. The system 100 could thus dynamically vary the threshold adjustment amount accordingly based on the likelihood of the user saying the expected response. The likelihood of the user saying the expected response could be determined ahead of time or dynamically and/or automatically estimated based on actual usage patterns.
For example, in the check-digits scenario described earlier, the probability (Pe) that the invention causes the user to pick an item from the wrong slot by incorrectly accepting the hypothesis as the expected response is given by,
Pa, Pb, Pc, and Pd depend on many factors including (but not limited to) the following:
It is easy to see that to control Pe by means of the threshold adjustment, the other probabilities need to be estimated. Pa, Pb, Pc, and Pd may be static quantities or may be adjusted dynamically as the system observes a given user's patterns.
For example, if the system notices that a user is more prone to go to an incorrect shelf, it would adjust its estimate of Pa higher. To maintain the same Pe, the system would then change its adjustment to the acceptance threshold to make Pd lower. Therefore, the amount of the threshold adjustment may be dynamically determined. This is just one of many possible ways and a person of ordinary skill in the art will appreciate that the other factors can also affect the threshold adjustment according to the formula noted above.
In still another embodiment, the acceptance threshold adjustment amount can also be determined by taking into account the “cost” of the recognizer making an error. A smaller adjustment would be used when the cost is greater, to prevent errors as described above where an incorrect hypothesis is mistakenly recognized as the expected response. For example, the invention could be used on the passcode for a rocket or missile launcher or in a scenario to confirm a warehouse worker's location when picking health and beauty products. The “cost” of making a mistake in the rocket example is much higher than in the warehouse example. Thus, all other components/factors being equal, the adjustment amount used for the rocket example should be chosen to be less than the adjustment for the warehouse example. In practice, this cost of mistakenly recognizing the expected response must be balanced against the cost of requiring that the operator repeat the speech input 102.
In one embodiment of the invention, the cost of mistakenly recognizing the hypothesis as the expected response can be expressed as:
In still another embodiment, the system 100, through the use of the invention and a threshold adjustment, may be used to effectively override the acceptance algorithm. For example, in those scenarios wherein the cost of a wrong answer is insignificant in the context of the application, the reduction to the threshold can effectively be infinite. That is, the recognizer would accept the hypothesis, (which equals the expected response) regardless of how its confidence factor relates to the threshold.
In accordance with another aspect of the invention, a related tool allows a voice application developer to specify the expected response for the system. (Herein, “voice application developer” or “developer” is used to refer to the user of the voice application development tool, i.e. the person who creates or programs the voice application. The developer is not to be confused with the user of the voice recognition system 100.) Voice application development tools allow a voice application developer to specify what vocabulary items and grammar are available to be recognized at a given point of a dialog. At least one such voice application development tool 101 exists separate and apart from the speech recognition system 100. The outputs of the tool 101 are used by the speech recognition system 100 to define the behavior of the speech recognition system. For example, using an interface of the voice application development tool, a developer specifies what information is to be delivered to a user of the speech recognition system, such as what sentences or questions the system will prompt the user for. The developer also specifies what responses the speech recognizer should attempt to recognize. For example, using a voice application development tool 101, a developer can specify that the voice application prompts the user “What is the check-digit?” and that the voice application should listen for the vocabulary items “one”, “two”, “three”, “four”, “five”, or “six.” Referring to
Referring again to
In the example, the utterance continues because three digits of the number 125 were spoken. With the recognition of the vocabulary word “two” the system queues or otherwise stores the vocabulary word “two” and its confidence factor. As the system is still in the Reporting state, it thus proceeds through step 306 to step 308. However, in this example, the word “two”, with its low confidence factor as noted above, does not pass the acceptance criteria. Pursuant to step 310, the word “two” is not acceptable or is initially rejected. In such a case, in accordance with the principles of the present invention, the system progresses on a path to step 318 so that the portion of the hypothesis or utterance string, which at this stage includes the words “one two,” is compared to the beginning portion of the expected response. Since the expected response is “one two five”, the first parts or portion of the hypothesis compare favorably to the first parts or portion of the expected response, such that the portion of the hypothesis generated so far is considered to be part of the expected response, as noted in step 318. Because the hypothesis is part of the expected response, the invention progresses through step 320 to step 322. In step 322, the hypothesis generated so far is compared to the expected response in its entirety. Since the hypothesis “one two” does not match the complete expected response “one two five”, the flow proceeds to step 330, where the system is switched to a “not reporting” state. Then the system waits for the next vocabulary word of the hypothesis in step 316.
The system waits in step 316 until the next word is received. In the example, the next word is “five.” The vocabulary word encounters this system now in the Not Reporting state (step 306). Therefore, the system progresses to step 318 where the hypothesis string, that now includes the words “one, two, five”, is compared to the beginning portion of the expected response, which is “one two five”. Since the utterance string is part of the expected response pursuant to step 320, the next determination to be made is whether the complete expected response has been received. In this example, the last word “five ” completes the expected response and, thus, pursuant to step 322, the system proceed to step 324 wherein the acceptance threshold is lowered or otherwise appropriately adjusted, and the confidence factor of each queued word is compared to the adjusted threshold (step 326). In one example, the lowering of the acceptance threshold may have been sufficient so that the spoken “two” was now accepted. Therefore, all words “one, two, five” are accepted. Alternatively, if the threshold was not lowered enough, then the “two” would not be accepted. The threshold is reset to its original value in step 328, and pursuant to step 312, the system switches to a Reporting state. In step 314, words that have been queued and are now accepted are reported as recognized words. In the example just given, because the utterance compared favorably to the expected response and the confidence factor of each word of the hypothesis met the adjusted acceptance threshold, the entire utterance (e.g., the three words “one two five”) is reported as being accepted.
In an alternative example, one or more of the words might not be part of the expected response. For example, the middle word might have been heard and recognized as “three” rather than “two.” In this case, the utterance detected or hypothesis is “one three five.” If “one” is initially accepted and “three” is not accepted because it has a low confidence factor, then flow would proceed through steps 308 and 310 to step 318. Then, pursuant to a comparison to the expected response (step 318), it would be determined that the partial hypothesis “one three” was not part of the expected response (step 320). Then, the system would not adjust the threshold, switch to a “not reporting” state, nor delay the decision on this word. As such, if a word is initially rejected and is not part of the expected response, the word would not be accepted. If the last word spoken was actually “five” but was initially rejected and “one two” has been accepted, the word “five” may be stored according to the principles of the invention (step 304) and thereafter re-evaluated against a lower threshold value (step 326). In this example, the “five” is only stored long enough to test it with the adjusted threshold, since it matches the last word of the expected response. Although one feature of the invention is that the reporting of accepted words is sometimes delayed, this example illustrates that the invention does not always delay the reporting of accepted words.
As such, the present invention is able to analyze individual words of a multi-word utterance and instead of initially rejecting all or part of the utterance because one or more words are not initially accepted, it is able to queue or store the unaccepted words and then make a later comparison or analysis based upon how the utterance matches against the expected response string. In that way, the invention is able to accept the properly spoken expected response even though one or more words have confidence factors that do not compare favorably against the initial acceptance threshold, but do compare favorably against the adjusted threshold.
Thus, while the present invention has been illustrated by a description of various embodiments and while these embodiments have been described in considerable detail, it is not the intention of the applicants to restrict or in any way limit the scope of the appended claims to such detail. Additional advantages and modifications will readily appear to those skilled in the art. Thus, the invention in its broader aspects is therefore not limited to the specific details, representative apparatus and method, and illustrative example shown and described. Accordingly, departures may be made from such details without departing from the spirit or scope of applicants' general inventive concept. For example, the exemplary speech recognition system described herein has focused on wearable wireless terminals. However, the principles of the present invention are applicable to other speech recognition environments as well.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4882757||26 Jan 1989||21 Nov 1989||Texas Instruments Incorporated||Speech recognition system|
|US4928302||1 Nov 1988||22 May 1990||Ricoh Company, Ltd.||Voice actuated dialing apparatus|
|US4959864||19 Sep 1989||25 Sep 1990||U.S. Philips Corporation||Method and system for providing adaptive interactive command response|
|US5127043||15 May 1990||30 Jun 1992||Vcs Industries, Inc.||Simultaneous speaker-independent voice recognition and verification over a telephone network|
|US5127055||11 Feb 1991||30 Jun 1992||Kurzweil Applied Intelligence, Inc.||Speech recognition apparatus & method having dynamic reference pattern adaptation|
|US5230023||30 Jan 1991||20 Jul 1993||Nec Corporation||Method and system for controlling an external machine by a voice command|
|US5297194||22 Jun 1992||22 Mar 1994||Vcs Industries, Inc.||Simultaneous speaker-independent voice recognition and verification over a telephone network|
|US5428707||13 Nov 1992||27 Jun 1995||Dragon Systems, Inc.||Apparatus and methods for training speech recognition systems and their users and otherwise improving speech recognition performance|
|US5457768||12 Aug 1992||10 Oct 1995||Kabushiki Kaisha Toshiba||Speech recognition apparatus using syntactic and semantic analysis|
|US5465317||18 May 1993||7 Nov 1995||International Business Machines Corporation||Speech recognition system with improved rejection of words and sounds not in the system vocabulary|
|US5488652||14 Apr 1994||30 Jan 1996||Northern Telecom Limited||Method and apparatus for training speech recognition algorithms for directory assistance applications|
|US5566272||27 Oct 1993||15 Oct 1996||Lucent Technologies Inc.||Automatic speech recognition (ASR) processing using confidence measures|
|US5602960||30 Sep 1994||11 Feb 1997||Apple Computer, Inc.||Continuous mandarin chinese speech recognition system having an integrated tone classifier|
|US5625748||18 Apr 1994||29 Apr 1997||Bbn Corporation||Topic discriminator using posterior probability or confidence scores|
|US5640485||6 Apr 1995||17 Jun 1997||Nokia Mobile Phones Ltd.||Speech recognition method and system|
|US5644680||25 May 1995||1 Jul 1997||Northern Telecom Limited||Updating markov models based on speech input and additional information for automated telephone directory assistance|
|US5651094||5 Jun 1995||22 Jul 1997||Nec Corporation||Acoustic category mean value calculating apparatus and adaptation apparatus|
|US5684925||8 Sep 1995||4 Nov 1997||Matsushita Electric Industrial Co., Ltd.||Speech representation by feature-based word prototypes comprising phoneme targets having reliable high similarity|
|US5710864||29 Dec 1994||20 Jan 1998||Lucent Technologies Inc.||Systems, methods and articles of manufacture for improving recognition confidence in hypothesized keywords|
|US5717826||11 Aug 1995||10 Feb 1998||Lucent Technologies Inc.||Utterance verification using word based minimum verification error training for recognizing a keyboard string|
|US5737489||15 Sep 1995||7 Apr 1998||Lucent Technologies Inc.||Discriminative utterance verification for connected digits recognition|
|US5737724||8 Aug 1996||7 Apr 1998||Lucent Technologies Inc.||Speech recognition employing a permissive recognition criterion for a repeated phrase utterance|
|US5774841||20 Sep 1995||30 Jun 1998||The United States Of America As Represented By The Adminstrator Of The National Aeronautics And Space Administration||Real-time reconfigurable adaptive speech recognition command and control apparatus and method|
|US5774858||23 Oct 1995||30 Jun 1998||Taubkin; Vladimir L.||Speech analysis method of protecting a vehicle from unauthorized accessing and controlling|
|US5797123||20 Dec 1996||18 Aug 1998||Lucent Technologies Inc.||Method of key-phase detection and verification for flexible speech understanding|
|US5799273||27 Sep 1996||25 Aug 1998||Allvoice Computing Plc||Automated proofreading using interface linking recognized words to their audio data while text is being changed|
|US5832430||8 Dec 1995||3 Nov 1998||Lucent Technologies, Inc.||Devices and methods for speech recognition of vocabulary words with simultaneous detection and verification|
|US5839103||7 Jun 1995||17 Nov 1998||Rutgers, The State University Of New Jersey||Speaker verification system using decision fusion logic|
|US5842163||7 Jun 1996||24 Nov 1998||Sri International||Method and apparatus for computing likelihood and hypothesizing keyword appearance in speech|
|US5893057||18 Oct 1996||6 Apr 1999||Ricoh Company Ltd.||Voice-based verification and identification methods and systems|
|US5893902||15 Feb 1996||13 Apr 1999||Intelidata Technologies Corp.||Voice recognition bill payment system with speaker verification and confirmation|
|US5895447||28 Jan 1997||20 Apr 1999||International Business Machines Corporation||Speech recognition using thresholded speaker class model selection or model adaptation|
|US5899972||29 Sep 1995||4 May 1999||Seiko Epson Corporation||Interactive voice recognition method and apparatus using affirmative/negative content discrimination|
|US5946658||2 Oct 1998||31 Aug 1999||Seiko Epson Corporation||Cartridge-based, interactive speech recognition method with a response creation capability|
|US5960447||13 Nov 1995||28 Sep 1999||Holt; Douglas||Word tagging and editing system for speech recognition|
|US6003002||29 Dec 1997||14 Dec 1999||Texas Instruments Incorporated||Method and system of adapting speech recognition models to speaker environment|
|US6006183||16 Dec 1997||21 Dec 1999||International Business Machines Corp.||Speech recognition confidence level display|
|US6073096||4 Feb 1998||6 Jun 2000||International Business Machines Corporation||Speaker adaptation system and method based on class-specific pre-clustering training speakers|
|US6088669||28 Jan 1997||11 Jul 2000||International Business Machines, Corporation||Speech recognition with attempted speaker recognition for speaker model prefetching or alternative speech modeling|
|US6094632||29 Jan 1998||25 Jul 2000||Nec Corporation||Speaker recognition device|
|US6101467||29 Sep 1997||8 Aug 2000||U.S. Philips Corporation||Method of and system for recognizing a spoken text|
|US6122612||20 Nov 1997||19 Sep 2000||At&T Corp||Check-sum based method and apparatus for performing speech recognition|
|US6151574||8 Sep 1998||21 Nov 2000||Lucent Technologies Inc.||Technique for adaptation of hidden markov models for speech recognition|
|US6182038||1 Dec 1997||30 Jan 2001||Motorola, Inc.||Context dependent phoneme networks for encoding speech information|
|US6192343||17 Dec 1998||20 Feb 2001||International Business Machines Corporation||Speech command input recognition system for interactive computer display with term weighting means used in interpreting potential commands from relevant speech terms|
|US6205426||25 Jan 1999||20 Mar 2001||Matsushita Electric Industrial Co., Ltd.||Unsupervised speech model adaptation using reliable information among N-best strings|
|US6230129||25 Nov 1998||8 May 2001||Matsushita Electric Industrial Co., Ltd.||Segment-based similarity method for low complexity speech recognizer|
|US6233555||24 Nov 1998||15 May 2001||At&T Corporation||Method and apparatus for speaker identification using mixture discriminant analysis to develop speaker models|
|US6233559||1 Apr 1998||15 May 2001||Motorola, Inc.||Speech control of multiple applications using applets|
|US6243713||24 Aug 1998||5 Jun 2001||Excalibur Technologies Corp.||Multimedia document retrieval by application of multimedia queries to a unified index of multimedia data for a plurality of multimedia data types|
|US6292782||9 Sep 1996||18 Sep 2001||Philips Electronics North America Corp.||Speech recognition and verification system enabling authorized data transmission over networked computer systems|
|US6330536||16 Mar 2001||11 Dec 2001||At&T Corp.||Method and apparatus for speaker identification using mixture discriminant analysis to develop speaker models|
|US6374212||13 Mar 2001||16 Apr 2002||At&T Corp.||System and apparatus for recognizing speech|
|US6374221||22 Jun 1999||16 Apr 2002||Lucent Technologies Inc.||Automatic retraining of a speech recognizer while using reliable transcripts|
|US6377662||14 Feb 2000||23 Apr 2002||Avaya Technology Corp.||Speech-responsive voice messaging system and method|
|US6377949||18 Sep 1998||23 Apr 2002||Tacit Knowledge Systems, Inc.||Method and apparatus for assigning a confidence level to a term within a user knowledge profile|
|US6397180||22 May 1996||28 May 2002||Qwest Communications International Inc.||Method and system for performing speech recognition based on best-word scoring of repeated speech attempts|
|US6421640||13 Sep 1999||16 Jul 2002||Koninklijke Philips Electronics N.V.||Speech recognition method using confidence measure evaluation|
|US6438519||31 May 2000||20 Aug 2002||Motorola, Inc.||Apparatus and method for rejecting out-of-class inputs for pattern classification|
|US6438520||20 Jan 1999||20 Aug 2002||Lucent Technologies Inc.||Apparatus, method and system for cross-speaker speech recognition for telecommunication applications|
|US6487532||24 Sep 1998||26 Nov 2002||Scansoft, Inc.||Apparatus and method for distinguishing similar-sounding utterances speech recognition|
|US6496800||1 May 2000||17 Dec 2002||Samsung Electronics Co., Ltd.||Speaker verification system and method using spoken continuous, random length digit string|
|US6505155||6 May 1999||7 Jan 2003||International Business Machines Corporation||Method and system for automatically adjusting prompt feedback based on predicted recognition accuracy|
|US6507816||4 May 1999||14 Jan 2003||International Business Machines Corporation||Method and apparatus for evaluating the accuracy of a speech recognition system|
|US6526380||9 Aug 1999||25 Feb 2003||Koninklijke Philips Electronics N.V.||Speech recognition system having parallel large vocabulary recognition engines|
|US6539078||14 Feb 2000||25 Mar 2003||Avaya Technology Corporation||Speech-responsive voice messaging system and method|
|US6542866||22 Sep 1999||1 Apr 2003||Microsoft Corporation||Speech recognition method and apparatus utilizing multiple feature streams|
|US6567775||26 Apr 2000||20 May 2003||International Business Machines Corporation||Fusion of audio and video based speaker identification for multimedia information access|
|US6571210||13 Nov 1998||27 May 2003||Microsoft Corporation||Confidence measure system using a near-miss pattern|
|US6581036||19 Oct 2000||17 Jun 2003||Var Llc||Secure remote voice activation system using a password|
|US6587824||4 May 2000||1 Jul 2003||Visteon Global Technologies, Inc.||Selective speaker adaptation for an in-vehicle speech recognition system|
|US6594629||6 Aug 1999||15 Jul 2003||International Business Machines Corporation||Methods and apparatus for audio-visual speech detection and recognition|
|US6598017||20 Jul 1999||22 Jul 2003||Canon Kabushiki Kaisha||Method and apparatus for recognizing speech information based on prediction|
|US6606598||21 Sep 1999||12 Aug 2003||Speechworks International, Inc.||Statistical computing and reporting for interactive speech applications|
|US6629072||28 Aug 2000||30 Sep 2003||Koninklijke Philips Electronics N.V.||Method of an arrangement for speech recognition with speech velocity adaptation|
|US6675142||21 Sep 2001||6 Jan 2004||International Business Machines Corporation||Method and apparatus for improving speech recognition accuracy|
|US6732074||27 Jan 2000||4 May 2004||Ricoh Company, Ltd.||Device for speech recognition with dictionary updating|
|US6735562||5 Jun 2000||11 May 2004||Motorola, Inc.||Method for estimating a confidence measure for a speech recognition system|
|US6754627||1 Mar 2001||22 Jun 2004||International Business Machines Corporation||Detecting speech recognition errors in an embedded speech recognition system|
|US6766295||10 May 1999||20 Jul 2004||Nuance Communications||Adaptation of a speech recognition system across multiple remote sessions with a speaker|
|US6799162||15 Dec 1999||28 Sep 2004||Sony Corporation||Semi-supervised speaker adaptation|
|US6832224||1 Apr 2002||14 Dec 2004||Tacit Software, Inc.||Method and apparatus for assigning a confidence level to a term within a user knowledge profile|
|US6834265||13 Dec 2002||21 Dec 2004||Motorola, Inc.||Method and apparatus for selective speech recognition|
|US6868381||21 Dec 1999||15 Mar 2005||Nortel Networks Limited||Method and apparatus providing hypothesis driven speech modelling for use in speech recognition|
|US6879956||29 Sep 2000||12 Apr 2005||Sony Corporation||Speech recognition with feedback from natural language processing for adaptation of acoustic models|
|US6882972||5 Oct 2001||19 Apr 2005||Sony International (Europe) Gmbh||Method for recognizing speech to avoid over-adaptation during online speaker adaptation|
|US6961700||18 Mar 2002||1 Nov 2005||Allvoice Computing Plc||Method and apparatus for processing the output of a speech recognition engine|
|US6961702||6 Nov 2001||1 Nov 2005||Telefonaktiebolaget Lm Ericsson (Publ)||Method and device for generating an adapted reference for automatic speech recognition|
|US7031918||20 Mar 2002||18 Apr 2006||Microsoft Corporation||Generating a task-adapted acoustic model from one or more supervised and/or unsupervised corpora|
|US7039166 *||4 Mar 2002||2 May 2006||Verizon Corporate Services Group Inc.||Apparatus and method for visually representing behavior of a user of an automated response system|
|US7050550||10 May 2002||23 May 2006||Koninklijke Philips Electronics N.V.||Method for the training or adaptation of a speech recognition device|
|US7062441||13 May 1999||13 Jun 2006||Ordinate Corporation||Automated language assessment using speech recognition modeling|
|US7065488||28 Sep 2001||20 Jun 2006||Pioneer Corporation||Speech recognition system with an adaptive acoustic model|
|US7072750 *||8 May 2001||4 Jul 2006||Intel Corporation||Method and apparatus for rejection of speech recognition results in accordance with confidence level|
|US7203651||7 Dec 2001||10 Apr 2007||Art-Advanced Recognition Technologies, Ltd.||Voice control system with multiple voice recognition engines|
|US7216148||30 Oct 2001||8 May 2007||Hitachi, Ltd.||Storage system having a plurality of controllers|
|US7266494 *||10 Nov 2004||4 Sep 2007||Microsoft Corporation||Method and apparatus for identifying noise environments from noisy signals|
|US7392186||30 Mar 2004||24 Jun 2008||Sony Corporation||System and method for effectively implementing an optimized language model for speech recognition|
|US7406413||7 May 2003||29 Jul 2008||Sap Aktiengesellschaft||Method and system for the processing of voice data and for the recognition of a language|
|US7457745||3 Dec 2003||25 Nov 2008||Hrl Laboratories, Llc||Method and apparatus for fast on-line automatic speaker/environment adaptation for speech/speaker recognition in the presence of changing environments|
|US20010016816||11 Dec 2000||23 Aug 2001||Helmut Lucke||Method for recognizing speech|
|US20020026312||12 Jun 2001||28 Feb 2002||Tapper Paul Michael||Method for entering characters|
|US20020032566||26 Jul 1999||14 Mar 2002||Eli Tzirkel-Hancock||Apparatus, method and computer readable memory medium for speech recogniton using dynamic programming|
|US20020049593||3 Jul 2001||25 Apr 2002||Yuan Shao||Speech processing apparatus and method|
|US20020052742||12 Mar 2001||2 May 2002||Chris Thrasher||Method and apparatus for generating and displaying N-best alternatives in a speech recognition system|
|US20020103656||30 Jan 2001||1 Aug 2002||Bahler Lawrence G.||Automatic confirmation of personal notifications|
|US20020135609||24 Jan 2001||26 Sep 2002||Damiba Bertrand A.||System, method and computer program product for a transcription graphical user interface|
|US20020138274||26 Mar 2001||26 Sep 2002||Sharma Sangita R.||Server based adaption of acoustic models for client-based speech systems|
|US20020143540||28 Mar 2001||3 Oct 2002||Narendranath Malayath||Voice recognition system using implicit speaker adaptation|
|US20020152071||12 Apr 2001||17 Oct 2002||David Chaiken||Human-augmented, automatic speech recognition engine|
|US20020161581||28 Mar 2001||31 Oct 2002||Morin Philippe R.||Robust word-spotting system using an intelligibility criterion for reliable keyword detection under adverse and unknown noisy environments|
|US20020173955||16 May 2001||21 Nov 2002||International Business Machines Corporation||Method of speech recognition by presenting N-best word candidates|
|US20020173956||16 May 2001||21 Nov 2002||International Business Machines Corporation||Method and system for speech recognition using phonetically similar word alternatives|
|US20020177999||4 May 1999||28 Nov 2002||Kerry A. Ortega||Method and apparatus for evaluating the accuracy of a speech recognition system|
|US20020178004||23 May 2001||28 Nov 2002||Chienchung Chang||Method and apparatus for voice recognition|
|US20020193991||13 Jun 2001||19 Dec 2002||Intel Corporation||Combining N-best lists from multiple speech recognizers|
|US20020198710||13 Aug 2002||26 Dec 2002||Gustavo Hernandez-Abrego||System and method for speech verification using a robust confidence measure|
|US20020198712||11 Jun 2002||26 Dec 2002||Hewlett Packard Company||Artificial language generation and evaluation|
|US20030004721||27 Jun 2001||2 Jan 2003||Guojun Zhou||Integrating keyword spotting with graph decoder to improve the robustness of speech recognition|
|US20030023438||18 Apr 2002||30 Jan 2003||Hauke Schramm||Method and system for the training of parameters of a pattern recognition system, each parameter being associated with exactly one realization variant of a pattern from an inventory|
|US20030036903||16 Aug 2001||20 Feb 2003||Sony Corporation||Retraining and updating speech models for speech recognition|
|US20030120486||19 Dec 2002||26 Jun 2003||Hewlett Packard Company||Speech recognition system and method|
|US20030125945||14 Dec 2001||3 Jul 2003||Sean Doyle||Automatically improving a voice recognition system|
|US20030139925||31 Dec 2001||24 Jul 2003||Intel Corporation||Automating tuning of speech recognition systems|
|US20030149561||1 Feb 2002||7 Aug 2003||Intel Corporation||Spoken dialog system using a best-fit language model and best-fit grammar|
|US20030154075||29 Dec 1998||14 Aug 2003||Thomas B. Schalk||Knowledge-based strategies applied to n-best lists in automatic speech recognition systems|
|US20030154076||11 Feb 2003||14 Aug 2003||Thomas Kemp||Method for recognizing speech/speaker using emotional change to govern unsupervised adaptation|
|US20030191639||5 Apr 2002||9 Oct 2003||Sam Mazza||Dynamic and adaptive selection of vocabulary and acoustic models based on a call context for speech recognition|
|US20030220791||25 Apr 2003||27 Nov 2003||Pioneer Corporation||Apparatus and method for speech recognition|
|US20040024601||31 Jul 2002||5 Feb 2004||Ibm Corporation||Natural error handling in speech recognition|
|US20040215457||17 Oct 2001||28 Oct 2004||Carsten Meyer||Selection of alternative word sequences for discriminative adaptation|
|US20050055205||27 Aug 2004||10 Mar 2005||Thomas Jersak||Intelligent user adaptation in dialog systems|
|US20050071161||17 Sep 2004||31 Mar 2005||Delta Electronics, Inc.||Speech recognition method having relatively higher availability and correctiveness|
|US20050080627 *||2 Jul 2003||14 Apr 2005||Ubicall Communications En Abrege "Ubicall" S.A.||Speech recognition device|
|US20050086055||2 Sep 2004||21 Apr 2005||Masaru Sakai||Voice recognition estimating apparatus, method and program|
|US20050137868 *||19 Dec 2003||23 Jun 2005||International Business Machines Corporation||Biasing a speech recognizer based on prompt context|
|US20060178882 *||4 Feb 2005||10 Aug 2006||Vocollect, Inc.||Method and system for considering information about an expected response when performing speech recognition|
|US20070073540||15 Mar 2006||29 Mar 2007||Hideki Hirakawa||Apparatus, method, and computer program product for speech recognition allowing for recognition of character string in speech input|
|US20070192095 *||6 Oct 2006||16 Aug 2007||Braho Keith P||Methods and systems for adapting a model for a speech recognition system|
|EP0867857A2||27 Mar 1998||30 Sep 1998||Dragon Systems Inc.||Enrolment in speech recognition|
|EP0905677B1||25 Sep 1998||5 Nov 2003||NORTEL NETWORKS France||Speech recognition method|
|EP1011094B1||17 Dec 1998||2 Mar 2005||Sony Corporation||Semi-supervised speaker adaption|
|EP1377000B1||11 Jun 2003||22 Apr 2009||Swisscom (Schweiz) AG||Method used in a speech-enabled automatic directory system|
|WO2005119193A1||24 May 2005||15 Dec 2005||Philips Intellectual Property & Standards Gmbh||Performance prediction for an interactive speech recognition system|
|WO2006031752A2||9 Sep 2005||23 Mar 2006||Soliloquy Learning, Inc.||Microphone setup and testing in voice recognition software|
|1||3-Page International Search Report mailed Nov. 6, 2007 for PCT/US2007/065652.|
|2||5-Page International Search Report mailed Nov. 20, 2007 for PCT/US2007/065629.|
|3||5-Page International Search Report mailed Nov. 6, 2007 for PCT/US2007/065615.|
|4||Anderson et al., Automating tuning of speech recognition systems., Published Jul. 24, 2003.|
|5||Bahler et al., Automatic confirmation of personal notifications., Published Aug. 1, 2002.|
|6||Bennett et al., Combining n-best lists from multiple speech recognizers., Published Dec. 19, 2002.|
|7||Brittan et al., Speech recognition system and method., Published Jun. 26, 2003.|
|8||Chaiken et al., Human-augmented, automatic speech recognition engine., Published Oct. 17, 2002.|
|9||Chengyi Zheng and Yonghong Yan, Improving Speaker Adaptation by Adjusting the Adaptation Data Set.|
|10||Christensen, "Speaker Adaptation of Hidden Markov Models using Maximum Likelihood Linear Regression", Thesis, Aalborg University, Apr. 1996.|
|11||Damiba, System, method and computer program product for a transcription graphical user interface., Published Sep. 26, 2002.|
|12||Hartley et al., Method and system for speech recognition using phonetically similar word alternatives., Published Nov. 21, 2002.|
|13||Hernandez-Abrego et al., System and method for speech verification using a robust confidence measure., Published Dec. 26, 2002.|
|14||Hinde et al., Artificial language generation and evaluation., Published Dec. 26, 2002.|
|15||International Search Report mailed May 26, 2006.|
|16||Kellner, A. et al., Strategies for Name Recognition in Automatic Directory Assistance Systems, Interactive Voice Technology for Telecommunications Applications, IVTTA '98 Proceedings, 1998 IEEE 4th Workshop, Sep. 29, 1998.|
|17||Lucke, Method for recognizing speech., Published Aug. 23, 2001.|
|18||Mokbel, "Online Adaptation of HMMs to Real-Life Conditions: A Unified Framework", IEEE Trans. on Speech and Audio Processing, May 2001.|
|19||Morin, Robust word-spotting system using an intelligibility criterion for reliable keyword detection under adverse and unknown noisy environments., Published Oct. 31, 2002.|
|20||Reich, Method of speech recornition by presenting n-best word candidates., Published Nov. 21, 2002.|
|21||Schalk et al., Knowledge-based strategies applied to n-best lists in automatic speech recognition systems., Published Aug. 14, 2003.|
|22||Shao, Speech processing apparatus and method., Published Apr. 25, 2002.|
|23||Silke Goronzy, Krzysztof Marasek, Ralf Kompe, Semi-Supervised Speaker Adaptation, in Proceedings of the Sony Research Forum 2000, vol. 1, Tokyo, Japan, 2000.|
|24||Silke Goronzy, Krzysztof Marasek, Ralf Kompe, Semi-Supervised Speaker Adaptation, Sony International (Europe) GmbH, Advanced Technology Center Stuttgart (ACTS), Home Network Company Europe, Man Machine Interfaces.|
|25||Smith, Ronnie W., An Evaluation of Strategies for Selective Utterance Verification for Spoken Natural Language Dialog, Proc. Fifth Conference on Applied Natural Language Processing (ANLP), 1997, 41-48.|
|26||Tapper, Method for entering characters., Published Feb. 28, 2002.|
|27||Thrasher et al., Method and apparatus for generating and displaying n-best alternatives in a speech recognition system., Published May 2, 2002.|
|28||Tzirkel-Hancock et al., Apparatus, method and computer readable memory medium for speech recognition using dynamic programming., Published Mar. 14, 2002.|
|29||Zhou, Integrating keyword spotting with graph decoder to improve the robustness of speech recognition., Published Jan. 2, 2003.|
|30||Zhou, Spoken dialog system using a best-fit language model and best-fit grammar., Published Aug. 7, 2003.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US8255219||9 Mar 2011||28 Aug 2012||Vocollect, Inc.||Method and apparatus for determining a corrective action for a speech recognition system based on the performance of the system|
|US8374870||9 Mar 2011||12 Feb 2013||Vocollect, Inc.||Methods and systems for assessing and improving the performance of a speech recognition system|
|US8407047 *||31 Mar 2009||26 Mar 2013||Fujitsu Limited||Guidance information display device, guidance information display method and recording medium|
|US8515762 *||22 Jan 2009||20 Aug 2013||Microsoft Corporation||Markup language-based selection and utilization of recognizers for utterance processing|
|US8612235||8 Jun 2012||17 Dec 2013||Vocollect, Inc.||Method and system for considering information about an expected response when performing speech recognition|
|US8756059 *||30 Dec 2010||17 Jun 2014||Vocollect, Inc.||Method and system for considering information about an expected response when performing speech recognition|
|US8868421||11 Oct 2010||21 Oct 2014||Vocollect, Inc.||Methods and systems for identifying errors in a speech recognition system|
|US8914290||18 May 2012||16 Dec 2014||Vocollect, Inc.||Systems and methods for dynamically improving user intelligibility of synthesized speech in a work environment|
|US8958848 *||16 Jun 2008||17 Feb 2015||Lg Electronics Inc.||Mobile terminal and menu control method thereof|
|US9076459||12 Mar 2013||7 Jul 2015||Intermec Ip, Corp.||Apparatus and method to classify sound to detect speech|
|US9202458||11 Oct 2010||1 Dec 2015||Vocollect, Inc.||Methods and systems for adapting a model for a speech recognition system|
|US9299344||1 Jul 2015||29 Mar 2016||Intermec Ip Corp.||Apparatus and method to classify sound to detect speech|
|US9497305||12 Jan 2015||15 Nov 2016||Lg Electronics Inc.||Mobile terminal and menu control method thereof|
|US9576578 *||12 Aug 2015||21 Feb 2017||Google Inc.||Contextual improvement of voice query recognition|
|US9692865||30 Sep 2016||27 Jun 2017||Lg Electronics Inc.||Mobile terminal and menu control method thereof|
|US9697818||5 Dec 2014||4 Jul 2017||Vocollect, Inc.||Systems and methods for dynamically improving user intelligibility of synthesized speech in a work environment|
|US20060143007 *||31 Oct 2005||29 Jun 2006||Koh V E||User interaction with voice information services|
|US20090253463 *||16 Jun 2008||8 Oct 2009||Jong-Ho Shin||Mobile terminal and menu control method thereof|
|US20090326943 *||31 Mar 2009||31 Dec 2009||Fujitsu Limited||Guidance information display device, guidance information display method and recording medium|
|US20100185447 *||22 Jan 2009||22 Jul 2010||Microsoft Corporation||Markup language-based selection and utilization of recognizers for utterance processing|
|US20110093269 *||30 Dec 2010||21 Apr 2011||Keith Braho|
|US20170061959 *||1 Sep 2015||2 Mar 2017||Disney Enterprises, Inc.||Systems and Methods For Detecting Keywords in Multi-Speaker Environments|
|EP2779160A1||4 Mar 2014||17 Sep 2014||Intermec IP Corp.||Apparatus and method to classify sound to detect speech|
|EP3023979A1||26 Oct 2015||25 May 2016||Hand Held Products, Inc.||Method and system for recognizing speech using wildcards in an expected response|
|EP3023980A1||3 Nov 2015||25 May 2016||Hand Held Products, Inc.||Concatenated expected responses for speech recognition|
|Cooperative Classification||G10L15/1815, G10L15/08|
|3 May 2005||AS||Assignment|
Owner name: VOCOLLECT, INC., PENNSYLVANIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BRAHO, KEITH;EL-JAROUDI, AMRO;PIKE, JEFFREY;REEL/FRAME:016188/0001
Effective date: 20050207
|18 Jun 2007||AS||Assignment|
Owner name: PNC BANK, NATIONAL ASSOCIATION, AS AGENT, PENNSYLV
Free format text: SECURITY AGREEMENT;ASSIGNOR:VOCOLLECT, INC.;REEL/FRAME:019458/0223
Effective date: 20050713
|7 Mar 2011||AS||Assignment|
Owner name: VOCOLLECT, INC., PENNSYLVANIA
Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:PNC BANK, NATIONAL ASSOCIATION;REEL/FRAME:025912/0205
Effective date: 20110302
|24 Jun 2014||FPAY||Fee payment|
Year of fee payment: 4