Patent Application
20180190269
The present invention is in the field of computer systems and, more specifically, to systems that use automatic speech recognition with phonetic dictionaries to communicate using select pronunciations.
The Carnegie Mellon University (CMU) notation for English language phonemes include:
AA as in odd
AE as in at
AH as in hut
AO as in ought
AW as in cow
AY as in hide
Bas in be
CH as in cheese
Das in dee
DH as in thee
EH as in Ed
ER as in hurt
EY as in ate
F as in fee
Gas in green
HH as in he
IH as in it
IY as in eat
JH as in gee
K as in key
L as in lee
M as in me
N as in knee
NG as in ping
OW as in oat
OY as in toy
P as in pee
R as in read
S as in sea
SH as in she
T as in tea
TH as in theta
UH as in hood
UW as in two
Vas in vee
W as in we
Y as in yield
Z as in zee
ZH as in seizure
Modern automatic speech recognition (ASR) technology is improving at an ability to recognize speakers' words, even when speakers have different accents and use different pronunciations of words. Some ASR systems are able to recognize both S AE N JH OW Z and S AA N HH OW S EY as the word “San Jose”. Note that some words, such as “San Jose”, contain multiple parts separate by a space. Some words include hyphens, such as “give-and-take”. Some words are acronyms (pronounced as a word) and initialisms (pronounced letter by letter) that may alternatively be pronounced as individual letters or as if a spoken word, such as “MPEP”, pronounced as EH M P IY IY P IY or EH M P EH P.
Many words have one strongly preferred pronunciation, such as “San Jose”. Some words have multiple generally acceptable pronunciations, such as “tomato”, for which pronunciations T AH M EY T OW and T AH M AA T OW are both generally acceptable. That fact was popularized in the song Let's Call the Whole Thing Off by George and Ira Gershwin. Such systems use a phonetic dictionary to map sequences of graphemes to phonemes. Many systems use proprietary phonetic dictionaries, but CMUdict from researchers at Carnegie Mellon University is a widely used and freely available one.
Some systems have speech synthesis functions that produce audio samples that, when sent to a digital to analog converter, amplifier, and played through a speaker produce speech back to users. They also use phonetic dictionaries, but with one sequence of phonemes for the pronunciation of each word. When they produce speech with a pronunciation that is unfamiliar to a user, it is either disconcerting for the user or completely misunderstood by the user. Either users need to figure out the system's pronunciation or designers need to design systems to use pronunciations that users expect. Designing such systems is impossible, particularly for words with multiple generally acceptable pronunciations. Therefore, what is needed is a system that can teach users common pronunciations and systems that can learn users' preferred pronunciations.
The present invention provides for systems to teach users common pronunciations and for users to teach systems their personally preferred pronunciations. Various forms of speech synthesis are appropriate. Text-to-speech (TTS) is commonly used, but other means are appropriate. Speech synthesis uses a phonetic dictionary of preferred pronunciations in order to produce speech output. The present invention, accordingly, is not abstract, but rather a specific improvement in the field of speech synthesis given the details provided with respect to the system and methods outlined. More specifically, in some embodiments, the preferred pronunciation phonetic dictionary has generally preferred pronunciations. When the system captures speech through ASR, it responds to the user with the preferred pronunciation.
A simple system receives and recognizes user speech to produce a transcription; detects an interruption point in the user speech, such as by using and end-of-utterance detection; then generates speech output from the transcription, doing so using the preferred pronunciations. As a result, users can hear their own words spoken back with preferred pronunciation. This is useful for training users in the system language.
In some embodiments, transcriptions are plain text strings. In some embodiments, transcriptions include special characters or escape codes to embed meta information. In some embodiments transcriptions are represented using a markup language such as Speech Synthesis Markup Language (SSML). Transcriptions might include transcription errors. Common causes of transcription errors are background noise during audio capture, distortion due to analog components or signal processing, loss of transmitted data, or unusual vocal characteristics of speakers, such as thick accents or young age. With most transcription errors, the generated speech output is obviously incorrect.
Many systems do more than provide language training to users by parroting their words. Many systems provide various useful results as output synthesized speech. Some examples are virtual assistants, navigation systems, telephone interactive voice response systems, automatic real-time language interpreters, voice-controlled music players, and interactive robots.
Some training systems allow for selection of different synthesized voices. Some training systems allow for different sets of preferred pronunciations, such as would be appropriate for different dialects. Some training systems indicate to the user which words the user spoke with a pronunciation other than the desired one. Such indications can be by color or weight of text in a visual transcription, by emphasizing in the synthesized speech the users' alternately pronounced word, or by other means of indicating particular words to a user.
Some training systems do ASR with an extended set of phonemes beyond those conventionally recognized in the system's spoken language. Some such systems indicate a degree of mispronunciation based on the distance of the recognized phonemes from those of the preferred pronunciation of words.
The invention is applicable within many physical devices. It can be implemented within general-purpose mobile phones, desktop computers, and servers, but also within specialized devices such as training school kiosks and small, power-optimized, wearable devices such as headsets.
Some embodiments classify users based on the pronunciations detected in their recognized speech. Some such systems include pre-defined classifications of dialects. Some such systems compute correlations between the pronunciation variations of particular words between users to classify users automatically. Classification can be either in groups or on a continuum in any number of dimensions.
Some classifications are based on, for example, a dozen or so regional variants, larger numbers of machine-learning-generated classes based on correlations between frequency of certain pronunciations across users, ethnic background, or socioeconomic status. Some embodiments perform classification by as little as a single words' pronunciation. Some embodiments perform classification on many words' pronunciations.
Some embodiments adapt to user speech. They identify, for words that have multiple acceptable pronunciations, which pronunciation speakers use. Such embodiments store lists of words and their user-preferred pronunciations. When speech synthesis uses a word, it chooses the preferred pronunciation. Pronunciations can be updated if a speaker uses the word again with a different pronunciation.
For words that a certain speaker has never spoken, some such systems identify preferred pronunciations of one or more other speakers who are classified the same as the certain speaker. Similarly, some systems predict preferred pronunciations for a certain user based on the preference of other users with a high degree of correlation, based on identified preferred word pronunciations, to the certain user.
Systems that store preferred pronunciations are able to learn the generally preferred pronunciations of proper nouns and abbreviations. By comparing preferred pronunciations across many users, such a system learns, and thereby it is able to provide training to other users.
All statements herein reciting principles, aspects, and embodiments of the invention as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents and equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure. It is noted that, as used herein, the singular forms “a,” “an” and “the” include plural referents unless the context clearly dictates otherwise. Reference throughout this specification to “one aspect,” “another aspect,” “one embodiment,” “an embodiment,” “certain embodiment,” or similar language means that a particular aspect, feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the invention. Thus, appearances of the phrases “in one embodiment,” “in at least one embodiment,” “in an embodiment,” “in certain embodiments,” and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment or similar embodiments.
The present invention is applicable to essentially any human language. This disclosure uses English as an example.
The invention is useful in cases where lexemes, or specifically their computer representations, correspond to multiple generally acceptable pronunciations. The word tomato is an example in English. In Mandarin Chinese, the character is an example. It is pronounced B OW as in the phrase
, and it is pronounced P UW as in the phrase
. In Japanese, the character
is an example. It can be pronounced OW as in the word
OW AA M EY, but
can also be pronounced D AY as in the word
D AY G AA S Y OW. In Korean, the particle II is an example. In the word
it is pronounced
, but in the word
it pronounced like
. In French, the word fils is an example. Fils, referring to male children is pronounced F IY S, and fils referring to fine strings is pronounced F IY L.
One embodiment of the invention is a system that performs a method that can be useful for training users to use standard pronunciations of words. The system captures the audio of speech until detecting an end-of-utterance (EOU). The system performs ASR on the speech audio to produce a textual transcription of the utterance. Some embodiments perform incremental ASR, which can give lower latency for responses because the system can do much of the processing before the EOU. Some embodiments perform ASR only after the EOU. With sufficient processing performance, this can allow for simpler ASR algorithms and potentially better results with temporally bi-direction algorithms.
After capturing an utterance up to an EOU, the system uses the transcription to synthesize speech audio using a desirable accent and voice, and generally preferred pronunciation of words. If, for example, a user says, “EH S S IY Y UW B IY EY IH N S AE N JH UW W AA N”, the system produces a transcription, “SCUBA in San Juan”, and produces speech audio output, “S K UW B AH IH N S AE N HH W AA N”.
Some embodiments use a standard text representation, such as American Standard Code for Information Interchange (ASCII). Any other means of representing words is possible, such as by using machine learning to correlate audio segments with conceptual meanings. Some embodiments use traditional text-to-speech (TTS) algorithms based on either concatenation of speech samples or parametric synthesis. Some embodiments use mappings of concept representations to desirable output speech audio.
Speech engine 21 looks up mappings of words to phoneme sequences using a phonetic dictionary 22. Based on sequence hypotheses and their scores and what orders of phonemes match words in phonetic dictionary 22, the speech engine produces text that is the most likely hypothesis of what the user said. Speech engines are good, and improving, and can correctly transcribe what users say into text most of the time for even long sequences of words and for users with many kinds of voices, accents, and environments of background noise. Because many words have multiple acceptable pronunciations, phonetic dictionary 22 stores multiple pronunciations for many words of the same textual representation. For example, phonetic dictionary 22 has both T AH M EY T OW and T AH M AA T OW for the text, “tomato”.
The embodiment of
In some embodiments, phonetic dictionary 24 includes multiple entries with the same spelling in the case of heteronyms that have the same spelling but different pronunciations based on meanings, such as the word “desert”, pronounced D EH Z ER T for a hot, dry, sandy region or pronounced D IH Z ER T for the act of abandoning others in a bad situation. Such multiple entries are tagged by their specific meanings, and the system uses an interpretation, according to a semantic grammar, to determine which meaning is appropriate for the speech synthesis. Some embodiments have multiple entries for text words that have the same meaning, but different pronunciations based on syntax, such as the word “the” which is pronounced DH AH when placed before a word that begins with a consonant and pronounced DH IY when placed before a word that begins with a vowel.
Linguists often associate numbers of recognizable phonemes in each language: approximately 40 for English, approximately 40 for Mandarin Chinese, approximately 25 for Spanish, approximately 25 for Japanese, approximately 45 for German, approximately 25 for Korean, approximately 77 for Lithuanian. The set of phonemes actually used by any particular speaker of a language varies based on their dialect, accent, and native language.
Whereas a typical English phonetic dictionary has many, but a minority of words with multiple pronunciations, some embodiments use a hyperphonetic dictionary. A hyperphonetic dictionary recognizes more than the normal number of phonemes for a language, such as 100 or more. Such phonetic dictionaries are able to recognize multiple pronunciations for almost all words. Each pronunciation has a distance from a particular generally preferred pronunciation.
Some speech synthesis modules are able to produce speech with emphasis on particular words. Markup languages such as SSML are useful to represent degrees of emphasis for particular words for speech synthesis modules to produce. Some speech synthesis modules are able to synthesize speech with different degrees of stress on particular syllables. Syllables are units of organization for sequences of speech sounds, typically comprising a nucleus (most often a vowel) with optional initial and final margins (typically, consonants). In the embodiment of
Some embodiments apply emphasis, at per-word granularity, based on the average degree of mispronunciation of all of the phonemes in the word. Some embodiments synthesize speech with word emphasis or syllable stress only on the word of the utterance that had the highest error value.
The mobile device 41 runs an app that uses the display 42 to show a visual display of the text transcription 43 of each utterance. The embodiment of
In natural human speech, word emphasis can affect the implied meaning of an utterance. The phrase, “bought a car” with stress on the word “bought” would imply not receiving a car as a gift. With stress on the word “car” the phrase implies not buying a bicycle. Furthermore, other prosodic aspects of utterances, such as their speed, are meaningful to users. In order for users to hear the most similar speech output to their speech input, some embodiments detect emphasis, speed, pitch variation, and other prosody attributes and use those for speech synthesis to mimic user speech. Some embodiments repeat user speech, but change emphasis from the spoken speech to the most mispronounced word, but only if the pronunciation error value is above a threshold.
Some speakers are better able to identify their mispronunciations if they listen to a recording of their speech, rather than just hearing themselves as they speak. Some embodiments record the input spoken utterance and store the audio. At the end of utterance, the system first plays back the recorded audio, and then plays the synthesized speech with corrected pronunciation. Thereby, a user is able to aurally compare the utterance, as spoken, and the same utterance using preferred pronunciations.
Headset unit 51 is controlled by a system-on-chip (SoC).
Some embodiments are devices with microphones and low-power mobile processors optimized for audio digital signal processing (DSP) processing, such as with single-instruction multiple-data (SIMD) instruction set extensions. Some embodiments are cloud data center servers that receive digital audio samples over networks from remote microphone-enabled devices. Some such data center processors are massively parallel multi-core processors designed for load balancing the processing tasks for many simultaneous utterances. The power-performance profile and cost of general-purpose processors or even graphics processing units (GPUs) would be impractical for efficient data center operations when serving many simultaneous users.
Some system users, based on their region or dialect, prefer to hear synthesized speech using localized pronunciations.
Variation classifier 75 stores its detected class, and outputs it as a selection signal to the set of preferred pronunciation phonetic dictionaries 74. Speech synthesis unit 23 uses the selected preferred pronunciation phonetic dictionary 74 to produce synthesized speech audio using familiar pronunciations.
Variation classifier 75 continuously performs classification, and compares its identified class to its stored class. If the identified class does not match the stored class for several utterances in a row, the variation classifier 75 changes its stored class to the identified class, and outputs the new class as the selection signal.
In some embodiments, the per-class pronunciation variation data 76 includes a large portion of words in the phonetic dictionaries. In some embodiments, the per-class pronunciation variation data only includes a small number of frequently spoken words that are very distinct between dialect classes. For example, the word, “lawyer” is pronounced L OY ER in northeastern and western US, but pronounced L AO Y ER in the southern US.
Referring to
The dictionary samples of
Some embodiments use a single preferred pronunciation phonetic dictionary, but have multiple entries for words with varying dialect-specific pronunciations. Such embodiments choose between the pronunciations based on the selection signal. Some embodiments have a single phonetic dictionary for the speech engine and the speech synthesis module. The phonetic dictionary includes multiple pronunciations, but indicates one as preferred, such as by placing it first on a list of pronunciations. Some embodiments with a single phonetic dictionary support dialect-specific pronunciations by tagging separate specific preferred pronunciations based on each class, as indicated by a class selection signal.
Certain classes of speakers tend to have corresponding accents. Some embodiments include a speech engine that uses acoustic models, such that the acoustic model can be selected. Various acoustic models are trained on speech with different accents. The selection signal from a variation classifier drives both the selection of a preferred pronunciation phonetic dictionary and selection of an acoustic model for the speech recognition front end. Some systems apply adaptation algorithms to baseline acoustic models.
Some embodiments customize speech synthesis based on what pronunciations a user tends to speak. Some embodiments mimic the user's pronunciation. Some embodiments adjust pronunciations in other ways that do not always mimic, but sometimes mimic and sometimes guide and teach the user by choosing different pronunciations. For example, a system mimics the user's preference for pronunciations when both are widely accepted, but uses the more common pronunciation when it is significantly more common than an alternative. Accordingly, such a system mimics a user's choice of T AH M EY T OW or T AH M AA T OW, but pronounces the acronym “NASA” as N AE S AH, even if the user tends to use the rare pronunciation, N EY S AH.
Referring now to
In embodiments without semantic parsing, speech engine 91 produces transcription text output. In embodiments with semantic parsing, speech engine 91 produces representations of the meaning of utterances. A handler 94 processes the transcription or meaning and performs a desirable system function. In virtual assistant systems, the handler 94 looks up answers to questions. In autonomous vehicles, the handler 94 drives the vehicle to specified locations. In communication devices, the handler 94 sends messages. The handler 94 eventually produces response text. In some embodiments, it is a plain text string. In some embodiments, it has pronunciation indications, such as stress, and in some embodiments, it includes meaning indications useful for looking up particular ones of multiple entries of word text in the phonetic dictionary.
A list manager 95 receives the transcription text or meaning representation from speech engine 91, as well as a pronunciation indicator. For example, for the word “aunt”, the speech engine 91 either produces the text aunt:0 or aunt:1 depending on which pronunciation the user spoke. List manager 95, monitors words flowing from the speech engine 91 to the handler 94. For each word that has more than one recognized pronunciation, the list manager 95 looks into a word list 96 within a user profile 97. If the word is in the word list 96, then the list manager 95 updates the preferred pronunciation to whichever pronunciation was spoken. If the word is not in the word list 96, then the list manager 95 adds the word to the list with the indication of the pronunciation that the user spoke.
User profile 97 is specific to whichever known system that the user is logged in and authenticated. In some embodiments, user profiles are tied to device IDs. In some embodiments, user profiles are shared among groups of users. In some embodiments, user profiles comprise information other than word lists, such as an indication of a preferred speech synthesis voice, speech speed, location, and credit card number, among other information.
Pronunciation selector 98 receives response text from handler 94. In many embodiments, the response text is different from the spoken user text. However, it is normal that, after a user uses the system for a significant number of utterances, some responses will use words that the user spoke. For example, if a user asks, “What's the weather in Bangor, Maine”, the system might respond, “Cold and rainy”, but if the user asks, one week later, “What's the nearest shopping center”, the system might respond, “The Bangor Mall”, using the same pronunciation of Bangor that the user spoke in the first utterance.
The pronunciation selector 98 provides this behavior by, when receiving response text, searching the word list 96 for each word in the response text. For each response text word found in the word list 96, the pronunciation selector 98 selects, from the phonetic dictionary 92, the stored preferred pronunciation. For each response text word not found in the word list 96, the pronunciation selector 98 selects the generally preferred (most common, and first-listed) pronunciation of each word from the phonetic dictionary 92.
The pronunciation selector sends the response phoneme sequence to speech synthesis module 99, which produces speech audio. In system variations that produce meanings, rather than just response text from the handler 94, the pronunciation selector 98 passes the stress indicators specific to the response word meaning to the speech synthesis module 99.
Referring to
Most Americans pronounce the word, “park” as P AA R K and “corn” as K AO R N, but people native to Boston commonly pronounce them P AA K and K AO N. Some embodiments use user profile information to select dialect-specific phonetic dictionaries for speech synthesis. Some embodiments, upon identifying one or more word pronunciations that distinctly indicate a particular dialect or set of possible dialects, change the phonetic dictionary, or adjust the preference order of pronunciations in a phonetic dictionary, thereby adopting full dictionaries of dialectic pronunciations likely preferred by the user.
Certain groups of people have sets of pronunciations. For example, most people in the US pronounce the word, “been”, as B IH N, but people in the Upper Midwest are more likely to pronounce the word as B EH N. Most people in the US pronounce the word “roof” as R UW F, but people in the Upper Midwest are more likely to pronounce the word as R UH F. There is a distinct positive correlation between the pronunciations B EH N and R UH F.
Some embodiments use known pronunciation correlations, such as these, to adapt a phonetic dictionary. This is a more fine-grained approach that uses specific correlations that do not identify distinct dialects. Linguists study such correlations, and their strengths. Such embodiments use correlation rules defined by linguistic analysis.
Some embodiments identify correlations between pronunciations, across users, and train their own phonetic dictionary adaptation rules. By performing a multiple correlation between each word pronunciation and all other word pronunciations, a system can most accurately choose an individual user's preferred pronunciation based on their personal word list. In practice, a real-time multiple correlation based on all words in the user's word list would require more processing time and power than is worthwhile for the user experience benefit. Therefore, some embodiments choose certain benchmark words that are both common, and widely distinguishing of different user pronunciation preferences. For example, the word “is” can be a good benchmark word because it is frequently used, and because it uses the IH phoneme. English uses the IH phoneme a lot, but many other languages do not. Non-native English speakers tend to replace IH with IY. Therefore, a system that detects “is” pronounced as IY Z will easily find strong correlations to pronunciations of words that use IY in place of IH.
Various embodiments apply pronunciation variation data as an overlay, or filter on pronunciations from a global phonetic dictionary.
Some embodiments crowdsource the order or weights of the different pronunciations of words that have multiple pronunciations. In some embodiments, speech engines recognize each of the pronunciations, and output the word in the transcription and an indication of which pronunciation was recognized. The embodiment accumulates counts of each pronunciation, and sorts or scores the pronunciation entries in the phonetic dictionary based on the counts for each pronunciation. This favors the pronunciations preferred by users who use a word frequently. Some embodiments count the preferred pronunciation across all users' profile word lists. This avoids bias towards most common speakers, but gives disproportionate influence to users over words that they only rarely use.
Crowdsourcing is particularly useful when new words enter the dictionary. Occasionally new words come into a language. For example, recently the word “fam” meaning family, the word “Google” meaning to conduct a web search, and the acronym TSA for the transportation security administration, and the name Quvenzhané Wallis of a child actress entered common English use.
In recent years, the acronym GABA, for gamma-Aminobutyric acid, has come into common use. Some people pronounce its letters, JH IY EY B IY EY. Some people pronounce it as a word G AE B AH or G AA B AH. Some embodiments update the dictionary with the text GABA, and all three pronunciations. Then, after recognizing the word a significant number of times in speech input, the system learns the frequency of each pronunciation. As a result, the system produces the preferred pronunciation in its speech synthesis of the word.
Crowdsourcing pronunciations is useful when new proper nouns come into the language, but also reinforces incorrect pronunciations if they are common. Some embodiments allow manual overrides of pronunciations to avoid having the system training users to use the common mispronunciations of difficult incoming proper nouns such as Quvenzhané.
Some embodiments use personal lists of word pronunciation preferences to improve ASR by improving the performance of the speech engine. Sometimes a speech engine receives two strongest phoneme sequence hypotheses with similar weights. This occurs such as when there is a lot of background noise or microphone distortion. Consider the word “data”, which has two common pronunciations, D AE T AH and D EY T AH. Consider the similar phoneme sequences D AE T AH V EH N D AO R (as in the phrase “data vendor”) and DH AE T AH V AH N D AO R (as in the phrase “that oven door”). Consider a scenario of a speech engine receiving those as the mostly highly scored phoneme hypotheses, but the first having a slightly higher score. Absent any other helpful input, such as semantic parsing according to grammar rules or considering context, the speech engine would naturally favor the transcription, “data vendor”.
However, some embodiments consult the user's profile word list. For hypothesis words that have multiple pronunciations, the system provides a favorable weight to the user's preferred pronunciation or an unfavorable weight to pronunciations that the user does not favor. If the user's preferred pronunciation is D EY T AH, not D AE T AH, then the speech engine scales down the score of the first hypothesis, and the speech engine will therefore choose the transcription, “that oven door”.
Referring to
The embodiment of
Numerous algorithms are appropriate for calculating weighted scores. One possible algorithm is to:
Select a phonetic dictionary based on a user class;
Associate the phonetic dictionary weights with each word in each transcription hypothesis for words that have multiple pronunciations;
Replace the weights from the phonetic dictionary with a large constant (e.g. 0.8) if the hypothesized pronunciation is the preferred one from the user profile word list, or a small constant (e.g. 0.25) if the hypothesized pronunciation is not the preferred one;
Compute a hypothesis score based on the average weight associated with each word that has multiple pronunciations, but counting the word weight once for each phoneme that varies from the phonemes of the preferred pronunciation.
Referring again to
Referring now to
Referring now to
Referring now to
Although the invention has been shown and described with respect to a certain preferred embodiment or embodiments, it is obvious that equivalent alterations and modifications will occur to others skilled in the art upon the reading and understanding of this specification and the annexed drawings. In particular regard to the various functions performed by the above described components (assemblies, devices, systems, etc.), the terms (including a reference to a “means”) used to describe such components are intended to correspond, unless otherwise indicated, to any component which performs the specified function of the described component (i.e., that is functionally equivalent), even though not structurally equivalent to the disclosed structure which performs the function in the herein illustrated exemplary embodiments of the invention. In addition, while a particular feature of the invention may have been disclosed with respect to only one of several embodiments, such feature may be combined with one or more other features of the other embodiments as may be desired and advantageous for any given or particular application.
Embodiments of the invention described herein are merely exemplary, and should not be construed as limiting of the scope or spirit of the invention as it could be appreciated by those of ordinary skill in the art. The disclosed invention is effectively made or used in any embodiment that comprises any novel aspect described herein. All statements herein reciting principles, aspects, and embodiments of the invention are intended to encompass both structural and functional equivalents thereof. It is intended that such equivalents include both currently known equivalents and equivalents developed in the future.
The behavior of either or a combination of humans and machines (instructions that, when executed by one or more computers, would cause the one or more computers to perform methods according to the invention described and claimed and one or more non-transitory computer readable media arranged to store such instructions) embody methods described and claimed herein. Each of more than one non-transitory computer readable medium needed to practice the invention described and claimed herein alone embodies the invention.
Some embodiments of physical machines described and claimed herein are programmable in numerous variables, combinations of which provide essentially an infinite variety of operating behaviors. Some embodiments of hardware description language representations described and claimed herein are configured by software tools that provide numerous parameters, combinations of which provide for essentially an infinite variety of physical machine embodiments of the invention described and claimed. Methods of using such software tools to configure hardware description language representations embody the invention described and claimed. Physical machines, such as semiconductor chips; hardware description language representations of the logical or functional behavior of machines according to the invention described and claimed; and one or more non-transitory computer readable media arranged to store such hardware description language representations all can embody machines described and claimed herein.
In accordance with the teachings of the invention, a computer and a computing device are articles of manufacture. Other examples of an article of manufacture include: an electronic component residing on a motherboard, a server, a mainframe computer, or other special purpose computer each having one or more processors (e.g., a Central Processing Unit, a Graphical Processing Unit, or a microprocessor) that is configured to execute a computer readable program code (e.g., an algorithm, hardware, firmware, and/or software) to receive data, transmit data, store data, or perform methods.
The article of manufacture (e.g., computer or computing device) includes a non-transitory computer readable medium or storage that may include a series of instructions, such as computer readable program steps or code encoded therein. In certain aspects of the invention, the non-transitory computer readable medium includes one or more data repositories. Thus, in certain embodiments that are in accordance with any aspect of the invention, computer readable program code (or code) is encoded in a non-transitory computer readable medium of the computing device. The processor or a module, in turn, executes the computer readable program code to create or amend an existing computer-aided design using a tool. The term “module” as used herein may refer to one or more circuits, components, registers, processors, software subroutines, or any combination thereof. In other aspects of the embodiments, the creation or amendment of the computer-aided design is implemented as a web-based software application in which portions of the data related to the computer-aided design or the tool or the computer readable program code are received or transmitted to a computing device of a host.
An article of manufacture or system, in accordance with various aspects of the invention, is implemented in a variety of ways: with one or more distinct processors or microprocessors, volatile and/or non-volatile memory and peripherals or peripheral controllers; with an integrated microcontroller, which has a processor, local volatile and non-volatile memory, peripherals and input/output pins; discrete logic which implements a fixed version of the article of manufacture or system; and programmable logic which implements a version of the article of manufacture or system which can be reprogrammed either through a local or remote interface. Such logic could implement a control system either in logic or via a set of commands executed by a processor.
Furthermore, all examples and conditional language recited herein are principally intended to aid the reader in understanding the principles of the invention and the concepts contributed by the inventors to furthering the art, and are to be construed as being without limitation to such specifically recited examples and conditions. Moreover, all statements herein reciting principles, aspects, and embodiments of the invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents and equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.
Furthermore, to the extent that the terms “including”, “includes”, “having”, “has”, “with”, or variants thereof are used in either the detailed description and the claims, such terms are intended to be inclusive in a similar manner to the term “comprising”.
The scope of the invention, therefore, is not intended to be limited to the exemplary embodiments shown and described herein. Rather, the scope and spirit of present invention is embodied by the appended claims.
This application claims the benefit of U.S. Application No. 62/440,254, filed on Dec. 29, 2016 (Atty Docket No. UND-004PRV) and entitled PRONUNCIATION GUIDED BY AUTOMATIC SPEECH RECOGNITION, which is hereby incorporated by reference.
| Number | Date | Country | |
|---|---|---|---|
| 62440254 | Dec 2016 | US |
