Patent Grant
8285549
A mobile device may be used as a principal computing device for many activities. For example, the mobile device may comprise a handheld computer for managing contacts, appointments, and tasks. A mobile device typically includes a name and address database, calendar, to-do list, and note taker, which may include these functions in a personal information manager. Wireless mobile devices may also offer e-mail, Web browsing, and cellular telephone service (e.g. a smartphone). Data may be synchronized between the mobile device and a desktop computer via a cabled connection or a wireless connection.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter. Nor is this Summary intended to be used to limit the claimed subject matter's scope.
A personality-based theme may be provided. An application program may query a personality resource file for a prompt corresponding to a personality. Then the prompt may be received at a speech synthesis engine. Next, the speech synthesis engine may query a personality voice font database for a voice font corresponding to the personality. Then the speech synthesis engine may apply the voice font to the prompt. The voice font applied prompt may then be produced at an output device.
Both the foregoing general description and the following detailed description provide examples and are explanatory only. Accordingly, the foregoing general description and the following detailed description should not be considered to be restrictive. Further, features or variations may be provided in addition to those set forth herein. For example, embodiments may be directed to various feature combinations and sub-combinations described in the detailed description.
The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate various embodiments of the present invention. In the drawings:
The following detailed description refers to the accompanying drawings. Wherever possible, the same reference numbers are used in the drawings and the following description to refer to the same or similar elements. While embodiments of the invention may be described, modifications, adaptations, and other implementations are possible. For example, substitutions, additions, or modifications may be made to the elements illustrated in the drawings, and the methods described herein may be modified by substituting, reordering, or adding stages to the disclosed methods. Accordingly, the following detailed description does not limit the invention. Instead, the proper scope of the invention is defined by the appended claims.
Embodiments of the invention may increase a device's (e.g. a mobile device or embedded device) appeal through personality theme incorporation. The personality may be an individual's personality and may be a celebrity figure's personality. To provide this personality theme, embodiments of the invention may use synthesized speech, music, and visual elements. Moreover, embodiments of the invention may provide a device that portrays a single personality or even multiple personalities.
Consistent with embodiments of the invention, speech synthesis may portray a target individual (e.g. the personality) through using a “voice font” generated, for example, from recordings made by the target individual or individuals. This voice font may allow the device to sound like a specific individual when the device “speaks.” In other words, the voice font may allow the device to produce a customized voice. In addition to the customized voice, message prompts may be customized to reflect the target individual's grammatical style. In addition, the synthesized speech may also be augmented by recorded phrases or messages from the target individual.
Furthermore, music may be used by the device to portray the target individual. In the case where the target individual is a musical artist, for example, songs by the target individual may be used for ring tones, notifications, etc., for example. Songs by the target individual may also be included with the personality theme for devices with media capabilities. Devices portraying actors as the target individual could use theme music from movies or television shows where the actor appeared.
Visual elements within the personality theme may include, for example, target individual images, objects associated with the target individual, and color themes that end-users might identify with the target individual or with the target individual's work. An example may be the image of a football for a “Shawn Alexander phone.” The visual elements could appear in the background on the mobile device's screen, in window borders, on some icons, or event printed on the phone exterior (possibly on a removable faceplate).
Accordingly, embodiments of the invention may customize a personality theme for a device around one or more personalities, possibly a celebrity (the “personality skin”) to provide a “personality skin package” used to deliver the personality theme. For example, embodiments of the invention may grammatically alter standard prompts to match the target individual's speaking style. Moreover, embodiments of the invention may include a “personality skin manager” that may allow users to switch between personality skins, remove personality skin packages, or download new personality skin packages, for example.
A “personality skin” may comprise, for example: i) a customized voice font generated from recordings from the target individual; ii) speech prompts customized to match a speaking style of the target individual; iii) personality-specific audio clips or files; and iv) personality-specific images or other visual elements. Where these elements (or others) are delivered together in a single package, they may be referred to as a personality skin package.
In addition, system 100 may comprise or otherwise be implemented in a mobile device. The mobile device 105 may comprise, but is not limited to, a mobile telephone, a cellular telephone, a wireless telephone, a wireless device, a hand-held personal computer, a hand-held computing device, a multi-processor system, a micro-processor-based or programmable consumer electronic device, a personal digital assistant (PDA), a telephone, a pager, or any other device configured to receive, process, and transmit information. For example, the mobile device may comprise an electronic device configured to communicate wirelessly and be small enough for a user to carry the electronic device easily. In other words, the mobile device may be smaller than a notebook computer and may comprise a mobile telephone or PDA, for example.
From stage 310, where computing device 400 queries first personality resource file 120, method 300 may advance to stage 320 where computing device 400 may receive the prompt at speech synthesis engine 140. For example, first application program 105, second application program 110, or third application program 115 may provide the prompt to speech synthesis engine 140 through speech service 145.
Once computing device 400 receives the prompt at speech synthesis engine 140 in stage 320, method 300 may continue to stage 330 where computing device 400 (e.g. speech synthesis engine 140) may query personality voice font database 150 for a voice font corresponding to the personality. For example the voice font may be created based on recordings of the personality's voice. In addition, the voice font may be configured to make the prompt sound like the personality when produced. In order to implement the customized voice feature of a personality skin, speech synthesis (or text-to-speech) engine 140 may be used. A voice font may be created for the target individual by processing a series of recordings made by that target individual. Once the font has been created it may be used by synthesis engine 140 to produce speech that sounds like the desired target individual.
After computing device 400 queries personality voice font database 150 in stage 330, method 300 may proceed to stage 340 where computing device 400 (e.g. speech synthesis engine 140) may apply the voice font to the prompt. For example, applying the voice font to the prompt may further comprise augmenting the voice font applied prompt with recorded phrases of the personality (e.g. target individual). In addition, the prompt may be altered to conform with a grammatical style of the personality (e.g. target individual).
While synthesized speech may sound acoustically like the target individual, the words used by system 100 for dialogs or notifications, may not accurately reflect the speaking style of target individual. In order to more closely match the speaking style of the target individual, applications (e.g. first application program 105, second application program 110, third application program 115, etc.) may also choose to alter the specific messages (e.g. prompts) to be spoken, such that they use the words and prosody characteristics the device user may expect the target individual to use. These alterations may be made by changing the phrases to be spoken (including prosody tags). Each speech application may need to make these alterations for their respective spoken prompts.
Once computing device 400 applies the voice font to the prompt in stage 340, method 300 may proceed to stage 350 where computing device 400 may produce the voice font applied prompt at output device 160. For example, output device 160 may be disposed within a mobile device. Output device 160 may, for example, comprise any of output devices 414 as described in more detail below with respect to
A system that may support personality skin packages may include a “personality skin manager.” As stated above,
First application 105 and second application 110 may load the appropriate resource file depending on the current voice font. The current voice font may be made available to first application 105 or second application 110 at runtime through a registry key. Additionally, personality manager 205 may notify first application 105 or second application 110 when the current skin (and thereby the current voice font) is updated. Upon receiving this notification, first application 105 or second application 110 may reload their resources as appropriate.
In addition to the customization of prompts, application designers may wish to customize speech recognition (SR) grammars, so the end user can issue voice commands in the speaking style of the target individual, or to address the device by the name of the individual. Such grammar updates may be stored and delivered in resource files in a manner similar to the customized prompts described above. These grammar updates may be particularly important in the multiple-personality scenario described below.
Besides managing the speech components of the personality skin package (voice font, prompts, and possibly grammars), personality manager 205 may also manage the visual and audio components of the personality skin such that when a user switched to a different personality skin, the look and sound of the device may update along with its voice. Some possible actions could include, but are not limited to, updating the background image on the device and setting a default ring tone.
Consistent with embodiments of the invention, the personality concept can also be extended such that a single device could portray multiple personalities. Consequently, supporting multiple personalities at one time may require additional RAM, ROM, or processor resources. Multiple personalities may extend the concept of a personality-based device in a number of ways. As described above, multiple personality skins may be stored on a device and may be selected at runtime by the end user or changed automatically by personality manager 205 based on a generated or user-defined schedule. In this scenario, only additional ROM may be required to store the inactive voice font databases and application resources. This approach may also be used to allow the device to change moods as a particular mood for an individual could be portrayed through a mood-specific personality skin. Applying moods to the device personality could make the device more entertaining and could also be used to convey information to the end user (for example, the personality skin manager could switch to a “sleepy” mood when the device battery becomes low).
Consistent with multiple personality embodiments of the invention, more than one personality may be active at a time. For example, each personality may be associated with a feature or set of features on the device. Then the end user may interact with a feature (e.g. e-mail) or a set of features (e.g. communications) by interacting with the associated personality. This approach may also help to restrain grammars if the user addresses the device by the name of the personality associated with the functionality he or she wants to interact with (e.g. “Shawn, what's my battery level?”, “Geena, what's my next appointment?”) Furthermore, when the user gets notifications from the device, the voice used may indicate to the user to which functional area the message belongs. For example, the user may be able to tell that a notification is related to e-mail because he or she recognizes the voice as belonging to the personality associated with e-mail notifications. The system architecture may changes slightly in this situation, because applications may specify the voice to be used for the device's notifications. Personality manager 205 may assign the voice that each application may use and the application may need to speak using the appropriate engine instance.
An embodiment consistent with the invention may comprise a system for providing personality-based theme. The system may comprise a memory storage and a processing unit coupled to the memory storage. The processing unit may be operative to query, by an application program, a personality resource file for a prompt corresponding to a personality and to receive the prompt at a speech synthesis engine. In addition, the processing unit may be operative to query, by the speech synthesis engine, a personality voice font database for a voice font corresponding to the personality. Moreover, the processing unit may be operative to apply, by the speech synthesis engine, the voice font to the prompt and to produce the voice font applied prompt at an output device.
Another embodiment consistent with the invention may comprise a system for providing personality-based theme. The system may comprise a memory storage and a processing unit coupled to the memory storage. The processing unit may be operative to produce at least one audio content corresponding to a predetermined personality and to produce at least one video content corresponding to the predetermined personality.
Yet another embodiment consistent with the invention may comprise a system for providing personality-based theme. The system may comprise a memory storage and a processing unit coupled to the memory storage. The processing unit may be operative to receive, at a personality manager, a user initiated input indicating a personality and to notify at least one application of the personality. Moreover, the processing unit may be operative to receive a personality resource file in response the at least one application requesting the personality resource file in response to the at least one application being notified of the personality.
With reference to
Computing device 400 may have additional features or functionality. For example, computing device 400 may also include additional data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Such additional storage is illustrated in
Computing device 400 may also contain a communication connection 416 that may allow device 400 to communicate with other computing devices 418, such as over a network in a distributed computing environment, for example, an intranet or the Internet. Communication connection 416 is one example of communication media. Communication media may typically be embodied by computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and includes any information delivery media. The term “modulated data signal” may describe a signal that has one or more characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media may include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, radio frequency (RF), infrared, and other wireless media. The term computer readable media as used herein may include both storage media and communication media.
As stated above, a number of program modules and data files may be stored in system memory 404, including operating system 405. While executing on processing unit 402, programming modules 406 (e.g. first application program 105, second application program 110, third application program 115, and speech synthesis engine 140) may perform processes including, for example, one or more method 300's stages as described above. The aforementioned process is an example, and processing unit 402 may perform other processes. Other programming modules that may be used in accordance with embodiments of the present invention may include electronic mail and contacts applications, word processing applications, spreadsheet applications, database applications, slide presentation applications, drawing or computer-aided application programs, etc.
Generally, consistent with embodiments of the invention, program modules may include routines, programs, components, data structures, and other types of structures that may perform particular tasks or that may implement particular abstract data types. Moreover, embodiments of the invention may be practiced with other computer system configurations, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, and the like. Embodiments of the invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
Furthermore, embodiments of the invention may be practiced in an electrical circuit comprising discrete electronic elements, packaged or integrated electronic chips containing logic gates, a circuit utilizing a microprocessor, or on a single chip containing electronic elements or microprocessors. Embodiments of the invention may also be practiced using other technologies capable of performing logical operations such as, for example, AND, OR, and NOT, including but not limited to mechanical, optical, fluidic, and quantum technologies. In addition, embodiments of the invention may be practiced within a general purpose computer or in any other circuits or systems. Moreover, embodiments of the invention may also be practiced in conjunction with technologies such as Instant Messaging (IM), SMS, Calendar, Media Player, and Phone (caller-ID).
Embodiments of the invention, for example, may be implemented as a computer process (method), a computing system, or as an article of manufacture, such as a computer program product or computer readable media. The computer program product may be a computer storage media readable by a computer system and encoding a computer program of instructions for executing a computer process. The computer program product may also be a propagated signal on a carrier readable by a computing system and encoding a computer program of instructions for executing a computer process. Accordingly, the present invention may be embodied in hardware and/or in software (including firmware, resident software, micro-code, etc.). In other words, embodiments of the present invention may take the form of a computer program product on a computer-usable or computer-readable storage medium having computer-usable or computer-readable program code embodied in the medium for use by or in connection with an instruction execution system. A computer-usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
The computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. More specific computer-readable medium examples (a non-exhaustive list), the computer-readable medium may include the following: an electrical connection having one or more wires, a portable computer diskette, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, and a portable compact disc read-only memory (CD-ROM). Note that the computer-usable or computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
Embodiments of the present invention, for example, are described above with reference to block diagrams and/or operational illustrations of methods, systems, and computer program products according to embodiments of the invention. The functions/acts noted in the blocks may occur out of the order as shown in any flowchart. For example, two blocks shown in succession may in fact be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved.
While certain embodiments of the invention have been described, other embodiments may exist. Furthermore, although embodiments of the present invention have been described as being associated with data stored in memory and other storage mediums, data can also be stored on or read from other types of computer-readable media, such as secondary storage devices, like hard disks, floppy disks, or a CD-ROM, a carrier wave from the Internet, or other forms of RAM or ROM. Further, the disclosed methods' stages may be modified in any manner, including by reordering stages and/or inserting or deleting stages, without departing from the invention.
All rights including copyrights in the code included herein are vested in and the property of the Applicant. The Applicant retains and reserves all rights in the code included herein, and grants permission to reproduce the material only in connection with reproduction of the granted patent and for no other purpose.
While the specification includes examples, the invention's scope is indicated by the following claims. Furthermore, while the specification has been described in language specific to structural features and/or methodological acts, the claims are not limited to the features or acts described above. Rather, the specific features and acts described above are disclosed as example for embodiments of the invention.
This application is a Continuation of co-pending U.S. application Ser. No. 11/752,989 entitled “Personality-Based Device” filed May 24, 2007, which is incorporated herein by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5327521 | Savic et al. | Jul 1994 | A |
| 6336092 | Gibson et al. | Jan 2002 | B1 |
| 6615174 | Arslan et al. | Sep 2003 | B1 |
| 6810378 | Kochanski et al. | Oct 2004 | B2 |
| 6964023 | Maes et al. | Nov 2005 | B2 |
| 7137126 | Coffman et al. | Nov 2006 | B1 |
| 7149682 | Yoshioka et al. | Dec 2006 | B2 |
| 7191132 | Brittan et al. | Mar 2007 | B2 |
| 7483832 | Tischer | Jan 2009 | B2 |
| 7606709 | Yoshioka et al. | Oct 2009 | B2 |
| 7693717 | Kahn et al. | Apr 2010 | B2 |
| 7729916 | Coffman et al. | Jun 2010 | B2 |
| 8131549 | Teegan et al. | Mar 2012 | B2 |
| 20020010584 | Schultz et al. | Jan 2002 | A1 |
| 20020120450 | Junqua et al. | Aug 2002 | A1 |
| 20030028380 | Freeland et al. | Feb 2003 | A1 |
| 20040018863 | Engstrom et al. | Jan 2004 | A1 |
| 20040098266 | Hughes et al. | May 2004 | A1 |
| 20040148176 | Scholl | Jul 2004 | A1 |
| 20050037746 | Ramalho et al. | Feb 2005 | A1 |
| 20050086328 | Landram et al. | Apr 2005 | A1 |
| 20050203729 | Roth et al. | Sep 2005 | A1 |
| 20060069567 | Tischer et al. | Mar 2006 | A1 |
| 20060129399 | Turk et al. | Jun 2006 | A1 |
| 20060173911 | Levin et al. | Aug 2006 | A1 |
| 20060253286 | Akabane et al. | Nov 2006 | A1 |
| 20070011009 | Nurminen et al. | Jan 2007 | A1 |
| 20070213987 | Turk et al. | Sep 2007 | A1 |
| 20080082320 | Popa et al. | Apr 2008 | A1 |
| 20080291325 | Teegan et al. | Nov 2008 | A1 |
| Number | Date | Country |
|---|---|---|
| 1 271 469 | Jan 2003 | EP |
| 2003-337592 | Nov 2003 | JP |
| WO 2004032112 | Apr 2004 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20120150543 A1 | Jun 2012 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11752989 | May 2007 | US |
| Child | 13404048 | US |
