The present invention relates generally to instant messaging and presence (IMP) systems. More particularly, the invention relates to an automated text entry system and method that collects and stores phrases that may be inserted into a messaging stream. Phrases are automatically extracted from a plurality of sources and are thereafter conveniently accessed from the user interface of the portable device.
Instant messaging and presence systems have become very popular in a wide variety of mobile devices, such as cell phones, smart phones, personal digital assistants (PDAs) and two-way pagers. Initially instant messages served the simple purpose of communication between two people. However, more recently, instant messaging and presence technology has evolved to handle more sophisticated functions such as interacting with data processing applications and control system applications. In these more sophisticated applications, the text of a message may serve as a command to initiate a database query, input data into a data processing application, or control the operation of a remote software system.
Despite the wide acceptance and potential power of instant messaging, there remains a significant problem that has not yet been adequately addressed. The problem: data entry on most mobile devices can be exceedingly difficult, due to the small size of those devices. First, devices with physical keyboards use miniaturized keys, placed in close proximity. These are difficult to use for typing. Second, devices with on-screen keyboards require a stylus or pointing device, limiting the speed of entry. Third, devices with keypads typically map the alphabet to numeric keys (numbering 10-12 keys). Thus multiple keystrokes are required for many characters.
Others have attempted to address the data entry problem through a variety of techniques. The word completion technique uses a dictionary and frequency model with selection predicted by the initial letters of the word entered by the user. Predictions may be wrong and the dictionary may grow to an excessively large size for resource-constrained mobile devices. Another character mapping technique involves mapping the most frequently used characters so that they are available for selection first. However, this requires the user to learn a new keypad assignment and to enter multiple keystrokes for characters that are not on the top 33 percent in frequency of usage. Although not particularly convenient for text message creation and editing, another technique for accelerating keyboard or keypad entry involves command history replay. Many command shells (such as those used to interact with the UNIX operating system) provide such a command history replay feature. The feature is limited to a providing replay of recently entered commands and is therefore not sufficiently flexible for instant messaging communication.
In addition to the aforementioned keyboard or keypad accelerating techniques, those systems which utilize a stylus and screen area for text entry often attempt to address the user interface problem by providing handwriting recognition. Some systems require the user to learn a specific handwriting style for character entry. Other systems employ more sophisticated handwriting recognizers. However, these recognizers still make frequent recognition errors, slowing the user down to make corrections.
The present invention improves upon techniques attempted in the past. The invention uses a method that allows the user to more quickly enter words and phrases when sending instant messages. Key phrases are presented in a menu which the user can navigate while creating a message. Selecting the desired phrase from the menu causes the selected phrase to be inserted into the text message area which the user is editing, or alternately, to send the phrase directly as a message. The full power of the system and method derives from the manner in which phrases are collected, stored and used to facilitate instant messaging on portable devices. The system constructs and manages one or multiple phrase lists, each based on a different criteria, if desired. Phrases are added to the list in an automated fashion, with information for constructing the phrases coming from potentially multiple sources. One source involves text messages sent or received by the local instant messaging appliance, itself. Another source comes from the instant messages processed by buddies of the current instant messaging device's user. Yet another source of information flows from the instant messaging network through which all instant messaging users subscribe. The system is able to scan and distill from this information the most probably useful phrases which the user will then select by simple menu selection. The system is able to store not only the phrase text information but also a rich set of context data by which the stored phrases may be organized, filtered and retrieved for use in specific situations. The system can record both predefined context data and the user-defined context data. Predefined data might record context information such as who, what, when, where and why. User-defined context categories may also be created to address specific contextual situations that a particular user frequently encounters. If desired, the user-defined context criteria can be used singly or in combination with system-defined context information to create different context scenario “play lists” to cover specific uses the user may frequently encounter. Such uses include, for example, listing the user's favorite phrases or most frequently used phrases, or most frequently used phrases in a given session or in connection with some other qualifier.
Further areas of applicability of the present invention will become apparent from the detailed description provided hereinafter. It should be understood that the detailed description and specific examples, while indicating the preferred embodiment of the invention, are intended for purposes of illustration only and are not intended to limit the scope of the invention. Accordingly, for a more complete understanding of the invention, refer to the remaining specification and to the accompanying drawings.
The present invention will become more fully understood from the detailed description and the accompanying drawings, wherein:
The following description of the preferred embodiment(s) is merely exemplary in nature and is in no way intended to limit the invention, its application, or uses.
Referring to
The cellular telephone 10 includes a display 12 that can be used to display an instant messaging application such as the instant messaging chat application illustrated at 14. In this chat application, the user communicates with a buddy using text messages. The user types these messages by manipulating the keypad keys 16 and the ensuing text message dialog is presented on the screen as at 18.
In accordance with one aspect of the invention, when the user wishes to utilize the system or accelerating instant messaging input, he or she activates a predefined key on keypad 16 to call up an on-screen menu 20 containing a list of phrases from which the user may select. By selecting one of the phrases in a convenient fashion, such as by selecting its numerical index number, that phrase may be either inserted into the message text being entered by the user or simply sent directly as instant messaging text. As illustrated, menu 20 can overlap all or a portion of the screen containing the instant messaging text 18. Once the user has made a selection from the menu 20, the menu can be put away or removed from the screen so that the text message 18 can be seen in its entirety.
In the illustrated embodiment of
To generate the phrase lists used by the message editor or browser, several techniques are employed. One technique allows the user to predefine certain phrases and categorize those phrases according to predefined or user-defined contexts. In addition, the system also creates phrase lists automatically. An overview of the process for doing this is shown in
Generally speaking, an instant messaging session among two or more users can be modeled as a message stream in which the individual message is sent by each user are serially organized and delimited in a manner to allow the message text from each user to be separated and displayed on successive lines of the instant messaging browser appliance. An exemplary message stream is illustrated at 40 in
The system accesses the instant messaging log file and then scans the message streams as depicted at 42. The message streams are scanned to identify and extract candidate phrases (step 44) based on one or more information extraction models as will be more fully discussed below. In addition, as depicted at step 46, certain context data is obtained and then associated with the extracted phrases. The phrase text and context data are then stored at step 48 in a suitable data store 50. As will be discussed in connection with
Once stored in the data store, the phrase text may be selectively accessed and presented in the menu window 20 (
Referring now to
The process described in
Once the information has been extracted and stored at one or more of the locations illustrated in
Using the information extraction process illustrated in
Referring to
By associating context information with each string of phrase text, the system can selectively filter out and display only phrase text entries that meet a particular set of attributes. By defining different scenarios having particular sets of attributes, the user can readily call up a customized list of phrase text entries to match whatever scenario the user is currently interested in. Examples of some common scenarios are provided later below.
The flat file representation at 80 is useful in understanding how multiple context attributes may be associated with a given phrase text string. In an actual implementation, a relational database (as opposed to a flat file) may be used to implement the data store. For purposes of illustration, a three table relational structure is featured in
The system and method for accelerating instant message input readily adapts to a number of different scenarios. The following are presented as examples.
Scenario: Favorite Phrases
The user can create and edit his or her favorite phrase list. These phrases appear in the favorite phrases menu or list displayed in the menu window 20 (
Scenario: Most Frequent Phrases
Initially before the user has participated in any instant message sessions, there are no phrase lists based on frequency. Each time the user participates in an instant message session, the phrase list can be created (first time) or updated (as discussed more fully below). As each session is completed, the most frequent phrase list can be updated. Alternately, the most frequently phrase list could be updated during each session by immediately merging each phrase as it is sent into the most frequent phrase list and update the contents and frequencies at that time. Referring to
Scenario: Most Frequent Phrases by Session or Other Qualifier
A set of phrases can be distinguished by many attributed, represented by the context data. The context data may include attributes such as participants, time window or time of day, and related event context as noted in the user's calendar. Other context data may also be used as discussed generally in connection with
Scenario: Short Messages as Idioms
Another technique is to process only those messages whose text length is less than a certain length (e.g., ten characters), with the strategy that these short messages are most likely to be instant messaging idioms. Examples of such idioms are “hw r u?”, “whts nu”, “bye” and so forth. For this scenario the extract phrases step 44 of
Further Details of Phrase List Creation
As noted above, the user can create local phrase lists in different ways. These include editing a list directly on the instant messaging device, creating a phrase list on a desktop computer and downloading it into the device, or creating it using a web interface and then transferring it to the device. The user can transfer phrase lists between devices that he or she uses, or the user may exchange phrase lists with other users. An instant messaging service provider can also provide phrase list storage on the instant messaging provider servers for its users. This latter capability is illustrated in
The user can directly edit a phrase list which is a sequence of text phrases. Subject to system limits, the user is thus able to determine each phrase, its length, character set, position in the phrase list and number of phrases in the list.
As previously noted, the generation of phrase lists by automatic processing of the instant messaging session logs can be performed on the local device, on another party's device, on a computer at the service provider or on another computer such as a computer operated by the user of the instant messaging appliance. The processing can be done on the same device or system where the session logs are captured, or the logs can be transferred to another system or device for processing. Thus referring to
An instant messaging session log contains a sequence of the ID of the sender and the text of the message in chronological order. Thus a possible phrase extraction algorithm consists of these steps:
Pseudo code of this algorithm is as follows:
The resulting phrase list contains a sequence: phrase, occurrence count, frequency in the instant messaging log. The phrase list may have additional information, including: file name of instant messaging session log, date of session, participants in session. The phrase list for a set of instant messaging session logs can be combined:
The pseudo code for this algorithm follows:
The resulting merged phrase list contains a sequence: phrase, occurrence count, frequency of occurrence in the merged sessions. The phrase list may have additional information, including file name of each original instant messaging session log, date of each session, participants in each session.
The selection of a combination of phrase lists to merge allows the creation of phrase lists meeting various criteria, including but not limited to:
Each phrase list can be aged. Entries based on instant messaging logs prior to a specific time window (e.g., thirty days) can be eliminated from the frequency. This allows the user's phrase list to adjust to changes in message patterns that occur over time.
While the foregoing has illustrated the principles of the invention in the context of a text-based message, it will be understood that the techniques are applicable to any language, both alphabetic and ideographic. In addition, the techniques can be applied to both short message service (SMS) systems and multimedia service (MMS) as well as e-mail text entry. The invention can be used on desktop computers and other computing devices besides mobile devices. It can be used on any device which is equipped with instant messaging, SMS, MMS or similar client software. Moreover, the invention can be used on other appliances that have some form of alphanumeric keypad (or an analog to such keypad) such as telephones and remote controls.
The description of the invention is merely exemplary in nature and, thus, variations that do not depart from the gist of the invention are intended to be within the scope of the invention. Such variations are not to be regarded as a departure from the spirit and scope of the invention.