The present invention will now be described with reference to the drawings, wherein like reference numerals are used to refer to like elements throughout. It will be understood that the figures are not necessarily to scale.
The interchangeable terms “electronic equipment” and “electronic device” include portable radio communication equipment. The term “portable radio communication equipment,” which herein after is referred to as a “mobile radio terminal,” includes all equipment such as mobile telephones, pagers, communicators, electronic organizers, personal digital assistants (PDAs), smartphones, portable communication apparatus or the like.
In the present application, the invention is described primarily in the context of a mobile telephone. However, it will be appreciated that the invention is not intended to be limited to a mobile telephone and can be any type of appropriate electronic equipment, examples of which include a media player, a gaming device and a computer.
Referring initially to
The electronic device of the illustrated embodiment is a mobile telephone and will be referred to as the mobile telephone 10. The mobile telephone 10 is shown as having a “brick” or “block” form factor housing, but it will be appreciated that other type housings, such as a clamshell housing or a slide-type housing, may be utilized.
The mobile telephone 10 may include a display 14. The display 14 displays information to a user such as operating state, time, telephone numbers, contact information, various navigational menus, etc., which enable the user to utilize the various features of the mobile telephone 10. The display 14 also may be used to visually display content received by the mobile telephone 10 and/or retrieved from a memory 16 of the mobile telephone 10. The display 14 may be used to present images, video and other graphics to the user, such as photographs, mobile television content and video associated with games.
A keypad 18 provides for a variety of user input operations. For example, the keypad 18 typically includes alphanumeric keys for allowing entry of alphanumeric information such as telephone numbers, phone lists, contact information, notes, etc. In addition, the keypad 18 typically includes special function keys such as a “call send” key for initiating or answering a call, and a “call end” key for ending or “hanging up” a call. Special function keys may also include menu navigation and select keys, for example, for navigating through a menu displayed on the display 16 to select different telephone functions, profiles, settings, etc., as is conventional. Special function keys may include audiovisual content playback keys to start, stop and pause playback, skip or repeat tracks, and so forth. Other keys associated with the mobile telephone may include a volume key, an audio mute key, an on/off power key, a web browser launch key, a camera key, etc. Keys or key-like functionality may also be embodied as a touch screen associated with the display 14.
The mobile telephone 10 includes call circuitry that enables the mobile telephone 10 to establish a call and/or exchange signals with a called/calling device, typically another mobile telephone or landline telephone. However, the called/calling device need not be another telephone, but may be some other device such as an Internet web server, content providing server, etc. Calls may take any suitable form. For example, the call could be a conventional call that is established over a cellular circuit-switched network or a voice over Internet Protocol (VoIP) call that is established over a packet-switched capability of a cellular network or over an alternative packet-switched network, such as WiFi, WiMax, etc. Another example includes a video enabled call that is established over a cellular or alternative network.
The mobile telephone 10 may be configured to transmit, receive and/or process data, such as text messages (e.g., colloquially referred to by some as “an SMS”), electronic mail messages, multimedia messages (e.g., colloquially referred to by some as “an MMS”), image files, video files, audio files, ring tones, streaming audio, streaming video, data feeds (including podcasts) and so forth. Processing such data may include storing the data in the memory 16, executing applications to allow user interaction with data, displaying video and/or image content associated with the data, outputting audio sounds associated with the data and so forth.
In addition, the processing device 22 may execute code that implements the audiovisual contact list function 12. It will be apparent to a person having ordinary skill in the art of computer programming, and specifically in application programming for mobile telephones or other electronic devices, how to program a mobile telephone 10 to operate and carry out logical functions associated with the audiovisual contact list function 12. Accordingly, details as to specific programming code have been left out for the sake of brevity. Also, while the audiovisual contact list function 12 is executed by the processing device 22 in accordance with a preferred embodiment of the invention, such functionality could also be carried out via dedicated hardware, firmware, software, or combinations thereof, without departing from the scope of the invention.
Continuing to refer to
The mobile telephone 10 further includes a sound signal processing circuit 28 for processing audio signals transmitted by and received from the radio circuit 26. Coupled to the sound processing circuit 28 are a speaker 30 and a microphone 32 that enable a user to listen and speak via the mobile telephone 10 as is conventional. The radio circuit 26 and sound processing circuit 28 are each coupled to the control circuit 20 so as to carry out overall operation. Audio data may be passed from the control circuit 20 to the sound signal processing circuit 28 for playback to the user. The audio data may include, for example, audio data from an audio file stored by the memory 18 and retrieved by the control circuit 20, or received audio data such as in the form of streaming audio data from a mobile radio service. The sound processing circuit 28 may include any appropriate buffers, decoders, amplifiers and so forth.
The display 14 may be coupled to the control circuit 20 by a video processing circuit 34 that converts video data to a video signal used to drive the display 14. The video processing circuit 34 may include any appropriate buffers, decoders, video data processors and so forth. The video data may be generated by the control circuit 20, retrieved from a video file that is stored in the memory 16, derived from an incoming video data stream received by the radio circuit 28 or obtained by any other suitable method.
The mobile telephone 10 further includes one or more I/O interface(s) 36. The I/O interface(s) 36 may be in the form of typical mobile telephone I/O interfaces and may include one or more electrical connectors. As is typical, the I/O interface(s) 36 may be used to couple the mobile telephone 10 to a battery charger to charge a battery of a power supply unit (PSU) 38 within the mobile telephone 10. In addition, or in the alternative, the I/O interface(s) 36 may serve to connect the mobile telephone 10 to a headset assembly (e.g., a personal handsfree (PHF) device) that has a wired interface with the mobile telephone 10. Further, the I/O interface(s) 36 may serve to connect the mobile telephone 10 to a personal computer or other device via a data cable for the exchange of data. The mobile telephone 10 may receive operating power via the I/O interface(s) 36 when connected to a vehicle power adapter or an electricity outlet power adapter.
The mobile telephone 10 may also include a timer 40 for carrying out timing functions. Such functions may include timing the durations of calls, generating the content of time and date stamps, etc. The mobile telephone 10 may include a camera 42 for taking digital pictures and/or movies. Image and/or video files corresponding to the pictures and/or movies may be stored in the memory 16. The mobile telephone 10 also may include a position data receiver 44, such as a global positioning system (GPS) receiver, Galileo satellite system receiver or the like.
The mobile telephone 10 also may include a local wireless interface 46, such as an infrared transceiver and/or an RF adaptor (e.g., a Bluetooth adapter), for establishing communication with an accessory, another mobile radio terminal, a computer or another device. For example, the local wireless interface 46 may operatively couple the mobile telephone 10 to a headset assembly (e.g., a PHF device) in an embodiment where the headset assembly has a corresponding wireless interface.
With additional reference to
With additional reference to
The logical flow for the audiovisual contact list function 12 may begin in block 54 where the user carries out actions to take a photograph with the camera 42. The photograph may be stored by the memory 16 in any suitable file format, such as JPEG. In most cases, it is believed that the photograph will be of a person, but the photograph could include multiple people or the photograph could be of an object or landscape. In other embodiments, the photograph may be downloaded or transferred to the mobile telephone 10 instead of being generated by the camera 42. This embodiment may have particular application in situations where the mobile telephone 10 does not have a built-in camera.
Proceeding to block 56, the user may record an audio message using the mobile telephone 10. For instance, the audiovisual contact list function 12 may prompt the user to speak into the microphone 32 or the microphone of an operatively interfaced headset (not shown). In one embodiment and when the photograph of block 54 is of a person, the user may have the subject of the photograph input the audio message.
The audio message may be captured and stored by the memory 16 in any suitable file format. In most cases, it is believed that the audio message will relate to the subject matter of the photograph that was taken in block 54. For instance, if the photograph is of a person, the audio message may be the name of the person. As another example, if the photograph is of a commercial establishment (e.g., a store or building), the audio message may be the name or address of the corresponding location.
Thereafter, in block 58, the audio message is run through a speech recognition software engine. For instance, the speech recognition engine may convert the audio message to text using a speech-to-text conversion process. Alternatively, the speech recognition engine may attempt to recognize patterns in the audio message to identify a meaningful term (or terms) from the audio message by matching the audio signals to a function or value. While speech recognition software is undergoing continuous improvement, suitable speech recognition engines will be known to those of ordinary skill in the art. The speech recognition engine may form a part of the audiovisual contact list function 12 or may be implemented in a separate program that is executed by the mobile telephone 10. Since speech recognition processing may consume a considerable amount of processing capacity, the speech recognition engine may be resident in and executed by the server 52. In this embodiment, the audio message may be transmitted to the server 52 for processing and the results of the speech recognition may be returned to the mobile telephone 10.
Proceeding to block 60, the audiovisual contact list function 12 may determine if there is a match between the output of the speech recognition from block 58 and existing contact information. As will be understood, contact information may be stored in a contact list database. Such databases typically store the names of people, along with their address (e.g., home address and/or work address), telephone numbers and electronic mail addresses. Other information may be stored, such as notes and important dates (e.g., birthdays and anniversaries). The contact list database may be stored using the memory 16 and accessed using a contact list interface software application executed by the processing device 22.
In the embodiment where the audio message was converted to text, the text may be compared against the entries in the user's contact list for a matching string of characters. The search for a matching entry or entries may attempt to match text in one or more particular fields in the contact list database or all fields in the contact list database. Also, the engine used to identify matches may use variant spellings for the converted text and/or pronunciation-based search algorithms to match the text to contact list data.
In the embodiment where the audio message was converted to a meaningful term (e.g., a value, a sound signal profile, etc.), the term may be compared against commensurate types of terms derived from the data contained in the contact list database. For instance, text-based data that is entered into a contact list may be converted to a term by running a conversion algorithm.
If a match is identified in block 60, the logical flow may proceed to block 62 where the photograph taken in block 54 is associated with the contact list entry that matches the converted audio message. Thereafter, in block 64, the photograph may be displayed on the display 14 at times that may provide the user with a visual cue for the information from the associated contact list entry. This may assist the user recall the identity of a person corresponding to the associated contact list entry or a location corresponding to the associated contact list entry in a variety of circumstances. For example, if the user were to browse his or her contact list entries, the photograph may be displayed when the associated contact list entry is highlighted from a list of entries, or is selected for viewing or dialing. In another situation, if the mobile telephone 10 were to receive a call from a telephone number matching the contact list entry associated with the photograph, the photograph may be displayed to assist the user identify the caller. In addition to or instead of displaying the photograph in these and/or similar circumstances, the audio message may be audibly played back to the user.
If a match is not identified in block 60, the logical flow may proceed to block 66 where the user may be prompted to enter contact information that corresponds to the photograph and/or the audio message. In this manner, a content list entry may be generated and associated with the photograph. Alternatively, the user may be prompted to manually identify an existing contact list entry for association with the photograph. Thereafter, the logical flow may proceed to block 64 (described above) so that the photograph may be displayed in connection with activity relating to the associated contact list entry.
With additional reference to
Beginning in block 68 the user may carry out actions to take a photograph with the camera 42. The photograph may be stored by the memory 16 in any suitable file format, such as JPEG. In most cases, it is believed that the photograph will be of a person, but the photograph could include multiple people or the photograph could be of an object or landscape. In other embodiments, the photograph may be downloaded or transferred to the mobile telephone 10 instead of being generated by the camera 42. This embodiment may have particular application in situations where the mobile telephone 10 does not have a built-in camera.
Proceeding to block 70, the user may enter text relating to the photograph. For instance, the audiovisual contact list function 12 may prompt the user to enter text by depressing buttons of the keypad 18. In most cases, it is believed that the entered text will relate to the subject matter of the photograph that was taken in block 68. For instance, if the photograph is of a person, the text may be the name of the person. As another example, if the photograph is of a commercial establishment (e.g., a store or building), the audio message may be the name or address of the corresponding location.
Thereafter, in block 72, the audiovisual contact list function 12 may determine if there is a match between the text entered in block 70 and existing contact information that has been stored in a contact list database. For instance, the text may be compared against the entries in the user's contact list for a matching string of characters. The search for a matching entry or entries may attempt to match text in one or more particular fields in the contact list database or all fields in the contact list database. Also, the engine used to identify matches may use variant spellings for the text and/or pronunciation-based search algorithms to match the text to contact list data.
If a match is identified in block 72, the logical flow may proceed to block 74 where the photograph taken in block 68 is associated with the contact list entry that matches the text entered in block 70. Thereafter, in block 76, the photograph may be displayed on the display 14 at times that may provide the user with a visual cue for the information from the associated contact list entry. This may assist the user recall the identity of a person corresponding to the associated contact list entry or a location corresponding to the associated contact list entry in a variety of circumstances. For example, if the user were to browse his or her contact list entries, the photograph may be displayed when the associated contact list entry is highlighted from a list of entries, or is selected for viewing or dialing. In another situation, if the mobile telephone 10 were to receive a call from a telephone number matching the contact list entry associated with the photograph, the photograph may be displayed to assist the user identify the caller.
If a match is not identified in block 72, the logical flow may proceed to block 78 where the user may be prompted to enter contact information that corresponds to the photograph and/or the text entered in block 70. In this manner, a content list entry may be generated and associated with the photograph. Alternatively, the user may be prompted to manually identify an existing contact list entry for association with the photograph. Thereafter, the logical flow may proceed to block 76 (described above) so that the photograph may be displayed in connection with activity relating to the associated contact list entry.
With additional reference to
In block 80, the user may carry out actions to take a photograph with the camera 42. The photograph may be stored by the memory 16 in any suitable file format, such as JPEG. In most cases, it is believed that the photograph will be of a person, but the photograph could include multiple people or the photograph could be of an object or landscape. In other embodiments, the photograph may be downloaded or transferred to the mobile telephone 10 instead of being generated by the camera 42. This embodiment may have particular application in situations where the mobile telephone 10 does not have a built-in camera.
Proceeding to block 82, the user may record an audio message using the mobile telephone 10. For instance, the audiovisual contact list function 12 may prompt the user to speak into the microphone 32 or the microphone of an operatively interfaced headset (not shown). In one embodiment and when the photograph of block 80 is of a person, the user may have the subject of the photograph input the audio message.
The audio message may be captured and stored by the memory 16 in any suitable file format. In most cases, it is believed that the audio message will relate to the subject matter of the photograph that was taken in block 82. For instance, if the photograph is of a person, the audio message may be the name of the person. As another example, if the photograph is of a commercial establishment (e.g., a store or building), the audio message may be the name or address of the corresponding location.
At some other time, such as before or after blocks 80 and 82 are carried out, the user may enter contact information a contact list database to establish a contact list entry in block 84. For example, entered may be the name a person, the business and/or residence address of the person, a telephone number or numbers for the person, an electronic mail address or addresses for the person and so forth.
Proceeding to block 86, the user may record a second audio message using the mobile telephone 10. In most cases, it is believed that the second audio message will relate to the contact list entry that was entered in block 84. For instance, the second audio message may be the name of the person for which contact information was entered. It will be appreciated that multiple contact list entries may be entered and an audio message for each contact list entry may be recorded.
In block 88, a comparison may be made between the audio message recorded in conjunction with the photograph of block 82 and each of the audio messages recorded in conjunction with establishment of the contact list entries of block 84. The comparison may be made by directly comparing the recordings or the sound characteristics of the recordings. In other embodiments, each of the recordings may be processed using a speech recognition software engine to convert the recordings to text or meaningful term, and the output of the speech recognition engine may serve as the basis of the comparison.
If the recording of block 82 contains sufficiently similar content to one of the recordings of block 86, the logic may find that a match exists between the two recordings. If a match is identified in block 88, the logical flow may proceed to block 90 where the photograph taken in block 80 is associated with the contact list entry having the audio message that matched the audio message recorded in block 82.
Thereafter, in block 92, the photograph may be displayed on the display 14 at times that may provide the user with a visual cue for the information from the associated contact list entry. This may assist the user recall the identity of a person corresponding to the associated contact list entry or a location corresponding to the associated contact list entry in a variety of circumstances. For example, if the user were to browse his or her contact list entries, the photograph may be displayed when the associated contact list entry is highlighted from a list of entries, or is selected for viewing or dialing. In another situation, if the mobile telephone 10 were to receive a call from a telephone number matching the contact list entry associated with the photograph, the photograph may be displayed to assist the user identify the caller. In addition to or instead of displaying the photograph in these and similar circumstances, the corresponding audio message of either of blocks 82 or 86 may be audibly played back to the user.
If a match is not identified in block 88, the logical flow may proceed to block 94 where the user may be prompted to enter contact information that corresponds to the photograph and/or the audio message of block 82. In this manner, a content list entry may be generated and associated with the photograph. Alternatively, the user may be prompted to manually identify an existing contact list entry for association with the photograph. Thereafter, the logical flow may proceed to block 92 (described above) so that the photograph may be displayed in connection with activity relating to the associated contact list entry.
The foregoing operations depict exemplary manners in which a method of coordinating audiovisual content with contact list information that may be implemented. An example application of the method includes taking a photograph of an individual and recording an audio message containing the name of the individual. Once an association between the photograph and a contract list entry has been made using the content of the audio message to match the photograph with the contact list entry, the photograph may be displayed in conjunction with the contract list entry. This may aid certain users who have difficulty “matching names with faces.”
In a variation of the method described above, instead of associating a photograph with a contact list entry, the method may be used to associate other types of audiovisual content with a contact list entry. Other types of audiovisual content that may be associated include, but are not limited to, video clips, ring tones, songs, and so on. Accordingly, the term audiovisual content is used broadly to include photographs, image files, video files, audio files, text, and any other content that may be associated with a contact list entry consistent with the techniques described herein.
Although the invention has been shown and described with respect to certain preferred embodiments, it is understood that equivalents and modifications will occur to others skilled in the art upon the reading and understanding of the specification. The present invention includes all such equivalents and modifications, and is limited only by the scope of the following claims.
The present application claims the benefit of U.S. Provisional Application Ser. No. 60/823,698, filed Aug. 28, 2006, the disclosure of which is herein incorporated by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
60823698 | Aug 2006 | US |