The present invention relates to the field of wireless mobile telephony. More specifically, the present invention relates to visualization of various non-visual aspects of wireless mobile telephony to further improve the usability of wireless mobile phones.
Advances in integrated circuit and telecommunication technology have led to wide spread adoption of wireless mobile client devices, in particular, wireless mobile phones. Wireless mobile phones are popular, partly because they offer the advantage of enabling their users to be communicatively reachable by their business associates, friends and family members, wherever the users may be, as long as they are within the reach of the service networks.
Ever since their initial introductions, the cost for owning and using a wireless mobile phone has steadily declined. Today, the cost for owning and using a wireless mobile phone is well within the ability of many non-professionals. In fact, as the cost for air time continues to decline, wireless mobile phones have become the first medium of communication for non-professionals as well as professionals. When the need to make a call arises, a wireless mobile phone user will reach for their wireless mobile phone first, even if a traditional wired line telephone is readily available.
At the same time, successive generations of wireless mobile phones have also packed more functions and performance while reducing in size. Today, virtually all wireless mobile phones offer core functions such as dial list, call log, and so forth, while many high end models offer advanced functions such as emails and Internet access.
However, there remains a number of situations where the current generation of wireless mobile phones do not adequately address the users' needs and further improvements are needed. One of these situations is where audible operation of a wireless mobile phone is prohibited or inappropriate. In addition to theaters, many restaurants have joined the rank of commercial establishments requesting their patrons to turn off their wireless mobile phones to enhance the enjoyment of other patrons. In circumstances like these, under the prior art, a user would have to either turn off the wireless mobile phone, or go into a “silent” mode to be notified of an incoming call. For the former option, the user will no longer be able to receive an incoming call, and is communicatively disconnected from the user's colleagues and friends. As to the latter option, generally, it means placing the wireless mobile phone in a vibrational mode of operation. Under this mode, a wireless mobile phone appropriately equipped with the proper vibrational features would notify a user of an incoming call through activation of a vibration unit included with the wireless mobile phone. However, once notified, generally there is no convenient way for the user to take and engage in the call. If the user desires to take the call, generally the user has to leave the environment that “imposed” the requirement.
Another situation is in the area of content presentation. While as alluded to earlier, many high end models provide for Internet access, generally, for bandwidth and other reasons, the world wide web (WWW) contents are edited, with substantial amount of the multi-media contents removed. As a result, user experiences are generally less satisfying when compared to e.g. accessing the WWW using a personal computer.
As those skilled in the art of wireless mobile telephony would appreciate, these are but a couple of examples of the limitations of the current generation of wireless mobile phones. One of the primary sensory abilities of a human being is the sensory of vision. Thus, as wireless mobile phones are increasingly becoming a personal accessory, it is desirable in general for wireless mobile phones to have greater abilities to visually present information or visually complement other conventional non-visual features.
The present invention is illustrated by way of example and not by way of limitation in the figures of the accompanying drawings, in which like references indicate similar elements and in which:
a & 2b illustrate the relevant operational flows of the visualizer, including the relevant operational flows of the visualization controller and an exemplary visualization agent, in accordance with one embodiment each, respectively;
a & 3b illustrate an external view of a wireless mobile phone, incorporated with the visualization teachings of the present invention, in accordance with one embodiment;
a & 4b illustrate an exposed view of a wireless mobile phone, incorporated with the visualization teachings of the present invention, in accordance with another embodiment;
a & 7b illustrate exemplary visualizations of graphics and sounds, in accordance with one embodiment of the present invention; and
a & 8b illustrate exemplary visualizations of text and key stroking events, in accordance with one embodiment of the present invention.
The present invention provides for visualization of various non-visual aspects of wireless mobile telephony to further enhance the usability of wireless mobile phones. Among the various visualizations contemplated are visualization of telephony events, alphanumeric contents of messages and web pages, and sound. Visualization of telephony events includes visualization of incoming call notifications and key stroking patterns (e.g. for menu selection). However, from the description to follow, it will be apparent that the visualization teachings of the present invention may also be applied and practiced with other non-visual aspects of wireless mobile telephony.
Further, in the description to follow, for purposes of explanation, various details are set forth in order to facilitate a thorough understanding of the present invention. However, the present invention may be practiced without some or many of the specific details. In other instances, in order not to obscure the present invention, well-known features are omitted, simplified or merely briefly described.
The description will be presented using terms that are commonly employed by those skilled in the art of wireless mobile telephony to convey the substance of their work to others skilled in the same art. Examples of these terms include but are not limited to incoming calls, detecting, determining, requesting, and so forth. As those skilled in the art of wireless mobile telephony would appreciate, these quantities may take the form of electrical, magnetic, or optical signals, and the operations involve corresponding processing of these signals by electrical, magnetic, or optical components.
The term “wireless mobile phone” as used herein (in the specification and in the claims) refers to the class of telephone devices equipped to enable a user to make and receive calls wirelessly, notwithstanding the user's movement, as long as the user is within the communication reach of a “service or base station”. Unless specifically excluded, the term “wireless mobile phone” is to include the analog subclass as well as the digital subclass (of all signaling protocols).
Various operations will be described as multiple discrete steps in turn, in a manner that is most helpful in understanding the present invention. However, the order of description should not be construed as to imply that these operations are necessarily order dependent. In particular, these operations need not be performed in the order of presentation.
The phrase “in one embodiment” will be repeatedly employed in the description to follow. In general, the phrase does not refer to the same embodiment, although in some instances it may.
Referring now to
LEDs 1114 are employed by visualizer 1102 to effectuate visualization of various non-visual aspects of wireless mobile telephony to enhance a user's experience in using wireless mobile phone 1100. More specifically, the desired visualizations are effectuated by visualization controller 1112 selectively activating and de-activating selected ones of LEDs 1114 in selected manners, as requested by the requestors it serves. For the illustrated embodiments, these requesters include visualization agents 1104-1108.
Beside LEDs 1114 and visualizer 1102, for the illustrated embodiment, wireless mobile phone 1100 also includes other hardware and software components 1122-1124. Other hardware components 1122 include in particular a microprocessor for processing instructions, an input keypad for entering data and commands, a visual display for displaying information for the user, and a transceiver for sending and receiving signals wirelessly. Other software components 1124 include in particular corresponding device drivers (e.g. for controlling the input keypad and the visual display), system services (e.g. graphics and audio services), a browser (e.g. for accessing the WWW), and various applications (e.g. dial list, call log, and so forth). Typically, at least selected ones of these system services, the browser and/or the applications include menus of commands for user selection.
For the illustrated embodiment, other hardware and software components 1122-1124 of wireless mobile phone 1100 include in particular the facilities necessary to practice the conduct of a non-audible call, using Morse codes. Conducting non-audible calls, in particular, through employment of Morse code, is the subject of incorporated by reference application '587. The required facilities are described in detail therein. Readers are directed to application '587 for details.
For the illustrated embodiment, these other hardware and software components 1122-1124 of wireless mobile phone 1100 also include in particular the facilities necessary to practice the selection of menu items by stroking or gliding over the input keys of the input keypad in various pre-determined stroking or gliding patterns. Data entry and/or menu item selection by way of key stroking or gliding patterns is the subject of incorporated by reference application '197. The required facilities are described in detail therein. Readers are likewise directed to application '197 for details.
Continuing to refer to
LEDs 1114 are presently preferred for their relatively low power consumption and compactness in size. Together, these attributes allow a higher number of individually illuminable light sources to be employed. In turn, the higher number of illuminable sources allows more variations in the manner the illuminable light sources may be arranged and disposed. However, in alternate embodiments, other light sourcing elements having attributes consistent with the design objectives and constraints may also be employed for the practice of the present invention. Accordingly, the term “LEDs” as used herein and in the claims are to be broadly construed, and given its conventional meaning as well as an expansive meaning including light sourcing elements with like attributes, i.e. with the acronym broadly stand for light emitting devices (unless specifically defined with its conventional meaning of light emitting diodes).
As described earlier, visualization controller 1112 is employed to perform the earlier described selective activation and deactivation of selected ones of LEDs 1114 in selected manners. The performances are made responsive to the requests of various visualization agents 1104-1108. For the illustrated embodiment, each of the various visualization agents 1104-1108 is responsible for invoking visualization controller 1112 to direct the activations and deactivations of LEDs 1114 to achieve the desired visualization for a corresponding non-visual aspect of wireless mobile telephony.
More specifically, event visualization agent 1102 is responsible for invoking visualization controller 1112 to direct LEDs 1114 to effectuate visualization of various telephony events associated with wireless mobile telephony. For the illustrated embodiment, these telephony events include in particular the arrival of an incoming call, as well as the key stroking pattern for selecting a menu item (see
Similarly, text visualization agent 1106 is responsible for invoking visualization controller 1112 to direct LEDs 1114 to effectuate visualization of various textual contents associated with wireless mobile telephony. For the illustrated embodiment, the textual contents include in particular textual contents of messages associated with a non-audible call, conducted using Morse code (see e.g.
For the illustrated embodiment, visualizer controller 1112 advantageously offers at least two manners, a visualization agent may request a visualization operation or visualization operations to be performed. These two manners include a first manner where a singular round of activation and deactivation of LEDs 1114 may be requested, and a second manner where a number of rounds of activation and deactivation of LEDs 1114 may be simultaneously requested via a single request.
In one embodiment, the first manner is requested via a function call to visualization controller 1112, providing controller 1112 with the identifiers of LEDs 1114 to be activated, and the corresponding durations of activation. For this embodiment, all other unspecified LEDs 1114 are assumed to remain deactivated. In alternate embodiments, group specifications in particular, an “ALL” LED group may be advantageously supported. Additionally, in various embodiments, the intensity or brightest of each LED may be specified (e.g. by way of an intensity/brightness index in the range of 0 through 16). Further, for multi-colored LEDs, the color may be specified.
In one embodiment, the second manner is requested via a function call to visualization controller 1112, providing controller 1112 with a pointer to a starting location in the included memory of wireless mobile phone 1100, where a data structure containing a series of rounds or cycles of activation and deactivation specifications is stored. The function call, in addition to the pointer, also includes a size of the data structure. In alternate embodiments, a predetermined end of structure demarcation may be employed, in lieu of a size specification. For each round/cycle of activation and deactivation, the LEDs to be turned on and off are identified. For example, for a row of eight LEDs, the LEDs to be turned on and off for a round or cycle may be specified by the “vector” [01010111] with “0” denoting an “off” state and “1” denoting an “on” state. In alternate embodiments, other manners of specification as well as other manners of providing the specification may be employed instead. Further, as before, the intensity/brightness as well as color (in the case of multi-color LEDs) may be specified.
The above described approaches are just two exemplary approaches where a visualization agent may request visualization controller 1112 to selectively activate and deactivate LEDs 1114 on its behalf. Further, agents 1104-1108 are provided in the illustrated embodiment to facilitate the effectuation of the desired visualizations, such that the desired visualizations may be achieved without requiring or merely requiring relatively small amount of modifications to the main line logic or operational components of wireless mobile phone 1100. However, in embodiments where the earlier described “request” interface of visualization controller 1112 is practiced, the visualization services offered by visualization controller 1112 may also be directly invoked by the other components of wireless mobile phone 1100 instead, should direct incorporation of the required logic into these other components of wireless mobile phone 1100 to practice the present invention be desirable. Thus, generically, a visualization requester, whether it is an “intervening” agent like visualization agents 1104-1108 or a functional “principal” (such as the component responsible for incoming call notification), may be referred to as a visualization “client”.
Referring now to
If the request is determined to be of the first type (i.e. a single round request type), visualization controller 1112 activates and/or deactivates selected ones of LEDs 1114 as requested, block 1208. If the request is determined to be of the second type (i.e. a multiple round/cycle request type), visualization controller 1112 activates and/or deactivates selected ones of LEDs 1114 as requested, block 1208, after retrieving the “specification” for the activations/deactivations to be performed, block 1206. For a multiple round request, the activation/deactivation operation of LEDs 1114 of block 1208 is iteratively performed for a sufficient number of times to achieve the selective activation/deactivation requested.
b illustrates the relevant operational flow of an exemplary visualization agent, which may be event, text or sound visualization agent 1104, 1106, or 1108, in accordance with one embodiment. As illustrated, at initialization, the agent performs one of a number of possible actions to ensure it is availed with the relevant information and/or data associated with the non-visual aspect of wireless mobile telephony it is responsible for. These possible actions include but are not limited to registering itself with an appropriate source or system service, such that it will be notified of or provided with the relevant information and/or data, or performing the necessary set up or re-direct such that it will be availed the relevant information and/or data.
For example, in an embodiment where the practiced visualizations include visualizing notice of an incoming call, at initialization, event visualization agent 1104 may register itself with a component of wireless mobile phone 1100 responsible for detecting an incoming call to notify it of such detection. Alternatively, event visualization 1104 may set itself up such that it can detect any attempt by the component to generate one or more rings for the incoming call. As those skilled in the art would appreciate, visualized notice of an incoming call is a particular useful alternative to the vibrational approach for a non-audible mode of operation, in lieu of the audible rings. Note that even for the non-audible mode of operation, the re-direct approach may nevertheless be effective if the component responsible for generating the audible rings will nevertheless make the attempts to generate the audible rings, and the attempts are merely “suppressed” (i.e. failed) or re-channeled to the component responsible for the vibrational notification, in view of the non-audible mode of operation.
Another example is for text visualization agent 1106 to register itself with or monitor the activities of the component responsible for rendering textual messages received in a non-audible call or the component responsible for rendering substantially textual (i.e. multi-media reduced) web pages. Yet another example is for sounds visualization agent 1108 to register itself with or monitor the activities of the component (e.g. a browser, a radio, a MPx or other media player of phone 1100) responsible for rendering audio contents or streaming audio.
Continuing to refer to
For example, in the case of event visualization agent 1104, it may consider the visualization condition is met upon having been notified by the component responsible for generating audible rings for incoming calls of the fact that an incoming call has been detected. In the case of text visualization agent 1106, it may consider the visualization condition being met upon detecting a textual message of a non-audio call being rendered, or upon detecting the browser rendering non-graphics or substantially textual contents. In the case of sounds visualization agent 1108, it may consider the visualization condition as being met, upon detecting a radio, a MPx or other media player rendering sounds.
Upon determining that one or more visualization conditions are met, the exemplary visualization agent determines the appropriate visualization for the detected condition or conditions, block 1226. In various embodiments, the visualization to be effectuated under various visualization conditions are predetermined, and their exact nature are application dependent.
For example, in the case of event visualization agent 1104, the predetermined visualization may involve requesting visualization controller 1112 to selectively activate and deactivate a row or column of LEDs 1114 to alert the user of an incoming call, or activate selected ones of LEDs 1114 to visualize the key stroking pattern corresponding to a menu selection made. This latter visualization is especially useful in teaching or familiarizing a user in selecting menu options through key stroking pattern (see co-pending '197 application for further detail on menu selection through key stroking pattern). In the case of textual visualization agent 1104, the predetermined visualization may involve requesting visualization controller 1112 to selectively activate and deactivate selected ones of LEDs 1114 to echo the corresponding Morse code representations of the alphanumeric characters of a textual message being rendered for a non-audible call, or selectively activate and deactivate selected ones of LEDs 1114 to render certain predetermined graphics of interest to supplement the non-graphics contents of a web page being rendered. The former visualization is also particularly useful in teaching or familiarizing a user to conduct a non-audible call using Morse code (see co-pending '587 application for further detail on conducting a non-audible call using Morse code). The predetermined graphics for the latter visualization may be completely arbitrary or dependent on the presence of certain key words in the non-graphics contents. In the case of sounds visualization agent 1108, the predetermined visualization may involve requesting visualization controller 1112 to selectively activate and deactivate selected ones of LEDs 1114 to render certain illumination patterns corresponding to certain predetermined attributes of the sound being rendered (e.g. its beat, tempo and so forth). The illumination to be rendered corresponding to the various attributes may be specified or stored in e.g. one or more audio visualization files. These specification files may be pre-provided, dynamically downloaded from a server, or retrieved from a storage medium integrated with an interchangeable covering of the mobile phone (also referred as “active” skin for certain embodiments, see co-pending application 'xxx for further detail). The various attributes may be determined e.g. from samples derived from the audio stream of the integrated radio or MPx player. The sampling may be performed continuously. In other words, for such continuous sampling embodiment, attributes are determined periodically based on the obtained samples, and the illumination pattern is selected based on the determined attributes. This process of attribute determination and illumination pattern selection is repeatedly performed, e.g. for as long as sounds are being rendered (or until instructed by a user to terminate).
Upon determining the visualization, the exemplary visualization agent requests visualization controller 1112 to effectuate the desired visualization accordingly, block 1228. Thereafter, the exemplary visualization agent returns to block 1224, and continues from there as described earlier, until eventually operation of the exemplary visualization agent is terminated (for whatever reason, e.g. when phone 1100 shuts down).
Note that while the foregoing description suggests that event, text and sound visualization agents 1104-1108 may operate with substantially the same operational flow, in alternate embodiments, each or selected ones of visualization agents 1104-1108 may operate with substantially different operational flow instead. Further, the present invention may be practiced with more or less visualization agents. Regardless of the number of visualization agents provided, preferably, user selection facility is provided to enable a user to selectively and individually enable or disable each of the provided visualization agents.
Having now described the present invention from a function view, in particular, the various relevant operational flows, we turn now to describe various exemplary embodiments for disposing and configuring the various elements for practicing the visualizations of the present invention.
For the illustrated embodiment, as alluded to earlier, wireless mobile phone 1100a includes antenna 1320, speaker 1322, visual display 1324, input key pad 1326 having input keys 1328, microphone 1330, and so forth. More importantly, wireless mobile phone 1100a includes LEDs 1114a disposed on a side exterior surface of the body of wireless mobile phone 1100a. In one implementation, wireless mobile phone 1100a further includes a radio (not shown). In another, wireless mobile phone 1100a further includes a MPx player (not shown).
In alternate embodiments, LEDs 1114a may be disposed in other exterior surfaces of the body of the wireless mobile phone 1100a instead. These other exterior surfaces may include the top or bottom exterior surface, and the front or back exterior surface. Note that by virtue of the manner content is displayed in visual display 1324, the exterior surfaces corresponding to the top, bottom, side, front and bottom surface are definitively defined.
For the illustrated embodiment, LEDs 1114a are disposed on the side exterior surface in a substantially columnar manner, along imaginary longitudinal axis 1311. In alternate embodiments, LEDs 1114a may be arranged in other configurations, e.g. in multiples of even or uneven rows and/or columns.
In one embodiment, LEDs 1114a are single ed LEDs of the same color. In another embodiment, LEDs 1114a are single colored LEDs of different colors. In yet another embodiment, every three single colored LEDs of different colors (e.g. one Red, one Green, and one Blue) are grouped and proximately disposed together (e.g. each input key having one corresponding group of LEDs around it), functionally forming multiple 3-LED groups to facilitate manifestation of other non-basic colors, such as orange, yellow and so forth. In yet another embodiment, at least some of LEDs 1114a are multi-colored LEDs. A multi-colored LED is a LED that is capable of emitting light in a selected one of a plurality of colors.
Similar to the embodiments of
More importantly, wireless mobile phone 1100b includes LEDs 1114b disposed on the interior front surface of wireless mobile phone 1100b, near or around input keys 1428. With front cover (face plate) 1421 in place, LEDs 1114b appear to be integrally disposed with input keys 1428. In other words, for the illustrated embodiment, LEDs 1114b are disposed and configured as an array of light sources. In one implementation, front cover (face plate) 1421 further includes an electronic component (not shown) having stored therein, programming instructions implementing a MPx player.
Similar to the variants of the embodiment of
As will be described in more detail below, front cover (face plate) 1421 may be an “active” front cover/face plate having an electronic component wherein all or portions of the visualization teachings of the present invention are implemented. In particular, in various embodiments, “active” front cover (face plate) 1421 is an “active” covering “skin” covering all or a portion of the body of wireless mobile phone 1100b. For these embodiments, instead of being disposed and configured on the interior front surface of wireless mobile phone 1100b, LEDs 1114b may be disposed on the exterior surface of the “active” interchangeable front cover (face plate) or covering “skin” instead. Active front cover (face plate) or covering “skin” is the subject matter of incorporated by reference application 'zzz. The constituting elements of these active front cover (face plate) or covering “skin” are described in details therein. Readers are referred to application 'zzz for details.
In addition to the conventional functions performed by these elements, the elements are employed to practice the visualization teachings of the present invention earlier described. In particular, among the conventional functions, it is expected that TX/RX 1513 may support one or more signaling protocols, including, but not limited to, code division multiple access (CDMA), time division multiple access (TDMA), global system for mobile communications (GSM), cellular digital packet data (CDPD), and so forth. Similarly, communication interface 1511 may support one or more serial, parallel and/or wireless communication protocols.
In alternate embodiments, other elements may be added, as well as having one or more of the illustrated elements omitted, without departing from the spirit and scope of the present invention.
In one embodiment, electronic component 1620 is a memory device, e.g. a subscriber identity module (SIM). In alternate embodiments, it may be a microprocessor having embedded memory. More importantly, for these embodiments, at least one or more of the visualization agents 1104-1108 are stored in the embedded memory. In various embodiments, the entire visualizer 1102, including visualization controller 1112, as well as agents 1104-1108 are stored in the embedded memory. In other words, for these embodiments, the visualization ability is additionally provided or partially provided to wireless mobile phone 1100 through the employment of an “active” interchangeable “cover” 1421 (i.e. face plate or covering skin), having embedded electronic component 1620 including all or a portion of visualizer 1102b.
Thus, it can be seen from the above description, methods and apparatuses for supplementing wireless mobile telephony with visualization of various non-visual aspects of wireless mobile telephony to improve usability have been described. As mentioned earlier, while the present invention has been described in terms of the above-illustrated embodiments, the present invention is not limited to the embodiments described. The present invention can be practiced with modification and alternation within the spirit and scope of the appended claims. For example, in various embodiments, visualization of events may include visualization of an “idle” state. That is, upon detection of an “idle” state, a predetermined pattern of activation and deactivation of the LEDs may be effectuated. The predetermined pattern may correspond to a theme, e.g. a Christmas theme, an American theme, and the like. The predetermined pattern may be pre-provided, downloaded or retrieved from the integrated electronic component of an interchangeable cover plate (“active” skin). Thus, the description is to be regarded as illustrative instead of restrictive on the present invention.
The present application is a non-provisional application of provisional application Ser. No. 60/313,247, filed on Aug. 17, 2001, having the same title, and claims priority to said provisional application. The present application is also a continuation-in-part application of (a) copending U.S. patent application Ser. No. 09/975,287, filed Oct. 10, 2001, entitled “A Wireless Mobile Phone with Encoded Data Entry Facilities”; which itself is a continuation-in-part application to U.S. patent application Ser. No. 09/767,587, filed Jan. 22, 2001 U.S. Pat. No. 6,418,323, entitled “A Wireless Mobile Phone with Morse Code and Related Capabilities”;(b) copending U.S. patent application Ser. No. 09/767,197, filed Jan. 22, 2001, entitled “A Wireless Mobile Phone with Key Stroking Based Input Facilities”;(c) copending U.S. patent application Ser. No. 10/367,620 filed Feb. 12, 2003, contemporaneously filed, entitled “Personalizing Electronic Devices and Smart Covering”, which itself is a non-provisional application of provisional application Ser. No. 60/306,326, filed Jul. 17, 2001, having the same title; and(d) copending U.S. patent application Ser. No. 09/908,118 filed Jul. 17, 2001, entitled “Luminescent Signaling Displays Utilizing A Wireless Mobile Communication Device”. The specifications of these applications are herein fully incorporated by reference.
Number | Name | Date | Kind |
---|---|---|---|
5946636 | Uyeno et al. | Aug 1999 | A |
5973612 | Deo et al. | Oct 1999 | A |
6144848 | Walsh et al. | Nov 2000 | A |
6304763 | Jahagirdar et al. | Oct 2001 | B1 |
6418323 | Bright et al. | Jul 2002 | B1 |
6438390 | Awan | Aug 2002 | B1 |
6792294 | Kushita | Sep 2004 | B1 |
Number | Date | Country | |
---|---|---|---|
20020098876 A1 | Jul 2002 | US |
Number | Date | Country | |
---|---|---|---|
60313247 | Aug 2001 | US | |
60306326 | Jul 2001 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 09975287 | Oct 2001 | US |
Child | 10086954 | US | |
Parent | 09767587 | Jan 2001 | US |
Child | 09975287 | US | |
Parent | 10086954 | US | |
Child | 09975287 | US | |
Parent | 10367620 | Feb 2003 | US |
Child | 10086954 | US | |
Parent | 09908118 | Jul 2001 | US |
Child | 10367620 | US | |
Parent | 09767197 | Jan 2001 | US |
Child | 09908118 | US |