Patent Grant
7903087
The present disclosure is directed toward a wireless handheld communication device that utilizes a trackball as a user auxiliary input tool; and more particularly, to the use of such a trackball to guide a cursor about a display screen of the communication device using rolling action of the trackball, as well as select highlighted or otherwise designated information on the screen using a click or depression action on the trackball.
With the advent of more robust wireless communications systems, compatible handheld communication devices are becoming more prevalent, as well as advanced. In a broader sense, these devices are referred to as handheld electronic devices, which include devices without communication functions. Where in the past such handheld communication devices typically accommodated either voice (cell phones) or text transmission (pagers and PDAs), today's consumer often demands a combination device capable of performing both types of transmissions, including sending and receiving e-mail. The suppliers of such mobile communication devices and underlying service providers are anxious to meet these demands, but the combination of voice and textual messaging, as well as other functionalities such as those found in PDAs, have caused designers to have to improve the means by which information is input into the devices by the operator, as well as provide better facilitation for the operator/user to navigate within the menus and icon presentations necessary for efficient operator interface with these more complicated devices.
For many reasons, screen icons are often utilized in such handheld communication devices as a way to allow operators to make feature and/or function selections. Among other reasons, operators are accustomed to such icon representations for function selection. A prime example is the personal computer “desktop” presented by Microsoft's Windows® operating system. Because of the penetration of such programs into the user markets, most electronics users are familiar with what has basically become a convention of icon-based functionality selections. Even with many icons presented on a personal computer's “desktop”, however, user navigation and selection among the different icons is easily accomplished utilizing a conventional mouse and employing the point-and-click methodology. The absence of such a mouse from these handheld wireless communication devices, however, has caused a different protocol to develop for icon navigation and selection.
As depicted in
In the trackball instance, current technology calls for the utilization of paired sensors located about the trackball for sensing rotational motion of the trackball which is representative of the desired direction the user would like the cursor to move on the screen, including a highlighting cursor that moves discretely amongst screen-displayed icons. The trackball itself is capable of free rotation within its receiving socket which gives the operator an impression that he or she can direct cursor motion on the screen (be it an icon highlighting cursor or a more traditional cursor such as a floating arrowhead) in any direction desired within the area of the display screen.
Not only is the trackball enabled for directing cursor movement on the display screen, but the ball itself is configured to be depressible so that when actuated (depressed), a selection is made just as if an equivalent button had been depressed. In this manner, the trackball is provided at least with dual functionality (navigation and selection). By providing this dual functionality in the trackball, inclusion of such an equivalent button is avoided thereby preserving prime “real estate” on the device for other uses. A problem, however, exists between this duality in functionality of the trackball and the manner in which an operator typically engages the trackball for depressed actuation. Very rarely will the operator's finger/thumb come directly down upon the trackball when press-engaging. Instead, initial engagement is nearly always a “glancing” engagement which means that the operator's digit is not only coming down on the trackball, but is also traveling thereacross. This sideways engagement induces rolling in the trackball that in some instances can cause the cursor to move from the intended location before depressed actuation (highlighted information selection) is accomplished. If this results, a wrong selection is highly likely. Therefore one aspect of the present disclosure details how to prevent such inadvertent cursor movement when in fact it is depressed actuation and selection that the operator intends.
Another constraint of the paired sensor configuration described above is that even though the trackball enjoys free rotation, its rotational movement must be resolved into X and Y components via the motion sensors. Therefore, movement between icons has been limited to up, down and sideways motion. More specifically, diagonal movement between icons has not been previously facilitated. As an example, and returning again to
Since these limitations are counterintuitive given the fact the trackball enjoys free rotation but the operator cannot move diagonally from icon to icon in a single step, frustration and product dissatisfaction are likely. Therefore, a primary aspect of the presently disclosed solution is the enablement of such direct diagonal movement between icons, even when the signals developed using the navigational tool are X and Y direction limited.
It should be appreciated that the examples of icon and spreadsheet navigation present a special problem typically not encountered when navigating across continuous screen fields such as, for example, when cursor-traversing a map that is presented on the screen. In the instance of at least trackball navigation, the individual X and Y signal components will normally be fine (small) enough to even be executed on a pixel-by-pixel basis. As a result, in most cases, the operator will not be able to visually detect that he or she is getting X-Y stepped movement of the cursor; to the eye, the steps are so small (pixel-by-pixel) that the cursor appears to be moving on a diagonal or smooth curve when accordingly directed. It should be appreciated, however, that there are certain configurations in which the X-Y limited movement is not sufficiently fine and the operator perceives an undesirable zig-zag motion of the cursor. Therefore the presently presented solutions focus on enabling an operator to diagonally navigate a cursor on a screen of a handheld electronic device by “blending” X and Y direction signals into diagonal signals for affecting diagonal cursor movement, and particularly in environments such as icon fields and spreadsheet matrices, and especially without experiencing undue delay or lag between the input of the instruction and the cursor's actual movement.
In another aspect, because these handheld electronic devices are getting substantially smaller and users are demanding greater and constant access, the devices are often carried in the user's pocket. Furthermore, since the trackball is exposed and rotates freely at the surface of the device, it is susceptible to unintentional and usually undesirable rotation. As an example, this can occur when the user places the handheld electronic device in his or her pocket and the rubbing of the fabric against the trackball causes unintentional rolling of the trackball. The undesirable nature of this occurrence is at least partly attributable to the fact that actuation of a device's navigation tool traditionally restores power to the screen (after having entered a sleep mode) because it is usually interpreted as an indication that the user wants to use the device in some capacity. Therefore, if the trackball is frequently unintentionally actuated, the screen will be lit unnecessarily, wasting battery power.
As described above, in the instance of a trackball being used as the navigation tool, sensors are required to detect motion of the trackball. Therefore, in order to be able to detect rollerball motion indicative of desired use, the sensors must always be powered-on which consumes energy and reduces the energy savings experienced because the screen has been put into sleep mode.
The present disclosure is directed toward minimizing or eliminating the deficiencies outlined above and which would otherwise prevail except for the mitigating solutions described and disclosed herein.
Exemplary methods and arrangements conducted and configured according to the advantageous solutions presented herein are depicted in the accompanying drawings where in:
As intimated hereinabove, one of the more important aspects of the types of handheld electronic devices to which this disclosure is directed is their size. While some users will grasp the device in both hands, it is intended that a predominance of users will cradle the device in one hand in such a manner that input and control over the device can be affected using the thumb of the same hand in which the device is held. Therefore the size of the device must be kept relatively small; of its dimensions, limiting the width of the device is most important with respect to assuring cradleability in a user's hand. Moreover, it is preferred that the width of the device be maintained at less than ten centimeters (approximately four inches). Keeping the device within these dimensional limits provides a hand cradleable unit that users prefer for its useability and portability. Limitations with respect to the height (length) of the device are less stringent with importance placed on maintaining device hand-cradleability. Therefore, in order to gain greater size, the device can be advantageously configured so that its height is greater than its width, but still remain easily supported and operated in one hand.
A potential problem is presented by the small size of the device in that there is limited exterior surface area for the inclusion of user input and device output features. This is especially true for the “prime real estate” of the front face of the device where it is most advantageous to include a display screen that outputs information to the user and which is preferably above a keyboard utilized for data entry into the device by the user. If the screen is provided below the keyboard, a problem occurs in being able to see the screen while inputting data. Therefore it is preferred that the display screen be above the input area, thereby solving the problem by assuring that the hands and fingers do not block the view of the screen during data entry periods.
To facilitate textual data entry, an alphabetic keyboard is provided. In one version, a full alphabetic keyboard is utilized in which there is one key per letter. This is preferred by some users because it can be arranged to resemble a standard keyboard with which they are most familiar. In this regard, the associated letters can be advantageously organized in QWERTY, QWERTZ or AZERTY layouts, among others, thereby capitalizing on certain users' familiarity with these special letter orders. In order to stay within the bounds of a limited front surface area, however, each of the keys must be commensurately small when, for example, twenty-six keys must be provided in the instance of the English language. An alternative configuration is to provide a reduced keyboard in which at least some of the keys have more than one letter associated therewith. This means that fewer keys can be included which makes it possible for those fewer keys to each be larger than in the instance when a full keyboard is provided on a similarly dimensioned device. Some users will prefer the solution of the larger keys over the smaller ones, but it is necessary that software or hardware solutions be provided in order to discriminate which of the several associated letters the user intends based on a particular key actuation; a problem the full keyboard avoids. Preferably, this character discrimination is accomplished utilizing disambiguation software accommodated within the device. As with the other software programs embodied within the device, a memory and microprocessor are provided within the body of the handheld unit for receiving, storing, processing, and outputting data during use. Therefore, the problem of needing a textual data input means is solved by the provision of either a full or reduced alphabetic keyboard on the presently disclosed handheld electronic device.
Keys, typically of a push-button or push-pad nature, perform well as data entry devices but present problems to the user when they must also be used to affect navigational control over a screen-cursor. In order to solve this problem the present handheld electronic device preferably includes an auxiliary input that acts as a cursor navigational tool and which is also exteriorly located upon the front face of the device. Its front face location is particularly advantageous because it makes the tool easily thumb-actuable like the keys of the keyboard. A particularly usable embodiment provides the navigational tool in the form of a trackball which is easily utilized to instruct two-dimensional screen cursor movement in substantially any direction, as well as act as an actuator when the ball of the trackball is depressible like a button. The placement of the trackball is preferably above the keyboard and below the display screen; here, it avoids interference during keyboarding and does not block the user's view of the display screen during use.
In some configurations, the handheld electronic device may be standalone in that it is not connectable to the “outside world.” One example would be a PDA that stores such things as calendars and contact information, but is not capable of synchronizing or communicating with other devices. In most situations such isolation will be detrimentally viewed in that at least synchronization is a highly desired characteristic of handheld devices today. Moreover, the utility of the device is significantly enhanced when connectable within a system, and particularly when connectable on a wireless basis in a system in which both voice and text messaging are accommodated.
In at least one embodiment, the presently disclosed solutions are directed toward facilitating the use of a depressible trackball 150 on a wireless handheld communication device 300 as a navigation tool and a selection tool relative to information presented on a display screen 322 of the device 300 as depicted in
Cursor navigation is affected about the display screen 322 by digitally (finger or thumb) engaging the trackball 150 and maintaining the trackball 150 in a navigation zone 167 that spans a predefined depth into the device 300 down from an unactuated position of the trackball 150 as depicted in
The selection of highlighted or otherwise designated information 172 is affected on the display screen 322 by digitally depressing the trackball 150 into a selection zone 168 that is a predefined depth into the device 300 below the navigation zone 167 (see
The flow chart of
As an example, cursor movement is prevented by disregarding cursor movement signals generated by one or more trackball rotational movement sensors 160, 162, 164 and 166 when the trackball 150 is located in the selection zone 168.
Such disregard of cursor movement signals from the sensors 160, 162, 164 and 166 is accomplished using an incorporated (programmed) filter-function associated with an integrated controller (microprocessor 338, see
In one embodiment, whether the trackball 150 is located in the navigation zone 167 or the selection zone 168 is sensed and a cursor-control routine is implemented via the integrated microprocessor controller 338 that is tailored for the particular zone within which the trackball 150 is sensed to be located.
In a related embodiment, the navigation/selection process/method outlined in
As depicted in
In view of its wireless nature, in an exemplary embodiment, the handheld communication device transmits data to, and receives data from a communication network utilizing radio frequency signals (see
As depicted in
Alternatively, and as depicted in
In an alternative embodiment, a similar method is disclosed in which the use of a trackball 150 as a navigation tool and a selection tool is facilitated relative to information 172 presented on a display screen 322 of the device 300. The method comprises providing a wireless handheld communication device 300 including at a front face thereof a display screen 322 located above a keyboard 332 suitable for accommodating textual input to the device 300. The device 300 further includes a depressible trackball 150 that functions as a navigation tool for moving a cursor 171 about on the display screen 322, when rolled, and functions as a selection tool for selecting cursor-highlighted information 172 on the display screen 322 when sufficiently depressed. Cursor navigation is affected about the display screen 322 by digitally engaging and rolling the trackball 150. Selection of highlighted information 172 on the display screen 322 is affected by digitally depressing the trackball 150 into the device 300. Initial engagement of the trackball 150 is sensed based on movement thereof (up, down or rotational) and a time-delay function is instituted during which no cursor movement is affected for a predetermined period of time.
As before, prevention of cursor movement is continued if the trackball 150 is depressed into a selection zone 168 indicating the user's desire to select designated (cursor-highlighted) information 172 on the display screen 322 before expiration of the predetermined time-delay period. Cursor movement is prevented by disregarding cursor movement signals generated by one or more trackball rotational movement sensors 160, 162, 164 and 166 when the trackball 150 is located in the selection zone 168. Disregard of cursor movement signals is accomplished using a filter-function associated with an integrated controller 338 of the wireless handheld communication device 300 that nullifies the cursor movement signals when the trackball 150 is located in the selection zone 168. Furthermore, nullification of the cursor movement signals is accomplished using one of an arithmetic-based filter-function or a time-based window filter-function.
In an alternative aspect, the present disclosure is directed to methods and arrangements for facilitating diagonal cursor movement in such environments as icon arrays 170 and spreadsheet grids on a display screen 322 of a relatively small, wireless handheld communication device 300, variously configured as described above, such as that depicted in
As depicted in
As may be appreciated from
In one embodiment, the keyboard 332 comprises a plurality of keys with which alphabetic letters are associated on a one letter per key basis. It is contemplated that the keys may be directly marked with the letters, or the letters may be presented adjacent, but clearly in association with a particular key. This one-to-one pairing between the letters and keys is depicted in
In the alternative embodiment of
As depicted in
In one embodiment, the plurality of sensors 160, 162 number two. One of the two sensors 162 outputs signals indicative of x-component rolling motion of the trackball 150 relative to the handheld communication device 300 and about the intersecting y-axis 154 of the trackball (see the rotational arrows about the y-axis in
In another embodiment, the plurality of sensors 160, 162, 164, 166 number four. A first pair of opposed sensors 162, 166 outputs signals indicative of x-component rolling motion of the trackball 150 relative to the handheld communication device 300 and about the intersecting y-axis 154. A second pair of opposed sensors 160, 164 outputs signals indicative of a y-component rolling motion of the trackball 150 relative to the handheld communication device 300 and about the intersecting x-axis 152. The four sensors 160, 162, 164, 166 are oriented radially about the trackball 150 with approximately ninety degree spacing between consecutive sensors as depicted in
Each produced x-direction signal represents a discrete amount of x-component (incremental x-direction) rolling motion of the trackball 150 relative to the handheld communication device 300 while each produced y-direction signal represents a discrete amount of y-component (incremental y-direction) rolling motion of the trackball 150 relative to the handheld communication device 300.
In one embodiment, the predetermined criterion for discriminating user indicated x-direction cursor movement is identification of a threshold number of x-direction signals in a predetermined signal sample. For example, out of a moving-window sample of 10 consecutive signals, six or more must be x-signals in order to be indicative of desired x-direction cursor movement. Likewise, the predetermined criterion for discriminating user indicated y-direction cursor movement is identification of a threshold number of y-direction signals in a predetermined signal sample. The same sampling example holds, but applied to y-signals instead of x-signals. In a similar respect, the predetermined criterion for discriminating user indicated diagonal cursor movement is identification of a threshold number of x-direction signals and a threshold number of y-direction signals in a predetermined signal sample. For instance, out of a moving-window sample of 10 consecutive signals, four or more must be x-signals and four or more must be y-signals in order to be indicative of desired diagonal cursor movement.
In a more generic sense, it is pattern recognition software that is utilized to identify user indicated diagonal cursor movement based on analysis of a predetermined signal sample.
Alternatively, a method is disclosed for affecting diagonal movement of a highlighting cursor 171 amongst an array of icons 170 on a display screen 322 of a handheld communication device 300. Movement at an auxiliary user input 328 of the handheld communication device 300 is sensed and which is indicative of the user's desire to affect diagonal movement of the highlighting cursor 171 from a currently highlighted icon 172 on the display screen 322 to a diagonally located icon 174 on the display screen 322 of the handheld communication device 300. The movement is described as being “at” the auxiliary user input 328 to cover such situations as when the input is a touchpad or similar device since no portion of that type of input device actually moves, but the user's finger indicatively moves relative thereto (across the touchpad).
As in the previously described method, x-direction signals and y-direction signals are produced based on the sensed movement at the auxiliary user input 328. Again, the highlighting cursor 171 is held steady on a presently highlighted icon 172 on the display screen 322 while processing the x-direction signals and y-direction signals until a predetermined criterion is met for discriminating whether the user has indicated movement to an icon left or right of the presently highlighted icon 172, above or below the presently highlighted icon 172, or diagonally positioned relative to the presently highlighted icon 172. Diagonal movement of the highlighting cursor 172 is then affected between diagonally positioned icons on the display screen 322 of the handheld communication device 300 when diagonal cursor movement is discriminated to have been user indicated. In other respects, this embodiment is similar to that which has been earlier described.
In yet another embodiment, the apparatus of a handheld communication device 300 is disclosed that is capable of affecting diagonal movement of a highlighting cursor 171 amongst an array of icons 170 on a display screen 322 of the handheld communication device 300. The display screen 322 is located above a keyboard 332 suitable for accommodating textual input to the handheld communication device 300 and an auxiliary user input 328 is located essentially between the display 322 and keyboard 332. Sensors 160, 162 (164, 166) are provided that are capable of sensing movement at the auxiliary user input 328 indicative of the user's desire to affect diagonal movement of the highlighting cursor 171 from a currently highlighted icon number 172 on the display screen 322 to a diagonally located icon 174 on the display screen 322 of the handheld communication device 300. The sensors produce x-direction signals and y-direction signals based on the sensed movement at the auxiliary user input 328. A processor 338 is included that is capable of analyzing the produced x-direction signals and y-direction signals and outputting a cursor control signal that holds the highlighting cursor 171 steady on a presently highlighted icon 172 on the display screen 322 during the processing and until a predetermined criterion is met for discriminating whether the user has indicated movement to an icon left or right of the presently highlighted icon, above or below the presently highlighted icon 172, or diagonally positioned relative to the presently highlighted icon numeral and 72 and then affecting diagonal movement of the highlighting cursor number 171 between diagonally positioned icons on the display screen of the handheld communication device 300 when diagonal cursor movement is discriminated to have been user indicated.
As mentioned hereinabove, there are situations in which the user will not want the X and Y signals to be converted into diagonal movement generating signals. For example, when navigating a map scene or other type of image, the finest directional movement possible from the navigation tool will be most desired; otherwise the “collection” of X and Y signals produces undesirable “jerky” cursor movement. Therefore, in at least one embodiment, the diagonal movement feature can be turned on and off by the user, or is automatically set in dependence upon the application that is being cursor-traversed.
In another aspect, when non-use of the device 300 has been determined, the handheld electronic device 300 enters a power-saving mode. As an example, non-use of the device 300 is detected when neither the device's applications nor its features have been utilized for a predetermined length of time. In yet another embodiment, the determination of non-use of the device 300 is based on a preselected period of time elapsing between sensor-detected movements of the ball 150 of the trackball navigation tool 328. In another embodiment, a routine is used to detect when the device 300 is placed into an environment where use of the screen 322 and auxiliary input 328 is no longer required, such as when the device 300 is placed in a holster or pocket of the user. In yet another embodiment, the determination of non-use is based on user actuation of a preset key combination; preferably this is by depressing and holding the trackball navigation tool 328 for longer than a preset time period.
The key combination used to determine non-use of the device 300 can be preset or user definable. If a preset key combination is implemented, the keys used to indicate non-use are a set of keys that would not normally be entered by the user of the device 300. The key combination may further involve selecting a feature from a menu of items or an icon on the home screen of the device 300. The user defined key combination preferably informs the user that the device 300 is going into a non-use mode and allows exit thereof when the preset key combination is entered.
In one embodiment, a method for reducing power consumption during periods of non-use by the handheld electronic device 300 is disclosed. This method involves a power-saving mode that disables a sensor 160, 162, 164, 166 that, as described above is used to detect motion of the ball 150 of the trackball navigation tool 328. Furthermore, the power consumption can further be reduced through the use of a display screen sleep mode. Preferably, the screen sleep mode is instituted before disablement of the sensors 160, 162, 164, 166. Thus, the power consumption is stepwise reduced in degree by an initial amount attributable to the institution of the display screen sleep mode. An incremental increase in power-savings is experienced by disabling the sensors 160, 162, 164, 166.
Implementation of the power-savings mode is further described in relation to the sensors 160, 162, 164, 166. When a device 300 implements one or more sensors 160, 162, 164, 166 for detecting movement of the trackball 150, power-savings can be realized through disabling one or more of the available sensors 160, 162, 164, 166 on the device. Preferably, all sensors 160, 162, 164, 166 are disabled. When the sensors 160, 162, 164, 166 are disabled, rolling motion of the ball 150 will not cause an exit from the power-savings mode because no motion is recorded because the sensors 160, 162, 164, 166 are disabled.
In a further embodiment, the method disables the display screen 322 of the handheld 300 before disabling the sensor 160, 162, 164, 166. This is referred to as a display screen sleep mode which reduces the power consumed by the device 300 because the screen 322 is not consuming power. By first disabling the screen 322 and then disabling the sensor 160, 162, 164, 166 it is possible to allow for an exit from the display screen sleep mode by moving the ball 150 of the trackball navigation tool 328. Thus, when motion of the ball 150 is detected before the sensor 160, 162, 164, 166 is effected, an exit from power-saving mode is effected. This delay is appropriate to allow a user of the device 300 a chance to abort entry into a power-saving mode, which may not be desired at that time. Preferably, the user is informed of entry into this power-savings mode by having the display 322 disabled before the sensor 160, 162, 164, 166.
The screen sleep mode or power-saving mode can be exited through the use of a predefined routine. In a preferred embodiment, a preset wakeup key combination is used to restore the device 300 to a use-mode. This preset wakeup key combination can take the form of select button and “*” in sequential order. Another preferred key combination is depressing the trackball 150 and pressing “*” simultaneously or sequentially. Other key combinations are considered within the scope of this disclosure. Alternatively, the device 300 features a mechanism to detect the proximity of a human digit in relation to the trackball. When the digit is within a predefined distance from the trackball 150, the device 300 detects the presence of the digit and the device 300 exits the power-saving mode.
In another embodiment, a method for power consumption savings for a handheld electronic device 300 having a trackball navigation tool 328 is presented. This involves entering a screen sleep mode, receiving an input from one of the sensors 160, 162, 164, 166 associated with the trackball 150, and entering a low power display mode. This low power display mode utilizes the ability to reduce the intensity of the light of the screen 322 in order to save power. Thus after the screen 322 was put into a sleep mode in which the functionality of the device 300 continues to operate and only the screen 322 is turned off, a selection input will cause the screen 322 to enter the low power state where it does not return to full brightness.
The input from the sensor used to exit the screen sleep mode can be either a sensor 160, 162, 164, 166 or a selection sensor (not shown). Thus if a sensor 160, 162, 164, 166 is used to exit the screen sleep mode, a roll of the ball 150 such that it actuates one of the plurality of sensors 160, 162, 164, 166 will exit the screen sleep mode. However, if the input is from the selection sensor merely rolling the ball 150 will not exit the screen sleep mode. Using the selection sensor, will require a selection actuation of the navigation tool 328 in order to exit the screen sleep mode. Alternatively, other keys, combination of keys, combination of a key and navigation tool, or combination thereof may be used to exit the screen sleep mode.
In an exemplary embodiment, the method of going from a power save mode to a full power mode is shown. Once the power save mode has been activated either by the user of the device 300 or by the device 300 itself, the sensors 160, 162, 164, 166 are disabled. When a detection of either a key press or depression (selection operation) of the trackball 150 is made, the device is put into a low power mode. Alternatively, one of the above described inputs may be used to determine when to enter low power mode. Once the low power mode has been entered, the sensors 160, 162, 164, 166 will be activated again. Once another actuation of the trackball 150 or keys is detected the device will then enter full power mode.
Yet another embodiment is a handheld electronic device 300 having a trackball navigation tool 328 and being adapted to reduce power consumption during periods of non-use. The trackball navigation tool 328 is the same as described above along with the sensor 160, 162, 164, 166, which is able to effect corresponding cursor movement on a display screen. The device 300 has a processor 338 that is capable of being programmed to reduce power consumption during periods of non-use by instituting a power-saving mode that disables the sensor 160, 162, 164, 166 when non-use of the device 300 is determined.
The handheld electronic device 300 in one embodiment makes use of a standby mode to save power. This mode can be entered either automatically by not detecting a level of activity for a given period of time or through a key sequence. Some of the examples of the key sequence that can be entered include depressing the power button for a short amount of time (not long enough to turn off the device) or depressing the mute key while not on a phone call. This standby mode can likewise be exited through the same set of key presses or a different set when standby mode is no longer desired.
When the device 300 has entered the standby mode, the screen 322 is put into a sleep mode in which the screen 322 is no longer illuminated. The screen 322 remains in this sleep mode unless the keys required to exit standby mode are depressed. When entering the standby mode, a message is presented on the display 322 informing the user that a standby mode is going to be entered and the key presses required to exit the mode. The device 300 will, however, continue to receive messages and phone calls. If a phone call is received by the device 300, it can be answered without exiting the standby mode or by temporarily disabling the standby mode. Once the phone call is finished the device 300 will again resume the standby mode.
If the device 300 is subsequently put into a holster, the device 300 will sense the holster position and this will override the standby mode. Thus, when the device 300 is holstered while in standby mode, it will respond based upon the holster settings for the device 300. When removed from the holster it will resume normal operation and ignore the earlier entered standby mode operation. Likewise, if the device 300 is placed into standby mode and the device 300 is also enabled with a security timeout mode, the device 300 will enter the security timeout mode at the appropriate time as controlled through the security timeout mode.
The motion of the navigation tool 328 commands a cursor to move on the display screen 322 of a handheld electronic device 300. While “cursor” movement is referred to herein, it shall be appreciated that any resultant motion that is directed by the navigation tool 328 is contemplated. Other such motions include but are not limited to scrolling down through a view on a webpage and scrolling through menu options. It should be appreciated that all such types of navigational motion on the display screen 322 is exemplarily described herein in terms of a cursor (such as a pointing arrow) movement across a display screen 322; however, those persons skilled in the art will also appreciate that “cursor” movement or navigation on a screen can also be descriptive of successively highlighting presented menu items, screen icons and the like.
The handheld communication device 300 comprises a radio transmitter 318 capable of transmitting data to a communication network 319 utilizing radio frequency signals and a radio receiver 312 capable of receiving data from the communication network 319 utilizing radio frequency signals.
Further aspects of the environments, devices and methods of employment described hereinabove are expanded upon in the following details. An exemplary embodiment of the handheld electronic device as shown in
The handheld electronic device includes an input portion and an output display portion. The output display portion can be a display screen, such as an LCD or other similar display device.
The input portion includes a plurality of keys that can be of a physical nature such as actuable buttons or they can be of a software nature, typically constituted by virtual representations of physical key on a display screen (referred to herein as “software keys”). It is also contemplated that the user input can be provided as a combination of the two types of keys. Each key of the plurality of keys has at least one actuable action which can be the input of a character, a command or a function. In this context, “characters” are contemplated to exemplarily include alphabetic letters, language symbols, numbers, punctuation, insignias, icons, pictures, and even a blank space. Input commands and functions can include such things as delete, backspace, moving a cursor up, down, left or right, initiating an arithmetic function or command, initiating a command or function specific to an application program or feature in use, initiating a command or function programmed by the user and other such commands and functions that are well known to those persons skilled in the art. Specific keys or other types of input devices can be used to navigate through the various applications and features thereof. Further, depending on the application or feature in use, specific keys can be enabled or disabled.
In the case of physical keys, all or a portion of the plurality of keys have one or more indicia displayed at their top surface and/or on the surface of the area adjacent the respective key, the particular indicia representing the character(s), command(s) and/or function(s) typically associated with that key. In the instance where the indicia of a key's function is provided adjacent the key, it is understood that this may be a permanent insignia that is, for instance, printed on the device cover beside the key, or in the instance of keys located adjacent the display screen, a current indicia for the key may be temporarily shown nearby the key on the screen.
In the case of software keys, the indicia for the respective keys are shown on the display screen, which in one embodiment is enabled by touching the display screen, for example, with a stylus to generate the character or activate the indicated command or function. Such display screens may include one or more touch interfaces, including a touchscreen. A non-exhaustive list of touchscreens includes, for example, resistive touchscreens, capacitive touchscreens, projected capacitive touchscreens, infrared touchscreens and surface acoustic wave (SAW) touchscreens.
Physical and software keys can be combined in many different ways as appreciated by those skilled in the art. In one embodiment, physical and software keys are combined such that the plurality of enabled keys for a particular application or feature of the handheld electronic device is shown on the display screen in the same configuration as the physical keys. Thus, the desired character, command or function is obtained by depressing the physical key corresponding to the character, command or function displayed at a corresponding position on the display screen, rather than touching the display screen. To aid the user, indicia for the characters, commands and/or functions most frequently used are preferably positioned on the physical keys and/or on the area around or between the physical keys. In this manner, the user can more readily associate the correct physical key with the character, command or function displayed on the display screen.
The various characters, commands and functions associated with keyboard typing in general are traditionally arranged using various conventions. The most common of these in the United States, for instance, is the QWERTY keyboard layout. Others include the QWERTZ, AZERTY, and Dvorak keyboard configurations of the English-language alphabet.
The QWERTY keyboard layout is the standard English-language alphabetic key arrangement 44 (see
The QWERTZ keyboard layout is normally used in German-speaking regions. This alphabetic key arrangement 44 is shown in
The AZERTY keyboard layout is normally used in French-speaking regions. This alphabetic key arrangement 44 is shown in
The Dvorak keyboard layout was designed in the 1930s by August Dvorak and William Dealey. This alphabetic key arrangement 44 is shown in
Alphabetic key arrangements in full keyboards and typewriters are often presented along with numeric key arrangements. An exemplary numeric key arrangement is shown in
As shown in
It is desirable for handheld electronic devices 300 to include a combined text-entry keyboard and a telephony keyboard. Examples of such mobile communication devices include mobile stations, cellular telephones, wireless personal digital assistants (PDAs), two-way paging devices, and others. Various keyboards are used with such devices depending in part on the physical size of the handheld electronic device. Some of these are termed full keyboard, reduced keyboard, and phone key pads.
In embodiments of a handheld electronic device having a full keyboard, only one alphabetic character is associated with each one of a plurality of physical keys. Thus, with an English-language keyboard, there are at least 26 keys in the plurality, one for each letter of the English alphabet. In such embodiments using the English-language alphabet, one of the keyboard layouts described above is usually employed, and with the QWERTY keyboard layout being the most common.
One device that uses a full keyboard for alphabetic characters and incorporates a combined numeric keyboard is shown in
In order to further reduce the size of a handheld electronic device without making the physical keys or software keys too small, some handheld electronic devices use a reduced keyboard, where more than one character/command/function is associated with each of at least a portion of the plurality of keys. This results in certain keys being ambiguous since more than one character is represented by or associated with the key, even though only one of those characters is typically intended by the user when activating the key.
Thus, certain software usually runs on the processor of these types handheld electronic device to determine or predict what letter or word has been intended by the user. Predictive text technologies can also automatically correct common spelling errors. Predictive text methodologies often include a disambiguation engine and/or a predictive editor application. This helps facilitate easy spelling and composition, since the software is preferably intuitive software with a large word list and the ability to increase that list based on the frequency of word usage.
The software preferably also has the ability to recognize character letter sequences that are common to the particular language, such as, in the case of English, words ending in “ing.” Such systems can also “learn” the typing style of the user making note of frequently used words to increase the predictive aspect of the software. With predictive editor applications, the display of the device depicts possible character sequences corresponding to the keystrokes that were entered. Typically, the most commonly used word is displayed first. The user may select other, less common words manually, or otherwise. Other types of predictive text computer programs may be utilized with the keyboard arrangement and keyboard described herein, without limitation.
The multi-tap method of character selection has been in use a number of years for permitting users to enter text using a touch screen device or a conventional telephone key pad such as specified under ITU E 1.161, among other devices. Multi-tap requires a user to press a key a varying number of times, generally within a limited period of time, to input a specific letter, thereby spelling the desired words of the message. A related method is the long tap method, where a user depresses the key until the desired character appears on the display out of a rotating series of letters.
A “text on nine keys” type system uses predictive letter patterns to allow a user to ideally press each key representing a letter only once to enter text. Unlike multi-tap which requires a user to indicate a desired character by a precise number of presses of a key, or keystrokes, the “text-on-nine-keys” system uses a predictive text dictionary and established letter patterns for a language to intelligently guess which one of many characters represented by a key that the user intended to enter. The predictive text dictionary is primarily a list of words, acronyms, abbreviations and the like that can be used in the composition of text.
Generally, all possible character string permutations represented by a number of keystrokes entered by a user are compared to the words in the predictive text dictionary and a subset of the permutations is shown to the user to allow selection of the intended character string. The permutations are generally sorted by likelihood of occurrence which is determined from the number of words matched in the predictive text dictionary and various metrics maintained for these words. Where the possible character string permutations do not match any words in the predictive text dictionary, the set of established letter patterns for a selected language can be applied to suggest the most likely character string permutations, and then require the user to input a number of additional keystrokes in order to enter the desired word.
The keys of reduced keyboards are laid out with various arrangements of characters, commands and functions associated therewith. In regards to alphabetic characters, the different keyboard layouts identified above are selectively used based on a user's preference and familiarity; for example, the QWERTY keyboard layout is most often used by English speakers who have become accustomed to the key arrangement.
In this example, the color scheme of the numeric phone keys has a two tone appearance, with the upper portion of the numeric keys being a first color and the lower portion of the numeric keys being a second color. In the example, the upper portion of the keys is white with blue letters and the lower portion of the keys is blue with white letters. Most of the remaining keys associated with the QWERTY key arrangement are predominantly the second, blue color with white lettering. The first color may be lighter than the second color, or darker than the second color. In addition, the keyboard 14 includes a “send” key 6 and an “end” key 8. The “send” key 6 is positioned in the upper left corner of the keyboard 14 and the “end” key 8 is positioned in the upper right corner. The “send” key 6 and “end” key 8 may have different color schemes than the remainder of the keys in order to distinguish them from other keys. In addition, the “send” and “end” keys 6, 8 may have different colors from one another. In the example shown, the “send” key 6 is green and the “end” key 8 is red. Different colors may be utilized, if desired.
Another embodiment of a reduced alphabetic keyboard is found on a standard phone keypad. Most handheld electronic devices having a phone key pad also typically include alphabetic key arrangements overlaying or coinciding with the numeric keys as shown in
As described above, the International Telecommunications Union (“ITU”) has established phone standards for the arrangement of alphanumeric keys. The standard phone numeric key arrangement shown in
The table below identifies the alphabetic characters associated with each number for some other phone keypad conventions.
It should also be appreciated that other alphabetic character and number combinations can be used beyond those identified above when deemed useful to a particular application.
As noted earlier, multi-tap software has been in use for a number of years permitting users to enter text using a conventional telephone key pad such as specified under ITU E 1.161 or on a touch screen display, among other devices. Multi-tap requires a user to press a key a varying number of times, generally within a limited period of time, to input a specific letter associated with the particular key, thereby spelling the desired words of the message. A related method is the long tap method, where a user depresses the key until the desired character appears on the display.
An exemplary handheld electronic device is shown in the assembly drawing of
The navigation tool 328 is frictionally engaged with the support frame 101, but in a preferred embodiment the navigation tool 328 is removable when the device is assembled. This allows for replacement of the navigation tool 328 if/when it becomes damaged or the user desires replacement with a different type of navigation tool 328. In the exemplary embodiment of
A serial port (preferably a Universal Serial Bus port) 330 and an earphone jack 140 are fixably attached to the PCB 102 and further held in place by right side element 105. Buttons 130-133 are attached to switches (not shown), which are connected to the PCB 102.
Final assembly involves placing the top piece 107 and bottom piece 108 in contact with support frame 101. Furthermore, the assembly interconnects right side element 105 and left side element 106 with the support frame 101, PCB 102, and lens 103. These side elements 106, 105 provide additional protection and strength to the support structure of the device 300. In a preferred embodiment, backplate 104 is removably attached to the other elements of the device.
The block diagram of
The above described auxiliary I/O subsystem 328 can take a variety of different subsystems including the above described navigation tool 328. As previously mentioned, the navigation tool 328 is preferably a trackball based device, but it can be any one of the other above described tools. Other auxiliary I/O devices can include external display devices and externally connected keyboards (not shown). While the above examples have been provided in relation to the auxiliary I/O subsystem, other subsystems capable of providing input or receiving output from the handheld electronic device 300b are considered within the scope of this disclosure.
In a preferred embodiment, the communication device 300 is designed to wirelessly connect with a communication network 319. Some communication networks that the communication device 300 may be designed to operate on require a subscriber identity module (SIM) or removable user identity module (RUIM). Thus, a device 300 intended to operate on such a system will include SIM/RUIM interface 344 into which the SIM/RUIM card (not shown) may be placed. The SIM/RUIM interface 344 can be one in which the SIM/RUIM card is inserted and ejected.
In an exemplary embodiment, the flash memory 324 is enabled to provide a storage location for the operating system, device programs, and data. While the operating system in a preferred embodiment is stored in flash memory 324, the operating system in other embodiments is stored in read-only memory (ROM) or similar storage element (not shown). As those skilled in the art will appreciate, the operating system, device application or parts thereof may be loaded in RAM 326 or other volatile memory.
In a preferred embodiment, the flash memory 324 contains programs/applications 358 for execution on the device 300 including an address book 352, a personal information manager (PIM) 354, and the device state 350. Furthermore, programs 358 and data 356 can be segregated upon storage in the flash memory 324 of the device 300. However, another embodiment of the flash memory 324 utilizes a storage allocation method such that a program 358 is allocated additional space in order to store data associated with such program. Other known allocation methods exist in the art and those persons skilled in the art will appreciate additional ways to allocate the memory of the device 300.
In a preferred embodiment, the device 300 is pre-loaded with a limited set of programs that enable it to operate on the communication network 319. Another program that can be preloaded is a PIM 354 application that has the ability to organize and manage data items including but not limited to email, calendar events, voice messages, appointments and task items. In order to operate efficiently, memory 324 is allocated for use by the PIM 354 for the storage of associated data. In a preferred embodiment, the information that PIM 354 manages is seamlessly integrated, synchronized and updated through the communication network 319 with a user's corresponding information on a remote computer (not shown). The synchronization, in another embodiment, can also be performed through the serial port 330 or other short range communication subsystem 340. Other applications may be installed through connection with the wireless network 319, serial port 330 or via other short range communication subsystems 340.
When the device 300 is enabled for two-way communication within the wireless communication network 319, it can send and receive signals from a mobile communication service. Examples of communication systems enabled for two-way communication include, but are not limited to, the GPRS (General Packet Radio Service) network, the UMTS (Universal Mobile Telecommunication Service) network, the EDGE (Enhanced Data for Global Evolution) network, and the CDMA (Code Division Multiple Access) network and those networks generally described as packet-switched, narrowband, data-only technologies mainly used for short burst wireless data transfer.
For the systems listed above, the communication device 300 must be properly enabled to transmit and receive signals from the communication network 319. Other systems may not require such identifying information. A GPRS, UMTS, and EDGE require the use of a SIM (Subscriber Identity Module) in order to allow communication with the communication network 319. Likewise, most CDMA systems require the use of a RUIM (Removable Identity Module) in order to communicate with the CDMA network. The RUIM and SIM card can be used in multiple different communication devices 300. The communication device 300 may be able to operate some features without a SIM/RUIM card, but it will not be able to communicate with the network 319. In some locations, the communication device 300 will be enabled to work with special services, such as “911” emergency, without a SIM/RUIM or with a non-functioning SIM/RUIM card. A SIM/RUIM interface 344 located within the device allows for removal or insertion of a SIM/RUIM card (not shown). This interface 344 can be configured like that of a disk drive or a PCMCIA slot or other known attachment mechanism in the art. The SIM/RUIM card features memory and holds key configurations 351, and other information 353 such as identification and subscriber related information. Furthermore, a SIM/RUIM card can be enabled to store information about the user including identification, carrier and address book information. With a properly enabled communication device 300, two-way communication between the communication device 300 and communication network 319 is possible.
If the communication device 300 is enabled as described above or the communication network 319 does not require such enablement, the two-way communication enabled device 300 is able to both transmit and receive information from the communication network 319. The transfer of communication can be from the device 300 or to the device 300. In order to communicate with the communication network 319, the device 300 in a preferred embodiment is equipped with an integral or internal antenna 318 for transmitting signals to the communication network 319. Likewise the communication device 300 in the preferred embodiment is equipped with another antenna 316 for receiving communication from the communication network 319. These antennae (316, 318) in another preferred embodiment are combined into a single antenna (not shown). As one skilled in the art would appreciate, the antenna or antennae (316, 318) in another embodiment are externally mounted on the device 300.
When equipped for two-way communication, the communication device 300 features a communication subsystem 311. As is well known in the art, this communication subsystem 311 is modified so that it can support the operational needs of the device 300. The subsystem 311 includes a transmitter 314 and receiver 312 including the associated antenna or antennae (316, 318) as described above, local oscillators (LOs) 313, and a processing module 320 which in a preferred embodiment is a digital signal processor (DSP) 320.
A signal received by the communication device 300 is first received by the antenna 316 and then input into a receiver 312, which in a preferred embodiment is capable of performing common receiver functions including signal amplification, frequency down conversion, filtering, channel selection and the like, and analog to digital (A/D) conversion. The A/D conversion allows the DSP 320 to perform more complex communication functions such as demodulation and decoding on the signals that are received by DSP 320 from the receiver 312. The DSP 320 is also capable of issuing control commands to the receiver 312. An example of a control command that the DSP 320 is capable of sending to the receiver 312 is gain control, which is implemented in automatic gain control algorithms implemented in the DSP 320. Likewise, the communication device 300 is capable of transmitting signals to the communication network 319. The DSP 320 communicates the signals to be sent to the transmitter 314 and further communicates control functions, such as the above described gain control. The signal is emitted by the device 300 through an antenna 318 connected to the transmitter 314.
It is contemplated that communication by the device 300 with the wireless network 319 can be any type of communication that both the wireless network 319 and device 300 are enabled to transmit, receive and process. In general, these can be classified as voice and data. Voice communication is communication in which signals for audible sounds are transmitted by the device 300 through the communication network 319. Data is all other types of communication that the device 300 is capable of performing within the constraints of the wireless network 319.
In the instance of voice communications, voice transmissions that originate from the communication device 300 enter the device 300 though a microphone 336. The microphone 336 communicates the signals to the microprocessor 338 for further conditioning and processing. The microprocessor 338 sends the signals to the DSP 320 which controls the transmitter 314 and provides the correct signals to the transmitter 314. Then, the transmitter 314 sends the signals to the antenna 318, which emits the signals to be detected by a communication network 319. Likewise, when the receiver 312 obtains a signal from the receiving antenna 316 that is a voice signal, it is transmitted to the DSP 320 which further sends the signal to the microprocessor 338. Then, the microprocessor 338 provides a signal to the speaker 334 of the device 300 and the user can hear the voice communication that has been received. The device 300 in a preferred embodiment is enabled to allow for full duplex voice transmission.
In another embodiment, the voice transmission may be received by the communication device 300 and translated as text to be shown on the display screen 322 of the communication device 300. The communication device 300 is also capable of retrieving messages from a voice messaging service operated by the communication network operator. In a preferred embodiment, the device 300 displays information in relation to the voice message, such as the number of voice messages or an indication that a new voice message is present on the operating system.
In a preferred embodiment, the display 322 of the communication device 300 provides an indication about the identity of an incoming call, duration of the voice communication, telephone number of the communication device, call history, and other related information. It should be appreciated that the above described embodiments are given as examples only and one skilled in the art may effect alterations, modifications and variations to the particular embodiments without departing from the scope of the application.
As stated above, the communication device 300 and communication network 319 can be enabled to transmit, receive and process data. Several different types of data exist and some of these types of data will be described in further detail. One type of data communication that occurs over the communication network 319 includes electronic mail (email) messages. Typically an email is text based, but can also include other types of data such as picture files, attachments and html. While these are given as examples, other types of messages are considered within the scope of this disclosure as well.
When the email originates from a source outside of the device and is communicated to the device 300, it is first received by the receiving antenna 316 and then transmitted to the receiver 312. From the receiver 312, the email message is further processed by the DSP 320, and it then reaches the microprocessor 338. The microprocessor 338 executes instructions as indicated from the relevant programming instructions to display, store or process the email message as directed by the program. In a similar manner, once an email message has been properly processed by the microprocessor 338 for transmission to the communication network 319, it is first sent to the DSP 320, which further transmits the email message to the transmitter 314. The transmitter 314 processes the email message and transmits it to the transmission antenna 318, which broadcasts a signal to be received by a communication network 319. While the above has been described generally, those skilled in this art will appreciate those modifications which are necessary to enable the communication device 300 to properly transmit the email message over a given communication network 319.
Furthermore, the email message may instead be transmitted from the device 300 via a serial port 330, another communication port 340, or other wireless communication ports 340. The user of the device 300 can generate a message to be sent using the keyboard 332 and/or auxiliary I/O 328, and the associated application to generate the email message. Once the email message is generated, the user may execute a send command which directs the email message from the communication device 300 to the communication network 319. In an exemplary embodiment, a keyboard 332, preferably an alphanumeric keyboard, is used to compose the email message. In a preferred embodiment, an auxiliary I/O device 328 is used in addition to the keyboard 332.
While the above has been described in relation to email messages, one skilled in the art could easily modify the procedure to function with other types of data such as SMS text messages, internet websites, videos, instant messages, programs and ringtones. Once the data is received by the microprocessor 338, the data is placed appropriately within the operating system of the device 300. This might involve presenting a message on the display 322 which indicates the data has been received or storing it in the appropriate memory 324 on the device 300. For example, a downloaded application such as a game will be placed into a suitable place in the flash memory 324 of the device 300. The operating system of the device 300 will also allow for appropriate access to the new application as downloaded.
Exemplary embodiments have been described hereinabove regarding both wireless handheld electronic devices, as well as the communication networks within which they cooperate. It should be appreciated, however, that a focus of the present disclosure is the facilitation of an operator to use a trackball-based auxiliary input device on the wireless handheld electronic device as both a navigation tool, as well as a selection tool. The present disclosure further contemplates the combination of this facilitation with the described methods and arrangements for enabling diagonal cursor guidance using the trackball, as well as those methods and arrangements for conserving power on such trackball-incorporating handheld devices.
The present application claims the benefit of U.S. Provisional Application Nos. 60/773,145 filed 13 Feb. 2006 and 60/773,799 filed 14 Feb. 2006. The present application is also a continuation-in-part of U.S. application Ser. Nos. 11/423,740 and 11/423,779, each filed 13 Jun. 2006. Said applications are expressly incorporated herein by reference in their entireties.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4493992 | Geller | Jan 1985 | A |
| 5508717 | Miller | Apr 1996 | A |
| 6628315 | Smith Dawkins et al. | Sep 2003 | B1 |
| 7450113 | Gillespie et al. | Nov 2008 | B2 |
| 20030076294 | Shibazaki | Apr 2003 | A1 |
| 20040051695 | Yamamoto et al. | Mar 2004 | A1 |
| 20040064597 | Trewin | Apr 2004 | A1 |
| 20040119685 | Harries et al. | Jun 2004 | A1 |
| 20050184962 | Lee | Aug 2005 | A1 |
| Number | Date | Country |
|---|---|---|
| 1523164 | Apr 2005 | EP |
| 9725666 | Jul 1997 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20070188471 A1 | Aug 2007 | US |
| Number | Date | Country | |
|---|---|---|---|
| 60773145 | Feb 2006 | US | |
| 60773799 | Feb 2006 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11423779 | Jun 2006 | US |
| Child | 11469607 | US | |
| Parent | 11423740 | Jun 2006 | US |
| Child | 11423779 | US |
