Patent Application
20100302139
The present invention relates to methods for using vibration detector to add imaginary keys and to detect imaginary key presses on the casing, and/or the screen, of a handheld mobile communication apparatus.
Modern mobile communication apparatuses are capable of performing a multitude of complex tasks ranging from applications making voice calls, accessing web pages, send/receive e-mails, display live television, taking high resolution pictures, playing games and music, etc. To be able fully take advantage of the mobile communication apparatus capabilities, the apparatus must have an intuitive and user-friendly user-interface.
Entering text into the applications running in the mobile communication apparatuses, together with navigating and operating the same, are considered by many users to be the main bottlenecks in terms of usability. The main obstacle is that these apparatuses often only are equipped with a limited number of hardkeys such as a standard “phone keypad”, comprising ten keys (0-9) some functional keys, and a navigation device (joystick or four-way navigation button), for entering text and to navigate and operate the applications. This limitation leads to the need for long complex key press combinations to maneuver the application, which are both difficult to remember and easy to enter wrong. Thus, leading to a slow input speed and great frustration with the user.
If the mobile communication apparatus is equipped with a large touch-sensitive display, adding softkeys in the display can be one way of reducing the problem with the need for more hardkeys. However, display space is limited and therefore precious, and softkeys must often be operated using pen-type objects, which for many users is not optimal.
One way of reducing the problem would of course be to add more hardkeys to the apparatus, but factors such as cover and frame mechanics, design, and cost makes it nearly impossible to do that.
In view of the above, an objective of the invention is to solve or at least reduce the problems discussed above. In particular, an objective is to provide a user-friendly way of adding user-configurable imaginary buttons, or keys, to the mobile communication apparatus to facilitate the navigation and operation of applications therein.
According to a first aspect of the present invention, there is provided a method for a portable apparatus, comprising enabling of said portable apparatus to receive a user input, wherein said user input comprise of one or more taps by a user on said portable apparatus, detection of said one or more taps on said portable apparatus using a vibration detector, determination of at least one location of said one or more taps on said portable apparatus, enabling of rendering of an application in said portable apparatus, and rendering of an application depending on said at least one location of said one or more taps on said portable apparatus.
In this way a tap on a predetermined position on the casing can be used as a virtual key press. In this way imaginary keys can be configured and located at any location on the casing of the apparatus without implementing any additional mechanics or electronics. The user can operate the imaginary keys either by tapping on the side of the casing or on the front of the casing.
The method may comprise detection of one or more taps tapped in sequence within a predetermined time frame. Thus different tapped sequences may be associated with different commands, which increase the number of commands that can be associated with tapping
The method may comprise an application rendered by said one or more taps in any combination with one or more movements of the portable apparatus.
The method may comprise an application rendered by said one or more taps in any combination with one or more key hold and/or key press. Thus tapping may be combined with usual key hold and/or key press actions.
The method may comprise that a detection of a tap is acknowledged to the user by any combination of a vibration indication, a visual indication, or an audio indication. Any of these indications offer useful feedback to the user since the user obtains the indication above as confirmation.
The method may comprise that one or more taps are located on the casing of the portable apparatus. Thus a user can for instance place imaginary keys on the casing.
The method may comprise that one or more taps on the portable apparatus are detected using at least two vibration detectors.
According to a second aspect of the present invention, there is provided a rendering application for a portable apparatus comprising a casing, a display, and navigation means, said application arranged to cause enabling of said portable apparatus to receive a user input, wherein said user input comprise of one or more taps by a user on said portable apparatus, the detection of said one or more taps on said portable apparatus using a vibration detector, the determination of at least one location of said one or more taps on said portable apparatus, the enabling of rendering of an application in said portable apparatus, and the rendering of an application depending on said at least one location of said one or more taps on said portable apparatus.
According to a third aspect of the present invention, there is provided a casing, a display, a vibration detector, and input means arranged to receive a user input, wherein said user input comprise of one or more taps by a user on said portable apparatus, and further arranged to detect said one or more taps on said portable apparatus using a vibration detector, and determining at least one location of said one or more taps on said portable apparatus. It is further arranged to enabling rendering of an application in said portable apparatus, and rendering of an application depending on said at least one location of said one or more taps on said portable apparatus. The vibration detector may be comprised on a main printed circuit board of the apparatus. The vibration detector may sense vibration along at least two axes. More particularly it may sense vibration along three axes. The apparatus may further comprise at least a second vibration detector. Thus the method for may be implemented in a portable apparatus as disclosed above and the apparatus may be realized by a casing, a display, a vibration detector and input means.
According to a fourth aspect of the present invention, there is provided a computer-readable medium having computer-executable components comprising instructions for enabling said portable apparatus to receive a user input, wherein said user input comprise of at one or more taps by a user on said portable apparatus, detecting said one or more taps on said portable apparatus using a vibration detector, determining at least one location of said one or more taps on said portable apparatus, enabling rendering of an application in said portable apparatus, and the rendering of an application depending on said at least one location of said one or more taps on said portable apparatus.
According to a fifth aspect of the present invention, there is provided a user interface comprising a casing, a display, and an input receiver, wherein said user interface is arranged to, enable said portable apparatus to receive a user input, wherein said user input comprise of at one or more taps by a user on said portable apparatus, detecting said one or more taps on said portable apparatus using a vibration detector, determining at least one location of said one or more taps on said portable apparatus, enabling rendering of an application in said portable apparatus, and rendering of an application depending on said at least one location of said one or more taps on said portable apparatus.
The second, third, fourth, and fifth aspects of the present invention may be combined in any way with the features of the first aspect of the present invention.
Generally, all terms used in the claims are to be interpreted according to their ordinary meaning in the technical field, unless explicitly defined otherwise herein. All references to “a/an/the [element, device, component, means, step, etc]” are to be interpreted openly as referring to at least one instance of said element, device, component, means, step, etc., unless explicitly stated otherwise. The steps of any method disclosed herein do not have to be performed in the exact order disclosed, unless explicitly stated,
Other objectives, features and advantages of the present invention will appear from the following detailed disclosure, from the attached dependent claims as well as from the drawings.
The above, as well as additional objects, features and advantages of the present invention, will be better understood through the following illustrative and non-limiting detailed description of preferred embodiments of the present invention, with reference to the appended drawings, where the same reference numerals will be used for similar elements, wherein:
a shows a display view of a handheld communication apparatus according to an embodiment of the present invention; and
b shows another display view of a handheld communication apparatus according to an embodiment of the present invention; and
c shows another display view of a handheld communication apparatus according to an embodiment of the present invention; and
d shows another display view of a handheld communication apparatus according to an embodiment of the present invention; and
The mobile communication apparatus can also comprise other elements normally present in such an apparatus, such as a keypad 106, a speaker 108, a microphone 110, an accelerometer (not shown), a vibration device (not shown), a processor (not shown), a memory (not shown), etc.
There are several problems associated with this type of mobile communication apparatus. For instance the keypad 106, with a limited number of hardkeys, and the navigation means 104 are the only means at disposal for a user to enter, maneuver, and navigate information displayed on the display 102. This makes text entering and navigation especially cumbersome. Another problem is which hardkeys to use in the maneuvering and navigation process. Since most of the hardkeys are not placed in the vicinity of the display 102, it can be quite confusing for a user to which hardkeys to use. The traditional solution to the problem of not having enough hardkeys, is to use different sequences or combinations of key presses to simulate an additional hardkey. However, this approach often leads to slow input speed and it also dramatically increases the possibility to enter the wrong combination of key presses.
a shows a front view of another type of a mobile communication apparatus 200, which is often referred to as a Personal Digital Assistant (PDA) type of mobile communication apparatus.
In this example the front view of the PDA comprise a front casing 202 with a large display screen 204 which can be touch-sensitive. In this example the display screen 204 displays a general softkey bar 208 and a general status indication area 206. The general status indication area 206 can for example include symbols for battery status, reception quality, speaker on/off, present mode, time and date, etc. The status indication section is not in any way limited to only include these symbols. Thus, other symbols in any shape, form or color can occur. The softkey bar 208, in this example situated at the bottom of the display view, is operable by using the navigation means 216 or, if using a touch sensitive screen, by tapping the softkey with a pen-like object, such as a stylus, a finger, or another body part. The functions of these softkeys are not limited by the functions indicated in the figure. Neither are the placements of the general softkey bar 208 and a general status indication area 206 limited to the bottom and the top of the screen as shown in the example.
The navigation means 216 can for instance be used to navigate items displayed on the screen 204, or to perform basic functions, such as activating the phone when receiving a call.
The mobile communication apparatus 200 may also comprise other elements normally present in such an apparatus, such as a front casing 202, a speaker 210, a microphone 212, a camera 214, one or more sensors and detectors (not shown), arranged to detect all or some of the quantities vibration, motion, heat, or pressure, a vibration device (not shown), a processor (not shown), a memory (not shown), etc.
b shows a side view of the mobile communication apparatus 200 presented in
The navigation and maneuvering of the applications in the PDA type mobile communication apparatus, shown in
Several embodiments of the present invention will now be exemplified using the drawings of the PDA type mobile communication apparatus as previously exemplified in
a and 3b shows an embodiment of the present invention. To avoid the problem of having to use long and complex key press combinations to simulate an additional hardkey, or to avoid the problem of crowding the display with many softkeys, one or more sensors and detectors, detecting vibrations (such as by an accelerometer), motion, pressure, or heat, can be used.
All embodiments of the present invention will hereinafter be described using vibration detection as the main type of sensor and detector technique. However, it should be understood that the present invention could also be implemented using sensors and detectors capable of detecting all or some of the quantities; vibrations, motion, pressure, or heat.
The main sensor could for example be a triple-axes MEMS (Micro-Electro-Mechanical Systems) accelerometer. Furthermore, the sensor may be active in a situation when a possible command is likely to occur. Likewise the sensor may be deactivated in a situation when a possible command is not likely to occur. Hence such an activating and deactivating strategy will be beneficiary for the power consumption, which is of importance since mobile communication apparatus usually have limited power resources.
The detected vibrations may pertain to a resonant frequency signal associated with each axis. As an example each such signal may be recorded every 300 ms. Characteristics of these signals may then be matched to characteristics of pre-recorded signals in order to match a vibration to a location of origin.
The detectors, in this case vibration detectors, are able to detect vibrations in/on the apparatus of at least two axes, preferably three axes, and to pinpoint, in all three dimensions, the origin or position of the vibration. They are also capable of detecting the force of the percussion, which allows the apparatus to differentiate between a hard and a soft tap. In this way a tap on a predetermined position on the casing can be used as a virtual key press. In this way imaginary keys can be configured and located ail over the casing of the apparatus without implementing any additional mechanics or electronics.
The vibration detector may be comprised on the main PCB (printed circuit board) of the apparatus. Having the vibration detector comprised in the main phone PCB has the added advantages of providing a compact, cheap, and solid solution, which in addition allows for easy assembly.
There may be several detectors cooperating to determine the location of origin of a vibration. For example, a first vibrator may detect a fundamental vibration whilst a second vibrator may detect a harmonic vibration, or an echo vibration.
a shows a mobile communication apparatus with markings at three locations 302, 304 and 306 on its casing. When a user taps one of these markings with his finger or a pen-like object, an accelerometer, receding inside the apparatus, will detect the position and force of the tap, and interpret it as a key press, and consequently maneuver the application in the same manner as if the user had pushed a real mechanical hardkey.
As shown in
The marking can either be put on the casing during manufacturing or be added by the user. Another possibility is to sell interchangeable covers together with a specific application, e.g. a software application. In this way a customized casing with pre-marked imaginary keys is provided for a particular application.
Not only the casing at the side of the display can be marked and configured to function as a virtual key. For example
b shows a side view of the apparatus in
c shows another embodiment of the present invention. In this example the casing is utilized as an extension of the display (being non- or touch-sensitive display). The application running in the mobile communication apparatus displays a selectable alternative, ‘Alternative 1’ on the display 315. The selectable softkey area belonging to the alternative 316 is clearly marked on the screen. The displayed marking 316 is stretched out onto the casing and blends together with the casing marking 317. The marking on the casing 317 have preferably the same color and shape as the marking 316 in the display. This will indicate to the user that the selectable area is in fact both the touch-sensitive area on the display and the marked area on the casing. Thus, the operable area can be viewed as enlarged, extending beyond the touch-sensitive screen onto the casing. This is very convenient if the alternatives crowd the display area, or if the descriptive alternative texts are very long and need lots of display-space.
The markings for tappable positions do not need to be in the form of geometric shapes of various colors or forms. Also printed text and company logos put on the casing can be utilized. When for instance the company name Nokia 310, shown in
The casing does not need to be marked to contain imaginary keys. A user can for instance place imaginary keys on the casing. These un-marked keys can be used as secret imaginary keys, which can be used when entering a password to an application. The coordinates of the secret keys on the casing can in this case be translated into a sequence of letters and numbers making up a password.
It should be noted that the embodiments of the invention presented in
The vibration detector may also be able to detect both heat and/or pressure from the user's fingers when tapping the casing. This can be utilized to further filter out unwanted tap “noise”.
The vibration detector may also be able to detect motions of the handheld communication apparatus. A moving motion of the apparatus can for instance be utilized together with taps to maneuver an application. A side-to-side motion can for example trigger browsing of documents in an archive, while a tap selects the displayed document for reading/editing. A tap/motion detection program running in the mobile communication apparatus can be configured to filter out a tap/motion from other vibrations and motion noise.
Since pushing an imaginary key does not provide the same bio-feedback as pushing a mechanical key other indications to the user that the imaginary key has been pushed successful may be provided. The indication of a successful key press may be in the form of a vibration of the apparatus, an audio signal, or a visual indication such as flashing the display or blinking with an light emitting diode.
The invention can be computer-implemented, i.e. the media handling is performed on a general or dedicated computerized apparatus 601, such as a personal computer, a mobile phone, a digital camera, a personal digital assistant, a media player, or other similar apparatus. Instructions for performing the invention can then be executed by the apparatus. These instructions can be loaded into the apparatus 601 from a computer-readable medium 602, as exemplary illustrated in
The invention presented above is beneficial in many ways. Persons with large fingers, or with gloves, or have deficient motor skills will greatly benefit from the greater and sensitive adjustable tapping area. An application developer and/or a user can define application specific virtual keys in any shape, size, or form.
The present invention can also replace the touch-sensitive screen, which are more expensive to use, consumes more power, and has a shorter lifespan than an ordinary display. The invention can also replace ordinary mechanical buttons, which are both costly to implement, takes up space both inside and outside of the apparatus, and wears quickly out, especially in harsh conditions. The invention can therefore be especially effective in the making of apparatuses for usage in tough conditions such as in heavy industry and military applications and even in outdoor applied consumer products.
While the embodiments of the present invention have been described with specificity to handheld communication devices, other types of computing devices with which the embodiments can be used will occur to those skilled in the art. For example, a personal computer can benefit from the invention in the same manner as the handheld communication device. Further, while the illustrated embodiments discusses the use of user-configurability, the user-configurability may be implicit or provided in some other manner than described above. The above-described embodiments of the invention are intended to be examples of the invention and alterations and modification may be affected thereto, by those skilled in the art, without departing from the scope of the invention, which is defined solely by the claims appended hereto.
| Number | Date | Country | Kind |
|---|---|---|---|
| 61012246 | Dec 2007 | US | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/EP08/52125 | 2/21/2008 | WO | 00 | 8/9/2010 |
