1. Field of the Invention
The present invention relates to electronic devices. In particular, the present invention relates to a novel and improved method, a dynamic user interface and an electronic device for generating user detectable multi-functional feedback.
2. Description of the Related Art
In information technology, the user interface (UI) is everything designed into an information device with which a human being may interact, including display screen, keyboard, mouse, light pen, the appearance of a desktop, illuminated characters, help messages, and how an application program or a Web site invites interaction and responds to it. In early computers there was very little user interface except for a few buttons at an operator's console. The user interface was largely in the form of punched card input and report output.
Personal Digital Assistants (PDA) typically comprise a large display area in proportion to the size of the device. Most PDAs include only a few mechanical buttons in order to provide as large display area as possible. Therefore, the display area is also used as an input device. The display area is usually touch-sensitive so that information can be transferred into the device just by touching the display or using a special tool, e.g. a special pen.
U.S. Pat. No. 5,241,308 (Paragon Systems) describes a touch sensitive panel for generating selected ones of any of a plurality of different signals, each of which is generated by touching a different location on the panel. The apparatus includes also force sensing means for sensing the magnitudes of the forces that are applied to each panel member support by the panel member when the member is touched at a selected location.
Touch-sensitive displays have many advantages over conventional information input methods. The display size can be made bigger when only few mechanical buttons are present. Above all, all the needed buttons can be generated by program basis in an applicable place. There are, however, several problems when a touch-sensitive display is used as a primary information input device. When a user uses his/her finger to touch the display, the user does not necessarily receive any haptic feedback as to whether his/her selection is acceptable or whether the selection has been made at all. A traditional keyboard, on the other hand, always provides some kind of mechanical response to a press of a button.
The main problem is that there is no solution for electronic devices for generating feedback for various stimulus signals with a single integrated component, and which provides a cost-effective solution coupled with minimal power consumption.
U.S. Pat. No. 5,245,245 (Motorola) describes an electronic device comprising a piezo-bender. The device is preferably a pager. When a signal is received, an electrical drive circuit electrically coupled to the piezo-bender drives the piezo-bender with a drive signal to generate vibratory motion in the piezo-bender, and a vibratory alert is thus provided. The device additionally comprises tuning means slidably coupled to the piezo-bender for mechanically tuning the resonance frequency of vibration of the piezo-bender by varying the length of the piezo-bender that can vibrate. It must be noted that the piezo-bender is mechanically tuned so that tuning must be made by a competent technician. It is also difficult to manufacture devices with exactly the same (resonance) characteristics because of the mechanical tuning feature. The solution in U.S. Pat. No. 5,245,245 is also bound to a certain fixed resonance frequency. U.S. Pat. No. 5,245,245 represents a low-profile and reliable vibrator for a selective call receiver. However, the reference publication does not present any connection between user actions and vibratory alert. The solution is not applicable for generating feedback for various stimulus signals with a single integrated component.
Reference publication WO01/54109 (Immersion) represents a solution of haptic feedback for touchpads and other touch controls. In that publication, a user employs a touch-input device for entering control instructions. Moreover, at least one actuator is coupled to the touch input device and outputs a force to provide a haptic sensation to the user contacting the touch surface. In other words, the user receives feedback from the input device itself. The actuator is situated under the touch-sensitive display. However, the solution presented in this reference publication is not applicable for generating feedback for various stimulus signals with a single integrated component.
The expression “touch-sensitive display” refers preferably to such displays that are being used in current PDAs. These displays, however, have weaknesses. The display is vulnerable to external impacts. The display may also be temperature sensitive, i.e. the use of a device with a touch-sensitive display may be restricted to a certain temperature range.
The present invention describes a method and an electronic device for generating user detectable multi-functional feedback with a single component in response to a stimulus signal. In the preferred embodiment, the electronic device is a hand-held device comprising at least a housing, electronic circuitry located in the housing, and a display, with the housing comprising at least a partially transparent lens, and the transparent lens area covering at least the display.
An electronic device in accordance with the present invention comprises one or more resonating vibrating elements attached to the housing or on the electronic circuitry. In a preferred embodiment, one or more resonating vibrating elements are attached to an area of the lens not covering the display. The lens is not necessarily a touch-sensitive display as represented in the background of the invention section. Instead, the lens may be more like a panel where the lens itself is not touch-sensitive. When the resonating element(s) are attached to the lens, the feedback is transmitted to the user of the electronic hand-held device effectively through the lens. With the resonating vibrating elements, the feedback is produced to the user in response to the stimulus signal. The resonating vibrating element is preferably a piezo-electric bender.
The touch-sensitive feature is achieved with special detecting means. In a preferred embodiment, the detecting means refer to one or more force sensors attached to the lens. In one embodiment, the electronic device comprises at least force sensors with which the location of a touch on the display can be determined.
In the present invention, an electrical drive circuit is electrically coupled to the resonating vibrating element(s) for electrically driving the resonating vibrating element(s) with a drive signal. The drive signal is constituted based on the stimulus signal. The stimulus signal is preferably a user-actuated signal, a radio signal received via a radio receiver of the electronic device or an electronic device induced signal. It is also contemplated that one or more different stimulus signals may be detected at the same time. When the drive signal is supplied to the resonating vibrating elements, preferably one or more of the following feedback signals are generated: a haptic feedback signal, a vibratory alert signal, an audio signal, and/or a buzzer signal.
The present invention also provides a dynamic user interface for generating user detectable multi-functional feedback with a single component in response to a stimulus signal in a device, the user interface comprising at least a housing and electronic circuitry located in the housing. The dynamic user interface further comprises means for detecting the stimulus signal, one or more resonating vibrating elements attached to the housing or on the electronic circuitry, and an electrical drive circuit electrically coupled to the resonating vibrating element(s) for electrically driving the resonating vibrating element(s) with a drive signal, the drive signal being constituted based on the stimulus signal.
The present invention has several advantages over the prior-art solutions. In the present invention, the resonating vibrating element(s) may be used to provide several different functions, whereas in the prior-art solutions each function requires a dedicated component in the implementation. This is a clear advantage.
The present invention represents a solution in which power consumption is low. This is a very important feature in electronic hand-held devices. In prior-art solutions, each feedback signal (e.g. a haptic feedback signal, a vibratory alert signal, an audio signal or a buzzer signal) must be generated with a dedicated component. In the present invention, on the other hand, all such feedback signals are generated with a single component and, therefore, there is only one power-consuming component. This enables power consumption to be more readily minimized.
The present invention also provides a solution in which it is not necessary to use conventional touch-sensitive displays. Electronic hand-held devices can be made much more durable because it is not necessary to use any elastic membranes or touch-sensitive displays. Instead, a rigid transparent lens covers the actual display device.
The solution represented by the present invention is simple. Furthermore, it is not prone to manufacturing differences because the feedback can be easily adjusted.
The present invention provides still further advantages. Because the solution uses only a single component to generate feedback, there is a significant space saving in the Printed Circuit Board (PCB). The number of components needed on the PCB is thus reduced. The present invention additionally provides a low-cost solution because of the savings in the components.
Other objects and features of the present invention will become apparent from the following detailed description considered in conjunction with the accompanying drawings. It is to be understood, however, that the drawings are designed solely for purposes of illustration and not as a definition of the limits of the invention, for which reference should be made to the appended claims. It should be further understood that the drawings are not necessarily drawn to scale and that, unless otherwise indicated, they are merely intended to conceptually illustrate the structures and procedures described herein.
The accompanying drawings, which are included to provide a further understanding of the invention and constitute a part of this specification, illustrate embodiments of the invention and together with the description help to explain the principles of the invention. In the drawings:
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings.
The lens TP is also used as a primary input device. User actions are detected with means IM for detecting stimulus signals. Means IM for detecting in one embodiment refers preferably to force sensors PS attached directly or indirectly to the lens TP. With three force sensors any location (i.e. a touch) on the lens TP area can be recognised and a relevant procedure started. Means IM for detecting stimulus signals together with the lens TP and the display DSP may refer to a conventional touch-sensitive display. In general, means IM for detecting stimulus signals may refer to several different physical or software components with which the stimulus signal(s) can be detected.
The CPU comprises means DM for determining the source of the stimulus signal, means TM for determining the resonance frequency by producing a bursted frequency sweep, means LM for detecting the vibration level with the force sensors PS, and means OM for feeding the obtained frequency to the resonating vibrating element(s) VIB. These various are preferably implemented in or with the CPU and/or relevant software application(s) or code.
The drive circuit DC in one embodiment comprises several components. It can comprise, e.g. an analog to digital converter (A/D), a digital signal processor, a digital to analog converter (D/A) and an amplifier. When, e.g. a radio signal is received with the radio receiver RF, the radio signal is input to a digital signal processor. The digital signal processor processes the radio signal and inputs the signal to the D/A-converter. The analog signal is then amplified by the amplifier and, finally, the amplified signal is input to the piezo-bender. Because the piezo-bender is attached to the lens TP, the whole system acts like an audio speaker and is able to produce an audio signal.
In one embodiment in accordance with
In one embodiment, the piezo-bender is also used in measuring acceleration. Preferably there is an external mass attached to the piezo-bender. When a hand-held device comprising a mass attached piezo-bender is moved along the z-axis, the z-axis being essentially perpendicular to the x/y-plane of the display of the hand-held device, the piezo-bender measures force changes (i.e. acceleration) resulting from the inertia. Several functions can be linked to this measurement. For example, the zooming factor of the material on the display of the hand-held device can depend on the measured acceleration information; this zooming example is described in more detail in patent application WO0127735 (Myorigo).
If the electronic hand-held device is a mobile phone and/or a radio, the device will also comprise a radio receiver RF part for sending and receiving radio frequency signals.
In a preferred embodiment, the lens/touch panel TP itself is not touch-sensitive. Force sensors PS are directly or indirectly attached to the lens TP. In the device depicted in
By using three or more force sensors PS, it is possible to accurately calculate and determine any location at which the lens TP is touched. With the above-mentioned arrangement, the lens TP itself does not have to contain any touch-sensitive membrane or any other touch-sensitive features. Instead, a touch is detected with the force sensors PS. The force sensors can also sense a user input outside of the transparent lens area. Therefore, certain areas of the housing HS or non-transparent areas of the lens TP can also be used as a part of the user interface.
The device shown in
In one embodiment in accordance with
When the piezo-bender is used in response to, e.g. a touch on the lens, a pulsed or continuous haptic feedback signal is generated. The haptic feedback signal is typically a short signal, e.g. a frequency of 200-300 Hz and a duration of 5-100, or a continuous signal. This signal is typically a plain or modulated resonance frequency of the piezo-bender. However, the feedback signal does not have to be restricted only to haptic feedback. With a piezo-bender, practically any required or desired frequency bandwidth can be produced. The feedback signal can additionally be a buzzer signal, a vibratory alert signal or an audio signal. This means that a piezo-bender attached to the lens of the electronic hand-held device can act as a speaker. Production of an audio signal may require that the audio bandwidth is flattened by digital signal processing in order to reduce the effect of the cantilever resonance frequencies. Certain criteria must be satisfied when generating audio signals. Especially in implementing the buzzer feature, the sound pressure level (in Pascals) has to be adequate, and the frequency band must be sufficiently broad. In addition, the harmonic multifold frequencies of the resonance frequency can be utilized when generating the feedback signal.
A conventional electronic device comprises different components for generating a haptic feedback signal, a buzzer signal, a vibratory alert signal or an audio signal. In such prior art devices a buzzer signal is generated with a buzzer, an audio signal is generated, e.g. with a speaker, a vibratory alert signal is generated, e.g. with an electromagnetic motor, and a haptic feedback signal is generated, e.g. with a DC motor, a solenoid, a moving magnet actuator, etc. All such feedback signals can in accordance with the present invention be generated with a piezo-element. This means a significant decrement in power consumption as compared to a situation in which the various feedback signals are generated with separate components.
The resonating vibrating element is preferably a piezo-bender of unimorph, bimorph or multilayer structure. It is crucial to define the type of the stimulus signal because the feedback signal generated by the piezo-bender solely depends on the stimulus signal. The feedback signal is a haptic feedback signal, a vibratory alert signal, an audio signal or a buzzer signal. It is also important to carefully define the attachment point of the piezo-bender to the housing or to the electronic circuitry. The piezo-bender component itself does not produce all of the needed feedback signals but, attached to the housing or to the electronic circuitry, it is able to produce multi-functional feedback.
There are numerous devices in which the dynamic user interface herein described can be used. Such devices include, by way of illustrative example, joysticks, keyboards, e-books, or practically any device in which multi-functional feedback can be employed.
The resonance frequency can utilized in yet another way. In the manufacturing phase, the lens or the overall housing may be manufactured such that one of the resonance frequencies of the lens or of the housing is in the same frequency range as that of the vibrating element. In this manner the overall effect of the haptic feedback is rendered more efficient.
It may occur that the resonance frequency must be individually identified. In accordance with the invention the electronic hand-held device comprises a feature by which the optimal frequency may be determined. This is done by determining the resonance frequency by producing a burst frequency sweep. The force sensors can be made use of in another situation. The haptic feedback responses of the vibrating element(s) can be detected with the force sensors. Using the force sensors it is possible to determine the individual resonance frequency. When the measurement is made, the drive circuit is set to feed the obtained frequency to the vibrating element(s).
The feedback parameters can also be individually tuned for each person using the device. The main parameters that the user can control are, for example, the amplitude, the time period of the vibration, and the vibration frequency.
The present invention additionally provides a solution using only a single component to generate feedback, resulting in significant space savings on the Printed Circuit Board (PCB) since the number of components needed on the PCB is reduced. The present invention also presents a low-cost solution because of the savings in the components.
Also in accordance with the present the feedback can be electrically adjusted. By adjusting the drive signal, a desired feedback can be achieved. The adjustment can be set manually by the user or automatically by the device itself. The present invention furthermore provides a dynamic user interface and an integrated low-cost and low-power solution for producing multi-functional feedback.
It should be noted that the piezo-bender component is not itself necessarily able to generate all of the feedback signals (i.e. a haptic feedback signal, a buzzer signal, a vibratory alert signal, and an audio signal) described herein in accordance with the present invention. However, the situation is different when the piezo-bender is attached to another component, as for example to a lens, or to a certain part of a housing, or to a PCB board. Together with the component to or on which the piezo-bender is attached, multi-functional feedback can be generated as herein described.
It will be apparent to persons skilled in the art that with the advancement of technology, the basic concept of the invention may be implemented in a variety of different ways. The invention and its implementation are thus not intended to be limited to the particular embodiments and examples described hereinabove, but may rather vary within the scope of the appended claims.
Thus, while there have shown and described and pointed out fundamental novel features of the invention as applied to preferred embodiments thereof, it will be understood that various omissions and substitutions and changes in the form and details of the methods disclosed and devices illustrated, and in their operation, may be made by those skilled in the art without departing from the spirit of the invention. For example, it is expressly intended that all combinations of those elements and/or method steps which perform substantially the same function in substantially the same way to achieve the same results are within the scope of the invention. Moreover, it should be recognized that structures and/or elements and/or method steps shown and/or described in connection with any disclosed form or embodiment of the invention may be incorporated in any other disclosed or described or suggested form or embodiment as a general matter of design choice. It is the intention, therefore, to be limited only as indicated by the scope of the claims appended hereto.
Number | Date | Country | Kind |
---|---|---|---|
20012187 | Nov 2001 | FI | national |
This is a continuation of International Application No. PCT/FI02/00889, filed Nov. 11, 2002 (now abandoned).
Number | Name | Date | Kind |
---|---|---|---|
4885565 | Embach | Dec 1989 | A |
5241308 | Young | Aug 1993 | A |
5245245 | Goldenberg | Sep 1993 | A |
5436622 | Gutman et al. | Jul 1995 | A |
6118435 | Fujita et al. | Sep 2000 | A |
6429846 | Rosenberg et al. | Aug 2002 | B2 |
7039866 | Rosenberg et al. | May 2006 | B1 |
7131073 | Rosenberg et al. | Oct 2006 | B2 |
20020033795 | Shahoian et al. | Mar 2002 | A1 |
Number | Date | Country |
---|---|---|
43 23 863 | Jan 1995 | DE |
61 138035 | Aug 1986 | JP |
02-105919 | Apr 1990 | JP |
04-137419 | May 1992 | JP |
09-161602 | Jun 1997 | JP |
11-162277 | Jun 1999 | JP |
2000-137576 | May 2000 | JP |
2001117715 | Apr 2001 | JP |
WO 9200559 | Jan 1992 | WO |
WO 9731333 | Aug 1997 | WO |
WO 9966997 | Dec 1999 | WO |
WO 0127735 | Apr 2001 | WO |
WO 0152029 | Jul 2001 | WO |
WO 0154109 | Jul 2001 | WO |
Number | Date | Country | |
---|---|---|---|
20040227721 A1 | Nov 2004 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/FI02/00889 | Nov 2002 | US |
Child | 10840174 | US |