Envelope modulator for haptic feedback devices

Information

  • Patent Grant
  • 7154470
  • Patent Number
    7,154,470
  • Date Filed
    Monday, July 29, 2002
    22 years ago
  • Date Issued
    Tuesday, December 26, 2006
    18 years ago
Abstract
An amplitude modulator circuit includes a reference oscillator and an envelope modulator coupled to the reference oscillator for receiving a reference signal. A microcontroller is coupled to the envelope modulator for providing an envelope signal to the envelope modulator and a low pass filter is coupled to the envelope modulator for receiving a modulated command from the envelope modulator. An inverter is coupled to the low pass filter for receiving a low passed envelope modulated signal from the low pass filter and a transducer or amplifier is coupled to the inverter and the low pass filter for receiving an inverted low passed signal and the low passed envelope modulated signal.
Description
BACKGROUND OF THE INVENTION

The present invention relates generally to the control of haptic feedback interface devices that interface a user with a computer device.


Humans interface with electronic and mechanical devices in a variety of applications, and the need for a more natural, easy-to-use, and informative interface is a constant concern. In the context of the present invention, humans interface with computer devices for a variety of applications. One such application is interacting with computer-generated environments such as games, simulations, and application programs. Computer input devices such as mice and trackballs are often used to control a cursor within a graphical environment and provide input in these applications. In portable computer or electronic devices, such as laptop computers or personal digital assistants (PDAs), mice typically have too large a workspace to be practical. A popular device for portable computers are “touchpads,” or touchscreens, which are small rectangular, planar pads that sense the location of a pointing object by any of a variety of sensing technologies.


In some interface devices, haptic feedback is also provided to the user. These types of interface devices can provide physical sensations which are felt by the user manipulating the user object of the interface device. One or more motors or other type of actuators are coupled to the device housing or manipulandum and are connected to the controlling computer system. The computer system controls forces output by the actuators in conjunction and coordination with displayed events. The computer system can thus convey physical force sensations to the user in conjunction with other supplied feedback as the user is grasping or contacting the interface device or manipulatable object.


In many haptic feedback devices, the haptic feedback takes the form of vibrations, jolts, or pulses output on the housing or manipulandum and are thus experienced by the user, referred to as “tactile” sensations herein. For example, many gamepad devices include a spinning eccentric mass that creates inertial vibrations on the housing or object. Other devices, such as the I-Feel Mouse from Logitech Corp., provide inertial vibrations using a linearly-moving mass. Still other devices may vibrate a housing or object by impacting or directly moving the housing or object with the actuator.


One problem with current haptic feedback devices is that tactile sensations output to the user tend to be more effective in particular frequency ranges and are less effective in other frequency ranges, thus causing haptic sensations to feel uneven and inconsistent to the user over broad frequency ranges.


SUMMARY OF THE INVENTION

In accordance with one aspect of the present invention, an amplitude modulator circuit comprises a reference oscillator and an envelope modulator coupled to the reference oscillator for receiving a reference signal. A microcontroller is coupled to the envelope modulator for providing an envelope signal to the envelope modulator and a low pass filter is coupled to the envelope modulator for receiving a modulated command from the envelope modulator. An inverter is coupled to the low pass filter for receiving a low passed envelope modulated signal from the low pass filter and a transducer or amplifier is coupled to the inverter and the low pass filter for receiving an inverted low passed signal and the low passed envelope modulated signal.


In accordance with another aspect of the present invention, the reference oscillator comprises a sine wave generator.


In accordance with a further aspect of the present invention, the envelope modulator comprises a ramp generator circuit.


In accordance with yet another aspect of the present invention, the low pass filter is a second order low pass filter.


In accordance with a further aspect of the present invention, a method of amplitude modulation of a resonant frequency sinusoid by a pulse width modulated envelope function comprises providing an envelope wave shape to an envelope modulator, providing a sinusoidal reference signal to the envelope modulator, providing a modulated command from the envelope modulator to a low pass filter, providing a low passed modulated command signal from the low pass filter to an inverter and a transducer or amplified, and providing an inverted low passed modulated command signal from the inverter to the transducer or amplifier passed modulated command signal.


Other features and advantages of the present invention will be understood upon reading and understanding the description of the preferred exemplary embodiments, found hereinbelow, in conjunction with reference to the drawings, in which like numerals represent like elements.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a schematic view illustrating a design topology of an embodiment of a circuit in accordance with the present invention; and



FIG. 2 is a schematic of an example of a circuit in accordance with the present invention.





DESCRIPTION OF SPECIFIC PREFERRED EXEMPLARY EMBODIMENTS

The present invention is an alternative embodiment of an envelope modulation approach referred to in patent application Ser. No. 09/908,184, filed Jul. 17, 2001, which is incorporated herein by reference in its entirety for all purposes. That invention as well as the one described herein, provides methods used to modulate a high frequency signal, suitable for driving a vibrotactile transducer, with a lower frequency signal that contains tactile information. The composite or modulated signal is used to drive an actuator that conveys the lower frequency tactile information to the human user via electrical amplification that drives a transducer, thereby mechanically conveying the tactile information to the user. The high frequency signal oscillates at a frequency that is close to the resonant frequency of the mechanical actuator driven by the transducer, and hence the haptic sensations benefit from mechanical amplification caused by the resonant signal. In patent application Ser. No. 09/908,184, one methodology described is to multiply a resonant frequency sinusoid by the modulating envelope. The amplitude modulated sinusoid then commands an amplifier as a pulse width modulated signal.


A conventional approach requires that the pulse width modulated (PWM) frequency be updated at a high rate in order to accurately conform to a sinusoidal resonant frequency waveform. Deviations from a pure sinusoid generate audible noise in the actuator that detracts from the actuator as a tactile device. A high PWM update rate would be necessary to accurately command a sinusoid that may be in the 100 to 200 Hz range. Such a high update rate would consume significant processor duty cycle and potentially require a more costly processor than with the invention described herein.


The present invention describes amplitude modulation of a resonant frequency sinusoid by a pulse width modulated envelope function to provide strong haptic sensations over a broad frequency range.


A preferred embodiment of the present inventive approach is to use an electronic circuit to perform the envelope modulation function so that the processor only needs to command the envelope wave shape, which is a much lower frequency signal that requires a lower processor update rate. Use of a single electronic circuit reduces costs of the device, since separate components such as op amps or other amplifiers are not required.



FIG. 1 illustrates a design topology of one embodiment of the present invention. The inventive circuit topology 10 includes a signal generator (“reference oscillator”) 11 that produces a sinusoidal reference signal with a frequency that is the same as (or close to) the mechanical resonant frequency of the tactile actuator. If the mechanical system has more than one resonant frequency, one of the resonant frequencies is chosen at which the oscillator will provide the signal. An actuator, such as a piezoelectric actuator or other actuator driving an oscillating mass or manipulandum, typically has a resonant frequency at which output forces (vibrations) are strongest due to the mechanical properties of the system. It is this resonant frequency at which the actuator is preferably driven.


The circuit topology of FIG. 1 also includes an envelope modulator 12 that amplitude modulates the reference signal output by the reference oscillator with an envelope signal 13 from a microcontroller (processor) 14, such as a microprocessor, state machines, etc. The envelope signal can include haptic effects or features that are desired to be output to the user, such as a jolt, a vibration of a desired frequency, etc. A low pass filter 15 receives modulated command 16 output by the envelope modulator. The low pass filter removes the high frequency content of the command envelope signal from the processor. An inverter 17 receives the low passed signal from the filter to provide a differential output signal. The low passed envelope modulated signal 18 from the low pass filter is also sent to a transducer or amplifier 19, such as a piezo transducer or motor amplifier. The inverted low passed signal from the inverter is also sent to the transducer or amplifier so that a differential drive signal is provided to the transducer or amplifier. Other embodiments can produce a single ended signal that either drives the transducer directly or indirectly through an amplifier.



FIG. 2 illustrates an example of a more detailed embodiment of the present invention. This embodiment consists of four circuits. The first circuit is a sine wave generator (reference oscillator) 20. The sine wave generator produces a reference sinusoidal function with a frequency that is the same as (or close to) a mechanical resonant frequency of the actuator. This reference signal is one of the two signals used by the second circuit. The signal generator is preferably a free-running oscillator that is formed by a double integrating feedback loop.


The second circuit is an envelope modulator 21 that generates a series of pulses at the processor's PWM frequency (for example, nominally 24 kHz) with an amplitude that is proportional to the instantaneous voltage of the reference sinusoid. This circuit is preferably a ramp generator that is reset when the PWM signal is low. When the PWM signal is high, the ramp generator produces a sawtooth output signal with an output voltage that increases linearly in time at a rate that is proportional to the instantaneous voltage of the reference sinusoid. In this way, the circuit produces a series of sawtooth pulses with a width proportional to the PWM duty cycle and height proportional to the instantaneous voltage of the reference sinusoid. The average voltage of the sawtooth signal is therefore the same as a signal that would be produced by directly multiplying the reference sinusoid by the PWM command signal. The sawtooth signal output waveform from this circuit then feeds into the third circuit. An envelope command indicating envelope wave shape is provided by microprocessor 25 at output 26.


The third circuit is a second order low pass filter 22 with a corner frequency that lies between the resonant frequency of the actuator (or mechanical system) and the pulse width modulation frequency of the command signal. The fourth circuit is an inverter 23 that inverts the output of the third circuit. The signals output from the third and fourth circuits constitute a differential drive signal that is modulated at the reference sinusoid frequency and has an amplitude that is proportional to the duty cycle of the commanded PWM signal. This differential drive signal can then drive a piezo transducer directly or be amplified to drive an electric motor (such as a DC motor) or other actuator.


The invention frees the processor from the task of performing the envelope modulation function at a sufficiently high update rate to produce a clean modulated sinusoidal output.


A prototype circuit demonstrated that the circuit was able to drive either one or two piezo transducers, and that a constant frequency sinusoidal waveform was being modulated by the PWM envelope command from a TouchSense processor. The prototype circuit further demonstrated that the generated waveform was exciting an inertially grounded mass/transducer/spring system at its mechanical resonant frequency. The frequency of the sinusoidal driving function was tuned to the resonant frequency of the mechanical system. The tactile sensation felt when touching the mass in the mechanical system conveyed the impression that it was excited at the much lower envelope function frequency rather than the mechanical system's resonant frequency.


The present invention is suitable to drive actuators to provide haptic sensations in a variety of haptic feedback computer interface devices, including mice, joysticks, trackballs, gamepads, remote controls, PDA's, touchpads for laptop computers, touchscreens for a variety of devices, gloves, steering wheels, etc. Some examples of suitable devices and haptic sensations are described in copending application Ser. No. 09/917,263, filed Jul. 26, 2001, entitled, “Haptic Interface for Laptop Computers and Other Portable Devices,” including piezoelectric transducer embodiments, and which is incorporated herein by reference in its entirety for all purposes. Other tactile devices and sensations used for inertial tactile feedback, and suitable for use with the present invention, are described in U.S. Pat. Nos. 6,211,861 and 6,088,019 and application Ser. Nos. 09/585,741, and 09/487,737, all incorporated herein by reference in their entirety for all purposes. Other interface device embodiments suitable for use with the present invention are described in Ser. Nos. 09/759,780, 60/236,417, and 60/236,558, incorporated by reference herein in their entirety for all purposes.


While this invention has been described in terms of preferred exemplary embodiments, there are alterations, modifications, and permutations thereof which fall within the scope of this invention. It should also be noted that the embodiments described above can be combined in various ways in a particular implementation. Furthermore, certain terminology has been used for the purposes of descriptive clarity, and not to limit the present invention.

Claims
  • 1. An apparatus, comprising: a reference oscillator configured to provide a reference signal having a frequency substantially similar to a resonant frequency of an actuator;a controller configured to provide an envelope signal, wherein the envelope signal includes tactile information; andan envelope modulator coupled to the reference oscillator and the controller, the envelope modulator configured to modulate the reference signal with the envelope signal to produce a modulated command signal, the envelope modulator being configured to provide an output signal, the output signal configured to drive the actuator to output a haptic effect based on the modulated command signal.
  • 2. The apparatus of claim 1, further comprising: a filter coupled to the envelope modulator, the filter configured to produce a filtered modulated command signal based on the modulated command signal, the output signal being based on the filtered modulated command signal.
  • 3. The apparatus of claim 1, further comprising: a low-pass filter coupled to the envelope modulator, the low-pass filter configured to produce a low-pass filtered modulated command signal based on the modulated command signal, the output signal being based on the low-pass filtered modulated command signal.
  • 4. The apparatus of claim 1, further comprising: a second-order low-pass filter coupled to the envelope modulator, the second-order low-pass filter configured to produce a second-order low-pass filtered modulated command signal based on the modulated command signal, the output signal being based on the second-order low-pass filtered modulated command signal.
  • 5. The apparatus of claim 1, further comprising: a filter coupled to the envelope modulator, the filter configured to produce a filtered modulated command signal based on the modulated command signal; andan inverter coupled to the filter, the inverter configured to produce an inverted filtered modulated command signal based on the filtered modulated command signal, the output signal being based on the inverted filtered modulated command signal.
  • 6. The apparatus of claim 1, further comprising: a filter coupled to the envelope modulator, the filter configured to produce a filtered modulated command signal based on the modulated command signal; andan inverter coupled to the filter, the inverter configured to produce an inverted filtered modulated command signal and a differential output signal based on the filtered modulated command signal, the output signal being based on the differential output signal.
  • 7. The apparatus of claim 1, further comprising: a filter coupled to the envelope modulator, the filter configured to produce a filtered modulated command signal based on the modulated command signal; andan amplifier coupled to the filter, the amplifier configured to produce an amplified filtered modulated command signal based on the filtered modulated command signal, the output signal being based on the amplified filtered modulated command signal.
  • 8. The apparatus of claim 1, further comprising: a filter coupled to the envelope modulator, the filter configured to produce a filtered modulated command signal based on the modulated command signal,the actuator being a transducer, the transducer being coupled to the filter and configured to provide a physical response based on the filtered modulated command signal.
  • 9. The apparatus of claim 1, wherein the reference oscillator includes a sine wave generator.
  • 10. The apparatus of claim 1, wherein the envelope modulator includes a ramp generator.
  • 11. A method, comprising: generating a reference signal having a frequency substantially similar to a resonant frequency of an actuator;generating an envelope signal from a microcontroller, wherein generating an envelope signal further includes providing tactile information;modulating the reference signal with the envelope signal to produce a modulated command signal; andproviding an output signal based on the modulated command signal; anddriving the actuator with the output signal to output a haptic effect.
  • 12. The method of claim 11, further comprising: filtering the modulated command signal to produce a filtered modulated command signal, the output signal being based on the filtered modulated command signal.
  • 13. The method of claim 11, further comprising: low-pass filtering the modulated command signal to produce a low-pass filtered modulated command signal, the output signal being based on the low-pass filtered modulated command signal.
  • 14. The method of claim 11, further comprising: inverting the modulated command signal to produce an inverted modulated command signal, the output signal being based on the inverted modulated command signal.
  • 15. The method of claim 11, further comprising: filtering the modulated command signal to produce a filtered modulated command signal; andinverting the filtered command signal to produce an inverted filtered modulated command signal, the output signal being based on the inverted filtered modulated command signal.
  • 16. The method of claim 11, further comprising: filtering the modulated command signal to produce a filtered modulated command signal; andinverting the filtered modulated command signal to produce a differential output signal, the output signal being based on the differential output signal.
  • 17. The method of claim 11, further comprising: filtering the modulated command signal to produce a filtered modulated command signal; andamplifying the filtered modulated command signal to produce an amplified filtered modulated command signal, the output signal being based on the amplified filtered modulated command signal.
  • 18. An apparatus, comprising: a reference oscillator capable of generating a reference signal having a frequency substantially similar to a resonant frequency of an haptic actuator;a microcontroller configured to generate an envelope signal, which includes tactile information;an envelope modulator coupled to the reference oscillator and the microcontroller, wherein the envelope modulator is configured to generate a modulated command signal in response to the reference signal and the envelope signal;a low-pass filter coupled to the envelope modulator; andan inverter coupled to the low-pass filter and configured to drive the haptic actuator in response to the modulated command signal.
  • 19. The apparatus of claim 18, further comprising: an amplifier coupled to the inverter and the haptic actuator.
  • 20. The apparatus of claim 18, wherein the haptic actuator is a transducer.
CROSS-REFERENCES TO RELATED APPLICATIONS

This application claims benefit of U.S. Provisional Application No. 60/309,913 filed Aug. 2, 2001, the disclosure of which is incorporated by reference in its entirety. This application is a continuation-in-part of U.S. application Ser. No. 09/908,184 filed Jul. 17, 2001.

US Referenced Citations (69)
Number Name Date Kind
2972140 Hirsch Feb 1961 A
3157853 Hirsch Nov 1964 A
3220121 Cutler Nov 1965 A
3497668 Hirsch Feb 1970 A
3517446 Corlyon et al. Jun 1970 A
3623064 Kagan Nov 1971 A
3902687 Hightower Sep 1975 A
3903614 Diamond et al. Sep 1975 A
3911416 Feder Oct 1975 A
4127752 Lowthorp Nov 1978 A
4160508 Salisbury, Jr. Jul 1979 A
4236325 Hall et al. Dec 1980 A
4262549 Schwellenbach Apr 1981 A
4333070 Barnes Jun 1982 A
4464117 Foerst Aug 1984 A
4484191 Vavra Nov 1984 A
4513235 Acklam et al. Apr 1985 A
4581491 Boothroyd Apr 1986 A
4599070 Hladky et al. Jul 1986 A
4708656 de Vries et al. Nov 1987 A
4713007 Alban Dec 1987 A
4771344 Fallacaro et al. Sep 1988 A
4794392 Selinko Dec 1988 A
4885565 Embach Dec 1989 A
4891764 McIntosh Jan 1990 A
4930770 Baker Jun 1990 A
4934694 McIntosh Jun 1990 A
5019761 Kraft May 1991 A
5022384 Freels Jun 1991 A
5022407 Horch et al. Jun 1991 A
5035242 Franklin et al. Jul 1991 A
5038089 Szakaly Aug 1991 A
5078152 Bond et al. Jan 1992 A
5103404 McIntosh Apr 1992 A
5165897 Johnson Nov 1992 A
5175459 Danial et al. Dec 1992 A
5186695 Mangseth et al. Feb 1993 A
5212473 Louis May 1993 A
5240417 Smithson et al. Aug 1993 A
5271290 Fischer Dec 1993 A
5275174 Cook Jan 1994 A
5283970 Aigner Feb 1994 A
5299810 Pierce et al. Apr 1994 A
5309140 Everett, Jr. et al. May 1994 A
5334027 Wherlock Aug 1994 A
5388992 Franklin et al. Feb 1995 A
5436622 Gutman et al. Jul 1995 A
5437607 Taylor Aug 1995 A
5466213 Hogan et al. Nov 1995 A
5547382 Yamasaki et al. Aug 1996 A
5575761 Hajianpour Nov 1996 A
5649020 McClurg et al. Jul 1997 A
5684722 Thorner et al. Nov 1997 A
5690582 Ulrich et al. Nov 1997 A
5734236 Motegi Mar 1998 A
5766016 Sinclair et al. Jun 1998 A
5767839 Rosenberg Jun 1998 A
5785630 Bobick et al. Jul 1998 A
5952806 Muramatsu Sep 1999 A
6088019 Rosenberg Jul 2000 A
6111577 Zilles et al. Aug 2000 A
6160489 Perry et al. Dec 2000 A
6211861 Rosenberg et al. Apr 2001 B1
6216059 Ierymenko Apr 2001 B1
6219034 Elbing et al. Apr 2001 B1
6422941 Thorner et al. Jul 2002 B1
6429846 Rosenberg et al. Aug 2002 B1
6697043 Shahoian Feb 2004 B1
6717573 Shahoian et al. Apr 2004 B1
Foreign Referenced Citations (5)
Number Date Country
0 349 086 Jan 1990 EP
H2-185278 Jul 1990 JP
H4-8381 Jan 1992 JP
H5-192449 Aug 1993 JP
H7-24147 Jan 1995 JP
Related Publications (1)
Number Date Country
20030057934 A1 Mar 2003 US
Provisional Applications (1)
Number Date Country
60309913 Aug 2001 US
Continuation in Parts (1)
Number Date Country
Parent 09908184 Jul 2001 US
Child 10208575 US