Vibration devices are used in a wide range of applications including haptic displays, haptic interfaces, force feedback devices, vibratory feeders, beauty products, personal hygiene products, personal pleasure products, personal massagers, tree harvesters, and seismic vibrators. Some widely used products that include haptic displays include the DUALSHOCK® 3 wireless controller for Sony Computer Entertainment's PlayStation® 3; the PlayStation® Move motion controller for motion gaming with Sony Computer Entertainment's PlayStation® 3; Microsoft Corporation's Xbox 360 Wireless Speed Wheel; and the Wii Remote™ Plus controller which is used for motion gaming with the Nintendo Wii.
Vibration actuators are typically the smallest and lowest cost method for generating haptic sensations. Therefore, it is advantageous to use vibration actuators to create a wide range of haptic sensations. Common low cost vibration actuators include Eccentric Rotating Mass actuators (ERMs) and Linear Resonant Actuators (LRAs). One of the advantages of both ERMs and LRAs is that they can generate relatively large vibration forces from low power input. Both ERMs and LRAs generally build up kinetic energy during their ramp-up period; an ERM does this as the velocity of its rotating mass increases, and an LRA does this as the amplitude of vibration of its moving mass increases. These low cost actuators are used in many applications, including in consumer electronics products such as smartphones and videogame controllers.
Many smartphones today use either a single ERM or a single LRA to produce alerts by vibrating the entire device. This has the advantage that the vibration alert can be felt while the device is inside a person's pocket. Game controllers (also commonly termed interchangeably as “videogame controllers” or simply “controllers”) often incorporate two ERMs within a two-handed device such as the Xbox 360 Wireless Controller or the Xbox 360 Wireless Speed Wheel (both devices from Microsoft). Sometimes such dual-ERM controllers are configured with one ERM having a large rotating mass and the other ERM having a small rotating mass. A single-handed controller such as the Wii Remote™ Plus (from Nintendo) will typically have a single ERM to provide vibration feedback to the user.
A common limitation of most existing vibration devices is the inability to define the directionality of the vibratory forces. ERM actuators generate centripetal forces that rotate in a plane, and generally the direction of vibration (that is to say, the instantaneous direction of the rotating centripetal force vector) cannot be not sensed in haptic applications due in part to the high rate of change of the direction of vibrations. In an ERM a centripetal force is applied onto the eccentric mass by the motor shaft, and an equal and opposite centrifugal force is applied onto the motor shaft. In this document both the terms centripetal and centrifugal are used with the understanding that these are equal but opposite forces. LRAs vibrate back and forth, and thus it may be possible to sense the axis of vibration, but it is not possible to provide more of a sensation in the forward direction relative to the backward direction or vice versa. Since haptic applications are often integrated with audio and video displays such as in computer gaming where directions are an integral component of the game, it is desirable to provide a haptic sensation that also corresponds to a direction. Moreover, it is be useful to generate haptic cues of directionality for applications where a person does not have visual cues, such as to guide a vision-impaired person. Therefore, it is desirable to provide a human-perceptible indication of directionality in vibratory haptic displays and interfaces. In addition, it is advantageous to use vibration actuators to generate a wide range of vibration waveforms including both directional and non-directional waveforms.
There have been some haptic vibration devices that provide a sensation of vibration direction, but these prior implementations have disadvantages. Specifically, asymmetric vibrations have been used to generate a haptic sensation that is larger in one direction than the opposite direction.
However, existing asymmetric vibrators are complex, costly, or have limited controllability. They tend to be bulky and have low power efficiency. Tappeiner et. al. demonstrated a vibration device that generated asymmetric directional haptic cues (Tappeiner, H. W.; Klatzky, R. L.; Unger, B.; Hollis, R., “Good vibrations: Asymmetric vibrations for directional haptic cues”, World Haptics 2009, Third Joint Euro Haptics Conference and Symposium on Haptic Interfaces for Virtual Environments and Teleoperator Systems), yet this device uses a high power and an expensive 6-DOF magnetic levitation haptic device. Amemiya et. al. (Tomohiro Amemiya; Hideyuki Ando; Taro Maeda; “Kinesthetic Illusion of Being Pulled Sensation Enables Haptic Navigation for Broad Social Applications, Ch. 21, Advances in Haptics, pp. 403-414”) illustrated a device that also generates asymmetric vibrations for haptic applications, yet this device uses a complex and large linkage system with 6 links and it appears that the direction of vibration cannot be modified in real-time.
Another limitation of vibration devices that use ERMs is that the amplitude of vibration is dependent on the frequency of vibration, since the vibration forces are generated from centripetal acceleration of an eccentric mass. Some prior approaches have used multiple ERMs to control frequency and amplitude independently, but in the process also generate undesirable torque effects due to the offset between the ERMs.
It is desirable to produce not only haptic directional cues but also to be able to render legacy haptic effects, so that a single game controller could generate both new and existing sensations. Therefore, one aspect of this disclosure and associated embodiments described in this specification include vibration devices and methods of operating those devices employing multiple, low-cost actuator components in lieu of a single, high-cost actuator for creating haptic effects. The aspects described within this disclosure include synchronizing arrays of low-cost, readily available vibration actuators to emulate superlative single actuators and to bring together sets of these emulated high-performance actuators to create a broad range of desired control effects.
According to one aspect of the invention, a vibration device comprises a mounting platform, a plurality of linear resonant actuators attached to the mounting platform, and a controller. Each of the plurality of linear resonant actuators has a moveable mass and an axis of vibration in accordance with a direction of movement of the moveable mass. The axes of vibration of the plurality of actuators being arranged in a substantially parallel configuration. The controller is coupled to each of the plurality of actuators, and is configured to (1) control each actuator to impart a sinusoidal vibration force of a frequency, f1, onto the mounting platform, and (2) control amplitudes and phases of the sinusoidal vibration force from each actuator to generate a combined vibration waveform onto the mounting platform. The combined vibration waveform emulates a virtual vibration actuator having one or both of the following properties: a faster amplitude response than any one of the plurality of linear resonant actuators, or a larger amplitude response than any one of the plurality of linear resonant actuators for non-resonant frequencies.
In one example, all of the plurality of linear resonant actuators are substantially identical. In another example, the vibration device is configured for haptic applications. In one alternative, the vibration device is further configured to be portable by a person. Here, the vibration device may be further configured to be worn or held by a person.
In any of the above examples, the vibration device may be further configured to provide haptic output for one of the following devices: a game controller, a motion game controller, a handheld game console, a remote control, a handheld portable computer, a navigation device, a handheld construction tool, a handheld surgical tool, a stylus, a plush toy, a pair of eyeglasses, a wristband, a wristwatch, a belt, an armband, a leg band, a mobile phone, a tablet computer, a device for aiding a vision-impaired person, a device for aiding a hearing-impaired person, and a device for augmenting reality with haptic feedback, a personal pleasure device for providing pleasurable haptic sensations, and a vibration device used for singly or in a pair for conveying telepresence.
In another example, the combined waveform has the larger amplitude response than any one of the linear resonant actuators for non-resonant frequencies, and the virtual vibration actuator has a control sequence that controls the combined waveform to go from zero amplitude to maximum amplitude within one quarter-wavelength. In a further example, the virtual vibration actuator has a larger amplitude response than any one of the plurality of linear resonant actuators for any given sinusoidal driving force frequency not equal to the resonant frequency of any one of the plurality of linear resonant actuators. In yet another example, the controller manages the virtual vibration actuator to implement a control sequence that undergoes optimal amplitude response immediately followed by optimal damping.
In accordance with another alternative, the controller manages the virtual vibration actuator to implement a control sequence that exhibits successive h-pulses of arbitrary amplitudes. In a further alternative, the virtual vibration actuator is controlled by the controller to implement a control sequence that undergoes optimal amplitude response followed by constant sinusoidal motion for N>1 half-wavelengths followed by optimal damping, wherein N is an integer value.
The virtual vibration actuator may be controlled by the controller to implement a control sequence that generates a sequence of h-pulses such that successive h-pulses differ in amplitude. In this case, changes in amplitude may have a relationship to at least one of changes in position of the vibration device and changes in orientation of the vibration device. In another example, the virtual vibration actuator is controlled by the controller to implement a control sequence that exhibits an h-pulse of arbitrary width. In this case, the arbitrary width may be determined by a resonant frequency associated with one or more of the plurality of linear resonant actuators. And for any of the above examples, the virtual vibration actuator may be controlled by the controller to exhibit superposition or sequential concatenation of multiple instances of the control sequence.
In accordance with another aspect of the invention, a vibration device is provided that comprises a mounting platform, a plurality of vibration actuators attached to the mounting platform, and a controller. Each of the plurality of vibration actuators having a moveable mass that is constrained to rotate about an axis of vibration and a spring attached to the moveable mass and the mounting platform. Each of the vibration actuators is configured to operate as a mechanical harmonic oscillator. The axes of vibration of the plurality of actuators are arranged in a substantially parallel configuration. The controller is coupled to each of the plurality of actuators and is configured to (1) control each actuator to impart a sinusoidal vibration torque of a frequency, f1, onto the mounting platform, and (2) control amplitudes and phases of the sinusoidal vibration torque from each actuator to generate a combined vibration torque onto the mounting platform. The combined vibration torque emulates a single virtual vibration actuator having one or both of the following properties: a faster amplitude response than any one of the plurality of actuators, or a larger amplitude response than any one of the plurality of actuators for non-resonant frequencies.
In one example, the plurality of vibration actuators is a first plurality of actuators, and the vibration device further comprises a second plurality of vibration actuators attached to the mounting platform. Each of the second plurality of vibration actuators has a moveable mass that is constrained to rotate about an axis of vibration and a spring attached to the moveable mass and the mounting platform. Each of the second vibration actuators is configured to operate as a mechanical harmonic oscillator. The axes of vibration of the second plurality of actuators are arranged in a substantially parallel configuration with the first plurality of vibration actuators. The controller is coupled to each of the second plurality of actuators, and is configured to control each of the second plurality of actuators to impart the sinusoidal vibration torque of the frequency, f1, onto the mounting platform such that movement of the moveable masses in the second plurality of vibration actuators counter-rotate relative to movement of the moveable masses in the first plurality of vibration actuators. The controller is also configured to control amplitudes and phases of the sinusoidal vibration torque from each actuator of the second plurality to generate a combined vibration force onto the mounting platform that emulates a single virtual vibration actuator.
For either of the above cases, all of the vibration actuators may be substantially identical. The vibration device may also be configured for haptic applications. In one example, the vibration device is further configured to be portable by a person. And in this case, the vibration device may be further configured to be worn or held by a person.
For any of the above examples, the vibration device may be further configured to provide haptic output for one of the following devices: a game controller, a motion game controller, a handheld game console, a remote control, a handheld portable computer, a navigation device, a handheld construction tool, a handheld surgical tool, a stylus, a plush toy, a pair of eyeglasses, a wristband, a wristwatch, a belt, an armband, a leg band, a mobile phone, a tablet computer, a device for aiding a vision-impaired person, a device for aiding a hearing-impaired person, and a device for augmenting reality with haptic feedback, a personal pleasure device for providing pleasurable haptic sensations, or a vibration device used for singly or in a pair for conveying telepresence.
In accordance with another aspect of the invention, a vibration device is provided that comprises a mounting platform, a plurality of linear resonant actuators attached to the mounting platform such that the axes of vibration for the actuators are substantially in a parallel configuration, and a controller. Each linear resonant actuator includes a moveable mass. The controller is coupled to each of the linear resonant actuators, and is configured to (1) control each one of the linear resonant actuators to impart a sinusoidal vibration force of a frequency, f1, onto the mounting platform, and to (2) control amplitudes and phases of each sinusoidal vibration force to generate a combined vibration waveform onto the mounting platform. The combined vibration waveform emulates a virtual actuator having a maximum amplitude, A1. The virtual vibration actuator has one or both of the following properties: a faster amplitude response than any one of the plurality of linear resonant actuators, or a larger amplitude response than any one of the plurality of linear resonant actuators for non-resonant frequencies.
In one example, the controller is configured to control the combined vibration waveform so that the virtual vibration actuator starts from rest and extends to the maximum amplitude A1 in one quarter-wavelength of motion with no periods of reduced amplitude oscillation prior to maximal extension. In another example, the controller is configured to control the combined vibration waveform so that the virtual vibration actuator transitions from extension to the amplitude A1 to a rest position in one quarter-wavelength of motion with no periods of reduced amplitude oscillation posterior to maximal extension. In a further example, the controller is configured to control the combined vibration waveform so that the virtual vibration actuator starts from rest, extends to a desired amplitude in one quarter-wavelength of motion and then returns to rest in the next successive quarter-wavelength of motion, with no periods of reduced amplitude oscillation at the onset or offset of the device's motion. Here, the virtual vibration actuator may be controlled by the controller to start from rest, extend to a selected amplitude in one quarter-wavelength of motion, oscillate about its rest position at the selected amplitude for an integer number of half-wavelengths, and then return to rest in one quarter-wavelength of motion, with no periods of reduced amplitude oscillation at the onset or offset of the vibration device's motion. For either of these examples, the controller may be configured to generate a successive series of the combined vibration waveforms, wherein each one of the waveforms in the successive series has the same amplitude. Alternatively, for these examples, the controller may be configured to generate a successive series of the combined vibration waveforms, wherein each one of the waveforms in the successive series has a different amplitude.
In accordance with another example, the virtual vibration actuator may have an oscillation period, T1, which starts from rest, extends to a selected amplitude in one quarter-period of motion, and then returns to rest in the next successive quarter-period of motion, with no oscillations of reduced amplitude at the onset or offset of the vibration device's motion. In a further example, one or both of input forcing functions and output vibration patterns managed by the controller are related to either (1) an absolute spatial position and orientation of the vibration device, or (2) a spatial position and orientation of the vibration device relative to an external object, living entity or location. And in this case, one or both of input forcing functions and output vibration patterns managed by the controller may be dynamically determined by the spatial position and orientation of the vibration device relative to an external object, so that the vibration device is configured to guide a user towards or away from the external object, living entity or location.
The foregoing aspects, features and advantages of the present disclosure will be further appreciated when considered with reference to the following description of preferred embodiments and accompanying drawings, wherein like reference numerals represent like elements.
As used herein, an actuator is a device that can generate mechanical motion or force. Actuators can convert a source of energy into mechanical motion or force. The source of energy can be electrical, pneumatic, hydraulic, or another source. Examples of actuators include rotary and linear motors. Examples of electric actuators include DC, AC, and stepper motors.
The term “direction” includes the orientation of an axis, also referred to as vector direction. A vector aligned with a specific direction can be either in the positive direction along the axis or the negative direction along the axis. As used herein, the term direction may distinguish between all angles in a circle, such as 0 to 360 degrees. And vibration control may distinguish between positive and negative directions along a single axis. Furthermore, the term “controller” is used herein in some situations to reference to game controller, and in other situations to a real-time controller of actuators, such as a microprocessor or an ASIC.
In this disclosure, the term “General Synchronized Vibration” refers to control of the timing, and in some cases also control of amplitude, of multiple vibration forces, torques, or forces and torques. The sources of these vibration forces and torques can be electromagnetic, electrostatic, magnetic, spring forces, inertial forces such as centripetal forces, piezoelectric, pneumatic, hydraulic, or other force and torque sources. The sources of these vibration forces and torques can include those described in the text “Engineering Haptic Devices: A Beginner's Guide for Engineers” by Thorsten A. Kern, © 2009 (the entire disclosure of which is hereby expressly incorporated by reference herein). These vibration forces and torques can be generated from separate Vibration Actuators or from actuators that generate multiple force, torques, or forces and torques. In General Synchronized Vibration the forces, torques, or forces and torques are vectorially combined so that they generate a combined force, torque, or force and torque onto an object. The vector combination of force and torque vectors is also referred to as superposition. General Synchronized Vibration results in a combined vibration force, a combined vibration torque, or a combined vibration force and vibration torque onto an object. A force applied onto an object can also apply a torque onto that object. Accordingly, the references in this document to force also apply to force and torque unless explicitly described otherwise.
In the event that there is a difference in the usage of terminology between the instant application and any wholly included reference identified herein, the usage of the differing term definitions will be governed by the use in the present disclosure.
A vibration (or vibratory) actuator can impart repeated forces onto an object. These repeated forces can repeat a similar force profile over time during each repetition. Examples include rotary motors with eccentric masses, and linear actuators which move masses back and forth. These actuators can be DC, AC, stepper, or other types of actuators. A vibration actuator can repeat a similar force profile (waveform) in each cycle, or there can be variations in force profiles between cycles. Variations between cycles can be in amplitude, frequency, phase, and profile shape.
When a force is generated in a repeated cycle it can generate a vibratory force. The profile (also referred to as a waveform) of a repeated force cycle can be in a sinusoidal shape, triangular wave, a square wave, or other repeated profile as shown in
f=1/T (1)
A vibration force, F, is in a repeated cycle when
F(t+T)=F(t) (2)
where T is the period of vibration and t is time.
For purposes of vibration devices it is sufficient for the period of vibration to be approximate, and therefore a vibration is considered to be in a repeated cycle when:
F(t+T)=F(t) (3)
One vibration waveform is a sinusoidal waveform, where the vibration force can be given by:
F(t)=A sin(ωt+φ) (4)
Here, F(t) is force as a function of time. A is the maximum amplitude of force. ω is the frequency of vibration in radians per second (the frequency in Hertz is f=ω/(2π). And φ is the phase of vibration in radians. When ωt=2π the force profile repeats itself.
A vibration actuator may impart repeated forces onto an object. Due to the dynamics of an actuator, a single actuator can impart forces at multiple frequencies at the same time. However, for the purposes of analyzing vibrations and describing vibration devices herein, the primary frequency of an actuator's motion means the frequency having the largest component of kinetic energy in it.
The period of vibration can be defined by the time elapsed between the beginning of one vibration cycle and beginning of the next cycle. Thus to identify the period of vibration it is useful to identify the beginning of a cycle. One method for defining the beginning of cycle is to define the beginning of the cycle as the point with maximum amplitude in the profile.
The sine wave 12, triangle wave 14, and arbitrary profile wave 16 all have a unique point of maximum amplitude during each repeated cycle, and this point of maximum amplitude is used to define the beginning of the cycle. The square wave 18 does not have a unique point of maximum amplitude within a cycle; in such cases a repeated point on the profile can be selected to designate the beginning of the cycle. In
A frequency of vibration can also be identified when the shape of signal does not consist of exactly repeated profiles. Variations in amplitude of the cycle and small changes in the shape of a cycles profile still allow one to identify a unique point that designates the beginning of the cycle. As long as a repeated point in the profile can be identified, then the beginning of each cycle, a vibration period, and vibration frequency can be determined.
The phase of vibration defines the timing of the beginning of a cycle of vibration. A phase difference between two vibration waveforms is defined as the difference between the beginning of a vibration cycle in one waveform and the beginning of a vibration cycle in the other waveform. If there is a nonzero difference in the phase of vibration between two profiles, then the beginning of the cycles do not coincide in time.
As long as it is possible to identify the beginning of a cycle it is possible to identify a phase of vibration, even when the amplitude and frequency of vibration change between cycles of vibration.
One implementation of synchronized vibration is a vibration force formed by the superposition of two or more vibration waveforms where each of the waveforms include peaks that coincide in time with the peaks of the other waveforms on a regularly repeating basis. In a preferred embodiment, each of the waveforms would have the same frequency and a specified phase difference between them. Superposition can preferably be the vector sum of forces, torque, or forces and torque. Typically, the sources of these vibration waveforms are different vibration actuators. Often in synchronous vibration the waveforms have a zero phase difference between them, and thus the vibration waveforms are in-phase and in synchronous vibration. As used herein, specified phase difference may range between and including 0° and 360°. In some embodiments, the specified phase difference is 0° or 180°. In synchronized vibration, the various vibration waveforms can have different amplitudes.
Typically, synchronized vibration profiles will have similar shaped profiles. However, vibration actuators with different shaped vibration profiles can also be vibrated synchronously by matching frequency of vibration and specifying the phase difference between the waveforms. The matching of phase and frequency of vibration can be done approximately and still result in synchronized vibration.
Synchronized vibration can be generated by adding two vibration profiles together, where the amplitude of the second vibration profile is a multiple of the amplitude of the first vibration profile. This multiplying factor can be either positive or negative.
If there are two or more vibrating actuators where the peak amplitude of force of each vibrating actuator occurs repeatedly at approximately the same time, then these actuators are in-phase and in synchronous vibration. The peak amplitude of force can be either in the positive or negative direction of the vibration actuators' or vibration device's coordinate system. Thus if a positive peak amplitude from one actuator occurs at approximately the same time as the negative peak amplitude of another actuator, then these actuators are in-phase and are in synchronous vibration.
An exemplary linear motion vibration actuator 100 is shown in
As the moving mass 102 in the linear motion vibration actuator 100 moves back and forth, forces are generated between the moving mass 102 and the base 104. These forces can be transmitted through the base 104 of the actuator 100 to an object that the actuator is mounted to (not shown). The moving mass 102 may also be attached to an object, such as a handle (not shown), that is external to the actuator 100, and may transmit forces directly to an object external to the actuator 100.
The forces in the linear motion vibration actuator 100 may be magnetic forces, such as with a voice coil. The moving mass 102 may contain, for instance, a permanent magnet, electromagnet, ferromagnetic material, or any combination of these. The base 104 may contain, for instance, a permanent magnet, an electromagnet, ferromagnetic material, or any combination of these. Magnetic forces may be generated between base 104 and the moving magnet that generate acceleration and motion of the moving mass 104. A force in the linear motion vibration actuator 100 generated with an electromagnet can be modulated by controlling the current flowing through the electromagnet.
One embodiment of linear motion vibration actuator 100 in accordance with the present disclosure is shown in
In this embodiment, the force in the actuator 110 can be modulated by controlling the current in the electromagnet. When the current in the electromagnet flows in one direction, then the magnetic force will push the moving mass 112 towards one side of the actuator. Conversely when the current in the electromagnet flows in the other direction, then the moving mass 112 will be pushed to the other side of the actuator 110. Increasing the amount of current in the electromagnet will increase the amount of force applied onto the moving mass 112.
Another embodiment of the linear motion vibration actuator 100 in accordance with the present disclosure is shown in
In this embodiment both the electromagnet 124 and the permanent magnet of the moving mass 122 may have ferromagnetic material placed adjacent to them to increase the force output of the actuator 120. The force in the actuator 120 can be modulated by controlling the current in the electromagnet 124. When the current in the electromagnet 124 flows in one direction, then the magnetic force will push the moving mass 122 towards one side of the actuator 120. Conversely when the current in the electromagnet flows in the other direction, then the moving mass 122 will be pushed to the other side of the actuator 120. Increasing the amount of current in the electromagnet will increase the amount of force applied onto the moving mass 122.
Another embodiment of the linear motion vibration actuator 100 in accordance with aspects of the present disclosure is shown in
The springs 138 function to keep the moving mass 132 close to the center position when the actuator power is off, and to provide a restoring force when the moving mass 132 is at one end of travel of the actuator 130. The stiffness of the springs 138 can be selected so that the natural frequency of the actuator 130 increases the amplitude of vibration at desired natural frequencies. This spring effect can be generated from a single spring, from a nonlinear spring, from extension springs, as well as compression springs. A number of such spring configurations which may be employed with the present disclosure are described in the aforementioned U.S. patent application Ser. No. 11/325,036.
Another embodiment of the linear motion vibration actuator 100 according to aspects of the present disclosure is shown in
The size of the permanent magnets 148 attached to the base 144 can be selected so that the natural frequency of the actuator 140 increases the amplitude of vibration at desired natural frequencies. The actuator 140 may be controlled so that one or more natural frequencies are selected during different modes or times of operation. Use of repulsive magnetic forces as shown in
Alternative embodiments of linear motion vibration actuators that may also be utilized with the present disclosure include both springs and magnets, either alone or in combination, that return a moving mass towards the center of range of motion of the actuator.
A further alternative embodiment of the linear motion vibration actuator 100 in accordance with the present disclosure is shown in
A preferred embodiment of a vibration device 200 according to the present disclosure is shown in
The vibration actuators 202, 204 are desirably attached in a relatively rigid fashion to the vibration device enclosure or base. Rigid attachment provides a common base to the vibration device 200, upon which forces from both vibration actuators 202, 204 are applied. In this embodiment, the two actuators 202, 204 are mounted at approximately right angles to each other. The force generated by actuator 202 is shown as force vector F1, and the force vector from actuator 204 is shown as F2. As expressed herein, vectors and matrices are designated by bold font and scalars are designated without bolding. The combined force generated by the vibration device 200 is the vector sum of the vibration forces from both of the actuators 202, 204, and is shown in
The combined force, Fcombined, applied by the vibration actuators 202 and 204 onto the vibration device 200 is a superposition of the vibration forces from each actuator, and is a function of time, t. The force vector can Fcombined(t) is given by the vector equation:
F
combined(t)=F1(t)+F2(t) (5)
where F1(t) is the force vector from actuator 202 as a function of time, and F2(t) is the force vector from actuator 204 as a function of time.
Both actuators 202, 204 can be operated in a vibratory fashion. For the case of a sine wave vibration, the actuator forces can be given by:
F
1(t)=a1A1 sin(ω1t+φ2) (6)
and
F
2(t)=a2A2 sin(ω2t+φ2) (7)
respectively, where A1 and A2 are the respective amplitudes of vibration, a1 and a2 are the unit vectors corresponding to the respective directions of vibration, ω1 and ω2 are the respective frequencies of vibration, φ2 and φ2 are the respective phase angles, and t is time. Other profile vibrations including square waves, triangle waves, and other profiles can also be implemented with each actuator.
In the example shown in
and the unit vector a2 aligned with the x axis and is represented by:
The combined force vector, Fcombined, is given by the superposition of forces form the actuators 202 and 204, and thus is given by:
F
combined(t)=a1A1 sin(ω1t+φ2)+a2A2 sin(ω2t+φ2) (10)
It is possible to vibrate actuators 202 and 204 shown in
F
combined(t)=[a1A1+a2A2] sin(ωt+φ) (11)
With such in-phase and synchronous vibration the vibration is synchronized, then the peak forces from both linear motion vibration actuators will occur at the same instances during each cycle of vibration. The net direction of vibration force is the vector combination of [a1A1+a2A2]. Thus, in synchronized vibration and in-phase vibration, the vibration device generates a vibration force at a specified frequency in a specified direction that results from the vector combination of forces from the direction and magnitude of each of the actuators in the device. It is possible to control the magnitude of vibration in each linear motion vibration actuator, and thereby control the net direction of vibration of Fcombined.
In a preferred example, the vibration frequency, ω, phase φ, and waveform of each actuator are substantially identical. For instance, ωt may be set to be substantially equal to ω1 and φ2 may be set to be substantially equal to φ1. By way of example only, ωt may be set to within 10% of the value of ω1, more preferably to within 5% of the value of ω1. Similarly, by way of example only, φ2 may be set to within 10% of the value of ω1, more preferably to within 5% of the value of φ1. In another example, the frequencies and/or phases may be set exactly equal to one another. Alternatively, the frequencies, phases, and/or waveforms of each actuator may be set so that a user would not be able to notice the difference in frequency, phase or waveform. In a further alternative, if the vibration device is used in a haptic application to generate force sensations on the user, small variations may occur which may not be detected by the user or which cannot be significantly felt by the user. In other instances, force sensations in a haptic application or in a vibratory feeder application may vary minutely so that user performance in the haptic application or performance of the vibratory feeder is not significantly changed.
It is also possible to apply equation 11 to a vibration profile/waveform of arbitrary shape. Here, waveform p(t) may be used to represent the waveform shape over time t. A period of vibration may be represented by p(t)=p(t+nT), where n=1, 2, 3, etc. and T is the period of vibration. In this case, an arbitrarily shaped synchronized vibration profile may be represented as:
F
combined(t)=[a1(t)A1(t)+a2(t)A2(t)]p(t) (11.1)
When the direction of vibration force for each actuator is substantially constant relative to a base member, the arbitrarily shaped synchronized vibration profile may be represented as:
F
combined(t)=[a1A1(t)+a2A2(t)]p(t) (11.2)
To illustrate how the direction of Fcombined can be controlled, the peak magnitudes, A1 and A2, are represented in
By varying the magnitude of the vibration force in the actuators 202, 204, it becomes possible to control the direction of vibration of the combined force effect. In
In a similar fashion, the direction of combined force can be rotated in the clockwise direction as shown in
It is also possible to change the direction of Fcombined to an adjacent quadrant. As shown in
An alternative embodiment of a vibration device in accordance with the present disclosure is shown in
The unit vector a1 is given by:
where the angle α describes the orientation of actuator 1 relative to the x axis as shown in
where the angle β describes the orientation of actuator 2 relative to the x axis as shown in
For a given vibration waveform the maximum magnitude of force vectors, F1,max and F2,max, from actuators 212 and 214 in
F
1,max
=A
1
a
1 (14)
F
2,max
=A
2
a
2 (15)
When actuators 212 and 214 are vibrated synchronously and in-phase (e.g. with the same frequency and with zero phase difference), then the maximum force amplitude occurs at the same time. Thus the maximum combined force vector, Fcombined,max, is given though superposition of the force vectors, and is given by:
F
combined,max
=F
1,max
F
2,max (16)
A matrix of actuator directions, DL, can be created where each of its columns is a unit vector that corresponds to the direction of vibration of a linear motion vibration actuator in a vibration device. For a vibration device with two linear motion vibration actuators, such as the one shown in
D
L
=[a
1
|a
2] (17)
where a1 and a2 are column vectors.
A matrix representation of the combined force is given by:
where A1 and A2 are scalars. For the case of vibration in a plane, the vectors a1 and a2 will be 2×1 vectors and the matrix DL will be 2×2.
When the direction matrix, DL, is invertible then the amplitude of vibration in the individual actuators that corresponds to a desired combined force vector, Fcombined, is given by:
When the actuators are aligned orthogonally, then the direction matrix, DL, is orthonormal and its inverse is given by its transpose as shown below:
D
−1
=D
T (20)
When the direction matrix, DL, in not invertible because there are more vibration actuators than directions of force being controlled, then a pseudo inverse of matrix DL can be used. For example, if there are 3 vibration actuators in the xy plane, and the control objective is only to control a two dimensional force, the DL matrix is given by:
D
L
=[a
1
|a
2
|a
3] (21)
where a1, a2, and a3 are 2×1 column vectors.
The pseudo inverse is described in “Introduction to Linear Algebra”, 3rd Edition by Gilbert Strang, published in 2003 by Wellesley-Cambridge Press, the entire disclosure of which is incorporated by reference herein.
One method for calculating a pseudo inverse, DL+, is given by:
D
L
+
=D
L
T(DLDLT)−1 (22)
In such a case the amplitude of vibration for each actuator can be given by:
It is possible to specify the combined force vector, Fcombined, in terms of a direction of vibration and amplitude. For a two dimensional embodiment the combined amplitude of vibration can be specified by the scalar Acombined, and the direction of vibration can be specified by an angle, theta, as shown in
Thus, it can be seen that the amplitudes of vibration, A1 and A2, can be represented in terms of the direction of vibration, theta, combined amplitude of vibration, Acombined, and direction matrix, DL, as given by:
Equation 25 provides the scalar magnitude of A1 and A2. When the sign of A1 is different than the sign of A2 then vibration waveform can be generated directly using the results of Eq. Avec. Alternatively, the waveform can be generated using absolute values of A1 and A2 but with one waveform completely out of phase with the other waveform. A sine wave is defined to be completely out of phase when it is 180 degrees out of phase. General waveforms are defined to be completely out of phase when the maximum positive amplitude of vibration of one waveform concedes with the maximum negative amplitude of the other waveform. A depiction of two actuators vibrating completely out of phase is shown in
It is also possible to specify the combined direction of vibration in terms of a unit vector, acombined, as shown in
F
combined
=A
combined
×a
combined (26)
Another configuration according to aspects of the present disclosure is a three dimensional configuration, where there are at least 3 linear motion vibration actuators as shown in
In the vibration device 220 of
F
combined
=A
combined
×a
combined (27)
where acombined and Fcombined are 3 dimensional vectors.
Vibration devices according to the present disclosure may include an arbitrary number of actuators in arbitrary locations and orientations.
Another alternative embodiment of a vibration device according to the present disclosure is shown in
In a variation of
A further embodiment of a vibration device according to the present disclosure is shown in
An alternative embodiment of a vibration device 290 in accordance with aspects of the present disclosure is shown in
In the vibration device embodiments described herein the vibration actuators may be attached to the vibration device in a rigid, a semi-rigid or a non-rigid fashion. Even when vibration actuators are attached in a non-rigid fashion to a vibration device, the vibration device is operable to transmit the superposition of forces from all vibration actuators. When vibration actuators are attached in a rigid fashion to a vibration device, the combined force applied by the vibration device becomes less dependent on the location where the vibration device transmits force and torques to other bodies. In addition, the more rigid the attachment between the vibration actuators and the vibration device, the more uniform the timing of the force superposition becomes at all points of the vibration device.
In an example, it is possible to attach the actuators directly onto a person's hand and body, for instance as shown in U.S. Pat. Nos. 6,275,213 and 6,424,333. In uses of the present disclosure where actuators are directly attached or indirectly coupled to the hand or body, the vibration force from each actuator may be felt directly at different locations on the body, yet a synchronized combined force vector can still be applied onto the body by synchronizing the operation of the actuators.
Vibration devices in accordance with the present disclosure can be built with rotary vibration actuators as well as with linear motion vibration actuators. In some cases the cost to manufacture rotary vibration actuators is less than the cost to manufacture linear motion vibration actuators. Thus, if cost is a factor, it may be desirable to utilize rotary vibration actuators in place of or in combination with linear motion vibration actuators. However, in order to generate synchronized vibration with rotary vibration actuators, it is necessary to control the rotary position of the actuators along with the rotary velocity.
A rotary vibration actuator may comprise, for example, a DC motor, a rotary solenoid, a rotary stepper motor, a servo motor, or other type of rotary actuator. One advantage of rotary actuators is their relatively low cost. The servo motor uses a position sensor and/or a velocity sensor for feedback. In some situations the rotary stepper motor may be more desirable because it allows for control of position and velocity without the use of a sensor.
Many existing vibrators utilize rotary vibration actuators with eccentric masses, but not with synchronized vibration. In accordance with the present disclosure, a pair of rotary vibration actuators can be configured to achieve a vibration force that is aligned with a single direction of motion. Accordingly, a pair of such rotary actuators can be used when a vibration force in a specified direction is required.
For instance, a vibration device according to the present disclosure can be built, by way of example only, with two rotary vibration actuators that rotate in opposite directions, as shown in
With rotary vibration actuators it is possible to create synchronized vibration in an analogous fashion to the synchronized vibration described with linear motion vibration actuators. With rotary vibrating actuators, synchronized vibration is defined to occur where two rotary actuators rotate in approximately the same plane at the same angular velocity in opposite directions, and where the relative angle between the actuators is controlled, such that the actuator centrifugal force vectors align repeatedly in the direction of desired vibration force.
The direction of vibration force can be controlled with a pair of rotary (or rocking) vibration actuators by controlling the angle at which the centrifugal force vectors become aligned. Therefore, it is possible to control the direction of combined force with rotary actuators in a fashion analogous to how the direction of combined force can be controlled with multiple linear vibration actuators.
An alternative type of rotary actuator suitable for use with the present disclosure is a rotary actuator with a pivoting mass.
As seen in
The mass 402 may pivot in either a clockwise or counterclockwise manner.
Vibration forces and/or torques can be generated with the pivoting actuator 400 as shown in
Vibration forces and/or torques can be generated by moving a mass back and forth. It is possible to define the beginning of a vibration waveform as an instance at which a mass reverses its direction of motion. For linear actuators, the reversal of direction is a reversal of translation. For rotary actuators, the reversal of direction is a reversal of rotation. In general, the reversal of motion of a mass in an actuator may include both translation and rotation.
In actuators having a spring device attached to a moving mass, energy can be built up in the spring device, especially when the mass is moved back and forth close to a natural frequency of the mass and spring system. In such cases, the maximum vibration force can occur at the maximum deformation of the spring device, which can occur when the mass reaches its maximum excursion and reverses its direction. Accordingly, moving masses in two (or more) actuators that are operating in synchronized vibration, can reverse direction at approximately the same time.
An alternative method for generating vibration would be to operate the pivoting actuator 400 in a clockwise (or counterclockwise) direction and then deactivate the pivoting actuator 400 while allowing the spring device 410 to rotate the pivoting mass 402 in the counterclockwise (or clockwise) direction. This approach would allow one to use pivoting actuators and control circuitry that only operates in a single direction.
One type of pivoting actuator 400 that could be employed is a DC motor. However, not all the components of the DC motor are necessary for this application, because the output shaft does not rotate continuously. Accordingly it is not necessary to have motor brushes, which can reduce cost as well as electrical power losses and frictional losses. In a preferred example, the pivoting actuator 400 may essentially include a stator and a rotor. The stator may be stationary and desirably contains permanent magnets and/or electromagnets. The rotor is operable to pivot and can contain permanent magnets and/or electromagnets. The polarity of the magnets in the stator and rotor can be configured so that activation of the electromagnets causes an electromagnetic torque to be exerted onto the rotating mass 402.
In the embodiment of
It is possible to generate nonlinear spring force, even with use of a linear spring element. Consider the embodiment shown in
As shown in
Low frequency operation is desirable in some situations, for instance in games that have low frequency effects. For instance, games may generate actions or events in the sub-200 Hertz range, such as between 15 and 150 Hertz. In certain cases the actions or events may be as low as 20-50 Hertz or lower, such as about 10-20 Hertz. Examples of such actions/events include gunshots, automobile related sounds such as a car spinning out of control, and helicopter related sounds such as the whirring of the rotor blades. Eccentric mass actuators may not be suitable to generate a haptic sensation in this frequency range, but pivoting actuators or linear actuators may generate such frequencies.
As the magnitude of rotation of the pivoting mass 422 increases, the lengthening of the spring device 428 increases as shown in
While several types of actuators have been described above that may be used with the present disclosure, other types of actuators may also be employed so long as they can be controlled as described herein. For instance, piezoelectric devices without separate or distinct “moving” and “stationary” masses may be employed either alone or in combination with other actuator types to impart vibratory forces in the manners described herein.
An alternative embodiment of the present disclosure includes two rotary vibration actuators whose planes of vibration are not the same; however, in this case the two planes are not orthogonal to each other. In this embodiment, the component of centrifugal force from one actuator that can be projected onto the plane of the other actuator can be used to achieve a component of synchronous vibration.
In one example, two or more vibration devices may be mounted devices into a game controller, as shown in
There are many orientations of both the rotary actuators and springs that can be used to achieve an embodiment where synchronized vibration is possible. For instance, the axis of rotation of both actuators can be aligned while the spring direction can vary, allowing an alternative configuration for synchronized vibration.
A controller for synchronized vibration of a pair of rotary vibration actuators specifies the angular position of each rotating shaft, such that the angle where the centrifugal force vectors are aligned is the desired direction of force vibration and the angular position is incremented such that the rotational velocity matches the desired vibration frequency.
A system 500 having a controller for one or more vibration devices that use linear motion vibration actuators is shown in
The controller 502 may be, by way of example only, a microprocessor and the driver circuit(s) 504 may be, for instance, one or more electrical amplifiers. The controller 502 and drive circuit 504 may be integrated into a single microprocessor or single electrical circuit. The control method in this figure is for a configuration with N actuators, where N is an arbitrary number of actuators. Some of the figures showing various control methods in the instant application illustrate only two actuators. However, it should be understood that control methods according to the present disclosure can be extended to include an arbitrary number of actuators, as shown in
The output from the vibration device controller 502 shown in
Here, t is time and ω is the vibration frequency in radians per second. The parameter p is the phase of vibration and may be set to zero. The value of ω in terms of frequency f in vibrations per second is given by ω=2πf.
When the vibration actuators have a linear relationship between the command magnitude and the magnitude of vibration, the output A1(t) and A2(t) from equation 28 can be applied directly to the vibration actuators to generate a combined vibration direction corresponding to the angle theta. However some vibration actuators may have a nonlinear relationship between the command magnitude and the magnitude of vibration. For such nonlinear actuators it is possible to generate vibration in the direction theta by using a linearization function that adjusts the magnitude of A1 and A2 to compensate for the nonlinearity of the actuator, as shown in the following equation.
The linearization equation described above can be a lookup table or a scaling algorithm or other type of function.
The ability to control the direction of vibration over time, such as though use of equations 28 and 29, is an important advantage of the present disclosure. The ability to control vibration direction can be used in vibratory feeders to direct parts in a desired direction. In addition, there are numerous advantages of using the disclosure for haptic devices as described herein.
If a digital computer is used, the digital output for each actuator 554a,b is then preferably fed into respective digital-to-analog (“DAC”) converters 556a and 556b, which convert the output to the appropriate analog waveform. The analog waveforms are then fed into the appropriate driver circuits 558a and 558b. Those skilled in the art could use other means to modulate the linear vibrations of each actuator 554a and 554b, for example via pulse width modulated (“PWM”). Varying the parameters produces an extremely broad range and rich set of haptic sensations for the end user.
In addition to creating varying force effects, one could control the direction of vibration—that is to say the direction of vibration could remain stationary. The resultant force effects can be of lower frequency than the frequency of vibration.
There are also useful applications for generating precise patterns of vibrations from simple parameters. Such patterns include circles, ellipses and straight lines. Furthermore, the amplitude and duration of the patterns may be precisely controlled over time. Moreover, a sequence of patterns may be generated as desired.
Each of the vibration devices described herein according to the present disclosure can be used as a haptic interface. Haptic interfaces provide force sensation to a user. Haptic interfaces include computer gaming controllers, robot controllers, surgical tool controllers, as well as other devices where a force sensation is provided to a user.
An embodiment 600 of the present disclosure with a haptic interface application is shown in
In the embodiment shown in
A haptic interface application can include a simulation of a virtual environment or representation of a real environment to the user 606. A systems controller method of control can be based upon this real or virtual environment. Typical simulated environments include games, driving and flight simulations, surgical simulations, and other types of simulations. Typical real world environments include control of robots and remote machines, long distance interactions, and other types of environments. It is often desirable that a haptic interface provide force sensations that correlate with the real or simulated environment in which the haptic interface is being used.
Another embodiment 620 having a haptic interface application is shown in
In the embodiment of
The embodiment shown in
A first example involves the simulation of a user firing a gun. In this simulation, the vibration device controller 632 could specify the angle theta to represent the direction of a gun firing, the amplitude of vibration, Acombined, to represent the amplitude of the gun recoil, and the frequency of vibration, f, to represent the frequency of bullets leaving the gun.
A second example involves an impact between objects. In this simulation the vibration device controller 632 may specify the angle theta to represent the direction of impact, and the amplitude of vibration, Acombined, to represent the amplitude of impact.
A third example involves driving a vehicle. In this simulation the vibration device controller 632 could specify the angle theta to represent the direction of vehicle motion, the frequency of vibration, f, to represent the frequency of vehicle vibration as it drives over bumps in the road or the speed of the vehicle, and the amplitude of vibration, Acombined, to represent the amplitude of bumps in the road.
A fourth example involves a car or spacecraft spinning out of control. In this simulation the vibration device controller 632 could specify an angle theta that represents the vehicle's orientation. To represent the vehicle spinning, the angle theta can vary over time. The rate at which the angle theta can be different than the vibration frequency. Typically the frequency at which a vehicle spins would be significantly lower than typical vibration frequencies.
An algorithm that can be used to create the vehicle spinning described above varies the direction of vibration continually. The direction of vibration may be rotated at a rate of β radians per second, using the equation below:
Equation 30 illustrates that the frequency of direction change, β, can be modified independently from the frequency of vibration ω. A user such as user 606 or 626 can sense both the frequency of vibration and the direction of vibration. In this fashion, sensations at both the β and ω frequencies can felt by the user. It is possible to set the frequency β much lower than the frequency ω, thereby overcoming a limitation of known devices. By way of example only, ω may vary between 10 Hz and 100 Hz while β may be on the order of 1 Hz. In another instance, β may vary from between about 5% to 20% of ω. Of course, in other instances ω and β may be similar or the same, or, alternatively, β may be larger than ω. All of these examples will depend on the specific effect that is desired.
Low frequency operation is desirable in some situations, for instance in games that have low frequency effects. For instance, games may generate actions or events in the sub-200 Hertz range, such as between 1 and 150 Hertz. In certain cases the actions or events may be as low as 2 Hertz or lower, such as about 0.5-1 Hertz. Examples of such actions/events include gunshots, automobile related sounds such as corresponding to a car spinning out of control, and helicopter related sounds such as the whirring of the rotor blades. A traditional eccentric mass actuator may not be suitable to generate a haptic sensation in this frequency range; however, two or more vibration actuators operated in synchronized vibration may generate such frequencies.
β is not limited to any particular rate or range of rates. For instance, β may be a relatively low rate to represent a slow spinning action, e.g., of a car spin out at less than 10 miles per hour, or β may be a relatively high rate to represent a fast spinning action, e.g., of a car spin out at a speed in excess of 40 miles per hour. Similarly, ω is not limited to any particular frequency of vibration. Preferably, ω is set within a range of frequencies that can be felt or otherwise detected by a user.
Equation 30 may be modified by changing the vibration profile from a sine wave to a square wave, triangle wave, or other profile. In addition, the amplitude of vibration, Acombined, can be varied over time. The frequencies β and ω can also be varied over time. In this fashion a wide range of force effects can be created.
Vibration actuators can be used to provide haptic sensations either through synchronized vibration or otherwise. Actuators can be vibrated without synchronization when there is no need to convey directional information, and then the actuators can be switched to synchronous vibration when there is a need to convey directional information though the haptic interface.
Many linear motion vibration actuators take advantage of resonance to achieve relatively high level of forces with low power requirements. However, to achieve these high levels of forces a number of vibration cycles have to occur before the peak magnitude of vibration occurs. In addition when the actuator is shut off, the moving mass in the actuator may continue to oscillate for a number of cycles. Thus the dynamics of the actuator prevents instantaneous response of the actuator to increase or decrease the magnitude of vibration.
When synchronous vibration is used to control the direction of combined force, the actuator dynamics may limit the speed at which the direction of combined force can be changed. One of the examples presented above describes implementation of a haptic force sensation that corresponds to the spinning of a car. However, the actuator dynamics may limit the rate at which such spinning effect can be generated. As will be described in detail below, it is possible to provide a method that can increase the rate at which the direction of force can be changed for a system of vibration actuators that are synchronously vibrated.
Equation 25 above defines the required amplitude of vibration of actuators to achieve a combined force direction corresponding to an angle theta. For a given actuator in a vibration device, the required amplitude of vibration is defined as Ades, which indicates the desired amplitude of vibration of that actuator. If the actuator is at rest or at a lower level of vibration than Ades, then it may be desirable to initially drive the actuator at a higher level of vibration to more quickly raise the amplitude of vibration to Ades. Conversely if the actuator is already vibrating at an amplitude higher than Ades it may be desirable to initially drive the actuator at a lower level or even brake the actuator to more quickly lower the amplitude of vibration to Ades. These variations in the amplitude at which the actuator is driven are defined as corrections to the commanded vibration magnitude.
One method of determining the proper corrections to the vibration magnitude is to model the dynamics of the actuator. This approach allows one to predict the dynamic states of the actuator and optimal commands to most quickly generate the desired amplitude of vibration.
An alternate method of determining the corrections to the vibration magnitude does not require a dynamic model of the actuator or explicitly predicting the dynamic states of the actuator. In this method a counter is maintained to track the recent number of vibrations of the actuator and the corresponding commands sent to the actuator during these recent vibrations. The command to the actuator at the kth vibration is given by the following equation:
A
com
k
=A
des
k
+A
cor
k
Ades
If the desired amplitude at the kth vibration is greater than the amplitude during the previous vibration, then most likely the vibration level needs to be increased. Accordingly, the correction to the command at vibration k, Acor
A
cor
k
=K*(Ades
Here, K is a gain chosen based upon actuator performance. This same equation works for reducing the magnitude of vibration quickly. When Ades
Another approach to correcting the magnitude of vibration takes into consideration the two previous commanded amplitudes, and is given by the following equation:
A
cor
k
=K
1*(Ades
Here K1 is a gain that corresponds to the k−1 vibration command, and K2 is a gain that corresponds to the k−2 vibration command. In a similar fashion even more prior commands can be incorporated into the correction algorithm. The following equation shows how “m” prior commands can be incorporated into an actuator command.
A
cor
k
=K
1*(Ades
Alternative methods of control for multiple vibrating actuators may include modified synchronization. One method of modified synchronization is for one actuator to vibrate at a frequency that is an integer multiple of the vibration frequency of another actuator.
One advantage of such a modified synchronization method is that multiple vibration frequencies can occur at the same time while still providing for some superposition or peak amplitudes. The superposition of peak amplitudes allows for control of direction of vibration, in a similar fashion to how the direction for vibration is controlled for synchronized vibration. With this modified method of synchronized vibration, it is possible to specify the direction of combined force only during a portion of the vibration cycle. Nevertheless, a direction component to the vibration can be controlled in the duration close to the time where the superposition of peaks occurs. Close to the time at which there is superposition of peaks in the vibrations, the combined force vector, Fcombined, can be approximated by:
F
combined
=a
1
A
1
+a
2
A
2 (34)
Here, a1 and a2 are the unit vectors aligned with the directions of actuator 1 and actuator 2, respectively. A1 and A2 are the amplitudes of force of actuator 1 and actuator 2, respectively, near the duration of the superposition of peaks. By modifying the amplitudes A1 and A2 it is possible to modify the amplitude and direction of the combined force vector, Fcombined. A similar approach can be used when there are more than two vibration actuators.
If there are two or more vibrating actuators where repeatedly the peak amplitude of force of these vibrating actuators occurs at approximately the same time, then the combined direction of force of these actuators can be controlled near the time when these repeated peak amplitudes occur. In this case, the combined direction of force can be controlled by modifying the amplitude of vibration of the actuators.
An alternative modified synchronization is to drive two vibration actuators at the same frequency but one vibration actuator at a phase where its peak magnitude of force occurs when a second vibration actuator is at zero force, which is at 90 degrees out of phase for a sinusoidal vibration. In such a modified synchronization the combined force direction rotates in a circle or ellipsoid during each vibration period.
Additional methods for modified synchronization of vibration may include the superposition of profiles as described in the “Jules Lissajous and His Figures” (“Lissajous”), appearing in chapter 12 of “Trigonometric Delights” by Eli Maor, published in 1998 by Princeton University Press. The entire disclosure of Lissajous is hereby incorporated by reference. Lissajous describes how profiles can be combined through various combinations of frequencies, phases, amplitudes, and profiles to generate a wide range of output figures. These are also known as Bowditch curves. Lissajous also describes how geometric shapes can be created from multiple vibration sources. These combinations of vibrations can be applied to haptic devices and vibration devices in accordance with aspects of the present disclosure. Thus, the concepts of superposition described in Lissajous can be applied by vibration actuators to yield a wide range of force sensations.
Electric actuators often require a driver circuit separate from a controller. The driver circuit provides sufficient current and voltage to drive the Actuators with the necessary electrical power. A wide range of driver circuits have been developed for electrical actuators and specifically for vibration actuators, and are known to those skilled in the field. Such driver circuits include linear drivers, PWM drivers, unipolar drivers, and bipolar drivers. A circuit block diagram for a vibration actuator 700 according to the present disclosure includes a vibration controller 702, a driver circuit 704, and an actuator 706, as shown in
The vibration controller 702 shown in
It is often desirable to control a vibration device or actuators from a digital controller such as a microprocessor or other digital circuit. Digital control circuits often have low level power output, and therefore require a higher power driver circuit to drive an actuator. In addition, low cost digital controllers often have digital outputs, but do not have analog outputs. To simplify the vibration controller circuitry and lower cost, the vibration signal can be a binary logic directional signal which signals the moving mass to move either forward or backwards. In this configuration, the vibration signal can be in the form of a square wave to generate the desired vibration effect. Even with such a square wave control signal, the actual motion and vibration force of the vibration actuator will most likely not follow a square wave exactly due to the dynamics of the actuator.
To further simplify the vibration controller circuitry and lower cost, the amplitude of the vibration signal can be modulated with a PWM signal, where the duty cycle of the signal is proportional to the amplitude of vibration. An embodiment 710 with such a digital vibration controller 712 for one actuator 716 is shown in
Digital control circuitry can be used to control a complete vibration device in synchronized vibration. In synchronized vibration the frequency and phase of two or more actuators are the same. Accordingly, a single square wave can be used to control the direction of the vibration actuators that are in synchronized vibration. The amplitude of vibration can be controlled independently for each actuator, with separate PWM signals.
The embodiment 720 of
Electric actuators in accordance with the present disclosure can be driven with unipolar or bipolar drivers. A unipolar driver will generate current in an actuator in a single direction. A unipolar driver is well suited for actuators where the moving mass is ferromagnetic and an electromagnetic coil only generates attractive magnetic forces, such as the actuator 150 shown in
A bipolar driver can generate current in two directions. Bipolar drivers are well suited for actuators where the moving mass is magnetic and where reversing the direction of current in an electromagnetic coil can reverse the direction of force on the moving mass. Examples of such actuators are presented in
In vibrating circuits it can be advantageous to increase power output of the driver circuits through use of a charge pump capacitor as used in 3958 and 3959 drivers manufactured by Allegro Microsystems. It can also be advantageous to incorporate a capacitor in series with a linear motion vibrating actuator to benefit from a resonance effect and temporary storage of energy in the capacitor, as described in the aforementioned U.S. patent application Ser. No. ______ entitled “Vibration Device.”
As detailed herein, vibration actuators can be used in a variety of methods to create haptic effects. Vibration actuators can be operated continuously throughout the duration of a specified haptic effect, or can be pulsed on and off during the haptic effect. By pulsing vibration actuators on and off the user feels only a small number of vibrations, then feels a pause, and then the vibration resumes. In this fashion it is possible to generate secondary sensations associated with the frequency of pulsing the actuators on and off. Examples of how such pulse effects can be used are described in U.S. Pat. Nos. 6,275,213 and 6,424,333.
Any of the actuators described herein may be used in accordance with the present disclosure to produce a wide variety of haptic effects. While some actuators such as linear actuators and rocking mass actuators may be particularly suited for low frequency operation, all actuators herein may provide synchronized feedback. Such feedback may be employed in games, virtual reality equipment, real-world equipment such as surgical tools and construction equipment, as well as portable electronic devices such as cellular phones and pagers. By way of example only, cellular phones and pagers may implement different vibration effects to identify different callers or different actions. Synchronized vibration may provide directional feedback, for instance, with the impact or recoil of a gun in a game, or to distinguish between frontal and side impacts in driving games. Synchronized vibration may also provide a continual rotation of a vibration force vector in a game to simulate a car spinning out of control. Synchronized vibration may also be used in endless other applications and situations to provide a rich haptic experience to a user.
As mentioned above, other aspects of the disclosure include General Synchronized Vibration. General Synchronized Vibration differs from non-synchronized vibration in that the frequency and phase of multiple vibration forces are controlled. Embodiments with multiple Vibration Actuators that are not controlled with the General Synchronized Vibration approach will often have inconsistent frequency, amplitude, or relative phase between the actuators. With General Synchronized Vibration the frequency and phase of the Vibration Actuators may vary during the start-up and transitions between various waveforms. However, once the actuators are synchronized, each actuator is controlled to a specific frequency and phase.
Often each actuator is controlled to a fixed frequency and phase for a given duration of time. This duration of time depends on the application, but is typically longer than the period of the highest frequency vibration force that is being synchronized. In haptic applications this duration of time is typically along enough for a person to sense the effect. However, there are some implementations of General Synchronized Vibration where the desired waveform of vibration varies quickly, such as a quickly changing direction used to provide a sensation of spinning. In such quickly varying waveforms, the desired frequency and phase of a vibration actuator may be changing in a duration that is shorter than the period of the vibration of that actuator. A common characteristic of General Synchronized Vibration is that the frequency and relative phase of multiple vibration actuators are explicitly controlled to desired values rather than randomly selected values.
In General Synchronized Vibration there is typically a consistent correlation between frequency and phase of the actuators and desired vibration effects. For example, a haptics effect library for software developers may have a routine labeled “spin,” which generates a sequence of desired frequency and phase for a plurality of Vibration Actuators. Each time the spin effect is executed, a similar sequence of frequency and phase and generated by the plurality of Vibration Actuators.
Embodiments of this disclosure include a Vibration Device comprised of multiple Vibration Actuators mounted onto a mounting platform such as a base plate, sub-frame, housing, or enclosure. For example the mounting platform could be the housing of a game controller, or the housing of a Vibration Actuator. The mounting platform transfers force and torque between the Vibration Actuators and thereby allows the vibration forces and torques to be superimposed upon each other. The mounting platform is preferably rigid, but can also be relatively rigid component, or a semi-rigid component. The mounting platform could be made of separate pieces. The mounting platform could include components of an object upon which vibration forces are being applied. For example if multiple Vibration Actuators are mounted onto a person's arm or other body parts and forces are transmitted from these actuators through the arm or body parts, then the arm or body parts can serve as the mounting platform. This disclosure pertains to any configuration where the forces and torques from multiple Vibration Actuators can be vectorially combined to generate a net vibration force, vibration torque, or vibration force and torque.
The mounting platform is typically attached to a number of items such as battery, control circuit board, and the stationary parts of the Vibration Actuators including housing and stator. The combined mass of the mounting platform and items that are attached to it is defined as a “Reference Mass”. The vibration force and torques are transferred from Vibration Actuators to the Reference Mass. If the mounting platform is able to move, the vibration forces may shake the Reference Mass. Typically the Reference Mass is in contact with an “External Object”, and forces and torques are transmitted between the Reference Mass and the External Object. For example, a game controller held in a user's hand would transfer forces and torques from the game controller's Reference Mass onto a user's hands, which in this case is an External Object. The mounting platform may be attached to the Earth, which would also be an External Object. A Vibration Device attached to the Earth is sometimes termed a “Shaker” or a “Shaker Device”.
A preferred embodiment uses two aligned LRAs, as shown in
For the embodiment shown in
F
1
=B
1 sin(ω1t+φ1)
F
2
=B
2 sin(ω2t+φ2)
The combined force for the LRA Pair is given by:
F
LRA
Pair
=B
1 sin(ω1t+φ1)+B2 sin(ω2t+φ2) (35)
Typically it is not critical to control vibration effects relative to absolute time. Accordingly, when implementing the vibration effect described in Eq. 35 above, it is not critical to control both the phase φ1 and φ2, but rather the relative phase between the two actuators. Therefore in some implementations one could set phase φ1 to zero and control only φ2. Alternatively one could directly control the phase difference between the actuators. In this application typically the phases of all the actuators are shown in the equations. However, without loss of utility only the relative phase of the actuators can be controlled. Thus the phase of Vibration Actuators 2, 3, 4, etc. would be controlled relative to the phase of actuator 1; thereby eliminating the need to control the phase of actuator 1 relative to absolute time.
A feature of this disclosure includes the use of superposition of synchronized vibration waveforms. When multiple vibration forces are generated on a single vibration device, the Combined Vibration Force for the device is the superposition of the multiple waveforms. An example with two synchronized sine waves described by Eq. 35 is shown in
Furthermore, at the time when waveform 1 is at its negative peak then waveform 2 is at a positive peak, and the forces magnitudes are subtracted from each other (also referred to as destructive interference or negative interference). Due to this synchronization the combined vibration waveform is asymmetric, meaning that the force profile for positive force values is different than the force profile for negative force values. In the asymmetric waveform shown in
In an LRA, a moving mass moves relative to the actuator housing, and a restoring spring transfers force between the moving mass and the actuator housing. The force imparted by an LRA onto a mounting platform is a combination of the force from the restoring spring, and the electromagnetic force between the stator and moving mass. The restoring spring can be, for example: a mechanical spring or a magnetic spring. As resonance builds up in an LRA, the magnitude of the spring restoring force increases and becomes the dominant portion of the actuator force. Accordingly, the peak force imparted by a LRA onto the mounting platform typically occurs at or near the peak excursion point of the moving mass.
In
Thus, in this embodiment the timing of the moving masses is an indication of an asymmetric vibration waveform. In
In the embodiment shown in
A variation of this embodiment is shown in
Another variation of this embodiment is shown in
The timing of vibration force within a Vibration Actuator can be correlated with a number of physical properties. For example, in many LRAs a spring applies a restoring force onto a moving mass and the vibration force is largely correlated with the position of the moving mass. In ERMs the direction of the vibration force largely correlates to the angular position of a rotating eccentric mass. Linkage mechanisms can be used to generate vibrations, such as a slider-crank vibration actuator 1110 shown in
A feature of this disclosure includes combining vibration waveforms from multiple Vibration Actuators to generate a more complex vibration waveform. The asymmetric vibration described by Eq. 35 and shown in
A vibration force, F, is in a repeated cycle over a period T when F(t+T)=F(t). The vibration force of an ith actuator in a repeated cycle can be given by:
F
1(t+Δi+Ti)=Fi(Δi+t),
where Δi is the phase and Ti is the period of the ith actuator. For the embodiment shown in
F
AlignedSet
=F
1(Δ1+t)+F2(Δ2+t)+ . . . +FN(ΔN+t) (36)
In the general case, the waveform shapes of Fi can be a wide range of waveforms including sine waves, triangle waves, square waves, or other waveforms. In some embodiments, the frequency of the actuator with the lowest frequency is defined as the fundamental frequency, ω1, and the remaining actuators vibrate at integer multiples of the fundamental frequency. In these embodiments the period of the fundamental frequency is given by T1 and the remaining vibration periods are given by such that:
T
1=2T2,T1=3T3, . . . T1=NTN
When all the vibration actuators vibrate at integer multiples of the fundamental frequency, then the combined waveform has a repeated waveform with a period of the fundamental frequency. The fundamental frequency is also referred to as the first harmonic.
One method of implementing General Synchronized Vibration is to use sinusoidal vibrations in each actuator of an aligned set, and use Fourier Waveform Synthesis to select the phase, frequency, and amplitude of each actuator to approximate a desired vibration waveform. For a set of N aligned actuators with sinusoidal waveforms, the combined force of an Aligned Set, FAlignedSetFourier, is given by:
F
AlignedSetFourier
=B
1 sin(ω1t+φ1)+B2 sin(ω2t+φ2)+ . . . +BN sin(ωNt+φN) (37)
A wide range of additional waveforms can be synthesized from a set (a plurality) of vibration waveforms. Fourier synthesis is a method whereby an arbitrary waveform can be approximated from a combination of sine waves, including both symmetric and asymmetric waveforms. It is advantageous to use actuators vibrating at frequencies that are integer multiples of the frequency of vibration of other actuators. The lowest frequency in the set is referred to as the fundamental frequency or the first harmonic, the second harmonic is twice the fundamental frequency, the third harmonic is three times the fundamental frequency, and so on.
An advantage of using harmonics is that all the waveforms in the set repeat at the period of the fundamental frequency, thereby providing a repeating waveform profile of the combined waveform. In many vibration applications each vibration actuator generates a force with a repeated waveform that has a zero DC component and the combined force is described by Eq. 37. Accordingly, the combined vibration force does not have a DC component. Fourier synthesis is widely used in create a wide range of waveforms. One example waveform is a Sawtooth waveform, which creates a sudden change of force in one direction. In this manner, the Sawtooth waveform can be used to generate directional haptic cues. When the set of waveforms consists of three sine waves, the Sawtooth waveform can be generated with the first harmonic at relative amplitude 1, the second harmonic is at relative amplitude of ½, and the third linear sine wave with a relative amplitude of ⅓. With Fourier waveform synthesis, arbitrary waveforms can be approximated including both symmetric and asymmetric waveforms. When using Fourier waveform synthesis, both constructive and destructive interference can occur for both the positive and negative forces amplitudes.
An operating advantage of an LRA is to use resonance to generate high magnitude vibration forces from a relatively low power input, and an LRA can be designed and manufactured to have a specific resonant frequency by optimizing its spring stiffness and moving mass. In embodiments of General Synchronized Vibration, it can be advantageous to select a set of LRAs with resonant frequencies that correspond to at least some of the harmonics of a desired waveform. For example for a vibration device such as that in
Although LRAs are generally designed to operate at their resonant frequency, one can operate LRAs at other frequencies with lower amplitude force output per input command signal. Since lower amplitude force output is typically required at higher harmonics, once could build a Vibration Device with LRAs that all have the same resonant frequency, but operate them at different frequencies. For example for a vibration device with a set of 2 LRAs, both LRAs could have a specified resonant frequency of ( 3/2)ω1, where the first LRA is driven at ω1, and the second LRA is driven at 2ω1. In this configuration both LRAs are amplifying the input signal, but less than if they were driven at the resonant frequency of the LRAs, which is ( 3/2)ω1 for this example.
Asymmetric Vibration waveforms are useful for generating directional haptic cues, and can be synthesized using Fourier synthesis. For instance, an example of a method for selecting frequency, phase, and amplitude of sinusoidal vibrations to generate a high level of asymmetry is discussed below. Vibration parameters are specified for a set of 2, 3, and 4 actuators. In addition a process is presented for identifying parameters for waveforms with a high level of vibration asymmetry for any number of actuators. It should be noted that high levels of asymmetry may be achieved even if the values specified by this example are only approximately implemented. For instance, in the case of superposition of two sine waves, if there is a 30% error in the amplitude of vibration then 90% of desired asymmetry effect will still be realized.
Fourier synthesis allows one to approximate an arbitrary waveform with a superposition of sinusoidal waves. However, it is advantageous in some applications to generate asymmetric waveforms that have higher peak magnitudes in the positive direction than in the negative direction (or vice versa). The question then becomes what is the best function to approximate that will maximize the amount of asymmetry for a given number of superimposed sine waves? It is of special interest to consider asymmetric waveforms that have a zero DC component and thus can be composed solely of sine waves. Waveforms with a zero DC component can be used to generate vibrations from a set of vibrators since each vibrator will typically have a zero DC component. An asymmetric pulse train is illustrated in
where W is the pulse width, V is valley amplitude, T is period of repeated pulse, and P is peak amplitude.
The amount of asymmetry in a pulse-train can be defined by the percentage increase of P over V. One could increase the amount of asymmetry by reducing W, which would generate a thin and high pulse. However, if W is too small, the waveform would not be well-approximated with a small number of sine waves. Accordingly, an analytical question is, “What is the optimal value of W for a waveform composed of N sine waves?”
where f(t) is an arbitrary waveform and when a0=0 it have zero DC component. The Fourier coefficients can be calculated by multiplying both sides of the above equation by sin(2πnt) or cos(2πnt) and then canceling out terms. The coefficients are:
The equation for a0 holds if the DC component is zero. For the pulse waveform above, an is given by:
In a similar fashion:
By substituting in V from the equation above, the result is:
Fourier coefficients can be represented by an and bn as:
An alternative representation using sine waves and phase is:
To relate the two representations, the addition of sines formula:
sin(α+β)=sin(α)cos(β)+cos(α)sin(β)
may be used with:
α=2πnt
β=φn
A
n sin(2πnt+φn)=An cos(φn)·sin(2πnt)+An sin(φn)cos(2πnf)
Let
In one scenario, the process shown in
The variable “NACT” in Table I is used to define the number of sine waves since it can also represent the number of actuators. For two sine waves, an asymmetry of 100% can be achieved, which indicates there is twice the magnitude in the positive direction (or vice versa). Higher numbers of sine waves can provide even higher amounts of asymmetry as shown in Table I. One example is shown in
General Synchronized Vibration can be performed with a set of non-sinusoidal waveforms. Even without use of Fourier synthesis, asymmetric waveforms can be generated by synchronizing the waveforms to create positive interference of two or more waveforms in one direction, and negative interference of two or more waveforms in the opposite direction. Embodiments with non-sinusoidal waveforms can still have the peaks of two or more waveforms occur simultaneously with positive interference in one direction and also occur simultaneously with negative interference in the opposite direction.
To create an especially distinct vibration effect, some LRA vibration actuators can be operated at an amplitude high enough to push the moving mass into the travel stops, thereby creating an impact force during each oscillation. The impact with the travel stops will generate a vibration waveform that is not sinusoidal. Multiple such actuators can be synchronized together to generate positive and negative interference as instances of impacts of masses with travel stops. This configuration can generate sharp peaks of vibration force, where direction of vibration is controllable. These sharp peaks of vibrations could be used to generate haptic sensations corresponding to impacts such as simulating the recoil of a gun. A wide range of vibration effects can be generated with non-sinusoidal vibrations. Examples are presented herein that use sine wave vibration waveforms, with the understanding that similar approaches could be generated with other waveforms.
One waveform that can be simulated is referred to as a “missing fundamental” waveform, which takes advantage of a phenomenon of human perception. As explained in “Music and Connectionism” by Peter M. Todd, D. Gareth Loy, MIT Press 2003, humans may perceive that a sound contains pitch of a certain frequency even though that frequency is not present in the sound if the sound contains higher frequencies that are integer multiples of the low frequency. In haptic applications, low frequency vibrations may be difficult to generate due to size and power constraints, while it may be easier to generate higher frequency vibrations. A vibration waveform can be generated that does not contain a desired low frequency, but does include higher frequencies at integer multiples of the desired low frequency. A person may perceive the desired low frequency vibration, just as they perceive the missing fundamental in a sound. The perception of a missing fundamental in vibration can be enhanced by including audio or visual effects at the desired low frequency.
The embodiment shown in
LRAs generate vibration forces along an axis and thus are described as “Linear Force Actuators.” Other Linear Force Actuators include slider-crank vibrators, rack and pinion vibrators, linear actuators that do not use resonance, pistons, and solenoids. Rocking actuators and pivoting actuators (such as described in U.S. patent application Ser. No. 11/476,436) generate forces that are approximately along an axis and for many applications can be considered Linear Force Actuators. Indeed, any embodiment described herein as employing LRAs can also be implemented with Linear Force Actuators or other actuators that generate forces that are approximately along an axis.
A controller for General Synchronized Vibration of a pair of Linear Force Actuators is shown in
Both LRA and ERM Vibration Actuators take some time to ramp up to speed to generate their maximum force output. Embodiments described herein include controllers that may or may not synchronize the actuators during the ramp up period. In addition, a Vibration Device may be commanded to transition from one vibration effect to another vibration effect. During this transition time interval, the controller may or may not synchronize the actuators.
A vibration device controller can be a microprocessor or other programmable device. For each actuator in the vibration device, the vibration device controller can modify the frequency of vibration, the phase of vibration, the amplitude of vibration, or any combination of these parameters. The ability to change these parameters allows for a single vibration device to generate a wide range of waveforms.
The phase and amplitude of the force output of a Vibration Actuator depends on both the control signal and the physical characteristics of the actuator. For example there is often a phase lag between the control signal and the force output of the actuator. To distinguish between the waveform of the actuator outputs and the waveform of the control signal, the subscript “c” notation is used to designate the control waveform. Thus the commanded amplitudes, Ac, and the commanded phase pc are not necessarily a direct correlation to the actual amplitude and phase of the actuator force. For example, the command voltage, V, of a vibration device controller of an LRA actuator driven with a sinusoidal voltage signal at a frequency ω, with a command phase of φc, and a voltage peak magnitude Ac, given by:
V=A
c sin(ωt+φ) (38)
However, due to the phase lag inherent in the actuator and frequency response of the actuator, the steady state force output of the actuator, Fa, may be given by:
F
a
=A sin(ωt+φ) (39)
The phase lag is the difference between φ and φc. The frequency response is reflected in the ratio between Ac and A. Both the phase lag and the frequency response are functions of the actuator physics that can vary with vibration frequency, and which is often represented by an actuator specific Bode plot. For effective implementation of synchronized vibration it can be advantageous to take into consideration the phase lag inherent in each vibration actuator. This can be done by adding an equal but opposite phase offset to the controller waverform so that the actuator phase lag does not impact synchronization.
One method to implement this offset is to use a look up table, Bode plot, or algorithm for each actuator that determines the appropriate phase offset for a given vibration frequency. In addition, it can be advantageous to use a lookup table, Bode plot, or algorithm to determine the required voltage magnitude needed to generated the desired vibration force magnitude. The Fourier synthesis approach and the approach of matching positive and negative peaks of vibration described herein are implemented in reference to the actual phase of the actuator force output rather than the phase of the waveform from the actuator drive circuits. In order to simplify notation herein, the phase lag due to the actuator physics is generally not included in the equations relating to synchronization. Rather a more compact notation is used which represents the vibration force output, F, with the understanding that the appropriate command signal is generated to provided that output. The command signal includes the necessary phase lag and magnitude adjustment as needed based upon the actuator physics. The magnitude control can be implemented with a voltage, current, PWM signal of voltage or current, or other type of command used to drive said actuator. The Fourier synthesis approach and the approach of matching positive and negative peaks of vibration describe specific target frequency and phase of vibration for actuators within the vibration device; however, even if these target frequency and phase are not exactly met, the overall vibration effect often is close enough to the desired waveform to achieve a desired effect.
Due to manufacturing variations, two actuators that are built on the same assembly line may have different physical characteristics that affect their Bode plot, including phase lag, amplitude characteristics or resonant frequency. In some embodiments a sensor or sensors can be used to detect the phase of an actuator, the amplitude of vibration of an actuator, or the amplitude and phase. Such a sensor could be an optical sensor, Hall-effect sensor or other type of sensor that detects when a moving mass passes the midpoint or other point of vibration. One such embodiment is shown in
Another method of sensing is to attach actuators 1124a and 1124b to the Mounting Platform 1100 of the vibration device 1134 as shown in
The sensor measurements can be used to self-calibrate the vibration devices. A test pattern can operate each actuator separately to identify the actuator phase lag, force amplitude characteristics, and resonant frequency. These characteristics can be used to update a lookup table, Bode plot, or algorithm used to generate the voltage commands to the actuators. The combined force of multiple actuators can also be measured to confirm that the desired force effects are being achieved. Accordingly, the vibration device controller can use the sensor measurements to update the commanded amplitude, phase, and frequency as shown in
Embodiments of the disclosure also include configurations with multiple sets of aligned vibration actuators. One such configuration is shown in
In the embodiment shown in
F
combined
=a
1
A
1(B1 sin(ω1t+φ1)+B2 sin(ω2t+φ2))+a2A2(B1 sin(ω1t+φ1)+B2 sin(ω2t+φ2)) (40)
As described in U.S. patent application Ser. No. 11/476,436, there are methods for selecting the magnitude of A1 and A2 that will generate a desired direction for the vector Fcombined, yet these methods may only specify the axis of vibration and not whether the magnitude of force is positive or negative and thus limit the range of unique direction of vibrations to a range of 180 degrees. According to one aspect of the disclosure, an embodiment allowing control of the direction of vibration in all 360 degrees of the plane of the Mounting Platform, may have the following parameter relationships:
Numerous other embodiments are possible with multiple sets of aligned vibration actuators. Each set of aligned actuators can generate an arbitrary waveform, pAlignedSet. Embodiments of synchronized vibrations created from arbitrary shaped profiles are described above. Many such embodiments show a single actuator generating each waveform. However, it is also possible to have a set of aligned actuators create these waveforms. Therefore, such embodiments can be expanded to include configurations where a set of aligned actuators take the place of a single actuator. In these configurations, the arbitrary waveform profiles would take the form of the arbitrary waveform, pAlignedSet, as discussed herein.
Accordingly, embodiments of asymmetric vibration include 3D configurations and non-orthogonal configurations. An example of two non-orthogonal LRA Pairs is shown in
F
combined
=a
1
A
1(pAlignedSet)+ . . . +a2A2(pAlignedSet)+ . . . +aMAM(pAlignedSet) (41)
The approaches used to determine the values of A described above can be applied to these configurations as well. A variety of Lissajous vibration patterns are also described above, including lines, circles, ellipses, parabolas, etc. Asymmetric vibration waveforms can be used to produce larger peak forces during one part of the Lissajous vibration pattern than another part.
Turning to another aspect of the disclosure, an ERM is depicted in
One method of generating vibration forces is with an ERM where an eccentric mass is attached to motor shaft. As the motor rotates, centrifugal forces are generated onto the motor. General Synchronized Vibration can be applied to multiple ERMs by controlling the frequency and phase of rotation of the eccentric masses.
For the ith ERM, Ai is the amplitude of the vibration force, ωi is the frequency of vibration, and φi is the phase of vibration. The combined vibration force of the ERMs in
F
Ex
=A
1 cos(ω1t+φ1)+A2 cos(ω2t+φ2)+ . . . +AM cos(ωMt+φM)
F
Ey
=A
1 sin(ω1t+φ2)+A2 sin(ω2t+φ2)+ . . . +AM sin(ωMt+φM)
The force and torque imparted by an ERM onto a mounting platform are due to a combination of the centrifugal force from the rotating eccentric mass, the torque between the stator and rotor of the motor and other inertial forces such as gyroscopic effects. As the speed of the ERM increases the centrifugal force increases and typically becomes the dominant portion of the vibration force. Accordingly, once an ERM has sped up, the vibration force imparted by an ERM onto the mounting platform is close to the centrifugal force imparted by the rotating eccentric mass.
In one embodiment, the ERMs are configured in counter-rotating pairs, where each ERM in a pair has the same eccentric mass and operates at the same angular speed but the ERMs rotate in opposite directions from each other.
F
E1x
=A
1 cos(ω1t+φ1+φ1+σ1)+A1 cos(−ω1t−φ1+σ1)
F
E1y
=A
1 sin(ω1t+φ1+σ1)+A1 sin(−ω1t−φ1+σ1)
The phase difference between ERM 1212a and ERM 1212b is represented by two variables, φ1 and σ1, where φ1 represents a temporal phase and is half of the difference in overall phase and σ1 represents a geometric angle and is half of the average of the overall phase difference. For an ERM the magnitude of the vibration force, A, is equal to mrω2, where m is the mass, r is the radius of eccentricity, and ω is the speed of angular rotation in radians per second. Through trigonometric identities, this combined vibration force vector of the first ERM pair can be represented by the equation below. In this configuration, the force from a single counter-rotating pair generates a sinusoidal vibration force aligned with an axis of force direction defined by the angle σ1.
The embodiment in
F
E2x
=A
2 cos(ωnt+φ2+σ2)+A2 cos(−ω2t−φ2+σ2)
F
E2y
=A
2 sin(ω2t+φ2+σ2)+A2 sin(−ω2t−φ2+σ2)
In one control method, σ1 and σ2 are set equal to the same value, σ, and therefore both ERM pairs generate a vibration along the same axis and the combined vibration force vibration force vector of all four ERMs is given by:
In another control method, σ2 is set equal to π+σ1 and therefore both ERM pairs generate a vibration along the same axis but the contribution from the second ERM pair has a negative sign. With this method the combined vibration force vibration force vector of all four ERMs is given by:
There are similarities between the application of General Synchronized Vibration to Linear Force Actuators and ERMs. In both cases, the combined vibration force can be composed of a superposition of sine waves, and in both cases it is possible to implement asymmetric vibrations. One embodiment asymmetric vibration uses the relative magnitudes and phases for superposition of two sinusoidal waves. In this embodiment, the amplitude of the fundamental frequency is twice that of the second harmonic. For the embodiment shown in
Steps of General Synchronized Vibration are shown in
Embodiments are possible with a plurality of ERM pairs, as shown in
In the embodiment shown in
m
n
r
n=(An/A1)m1r1/n2 (45)
The phases may be represented relative to the starting time of a specific waveform of pulse-trains being approximated. In some implementations it is more convenient to set the phase of the first harmonic to zero and represent the phases of the other harmonics relative to the first harmonic. An equation that converts the phase of the nth harmonic, φn, to a phase of the nth harmonic relative to the first harmonic, is given by:
φrn=φn−(ωn/ω1)φ1 (46)
In addition, the phases may be defined relative a series of sine waves, while the ERM vibration equation Eq. 42 is specified in terms of a cosine wave. A cosine wave is a sinusoidal wave, but the phase is shifted by 90 degrees from a sine wave. Table I shows parameters for embodiments that superimpose 2, 3, and 4 sine waves. These parameters can be converted to relevant parameters for embodiments with 2, 3, and 4 ERM pairs, using Eq. 45 and Eq. 46 along with the 90-degree shift for the cosine representation. Table III, provided below, shows these parameters for ERM pairs which generate high levels of asymmetry. The method described in
Implementing General Synchronized Vibration with ERMs has an advantage that a wide range of vibration frequencies can be generated without being restricted to a specific resonance range. As the ERM frequency increases the centrifugal forces increase, the ratio of waveform amplitudes of A1 and An remains constant. Accordingly, high levels of asymmetric vibrations can be generated with a single ratio of eccentricity, as shown in Table II and Table III, over an arbitrary frequency.
An embodiment with four ERMS is shown in
Steps of General Synchronized Vibration are shown in
Other embodiments are possible with different frequency and mass relationships. The time, t, is represented in terms of the period of the fundamental frequency, where T1=2π/ω1. As seen in
Another vibration device is shown in
A single vibration device could operate similar to ERMs as either counter-rotating pairs or co-rating pairs. There are a number of advantages of operating a vibration device in a mode where some of the ERMs function as CORERMs. One advantage is that the magnitude of vibration can be increased by using a CORERM pair. Another advantage is that legacy vibration effects can be generated that simulate a single ERM rotating. For example, a haptic interface could be operated at one time to generate asymmetric vibration forces and at another time to simulate a single ERM. If users are accustomed to haptic signals from a single ERM, the CORERM pair allows for such familiar effects to be generated.
A large number of co-rotating ERMs could by synchronized together in with no phase offset such that their force magnitudes combine to create a vibration effect similar to a single large ERM. If all the co-rotating ERMs are CORERM pairs with co-located centers, then the center for the combined force would be the same as for a single large ERM.
Another advantage of using CORERM pairs is that they allow for Fourier syntheses of a wider range waveforms. One such embodiment is to replace each ERM in
Control of amplitude of vibration force can be especially useful in asymmetric vibrations used for haptic applications. A vibration device can be grasped by one hand, two hands, held with other body parts, attached to any body part, or placed in contact with any body part. Generally at least two sides of a haptic vibration device are in contact with a user, and each side contacts the user at somewhat different locations on their body. These different locations could be the different sides of a grip of a tube vibration device, such as shown in
Human perception often requires that a threshold be exceeded before a sensory event is perceived. In one embodiment, the magnitude of an asymmetric waveform is adjusted so that on one side of a Vibration Device low vibration forces are generated that are below a threshold of perception and on the opposite side higher peak forces are generated that are above a threshold of perception. In this manner, a vibration force may be perceived on mostly one location that is in contact with the vibration device, even though the vibration device is in contact with a number of locations on the body. As the direction of vibration is varies, the location on the body at which vibration is perceived may also vary. This approach uses vibration to generate effects that are vary significantly according to the direction of vibration, and thus are useful for indicating directional cues.
An embodiment with 2 ERMs in a tube is shown in
The embodiment in
The forces between an ERM and a mounting platform include both centrifugal forces and the motor torque generated between the motor stator and rotor. When an ERM is rotating at operating speed, the centrifugal forces are typically large and dominate the effect from the motor torque. However, some embodiments can bring effects from the motor torque to the forefront. When two ERMs with parallel axes are operated as a co-rotating pair with a phase offset of 180 degrees, the two eccentric masses balance each other out and the centrifugal forces cancel each other out. In this embodiment, the torque about the axes of rotation can be felt more prominently. The torque about the axis of rotation is felt during the acceleration and deceleration of the rotating masses. Higher torques can often be generated by periodically reversing the applied voltage to the motor, since the electromagnetic force (back EMF) in the motor can add to the reverse voltage being applied.
Even higher torques about the axis of rotation can be generated by using a brake to cause a sudden deceleration to a rotating mass. This approach is known as a reaction-wheel method for generating torques, and is useful when there is no grounded actuator to apply a torque effect.
One embodiment of an ERM Pair uses interleaved masses, an example of which is shown in
In an embodiment with interleaved masses, the ERM pair can generate centrifugal forces without generating a torque due to the distance between the ERMs. Interleaved ERM pairs are useful for generating pure force vibrations without torque vibrations. Interleaved ERM pairs can be operated as a co-rotating pair, and thereby vary the amplitude of vibration independently from the frequency of vibration. A co-rotating interleaved pair can switch between a 180 degree angle between the ERMs and a 0 degree angle to rapidly turn the vibration effect on or off. Since there are no torque effects, the complete vibration sensation will be turned off when the ERMs have a relative phase angle of 180 degrees. In addition, such a configuration can generate a gyroscopic effect without generating torque vibrations.
An interleaved ERM pair can also be operated as a counter-rotating pair, and thereby generate a vibration force along an axis. By controlling the phase of the interleaved ERMS, the direction of the vibration force can be controlled.
Embodiments with 3 ERMs are shown in
When the distance A times the eccentricity of ERM 1314a is equal to the distance B times the eccentricity of ERM 1314b, then the combined vibration force from synchronized ERMs 1314a and 1314b is projected onto the axis of rotation at the same point along this axis that the center of the eccentric mass of ERM 1312 is projected onto. In this configuration the combined vibration force from all 3 ERMs share the same plane. With this configuration, a vibration force can be generated by all 3 ERMs without generating a torque. Accordingly, the embodiment with 3 ERMs in
If the eccentricity of ERM 1314a plus the eccentricity of ERM 1314b is equal to the eccentricity of ERM 1312, then complete cancellation of the vibration forces can occur when all 3 ERMs are rotating. This complete cancellation allows for rapid on and off control of vibration forces. The embodiment in
Another embodiment with 3 ERMs is shown in
When the eccentricity of ERMs 1314a and 1314b are half the eccentricity of the center ERM 1312, and the ERMs 1314a and 1314b are synchronized to operate at the same frequency and same phase, then complete cancellation of vibration forces and torques can occur at a phase offset of 180 degrees. Thus, the embodiment in
An additional embodiment with 3 ERMs is shown in
To provide complete cancellation of the vibration force, the eccentricity of the rotating mass of ERMs 1314a and 1314b can be selected to be half that of the center ERM 1312. Complete cancellation of vibration torques can occur in the co-rotating mode when the center ERM 1312, is located in the center between ERMs 1314a and 1314b. The embodiment in
The embodiment in
General Synchronized Vibration of ERMS requires control of both the frequency and phase of rotating eccentric masses. One method is to use a motor, such as a stepper motor, where the position and speed can be defined open-loop by specifying a desired series of steps. Another method is to use closed loop control with a sensor or sensors that measure frequency and phase. An ERM with a sensor 1260 is shown in
Another method to sense frequency and phase is to use a discrete sensor that detects when the motor shaft spins by a set position relative to the motor housing, or a number of set positions relative to the motor housing. Such discrete sensors can use reflective optical sensors that reflect off a rotating object coupled to the motor shaft, line-of-sight optical sensors that detect when a rotating object coupled to the motor shaft interrupts the line of site, hall effect sensors that detect a discrete component that is coupled to the rotating shaft, or other method of discrete detection of the shaft position.
Implementing General Synchronized Vibration with ERMs requires that the frequency and phase be controlled for each ERM that is used to synthesize the desired waveform. Both the frequency, ω, and phase, φ, can be controlled by controlling the position, θ, of the rotating shaft of the ERM to be at a desired position as a function of time. Accordingly, control of frequency and phase can also be equivalent to control of the position of an eccentric mass to a desired position trajectory over time. Measurement of the shaft position can be performed continuously or at discrete instances such as when the shaft passes a certain position. Continuous measurements could be made with an encoder or other type of sensor that measures positions at frequency intervals. Discrete measurements could be made with an optical sensor that detects when the eccentric mass passes by. Discrete measurements could be made at a single position of motor rotation or at multiple positions. Discrete measurements can be augmented with a second sensor that also measures the direction of rotation. A direction sensor could be a second optical sensor mounted close to the first optical sensor. The direction of rotation can be determined by which optical sensor is triggered first.
A wide range of methods can be used for real-time control the position and speed of an ERM. One method is Proportional-Integral-Control. Another method includes time optimal control as described by “Optimal Control Theory: An Introduction”, by Donald E. Kirk, Dover Publications 2004. One real-time control approach is presented below for controlling a set of synchronized ERMs. The approach is written for use with a discrete sensor, but can also be applied with a continuous sensor. When a continuous sensor is used, the dynamic performance of the system can be improved by more accurately updating the commands to the motor continuously.
An exemplary control approach for a system with M ERMs is now discussed. For each ERM for i=1 to M, define the desired frequency, ωdes,i, and desired phase, φdes,i. The desired direction of rotation is defined as dirdes,i=sign(ωdes,i). Initialize the following variables:
a. Time, t=0
b. Number of revolutions of each ERM, nrevi=0 (for all i)
Next, start motors turning by providing an open-loop command, Vopen
θdes,i=ωdes,itmeas,i+φdes,i
θmeas,i=2πdirinrevi+θsensor
θerror,i=θdes,i−θmeas,i
A control law may be implemented to reduce the position error of each ERM. There are a wide range of control of control approaches in the field of control, including:
V
com,i
=K
p,iθerror,i+KI,i∫θerror,idt+KD,idθerror,i/dt
V
com,i
=V
open
loop,i
+K
p,iθerror,i+KI,i∫θerror,idt+KD,idθerror,i/dt
With all control approaches a bidirectional or unidirectional motor driver could be used. An advantage of using bidirectional motor drivers is that high levels of deceleration can be applied to an ERM by applying a reverse voltage, even if the motor never changes direction of rotation. This approach can reduce the time it takes to synchronize the ERMs. Another advantage of using bidirectional motor drivers is that ERMs could be operated in both counter-rotating and co-rotating modes.
An alternative method of calculating the position error is discussed below. Where the desired force is represented by Aisin(ωit+φi) and the desired position is represented by θ1(t)=ωit+φ1, start all ERMs at open loop voltages corresponding to ω1. Let the motors spin up to speed when ERM 1 passes the sensor so that it starts in phase, then reset the timer so t=0. See Table IV below.
In a digital system, ERM control may include the following. First, set rotation counts per revolution (e.g., 256 or 512). Correct for timer overflow so Δt=t1−ti-1 is always correct. Define ω in terms of rotation counts per timer counts. And use interrupts (or other operations) to avoid missing when an ERM passes by a sensor.
Some embodiments of Synchronized Vibration Devices can be controlled such that the combined force and torque sum to zero. In such an embodiment the force and torques from individual Vibration Actuators balance each other out to generate a net zero force and torque. An advantage of such an embodiment is that Vibration Actuators can be brought up to speed and put into a mode when no vibration effects are generated. When vibration effects are desired, they can be quickly implemented by modifying the phase of the vibration, without the lag for bringing the actuators up to speed. This embodiment is referred to as “Spinning Reserve”, and is analogous to the same term used for kinetic energy in an electric utility power plant that is held in reserve to quickly provide power when needed. The spinning reserve approach allows vibration to be quickly turned on and off. Spinning Reserve embodiments can include ERM actuators that are spinning in such a manner that the combined forces and torque sum to zero. Spinning Reserve embodiments can also include with LRA actuators and other resonant actuators that are vibrating in such a manner that the combined forces and torque sum to zero.
The spinning reserve approach has the advantage of fast on and off response times, but also can require increased power consumption since the vibration actuators are operated even when no overall vibration effects are generated. To reduce the added power consumption, the vibration actuators can be spun up to speed at the first indication that a need for vibration force is imminent. Such indications could be a keystroke, computer mouse motion, user touching a touch-screen, movement detection via a sensor of a game controller, beginning of a game portion where vibration effects are used, or any other event that would indicate that a desired vibration effect would be imminent. In a similar fashion power can be conserved by spinning down and stopping the actuators once the need for vibration is no longer imminent. Indications to spin down the actuators could include passage of a set amount of time where no user input is registered, transition to a new phase of a computer program where vibration effects are no longer needed, or other indication. During the spin up and spin down of the actuators, the actuators can by synchronized so that they operate in a spinning reserve mode and do not generate a combined vibration force. In this fashion, the user will not feel the spin up and spin down of the vibration actuators.
A spinning reserve embodiment with 4 ERMs is shown in
Another method of Synchronized Vibration can be applied to the embodiment shown in
When ERMs are rotating they generate a gyroscopic effect due to the angular inertia of the motor rotor and rotating mass. When the angular velocity of the ERMs is large this gyroscopic effect can be used to generate a haptic sensation in response to changes in orientation of the vibration device. The implementation of spinning reserve as shown in Table V has a gyroscopic effect since all ERMs are rotating in the same direction and their angular inertia combined. The implementation of spinning reserve as shown in Table VI does not have a gyroscopic effect since half the ERMs are rotating in the opposite direction of the other half, and therefore angular inertias cancel each other out when rotational inertias are equal. The mode of implementation of spinning reserve can be selected according to the desired gyroscopic effect.
Another method of Synchronized Vibration can be applied to the embodiment shown in
Another method of Synchronized Vibration can be applied to the embodiment shown in
Indeed Synchronized Vibration can be applied to the embodiment shown in
Another method of Synchronized Vibration can be applied to the embodiment shown in
Another implementation of pure torque can produce an asymmetric torque, where the peak torque in the clockwise direction is larger than the peak torque in the counterclockwise direction, or vice versa. One such asymmetric torque implementation for a 4 ERM configuration could be as shown in Table XI. This is achieved by operating ERMs 1192a and 1192b at twice the frequency of ERMs 1190a and 1190b, and controlling the phase appropriately. For the configuration shown in
Yet another method of Synchronized Vibration can be applied to the embodiment shown in
A wide range of haptic effects can be generated by switching between the various effects described herein. When the ERMs are rotating at the same speed in two different effects, the change between effects (including the no-vibration spinning reserve) can be achieved quickly. In many cases the change in effect only requires a positive or negative phase change of 90 degrees in specific ERMs.
Embodiments with 4 ERMs that are not aligned along the same axis also can generate many useful effects.
The embodiment shown in
As discussed above with regard to
Another embodiment of an interleaved ERM pair is shown in
The performance of almost any vibration device can be improved by applying the methods and embodiments of General Synchronized Vibration discussed herein. This approach toward synchronization allows for a wide range of waveforms to be generated including asymmetric waveforms that generate larger peak forces in one direction than the opposing direction. Applications range from seismic shakers and fruit tree harvesters, to vibratory feeders and miniature vibration applications. The embodiments described herein can replace more expensive actuation devices that are used to generate complex waveforms of vibrations. Such applications include seismic shakers that are simulating specific earthquake profiles, and voice coils that are used to generate complex haptic effects.
Haptic applications described herein can be used to augment any device that has a visual display including computer gaming, television including 3D television, a handheld entertainment system, a smartphone, a desktop computer, a tablet computer, a medical device, a surgical instrument, an endoscope, a heads-up display, and a wristwatch. Implementation of haptic feedback within a system that has a visual display is shown in
As described herein, Vibration Force cues can be generated in specific directions, and these directions can be chosen to correspond to direction that is relevant to an object or event that is being shown on a graphic display.
Moreover, it is be useful to generate haptic cues of directionality for applications where a person does not have visual cues, such as to guide a blind person or applications where vision is obscured or preoccupied with another task. For example, if a person had a handheld device such as a mobile phone that could generate directional haptic cues through vibration, and the mobile phone knew its absolute orientation as it was being held and the orientation the person should be in to move forward to a goal, then the mobile phone could communicate directional haptic cues through vibration (a force, a torque, or a combined force and torque) that corresponded to the direction and magnitude of the change in orientation the person holding the mobile phone needed to make.
The Vibration Devices describe herein can be used to improve the performance of existing devices that use vibration. For example vibration is used in fruit tree harvesting. By allowing the operator to generate complex waveforms and control the direction of vibration a higher yield of ripe fruit could be harvested, while leaving unripe fruit on the tree. Vibratory feeders are used in factory automation, and typically involve a significant amount of trial an error to achieve the desired motion of the parts. By allowing the operator to generate complex waveforms and control the direction of vibration it can be easier to generate the desired part motion and a wider range of parts could be processed with vibratory feeders.
The Vibration Devices described herein allow for a wide and continuous adjustment in areas such as vibration magnitude, frequency, and direction. To improve performance of a Vibration Device, sensor feedback can be used, as shown in
One application is to use General Synchronized Vibration for locomotion.
However, there will generally be no motion in the negative x direction, since the friction threshold is not exceeded. In this fashion, the Vibration Device 1200 will take steps in the positive x direction. The direction of motion along the x axis can be reversed by changing the synchronization of the Vibration Actuators and generating an asymmetric waveform that has a larger peak force in the negative direction. A location device can be made to move in arbitrary directions on a surface 1282 by using a Vibration Device 1200 where the direction of vibration can be controlled on a plane, such as those shown in
Vibration is also used for personal pleasure products such as Jimmyjane's Form 2 Waterproof Rechargeable Vibrator. Vibration is also used for personal massager products such as the HoMedics® Octo-Node™ Mini Massager. Vibration is also used for beauty products such as Estee Lauder's TurboLash and Lancome's Oscillation mascara applicators. INOVA produces the AHV-IV Series Vibrators for Vibroseis seismic exploration. General Synchronized Vibration can be used to improve the performance of such products by allowing the user to customize the vibration waveforms and direction of peak vibration forces.
General Synchronized Vibration may also be used in therapeutic medical applications. For example a Vibration Device could vibrate a patient's stomach to aid in digestion, and the patient or a sensor could determine how to adjust the vibration over time.
Now having developed a foundation of General Synchronized Vibration in the previous section, the architecture for a “Synchronized Array of Vibration Actuators in a Network Topology” (hereinafter “SAVANT”) is now presented to motivate the use of multiple, low-cost actuator components in lieu of a single, high-cost actuator. When using multiple actuators in an array, the system is able to exhibit various modalities which we will refer to as dimensions of the SAVANT architecture. These orthogonal dimensions are: performance, bandwidth, reliability, magnitude, spatial and temporal.
The SAVANT architecture is generically applicable to any type of low-cost actuator, but for the purposes of the present analysis, systems of linear resonant actuators (LRAs) are discussed. It will first be shown that the analysis for multiple, collinear LRAs can be reduced to the analysis of a single LRA driven by the sum of the component LRA forcing functions. Then, example implementations of the different dimensions of SAVANT will be presented and compared with different single-actuator solutions currently available. Finally a discussion of multi-dimensional control effects and sequences of these effects will be presented.
Having developed a foundation of General Synchronized Vibration in the previous section, a new conceptual framework is introduced for creating haptic effects with vibration actuators. This architecture is designed primarily with small, hand-held consumer devices in mind but it is general enough to apply to any device of any size. The basis of the architecture is joining small actuator elements together in different physical geometric configurations, or network topologies, to create a Synchronized Array of Vibration Actuators in a Network Topology—or SAVANT.
The power of SAVANT is three-fold: to synchronize arrays of low-cost, readily available vibration actuators to emulate superlative single actuators; to bring together sets of these emulated high-performance actuators to create almost any desired control effect; and to have an array of vibration actuators that is fault tolerant.
Any array of rigidly or semi-rigidly coupled actuators whose motions and control schemes have been synchronized with the purpose of having characteristics or producing haptic effects beyond the abilities of any single actuator in the array is a SAVANT. Subsets of the set of actuators in a SAVANT are also called SAVANTs as long as they still meet the definition.
While the number of actuators in a SAVANT must be at least two, SAVANTs may be further decomposed into a set of connected SAVANT nodes such that the number of actuators in a SAVANT node must only be at least one. The advantage of representing a SAVANT as a network of SAVANT nodes is that it enables the specification of geometric relationships between the SAVANT nodes. The specification of a SAVANT's nodes as a particular geometrical configuration is defined to be that SAVANT's specific network topology.
Furthermore, the SAVANT node is further defined to be a collection of rigidly or semi-rigidly coupled actuators in close proximity of one another whose resultant vibration effects are designed to appear to emanate from a single spatial point. These groups of actuators are also referred to herein as proximal groups. Groups of actuators that are spatially separated so as to jointly create effects that require non-pointlike origin are referred to herein as distal groups or distal nodes.
The network topology of the actuators in a SAVANT determines how they can be used together. The relevant properties of the SAVANT are the collinearities of the component actuators, the spanning set of displacement vectors and the relative proximities of the nodes.
The division of an array into SAVANT subsets is fluid. A single device may contain a SAVANT having a plurality of synchronized actuators and at any given time these actuators may be functioning in any available capacity. For example a device could have a total of six synchronized actuators: in response to stimulus A the six actuators could be divided into three subsets of two-actuator SAVANTs to produce the resultant control effect α; in response to stimulus B, the six actuators could instead be divided into two subsets of three-actuator SAVANTs to produce the control effect β. By joining together low-cost component actuators to emulate a single actuator with arbitrarily superlative performance characteristics, one also gets haptic capabilities unavailable to devices with unsynchronized vibration actuators, such as directional vibration and asymmetric vibration.
An LRA-type actuator has three performance characteristics that can be improved by combining multiple actuators together: response time, bandwidth and force output. An array of collinear LRA-type actuators can emulate improvement of any of these separately or at the same time. For example, four collinear LRAs could have synchronized control schemes such that they emulate a single component LRA with a faster response time. Alternatively they could be controlled synchronously to emulate a single component LRA with an increased frequency response range, or bandwidth. Or in a completely separate scenario the same four LRAs could be split into two subsets where each subset of two LRAs emulates a single LRA with increased bandwidth and collectively the two subsets work together to emulate faster response times.
Since an array of actuators with a given network topology can work together to emulate any single improved performance characteristic without improving the other two, then in the space of the actuator control schemes we consider these performance modes to be orthogonal. Thus it is possible for a SAVANT to simultaneously be in multiple performance modes, but it is not necessary. Later we will consider many examples of these control modes as well as combinations of them.
Beyond out-performing single actuator elements, arrays of actuators also have available two control modes unique to multiple synchronized actuators. These modes are referred to as spatial and temporal. SAVANTs running in spatial mode can create haptic effects that relate to the user via their position and orientation in space. For instance a set of actuators may work together to create a half-wavelength oscillation or the amplitude of a vibrational effect may change based on the position of the device (per se relatively to another object or positions related to the Earth). In temporal mode, SAVANTs can create vibrational effects that interact with the user to create an awareness of time. These can include asymmetric waveforms created through Fourier synthesis of harmonic forcing functions.
Finally, proximal arrays of collinear actuators have a natural safeguard against individual component failure. Many devices will use haptic effects to protect the wellbeing of their users, often in perilous or extreme environments. It is crucial that the vibration actuators are fault tolerant. One of the ways to achieve this is to build in redundancies for the purposes of reliability. Arrays of actuators that are designed to work together for the purposes of fault tolerant reliability are SAVANTs said to be running in reliability mode.
Because SAVANTs can exhibit these control modalities independently or simultaneously, they may be combined together into a single vector space which is referred to herein as the SAVANT “Control Space.” This space spans the haptic capabilities of sets and/or subsets of actuators. The purpose of introducing this space and its comprising directions is to abstract the capabilities of groups of actuators. The discussion of haptic control schemes can be elevated from “on and off” to sequences of control effects designed to enhance the user experience beyond today's capabilities, while only using low-cost components that are readily available today.
All possible haptic effects (within reason) can be created with the SAVANT architecture. In general, a SAVANT of sufficient size can be thought of as a vibration synthesizer, designed to create arbitrary vibrational output either using predefined control sequences or in response to external information, e.g., user interface or sensor feedback. Generically the SAVANT architecture applies to any type of actuator—and SAVANTs of one actuator type can even emulate another actuator type. For instance, two LRA-type actuators can be synchronized to emulate the output of an ERM-type actuator and vice versa. Given this duality, all control sequences designed e.g. for an LRA-type SAVANT are equally valid for an ERM-type SAVANT where each LRA-type actuator is replaced with two synchronized ERMs designed to emulate an LRA.
As previously stated, for the purpose of this inventive disclosure the examples of specific electronic components are designed for haptic applications of hand-held devices. The SAVANT architecture is not limited to actuators of this dimensional scale. That is to say, SAVANT is intended to be applicable at other dimensional scales with appropriate actuators—for example, an array of MEMS LRA actuators which might use electrostatic forces in place of electromagnetic forces; or arrays of very large LRAs that may be used for seismic exploration. Moreover, the examples discussed herein are based on a relatively small number of actuators but the architecture is consistent for any number of actuators. And finally, though the majority of examples in this text are concerned with homogeneous SAVANTs, it is perfectly acceptable and often desirable to have heterogeneous arrays of actuators. Here the notion of heterogeneity includes both actuators of a similar type with varying characteristics and actuators of different types.
Correspondingly,
Correspondingly,
Correspondingly,
Correspondingly,
Finally,
A. Equation of Motion for an LRA Array
First consider a single LRA. The response function of an LRA is that of a damped harmonic oscillator with a resonant angular frequency ω0, a mass m and a damping ratio ζ. Usually, though, LRAs are labeled by their resonant frequency f0, where ω0=2πf0. Generically, the LRA can be driven with any arbitrary function of time—usually implemented via the methods of pulse-width modulation, or PWM—but for simplicity let us just consider a simple sinusoidal driving force. This simplification is well-motivated by hardware considerations and as shown below, it is still quite general. Thus the equation of motion for a single LRA will be the solution of the differential equation
where ω and φ determine the characteristics of the driving force. If the LRA is starting from rest then the initial conditions are given by x(0)=0, x′(0)=0.
The steady-state maximum amplitude is given by
If we were to have n identical LRAs configured in parallel such that all the vibration directions were oriented along e.g. the x-axis, then each LRA would be governed by its own equation
and the total response of the embedding system, e.g. a phone or game controller, would be proportional to x(t)=x1(t)+x2(t)+ . . . +xn(t). We can reduce the number of equations though by introducing a change of variables. Let
X(t)=x1(t)+x2(t)+ . . . +xn(t) (Eq. 104)
which leads to
X′(t)=x1′(t)+x2′(t)+ . . . +xn′(t) (Eq. 105)
and
X″(t)=x1″(t)+x2″(t)+ . . . +xn″(t). (Eq. 106)
Summing the left-hand sides of Eq. 103 we have
(x1″(t)+x2″(t)+ . . . +xn″(t))+2ζω0(x1′(t)+x2′(t)+ . . . +xn′(t))+ω02(x1(t)+x2(t)+ . . . +xn(t))=X″(t)+2ζω0X′(t)+ω02X(t) (Eq. 107)
which we recognize as the equation of motion for a single simple harmonic oscillator whose position is given by X(t). On the right-hand side we are left with the sum of the individual forcing functions. Generically there is no simplification of the addition of sine functions. Note though that we can trivially deal with anti-parallel components by reversing the sign of their forcing function. Thus our array of n (anti-)parallel LRAs is governed by the single equation
Interestingly, the initial condition for the array of LRAs is just the sum of initial conditions of the individual LRAs:
X(0)=x1(0)+x2(0)+ . . . +xn(0),X′(0)=x1′(0)+x2′(0)+ . . . +xn′(0), (Eq. 109)
This can have unexpected consequences. Consider the case where there is an even number of LRAs with an identical steady-state maximum amplitude and the steady-state motions of each successive pair are out of phase by n-meaning that when 1, 3 and 5 are at A; 2, 4 and 6 are at −A. Even though each individual element is vibrating, the sum of the amplitudes is always zero and there will be no net motion of the embedding system. If one were to change the driving force while the array is in this state, it will have the same response as if it were starting from rest.
B. Analysis of Multiple LRAs
In the following sections we will use LRAs to give example control effects for each of the six dimensions of SAVANT. Since arrays of LRAs are governed by one differential equation, the analysis of multiple LRAs is computationally no different than that of a single LRA. Physically though, there are advantages. If a single LRA can be driven with a maximum driving amplitude F, then the n-LRAs system is effectively a single LRA with a maximum driving amplitude of n×F. The addition of maximum driving amplitudes forms the basis of the performance, bandwidth and magnitude modes.
1. Magnitude Mode
A straightforward consequence of having multiple LRAs in a synchronous topology is that their response amplitudes (and therefore their momentum transfers to the embedding system) simply add together. In the case of two identical, parallel LRAs driven identically, Eq. 108 yields
which is the equation of a single LRA with a maximum driving amplitude of 2 F. Physically this means that if there is a single LRA that can produce a maximum acceleration of 2 g, then two parallel LRAs will produce a maximum acceleration of 4 g; three LRAs could produce 6 g, and so on. This is due to the fact that LRAs are linear systems, as shown in the previous section. This is not the case for rotating actuators such as ERMs, though the methods of SAVANT are still generically applicable to them. The use of multiple actuators to produce vibrational magnitudes greater than the capacity of a single component actuator is denoted herein as a SAVANT running in magnitude mode.
2. Reliability Mode
Having multiple LRAs is in the system allows the designer to build in redundant components. This could be particularly useful especially for medical, scientific or military applications or in situations where the embedding device is habitually used in a rugged environment. When a device contains a group of identical actuators designed for the sole purpose of having built-in redundancy to safeguard against the failure of component actuators, this group of actuators is described as a SAVANT running in reliability mode.
3. Performance Mode
Actuators like LRAs are attractive because they are relatively low-cost, their design and control characteristics are well-understood and because their manufacturing infrastructure is already well-developed. Current trends disfavor the use of these actuators though because of their relatively long response times and narrow bandwidths compared to more exotic actuators-such as piezo-based solutions. By briefly leveraging the increased maximum driving amplitude afforded by an array of LRAs, one can bring the total response time down to the same order of magnitude as the piezo actuators. In the language of the architecture laid out in this work, the use of multiple actuators to effectively emulate a single, high-performance actuator will be referred to as a SAVANT running in performance mode.
To see how a SAVANT in performance mode compares with individual LRAs, the spring characteristics of a single LRA were modeled from data provided by Texas Instruments, Inc. We call this model “MOD1.” The data was taken from an AAC ELV1411A LRA from AAC Technologies Holdings Inc. which has a rated resonant frequency of 150 Hz and is shown in
As shown in this figure, the relative heights and positions of the peaks are determined by the resonant frequency, the driving frequency and the damping ratio. The overall scale for the y-axis is determined by the forcing amplitude and the mass. One can fit the parameters of the spring equation, Eq. 101, by assuming the driving function is at the same frequency as the resonant frequency; i.e. ω=ω0. Since we are only interested in relative response times, the resulting motion may be rescaled by the steady-state maximum amplitude given by Eq. 102. This allows one to easily see the fraction of the steady-state maximum amplitude as a function of time.
The damping ratio was derived by fitting a damped, driven harmonic oscillator with resonant frequency of 150 Hz (driven at the resonance frequency) to the experimental output in
Solving Eq. 101 using the constants for the AAC ELV1411A 150 Hz LRA will give the response of the LRA as a function of time. In
Now consider the effect of two LRAs working together. The most basic control scheme that can be applied is one where at t=0 both LRAs are driven with their maximum forcing amplitudes for some short time τ. Then at t=τ the forcing amplitudes are reduced for each LRA to half the maximum. By running two parallel LRAs together at half their maximum amplitude the resultant steady-state amplitude will equal that of a single LRA driven at the maximum amplitude. This idea trivially generalizes to n LRAs: we initially drive all LRAs at their maximum forcing amplitudes and then after some time the forcing amplitudes are reduced to 1/n; such that the sum of the forcing amplitudes is equal to the maximum forcing amplitude of a single LRA. It is essential that each component is still driven at 1/n, rather than, e.g., driving one at maximum and keeping the others at rest. The reason for this is that undriven LRAs parallel to the driving force will begin to oscillate and act as dampers on the system.
In
By adding a third LRA to the system one can achieve even faster response times. In
Response times for 1-LRA, 2-LRA and 3-LRA systems based on our LRA model, MOD1.
4. Bandwidth Mode
Performance mode leverages multiple actuators to emulate a single actuator with an improved response time. The same emulated increase can also be seen in bandwidth. Amplitude response for a typical LRA drops off exponentially as the driving frequency differs from the resonant frequency. The response amplitudes are additive though; meaning that at any given frequency, the maximum amplitude for an n-LRA system is n times the maximum amplitude of the 1-LRA system. We denote systems of multiple, synchronized actuators controlled in a manner as to emulate a single high-bandwidth actuator as a SAVANT running in bandwidth mode.
In the specific case of the our first LRA model, MOD1, when the driving frequency is less than half of the resonant frequency, the steady-state maximum amplitude drops to roughly ¼ of the maximum resonance amplitude. Thus, with four parallel LRAs one can achieve the steady state maximum amplitude even when the driving force frequency differs greatly from the resonant frequency. In
For the system of four 150 Hz LRAs using our LRA model, MOD1, the maximum amplitude while being driven at 1.5 Hz is still 6% higher than a single LRA being driven at its resonant frequency. The response of the 4-LRA system when driven at 1 Hz is almost 90% of the single-LRA amplitude at resonance.
Thus, rather than continually developing more and more exotic actuator solutions, one can use the SAVANT architecture to emulate an LRA with an arbitrarily large bandwidth and force output and/or arbitrarily short response time by adding together an arbitrary number of LRAs.
5. Spatial Mode
So far we have only considered parallel configurations of LRAs. But by orienting groups of LRAs along different axes and synchronizing their control schemes, we can also produce spatial vibrational effects. Examples of such effects are linear vibrations along any line within the space spanned by the vibration axes and circular or elliptical vibrations in any plane within the vibration-axes space. When the system of LRAs is working to produce a spatial vibrational effect, we say that it is running in spatial mode.
Start by considering the action of a single LRA. An LRA is effectively a spring whose mechanical vibrations are oriented along an axis. When the LRA is embedding inside a larger system, it tends to produce vibrations of that embedding system along the axis of orientation. Now add in another LRA: one whose axis of mechanical vibration is oriented perpendicular to the first LRA. Since any two non-collinear lines span the plane, it is not necessary for the two LRAs to be completely orthogonal, only that they not be completely parallel. We choose orthogonal examples for simplicity but more complicated control schemes for non-orthogonal actuators can be devised using the methods of linear algebra.
Each LRA will be vibrating along its own axis, but will each be applying a force to the embedding system. Since the forces they're applying are vectors, we need to take the vector sum to find the resultant force; and therefore the resultant motion of the embedding system. If these two identical, perpendicular LRAs are being driven by identical forcing functions, then the resulting motion of the embedding object will be sinusoidal in the plane spanned by the two axes of orientation. The motion of the embedding object will have an angular separation of 45° from either axis, effectively bisecting the vibrational axes (see
The angle of the resulting motion can be changed by changing the relative amplitudes of the forcing functions. If we characterize the resulting motion as the angle it makes with the horizontal axis, then any arbitrary linear motion can be achieved with forcing amplitudes proportional to {cos(θ), sin(θ)}, where the first is the forcing amplitude of the horizontal actuator and the second is the forcing amplitude for the vertical actuator. For the example above, we wanted an angle of 45°,
which means that we need to drive the actuators with the same forcing amplitudes. If instead we wanted to make an angle of 135°, i.e. the mirror-flip of the 45° example, we would drive them with amplitudes proportional to
This effectively means we would drive them out of phase by 180°.
The direction of the linear motion can even be made to vary in time. In this case, the forcing amplitudes become proportional to {cos(θ(t)), sin(θ(t))}; where now the angle θ is taken to be a function of time.
In
Instead of forcing the two orthogonal LRAs with the same phase but different amplitudes, we can also produce spatial vibrational effects by forcing them with the same amplitude but different phases. In the case above, forcing them with the same amplitude but relative phases of 180° again produced a linear vibration. Instead if we forced them with the same amplitude but relative phases of 90° we can produce circular vibrations, as shown in
When the amplitudes of the two vibrational directions are different but they are still forced relatively out-of-phase by 90°, the resulting motion is elliptical, like that shown in
The linear and elliptical vibration effects described above are created with proximal SAVANTs: groups of actuators (also known as SAVANT nodes) that are designed to have or appear to have point-like origination. Alternatively, one can create distal SAVANTs; which are which are groups of actuators that are separated physically but still physically attached together so as to create effects originating from multiple points or even extended geometries.
For an example configuration of distal SAVANTs running in spatial mode, consider a bar-like object with uniform mass distribution and two SAVANTs, one placed at either end. Each of the SAVANTs are oriented parallel to each other but perpendicular to the axis-of-symmetry of the object. If the SAVANTs are forced with the same amplitude but out-of-phase by 180°, they will produce a torque on the object, creating a rotational vibrational effect. In principle any arrangements of non-collinear (non-coplanar) LRA orientations will span 2-space (3-space), but maximal orientations will provide the easiest orientations. For proximal systems these will be orthogonal orientations; distal systems are often best implemented by orthogonal, triangular and tetrahedral configurations. Orientations along the edges of higher-vertex Platonic solids (e.g. a cube, an octahedron, etc.) could also produce robust haptic possibilities.
The above examples of the line, circle and ellipse vibration effects are members of the set of Lissajous curves (see
These control effects may have parameters which control the geometric transformations, for example: rotation, scaling and reflection. The parameters may be constant or vary during the effect. The parameters may correspond to real-world events, such as having a consumer electronic device containing a SAVANT, such as a remote control, generate a circular vibration that scales in magnitude based on its proximity to a fixed point in space. Alternatively, a parameter may vary with the distance to a real moving target, or a virtual moving target may only exist as a computer-generated object that is rendered haptically, and which may displayed optionally simultaneously in other sensory modalities for example vision or audition.
In many instances of designing real-world devices, the designer may be required to fit the physical components of a SAVANT into a form factor that does not allow optimum orientations. However, as long as the displacement directions (or axes of rotation for ERM-type SAVANTs) are not collinear then one can still create control effects that span the plane by decomposing the motion vectors into orthogonal components using the methods of linear algebra. An example of this might be a hand-held controller (such as the Xbox 360 Wireless Controller from Microsoft Corporation) that includes two non-collinear ERMs whose design placement maximizes the user's proximity to the actuators. In this case the axes of rotation of the ERMs are not orthogonal nor are they collinear. Thus to create synchronized control effects for these two ERMs one must first decompose the relevant vectors into orthogonal components and then refine the orthogonal actuator control schemes accordingly.
6. Temporal Mode
All of the SAVANT systems explored thus far have been homogeneous systems. We can also consider the possibilities offered by heterogeneous SAVANTs. For example, consider a system of two parallel LRAs: one with a resonant frequency of 175 Hz and one with a resonant frequency of 180 Hz. By driving them separately at their resonant frequencies, the resulting steady state motion will have a beat pattern, as shown in
Generically the superposition of two oscillators oscillating at two different frequencies will result in a beat pattern. If the two frequencies are integer multiples of one another then the oscillators can be considered as part of a Fourier series. Fourier synthesis of multiple actuators driven at various harmonics of a given fundamental enables a device to approximate any (finite and bounded) vibrational output via Fourier decomposition. For example,
Prior to the introduction of the General Synchronized Vibration approach as described above and the SAVANT architecture, as described here, the capability to generate haptic vibration waveforms with many harmonics has been extremely limited due to the cost and availability of high bandwidth actuators such as Electro-active Polymers. But by creating synchronized systems of multiple lower-cost vibration actuators, one can leverage the increased bandwidth (see Section 3.2.4) to approximate arbitrary vibrational output by: computing the Fourier series of the function matching the desired output; truncating the series at the desired approximation; and then matching each term in the approximation to a SAVANT.
In the example of the Sawtooth wave above, instead of having five actuators—each with different resonant frequencies-one could instead have five SAVANTs. Each SAVANT would correspond to a term in the Fourier series approximation and each would be designed to provide the appropriate amplitude at the corresponding driving frequency. For example, the first term in the series is
where t is measured in milliseconds and the amplitude of 2 means twice the steady state maximum amplitude of the single 150 Hz LRA. Rather than building an LRA specifically designed to give the appropriate amplitude when driven at the frequency, a SAVANT of eight 150 HZ LRAs could provide the necessary output. The eight LRAs would effectively be a SAVANT running in magnitude and bandwidth modes. The remaining terms in the series approximation would each be created by a SAVANT in the same fashion.
The bandwidth gains from just one extra parallel LRA are significant compared to the single LRA. In
In Section II above, we developed some of the individual advantages multiple actuator systems have over single actuators. We now describe how those advantages can be made to work together and lay the framework for how to create a SAVANT system that will produce any desired vibrational output. Any possible vibrational effect can be decomposed into the 6-dimensional control space of the SAVANT architecture. Vibrational effects are only limited by the number and relative orientations of actuators in the SAVANT. The relative orientations of the actuators in a SAVANT will dictate the spatial and temporal characteristics while the number of actuators oriented together in a given direction will determine the performance, bandwidth, magnitude and reliability characteristics.
We define a “control effect” as a set of predetermined sequences of control signals for each actuator in the array, such as the example effects in Sections II(B)(1)-(6) above. They can be triggered by a user interface with the device or by internal triggers, such as information from on-board sensors. Running a SAVANT in a single mode constitutes a control effect which makes use of a single dimension of the 6-dimensional control space. It is easy to construct control effects which simultaneously make use of multiple dimensions of the control space. We refer to these as multi-dimensional control effects.
h-Pulse
Control effects leverage the power of multiple actuators to produce desired mechanical responses without the limitations inherent to single actuators. Let us look at an example for the familiar 3-LRA case:
When the optimal response time control sequence outlined in Section II(B)(3) is used in conjunction with an optimal braking strategy, the resultant waveform is a sequence of an integer number of half-wavelengths. This entire control effect is referred to as an “h-pulse.” An h-pulse is defined such that the system starts from rest, vibrates at the maximum amplitude for some time (with no ramp-up time) and then immediately stops vibrating. In
Since the h-pulse control effect must go from maximum mechanical vibration to no vibration, it can have any duration that is an integer multiple of half-wavelengths. For a 150 Hz LRA, since there are two half-wavelengths per cycle, that means one can create h-pulses with durations n×3.33 ms, where n is any integer. This duration can be changed by using pairs of LRAs running in bandwidth mode and driving the SAVANTs at lower frequencies.
We can arbitrarily rescale an h-pulse by rescaling all of the forcing amplitudes in the control sequence by some scaling factor. This will allow us to have h-pulses of any arbitrary mechanical vibrational amplitude. For instance, in
We can use sequences of scaled h-pulses to create an amplitude seeking control scheme, as shown in
The negative amplitudes can be implemented with positive forcing amplitudes but changes in the forcing phase by 180°. The forcing functions are turned off at t=25.5 ms.
It is possible to create amplitude seeking control sequences with even less time between pulses, but due to the overlap from previous pulses it requires a more detailed algorithm analysis.
A simple example of a multi-dimensional control effect is performance magnitude (see the discussion below for an explanation of the tensor product notation). The purpose of performance mode is to have a faster response time than a single actuator; the purpose of magnitude mode is to have a stronger mechanical vibration than a single actuator. We can combine these modes when we want to mimic a single actuator that is both faster and stronger than any available component actuator. For the specific case of the 150 Hz LRA discussed above, it was found that the optimal response time required 3 LRAs. Let us then construct a system with 6 LRAs, all oriented along the same axis. We want to position the LRAs as tightly as possible so that the resulting effect will be as point-like as possible. To achieve the performance magnitude control effect (assuming the LRAs are initially at rest):
1) Drive each LRA with a sinusoidal forcing function at the maximum amplitude. The phase won't affect the results much.
2) After some pre-determined optimal time r, change the forcing amplitudes to ⅙ of the maximum amplitude. For the AAC ELV1411A 150 Hz LRA this optimal time is T=2.57 ms.
3) After the desired vibration duration, stop forcing the LRAs. The vibration will damp out in the same time it would take a single LRA to damp out. Alternatively one could apply a braking method.
We note that the control schemes can generically be broken up into two phases: intervals where the SAVANT is outperforming a single component actuator and intervals where the SAVANT is emulating a single component actuator.
We can use performance mode to create extremely fast response and braking times and these allows us to create scaled h-pulses. We can concatenate sequences of these scaled h-pulses to create haptic gradients. These gradients can be scripted effects triggered by sensor information or controlled by a user interface such as a touchscreen. Relying on peoples' inherent ability to detect gradients, these systems could be used as input devices or as devices that give location feedback for the vision impaired. We can make the mechanical output of these gradients arbitrarily large by using multiple 3-LRA systems, effectively leveraging the magnitude mode.
The forcing functions are turned off at t=257.53 ms.
The widths of the single-peak h-pulses described in the Amplitude Seeking subsection were set by the driving frequency. Those h-pulses were created by a SAVANT composed of three parallel LRAs. By adding another set of three parallel LRAs we can increase the vibrational magnitude and bandwidth of the SAVANTs. This will allow the SAVANTs to be driven at lower frequencies while still maintaining on-resonance amplitudes. In
Even though the MOD1 LRAs in this group are being driven at ⅙th of their resonance frequency, their total vibration amplitude is still greater than a single LRA based on our LRA model, MOD1, vibrating at resonance. Note that the total force output of this group of LRAs based on our LRA model, MOD1, is not comparable to that of a single model LRA vibrating at resonance because the force output scales with the square of the vibration frequency. This control scheme is an example of SAVANTs utilizing bandwidth, magnitude and performance modes simultaneously. From the example multi-dimensional control schemes above that, given enough actuators, it is possible to simultaneously control a SAVANT in any subset of the six modes of the SAVANT architecture.
As mentioned above, a SAVANT may incorporate a wide range of vibration actuators including a linear resonant actuator which has a moving mass that oscillates back and forth along a linear path. Other actuators that are useful in a SAVANT include the actuators where the mass is constrained to rotate about a particular vibration axis, following a circular or semi-circular path. These rotational actuators include Eccentric Rotating Mass actuators, Pivoting Mass actuators, and Rocking Mass Actuators as have been introduced earlier in this disclosure. While a single linear resonant actuator can impart a force on the mounting plate it is attached to, a single rotational actuator can impart a torque onto the mounting plate it is attached to. As explained previously in this disclosure, the torques generated by one or more rotating vibration actuators when added with torques generated by one or more counter-rotating vibrating actuators can sum to a net force upon a mounting plate, for example in cases when the axes of rotation of the rotational actuators are arranged collinearly.
Current controllers, such as Nintendo's Wii Remote Plus motion controller and Sony Computer Entertainment's PlayStation Move motion controller, could be augmented at little cost to include a SAVANT that provides additional haptic cues and vibrations. These could be in addition to or instead of the ERMs currently in the devices. Though the incremental cost of adding controllers is small, the potential revenue from the expanded possibility of titles could be very high. Moreover, as other companies move towards controller-less motion controlled gaming and computing, haptic feedback provides an advantage for hand-held controllers. At the same time, it is possible though to develop wearable haptic devices, such as wristbands or belts incorporating SAVANTs, which provide spatial and directional feedback. These devices could be in addition to or in lieu of a hand-held controller.
Other wearable applications include a SAVANT incorporated into a vibration device contained within a wristband, an armband or a leg band. Still other examples of wearable applications include a SAVANT incorporated into a vibration device contained within wearable accessories such as a pair of eyeglasses, a pair of headphones or a hearing aid. Still further applications could include incorporating a SAVANT into a vibration device that is used for providing haptic feedback in a handheld stylus drawing or writing or pointing tasks.
Furthermore, SAVANTs can be incorporated into personal pleasure devices to increase the range of haptic vibration sensations for a person's body, for usage of such haptic vibration devices either externally or internally in relation to a person's body, or both. A SAVANT may be used for other hand tools and devices that are commonly used in construction; for example screwdrivers, hand-drills; pliers; and wrenches.
Another application might be a SAVANT in a device that augments reality for a non-sensory impaired person, or alternatively in a device that substitutes vibratory feedback and sensations for sensory modalities for which a person may have a deficit such as vision or hearing.
SAVANTs may be used to telepresence activities, such that a parent who is located in one city is able to hold a SAVANT enabled device, such as a game controller, that produces vibrations that correspond and convey, for example, to the respiration of the parent's child located in another city, or the heartbeat of a parent conveyed to the parent's child to enable a parent-child connection. A vibration device incorporating a SAVANT may be used to help generate calming vibration patterns for a person having Autism Spectrum Disorder. SAVANTs may also be used to generate vibrations in children's toys, for example inside plush toys, such as a teddy bear.
The SAVANT architecture is intentionally designed as a scalable network topology such that a first vibration device with a first embedded SAVANT may physically and logically interface with a second vibration device with a second embedded SAVANT such that the vibration controllers of both vibration devices could share sensors, data and control to establish a larger SAVANT device. In this fashion, the SAVANTs embedded inside various devices may be considered as modular vibration units that can be attached together to form larger SAVANTs with different and often more robust capabilities.
A. Discussion of Optimal Control Methods
It is clear from
And after the switching time τ, the left-hand side of Eq. 111 is merely rescaled by a factor of 1/n.
(Note that for all of the analysis in Section 3.2.3, we've only considered sinusoidal forcing functions with the phase φ=0. This phase will give you the fastest 3-LRA response because it allows the system to reach the maximum amplitude in the first half-cycle. For a 2-LRA system though, driving functions with a phase φ=n/2 give a slightly faster 90% max amplitude response time of roughly 4.8 ms.)
It is well known from the theory of linear differential equations that a sinusoidally-driven, damped harmonic oscillator has a response function whose frequency and phase are determined solely by the oscillator characteristics and the frequency and phase of the driving function. Additional LRAs only change the amplitude of the driving function (Eq. 111) and we′re only considering identically LRAs in this particular analysis. Therefore, it is impossible to change the position of the first peak by adding or removing LRAs from the system. Hence, since the 3-LRA system has its first peak at maximum amplitude, the control method we propose here is the optimal control method, within the subset of control methods where each LRA is driven by a sinusoidal function with frequency ω=ω0.
This analysis assumes that the maximum allowable driving amplitude is the steady-state maximum amplitude. Many actuators can be “over-driven” though; such that they can be driven beyond their steady-state maximum amplitude for a brief period of time. If this is a possibility then the 3-LRA optimal control scheme is equivalent to a 2-LRA control scheme where they are initially driven at 1.5×steady-state maximum amplitude or a single LRA that is briefly driven at 3×steady-state maximum amplitude.
1. Discussion of the Frequency and Amplitude Response Functions
When a harmonic oscillator-type vibration actuator is driven by a constant sinusoidal external force there are two functions that characterize the response of the vibration actuator. The first is the amplitude response, defined as how the amplitude of the resulting motion increases or decreases with time in the presence of an external driving force. For the previously discussed LRA model, MOD1, the vibration actuator reaches 10%, 50% and 90% of its maximum amplitude in roughly 1.53 ms, 6.05 ms and 19.75 ms respectively. Alternatively one could say that these happen in the first, second and sixth half-wavelength. It is desirable to achieve a faster amplitude response.
The second important relationship is how the amplitude responds to the driving force frequency. This relationship is called the bandwidth of the vibration actuator. We shall denote this as the “frequency response”. Typically the amplitude responds maximally to the resonant frequency and the response diminishes as the driving force frequency diverges from the resonant frequency. Using the same 150 Hz LRA as mentioned above, the maximum amplitude response happens for a sinusoidal driving force with a frequency of 150 Hz, while a driving force with frequency 105 Hz only produces an amplitude of roughly half the maximum.
Each response function mentioned above is the result of inherent physical limitations associated with harmonic oscillators. These natural limitations of the vibration actuators can be mitigated by employing multiple vibration actuators in parallel. Without loss of generality we shall consider only identical vibration actuators though all that is discussed applies to a heterogeneous population of vibration actuators as well.
For example, when driven at resonance our model of an LRA, MOD1, reaches about 33% of its maximum amplitude in the first quarter-wavelength. Leveraging this fact, one can drive of our MOD1 model LRAs together at resonance and after one quarter-wavelength the summed response amplitude of the three LRAs will roughly be the same the maximum amplitude of any single MOD1 model LRA. Thus we say that these three LRAs can emulate a single LRA that has the maximum amplitude response in minimal time (that is to say, a quarter-wavelength, since for a harmonic oscillator starting from rest and driven by a sinusoidal force, the first quarter-wavelength corresponds to the first inflection point and therefore the first extremum of the motion).
The same approach can be applied to improving the frequency responses to overcome bandwidth limitations of any individual vibration actuator. Since a single MOD1 LRA responds to a 105 Hz driving force with roughly half its maximum possible amplitude, by driving two MOD1 LRAs together one can emulate the single LRA on-resonance amplitude even when driven at 105 Hz.
When one employs a collection of vibration actuators together to emulate a virtual vibration actuator possessing amplitude and/or frequency responses superior to any component vibration actuator in the collection, we denote this as running a SAVANT in performance and/or bandwidth mode respectively. A wide gamut of vibration output patterns can be built from amalgamations and concatenations of performance and bandwidth modes. These output patterns include, but are not limited to: immediate cessation of vibrations; discrete gradients of constant amplitude; and single, unidirectional h-pulses. Various scenarios and examples of control strategies are discussed below.
1) Combining multiple vibration actuators to emulate a vibration actuator with an amplitude response faster than any component vibration actuator. When the virtual vibration actuator goes from zero amplitude to its maximum amplitude within one quarter-wavelength. We denote this vibrational output as optimal amplitude response and the corresponding control strategy as the SAVANT OAR Control Strategy. When the virtual vibration actuator goes from its maximum amplitude to zero amplitude within one quarter-wavelength. We denote this vibrational output as optimal braking and the corresponding control strategy as the SAVANT OB Control Strategy.
2) Combining multiple vibration actuators to emulate a vibration actuator with a frequency response greater than any component vibration actuator, for any given sinusoidal driving force frequency.
3) Combining multiple vibration actuators to emulate a virtual vibration actuator that undergoes optimal amplitude response immediately followed by optimal damping. This effectively mimics a single vibration actuator that exhibits one half-wavelength of sinusoidal motion. We denote this vibrational output as an h-pulse and the corresponding control strategy as the SAVANT HP Control Strategy.
4) Combining multiple vibration actuators to emulate a virtual vibration actuator that exhibits successive h-pulses of arbitrary amplitudes. We denote this vibrational output as amplitude seeking and the corresponding control strategy as the SAVANT AS Control Strategy.
5) Combining multiple vibration actuators to emulate a virtual vibration actuator that undergoes optimal amplitude response followed by constant sinusoidal motion for N>1 half-wavelengths followed by optimal damping. This effectively mimics a single vibration actuator that exhibits N half-wavelength of sinusoidal motion with no periods of reduced amplitude at the onset or offset. We denote this vibrational output as an h-pulse and the corresponding control strategy as the SAVANT IMP Control Strategy.
6) Combining multiple vibration actuators to emulate a virtual vibration actuator that generates a sequence of h-pulses such that successive h-pulses differ in amplitude. The changes in amplitude may or may not be associated with information external to the vibration actuators, such as dynamic position or orientation information. We denote this vibrational output as a vibrational gradient and the corresponding control strategy as the SAVANT VG Control Strategy.
7) Combining multiple vibration actuators to emulate a virtual vibration actuator that exhibits a half-wavelength oscillation of arbitrary width. We denote this vibrational output as an elongated h-pulse and the corresponding control strategy as the SAVANT EHP Control Strategy.
8) Combining multiple vibration actuators to emulate a virtual vibration actuator that exhibits a superposition or sequential concatenation of any one or more of the above mentioned control sequences. This would include for example a control sequence consisting of a sequence of h-pulses with monotonically increasing amplitudes followed by an h-pulse of a given amplitude and duration followed by a sequence of h-pulses with monotonically decreasing amplitudes. This vibrational output is a template for haptically emulating the tactile feedback of a mechanical button press.
2. Alternative LRA-Type Actuators
In the above analysis only a fitted model from data of the AAC ELV1411A 150 Hz LRA has been considered. There are many types of LRAs on the market today though, so it is instructive to test the robustness of the SAVANT architecture for different actuators. One can take same data from
Response times for 1-LRA, 2-LRA and 3-LRA systems based on fitted model of a 175 Hz LRA.
3. Optimal Braking Methods
For a given control effect, it is possible to predetermine the optimal braking strategy such that the effect can be halted as quickly as possible. This will usually involve using a forcing (braking) function that is 180° out-of-phase with respect to the initial forcing function. For the familiar case of the our model LRA, MOD1, the optimal braking method to go from maximum mechanical vibration to effectively zero mechanical vibration is shown in
4. Example Operational Process
An example process according to the above is presented by the following steps
Step 1) Select a desired output waveform.
Step 2) Define a collection of harmonic oscillators to emulate the desired waveform.
Step 3) Set up the equation of motion for the collection of harmonic oscillators, with each driven by its own input function. For any set of identical oscillators this reduces to a single equation driven by the sum of the relevant component input functions. Each discontinuous change in the desired output waveform will generically correspond to a discontinuous change in the input functions. For harmonic oscillators with resonant frequency, f0, the times at which these changes in the input function should happen is generically of the order ½nf0 before each discontinuity.
Step 4) Solve the equation of motion with a defined set of initial conditions. For a collection of n oscillators trying to emulate a single oscillator with maximum amplitude A, typical initial conditions for various desired effects are: +m A for immediate maximum amplitude; −m A for immediate minimum amplitude (stopping or braking); +A for steady state A; 0 for no amplitude. The necessary number of oscillators needed in order to immediately reach the emulated maximum amplitude within half a wavelength is defined by the characteristic amplitude response function for the oscillator. For our model LRA, MOD1, this number is 3 because in half of a wavelength that particular LRA model has reached about 33% of its maximum amplitude.
Step 5) Slowly vary the amplitudes and/or discontinuity times in the input function until the solution matches the desired output waveform to a sufficient degree of accuracy. Computational tools such as Java applets or Mathematica DynamicModules from Wolfram Research can facilitate this process by enabling smooth manipulation of the input function parameters, as shown in
5. Tensor Product Notation
The “circle times” symbol used in Section 4, , is a symbol used to indicate the tensor product of vector spaces. We are using this notation in a similar fashion to how it is used in quantum mechanics. In quantum mechanics the tensor product is used to describe the resulting multi-particle states available to two or more interacting or entangled particles. If one particle is in state a and another is in state b, the two-particle state would be labeled by a b. It represents all possible multi-particle states available given the two particles that make up the state. In the case of SAVANT, each SAVANT is like a quantum particle with available states and the tensor product of those SAVANTs defines the vector space of control effects available to the system.
For example, consider a collection of six parallel LRAs. We can choose to group these LRAs into two groups of three. Each group of three will be referred to as a SAVANT. We can individually (and independently) run each SAVANT in performance mode to emulate a single LRA with enhanced response time. If we choose to synchronize the control of each SAVANT though, such that they are both driven in performance mode at the same time and with the same phase, we would effectively be running the two SAVANTs in magnitude mode. To denote the fact that the individual LRAs in simultaneously in both the performance “state” and the magnitude “state”, we would say that they are being driven in performance magnitude.
The notation is used for convenience and is not intended to be completely analogous to its usage in tensor algebra.
Various reference materials are mentioned below, and are wholly incorporated by reference here. The reference materials include the following. The white paper from Immersion Corporation, entitled “Haptics in Touchscreen Hand-Held Devices,” dated April 2012. This white paper describes in Section 3.1 four types of actuators: Eccentric Rotating Mass Actuators (ERMs), Linear Resonant Actuators (LRAs), Piezo Modules, and Electro-Active Polymer Actuators (EAPs). The SAVANT architecture can be used with all of these types of actuators, and various instantiations of each. The monograph, “Engineering Haptic Devices: A Beginner's guide for Engineers,” Thorsten A. Kern, editor, published by Springer-Verlag, copyright 2009.
The monograph, “Vibrations and Waves,” by A. P. French, published by W. W. Norton & Company; 1 edition (1971).
The monograph, “Human Haptic Perception: Basics and Applications,” edited by Martin Grunwald, published by Birkhauser Verlag; (2008).
The monograph, “Feedback and Control for Everyone” by Pedro Albertos and Iven Mareels, published by Springer-Verlag; (2010).
The blogpost, “Enabling high-definition haptics: introducing piezo actuators,” by Eric Siegel of Texas Instruments.
The data sheet, “DRV 8601: Haptic Driver for DC Motors (ERMs) and Linear Vibrators (LRAs) with Ultra-Fast Turn-On,” from Texas Instruments Incorporated.
The World Wide Web article “How To Disassemble an Xbox 360 Wireless Controller” from instructables.com.
The following application notes from Precision Microdrives Limited: “AB-002: Discrete H-bridge For Enhanced Vibration Control” and “AB-003: Driving Linear Resonance Vibration Actuators”.
Furthermore, the reference by Eric W. Weisstein entitled “Lissajous Curve,” from MathWorld—A Wolfram Web Resource.
If there is a conflict or inconsistency between material in the instant specification and any discussion in the aforementioned references, then the specification dominates. This includes any conflicts or inconsistencies with regard to definitions, concepts, jargon, use of language, terminology or the like.
Although aspects of the disclosure have been described with reference to particular embodiments, it is to be understood that these embodiments are merely illustrative of the principles and applications of the present disclosure. It is therefore to be understood that numerous modifications may be made to the illustrative embodiments and that other arrangements may be devised without departing from the spirit and scope of the present disclosure as defined by the appended claims. By way of example only, it is possible to vary aspects of the embodiments herein to some degree while achieving the advantages of the Synchronized Array of Vibration Actuators in a Network Topology architecture and other benefits of the disclosure.
The present invention enjoys wide industrial applicability including, but not limited to, handheld or wearable devices providing haptic sensations or feedback to a user.
This application claims the benefit of the filing date of U.S. Provisional Patent Application No. 61/607,092, filed Mar. 6, 2012 and entitled SYNCHRONIZED ARRAY OF VIBRATION ACTUATORS IN A NETWORK TOPOLOGY, the entire disclosure of which is hereby expressly incorporated by reference herein. This application is also a continuation-in-part of U.S. patent application Ser. No. 13/422,453, filed Mar. 16, 2012 and entitled ASYMMETRIC AND GENERAL VIBRATION WAVEFORMS FROM MULTIPLE SYNCHRONIZED VIBRATION ACTUATORS, which is a continuation-in-part of U.S. patent application Ser. No. 13/030,663, filed Feb. 18, 2011, and entitled SYNCHRONIZED VIBRATION DEVICE FOR HAPTIC FEEDBACK, which is a continuation of U.S. application Ser. No. 11/476,436, filed Jun. 27, 2006, issued on Apr. 5, 2011 as U.S. Pat. No. 7,919,945, which claims the benefit of the filing date of U.S. Provisional Patent Application No. 60/694,468 filed Jun. 27, 2005 and entitled SYNCHRONIZED VIBRATION DEVICE FOR HAPTIC FEEDBACK, the entire disclosures of which are hereby expressly incorporated by reference herein. This application also claims the benefit of the filing dates of U.S. Provisional Patent Application No. 61/453,739, filed Mar. 17, 2011 and entitled ASYMMETRIC AND GENERAL VIBRATION WAVEFORMS FROM MULTIPLE SYNCHRONIZED VIBRATION ACTUATORS, and of U.S. Provisional Patent Application No. 61/511,268, filed Jul. 25, 2011 and entitled ASYMMETRIC AND GENERAL VIBRATION WAVEFORMS FROM MULTIPLE SYNCHRONIZED VIBRATION ACTUATORS, the entire disclosures of which are hereby expressly incorporated by reference herein.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US13/29375 | 3/6/2013 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
61607092 | Mar 2012 | US |