This description relates generally to interface devices for allowing humans to interface with computer systems, and more particularly to low-cost computer interface devices that allow the user to provide input to computer systems and allow computer systems to provide haptic feedback to the user.
A user can interact with an environment displayed by a computer to perform functions and tasks on the computer, such as playing a game, experiencing a simulation or virtual reality environment, using a computer aided design system, operating a graphical user interface (GUI), navigate web pages, etc. Common human-computer interface devices used for such interaction include a mouse, joystick, trackball, gamepad, steering wheel, stylus, tablet, pressure-sensitive sphere, or the like, that is connected to the computer system controlling the displayed environment. Typically, the computer updates the environment in response to the user's manipulation of a physical manipulandum such as a joystick handle or mouse. The computer senses the user's manipulation of the user object through sensors on the interface device that send locative signals to the computer. In other applications, interface devices such as remote controls allow a user to interface with the functions of an electronic device or appliance.
In some interface devices, force (kinesthetic) feedback and/or tactile feedback is also provided to the user, more generally known collectively herein as “haptic feedback.” These types of interface devices can provide physical sensations which are felt by the user manipulating a user manipulandum of the interface device, such as a joystick handle, mouse, wheel, etc. One or more motors or other actuators are coupled to the manipulandum and are connected to the controlling computer system. The computer controls forces on the manipulandum and/or device housing in conjunction and coordinated with displayed events and interactions by sending control signals or commands to the actuators. The computer system can thus convey physical force sensations to the user in conjunction with other supplied feedback as the user is grasping or contacting the interface device or manipulatable object of the interface device.
One problem with current haptic feedback controllers in the home consumer market is the high manufacturing cost of such devices, which makes the devices expensive for the consumer. A large part of this manufacturing expense is due to the inclusion of complex and multiple actuators and corresponding control electronics in the haptic feedback device. In addition, high quality mechanical and force transmission components such as linkages and bearings further add to the cost of the device. Some low cost haptic devices exist, but are highly limited in their ability to output haptic sensations.
A need therefore exists for a haptic feedback device that is lower in cost to manufacture yet offers the user compelling haptic feedback to enhance the interaction with computer applications.
The described subject matter is directed toward providing haptic feedback in an interface device using electroactive polymer (EAP) actuators, which can provide haptic sensations more efficiently and at lower cost than many existing technologies for haptic devices.
More particularly, a haptic feedback interface device is in communication with a host computer implementing a host application program and is manipulated by a user. The interface device includes a sensor device that detects the manipulation of the interface device by the user and outputs sensor signals representative of the manipulation, and an electroactive polymer actuator responsive to input signals and operative to output a force to the user caused by motion of the actuator. The output force provides a haptic sensation to the user. Haptic feedback interface devices using electroactive polymer (EAP) actuators to provide haptic sensations. A haptic feedback interface device is in communication with a host computer and includes a sensor device that detects the manipulation of the interface device by the user and an electroactive polymer actuator responsive to input signals and operative to output a force to the user caused by motion of the actuator. The output force provides a haptic sensation to the user. In an embodiment, a stylus including a body having a first end and a second end opposite from the first end, a moveable member coupled to the body and capable of being in contact with a user's hand; and an electro active polymer actuator coupled to the moveable member, wherein the electroactive polymer moves the moveable member from a first position to a second position with respect to the body upon being activated.
These and other advantages will become apparent to those skilled in the art upon a reading of the following specification and a study of the several figures.
a is a side elevational view of an electroactive polymer element in a bending motion;
b is a top plan view of an electroactive polymer element in a bending motion;
c is a side elevational view of an electroactive polymer sandwich structure providing linear and bending motion;
d is a perspective view of an electroactive polymer element in a cylindrical configuration to provide motion in multiple degrees of freedom;
e is a perspective view of an electroactive polymer structure that provides an area expansion of the element;
f is a perspective view of an electroactive polymer structure in a cylindrical structure that provides axial motion of the element;
a is a side elevational view of a mouse embodiment in which a button is moved in its degree of freedom by an electroactive polymer actuator;
b is a top plan view of a mouse embodiment in which a button is moved laterally by an electroactive polymer actuator;
c is a top plan view of a mouse embodiment in which a button includes an array of multiple electroactive polymer actuators;
a is a schematic view of an embodiment in which an inertial mass is moved linearly by an electroactive polymer actuator to provide inertial sensations;
b is a schematic view of an embodiment in which an inertial mass is moved rotationally by an electroactive polymer actuator to provide inertial sensations;
c is a view of an embodiment in which multiple inertial masses are moved by an electroactive polymer actuators;
a is a side view of a mouse embodiment in which a entire cover portion of the mouse is moved by an electroactive polymer actuator to provide tactile sensations;
b is a top plan view of a mouse embodiment in which side portions of the mouse are moved by an electroactive polymer actuator to provide tactile sensations;
c is a top plan view of a mouse embodiment in which top portions of the mouse are moved by an electroactive polymer actuator to provide tactile sensations;
d is a side view of a mouse embodiment in which a rear top portion of the mouse is moved by an electroactive polymer actuator to provide tactile sensations;
a is a side view of a wheel embodiment in which a rotatable wheel includes an inertial mass that is rotationally moved by an electroactive polymer actuator;
b and 7c illustrate a wheel embodiment including a number of electroactive polymer actuators which expand in area;
d is a perspective view of a wheel embodiment in which a rotatable wheel is braked by an electroactive polymer actuator;
e is a side elevational view of a wheel embodiment in which the entire rotatable wheel is moved laterally and vertically by electroactive polymer actuators;
a is a perspective view of a trackpoint controller in which an electroactive polymer actuator provides haptic feedback in its degrees of freedom;
b and 8c is perspective and side sectional views of a trackpoint controller in which an electroactive polymer actuator provides haptic feedback by linearly moving a poker against the user;
d is a perspective view of a trackpoint controller in which electroactive polymer actuators provide haptic feedback in linear degrees of freedom;
a is a perspective view of a vertical pin moved linearly by an electroactive polymer actuator against a user's finger;
b and 9c are perspective views of arrays of the vertical pins of
d and 9e are side views of a vertical pin moved laterally by an electroactive polymer actuator against a user's finger;
a is a front view of a knob in which an electroactive polymer actuator provides direct rotary forces in the rotary degree of freedom of the knob;
b is a perspective view of a knob in which an electroactive polymer actuator provides braking forces in the rotary degree of freedom of the knob;
a is a side elevational view of a stylus in which an electroactive polymer actuator provides linear forces to the tip of the stylus;
b is a side elevational view of a stylus in which an electroactive polymer actuator provides linear forces to the front end of the stylus;
c is a side elevational view of a stylus in which an electroactive polymer actuator provides forces to a button on the stylus;
d and 14e are side elevational and perspective views of a stylus in which electroactive polymer actuators provide outward forces from the stylus body;
a is a front view of a steering wheel in which an electroactive polymer actuator provides inertial forces;
b is a side view of a joystick handle in which an electroactive polymer actuator provides inertial forces;
c and 15d are perspective and side elevational views of a joystick handle in which electroactive polymer actuators provide braking forces in the degrees of freedom of the joystick handle;
a is a side elevational view of a tactile element in which electroactive polymer actuators provide linear motion to the element; and
b is a side elevational view of a tactile element in which electroactive polymer actuators provide lateral, shear motion to the element.
Host computer system 14 preferably includes a host microprocessor 100, a clock 102, a display screen 26, and an audio output device 104. The host computer also includes other well known components, such as random access memory (RAM), read-only memory (ROM), and input/output (I/O) electronics (not shown).
Host computer 14 can be a personal computer or workstation and may operate under any well-known operating system. Alternatively, host computer system 14 can be one of a variety of home video game console systems commonly connected to a television set or other display, such as systems available from Nintendo, Sega, Sony, or Microsoft. In other embodiments, host computer system 14 can be a “set top box” which can be used, for example, to provide interactive television functions to users, or a “network-” or “internet-computer” which allows users to interact with a local or global network using standard connections and protocols such as used for the Internet and World Wide Web. In other implementations, the host computer can be an appliance or electronic device, vehicle computer, etc.
Host computer 14 preferably implements a host application program with which a user is interacting via interface device 12 which includes haptic feedback functionality. For example, the host application program can be a video game, word processor or spreadsheet, Web page or browser that implements HTML or VRML instructions, scientific analysis program, virtual reality training program or application, or other application program that utilizes input of mouse 12 and outputs force feedback commands to the device 12. Herein, for simplicity, operating systems such as Windows™, MS-DOS, MacOS, Linux, Be, etc. are also referred to as “application programs.” Herein, computer 14 may be referred as providing a “graphical environment,”, which can be a graphical user interface, game, simulation, or other visual environment. The computer displays “graphical objects” or “computer objects,” which are not physical objects, but are logical software unit collections of data and/or procedures that may be displayed as images by computer 14 on display screen 26, as is well known to those skilled in the art. Suitable software drivers which interface such software with computer input/output (I/O) devices are available from Immersion Corporation of San Jose, Calif.
Display device 26 can be included in host computer 14 and can be a standard display screen (LCD, CRT, flat panel, etc.), 3-D goggles, or any other visual output device. Typically, the host application provides images to be displayed on display device 26 and/or other feedback, such as auditory signals. Audio output device 104, such as speakers, is preferably coupled to host microprocessor 100 via amplifiers, filters, and other circuitry well known to those skilled in the art and provides sound output to user when an “audio event” occurs during the implementation of the host application program. Other types of peripherals can also be coupled to host processor 100, such as storage devices (hard disk drive, CD ROM drive, floppy disk drive, etc.), printers, and other input and output devices.
Interface device 12 is coupled to the computer 14 by a bus 20, which communicates signals between device 12 and computer 14 and may also, in some embodiments, provide power to the device 12. In other embodiments, signals can be sent between device 12 and computer 14 by wireless transmission/reception. In some embodiments, the power for the actuator can be supplemented or solely supplied by a power storage device provided on the device, such as a capacitor or one or more batteries. The bus 20 is preferably bi-directional to send signals in either direction between host 14 and device 12. Bus 20 can be a serial interface bus, such as an RS232 serial interface, RS-422, Universal Serial Bus (USB), MIDI, or other protocols well known to those skilled in the art; or a parallel bus or wireless link.
Device 12 can include a local microprocessor 110. Local microprocessor 110 can optionally be included within the housing of device 12 to allow efficient communication with other components of the device. Processor 110 is considered local to device 12, where “local” herein refers to processor 110 being a separate microprocessor from any processors in host computer system 14. “Local” also preferably refers to processor 110 being dedicated to haptic feedback and sensor I/O of device 12. Microprocessor 110 can be provided with software instructions (e.g., firmware) to wait for commands or requests from computer host 14, decode the command or request, and handle/control input and output signals according to the command or request. In addition, processor 110 can operate independently of host computer 14 by reading sensor signals and calculating appropriate forces from those sensor signals, time signals, and stored or relayed instructions selected in accordance with a host command. Suitable microprocessors for use as local microprocessor 110 include lower-end microprocessors as well as more sophisticated force feedback processors such as the Immersion Touchsense Processor. Microprocessor 110 can include one microprocessor chip, multiple processors and/or co-processor chips, and/or digital signal processor (DSP) capability.
Microprocessor 110 can receive signals from sensor 112 and provide signals to actuator 18 in accordance with instructions provided by host computer 14 over bus 20. For example, in a local control embodiment, host computer 14 provides high level supervisory commands to microprocessor 110 over bus 20, and microprocessor 110 decodes the commands and manages low level force control loops to sensors and the actuator in accordance with the high level commands and independently of the host computer 14. This operation is described in greater detail in U.S. Pat. Nos. 5,739,811 and 5,734,373. In the host control loop, force commands are output from the host computer to microprocessor 110 and instruct the microprocessor to output a force or force sensation having specified characteristics. The local microprocessor 110 reports data to the host computer, such as locative data that describes the position of the device in one or more provided degrees of freedom. The data can also describe the states of buttons, switches, etc. The host computer uses the locative data to update executed programs. In the local control loop, actuator signals are provided from the microprocessor 110 to an actuator 18 and sensor signals are provided from the sensor 112 and other input devices 118 to the microprocessor 110. Herein, the term “tactile sensation” refers to either a single force or a sequence of forces output by the actuator 18 which provide a sensation to the user. For example, vibrations, a single jolt, or a texture sensation are all considered tactile sensations. The microprocessor 110 can process inputted sensor signals to determine appropriate output actuator signals by following stored instructions. The microprocessor may use sensor signals in the local determination of forces to be output on the user object, as well as reporting locative data derived from the sensor signals to the host computer.
In yet other embodiments, other hardware can be provided locally to device 12 to provide functionality similar to microprocessor 110. For example, a hardware state machine incorporating fixed logic can be used to provide signals to the actuator 18 and receive sensor signals from sensors 112, and to output tactile signals.
In a different, host-controlled embodiment, host computer 14 can provide low-level force commands over bus 20, which are directly transmitted to the actuator 18 via microprocessor 110 or other circuitry. Host computer 14 thus directly controls and processes all signals to and from the device 12, e.g. the host computer directly controls the forces output by actuator 18 and directly receives sensor signals from sensor 112 and input devices 118. Other embodiments may employ a “hybrid” organization where some types of forces (e.g. closed loop effects) are controlled purely by the local microprocessor, while other types of effects (e.g., open loop effects) may be controlled by the host.
Local memory 122, such as RAM and/or ROM, is preferably coupled to microprocessor 110 in device 12 to store instructions for microprocessor 110 and store temporary and other data. In addition, a local clock 124 can be coupled to the microprocessor 110 to provide timing data, similar to system clock 102 of host computer 14.
Sensors 112 sense the position or motion of the device (e.g. the housing or a manipulandum) in degrees of freedom and provides signals to microprocessor 110 (or host 14) including information representative of the position or motion. Sensors suitable for detecting motion include digital optical encoders, other optical sensor systems, linear optical encoders, potentiometers, optical sensors, velocity sensors, acceleration sensors, strain gauge, or other types of sensors can also be used, and either relative or absolute sensors can be used. Optional sensor interface 114 can be used to convert sensor signals to signals that can be interpreted by the microprocessor 110 and/or host computer system 14, as is well known to those skilled in the art.
Actuator(s) 18 transmits forces to the housing, manipulandum, buttons, or other portion of the device in response to signals received from microprocessor 110 and/or host computer 14. Device 12 preferably includes one or more actuators which are operative to produce forces on the device 12 (or a component thereof) and haptic sensations to the user. The actuator(s) are electroactive polymer (EAP) actuators, which are described in greater detail below, and are “computer-controlled”, e.g., the force output from the actuators is ultimately controlled by signals originating from a controller such as a microprocessor, ASIC, etc. Many types of additional actuators can be used in conjunction with the electroactive polymer actuators described herein, including a rotary DC motors, voice coil actuators, moving magnet actuators, pneumatic/hydraulic actuators, solenoids, speaker voice coils, piezoelectric actuators, passive actuators (brakes), etc. Actuator interface 116 can be optionally connected between actuator 18 and microprocessor 110 to convert signals from microprocessor 110 into signals appropriate to drive actuator 18. Interface 116 can include power amplifiers, switches, digital to analog controllers (DACs), analog to digital controllers (ADCs), and other components, as is well known to those skilled in the art.
In some of the implementations herein, the actuator has the ability to apply short duration force sensation on the housing or manipulandum of the device, or via moving an inertial mass. This short duration force sensation can be described as a “pulse.” The “pulse” can be directed substantially along a particular direction in some embodiments. In some embodiments, the magnitude of the “pulse” can be controlled; the sense of the “pulse” can be controlled, either positive or negative biased; a “periodic force sensation” can be applied, where the periodic sensation can have a magnitude and a frequency, e.g. a sine wave; the periodic sensation can be selectable among a sine wave, square wave, saw-toothed-up wave, saw-toothed-down, and triangle wave; an envelope can be applied to the period signal, allowing for variation in magnitude over time. The wave forms can be “streamed” from the host to the device, as described in applicant's U.S. Pat. No. 6,411,276, or can be conveyed through high level commands that include parameters such as magnitude, frequency, and duration.
Other input devices 118 can be included in device 12 and send input signals to microprocessor 110 or to host 14 when manipulated by the user. Such input devices include buttons, dials, switches, scroll wheels, knobs, or other controls or mechanisms. Power supply 120 can optionally be included in device 12 coupled to actuator interface 116 and/or actuator 18 to provide electrical power to the actuator. or be provided as a separate component. Alternatively, power can be drawn from a power supply separate from device 12, or power can be received across bus 20. Also, received power can be stored and regulated by device 12 and thus used when needed to drive actuator 18 or used in a supplementary fashion.
The interface device 12 can be any of a variety of types; some embodiments are described further below. For example, the device 12 can be a mouse device having planar degrees of freedom, in which the entire housing is moved. Alternatively, a manipulandum on the device, such as a joystick handle, a knob, a steering wheel, a trackball, etc., is moved by the user and tracked by sensors. Device 12 can also be a gamepad, joystick, steering wheel, stylus, touchpad, spherical controller, finger pad, knob, track ball, or other device, some embodiments of which are described below. Alternatively, a hand-held remote control device used to select functions of a television, video cassette recorder, sound stereo, internet or network computer (e.g., Web-TV™) can be used with the haptic feedback components described herein, or a cell phone, personal digital assistant, etc. The forces from the actuator(s) 18 can be applied to the housing of the device 12, and/or a movable manipulandum such as a joystick handle, steering wheel, knob, button, etc.
Electroactive polymers (EAP) are a class of polymers which can be formulated and/or processed to exhibit a wide range of physical, electrical, and electro-optical behaviors and properties.
When activated, such as by an applied voltage, EAP materials can undergo significant physical movement or deformations, typically referred to as electrostriction. These deformations can be along the length, width, thickness, radius, etc. of the material and in some cases can exceed 10% strain. Elastic strains of this magnitude are very unusual in common materials and even more unusual in that they can be fully controlled with the proper electronic systems. Materials in this class can be used to do useful work in a compact, easy to control, low power, fast, and potentially inexpensive package. They are often referred to as “electric muscles” because of these properties. These deformation properties can be used to provide forces to a user in a haptic feedback device.
Many of the materials can also act as high quality sensors, particularly for time-varying (i.e. AC) signals. When mechanically deformed (e.g. by bending, pulling, etc.), most EAP materials develop differential voltages which can be electrically measured. This ability to essentially generate electric potential makes them promising as force, position, velocity, acceleration, pressure, etc. sensors in haptic feedback devices. Many of these materials exhibit bi-directional behavior, and can act as either sensors or actuators, or act simultaneously as both sensors and actuators, depending on system design.
At present, there are four main classes of EAP, each with various advantages, disadvantages, and issues. The four classes, all included in the term “electroactive polymer” herein, are gels, ionic polymers (ionic polymer metal composites or IPMC), conducting polymers, and electrorestrictive polymers. Any of these types of EAP can be used, although some types may be more appropriate for a particular application than other types. A variety of EAP structures are described in the papers, “High-field electrostriction of elastomeric polymer dielectrics for actuator,” by Kornbluh et al., “Electro-mechanics of iono-elastic beams as electrically-controllable artificial muscles,” by M. Shahinpoor, “Polymer Electrolyte Actuator with Gold Electrodes,” by K. Oguro et al., and “Microgripper design using electro-active polymers,” by R. Lumia et al., all SPIE Conf. on Electroactive Polymer Actuators and Devices, SPIE Vol. 3669, 1999.
In a majority of EAP materials, the actuation mechanism is based on the movement of ionic species either in or out of a polymer network. Currently, the most commercially viable of these is the electrostrictive polymer class.
Electrorestrictive polymers presently can be classified in two classes: dielectric and phase transition. Dielectric polymers are typically a sandwich construction of two electrically conductive (and compliant) electrodes with a dielectric polymer in between. At high electric fields (e.g., 100's to 1000's of volts), the attractive force of the electrodes squeezes the intervening dielectric such that significant motion (strain) is induced. In some cases, this strain can be greater than 50%.
Phase transition electrorestrictive materials also exhibit high strain (deformation) in the presence of electric fields, but the mechanism is a ferroelectric-to-paraelectric transformation at the molecular chain level. One example of these materials has been developed by Q. M. Zhang et al. and is electron-irradiated polyvinelidene fluoride-trifluoroethylene (P(VDF-TrFE)) copolymer, described in the paper, “Electromechanical Behavior of Electroactive P(VDF-TrFE) Copolymers”, SPIE Conf. on Electroactive Polymer Actuators and Devices, SPIE Vol. 3669, 1999. When processed, P(VDF-TrFE) exhibits exceptional strain (>10% in some cases), extreme energy density (Joules/cm3), and high physical stiffness (elastic modulus). It is proposed that this class of materials exhibits energy densities exceeding that of traditional piezoceramics (PZT) and magnetorestrictive materials. Therefore, as described, P(VDF-TrFE) may be nearly ideal actuator material, including intrinsic sensing capabilities, for haptic devices.
EAP materials are often derivatives of existing polymers and therefore share common processing steps with these existing products. This commonality makes EAP materials potentially economical to produce in large volume and provides repeatable quality standards. For haptic device applications, EAP materials (particularly P(VDF-TrFE)) have many potential advantages over conventional sensing and actuation methods. For example, the EAP materials have high energy density, rapid response time, customizability (shape and performance characteristics), compactness, easy controllability, low power consumption, high force output and deflections/amount of motion, natural stiffness, both sensing and actuation functions, relatively low raw materials cost, and relatively inexpensive manufacturing cost.
EAP actuators and sensors can be configured in several different ways. Some of these configurations are described below.
Bending: A sandwich/layered “bimorph” structure can be provided which can generate single-axis displacements or forces in two directions. For example,
Linear motion:
Multiple degrees of freedom:
Area expansion:
Axial motion:
Diaphragm: Thin diaphragms can use planar expansion to generate in-plane or out-of-plane deflections, closing of apertures, etc.
The major classes of use contemplated for EAP actuators and sensors in haptic devices are inertial vibration actuators, linear actuators, rotational actuators, brakes, and miscellaneous uses. Many of these classes are described below in the provided example embodiments of haptic devices.
It should be noted that the EAP actuators described in the below embodiments can be controlled by a local microprocessor in accordance with firmware and/or host computer commands or signals, or a host computer can directly control the actuator(s).
Three general types of haptic feedback are described in relation to the mouse embodiment 250; other types are also possible, and all may be implemented with other types of haptic feedback devices (joysticks, trackballs, steering wheels, laptop sensor pads, etc.). The three general types are button haptic feedback, inertial haptic feedback, and housing motion haptic feedback.
a-3c illustrate generally the output of haptic feedback on a button. Button haptic feedback can be provided in several different ways. In
In the top plan view of
c is a top plan view of another button embodiment, where a tactile array 260 of haptic EAP elements 262 can be placed on or a near a button 256. Each EAP element 262 of the array can be individually moved up or down on the z-axis, allowing a variety of sensations to be conveyed to the user who is contacting the array or part of the array while resting a finger on the button. In other embodiments, a 1D array (single line of elements) can be provided instead of the 2-D array shown. EAP tactile arrays are described in greater detail below.
Another general type of haptic feedback is inertial feedback, which involves moving a mass with respect to an inertial ground such that the oscillations are conveyed to the user as vibrations or pulses. Inertial haptic feedback can be provided using EAP actuators.
b illustrates a rotary inertial EAP actuator 280, which includes an EAP element 282 that is configured like a coil to move a mass 284 in a rotational degree of freedom and thus provide rotary inertial forces to a housing or structure to which the actuator is coupled. The inner end 288 of the element 282 can be grounded to provide a reference for the other end of the element which oscillates. For example, the mass 284 can be oscillated approximately about the axis of rotation A, where examples of extreme positions are shown by the dashed lines. The positive and negative connections 286, as with all the embodiments shown with such connections herein, indicate that a signal or waveform can be applied to the EAP actuator to cause it to move.
c shows a multi-axis shaker module 290 which includes three masses M1, M2, and M3, each coupled to an associated EAP actuator structure 292 that is similar to the structure of
Housing motion haptic feedback is another general type of haptic feedback and can also be output using one or more EAP actuators.
b illustrates a mouse 320 including one or more moveable sections 322 provided in or on the side housing 324 of the mouse, where an EAP actuator can be coupled to each moveable section to move it. For example, a flexible material or hinge, such as rubber or flexible plastic, can couple the moveable sections 322 to the rest of the housing 324 to allow the motion. EAP actuators that bend, move linearly, or expand in area can be used to move the sections 322.
In
d shows a mouse 340 including an upper portion 342 of the housing moveable with respect to the remaining housing portion 344 as shown by arrow 346 and driven by an EP actuator, where the user's palm contacts the moveable portion to feel the haptic contact forces. A hinge or other flexure can couple the moveable portion 342 with the base portion 344. Differently-sized portions 342 can be provided in other embodiments.
Ball haptic feedback provides haptic forces acting on a ball, such as a trackball device, a ball used in a sensor mechanism in a mouse device, or other frictional movement device, to output haptic feedback in the degrees of freedom of motion of the interface device. For example, as shown in
Some embodiments of the interface device 12 can include a wheel, such as mouse wheel 254 shown in
In
In
e illustrates a wheel device 430 that uses an EAP actuator to provide lateral motion or forces on the wheel, parallel to the axis of rotation of the wheel. A linearly-moving EAP actuator 432 can be coupled to the rotating axle 434 (or to a member rotatably coupled to the axle) to provide horizontal forces and motion, as indicated by arrow 436, to wheel 438. Also, in some embodiments, a linearly-moving EAP actuator 440 can be coupled to a member as shown to provide a vertical force or motion on the entire wheel device 430 as indicated by arrow 442. These embodiments can also be used with a rotary control knob used in a variety of devices.
Other interface devices 12 can be provided with haptic feedback using EAP actuators. For example, in
In
d shows another embodiment of a trackpoint controller 470, where EAP actuators are used to provide haptic feedback in the normal x-y directions of control of the trackpoint controller. Four linearly-moving EAP actuators 472 are placed at 90 degree increments around a base 474 of the controller to provide linear force and/or motion to the central vertical post 476. The post can be moved linearly by the user in the x- and/or y-directions to control a cursor, value, etc. It should be noted that the embodiments shown in
Tactile arrays are multiple vertical “pins” that form a plane of contact perpendicular to the orientation of the pins at the pin's contact surfaces. The contact surfaces of the pins are contacted by a user's fingers or palm. Each pin can be individually moved perpendicularly to the pin's lengthwise axis, such that collectively the pins can be moved to convey different tactile sensations to the user.
d shows another embodiment 510 using the EAP pins described above. A lateral motion tactile element/array can be provided, where tactile sensations are provided moving pins perpendicular to their lengthwise axes (laterally). Each pin is moved laterally to provide stretching of the user's skin or shear sensations instead of indenting the skin of the user as in the embodiments of
EAP actuators can be used to provide specific forces in particular applications. For example,
Trigger devices can also make use of EAP actuators.
a shows a rotary knob 560 that can be used to control functions in a wide variety of devices. A spiral or coil EAP actuator 562 can be positioned inside the knob so that the EAP actuator exerts a torque on the knob when it is activated. Resistance or force can thus be provided in the rotary degree of freedom of the knob, as indicated by arrow 564, although a knob of limited rotational range should be used.
b illustrates a knob device 570 that includes an EAP actuator. Knob 572 is coupled to a rotating shaft 574, which is coupled to a cylindrical brake member 576 that can include a frictional surface. EAP actuator 578 includes a brake shoe 580 that is moved by the actuator 578 to contact the brake member 576. This engagement provides frictional forces on the shaft 574 and knob 572. This embodiment allows a knob having an unlimited (continuous) rotational range to be used. A linear EAP element can be used, as described in braking embodiments above.
A stylus-shaped interface device can also be provided with an EAP actuator to produce haptic feedback to the user of the stylus. A stylus can be used to point to or select objects on a screen, or draw or write lines by contacting the stylus with a tablet or with a display screen surface, e.g. on Personal Digital Assistants (PDA's), touch screens, graphics tablets, laptop computers, etc. For example,
b shows a different embodiment 620 that causes a front end portion 622 of the stylus to linearly move with respect to the back portion 624 of the stylus. A rubber bellows 626 can be positioned between the moving front portion and the back portion, and an EAP actuator (not shown) can be positioned inside the stylus housing. The EAP actuator can be a linearly-moving element that is coupled to the front end portion 622 to move that portion similarly to moving the tip member as shown in
Other features of a stylus can also be actuated using EAP actuators. In
In
Other devices can also be used with EAP actuators. For example, as shown in
c is a perspective view of a joystick embodiment 680 that provides passive force feedback to the joystick. Joystick handle 682 is placed in apertures of two rotating members 684a and 684b. When the handle 682 is rotated in a direction, the corresponding member 684 rotates as well. Frictional brake disks 686a and 686b are coupled to their associated rotating members 684a and 684b. EAP brakes 688a and 688b provide frictional forces on the disks 686 which causes resistance in the two degrees of freedom of the joystick handle (sensors, not shown, sense the rotational motion of the joystick handle). For example, the EAP brakes can include linearly-moving elements, similar to other brake embodiments described herein.
EAP actuators as disclosed herein can also be used on other types of controllers. For example,
a illustrates an embodiment 720 providing skin tactors using an EAP actuator. Skin tactors are similar to the pin grid arrays described above, in which one or more moving elements contacts a user's skin to provide a tactile sensation. One or more skin tactors can be provided in a haptic glove to engage the user's fingers and palm, in arrays on a vest to engage the user's chest or other body parts, or in other areas that can contact a user's skin. In
b illustrates another embodiment 730 having tactor elements. A linearly-moving EAP actuator 732 is coupled to a support 734. A tactor element 736 is coupled to a member 738 that is coupled to the end of the actuator 732. When the actuator 732 is moved linearly, the tactor element is moved laterally as indicated by arrow 740. This motion stretches the user's skin instead of moving an element into the skin. The grounded surface surrounding the tactor element, as well as the tactor element itself, can include ridges 742 or bumps to engage the user's skin. The stationary ridges on the grounded surface hold an engaged portion of the user's skin in place, while the moving ridges on the tactor element 736 stretch the middle area of the engaged portion of user's skin, creating a highly effective tactile sensation.
Other types of interface devices can employ EAP actuators, such as touchpads on laptop computers, PDA and game device screens used with styluses or fingers, etc., where haptic sensations are output directly on the touchpad or screen. For example, the touchscreens and touchpads disclosed in applicant's U.S. Pat. No. 6,429,846 can be coupled to bending, inertial shaker, or linearly-moving EAP actuators as disclosed herein rather than, for example, piezoelectric actuators. Tactile computer keyboards and keypads (as disclosed in applicant's U.S. Pat. No. 6,693,626) direction pads on gamepads (as disclosed in applicant's U.S. Pat. No. 6,563,487), and other interface devices may be used with the EAP actuators.
While the subject matter has been described in terms of several preferred embodiments, it is contemplated that alterations, permutations and equivalents thereof will become apparent to those skilled in the art upon a reading of the specification and study of the drawings. For example, many different types of haptic sensations can be provided with the actuators. Furthermore, certain terminology has been used for the purposes of descriptive clarity, and not to limit the scope of the claims.
This is a continuation application of U.S. patent application Ser. No. 11/711,400 filed Feb. 26, 2007 by Bruce M. Schena, entitled, “Haptic Devices Using Electroactive Polymers”, which is a continuation of U.S. patent application Ser. No. 09/866,385, filed May 24, 2001 by Bruce M. Schena, entitled, “Haptic Devices Using Electroactive Polymers”, now U.S. Pat. No. 7,196,688 which claims the benefit of U.S. Provisional Patent Application No. 60/206,929, filed May 24, 2000 also by Bruce M. Schena, entitled, “Haptic Feedback Devices Using Electroactive Polymers”.
Number | Date | Country | |
---|---|---|---|
60206929 | May 2000 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 11711400 | Feb 2007 | US |
Child | 12011349 | US | |
Parent | 09866385 | May 2001 | US |
Child | 11711400 | US |