1. Field of the Invention
The present invention relates generally to human-computer interaction, and more particularly, to haptic computer interfaces which measure position/orientation input from a computer user's hand while providing force/torque output to the user's hand.
2. Description of Prior Art
The term “haptics” refers to the human sense of touch. In recent decades, there has been a great deal of attention to providing computer interfaces that, in addition to the usual keyboard and mouse input devices, and visual output provided by the display on a monitor, can also engage the computer user's sense of touch. Generally, these haptic devices have a manipulandum or handle that can be grasped and moved about by the user to provide position input to a computer, in a manner similar to that of a computer mouse. Unlike a mouse, which can be moved in the plane of the desktop [2 degrees of freedom (DOF)], some haptic devices allow translational movement in all 3 DOFs while providing force back to the user's hand, and still others add rotational DOFs which also provide torque feedback. Of particular interest are those haptic devices with 6 DOFs, because 6 DOFs are needed to position and orient a rigid body in space.
Prior art haptic devices fall into two broad categories: i) electromechanical devices which are small robot arms with serial or parallel kinematic configurations (or a combination of serial and parallel aspects), and ii) non-mechanical devices which use principles of magnetic levitation. Haptic devices in the first category have been available commercially for some time from companies such as Sensable Technologies, Woburn, Mass., USA; Immersion, San Jose, Calif., USA; Mimic Technologies Inc., Seattle, Wash., USA; Force Dimension, Nyon, Switzerland; MPB Technologies Inc., Montreal, Quebec, Canada; Quanser, Inc., Markham, Ontario, Canada; Moog-FCS, Nieuw-Vennep, Netherlands; and Haption S. A., Soulge sur Ouette, France. Devices marketed by these and other firms, being electromechanical in nature, necessarily incorporate motors, encoders, links, joints, and transmission elements such as gears, capstans, cables, or belts. Whereas this body of prior art may serve as background for haptic interface devices per se, the present invention achieves similar functional goals through a fundamentally different mechanism, namely, magnetic levitation. Haptics based on magnetic levitation is capable of much higher performance since it can avoid unwanted artifacts associated with electro-mechanical devices.
Magnetic levitation (or magnetic suspension) devices have a long history and depend on various principles for their operation. These include magnetic bearings and magnetic levitation (“maglev”) trains, as well as numerous toys illustrating magnetic levitation. Of particular interest is Downer, et al., U.S. Pat. No. 4,700,094, issued Oct. 13, 1987, which describes a magnetic bearing utilizing Lorentz forces for maintaining the rotation of a flywheel which may be subject to small disturbances. Of tangential interest is Anderson, et al., U.S. Pat. No. 4,156,548, issued May 29, 1979, which describes a magnetic suspension and pointing system utilizing Maxwell forces. Of closest interest is Hollis, U.S. Pat. No. 4,874,998, issued Oct. 17, 1989, which describes a magnetically levitated fine motion robot wrist using Lorentz force actuation with a workspace of several millimeters. None of this art pertains to haptics or haptic devices.
The first use of magnetic levitation principles for a haptic device is disclosed in Hollis and Salcudean, U.S. Pat. No. 5,146,566, issued Sep. 8, 1992. This patent shows a hexagonal levitated body supported by Lorentz forces and using optical position sensors, rendering it capable of six-degree-of-freedom (DOF) motion and force/torque output. It is described as an input/output system for computer user interface, i.e., it describes a haptic device. Further, the invention describes, in general terms, various software elements for connecting and communicating between a computer user's software program and the magnetic levitation device. The device lacks the large workspace, light weight composite levitating element, interchangeable handles, reorientation capability, and automatic software procedures of the present invention.
The paper “Lorentz levitation technology: a new approach to fine motion robotics, teleoperation, haptic interfaces, and vibration isolation,” by R. L. Hollis and S. E. Salcudean, appeared in the International Symposium for Robotics Research, Hidden Valley, Pa., in Oct. 1-3, 1993, and further describes haptic interaction and other applications using magnetic levitation.
A motion scaling tele-operating system with force feedback suitable for microsurgery is disclosed in Salcudean, et al., U.S. Pat. No. 5,382,885, issued Jan. 17, 1995. The system uses a pair of hexagonal magnetic levitation devices in a master/slave arrangement providing haptic feedback to the user. An alternative magnetic levitation tele-operation system with haptic feedback is described in the paper “Design and control of a force-reflecting teleoperation system with magnetically levitated master and wrist,” Salcudean, Wong, and Hollis, IEEE Transactions on Robotics and Automation, Vol. 11, pages 844-858, December, 1995. The paper “Interacting with virtual environments using a magnetic levitation haptic interface,” by P. Berkelman, R. Hollis, and S. Salcudean, in IEEE International Conference on Robotics and Automation, Pittsburgh, August, 1995, pages 2296-2301, further describes haptic interaction between a computer program and a magnetic levitation device. Again, these devices lack the large workspace, light weight composite levitating element, interchangeable handles, reorientation capability, and automatic software procedures of the present invention.
Salcudean, et al., disclose an active joystick with optical position sensing in U.S. Pat. No. 6,195,083 B1, issued Feb. 27, 2001, which has a cubic configuration and very small workspace. This device was planned for commercialization, but never materialized. This device lacked the large workspace, light weight composite levitating element, interchangeable handles, reorientation capability, and automatic software procedures of the present invention. U.S. Pat. No. 5,790,108 issued to Salcudean, et al., on Aug. 4, 1998 describes a specific application of the Lorentz force coils in a hand controller.
The paper “Design of a hemispherical magnetic levitation haptic interface device,” by P. Berkelman, Z. J. Butler, and R. L. Hollis, in the ASME International Mechanical Engineering Congress and Exposition, Atlanta, November 1996, DSC-Vol. 58, pages 483-488, describes a design for a large workspace Lorentz magnetic levitation haptic device. This device lacks the light weight composite levitating element, interchangeable handles, reorientation capability, and automatic software procedures of the present invention.
Watanabe, et al. describe a magnetic actuator with reduced magnetic flux leakage and haptic sense in U.S. Patent Application Publication No. US 2004/0059245 A1, published Mar. 25, 2004 and in U.S. Pat. No. 7,336,006 B2. A similar much earlier design, by R. Hollis, “Ultrafast electrodynamic X, Y, and theta positioning stage,” was disclosed in U.S. Pat. No. 5,153,494, issued Oct. 6, 1992. These devices do not use magnetic levitation.
Li, et al., in U.S. Pat. No. 6,483,499 B1, issued Nov. 19, 2002, disclose a 3D sculpturing input device using a magnetized stylus held by the user. Hu, in U.S. Patent Application Publication No. US 2006/0209019 A1, published Sep. 21, 2006, discloses a magnetic haptic feedback system and methods for virtual reality environments. The system uses a magnetized tool upon which forces are generated with electromagnets. Neither of these devices use magnetic levitation as in the present invention.
The paper “A novel coil configuration to extend the motion range of Lorentz force magnetic levitation devices for haptic interaction,” by P. Berkelman, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, Oct. 29 through Nov. 2, 2007, pages 2107-2112, describes a magnetic levitation haptic device with permanent magnetic circuits and coil design to permit large translational and rotational motion. This device, while having a larger motion range than the present invention, does not have a light weight composite structure, and lacks a viable scheme for providing high resolution position/orientation sensing.
In summary, each of the prior art haptic devices and systems, whether based on electro-mechanical methods or on magnetic levitation methods suffers from one or more limitations which the present invention overcomes.
Accordingly, several objects and advantages of the present invention are given below, where the term “device” refers to the haptic interaction device alone, and the word “system” refers to the combination of the device and its hardware/software controller.
(a) A six-degree-of-freedom haptic device that is free of friction, backlash, link bending, cable or belt stretch, limited encoder resolution, and motor cogging effects which limit the performance of current electro-mechanical haptic devices;
(b) a haptic device based on Lorentz magnetic levitation which has a usable workspace which is much larger than that afforded by previous magnetic levitation devices;
(c) a haptic device which has very high spatial resolution, of the order of 2 micrometers, compared with about 50 micrometers for the most popular electro-mechanical device;
(d) a haptic device which can emulate very high stiffness, of the order of 50 N/mm, compared with about 2 N/mm for the most popular electro-mechanical device;
(e) a haptic device which incorporates high mechanical damping as well as high electrodynamic damping and is free of spurious resonant behavior;
(f) a haptic device with very high position and force bandwidths to engage not only the user's kinesthetic senses, but also to a significant degree the user's cutaneous senses;
(g) a magnetic levitation haptic device that can be readily re-oriented to an attitude which accommodates a person's preferences;
(h) a magnetic levitation haptic device which has a manipulandum or handle which can be easily interchanged with alternate handles;
(i) a magnetic levitation haptic device that incorporates push buttons in the handle which can be used to signal a user's application program;
(j) a six-degree-of-freedom magnetic levitation haptic device which incorporates an additional seventh, grasping degree of freedom;
(k) a magnetic levitation haptic system where the haptic device and haptic controller may be separated and located at a convenient distance from one another;
(l) a magnetic levitation haptic system whose levitated part, termed a flotor, can automatically take-off/land from/to resting configurations for the convenience of the user; and
(m) a magnetic levitation haptic system which can automatically cancel gravitational forces and torques on the levitated part for the convenience of the user.
The invention is a magnetic levitation haptic system (device and controller) with a handle operable by a person which sends position/orientation information to a person's computer, while accepting force/torque commands from the person's computer and applying them to the handle, thereby enabling a person to interact with a computer program using his or her sense of touch. Lorentz levitation permits the device part of the system to be free of static friction, link bending, encoder resolutions, motor cogging and backlash effects present in traditional electro-mechanical haptic devices. The handle may be moved about in six degrees of freedom, while the person using the device feels six-degree-of-freedom forces and torques on the handle. The invention may be part of a virtual reality system, or connected to a remote robot system capable of measuring forces and torques in the remote environment. Very high performance is obtained, in part, through having a light weight composite levitated element with high mechanical and electrodynamic damping. The device's handle is removable and interchangeable with other handles of various forms and functionality as may be required by the application. The system accommodates a particular kind of “grasping” handle which constitutes an additional seventh degree of freedom, for example a pinching motion between thumb and forefinger. The device can be readily rotated by the user to any desired attitude according to the user's preferences. The system includes an Application Programming Interface and algorithms in the controller for automatically taking off and landing the handle, and for automatically finding and canceling gravitational forces and torques on the levitated part. Intended applications of the invention include virtual surgery and dentistry, data visualization, remote robot control, micro- and nano-manipulation, microsurgery, and character animation.
The features of the invention believed to be novel and the elements characteristic of the invention are set forth with particularity in the appended claims. The invention itself, however, both as to organization and method of operation, may best be understood by reference to the detailed description which follows taken in conjunction with the accompanying drawings in which:
Referring to
Thread A, block 302 reads twelve sensor voltages from ADC 202 (see
Referring to (called the flotor frame) with origin near handle 130 on the flotor assembly's central axis, has axes xF passing through LED A, yF passing through LED B, and zF passing through LED C. The three LEDs are in juxtaposition with position sensing diodes A, B, and C, respectively. On the other hand, there is a similar, fixed orthogonal right-handed coordinate frame
(called the stator frame) whose three axes pass through the centers of the three position sensing photodiodes. It is important to note that when flotor assembly 100 is precisely at its zero position and orientation between inner stator assembly 140 and outer stator assembly 150, the flotor frame
and stator frame
are coincident.
coincides with stator frame
rays from each LED 106 pass along the optical axis of each of the corresponding sensor assemblies 170. Position sensing photodiodes A, B, and C have associated right-handed orthogonal sensing coordinate frames
and
. Thus it is apparent that when frame
is coincident with
, the centroids of the images of the LEDs will fall at the origins of frames
and
, whose position outputs will thus be zero. If, on the other hand, frame
is translated and rotated with respect to frame
, light rays from the LEDs will no longer be paraxial as shown by the dashed lines in
, momentarily at the center of the hemispherical flotor damper shell 102, is also shown. Dimensions needed for performing the forward kinematics calculation of thread A, block 308 shown in
to photodiode 180, and distance ll from origin of frame
to the location of a virtual pinhole, marked in the figure by a small dot. The virtual pinhole conceptually replaces the geometric effects of the lenses. Also shown is the distance lz from the virtual pinhole to the photodiode 180. It is thus recognized from geometric optics that ll−rF is the “object distance,” whereas lt is the “image distance.”
and flotor frame
shown displaced from stator frame
. Also shown is handle frame
, shown displaced from the origin of flotor frame
for clarity. Frame
is rigidly connected with the triangular base (shown in gray) to which LED emitters EA, EB, and EC are attached. Finding the image positions is equivalent to finding each of the vectors between the LEDs and the corresponding virtual pinholes associated with sensors A, B, and C. This is accomplished by using the transformation matrix fsT, which describes the flotor assembly's motion. For example, for LED A (emitter EA), with the constant vector fA (the location of LED A with respect to the flotor frame) and the constant transformation matrix saT, this is given by
aA=saTfsTfA. (1)
The light source is imaged on photodiode A at a point (sa, x, sa, y) given by the lens equation
where, as noted above, lz, is the distance from the virtual pinhole to the photodiode.
Before computing the forward kinematics, it is instructive to note that the inverse kinematics must be a function of six independent variables describing the position and orientation of the flotor frame with respect to the stator frame S. The representation used is {n1 n2 θ X Y Z}, where n1 and n2 represent the x and y components of a normalized rotation axis, θ the rotation angle about this axis, and X, Y, and Z the translational motion of the origin of
. Creating fsT as a function of these six variables plus n3 (the z component of the rotation axis) and computing sa, x and sa, y from Eqs. (1), (2) above gives the LED image position on photodiode A:
where ll is the distance from the origin of S to the pinhole and lt the distance from the origin to the photo-diode surface. Similar computations obtain for sensors B and C.
Unfortunately, computing the forward kinematics, (i.e., finding the flotor position and orientation from the light spot positions) has no closed-form solution. A preferred method, termed the reduced order method, due to Yu, Fries, and Hollis, is a fast numerical root-finding procedure that uses the flotor assembly motion history to obtain initial position guesses, directly solving for the flotor frame position and orientation in real time. Referring to
and
from the stator frame
. Only the magnitudes of the vectors are unknown, so the solution of the position and orientation of the flotor assembly can be reduced to a third-order problem. The virtual pinhole positions are given by Si, and the LED positions are Ei; the LED-to-pinhole unit vector directions are bi and their magnitudes are ui, where i=1 . . . 3.
For i, j=1 . . . 3 and i≠j it can be seen from
Ei=Si−biui, (5)
and
|Ei−Ej|2=a2, (6)
where a is the length of each side of the triangle determined by the three LEDs. Substituting for each Ei and Ej in Eqs. (5) and (6), the following system of three quadratic equations with three unknowns is obtained:
u12+2g3u1u2+u22+2f12u1+2f21u2+d2=0, (7)
u22+2g1u2u3+u32+2f23u2+2f32u3+d2=0, (8)
and
u32+2g2u3u1+u12+2f31u3+2f13u1+d2=0, (9)
where
gk=−bi·bj, (10)
fij=(Si−Sj)·bi, (11)
and
d2=|Si−Sj|2−a2<0. (12)
To obtain a solution to this reduced third-order problem, a two-stage numerical method is used, first obtaining an approximate solution by differentiating Eqs. (7)-(9) to update ui using the previous solution values, then improving the accuracy of the approximation with an efficient iterative Newton gradient method using successive LU decompositions, which are well known in the art. In practice, it is found that two or at most three iterations are needed to converge to a position error of less than 10−8 m, permitting this procedure to be executed at several thousand Hz. Finally, a simple fixed rotation transformation is needed to transform from the flotor frame to the handle frame
(shown offset in
(will be translated from frame
by a distance limited by the gap between inner stator assembly 140 and outer stator assembly 150, and rotated with respect to frame
by up to ±8°, limited by the effective range of sensor assemblies 170. This completes the description of how the position and orientation of handle 130 in flotor assembly 100 is computed.
Turning back to whereas the total torque τ is the vector sum of the torques around the axes of
. The variables xd, and vd, and the parameters Kp, Kv, and Kf, are under control of the computer user's client computer, as read in by thread B shown in
Referring to 's z axis; reversing the direction of current imparts a counter-clockwise torque. Equal currents I1, I3, and I5 in the horizontal coils create a force along the positive or negative z axis. In the general case, currents in each of the coils will each be different, as sketched in
The forces and torques generated on the handle when the flotor assembly is in the centered position can be expressed as F=AI, where F is a 6-vector force-torque wrench exerted through the origin of handle frame , I a 6-vector of the coil currents, and A is the 6×6 actuation matrix which maps them. The matrix A can be calculated from the sums of the Lorentz forces and torques, fk=Ik×Bk, and τk=ck×fk, where Bk are the magnetic fields of each actuator magnet assembly and ck are vectors from the handle (origin of frame
) to the coil centers. The effective magnetic induction Bk acting on coil k varies as much as 15% as the coil moves around in the gap of its associated magnet assemblies (see
where S and C are sine and cosine, respectively.
The task of thread A, block 312 is thus to determine the correct set of coil currents needed to produce the desired force-torque wrench F on the handle. Since matrix G has an inverse, the coil currents are simply calculated from I=G−1F/B.
Referring to
Referring to
, which is arbitrarily translated and rotated from the default handle frame
. In the usual case,
and
(are identical. The user frame can be specified by the computer user through the Application Programming Interface. Recall that the position and orientation of the handle frame
is determined by the forward kinematics solution executed in block 308 of Thread A shown in
is known, transformation to frame
is achieved by a well-known homogeneous transformation taking the form of a 4×4 matrix. On the other hand, the force-torque wrench through the handle is determined by the 6×6 actuation matrix A discussed in relation to block 312. This means, when
is not coincident with
, the desired force-torque wrench is no longer exerted at the handle, but must be exerted through the origin of frame
. This requires recomputing the geometric part G of the actuation matrix. The forces from each coil need only be rotated through the angles from frame
to frame
, independent of the displacement between the two frames. On the other hand, the torques from each coil must be changed to reflect the changed moment arm from each coil to the origin of frame
. That is, e.g., coil k will produce a force fk as well as a torque τk through the origin of
which is right angles to the force, and at right angles to a vector from the coil to the origin of
. The total torque through
is then the vector sum of the individual coil torques.
.
Similarly,
The present application claims the benefit of Provisional Patent Application Ser. No. 61/156,874, EFS ID: 4890579, entitled “Improved Magnetic Levitation Haptic Interface System,” filed Mar. 2, 2009, the entirety of which is hereby incorporated by reference for all purposes.
This invention was made with support from the United States Government under Grant Number CNS0625796 awarded by the National Science Foundation. The United States Government has certain rights in the invention.
Number | Name | Date | Kind |
---|---|---|---|
3061805 | Brodersen | Oct 1962 | A |
4700094 | Downer et al. | Oct 1987 | A |
4874998 | Hollis | Oct 1989 | A |
5146566 | Hollis et al. | Sep 1992 | A |
5382885 | Salcudean et al. | Jan 1995 | A |
6195083 | Salcudean et al. | Feb 2001 | B1 |
6373466 | Salcudean et al. | Apr 2002 | B2 |
6483499 | Li et al. | Nov 2002 | B1 |
7224252 | Meadow et al. | May 2007 | B2 |
7336006 | Watanane et al. | Feb 2008 | B2 |
8072418 | Crawford et al. | Dec 2011 | B2 |
20010052893 | Jolly et al. | Dec 2001 | A1 |
20050024331 | Berkley et al. | Feb 2005 | A1 |
20060209019 | Hu | Sep 2006 | A1 |
Entry |
---|
R. L. Hollis and S. E. Salcudean, “Lorentz Levitation Technology: a New Approach to Fine Motion Robotics, Teleoperation, Haptic Interfaces, and Vibration Isolation,” Int'l Symposium for Robotics Research, Hidden Valley, Pa., Oct. 1-3, 1993. |
P. J. Berkelman, Z. B. Butler, and R. L. Hollis, “Design of a Hemispherical Magnetic Levitation Haptic Interface,” ASME Int'l. Mechanical Engineering Congress and Exposition, Atlanta, Nov. 1996, DSC-vol. 58, pp. 483-488. |
P. Berkelman, “A Novel Coil Configuration to Extend the Motion Range of Lorentz Force Magnetic Levitation Devices for Haptic Interaction,” Proc. IEEE/RSJ Int'l. Conf. on Intelligent Robots and Systems, San Diego, Oct. 29-Nov. 2, 2007, pp. 2107-2112. |
P. J. Berkelman, R. L. Hollis, and S. E. Salcudean, “Interacting with Virtual Environments using a Magnetic Levitation Haptic Interface,” Int'l. Conf. on Intelligent Robots and Systems [IROS], Pittsburgh, PA, Aug. 1995. |
Number | Date | Country | |
---|---|---|---|
20110050405 A1 | Mar 2011 | US |
Number | Date | Country | |
---|---|---|---|
61156874 | Mar 2009 | US |