1. Field of the Invention
The present invention pertains generally to eye tracking technologies, and more particularly to precision eye tracking through use of relative iris edge based landmarks in eye geometry.
2. Background Information
In addition to the eyes being the “gateway to the soul” (Herman Melville), a subject's eyes are an incredibly sensitive bio-indicator that can be utilized for many functions.
Eye movement is the voluntary or involuntary movement of the eyes, helping in acquiring, fixating and tracking visual stimuli. In addition, rapid eye movement (REM) occurs during REM sleep.
“Eye tracking is the process of measuring either the point of gaze (“where we are looking”) or the motion of an eye relative to the head. An eye tracker is a device for measuring eye positions and eye movements. Eye trackers are used in a wide array of applications including research in numerous fields, medical diagnosis, psychology, in cognitive linguistics and even in advertising and product design. There are a number of methods for measuring eye movements. The most popular variant is a non-invasive technique that uses video images from which the eye position is extracted. Other methods use search coils or are based on the electro-oculogram. The non-invasive technique for recording eye position relative to the head using a camera to record eye position relative to the head is also known as video oculography or VOG. VOG systems are used by Vestibular Researchers, Ophthalmologist, Otolaryngologists, Physical Therapists, Neurologists, Audiologists, Balance Clinicians, Neurophysiologists, Physiologists, Neuroscientists, Occupational Therapists, and others.
The most widely used current designs are video-based eye trackers. A camera focuses on one or both eyes and records their movement as the subject viewer will often look at some kind of stimulus. Most modern eye-trackers use contrast to locate the center of the pupil. Image processing software is utilized to interpret the images to provide objective data of eye position. This type of image processing software is described in “A GEOMETRIC BASIS FOR MEASUREMENT OF THREE-DIMENSIONAL EYE POSITION USING IMAGE PROCESSING” Vision Res. Volume 36. No. 3, Moore et al., pp 445-459, 1996, which is incorporated herein by reference. In general, most eye tracking devices digitize an image of the, define the pupil using the high contrast difference between the pupil and the rest of the eye, and then define the center of the pupil by approximating a circle of the same size or calculating the centroid of the pupil itself. For relatively large-scale eye movements, such as saccades and nystagmus, this method is appropriate despite of the fact that the pupil changes in size and, to a lesser degree, shape.
Accurate eye position recording and monitoring in three dimensions (3D-yaw, pitch and torsion rotation about line of sight) is a significant clinical diagnostic tool in the field of vestibular disorders such as vertigo and other neurological disorders.
There is a need for greater precision in eye tracking systems.
In the field of eye tracking, greater accuracy or resolution in monitoring the movement of the eye can be gained by digitizing the eye, and tracking the movement of a landmark with fixed size and a fixed location relative to the eye's local coordinate system. At least a portion of the edge of the iris can be used as such a fixed landmark, or simply landmark. Further, by defining at least a portion of the edge of the iris, possibly even calculating its center (or other fixed landmark relative to the calculated iris edge), and tracking a portion of the edge and/or the center over time, both large and small scale eye movements, including but not limited to micro-tremors, can be traced with a higher degree of accuracy. This will aid in the diagnosis of diseases, assessing state of consciousness, and defining brainstem death.
These and other objects of the present invention will be clarified in the following description which is taken together with the attached figures in which like reference numerals represent like elements throughout.
A complete understanding of the invention will be obtained from the following description when taken in connection with the accompanying drawing figures, wherein like reference characters identify like parts throughout. It is also to be understood that the specific devices and processes illustrated in the attached drawings, and described in the following specification, are simply exemplary embodiments of the invention. Hence, specific dimensions and other physical characteristics related to the embodiments disclosed herein are not to be considered as limiting.
As discussed above, most eye tracking devices digitize an image of the, define the pupil using the high contrast difference between the pupil and the rest of the eye, and then define the center of the pupil by approximating a circle of the same size or calculating the centroid of the pupil itself. For relatively large-scale eye movements, such as saccades and nystagmus, this method is appropriate despite of the fact that the pupil changes in size and, to a lesser degree, shape. However, greater accuracy or even resolution in monitoring the movement of the eye can be gained by digitizing the eye, and tracking the movement of a landmark with fixed size and a fixed location relative to the eye's local coordinate system. The edge of the iris can be used as such a fixed landmark. The present invention provides that by defining or establishing at least a portion of the outer edge of the iris both large and small scale eye movements, including but not limited to micro-tremors, can be traced with a higher degree of accuracy. This will aid in the diagnosis of diseases, assessing state of consciousness, and defining brainstem death.
The term landmark within the meaning of the present application will reference a perceptible or visible artifact that is fixed relative to the local co-ordinate system of the eye. The eye defines a local co-ordinate system, often represented with an axis “through” the center of the pupil generally along a gaze path and two perpendicular axes thereto. It does not matter where the local co-ordinate system is established within the eye, rather that the artifact is fixed in such a local system such that it is a landmark or a fixed landmark. In other words the landmarks will move with the eye.
The concepts of the present invention can be explained in connection with
The present invention utilized at least a portion of the outer edge of the iris as a landmark for tracking eye movement. As shown in
The image processing for establishing the outer iris edge is substantially the same as for pupil edge detection, and is the same as general edge detection in image processing as known in the art. The term iris edge is intended to be broad enough to cover various formulations of finding such an image border. For example, in some edge recognition programs, an image will convert the color of different pixels to ranges or even to merely 0 and 1 depending upon a fixed threshold. In order to distinguish between noise and other eye artifacts (eye vessel), the edge detection algorithm may select find the first 1 in a row and verify that the next 2-5 pixels are also 1 before calculating that it is an edge, or may look at the surrounding X pixel values before calculating that the iris edge has been found. The term iris edge will define the edge of the iris within the scope of image edge detection algorithms.
The present invention contemplates detecting the outer iris edge and utilizing at least a portion of this as a landmark for eye tracking. The length of the segment that is utilized can be varied and the quadrant shape is merely an illustration. In some applications a single or distinct iris edge point will be a sufficient landmark to track. A plurality of edge points at different locations or of edge segments at different locations could also be utilized as eye landmarks within the scope of the present invention.
A further aspect of the present invention is to utilize the iris edge to define a center of the iris and to use the center of the iris as an eye tracking landmark.
The center of the iris landmark would be at the centroid of the iris area. The centroid of an area is very similar to the center of mass of a body. The centroid is calculated using only the geometry of the figure. The general function for calculating the centroid of a geometrically complex cross section is most easily applied when the figure is divided into known simple geometries and then applying the formula:
The distance from the y-axis to the centroid is
The distance from the x-axis to the centroid is
The coordinates of the centroid are (
This calculation of a centroid of the iris is represented in
A further iris based landmark would be a centroid of an iris segment such as a quadrant shown in
In summary the key feature of the present invention is the use of the iris edge as a basis for establishing landmarks for eye tracking. The iris edge may be used itself as a landmark or collection of landmarks in the form of a single iris edge point, as a single iris edge segment, as a collection of points or segments of the iris edge and combinations of iris edge points and iris edge segments. Further the iris edge may be used to calculate an iris center point, or other distinct point that is used as a landmark for eye tracking, and these can be used individually or in combination with each other. The landmarks that are calculated from the iris edge may be used in combination with the landmarks formed by the iris edge itself.
Further the iris based landmarks (which includes the landmarks formed by the iris itself) of the present invention can be used with known prior art landmarks to improve the prior art tracking methodologies. For example, the present invention can use both pupil center and iris based landmarks to track the eye position. It is believed that the iris edge based landmarks will provide for more precision in eye tracking methodologies and open up greater diagnostic possibilities accordingly.
Although the present invention has been described above by reference to an embodiment of the invention, the present invention is not limited to the embodiments described above. Modifications and variations of the embodiment described above will occur to those skilled in the art, in light of the above teachings without departing from the spirit of the present invention The present invention, therefore, to be limited only as indicated by the scope of the claims appended hereto and equivalents thereto.
This application claims the benefit of U.S. Provisional Patent Application No. 61/043,349, filed Apr. 8, 2008, entitled “Method of Precision Eye-tracking Through Use of Iris Edge Based Landmarks in Eye Geometry”
Number | Date | Country | |
---|---|---|---|
61043349 | Apr 2008 | US |