Aspects of the invention generally relate to eye surgical systems and methods, and more particularly to, systems and methods for imaging and tracking of eye measurements during ophthalmic surgeries.
Ophthalmic surgeries to perform vision correction have used laser-based systems in a variety of applications. For example, laser refractive surgeries such as phototherapeutic keratectomy (PRK) and laser-assisted in situ keratomileusis (LASIK) have been used to correct the refractive errors in patients' eyes. In certain applications, lasers may be driven by a treatment plan from the preoperative eye exam measured by a diagnostic device to achieve a desired change in corneal shape for vision correction. Wavefront measurement systems have been previously utilized to measure refractive characteristics of a particular patient's eye and an ablation pattern may be determined from the measurements to correct refractive errors.
For certain procedures, the eye may undergo cyclotorsional eye movements between eye examination/measurement and laser surgery, whereby portions of the eye may change or shift. For example, the pupil center may shift with respect to the surface of the cornea as pupil size changes from scotopic to photopic lighting conditions. Iris registration (IR) has been used to compensate for the pupil center shift and cyclorotation of the eye between a wavefront examination and subsequent laser surgery. In some systems, a torsion camera is used to capture images for IR. However, these systems may incur undesirable corneal specular reflections during imaging as a result of, for example, light sources used to illuminate the eye for imaging purposes. Specular reflections from natural or artificial sources may induce high-light intensity reflections and/or reduce image detail which may interfere with position detection and motion compensation. For example, specular reflections in eye image may reduce an area that may be suitably imaged in iris areas having one or more light reflections. It is desirable to have a maximum iris area available for IR to compensate eye movements between eye exam and laser treatment.
One example approach to address undesirable specular light reflections in eye surgeries is disclosed in U.S. Published Application 2009/0275929A1, whereby a light source and/or a camera lens include polarization filters to polarize the light from the source and/or to the imaging device to prevent reflections from being imaged. This approach increases mechanical complexity due to linear polarizers installation as well as increased expense in adding/modification of hardware. Furthermore, the polarized illumination approach has disadvantages including darker imaging from polarized light waves and consequently may require a higher light density be used during imaging. An increased light density requires increased current to drive the light source, thereby resulting in greater power consumption and increased heating of the light source such as an infrared LED, thereby reducing lifespan of the light source. A more effective and cost-sensitive method of removing corneal specular reflections for eye imaging remains desirable.
Aspects of the disclosed embodiments may generally relate to methods and systems for improving eye tracking and motion compensation during an ophthalmic laser procedure. According to one aspect, a method of imaging for an eye for a surgical procedure may include capturing a first image of the eye while the eye is illuminated with a first light source and, within a subsequent time period from the capturing of the first image, capturing a second image of the eye while the eye is illuminated with a second different light source. The first and second images may be processed into a third image to remove reflections associated with the first light source and the second light source to achieve an image without corneal specular reflections.
According to some aspects, the first light source is an auxiliary infrared light emitting diode (LED) and the second light source is an ocular dexter (OD) or oculus sinister (OS) infrared LED for respective right eye or left eye imaging. The first and second light sources are displaced in separate locations of a laser diagnostic and/or treatment light source, so as to cause a displacement between a specular reflection in the first image and a specular reflection in the second image. In one example, an imaged area of the eye not having a reflection in the second image may be superimposed or utilized for iris tracking in an area of the first image that does include a reflection, and vice versa, to produce the third image where a full imaged area of the eye absent any specular reflections may be presented, used or implemented for tracking and or measurement and subsequent treatment.
According to one aspect, a timed pulse of a specified frequency may be used to trigger illumination and de-illumination of the first light source and an offset of the rising edge of the timed pulse is used to trigger capturing the first image. A subsequent second timed pulse of the specified frequency may similarly trigger illumination and de-illumination of the second light source, and an offset from the rising edge of the second timed pulse triggers capturing of the second image. In certain, non-limiting embodiments, a frequency cycle for the first and second time pulses is set above 60 Hz, for example, at approximately for 100 Hz to enable a frame per second capturing of first and second images to occur with minimized potential eye movement between first and second captured images. According to various aspects, the third image is used to track one or more iris locations for wavefront measurement and subsequent laser refractive treatment surgery, such as a LASIK procedure.
According to further aspects, a surgical system for imaging an area of eye of a patient is disclosed. The surgical system may include an imaging light configured to intermittently trigger illumination of a first light source for a first time period and illumination of a second light source for a second time period, different than the first time period. The system may further include a camera, such as a torsion camera, to produce a first image of the area during the first time period and a second image of the area during the second time period. The system may further include a processor configured to generate a third image based on the first image and second image, including removal of one or more light reflections from the area from the first image based on the same area of the second image not including light reflections of the first image. The processor further generates the third image by removing differently located light reflections in areas of the second image with the same areas of the first image not including the differently located light reflections. The third image is generated without any corneal specular reflections in this manner. The system may include additional components for processing, measurement and treatment as detailed further below, but generally, may operate based on a timing circuit or logic to initiate pulses at a specific frequency to intermittently drive illumination and de-illumination of the first and second light source and capturing of the first and second images during respective illuminations by the first and second light sources.
According to some aspects, the area of an eye for imaging is an iris, although the embodiments are not so limited. In one example system, the first light source and the second light sources of the imaging light are separated and arranged in the imaging light to produce corneal specular reflections at different locations of the eye area, such as an iris, during first and second image capture. The first and second time period may occur in a cycle of greater than 60 Hz to avoid imaging inconsistencies such as eye movements between capturing of first and second images.
In some embodiments, the system imaging light may further include a third light source, e.g., OD LED or OS LED, along with auxiliary light source, to capture respective first and second images of an opposing eye of the patient and generate a further image of the opposing eye absent corneal specular reflections. According to some aspects, the first light source and the second light source are light emitting diodes (LEDs), and in some embodiments, infrared LEDs, although the embodiments are not so limited as different types of light sources or bulbs may also be used. Additionally, the surgical system may be for laser wavefront measurement and laser refractive surgery such as an excimer laser system for LASIK procedure or component thereof, although the embodiments are not limited in this respect and may be used in any medical diagnostic or treatment system where similar advantages may suitably be derived.
Aspects, features and advantages of the disclosed embodiments will become more apparent from the subsequent detailed description in reference to the drawings in which:
Embodiments disclosed herein generally provide systems and methods for improving eye tracking and motion compensation during an ophthalmic diagnostic and/or treatment procedure. Laser-based systems are commonly used in ophthalmic procedures. Wavefront measurement systems may be utilized to measure the refractive characteristics of a patient's eye and to generate corrective procedure patterns for ablative photodecomposition, whereby a laser is used to ablate corneal tissues to correct vision defects. Measurement/diagnostic and treatment procedures may frequently be performed as different phases of a surgical procedure. For wavefront measurement and treatment to be imposed on the patient's eye, an accurate tracking system is required. For example, when wavefront measurement is taken, a patient may be in a seated position. Subsequently during a treatment phase, the patient may be in a supine (or laying down) position. Differences in patient position, and other factors, may contribute to differences in eye position, for example a different torsional orientation. Additionally, even when a patient does not change position between measurement and treatment phases, the eye may encounter differences in pupil center shift and/or cyclotorsional rotation, i.e., rotation of an eye around its visual axis. Differences between eye position during measurement and treatment may lead to vision correction inaccuracies.
In certain embodiments, eye tracking and motion compensation is used to stabilize the motion of the patient or organ (e.g., the patient's eye) between measurement and treatment phases. An automated target acquisition and tracking system allows a surgeon/user to predetermine a treatment pattern, for example, determining a laser firing pattern for ablation used in corneal reshaping. One tracking and motion compensation technique is referred to as iris registration (IR), where distinct features of a patient's iris may be used to provide common positional coordinate reference points between measurement and treatment phases. Iris registration (IR), and/or other types of tracking procedures, may capture images with a torsion camera to identify and/or match the reference points of a patient's eye for measurement and treatment phases.
Embodiments relate to new methods that use pulsed LED illumination and image processing algorithm to remove the corneal specular reflections in the laser eye images for iris registration. One embodiment uses a pulse train to alternatively turn on an auxiliary LED bank and a peripheral LED bank for torsion imaging. The torsion camera video frame acquisition may be synchronized with the pulsed LED illumination to capture two eye images sequentially, one eye image is illuminated only by the auxiliary LED bank and the following eye image is illuminated only by the peripheral LED bank. An image processing algorithm is used to remove the specular reflection in the two eye images and create a new eye image without specular reflection for iris registration. According to one embodiment, an excimer laser may use pulsed LED illumination along with software processing to remove corneal specular reflections in torsion images for iris registration.
Embodiments discussed herein may be utilized with any system where eye imaging and/or lasers are used in detection for diagnosis and/or surgical procedures on a patient's eye. Although not limited thereto, embodiments described herein may be adapted for use on a STAR S4IR® excimer laser platform. In such an implementation, the infrared LED illumination is changed from continuous illumination to pulsed LEDs illumination, and the current 30 Hz torsion camera imaging is upgraded to at 60 Hz or more for faster camera captures used for torsional eye imaging. Electric circuit updates may also be implemented to create the pulse signal to control the synchronization of the infrared LEDs illumination and the torsional camera for capturing images as detailed further below. Image processing software is implemented to remove the specular refractions from first and second images and create a new, or third, eye image for iris registration.
Embodiments may also be used on a femtosecond laser platform for eye registration during a cataract surgery or lenticule extraction surgery. Embodiments may also be used for eye imaging on a diagnostic device for eye examination if the 1st Purkinje image affects the accuracy of eye image detection. The imaging illumination wavelength may range from visible to infrared.
There is no limitation on processors used for eye registration. However, when embodiments are used for a real-time eye tracking or iris tracking, a reasonably fast processor may be needed for image processing in real-time. Processors and/or controllers, may be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared. Moreover, explicit use of the term “processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (DSP) hardware, network processor, application specific integrated circuit (ASIC), field programmable gate array (FPGA), read only memory (ROM) for storing software, random access memory (RAM), and nonvolatile storage. Other hardware, conventional and/or custom, may also be included.
Referring to
The treatment accuracy of laser surgery relies on highly precise eye image detection and precise iris registration. Various attempts have been made to address specular reflections including the polarized illumination of the previously cited published patent application US2090275929. However, prior solutions have drawbacks as noted previously.
Referring to
Synchronizing pulse (SYNCH PULSE) 220 may be generated by clock generator 206 to alternatingly activate and deactivate light sources of the lighting system, e.g., the auxiliary LED 208 and peripheral LED bank (e.g., OS LED 207 and/or OD LED 208), as well as activate torsion camera 210 for video frame acquisition during illumination and image capture of patient eye 250 according to the methods described herein.
As shown in
Turning to
The first and second images are processed 330 with respective corneal light reflections from first and second LED banks removed. Processing 330 may generate a third image without light reflections present on the corneal area by combining processed first and second images. When the first and second LED banks are geographically displaced in the system of
For embodiments where both eyes of a patient will be imaged, the rising edge of the synchronizing pulse (SYNC PULSE) 405 is used as an external trigger for torsion camera to capture two eye images that one image is illuminated only by the auxiliary LED bank (AUX LED) and a subsequent image is illuminated only by the peripheral LED bank (OD LED or OS LED). To obtain more gray level matched video frame images in the field of view (FOV) of the camera, LED banks driving current may be adjusted or calibrated based on an obtained image histogram.
SYNCH pulse 405 may be used to trigger OS LED signal 420, and optionally, switch signal 430 to change use of OD to OS LEDs. For example, OD LED signal 415 is switched off and OS LED signal is switched on based on switch signal 430. A timer or alternative implementation for switching image lighting may also be used. As shown, video capture frame signal 425 may have an offset from respective aux LED and OD/OS LED illumination trigger signals to ensure an eye image has enough exposure level before image capture. The offset value of time delay is used to control the exposure time of one frame image based on image gray level (histogram value). The delay time of the camera used in practice, is 29 μs after the rising edge of the input trigger pulse. The offset between light activation and the image capture image may be calibrated in the system by tuning the LED light PWM control and LED current limiting resister. Calibration and tuning techniques are well known in the art and details are not discussed here.
Four frames may be used for image processing, one pair of images for OD and one pair of images for OS. Timing diagram 400 of
Reflections 520 and 522 can then be removed or omitted in digital processing. An image processing algorithm may be used to remove the specular reflections 520, 522 resulting from the infrared LEDs in
Because reflection removed processed images 600 and 650 may have iris detail obscured at points where reflections are removed, when images 600 and 650 are combined, full iris detail where reflections were once present, will be available for tracking in diagnosis and surgical procedures.
Although only one torsional image is captured on the laser system which is used for the iris registration, eye motion may occur during the camera exposure time may lead to anomolies in the capture eye image. To avoid the eye motion effect on the torsional eye imaging on the laser system, such as the STAR S4IR®, the frame rate for torsion eye imaging conventionally used for continues illumination is set at 30 Hz. Because embodiments described herein capture two sequential eye images to create a frame eye image for iris registration, the minimum frame rate should be increased to at least 60 Hz, which is twice faster than the current 30 Hz torsional camera. In some preferred embodiments, 100 Hz is used for the camera frame rate due to camera capability and preferred imaging results.
Embodiments disclosed herein may be in eye tracking apart from iris registration or used in a diagnostic devices apart from laser surgical systems unless the treatment plan is created by the diagnostic device and an eye image is associated for eye registration. In some embodiments, eye tracking tracks the pupil center movement. If the specular reflection falls inside the pupil area or at the pupil boundary, then the specular reflections can affect the pupil center detection.
Embodiments may alternatively be used in a method for eye imaging with a diagnostic device for eye examination, for example, if a first Purkinje image affects the accuracy of eye image detection.
Embodiments disclosed herein may be used for the iris registration in excimer laser systems as described above, or on a femtosecond laser system for cataract surgery or combination systems. In another case, embodiments disclosed herein can be used for the iris registration or lenticule centration on a femtosecond laser system for lenticule removal procedure. Further, embodiments may be used for eye tracker with pupil tracking and/or iris tracking.
Although features and elements are described above in particular combinations, one of ordinary skill in the art will appreciate that each feature or element can be used alone or in any combination with the other features and elements. In addition, the methods described herein may be implemented in a computer program, software, or firmware incorporated in a computer-readable medium for execution by a computer or processor. Examples of computer-readable media include electronic signals (transmitted over wired or wireless connections) and computer-readable storage media. Examples of computer-readable storage media include, but are not limited to, a read only memory (ROM), a random access memory (RAM), a register, cache memory, semiconductor memory devices, magnetic media such as internal hard disks and removable disks, magneto-optical media, and optical media such as CD-ROM disks, and digital versatile disks (DVDs).
This application claims the benefit under 35 U.S.C. § 119 (e) of U.S. Provisional Patent Application No. 63/505,634, filed Jun. 1, 2023, which is incorporated herein by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
63505634 | Jun 2023 | US |