The present invention relates to an optical image probe, the probe is particularly suited for miniature application e.g. in-vivo. The invention also relates to a corresponding imaging system with the said optical image probe and a corresponding method for imaging.
For correct diagnosis of various diseases biopsies are often taken. This can either be via a lumen of an endoscope or via needle biopsies. In order to find the correct position to take the biopsy, various imaging modalities are used such as X-ray, MRI and ultrasound. In case of e.g. prostate cancer in most cases the biopsy is guided by ultrasound. Although helpful, these methods of guidance are far from optimal. The resolution is limited and, furthermore, these imaging modalities can in most cases not discriminate between benign and malignant tissue. As a result a physician does not know for certain that from the correct part of the tissue a biopsy is taken. Thus, the physician takes almost blind biopsies and even if after inspection of the tissue no cancer cells are detected, one does not know for certain that simply the right spot to take the biopsy was missed.
In order to improve the biopsy procedure direct inspection of the biopsy position prior of taken the biopsy is required. A way to achieve this is by microscopic inspection at this position e.g. by an endoscopic inspection.
Considering the need to perform comprehensive and fast imaging by endoscopic inspection it is important for many applications to have the possibility of zooming. This is however difficult with mechanical means around the lenses due to the quite limited space. A zoom lens based on variable-focus fluid lenses has the advantage of no additional space consuming mechanical parts around the lenses. A switchable lens can be made according to the principles described in U.S. Pat. No. 7,126,903 B2 (Variable Focus Lens), which is hereby incorporated by reference in its entirety. In this reference, it is described how a variable-focus lens can be made with the smallest possible outer diameter. This lens has the drawback that only a certain zoom factor can be reached due to the limited diopter change that can be reached by the fluid lens.
Hence, an improved optical image probe would be advantageous, and in particular a more efficient and/or reliable probe would be advantageous.
Accordingly, the invention preferably seeks to mitigate, alleviate or eliminate one or more of the above mentioned disadvantages singly or in any combination. In particular, it may be seen as an object of the present invention to provide an optical image probe that solves the above mentioned problems of the prior art with obtaining a relatively high zoom factor in a compact way.
This object and several other objects are obtained in a first aspect of the invention by providing an optical image probe comprising:
a housing,
a fluid lens positioned at an end portion of the housing, the fluid lens having a changeable optical power, and
an image collector positioned within the housing, the collector being arranged in an optical path of the fluid lens, the collector being displaceable along the said optical path by an actuator.
The invention is particularly, but not exclusively, advantageous for obtaining a compact optical image probe and which simultaneously has a high zoom factor. Due the possible displacement of the image collector and the changeable optical power of the fluid lens, and cooperation between these two elements, it is possible to obtain a compact endoscope with a wide dynamic range of zoom factor with satisfactory focusing properties.
In order to be able to zoom one may thus make use of a fluid lens to change the effective focal length of the lens system of the probe (i.e. to zoom) and to use the displacement of the image collector to bring the lens system in focus. This may be performed simultaneously, consecutively (in both orders) or iteratively, or any combinations thereof. This way of zooming combines the best of both worlds: the fluid lens need only to switch over a small range, the large displacement can be achieved by an actuator mechanically connected to the image collector, and this actuator may therefore take relatively less lateral space than when it would have been designed immediately next to or around the lens elements (which would increase the endoscope diameter).
In general the present invention is implemented with an image collector which is diplaceably arranged on the optical path from the fluid lens, but it is to be understood for the skilled reader that the image collector, and the displacement thereof, may specifically be one or more fibres; one or more relay lens for transporting image to outside may be applied, or an image sensor (i.e. a sensor capable of converting optical signals into electric signals).
An optical system capable of zooming, e.g. a camera, having two fluid lenses may consume relatively small amount of space in a lateral direction of the optical system, but may have a relatively low zoom factor. An optical system capable of zooming with two displaceable lenses may have a high zoom factor, but normally consumes considerable space in a lateral direction of the optical system. Thus, the optical image probe according to the present invention with a displaceable image collector or image sensor and a fluid lens may have both a high zoom factor and is compact in a lateral direction.
Another advantage is to avoid the difficulty of scaling down a system with movable lenses (for small-diameter endoscopes). Such a system contains two small motors and several thin sliding rods. Small motors are difficult and expensive to make and the system is difficult to assemble. In our invention only one small motor is needed. Moreover, this motor can be somewhat larger than lens displacement motors, as there is more space behind the image collector than next to the lenses.
It may be mentioned that Japanese patent application JP 2006271503 discloses an endoscopic optical system where errors in quantization due to the limited resolution of the image sensor are reduced inter alia by displacing the image sensor while keeping the imaging lens fixed. However, this optical endoscope is only meant for focusing, not zooming. It is also not apparent that these measures may lead to a high zoom factor as obtained by the present invention. Thus, the endoscopic optical system disclosed in JP 2006271503 is not particularly relevant for the present invention.
In one embodiment, the fluid lens may be optically arranged for imaging a region of interest in front of the probe. Alternatively or additionally, the fluid lens may be optically arranged for imaging a region of interest next to the probe.
Beneficially, the probe may have a range of optical powers of the fluid lens defined by a maximum optical power (globally or locally) and a minimum optical power (globally or locally), the probe being optically arranged so that a corresponding range of focusing positions of the displaceable image collector enables focusing of the probe over a substantial part of the said range of optical powers. Thus, the fluid lens optical power range and focusing range of the image collector range may match each other. In this context a “substantial part” may mean at least 70%, 80% or 90%. The term “enable focusing” means in focus for the given purpose and application. Whether the image is “in focus” may conventionally be determined e.g. by edge detection, by high frequency analysis of the Fourier transformed (FT) signal, or other focusing techniques available or useable.
When zooming with a lens system having two fluid lenses and no moveable lenses, the fluid lenses must both change the focal length of the lens system as well as keeping the image in focus on the image sensor. In general the requirement of keeping the image in focus on the image sensor requires more optical power change than is required for the focal length change. This focusing requirement therefore limits the maximum achievable zoom factor. When, however, this focusing is performed by moving the image sensor, the above restriction is removed and a larger zoom factor becomes possible.
More specifically, the probe may have an optical power of the fluid lens and a corresponding focusing position of the image collector with an effective zoom factor of at least 2, preferably at least 2.5, or more preferably at least 3.0. The term “zoom factor” is understood to be a ratio of change in focal length. Other minimum value may be 1.6, or 1.8, or, alternatively, 3.5, 4.0.
Alternatively, the probe with two positions for the optical power of the fluid lens and two corresponding focusing positions of the image collector may have an effective zoom factor in the interval 1 to 4, preferably in the interval 1.5 to 3, or more preferably in the interval 1.5 to 2.5. New designs or liquid combinations may give much higher zoom factors. Thus, the intervals may alternatively be 1-5, 1-6, 2-5, or 2-6.
Typically, the fluid lens may consist of at least two immiscible fluids that are separated over a meniscus. In one embodiment, the shape of the meniscus in the fluid lens is changeable by pumping fluid into or out of the fluid container to provide a design that is easy to implement and avoids electrical wiring in the probe. In another embodiment, the fluid lens may be an electrowetting lens comprising two immiscible fluids. More particularly, the electrowetting lens may have an asymmetric electrode configuration so as to enable tilting of the meniscus formed between the two immiscible fluids so that the optical probe may repositioned the region of imaging by manipulating the meniscus.
The actuator may be an electromagnetic actuator, the electromagnetic actuator comprises an actuator housing, a driven member movably disposed with to the housing, preloading means for providing a normal force between the actuator housing and the driven member such that a friction force between the actuator housing and the driven member resulting from the normal force must be overcome to initiate a relative movement between the housing and the driven member, driving means for overcoming the said friction force and driving the driven member relative to the actuator housing. This actuator has the advantage that energy is only required during displacements not during fixed positions. Further details on this so-called friction stepper may be found WO2006/117715, which is hereby incorporated by reference in its entirety.
Alternatively, the actuator for displacing the image collector may be a piezoelectric actuator. In another embodiment, the said actuator may be a pneumatic or a hydraulic actuator, i.e. an actuator that converts fluid pressure into a corresponding displacement, e.g. a bellows. This has the particular advantage that electrical wiring and the use of electromagnets is avoided. Electrical wires can be negatively affected when heated for example during autoclave of an optical probe used for in-vivo inspection. Similarly magnets
Preferably, the probe may form part of an endoscope, a catheter, a needle, or a biopsy needle for in-vivo applications, though the present invention is not limited to these applications.
In a second aspect, the present invention relates to an optical imaging system, the system comprising:
a light source (LS),
a sample arm optically coupled to the light source, the sample arm having at its distal end an optical image probe according to the first aspect of the invention, and
an imaging display device (IDD) coupled (C) to the light source (LS) and the sample arm.
In a third aspect, the present invention relates to a method for performing optical imaging, the method comprising
providing a housing,
providing a fluid lens positioned at an end portion of the housing, the fluid lens having a changeable optical power, and
positioning an image collector within the housing, the collector being arranged on an optical path of the fluid lens, the collector being displaceable along the said optical path by an actuator.
The first, second, and third aspect of the present invention may each be combined with any of the other aspects. These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.
The present invention will now be explained, by way of example only, with reference to the accompanying Figures, where
In front of the fluid lens 5, a further lens 10 is positioned. The lens 10 can also be replaced a window with no optical power, but normally the fluid lens works in cooperation with additional optics.
An image sensor 40 is positioned within the housing, the sensor being arranged on the optical path of the fluid lens i.e. behind the fluid lens 5 so that light captured by the fluid lens 5 and the lens 10 can be detected by the image sensor 40. The image sensor 40 is displaceably arranged along the optical path by an actuator 42. Thus, as indicated in
As also indicated in
Region 11 denotes an area between the image sensor 40 and the fluid lens 5. Region 1 could be empty but several lens and other optical components could be positioned there as well. In
Similarly, the actuator 43 is connected outside of the probe 20 for powering and control as indicated by the arrow 43b. In
In
To demonstrate that larger zoom factors can be reached by a system consisting of a fluid lens and a moveable sensor compared to a system consisting of two fluid lenses, we consider the zoom lens system shown in
Consider as an example the case d1=5 mm and d2=5 mm. Let the switching range of the fluid lenses be limited by |f1|>6 mm and |f2|>6 mm. In this case the focal range change possible is 5.83 mm <F<14.17 mm, resulting in a zoom factor of 2.43. This range is limited by the constraint on f2. When we consider the case where the second lens is replaced by a fixed lens with f2=−2 mm and an image sensor that can be displaced between 2 mm <d2 <20 mm, we find that the focal length F can change between 12.0 mm <F<75.0 mm, showing a zoom factor of 6.25.
In the top view, the meniscus of the fluid interface is curved towards the oil phase resulting in a focal point F_P as indicated in the top view of
The second liquid 6a should have a different refractive index as compared to the first liquid 6b in order to allow for lens-action when the meniscus between the two liquids is curved. The two liquids are required to be immiscible to obtain a stable meniscus. By suitable choice of the surface tension between the two liquids and the geometry of the cavity (cylindrical or conical), both concave and convex lens action can be obtained.
The electrodes on the sides as indicated by 7 and 8 could be a series of electrodes i.e. more than the two electrodes drawn for simplicity here, that are equidistantly spaced on the circumference of the lens. In order to prevent short-circuits, the side electrodes do not run all the way to the bottom electrode 4 as indicated by the black liquid between electrode 4 and electrode 7 and 8, respectively. By applying the same voltage on all electrodes, a spherical meniscus can be obtained as a special case. However, by suitable voltage differences between these electrodes, the plane of the meniscus can be tilted as desired. This will result in a directionality of the focal point of the lens, allowing e.g. a surgeon to focus on objects that are not directly in front of the lens system. Such a tilted meniscus will also enable a surgeon to illuminate around a corner during an in vivo inspection. Due to the finite number of electrodes placed around the two fluids 6a and 6b, no perfectly tilted meniscus will be possible. Therefore, aberrations and wave front errors will be introduced to some extent.
Finally, an optically transparent cover layer 9 is placed on top of the lens in order to prevent liquid leaking out of the liquid lens 5. Adjacent to the cover layer 9, the high NA lens 10 is positioned. Possibly, layer 9 and lens 10 may be combined into one and the same entity.
One such actuator is an electro-magnetic actuator, a so-called friction stepper.
This actuator 70 with an image sensor 40 is shown in
When no current I runs through the coils, the magnet 73 stands still with respect to the coils 71 and steel plate 76 due to the magnetic attraction force Fm between magnet 73 and the ferric member 76, and due to a friction force FRIC between the magnet holder 72 and the magnet support 75. Next, if current runs through the coil 71, a driving force Fd occurs and the image sensor 40 can move to the right or to the left direction, depending on the current through the coils 71. To move the image sensor 40 in small steps, current pulses should be applied to the coils 71.
In order to check the feasibility of such a solution, Opera 3D simulation of the magnetic field has been performed. It is assumed that the actuator 40 can be placed into a tube with 3 mm inner diameter and the length of the actuator is 10 mm without the image sensor. Furthermore, the mass of the moving part of the actuator (image sensor 40, magnet 73 and magnet holder 72) is 0.25 g. In order to have no movement of the moving part due to 3G shock, the attractive force Fm should be greater than 0.036N and the driving force Fd should be higher than 0.01N. According to Opera 3D simulation, the attractive force of the simulated actuator is Fmε[0.046N, 0.051N] and Fdε[0.080N, 0.087N]. Consequently, the simulated actuator 70 can be used for moving the image sensor 40.
Further details on the so-called friction stepper can be found in International patent application WO 2006/117715, where an actuator including: a housing; a driven member movably disposed with respect to the housing; a magnet associated with the driven member and a ferric member for providing a magnetic attraction force between the driven member and the ferric member for providing a normal force, Fn, between the housing and driven member such that a friction force between the housing and driven member resulting from the normal force must be overcome to initiate a relative movement between the housing and driven member; and a magnetic drive system for overcoming the friction force and driving the driven member relative to the housing. Preloading means may comprise a magnet associated with the driven member and ferric member for providing a magnetic attraction force between the driven member and the ferric member, wherein the magnetic attraction force is substantially equal to the normal force.
The electro-magnetic actuator 80 can beneficially be implemented in combination with a displacement position as disclosed in U.S. Pat. No. 5,399,952, which is hereby incorporated by reference in its entirety. The actuator i.e. the electromagnetic drive system includes a motor having a first motor section movable relative to a second motor section along a motion axis. The second motor section has three excitation coils. The first motor section includes a magnetic circuit generating a magnetic field in the excitation coils. The first motor section also includes a short-circuit winding for only high-frequency induction currents. This short-circuit winding is magnetically coupled to the excitation coils. The degree of electromagnetic coupling of at least one excitation coil depends on the position of the first motor section relative to the second motor section. The short-circuit winding provides a position-dependent electromagnetic coupling between the center excitation coil and the two outer excitation coils. The position-dependent coupling can be detected by superimposing a high-frequency detection signal on the excitation system for the center coil and by detecting currents induced in the two outer coils by the high-frequency detection signal.
S1 providing a housing 19,
S2 providing a fluid lens 5 positioned at an end portion of the housing, the fluid lens having a changeable optical power, and
S3 positioning an image collector 40 within the housing, the collector being arranged on an optical path of the fluid lens, the collector being displaceable along the said optical path by an actuator 42, 70, 80 or 90.
The invention can be implemented in any suitable form including hardware, software, firmware or any combination of these. The invention or some features of the invention can be implemented as computer software running on one or more data processors and/or digital signal processors. The elements and components of an embodiment of the invention may be physically, functionally and logically implemented in any suitable way. Indeed, the functionality may be implemented in a single unit, in a plurality of units or as part of other functional units. As such, the invention may be implemented in a single unit, or may be physically and functionally distributed between different units and processors.
Although the present invention has been described in connection with the specified embodiments, it is not intended to be limited to the specific form set forth herein. Rather, the scope of the present invention is limited only by the accompanying claims. In the claims, the term “comprising” does not exclude the presence of other elements or steps. Additionally, although individual features may be included in different claims, these may possibly be advantageously combined, and the inclusion in different claims does not imply that a combination of features is not feasible and/or advantageous. In addition, singular references do not exclude a plurality. Thus, references to “a”, “an”, “first”, “second” etc. do not preclude a plurality. Furthermore, reference signs in the claims shall not be construed as limiting the scope.
Number | Date | Country | Kind |
---|---|---|---|
08160097.5 | Jul 2008 | EP | regional |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/IB09/52900 | 7/3/2009 | WO | 00 | 1/7/2011 |