Patent Grant
10228549
The disclosed invention generally relates to a flat lens system and correcting aberrations of images from the flat lens system using configuration and image processing techniques.
Anamorphic prism systems are known to compress or expand light beams, but they have not been used for image capture for a variety of reasons. These prism systems are afocal, and do not focus an image onto an image plane, making them unsuitable as an imaging system. Typically, anamorphic prism systems are designed for collimated light from one incident angle and therefore their performance degrades with off axis light, resulting in a lens with a very limited field of view. Many anamorphic prisms have chromatic dispersion resulting in chromatic aberrations making them unsuitable for multi-color images. Accordingly, anamorphic prism systems are almost exclusively used to shape laser beams, often monochromatic, and are generally referred to as beam expanders and beam compressors.
Achromatic anamorphic prism systems, generally require multiple prisms making them large and heavy. In addition, since the achromatic anamorphic prism systems only compress or expand in one dimension, it would require multiple of these systems to compress equally in two dimensions to maintain the image aspect ratio, which makes the systems even larger and heavier. For these reasons anamorphic prism systems have not been used for image capture.
Imaging devices such as cameras, microscopes and telescopes can be heavy and large. A large portion of this weight is due to the design of the optical lens elements, which can include heavy curved lenses, and the structure to support these lens separated by long focal distances. These imaging devices can be large (thick) mainly because in a typical lens system, the opening aperture to system device depth ratio is small. Moreover, to optically improve image resolution with the traditional lens systems, more device depth (longer focal length) is required in order to reduce lens refraction and minimize lens aberrations. The device depth of the imaging device can limit the imaging systems' performance and design. For example, the size and weight constraints of mobile, compact, or weight constrained imaging devices can limit resolution because they constrain the maximum focal length. The disclosed invention can increase the effective focal length in these systems, and improve resolution with the same size and weight constraints.
Additionally, conventional curved lenses have many different types of aberrations that reduce image resolution (spherical, coma, chromatic, and others). To correct these aberrations, conventional curved lenses use extra large pieces of precision glass, adding weight, size and cost to the lens system. The disclosed invention can reduce the size, weight and resulting cost of conventional curved lenses, and in some devices eliminate their use entirely.
In some embodiments, the disclosed invention is a flat lens system which includes: a wedge-shaped refractive material having a first surface and a second surface opposite to the first surface for refracting incident light beams from an object having a width of Y, from the first surface towards the second surface; a reflective material positioned at the second surface of the wedge-shaped refractive material for reflecting the refracted light beams at a first angle toward the first surface, wherein the reflected light beams are refracted from the first surface at a second angle to compress or expand the light from the object having a width of X and including chromatic aberrations; and an apparatus for forming and processing the image of the object to reduce said chromatic aberrations.
In some embodiments, X is smaller than Y to compress the image of the object for use in a telescope, for instance. In some embodiments, X is larger than Y to expand the image of the object for use in a microscope, for example.
In some embodiments, the reflective material may include one or more moving or rotating mirrors to reflect the refracted light beams at varying angles toward the first surface.
A more complete appreciation of the disclosed invention, and many of the attendant features and aspects thereof, will become more readily apparent as the disclosed invention becomes better understood by reference to the following detailed description when considered in conjunction with the accompanying drawings in which like reference symbols indicate like components.
Embodiments of the disclosed invention are directed to a flat lens system to obtain a high quality image with a more compact optical lens system and correcting aberrations of images from the flat lens system using configuration and image processing techniques. Increasing the initial surface area of the lens objective (aperture) allows more electromagnetic (EM) wave energy to be collected, and can result in a faster and better image quality. However, increasing the aperture to improve image quality and speed typically results in a proportionally larger size lens system and device depth.
The flat lens system according to the disclosed invention has an increased initial surface area of the lens objective (aperture), with a decreased corresponding device depth in the lens stack. The flat lens system collects the EM waves, such as visible and nonvisible lights, with a much larger aperture-to-device depth ratio. This means higher quality images can be captured faster with a smaller device depth. A flat lens system may be very large for telescopes for example, and small for microscopes, and yet maintain a large aperture-to-device depth ratio.
In some embodiments, the disclosed invention provides a flat lens system and image processing methods with an increased lens aperture to device depth ratio and corrects aberrations and distortions in the images produced by the lens. In some embodiments, the disclosed invention is capable of optical EM wave compression and/or expansion. Some applications for the flat (wedge) lens of the disclosed invention include both imaging and non-imaging applications. Examples of imaging applications are cameras, microscopes, telescopes, binoculars, scopes, telecentric lenses, and the like. Examples of non-imaging applications are architectural light pipes, which could provide indoor illumination using natural light, and solar concentrators for more efficient solar energy generation.
Varying angles a1 and/or a2 will vary the size X of the compressed image 210. The size X of compressed image 210 varies with the EM wavelength, angle a1 and a2, and the type of the refractive material 202. Angles a1 and/or a2 values can be varied for specific applications, such as the degree of the compression (X) needed. In many typical applications, angles a1 is between 15 and 25 degrees and a2 is between 75 to 105 degrees. Exit beam angles of a3 and a4 can be modified by varying angles a1 and/or a2 until the critical angle is reached which then alters the beam path to total internal reflection.
Referring back to
If the image processing is performed by an optical device (hardware), the correction is done before the image is received by the sensor. However, if the image processing is performed by software (executed on a processor), the corrections are performed after the image is received by the image sensor, that is, at the output of the sensor.
In some embodiments, the chromatic dispersion for the output image is dynamically measured (for example, at predetermined intervals) and a corresponding voltage (or current) is applied to the wedge to change its refractive index and/or its beam absorption to compensate for the measured chromatic dispersion. In some embodiments, the amount of the voltage (or current) applied to the wedge is determined from a stored lookup table, taking into account the measured chromatic dispersion and the type of the wedge material.
Characterizing the chromatic dispersion per device, and applying software algorithms in the image processor 216 to the image, can also be used to assist in controlling chromatic dispersion for imaging
There are many known image processing techniques to correct for image aberrations. One method is to calculate or measure the aberrations of the system, for example, by creating spot diagrams, which are different for each wavelength of light, and then apply an inverse transfer function to reverse these aberrations.
The refractive material 202 may be made of any type of glass, plastic, fluids such as water, or similar types of refractive materials. In case of a fluid, such as water, the fluid may also be used to allow cooling of the optics. The reflective surface 204 may be any type of mirror or other material having a reflective surface. Such reflective surface may be attached or coated on such material to form the reflective surface 204.
The flat lens of the disclosed invention may have any rectangular shape, rather than a square shape, which allows for variable compression ratio and aspect ratio of the image being formed. In some embodiments, the wedge angles a1 and a2 can be variable as the specific applications require. For example, using common BK7 glass, a typical wedge angle a2 may vary between 75 and 105 degrees, in some embodiments. Choosing an angle a2 closer to 75 degrees will result in higher energy captured and lower chromatic aberration but have lower compression. However, choosing an angle a2 closer to 105 degrees results in a higher compression of the image at the expense of higher energy losses and larger chromatic aberration. Angle a1 can be varied to produce similar effects.
Although
Here, α≅(I3−I1′)/2 and ϕ is the tilt angle of surface 1 from the vertical. ϕ and α may be adjusted until the desired compression or expansion ratio is obtained. For instance, for a prism of B270 optical crown glass (nd=1.5229) with ϕ=16.9 deg and α=14.0 deg, an anamorphic compression A′/A=MAG≈0.375 can be obtained. Typically, two of these reflective wedges, placed orthogonally to maintain the image aspect ratio, would result in a shortening the focal length required of the focusing lens system by 50% or more. This effect may be used to create a more compact device.
Compressing the image using this technique allows the image to be focused in a shorter distance while maintaining resolution. A shorter focal distance allows for a more compact device. This means higher quality images can be captured faster with a smaller lens system.
In block 314, in the case of imagery application, the (image) processor corrects aberrations from the lens system. The refracting wedge lens can introduce chromatic aberrations, but does not introduce other aberrations usually associated with circular lens systems. The chromatic aberration can be predetermined (by calculation or measurement) for each pixel. A table can be used to offset each color at each pixel to reposition the pixel at the appropriate position in the resolved image.
Alternatively, or in combination, hardware (optical) processing of the image may be performed by achromatic elements, such as achromatic wedge(s). An anamorphic prism for correcting an anisotropy of a radiation angle of a beam is described in U.S. Pat. No. 4,750,819, the entire contents of which is hereby expressly incorporated by reference. The anamorphic prism is formed as an achromatic structure using a first prism and a second prism. The refractive indexes and refractive index changes as a result of a wavelength fluctuation of the first and second prisms and an incident angle of the beam to the first prism can satisfy a predetermined relationship, where the beam can emerge from the second prism at an exit angle of 0 degree, which corrects the anisotropy of the angle of the beam.
The flat lens system of the disclosed invention collects the EM waves, such as visible and/or non-visible light, with a much larger aperture-to-device depth ratio. This means higher quality images can be captured faster with a smaller lens system.
The flat lens system may be very large for telescopes for example, and small for microscopes, and yet maintain a large aperture-to-device depth ratio. The image sensors are often charge coupled devices (CCDs) or CMOS sensors. The disclosed invention is not limited to the above examples of imaging sensor, rather, other types of EM or imaging sensors may be used with the flat lens of the disclosed invention. Human eye viewable optical elements may also be used. In the case of human eye viewable optical elements, blocks 308 to 314 may not be required because the human eye can focus the image.
In block 312, one or more processor(s), such as an image or EM wave processor(s), receives the information from the EM sensor(s) and modifies/enhances this information, as required by the application. This can also be used to expand/spread the image if the application is directed to a microscopic function, where the sequence is partially reversed.
In the case of a three dimensional (3D) imaging, more EM sensors may be required, as known in the art. The invention is not limited to the above examples of imaging sensor, rather, other types of EM or imaging sensors may be used with the flat lens of the disclosed invention.
The compressed image 406 may optionally get directed to an optional focusing lens 408 to focus the compressed image onto light sensor(s) 410 (for example, CCD or CMOS sensor(s)). An image processor 412 (implemented in software, hardware and/or firmware) corrects for any aberrations resulting from the lens system by using one or more image processing techniques and output a corrected compressed image 414. If the image processing is performed by an optical device (hardware), the correction is done before the image is received by the sensor. However, if the image processing is performed by software (executed on a processor), the corrections are performed after the image is received by the image sensor, that is, at the output of the sensor.
In these lens systems with moving reflective surface, the quality of the image is increased by reducing the field of view, and stitching many images together. This technique can improve final image resolution. Moving the mirror changes the view of what objects appear in the image. In these embodiments, the mirror is moved in a way that it can captures a series of images, each with a narrow field of view. The system then uses known image processing techniques to combine or stitch the captured images together into one composite image with a large field of view. For example, known image stitching methods may be used to register, calibrate and blend the images to produce the final image 414. Because the imaging system has a relatively large aperture size with lots of light, images can be captured very quickly. Another reason to move the mirror is to adjust the field of view, or change the compression of one single image, for example, for digital or optical zooming applications.
There are several different techniques to move the mirror 404. Although mirror 404 is shown as rotating, in some embodiments, it is possible to tilt the reflective surface (e.g., a mirror) about a fulcrum, or rotate about the edge as shown in
There are several known image processing methods to correct the image aberration caused by the flat lens. The use of these known methods is dependent upon the application of the flat lens. For example, lookup tables may be used to correct the aberrations as a relatively simple correction for chromatic aberrations. Moreover, transfer functions may be appropriated when fixing chromatic aberrations in a flat lens application.
In some applications, there may be a low intensity of EM energy, such as in low light applications (e.g., night vision, or for example Raman Spectroscopy of biological tissue where high power lasers may damage the tissues). In these applications, the large aperture of the lens system of the disclosed invention is capable of collecting a large amount of light energy, and still use a very compact design.
In some embodiments, the disclosed invention is capable of capturing and optionally process multispectral or hyperspectral imaging, which is used to collect and process information from across the electromagnetic spectrum to obtain the spectrum for each pixel in an image of a scene, with the purpose of finding objects, identifying materials, or detecting processes in the image of the scene.
In some embodiments, the disclosed invention is scalable and applies to a full range of system sizes including those from small microscopic/nano systems to large telescopic systems greater than, for example, 30 m is length or diameter.
It will be recognized by those skilled in the art that various modifications may be made to the illustrated and other embodiments of the invention described above, without departing from the broad inventive scope thereof. It will be understood therefore that the invention is not limited to the particular embodiments or arrangements disclosed, but is rather intended to cover any changes, adaptations or modifications which are within the scope of the invention as defined by the appended claims and drawings.
This patent application is a continuation of U.S. patent application Ser. No. 15/222,058, filed on Jul. 28, 2016, which claims the benefits of U.S. Provisional Patent Application No. 62/201,428, filed on Aug. 5, 2015, and the entire contents of which are hereby expressly incorporated by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 3200250 | Bouwers | Aug 1965 | A |
| 4623225 | Forkner | Nov 1986 | A |
| 4627690 | Fantone | Dec 1986 | A |
| 4750819 | Sugiki | Jun 1988 | A |
| 4872747 | Jalkio et al. | Oct 1989 | A |
| 5568315 | Shuman | Oct 1996 | A |
| 5995284 | Vanderwerf | Nov 1999 | A |
| 9759900 | Daugela | Sep 2017 | B2 |
| 20060261274 | Thomson et al. | Nov 2006 | A1 |
| 20060291704 | McClurg | Dec 2006 | A1 |
| 20150378186 | Xiong et al. | Dec 2015 | A1 |
| Entry |
|---|
| International Search Report and Written Opinion for corresponding International Application No. PCT/IB2016/054526 dated Oct. 20, 2016, 7pp. |
| Partial Supplementary European Search Report dated Nov. 30, 2018 for corresponding European Application No. 16832390.5 (12 pages). |
| Number | Date | Country | |
|---|---|---|---|
| 20170307864 A1 | Oct 2017 | US |
| Number | Date | Country | |
|---|---|---|---|
| 62201428 | Aug 2015 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15222058 | Jul 2016 | US |
| Child | 15647075 | US |
