1. Field of the Invention
This invention relates generally to otoscopes for imaging the inside of human or animal ears.
2. Description of the Related Art
Otoscopes are a common imaging device that clinicians use to diagnose diseases of the middle ear. While otoscopes range in complexity from simple magnifiers to high-definition digital cameras, their basic functionality has remained the same for many years. They simply deliver a magnified image of the middle ear. Recently, there has been interest in leveraging advances in plenoptic camera technology to build an otoscope that captures a three-dimensional depth profile (or lightfield) of the middle ear, possibly with additional multispectral information. However, capturing lightfield data places additional requirements on the illumination compared to traditional otoscopes.
Thus, there is a need for better illumination sources for otoscopes, particularly for plenoptic otoscopes.
One aspect includes a plenoptic otoscope with an illuminator located at a base of the speculum. The illuminator includes light sources arranged around a periphery of the base of the speculum. The light sources illuminate the inside of the ear.
Another aspect includes a plenoptic otoscope with an illuminator positioned to produce illuminating light that propagates along the optical train of the plenoptic otoscope. The plenoptic otoscope further includes a filter module that includes a central clear area and a plurality of spectral filters arranged around the central clear area. The illuminator produces white light that propagates through the central clear area of the filter module to the inside of the ear. In another arrangement, the white light propagates to the inside of the ear, but without propagating through the filter module.
Other aspects include components, devices, systems, improvements, methods, processes, applications and other technologies related to the foregoing.
The invention has other advantages and features which will be more readily apparent from the following detailed description of the invention and the appended claims, when taken in conjunction with the accompanying drawings, in which:
a-c (prior art) are example images showing different conditions of the ear as well as features to distinguish the conditions.
a-b show a perspective view and a cut-away view of a plenoptic otoscope.
a-c show an illuminator design that uses a ring of LEDs.
a-b show an illuminator design that uses a filter array with a central aperture.
c shows yet another illuminator design.
a-c show optical trains of a plenoptic otoscope with filtering.
a-b show use of a filter module with different spectral filters.
a-c show additional filter modules.
a-b show a plenoptic otoscope system, introducing notations of dimensions.
The figures depict embodiments of the present invention for purposes of illustration only. One skilled in the art will readily recognize from the following discussion that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles of the invention described herein.
The figures and the following description relate to preferred embodiments by way of illustration only. It should be noted that from the following discussion, alternative embodiments of the structures and methods disclosed herein will be readily recognized as viable alternatives that may be employed without departing from the principles of what is claimed. To facilitate understanding, identical reference numerals have been used where possible, to designate identical elements that are common to the figures.
A plenoptic otoscope design can overcome the poor data quality of current otoscopes for feature extraction for otitis diagnosis. For example, a plenoptic otoscope can be used to capture three-dimensional (3D) shapes, translucency, and/or detailed color information. Bright and spatially uniform illumination is important for otoscopes. A plenoptic otoscope additionally benefits if (1) the illumination source does not obstruct any portion of the imaging path, (2) the illumination is broadband and spatially/spectrally uniform to provide simultaneous acquisition of multispectral data, and (3) specular reflections are minimized to improve image analysis.
a-c (prior art) are example images showing different conditions of the ear as well as features to distinguish the conditions. The three conditions shown are acute otitis media (AOM) in
As can be seen from
a-b show a perspective view and a cut-away view of a plenoptic otoscope. In particular, note that the plenoptic otoscope includes a filter array 315 and a plenoptic sensor 390. The filter array 315 can be inserted into the optical train of the plenoptic otoscope.
The plenoptic otoscope head 380 can be mounted on top of a handle 360 that houses an illumination source (e.g., portable system) or can be connected to an illumination source (e.g., wall-mounted system). The otoscope illumination source may be an LED light source, a standard white illumination source, etc. The illumination source may have polarization characteristics as well. For example, it may emit unpolarized, partially polarized, or completely polarized (e.g., TE, TM) light.
a-c show an illuminator design that uses a ring of LEDs 410 mounted at the base of the speculum 370.
A prototype of the ring-LED design is shown in
As a variation of this technique, the ring illumination can be implemented with optical fibers rather than LEDs. As another variation, the speculum can be fabricated out of a material that acts as a waveguide. This can help direct light from the ring illuminator to the tissue.
a-b show an alternate design that uses a polarizing beamsplitter plate (PBSP) to direct light toward the middle ear.
A white light source placed within the otoscope handle is linearly polarized. A lens sends the light 721 toward a PBSP 722, which reflects 723 the converging polarized rays onto a small opening 712 within the filter module 710. After passing through the opening, the rays diverge and create a fairly uniform illumination spot centered on the speculum tip 372. Light scattered and reflected 724 from the middle ear return to the aperture 710, where they pass through the opening 712 as well as adjacent spectral filters. Rays are then incident on the PBSP, which only transmits rays that have changed polarization states (by scattering deep into tissue). This configuration provides both uniform illumination and reduced specular reflections.
c shows an alternate design, where the positions of the filter module 710 and beamsplitter 722 are reversed. That is, in
In one embodiment, the plenoptic image contains depth data. A computing module (not shown in
Another possible operational mode of the plenoptic otoscope is a spectral imaging mode. In the spectral imaging mode, the plenoptic image captured by the sensor array 350 contains spectral information and may be processed to provide two or more different spectral images of the object 310. In one embodiment, spectral imaging can be enabled by placing a filter module at a pupil plane conjugate of the plenoptic otoscope, as shown in
a-c show different placements of the filter module. In
In one implementation of
In one embodiment, the plenoptic otoscope is switchable between the depth imaging mode and the spectral imaging mode. In one approach, a clear filter is used for the depth imaging mode and one or more different spectral filters are used for the spectral imaging mode. To switch between the two modes, the filter module 315 could include one section that is clear and another section that contains the spectral filters. The filter module could be translated relative to the primary imaging system, so that the appropriate section is illuminated. An example of this type of filter module is shown in
In
In
This particular filter module has RGB filters for color imaging, plus a yellow filter since yellowish or amber color of tissue is an indicator, and is only shown as an example. In one embodiment, the filter module may include a plurality of different spectral filters. Filters having different colors and/or layouts may also be used in the filter module. For example, see U.S. patent application Ser. No. 13/040,809, filed on May 4, 2011, which is hereby incorporated by reference in its entirety.
Spectral imaging is useful to help distinguish different ear conditions. Some of the ear conditions are shown in
a-c show some additional filter modules. In
c has an array of filters. The center stripe includes three spectral filters: yellow, amber and a third spectral filter. These can be used for spectral imaging. The top right and top left filters are polarization filters, for example to reduce reflections. The polarization filters may also be useful in extracting illumination characteristics (e.g., when the illumination light has a certain degree of polarization). The middle right and middle left filters are transparent, for example for use in extracting depth information (e.g., depth imaging). The bottom right and bottom left filters are neutral density filters of different densities, for example to increase the dynamic range of the plenoptic otoscope.
a-b show a plenoptic otoscope system, introducing notation that will be used to describe different design considerations.
As shown in
In many conventional otoscopes, the magnification of the primary imaging system is set such that the entire tympanic membrane (TM) can be imaged onto the sensor array 350 (as seen in
The average diameter for the TM of an adult is h=7 mm. Here we define optical system specifications for the example of a ⅓″ sensor array with width W=4.6 mm and height H=3.7 mm. For this sensor array, the magnification for the primary imaging system is given by M=3.7 mm/7 mm=0.53. Such a magnification is typical for a conventional otoscope. In contrast, a microscope typically has a much larger magnification (>20), and a consumer camera imaging people or natural scenes typically has a much smaller magnification.
The total magnification of the primary imaging system is M=M1*M2, where M1 is the magnification of the first lens group, and M2 is the magnification of the second lens group. For illustration purposes, assume M2=1. In other approaches, M2 can be any suitable number other than 1. In the example where M2=1, M1=M. The working F-number, Nw, of the first lens group with magnification M is defined as Nw=(1+M)N, where Nis the F-number of the primary imaging system (i.e., N=f/D1, where D1 is the diameter of the entrance pupil of the primary imaging system, and f is the effective focal length of the primary imaging system.). In one embodiment, the primary imaging system of the plenoptic otoscope is faster than F/8.
The working distance, z1, for the otoscope is the distance between the object and the first lens group. For imaging a TM, a typical working distance is 27-30 mm. The bones behind the TM are located approximately up to a distance of 15 mm from the TM. As a result, the working distance may vary, for example, from 27 mm up to 45 mm. For illustration purposes, assume the working distance z1=30 mm. The entrance pupil is located in the narrow tip of the otoscope close to the first lens group, and is generally smaller than the tip of the otoscope. The tip of an otoscope has a typical diameter of 4-5 mm in order to fit into an ear canal. Let's assume the entrance pupil to have a diameter of 2 mm. Then the effective focal length of the first lens group is f=N*D1=10.4 mm. The second lens group relays the image of the first lens group onto an intermediate image plane, where the microlens array 340 is positioned. The sensor array 350 is positioned at a distance z3′ behind the microlens array 340 to capture the plenoptic image.
In one embodiment, the object is located near the hyperfocal distance of the first lens group. The hyperfocal distance is a distance beyond which all objects can be brought into an acceptable focus. Mathematically, the hyperfocal distance may be expressed as p=f2/(N c) +f, where f is the effective focal length, N is the F-number, and c is the circle of confusion diameter limit. In one implementation, the numerical aperture of a microlens matches the image-side numerical aperture of the primary imaging system. That means the working F-number of the primary imaging system matches the F-number of the microlens. Furthermore, the distance z3′ is chosen to be equal to the focal length of the microlens. In this configuration, the depth of field is bounded only in one direction, and therefore may be particularly suitable for imaging distant objects.
In one embodiment, the object is placed at a distance z1 away from the entrance pupil of the first lens group. The distance z2 between the exit pupil of the first lens group and the relay plane is determined by the lens equation as: z2=1/(1/f1−1/z1), where f1 is the effective focal length of the first lens group.
The relationship between the first lens group and the second lens group is given by D1exit/D1′=z2/z1′, where D1exit is the diameter of the exit pupil of the first lens group, D1′ is the diameter of the entrance pupil of the second lens group, and z1′ is the distance between the relay plane and the entrance pupil of the second lens group.
The distance z2′ between the exit pupil of the second lens group and the intermediate image plane is determined by the lens equation as: z2′=1/(1/f1′−1/z1′), where f1′ is the effective focal length of the second lens group.
The distance z3′ between the microlens array and the sensor array is chosen such that z3′=z2′×Mmicrolens. Here Mmicrolens=D2/D1′exit is the magnification of the microlens sub-system, where D2 is the diameter of the microlens (as shown in
In one embodiment, the filter module 315 is inserted at the aperture of the second lens group, as depicted in
Although the detailed description contains many specifics, these should not be construed as limiting the scope of the invention but merely as illustrating different examples and aspects of the invention. It should be appreciated that the scope of the invention includes other embodiments not discussed in detail above. For example, although the illumination sources have been described in the context of plenoptic otoscopes, they can also be used with conventional otoscopes. The illumination sources can also produce different types of illuminating light, including broadband or narrowband illumination in the ultraviolet, visible and/or near infrared spectrum. Various other modifications, changes and variations which will be apparent to those skilled in the art may be made in the arrangement, operation and details of the method and apparatus of the present invention disclosed herein without departing from the spirit and scope of the invention.
This application claims priority under 35 U.S.C. §119(e) to U.S. Provisional Patent Application Ser. No. 61/949,117, “Otoscope illumination,” filed Mar 6, 2014. The subject matter of the foregoing is incorporated herein by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
61949117 | Mar 2014 | US |