COMPACT INTRAORAL 3D SCANNER

Abstract
An apparatus for determining surface topography of a patient's teeth comprises a probe sized to be at least partially inserted into an intraoral cavity of the patient, a light source to output light; and a light focusing assembly. The light focusing assembly comprises a first lens, a second lens and a focus changing assembly comprising one or more additional lenses that shares an optical axis with the first lens and the second lens and being configured to focus the light to a plurality of external focal planes to illuminate the patient's teeth, wherein the focus changing assembly has a movement gain factor, and wherein as a result of the movement gain factor a change in separation between lenses of the focus changing assembly by a first distance results in a change in a focus setting by a second distance that is 2-10 times greater than the first distance. The apparatus further comprises a detector configured to measure one or more characteristics of incident light returning from the illuminated patient's teeth and a processor coupled to the detector and configured to generate data representative of a topography of the patient's teeth based on the one or more measured characteristics of the incident light returning from the illuminated patient's teeth.
Description
BACKGROUND

A variety of approaches have been developed for measuring surface topography optically. For example, optical systems and methods have been developed and employed that can be used to optically measure surface topography of a patient's teeth. The measured surface topography of the teeth can be used, for example, to design and manufacture a dental prosthesis and/or to determine an orthodontic treatment plan to correct a malocclusion.


One technique for measuring surface topography optically employs laser triangulation to measure distance between a surface of the tooth and an optical distance probe, which is inserted into the oral cavity of the patient. Surface topography measured via laser triangulation, however, may be less accurate than desired due to, for example, sub-optimal reflectivity from the surface of the tooth.


Other techniques for measuring surface topography optically, which are embodied in CEREC-1 and CEREC-2 systems commercially available from Siemens GmbH or Sirona Dental Systems, utilize the light-section method and phase-shift method, respectively. Both systems employ a specially designed hand-held probe to measure the three-dimensional coordinates of a prepared tooth. Both of these approaches, however, require a specific coating (i.e. measurement powder and white-pigments suspension, respectively) to be deposited to the tooth. The thickness of the coating layer should meet specific, difficult to control requirements, which leads to inaccuracies in the measurement data.


In yet another technique, mapping of teeth surface is based on physical scanning of the surface by a probe and by determining the probe's position, e.g., by optical or other remote sensing means.


U.S. Pat. No. 5,372,502 discloses an optical probe for three-dimensional surveying. Various patterns are projected onto the tooth or teeth to be measured and corresponding plurality of distorted patterns are captured by the optical probe. Each captured pattern provides refinement of the topography.


SUMMARY

Apparatus and methods for optically determining surface topography of three-dimensional structures are provided. In many embodiments, an apparatus for optically determining surface topography includes a light focusing assembly operable to vary focal depth of light beams incident upon the three-dimensional structure (e.g., a patient's dentition) being measured. The light focusing assemblies disclosed herein provide variation of focal depth with minimal or no moving parts, which provides smaller, faster, and more compact optics.


In one aspect, an apparatus is described for determining surface topography of a three-dimensional structure. In many embodiments, the apparatus includes a light focusing assembly. The light focusing assembly can be configured to overlap the light beams within a focus changing assembly in order to move external focal points of the light beams along a direction of propagation of the light beams. Characteristics of light reflected from the measured structure can be measured. The measured characteristics can be used to generate data representative of topography of the structure.


In another aspect, an apparatus is described for determining surface topography of a three-dimensional structure. In many embodiments, the apparatus includes a light focusing assembly. The light focusing assembly can include a convergent lens and a divergent lens. The separation between the convergent lens and divergent lens can be varied in order to displace external focal points of the light beams along a direction of propagation of the light beams. Characteristics of light reflected from the measured structure can be measured. The measured characteristics can be used to generate data representative of topography of the structure.


Other objects and features of the present invention will become apparent by a review of the specification, claims, and appended figures.


INCORPORATION BY REFERENCE

All publications, patents, and patent applications mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent, or patent application was specifically and individually indicated to be incorporated by reference.





BRIEF DESCRIPTION OF THE DRAWINGS

The novel features of the invention are set forth with particularity in the appended claims. A better understanding of the features and advantages of the present invention will be obtained by reference to the following detailed description that sets forth illustrative embodiments, in which the principles of the invention are utilized, and the accompanying drawings of which:



FIGS. 1A and 1B schematically illustrate, by way of a block diagram, an apparatus in accordance with many embodiments (FIG. 1B is a continuation of FIG. 1A);



FIG. 2A is a top view of a probing member, in accordance with many embodiments;



FIG. 2B is a longitudinal cross-section through line II-II in FIG. 2A, depicting exemplary rays passing therethrough;



FIG. 3 illustrates a telescopic light focusing assembly, in accordance with many embodiments;



FIG. 4 illustrates a light focusing assembly with a variable optical power element, in accordance with many embodiments;



FIG. 5 illustrates a light focusing assembly with a focus changing lens group, in accordance with many embodiments;



FIG. 6 is a simplified block diagram presenting acts of a method for determining surface topography of a three-dimensional structure, in accordance with many embodiments;



FIG. 7 illustrates a telescopic light focusing assembly, in accordance with many embodiments;



FIG. 8 illustrates a compact light focusing assembly, in accordance with many embodiments;



FIG. 9 illustrates a compact light focusing assembly and an optical probe, in accordance with many embodiments; and



FIG. 10 is a simplified block diagram presenting acts of a method for determining surface topography of a three-dimensional structure, in accordance with many embodiments.





DETAILED DESCRIPTION

In many embodiments, an apparatus for optically determining surface topography includes a light focusing assembly that is configured to controllably vary focal depth of light beams that are projected towards a three-dimensional structure (e.g., a patient's dentition) being measured. In contrast to conventional approaches that employ substantial movement of optical components, the light focusing assemblies disclosed herein employ few if any moving parts, thereby being smaller, faster, and more compact. Furthermore, the apparatus and methods disclosed herein for optically determining surface topography can be used to vary the focal depth of the light beams while maintaining telecentricity. Telecentric optics produce constant image magnification independent of the object distance over a defined telecentric range, and can therefore be advantageous for improving the accuracy of optical measurement systems.


The apparatus and methods described herein can be used to take optical measurements of the surfaces of any suitable three-dimensional structure. In many embodiments, optical measurements are taken to generate data representing the three-dimensional surface topography of a patient's dentition. The data can be used, for example, to produce a three-dimensional virtual model of the dentition that can be displayed and manipulated. The three-dimensional virtual models can be used to, for example, define spatial relationships of a patient's dentition that are used to create a dental prosthesis (e.g., a crown or a bridge) for the patient. The surface topography data can be stored and/or transmitted and/or output, such as to a manufacturing device that can be used to, for example, make a physical model of the patient's dentition for use by a dental technician to create a dental prosthesis for the patient.


In one aspect, an apparatus is provided for determining surface topography of a three-dimensional structure. The apparatus can include a probe, such as a probing member sized for insertion into the intraoral cavity. The apparatus can include an illumination unit configured to output a plurality of light beams. The light beams can propagate toward the structure along an optical path through the probe to generate illuminated spots on the structure. The surface of the structure reflects the incident light beams thereby producing a plurality of returning light beams. The apparatus can further include a detector configured to measure a characteristic of each of the plurality of light beams returning from the illuminated spots. Such characteristics can include, for example, intensity, wavelength, polarization, phase shift, interference, and/or dispersion of the returning light beams. Any description herein relating to light intensity can also be applied to other suitable characteristics of light, and vice-versa. The measurements of the characteristic(s) can be used to detect whether the incident light beams are focused on the surface of the structure and thereby determine the distance between the optical probe and the three-dimensional structure.


A processor can be coupled to the detector to generate data representative of the topography of the structure based on measured characteristics of each of a plurality of light beams returning from the illuminated spots. For example, the surface topography of the structure can be determined based on measuring the intensities of the returning light beams. In many embodiments, the apparatus is configured such that the intensity of any particular light beam returning from the structure is maximized when the incident light beam is focused on the surface of the structure, thus relating the magnitude of the intensity signal to the focal depth of the apparatus. Consequently, the relative depth of each point on the surface of the structure can be determined by scanning the light beams through a range of focal depths and identifying the focal depth at which the peak intensity signal is obtained. The surface topography of the structure can thus be determined by repeating this process for each point on the structure.


As another example, the surface topography can be determined by using spatial frequency analysis to identify which regions of the structure are in focus. In many embodiments, focused regions will contain higher spatial frequencies than out of focus regions. Accordingly, a distance between the probe and a specified region on the structure for a particular position and orientation of the probe relative to the structure can be determined by identifying when the spatial frequencies of the region are maximized. This approach can be applied to determine the surface topography of structures having spatial details.


In order to scan the focus the light beams through the range of focal depths, the apparatus can include a light focusing assembly. The light focusing assembly can be configured to focus each of a plurality of the light beams to a respective external focal point. The light beams may emanate from the probe at a location disposed between the respective external focal point and the light focusing assembly. To scan the focus of the light beams through the range of focal depths, the light focusing assembly can also be configured to overlap a plurality of the light beams within a focus changing assembly. The focus changing assembly can be operated to displace the external focal points along a direction of propagation of the light beams.


Many configurations are possible for the light focusing assembly and focus changing assembly. For example, at a least a portion of the focus changing assembly can be located at a back focal length of an objective lens of the light focusing assembly in order to inhibit changes in spacing between external focal points of the plurality of light beams when the external focal points move along the direction of propagation of the light beams. Alternatively or in combination, the focus changing assembly can be located along optical paths of the plurality of light beams such that a majority of the plurality of light beams overlaps with other light beams of the plurality along at least a portion of the focus changing assembly in order to inhibit changes in spacing between external focal points of the plurality of light beams when the external focal points move along the direction of propagation of the light beams. Each of the plurality of light beams may comprise a substantially collimated configuration upon entering the focus changing assembly. The focus changing assembly can similarly adjust each of the plurality of light beams to a convergent configuration, a collimated configuration, or a divergent configuration upon exiting the focus changing assembly in order to move the external focal points along the direction of propagation of the light beams. For instance, the focus changing assembly may move the external focal points at least 10 mm.


In many embodiments, the light focusing assembly includes one or more image space lenses and one or more object space lenses, with the focus changing assembly located along an optical path between the one or more image space lenses and the one or more object space lenses. The one or more object space lenses may comprise a telecentric lens and at least a portion of the focus changing assembly may be located at a back focal length of the telecentric lens. The one or more image space lenses may comprise a focal length and location arranged to overlap and substantially collimate the plurality of light beams passing through the focus changing assembly.


In many embodiments, the focus changing assembly includes a variable optical power element operable to move the external focal points without movement of the variable optical power element. The variable optical power element can be operated at a suitable frequency so as to oscillate separation between the external focal points and the probe by a desired range. For example, the variable optical power element may be operable to oscillate separation between the external focal points and the probe by at least 10 mm at a frequency greater than 10 Hz, or at a frequency from approximately 50 Hz to approximately 100 Hz.


Alternatively or in combination, the focus changing assembly can comprise a focus changing group of lenses in which the separation between lenses is varied to displace the external focal points through the range of focal depths. For example, the focus changing group of lenses can include a divergent lens and a convergent lens, with separation between the divergent lens and convergent lens being varied to displace the external focal points. In many embodiments, a change in separation between the lenses of the focus changing group of lenses results in a change in separation between the external focal points and the probe that is greater than the change in separation between the lenses. For example, the focus changing assembly can move the external focal points over a distance that is at least two times greater than a corresponding distance moved by at least a portion of the focus changing assembly. The change in separation between the lenses of the focus-changing group may result in a change in separation between the external focal points and the probe of at least 5 times or approximately 7.5 times the change in separation between the lenses of the focus changing group of lenses. Additionally, in many embodiments, the variable optical power element or the focus changing group lenses is operable to oscillate separation between the external focal points and the probe by a suitable distance and at a suitable frequency. For instance, the focus changing group of lenses may be operable to oscillate separation between the external focal points and the probe by at least 10 mm at a frequency greater than 10 Hz, or by at least 15 mm at a frequency from approximately 10 Hz to approximately 100 Hz.


In another aspect, a method is provided for determining surface topography of a three-dimensional structure. The method includes generating illuminated spots on the structure using a light focusing assembly to receive and focus each of a plurality of light beams to a respective external focal point external to a probe sized to be inserted into an intraoral cavity of a patient. The light focusing assembly can be operated to overlap each of the plurality of light beams within a focus changing assembly. The focus changing assembly can be operated to displace the external focal points along a direction of propagation of the plurality of light beams. The surface of the structure can reflect the light from the illuminated spots thereby producing a plurality of returning light beams. A characteristic of each of a plurality of light beams returning from the illuminated spots can be measured. Based on the measured characteristics, data representative of topography of the structure can be generated, as previously described herein.


In another aspect, an apparatus is provided for determining surface topography of a three-dimensional structure. The apparatus can include a probe, such as a probing member sized for insertion into the intraoral cavity. The apparatus can include an illumination unit configured to output an array of light beams. The light beams can propagate toward the structure along an optical path through the probe to generate illuminated spots on the structure. The surface of the structure can reflect the light from the illuminated spots thereby producing a plurality of returning light beams. The apparatus can further include a detector configured to measure a characteristic of each of the plurality of light beams returning from the illuminated spots. A processor can be coupled to the detector to generate data representative of the topography of the structure based on measured characteristics of each of a plurality of light beams returning from the illuminated spots, as previously described herein. The characteristic may comprise an intensity, for example.


To scan the focus of the light beams through the range of focal depths, the apparatus can include a light focusing assembly that includes a convergent lens and a divergent lens. The light focusing assembly can be configured to overlap each of the plurality of light beams to a system aperture disposed between the light focusing assembly and a location where the light beams emanate from the probe. The light focusing assembly can be operable to vary separation between the convergent lens and divergent lens to vary separation between the probe and an external focal point for each of the plurality of the light beams. In many embodiments, a change in separation between the convergent lens and the divergent lens results in a change in separation between the external focal points and the probe that is greater than the change in separation between the convergent lens and the divergent lens (e.g., at least 2 times or at least 4 times greater). In many embodiments, the divergent lens is disposed between the convergent lens and the system aperture. The apparatus can further include a telecentric lens disposed on the optical path between the system aperture and the external focal points.


In another aspect, a method is provided for determining surface topography of a three-dimensional structure. The method includes generating an array of light beams that propagate along an optical path to form illuminated spots on the structure. The optical path passes through a convergent lens, a divergent lens, and a probe sized to be inserted into an intraoral cavity of a patient. The divergent lens can be disposed between the convergent lens and a location where the light beams emanate from the probe. The surface of the structure reflects light from the illuminated spots thereby producing a plurality of returning light beams. A characteristic of each of a plurality light beams returning from the structure is measured. Based on the measured characteristic, data representative of topography of the structure is generated, as previously described herein. To scan the focus of the light beams through the range of focal depths, the separation between the convergent lens and the divergent lens is varied to vary separation between the probe and respective external focal points of each of a plurality of the light beams.


Turning now to the drawings, in which like numbers designate like elements in the various figures, FIGS. 1A and 1B illustrate an apparatus 20 for measuring surface topography optically. The apparatus 20 includes an optical device 22 coupled to a processor 24. The illustrated embodiment is particularly useful for measuring surface topography of a patient's teeth 26. For example, the apparatus 20 can be used to measure surface topography of a portion of the patient's teeth where at least one tooth or portion of tooth is missing to generate surface topography data for subsequent use in design and/or manufacture of a prosthesis for the patient (e.g., a crown or a bridge). It should be noted, however, that the invention is not limited to measuring surface topography of teeth, and applies, mutatis mutandis, also to a variety of other applications of imaging of three-dimensional structure of objects (e.g., for the recordal of archeological objects, for imaging of a three-dimensional structure of any suitable item such as a biological tissue, etc.).


The optical device 22 includes, in the illustrated embodiment, a light source 28 (e.g., a semiconductor laser unit) emitting a light, as represented by arrow 30. The light passes through a polarizer 32, which causes the light passing through the polarizer 32 to have a certain polarization. The light then enters into an optic expander 34, which increases the diameter of the light beam 30. The light beam 30 then passes through a module 38, which can, for example, be a grating or a micro lens array that splits the parent beam 30 into a plurality of light beams 36, represented here, for ease of illustration, by a single line.


The optical device 22 further includes a partially transparent mirror 40 having a small central aperture. The mirror 40 allows transfer of light from the light source 28 through the downstream optics, but reflects light travelling in the opposite direction. It should be noted that in principle, rather than a partially transparent mirror, other optical components with a similar function may be used (e.g., a beam splitter). The aperture in the mirror 40 improves the measurement accuracy of the apparatus. As a result of this mirror structure, the light beams produce a light annulus on the illuminated area of the imaged object as long as the area is not in focus. The annulus becomes a sharply-focused illuminated spot when the light beam is in focus relative to the imaged object. Accordingly, a difference between the measured intensity when out-of-focus and in-focus is larger. Another advantage of a mirror of this kind, as opposed to a beam splitter, is that internal reflections that occur in a beam splitter are avoided, and hence the signal-to-noise ratio is greater.


The optical device 22 further includes confocal optics 42, typically operating in a telecentric mode, relay optics 44, and an endoscopic probe member 46. In many embodiments, the confocal optics 42 is configured to avoid distance-introduced magnification changes and maintain the same magnification of the image over a wide range of distances in the Z direction (the Z direction being the direction of beam propagation). In many embodiments, the confocal optics 42 are telecentric, and can even be double telecentric. Double telecentric confocal optics (telecentric in both image space and object space) can provide improved optical measurement accuracies compared to non-telecentric optics or optics telecentric in image space or object space only. Exemplary embodiments of a light focusing assembly that can be included in the confocal optics 42 are described below. In many embodiments, the relay optics 44 is configured to maintain a certain numerical aperture of the light beam's propagation.


The endoscopic probe member 46 can include a light-transmitting medium, which can be a hollow object defining within it a light transmission path or an object made of a light transmitting material (e.g., a glass body or tube). The light-transmitting medium may be rigid or flexible (e.g., fiber optics). In many embodiments, the endoscopic probe member 46 includes a mirror of the kind ensuring total internal reflection and directing the incident light beams towards the patient's teeth 26. The endoscope 46 thus emits a plurality of incident light beams 48 impinging on to the surface of the patient's teeth 26.


The incident light beams 48 form an array of light beams arranged in an X-Y plane, relative to a Cartesian reference frame 50, and propagating along the Z-axis. When the incident light beams 48 are incident upon an uneven surface, resulting illuminated spots 52 are displaced from one another along the Z-axis, at different (Xi, Yi) locations. Thus, while an illuminated spot 52 at one location may be in focus for a given focal length produced by the confocal optics 42, illuminated spots 52 at other locations may be out-of-focus. Therefore, the light intensity of the returned light beams of the focused spots will be at its peak, while the light intensity at other spots will be off peak. Thus, for each illuminated spot, a plurality of measurements of light intensity are made at different positions along the Z-axis and for each of such (Xi, Yi) locations, typically the derivative of the intensity over distance (Z) will be made, and the Zi distance yielding the maximum derivative, Z0, will be the in-focus distance. As pointed out above, where, as a result of use of the punctured mirror 40, the incident light forms a light disk on the surface when out of focus and a sharply-focused light spot only when in focus, the distance derivative will be larger when approaching in-focus position thus increasing accuracy of the measurement.


The light reflected from each of the illuminated spots 52 includes a beam travelling initially in the Z axis in the opposite direction of the optical path traveled by the incident light beams. Each returned light beam 54 corresponds to one of the incident light beams 36. Given the asymmetrical properties of mirror 40, the returned light beams 54 are reflected in the direction of a detection assembly 60. The detection assembly 60 includes a polarizer 62 that has a plane of preferred polarization oriented normal to the polarization plane of polarizer 32. The returned polarized light beam 54 pass through imaging optics 64, typically a lens or a plurality of lenses, and then through an array of pinholes 66. Each returned light beam 54 passes at least partially through a respective pinhole of the array of pinholes 66. A sensor array 68, which can be a charge-coupled device (CCD) or any other suitable image sensor, includes a matrix of sensing elements. In many embodiments, each sensing element represents a pixel of the image and each sensing element corresponds to one pinhole in the array 66.


The sensor array 68 is connected to an image-capturing module 80 of the processor unit 24. The light intensity measured by each of the sensing elements of the sensor array 68 is analyzed, in a manner described below, by the processor 24. Although the optical device 22 is depicted in FIGS. 1A and 1B as measuring light intensity, the device 22 can also be configured to measure other suitable characteristics (e.g., wavelength, polarization, phase shift, interference, dispersion), as previously described herein.


The optical device 22 includes a control module 70 that controls operation of the light source 28 and/or a motor 72. In many embodiments, the motor 72 is drivingly coupled with the confocal optics 42 so as to scan the focus of the light beams through a range of focal depths along the Z-axis. In a single sequence of operation, the control unit 70 induces motor 72 to reconfigure the confocal optics 42 to change the focal plane location and then, after receipt of a feedback signal that the location has changed, the control module 70 induces the light source 28 to generate a light pulse. The control module 70 synchronizes the operation of the image-capturing module 80 with the operation of the confocal optics 42 and the light source 28 during acquisition of data representative of the light intensity (or other characteristic) from each of the sensing elements. Then, in subsequent sequences, the confocal optics 42 causes the focal plane to change in the same manner and intensity data acquisition continues over a range of focal lengths.


The intensity data is processed by the processor 24 per processing software 82 to determine relative intensity in each pixel over the entire range of focal planes of confocal optics 42. As explained above, once a certain light spot is in focus on the three-dimensional structure being measured, the measured intensity of the returning light beam will be maximal. Thus, by determining the Zi corresponding to the maximal light intensity or by determining the minimum derivative of the light intensity, for each pixel, the relative in-focus focal length along the Z-axis can be determined for each light beam. Thus, data representative of the three-dimensional topography of the external surfaces of the teeth is obtained. A resulting three-dimensional representation can be displayed on a display 84 and manipulated for viewing (e.g., viewing from different angles, zooming-in or out) by a user control module 85 (e.g., utilizing a computer keyboard, mouse, joystick, or touchscreen). In addition, the data representative of the surface topography can be transmitted through an appropriate data port such as, for example, a modem 88 or any suitable communication network (e.g., a telephone network) to a recipient (e.g., to an off-site CAD/CAM apparatus).


By capturing, in this manner, relative distance data between the probe and the structure being measured from two or more angular locations around the structure (e.g., in the case of a teeth segment, from the buccal direction, lingual direction and/or optionally from above the teeth), an accurate three-dimensional representation of the structure can be generated. The three-dimensional data and/or the resulting three-dimensional representation can be used to create a virtual model of the three-dimensional structure in a computerized environment and/or a physical model fabricated in any suitable fashion (e.g., via a computer controlled milling machine, a rapid prototyping apparatus such as a stereolithography apparatus).


As already pointed out above, a particular and preferred application is imaging of a segment of teeth having at least one missing tooth or a portion of a tooth. The resulting three-dimensional surface topography data can, for example, be used for the design and subsequent manufacture of a crown or any other prosthesis to be fitted into this segment.


Referring now to FIGS. 2A and 2B, a probing member 90 is illustrated in accordance with many embodiments. In many embodiments, the probing member 90 forms at least a portion of the endoscope 46. The probing member 90 may be sized to be at least partially inserted into a patient's intraoral cavity. The probing member 90 can be made of a light transmissive material (e.g., glass, crystal, plastic, etc.) and includes a distal segment 91 and a proximal segment 92, tightly glued together in an optically transmissive manner at 93. A slanted face 94 is covered by a reflective mirror layer 95. A transparent disk 96 (e.g., made of glass, crystal, plastic, or any other suitable transparent material) defining a sensing surface 97 is disposed along the optical path distal to the mirror layer 95 so as to leave an air gap 98 between the transparent disk 96 and the distal segment 91. The transparent disk 96 is fixed in position by a holding structure (not shown). Three light rays 99 are represented schematically. As can be seen, the light rays 99 reflect from the walls of the probing member 90 at an angle in which the walls are totally reflective, reflect from the mirror layer 95, and then propagate through the sensing face 97. The light rays 99 are focused on a focusing plane 100, the position of which can be changed by the confocal optics 42.


In many embodiments, the confocal optics 42 includes a telescopic light focusing assembly. The telescopic light focusing assembly is configured and operable to scan the focal points of the light beams through a range of focal depths. Scanning the focal points through a range of focal depths is accomplished in order to determine the in-focus distance for each of the light beams relative to the surface being measured, as previously described herein.



FIG. 3 illustrates a telescopic light focusing assembly 200, in accordance with many embodiments, that can be included in the confocal optics 42. The light focusing assembly 200 is configured and operable to scan the focal points of a plurality of light beams (e.g., a two-dimensional array of light beams) through a range of focal depths. The light focusing assembly 200 can include an image space lens group 202 and an object space lens group 204. The light focusing assembly 200 can be configured and operable to focus the light beams on to an external focal plane 206 (e.g., external to the endoscopic probe member 46) and controllably scan the location of the external focal plane 206 relative to the endoscopic probe member 46. The light beam chief rays may cross the optical axis at the back focal plane of the object space group 204 that is disposed between the image space group 202 and the object space group 204. A system aperture 208 may be situated at or near the back focal plane. An aperture stop (APS) 210 may be positioned at or near the system aperture 208. In many embodiments, the aperture stop 210 includes a circular opening in a physical light blocking plane and is used to define the beam width and, hence, the Numerical Aperture (NA) of the optical system.


Each of the image space lens group 202 and object space lens group 204 can each include one or more lenses. For example, in many embodiments, each of the image space lens group 202 and object space lens group 204 have a single convergent lens (e.g., a biconvex lens). “Lens” may be used herein to refer an element having a single lens or multiple lenses (e.g., doublet or triplet lenses).


To change the relative distance between the endoscopic probe member 46 and the external focal plane 206, the distance between the object space lens group 204 and the image space lens group 202 can be changed, for example, by a mechanism driven by the motor 72. The mechanism may displace one or more of the object space lens group 204 or image space lens group 202 along the direction of beam propagation along the optical axis of the optical system, also called the symmetry axis. By changing the distance between the object space lens group 204 and the image space lens group 202, the external focal plane 206 is displaced along the direction of beam propagation. The external focal plane 206 can be displaced to any suitable position, such as to a near focus position 212, an intermediate focus position 214, or a far focus position 216, by moving the object space lens group 204 along the symmetry axis.


In a telescopic light focusing assembly, telecentricity may be compromised when the external focal plane 206 is displaced due to displacement of the object space lens group 204 relative to the APS 210. The displacement of the object space lens group 204 relative to the APS 210 results in the light rays being refracted by different portions of the object space lens group 204.



FIG. 4 illustrates a light focusing assembly 220, in accordance with many embodiments, that can be included in the confocal optics 42. The light focusing assembly 220 can include an image space lens group 202, an object space lens group 204, and a focus changing assembly 222 disposed along an optical path between the image and object space lens groups, such as at or near a system aperture 208. At least one lens element of the image space lens group 202 or object space lens group 204 may be a telecentric lens. One or more optical components of the light focusing assembly 220 can be configured to overlap the plurality of light beams within the focus changing assembly 222. For instance, at least one lens element of the image space lens group 202 may comprise a focal length and location arranged to overlap and substantially collimate the light beams passing through the focus changing assembly 222.


The light focusing assembly 220 can be operable to displace the external focal plane 206 without moving the object space lens group 204 relative to the image space lens group 202. The external focal plane 206 can be displaced along the symmetry axis (e.g., to near, intermediate, and far focus positions) by varying the optical power of the focus changing assembly 222. Accordingly, the light focusing assembly 220 can maintain telecentricity and magnification even when shifting the location of the external focal plane 206. In many embodiments, the positioning and configuration of the focus changing assembly inhibits changes in spacing between external focal points of the external light beams when the external focal points are moved along the direction of propagation of the light beams. For example, the focus changing assembly 222 can be located at or near a back focal length of an objective lens (e.g., object space lens group 204) of the light focusing assembly 220. Alternatively or in combination, the focus changing assembly 222 can be located along the optical paths of the plurality of light beams such that a majority of the plurality of light beams overlap other light beams of the plurality along at least a portion of the focus changing assembly 222. Each of the plurality of light beams may comprise a substantially collimated configuration upon entering the focus changing assembly 222. The focus changing assembly 222 may similarly adjust each of the plurality of light beams to a convergent configuration, a substantially collimated configuration, or a divergent configuration upon exiting the focus changing assembly 222.


In the embodiment illustrated in FIG. 4, the focus changing assembly 220 includes a variable optical power element 224. The variable optical power element 224 can be any suitable optical element having a controllably variable optical power. For example, the variable optical power element 224 can include a variable power lens element or a liquid lens element, such as a liquid lens providing close focus ability and lower power consumption. The liquid lens may be electrically tunable to change the optical power, such as by applying a suitable current (e.g., within a range from 0 mA to 300 mA). In many embodiments, the variable optical power element 224 includes a high refractive index material and a low refractive index material, and an interface between the materials (e.g., a meniscus) may be varied to adjust the optical power. The optical power of the variable optical power element 224 can be varied by any suitable amount, such as by approximately 2 diopters, 5 diopters, 10 diopters, 15 diopters, 20 diopters, or 30 diopters. The optical power of the optical power element 224 can be varied over any suitable range, such as a range between any two of the following: 5 diopters, 8 diopters, 10 diopters, 15 diopters, 16.5 diopters, 20 diopters, 22 diopters, 25 diopters, or 50 diopters. The variable optical power element 224 can be operable to move the external focal plane 206 without movement of the variable optical power element 224 (e.g., without movement along the symmetry axis and/or without movement relative to the other components of the light focusing assembly 220). Accordingly, the light focusing assembly 220 can provide scanning of the external focal plane 206 without any moving optical parts.



FIG. 5 illustrates another light focusing assembly 230, in accordance with many embodiments, that can be included in the confocal optics 42. Similar to the light focusing assembly 220 illustrated in FIG. 4, the light focusing assembly 230 includes an image space lens group 202, an object space lens group 204, and a focus changing assembly 232, which may be disposed at a system aperture 208. The light focusing assembly 230 may receive a plurality of light beams and overlap the light beams within the focus changing assembly 232, as described above. In the light focusing assembly 230, however, the focus changing assembly 232 includes a focus changing lens group 234 instead of a variable optical power element. The optical power of the focus changing lens group 234 can be varied by relative movement between lens elements of the focus changing lens group 234. The relative movement between lens elements of the focus changing lens group 234 can include displacing any suitable component of the focus changing group, such as a single lens element, multiple lens elements, one or more portions of a lens element, one or more portions of multiple lens elements, or any suitable combination. For example, the focus changing group can be a pair of lenses and the movement can be a change in separation between the lenses (e.g., along the symmetry axis). By varying the optical power of the focus changing lens group 234, the external focal plane 206 is displaced along the symmetry axis (e.g., to near, intermediate, and far focus positions).


In the embodiment illustrated in FIG. 5, the focus changing lens group 234 includes a convergent lens 236 (e.g., a biconvex lens) and a divergent lens 238 (e.g., a biconcave lens). The optical power of the focus changing lens group 234 can be changed by varying the separation between the convergent lens 236 and the divergent lens 238. While the focus changing lens group 234 is illustrated as having one convergent lens and one divergent lens, a suitable focus changing lens group can include any suitable combination of lens elements in which relative movement between the lens elements effects a change in optical power.


In many embodiments, the movement of lens elements of the focus changing lens group 234 is small relative to the resulting displacement of the external focal plane 206. For example, an approximately 0 mm to approximately 2 mm movement of the focusing changing lens group 234 may produce an approximately 15 mm movement of the external focal plane 206. The light focusing assembly 230 can be configured such that a change in separation between lens elements of the focus changing lens group 234 results in at least a 2-, 3-, 4-, 5-, 7.5-, or 10-fold larger change in separation between the external focal plane 206 and the endoscopic probe member 46. In many embodiments, the displacement of the external focal plane 206 is approximately 2, 3, 4, 5, 7.5, or 10 times larger than the corresponding change in separation between lens elements of the focus changing lens group 234. The ratio of the movement distance of the external focal plane to the corresponding movement distance of the elements of the focusing changing assembly may be referred to herein as the “movement gain factor.” The movement gain factor provided by the focus changing assemblies may be approximately 1, 1.1, 2, 3, 4, 5, 7.5, 10, or 15.



FIG. 6 is a simplified block diagram of acts of a method 300 for determining surface topography of a three-dimensional structure. Any suitable optical assemblies, devices, apparatus, and/or systems, such as suitable embodiments described herein, can be used to practice the method 300.


In act 310, a plurality of light beams is generated. Any suitable device can be used to produce the light beams. For example, referring to FIG. 1A, the apparatus 20 can be used to produce the light beams. The apparatus 20 can include the grating or micro lens array 38, which splits the laser beam 30 emitted by light source 28 into an array of beams 36.


In act 320, the light beams are overlapped within a focus changing assembly. For example, as with the light focusing assembly 220 and with the light focusing assembly 230, the image space lens group 202 can overlap the light beams onto the focus changing assembly 222 and 232, respectively. The focus changing assembly may be disposed at or near a system aperture. Alternatively or in combination, the focus changing assembly may be situated at a back focal length of an objective lens or object space lens group (e.g., a telecentric lens).


In act 330, the focus changing assembly is operated to move the respective external focal points of the light beams. In many embodiments, the focus changing assembly includes a focus changing lens group or a variable optical power element disposed at a system aperture, for example, as in the light focusing assembly 220 or the light focusing assembly 230, respectively. In many embodiments, the external focal points form an external focal plane that can be displaced by varying the optical power of the focus changing assembly. Referring to the endoscopic probe member 46 illustrated in FIG. 2B, in many embodiments, the light beams propagate along an optical path through the endoscopic probe member 46 such that the external focal plane is disposed exterior to the probe (e.g., focusing plane 100). The light beams emanate from the endoscopic probe member 46 at a location disposed between the external focal plane and the light focusing assembly (e.g., sensing face 97). The optical path can be configured to generate an array of illuminated spots on a structure being measured, as illustrated in FIG. 1A by the illuminated spots 52 on the patient's teeth 26.


The external focal points can be displaced to scan the external focal plane through a plurality of focal depths. In many embodiments, the focus changing assembly can be operated to vary the separation distance between the external focal points and the endoscopic probe member 46, such as by oscillating the separation distance through a specified range. For example, the separation distance between the external focal points and the endoscopic probe member 46 can be oscillated by at least 5 mm, at least 10 mm, at least 15 mm, or at least 20 mm. In many embodiments, the oscillation of the separation distance can be within a range of approximately 10 mm to approximately 15 mm. Any suitable oscillation frequency can be used, such as a frequency greater than or equal to approximately 1 Hz, 10 Hz, 20 Hz, 50 Hz, 75 Hz, or 100 Hz. The oscillation frequency may be within a range from approximately 10 Hz to approximately 100 z, or approximately 50 Hz to approximately 100 Hz. In embodiments that employ a focus changing assembly, such as in the light focusing assembly 220 and in the light focusing assembly 230, increased oscillation rates may be achievable relative to the light focusing assembly 200 as a result of the reduced or eliminated movement of light focusing assembly components necessary to displace the external focal plane 206 through the desired distance.


In act 340, the characteristics of a plurality of light beams returning from the structure are measured. For example, as illustrated in FIG. 1A, the returning light beams 54 are reflected by the surface of the structure and each correspond to one of the incident light beams 36 produced by the optical device 22. Any suitable device can be used to measure the characteristics of the returning light beams, such as the sensor array 68. In many embodiments, the measured characteristic is intensity.


In act 350, data representative of topography of the structure is generated based on the measured characteristics, as previously described herein. Any suitable device can be used to receive and generate the data, such as the processor 24 depicted in FIG. 1B.


Table 1 provides an example configuration and operational parameters for the light focusing assembly 200 (hereinafter “telescopic assembly”) illustrated in FIG. 3, the light focusing assembly 220 (hereinafter “variable element assembly”) illustrated in FIG. 4, and the light focusing assembly 230 (hereinafter “moving lens assembly”) illustrated in FIG. 5.









TABLE 1







Example configuration and operational parameters


for light focusing assemblies.












Variable
Moving



Telescopic
Element
Lens



Assembly
Assembly
Assembly
















External focal plane
15
mm
15
mm
15
mm












movement distance







Focusing lens movement
15
mm
0
2
mm


distance















Optical power change
N/A
5
N/A












(diopter)







Typical moving lens
50
grams
N/A
5
grams


weight















Movement gain factor
1
N/A
7.5













Maximum oscillation
1
Hz
100
Hz
20
Hz










frequency












For each of the three systems in Table 1, the external focal plane is displaced by 15 mm. In the telescopic assembly, a 15 mm movement of an object space lens group weighing 50 g can be used to produce a 15 mm displacement of the external focal plane, for a movement gain factor of 1. The object space lens group can be oscillated at a maximum frequency of approximately 1 Hz. In the variable element assembly, a 5 diopter change in the optical power of a variable optical power lens element without movement of any optical elements can be used to produce a 15 mm displacement of the external focal plane. The optical power of the variable optical power element can be oscillated at maximum frequency of approximately 100 Hz. In the moving lens assembly, a 2 mm movement of a focus changing lens group moving lens that weighs 5 g can be used to produce a 15 mm displacement of the external focal plane, for a movement gain factor of 7.5. The focus changing lens group can be oscillated at a maximum rate of approximately 20 Hz.


Notably, the variable element assembly and the moving lens assembly provide several advantages. With the variable element assembly and the moving lens assembly, the external focal plane may be displaceable with significantly smaller or no movement of optical focusing elements, respectively, when compared to the telescopic assembly. For the moving lens assembly, the weight of the moving optical element may be substantially reduced compared to that of the telescopic assembly, thus reducing the amount of power needed to move the element. Furthermore, the maximum frequency of focal depth oscillation may be significantly higher for the variable element assembly and the moving lens assembly, thereby being compatible for use in systems with increased scanning rate, as compared to the telescopic assembly.



FIG. 7 illustrates an embodiment of a telescopic light focusing assembly 400 similar to the telescopic light focusing assembly 200 illustrated in FIG. 3. In many embodiments, however, the telescopic light focusing assembly 400 may have a significant minimum unfold reach 402 (e.g., 80 mm), which is the minimum distance between the front of the object space lens group 404 and the external focal plane 406. The unfold reach 402 may add to the overall length of the optical path between the grating or microlens array 38 and the structure being measured. It may, however, be advantageous to reduce the length of the optical path between the grating or microlens array 38 and the structure being measured to provide a more compact optical device 22.



FIG. 8 illustrates an embodiment of a compact light focusing assembly 410, in accordance with many embodiments. The compact light focusing assembly 410 can include a Z1 lens group 412 and a Z2 lens group 414. A front end lens group 416 can be disposed along the optical path distal to the compact light focusing assembly 410. The Z1 lens group 412 and the Z2 lens group 414 can be adjacently disposed. The Z2 lens group 414 can be disposed between the Z1 lens group 412 and a system aperture 418. The system aperture 418 can be disposed between the Z2 lens group 414 and the front end lens group 416, such as at a back focal length of the front end lens group 416. The Z1 and Z2 lens groups 412, 414 may be configured to overlap a plurality of light beams toward the system aperture 418. The Z1 and Z2 lens groups 412, 414 may adjust the configuration of light beams passing through the system aperture 418, such as by converging, diverging, or substantially collimating the light beams.


The Z1 lens group 412 and the Z2 lens group 414 can include any suitable lens or combination of lenses. For example, the Z1 lens group 412 can include a convergent lens (e.g., a biconvex lens) and the Z2 lens group 414 can include a divergent lens (e.g., a biconvex lens). The front end lens group 416 can include any suitable lens or combination of lenses, such as a convergent lens (e.g., a plano-convex lens with the planar face disposed towards the external focal plane 406). One or more of the Z1 lens group 412, Z2 lens group 414, or front end lens group 416 may include a telecentric lens. For example, in many embodiments, the front end lens group 416 is a telecentric lens. In the illustrated embodiment, an unfolded reach 420 (e.g., 110 mm in the intermediate focus position) between the distal face of the Z2 lens group 414 and the external focal plane 416 results in a reduced optical path length between the grating or microlens array 38 and the structure being measured. In both the telescopic light focusing assembly 400 and the compact light focusing assembly 410, the unfold reach can be measured from the distal face of a lens group that is moved so as to displace the location of the external focal plane 406.


In the compact light focusing assembly 410, the external focal plane 406 can be displaced along the symmetry axis by varying the separation between the Z1 lens group 412 and the Z2 lens group 414. Varying the separation between the Z1 lens group 412 and the Z2 lens group 414 can be accomplished by moving the Z1 lens group 412, moving the Z2 lens group 414, or moving both the Z1 lens group 412 and the 9Z2 lens group 414. For example, the separation between a convergent and divergent lens can be increased to vary the external focal plane between far, intermediate, and near focus positions.



FIG. 9 illustrates an optical assembly 430 that includes the compact light focusing assembly 410 and a probe 432 in accordance with many embodiments. The light beams focused by the compact light focusing assembly 410 can enter the probe 432 through a face 434 disposed towards the system aperture 418, reflect off the walls of the probe, and emanate from a face 436 disposed towards the external focal plane 406. The probe 432 can be manufactured from any suitable material, such as a light transmissive material (e.g., glass). In many embodiments, the walls of the probe are totally reflective, such that light beams reflect off the internal walls of the probe as they propagate through the probe. The probe can be probing member 90, as illustrated in FIGS. 2A and 2B. In many embodiments, a thin lens is positioned at a probe exit aperture 436.


The external focal plane 406 can be displaced relative to the probe 432 along the direction of the light beams emanating from the probe. The external focal plane 406 can be displaced by varying the separation between the Z1 lens group 412 and the Z2 lens group 414, as described above.


In many embodiments, a change in the distance between the Z1 and Z2 lens groups produces a larger change in the distance between the probe 432 and the external focal plane 406. For example, the compact light focusing assembly 410 can be configured such that a change in the distance between the Z1 lens group 412 and the Z2 lens group 414 produces at least a 2-fold larger change in the separation between the probe 432 and the external focal plane 406. In many embodiments, the compact light focusing assembly 410 is configured such that a change in the distance between the Z1 lens group 412 and the Z2 lens group 414 produces at least a 4-fold larger change in the separation between the probe 432 and the external focal plane 406. FIGS. 8 and 9 illustrate similar concepts, with FIG. 9 having the probe added to demonstrate suitability to a very slim probe. FIG. 8 illustrates the optical extent that would be required without the use of the forward aperture concept.


Use of the compact light focusing assembly 410 may result in significant reduction in overall optical path length. The compact light focusing assembly 410 may provide a reduced optical path length (as compared to existing approaches) without compromising field of view (FOV).



FIG. 10 illustrates acts of a method 500 for determining surface topography of a three-dimensional structure, in accordance with many embodiments. Any suitable optical assemblies, devices, apparatus, and/or systems, such as suitable embodiments described herein, can be used to practice the method 500.


In act 510, a plurality of light beams is generated. Any suitable device can be used to produce the light beams. For example, referring to FIG. 1A, the apparatus 20 can be used to produce the light beams. The apparatus 20 includes the grating or micro lens array 38, which splits the laser beam 30 emitted by light source 28 into an array of beams 36.


In act 520, the light beams are propagated through a convergent lens, a divergent lens, and a probe. Any suitable optics can be used to accomplish act 520. For example, the embodiments illustrated in FIG. 8 and FIG. 9 can be used to accomplish act 520.


In act 530, the separation between the convergent lens and the divergent lens is varied to vary the separation between the probe and the respective external focal points of the light beams. Referring, for example, to the embodiments illustrated in FIG. 9, the external focal points can form an external focal plane located exterior to the probe. The separation between the probe and the external focal plane can be increased by decreasing the separation between the convergent and divergent lenses. In some instances, the separation between the probe and the external focal points can be varied to scan the external focal plane through a plurality of focal depths. The separation can be oscillated by a suitable distance and at a suitable frequency, such as by the values previously provided herein with respect to the method 300. For example, the distance between the convergent and divergent lenses can be varied symmetrically by 1 mm, resulting in a 10 mm external focal plane shift.


In act 540, characteristics of the respective light beams returning from the respective light spots are measured. For example, as illustrated in FIG. 1A, the returning light beams 54 are reflected by the surface of the structure and each correspond to one of the incident light beams 36 produced by the optical device 22. Any suitable device can be used to measure the characteristics of the returning light beams, such as the sensor array 68.


In act 550, data representative of topography of the structure is generated based on the measured characteristics, as previously described herein. Any suitable device can be used to receive and generate the data, such as the processor 24 depicted in FIG. 1B.


Any suitable features of any of the embodiments of the assemblies, systems, methods, and devices described herein can be combined or substituted with any suitable features of other embodiments described herein. For example, the confocal optics 42 of the optical device 22 can include any of the light focusing assemblies described herein, such as any of the light focusing assemblies 220, 230, 410. In many instances, the exemplary optical systems described herein can be combined with a probe, such as the probing member 90, to facilitate optical measurement of the intraoral cavity. One of skill in the art will appreciate there are many suitable combinations and substitutions that can be made from the systems, methods, and devices described herein.


While preferred embodiments of the present invention have been shown and described herein, it will be obvious to those skilled in the art that such embodiments are provided by way of example only. Numerous variations, changes, and substitutions will now occur to those skilled in the art without departing from the invention. It should be understood that various alternatives to the embodiments of the invention described herein may be employed in practicing the invention. It is intended that the following claims define the scope of the invention and that methods and structures within the scope of these claims and their equivalents be covered thereby.

Claims
  • 1. An apparatus for determining surface topography of a patient's teeth, the apparatus comprising: a probe sized to be at least partially inserted into an intraoral cavity of the patient;a light source to output light;a light focusing assembly comprising a first lens, a second lens and a focus changing assembly comprising one or more additional lenses that shares an optical axis with the first lens and the second lens and being configured to focus the light to a plurality of external focal planes to illuminate the patient's teeth, wherein the focus changing assembly has a movement gain factor, and wherein as a result of the movement gain factor a change in position of at least one lens of the one or more additional lenses along the optical axis by a first distance results in a change in a focus setting by a second distance that is 2-10 times greater than the first distance;a detector configured to measure one or more characteristics of incident light returning from the illuminated patient's teeth; anda processor coupled to the detector and configured to generate data representative of a topography of the patient's teeth based on the one or more measured characteristics of the incident light returning from the illuminated patient's teeth.
  • 2. The apparatus of claim 1, wherein the light focusing assembly comprises a first lens group comprising the first lens and a second lens group comprising the second lens.
  • 3. The apparatus of claim 1, wherein the light focusing assembly is configured to overlap a plurality of light beams of the light within the light focusing assembly.
  • 4. The apparatus of claim 3, wherein the first lens comprises a focal length and a location arranged to overlap and substantially collimate the plurality of light beams passing through the light focusing assembly.
  • 5. The apparatus of claim 1, wherein the first lens is an image space lens and the second lens is an object space lens.
  • 6. The apparatus of claim 1, wherein the one or more additional lenses are disposed between the first lens and the second lens.
  • 7. The apparatus of claim 1, wherein the focus changing assembly is configured to change the focus setting to scan an external focal plane through a plurality of focal depths at a frequency of greater than or equal to 10 Hz.
  • 8. The apparatus of claim 1, wherein the light is substantially collimated upon entering the focus changing assembly and wherein the focus changing assembly adjusts the light to a convergent configuration, a collimated configuration, or a divergent configuration upon exiting the focus changing assembly.
  • 9. The apparatus of claim 1, wherein the apparatus is configured to move the at least one lens of the focus changing assembly along the optical axis by about 0-2 mm.
  • 10. The apparatus of claim 1, wherein the focus changing assembly is configured to change the focus setting by 10-mm.
  • 11. The apparatus of claim 1, wherein the focus changing assembly is configured to change the focus setting by about 15 mm.
  • 12. The apparatus of claim 1, wherein the focus changing assembly has a weight of about 5 grams or less.
  • 13. The apparatus of claim 1, wherein the focus changing assembly is configured to vary a focal length of the light while maintaining telecentricity.
  • 14. The apparatus of claim 1, wherein the light focusing assembly comprises confocal and telecentric optics.
  • 15. The apparatus of claim 1, wherein the second distance is 3-7.5 times greater than the first distance.
  • 16. The apparatus of claim 1, wherein the second distance is about 5 times greater than the first distance.
  • 17. The apparatus of claim 1, wherein the probe is at a distal end of the apparatus and comprises a mirror to direct the light towards the patient's teeth.
  • 18. The apparatus of claim 1, further comprising: a beam splitter or partially transparent mirror disposed between the light source and light focusing assembly.
  • 19. The apparatus of claim 1, wherein at least a portion of the focus changing assembly is located at a back focal length of the second lens.
  • 20. The apparatus of claim 1, wherein the one or more measured characteristics comprises an intensity of the incident light or a spatial frequency of the incident light.
CROSS-REFERENCE

This application is a continuation of U.S. application Ser. No. 17/694,462, filed Mar. 14, 2022, which is a continuation of U.S. application Ser. No. 16/922,967, filed Jul. 7, 2020, now U.S. Pat. No. 11,273,017, issued Mar. 15, 2022, which is a continuation of U.S. application Ser. No. 16/287,120, filed Feb. 27, 2019, now U.S. Pat. No. 10,743,967, issued Aug. 18, 2020, which is a continuation of U.S. application Ser. No. 15/811,365, filed Nov. 13, 2017, now U.S. Pat. No. 10,258,437, issued Apr. 16, 2019, which is a continuation of U.S. application Ser. No. 15/220,336, filed Jul. 26, 2016, now U.S. Pat. No. 9,844,427, issued Dec. 19, 2017, which is a continuation of U.S. application Ser. No. 14/323,215, filed Jul. 3, 2014, now U.S. Pat. No. 9,439,568, issued Sep. 13, 2016, each of which are incorporated herein by reference in their entirety.

Continuations (6)
Number Date Country
Parent 17694462 Mar 2022 US
Child 18371348 US
Parent 16922967 Jul 2020 US
Child 17694462 US
Parent 16287120 Feb 2019 US
Child 16922967 US
Parent 15811365 Nov 2017 US
Child 16287120 US
Parent 15220336 Jul 2016 US
Child 15811365 US
Parent 14323215 Jul 2014 US
Child 15220336 US