This disclosure relates generally to light sources such as for surgical visualization. This light source may be adjustable so as to provide the desired illumination. The light source may comprise one or more solid-state light sources such as LEDs and/or laser diodes, which may potentially be coupled to fiber optics in some cases.
Surgical visualization systems can assist healthcare providers visualize a surgical site during surgery. Such surgical visualization systems may include one or more types of cameras. Illumination can also be provided to the surgical site to enhance viewing and to assist in the visualization of surgical sites. Additionally, the spectral distribution of such illumination may be suitably tuned to enhance visualization. Such illumination may potentially be varied in different circumstances. Visualization systems may include cameras including but not limited to cameras that provide surgical microscope views, endoscopes, cameras on retractors, cameras on surgical tools, proximal cameras, exoscopes, etc. The visualization systems may include binocular displays that may include one or more displays (e.g., monitors) and may be configured to provide 2D or 3D viewing.
Various examples described herein include light sources that can provide light that is directed to a surgical site. The light source can be a variable light source that can be adjusted to provide different spectral distributions. The light source can therefore be tuned to provide the desired type of lighting.
The light source may include one or more solid state emitters such as Light Emitting Diodes (LEDs) and/or lasers (e.g., laser diodes). These LEDs may be white LEDs and/or color LED's such as red green and blue LEDs. Other colors LEDs as well as other types of light sources may be employed. The light from the light sources can be combined to provide an aggregate beam that is used to illuminate the surgical site.
Light from the one or more light sources and be tuned with a tunable filter that tailors the spectral distribution. Such tunable filters may comprise a filter such as an interference filter that is tilted to alter the spectral characteristics of the filter.
Light from the various emitters may be passed through different tunable filters to control the spectral distribution of the contributions of light from the different emitters. In this manner, the aggregate beam that is directed onto the surgical site may be tailored to provide the desired spectral characteristics.
Optical fiber may be employed at some stage to deliver the light to the surgical site. For example, the light from the emitters, tuned by the tunable filters and combined may be coupled into fiber optics. Light propagated through the fiber optics maybe directed onto the surgical site.
Accordingly, certain examples described herein include efficient, high-intensity, solid-state light sources such as LEDs and/or laser diodes that provide light that is spectrally tuned and collected and directed possibly into optical fiber or other optics that collects the light. Example designs may thus provide variable light rendering using small high-intensity light sources that propagate light through a collection of pathways for illuminating the receiving end of a fiber optics illumination conduit or light conduit. More particularly, certain embodiments may provide variable light rendering using small high-intensity light sources that output light that is directed to one or more variable filters via a collection of pathways for illuminating one end of a fiber optics illumination conduit or light conduit. Certain examples combine phosphor-coated LED high-intensity light sources and colored light sources (e.g., laser diodes) for excitation via a collection of pathways for illuminating one end of a fiber optics illumination conduit or light conduit.
Various designs may be configured to provide the user with choices for the illumination modes. The light source, for example, may be adjusted by the user to provide different types of illumination having different spectral make-up. The optical spectrum of the light provided may, for example, be adjusted by controlling which light sources is used to provide light as well as possibly by tuning light from the one or more light sources using the tunable filters.
Various designs may include a communication system to receive instructions from the user to control the illumination mode and/or to control the spectral distribution of the light output by the light source. A communication system may also provide communication to one or more displays and/or one or more cameras.
Various designs include an illumination device comprising at least one sub-source comprising a plurality of light emitters configured to produce light flux. The illumination device further comprises a plurality of optical fibers, each optical fiber of the plurality of optical fibers comprising a first end portion configured to receive the light flux from a corresponding light emitter and a second end portion configured to emit the received light flux. The light emitters are arranged in a first pattern, the first end portions are arranged in the first pattern, and the second end portions are arranged in a second pattern different from the first pattern.
Various examples described herein include light sources that can provide light that is directed to a surgical site. These light sources may be used to illuminate a surgical site while one or more cameras capture images such as video images of the surgical site and may be used for diagnosis, general medical lighting, or other procedures or activities. Cameras and systems for imaging the surgical site may include, for example, surgical microscope view cameras, endoscopes, cameras on retractors, cameras on surgical tools, proximal cameras, exoscopes, etc. Such surgical visualization systems may display images such as video using a binocular display assembly that include displays that provide views of images obtained from the camera or cameras. The surgical visualization systems may switch from viewing an image or video input from one camera to another or show multiple views simultaneously. Moreover, the light source may be automatically varied when switching from displaying a view from one camera to a view from another camera.
Illumination may facilitate enhanced visualization of the surgical site such as obtained by video camera. Light, for example, can be provided to the surgical site via optical fiber. In some cases where an endoscope is employed to capture images within the body, the light may be provided to the surgical site via the endoscope. In certain embodiments, the light can be provided via fiber optics in various ways. For example, fiber optics can be integrated into an endoscope configured to be inserted into a body via a natural opening or lumen in the body, or through a surgically induced opening in the body. For another example, fiber optics can be integrated into an exoscope (e.g., an imaging device that “stands off” from the patient and provides a surgery site view) or a camera providing surgical microscope views. For another example, fiber optics can be brought near the patient to supplement overhead surgical lighting (e.g., used by the physician sans optical devices or with non-illuminated magnification devices, such as loupes, or to supplement other medical imaging modalities such as endoscopes, exoscopes, or cameras providing surgical microscope views).
The light source can be a variable light source that can be adjusted to provide different spectral distributions. The light source can therefore be tuned to provide the desired type of lighting. In particular, it can be advantageous to provide a light source having a transition (e.g. gradual transition) or a variable change of the output spectral power distribution such as a gradual transition or a variable change between a white light rendering and narrow band imaging.
Certain examples described herein provide such light sources utilizing filters that have a spectral characteristic that varies with orientation such as tilt. Interference filters, for example, have a spectral response, such as spectral transmission or refection that varies with angle of orientation. Accordingly, by varying the orientation of these filters, the spectral distribution of the light interacting with the filter can be adjusted or tuned.
In certain embodiments, the light source can operate in three modes, as well as in combinations of these three modes. The three modes for certain embodiments can be described as follows:
Mode 1: White light for general medical or surgical illumination (e.g., “surface” based illumination). This mode can include the ability to illuminate a scene in a D65-near-equivalent matter, and can include the ability to modify the color temperature of the “white light” (e.g., adjusting the wavelength range of the white light to make it warmer or cooler).
Mode 2: Specialized “surface” based illumination (e.g., short wavelengths; blue waveband; green waveband; D-light; light compatible with photodynamic diagnosis (PDD); light which helps visualize changes in the epithelium, in either of two or more sub-modes). For example, this mode can include a sub-mode comprising activating both blue and green channels in a manner suitable for narrow band imaging (NBI), and can include a sub-mode comprising activating only blue light for a D-light mode.
Mode 3: “Deep penetrating” illumination comprising near infrared (NIR) illumination or excitation. This mode can include either or both of two sub-modes: a sub-mode with a broader-based NIR illumination to reveal below the surface structures in tissue, and a sub-mode with a narrow NIR illumination to excite a dye or other material, which can be used in conjunction with blocking filters.
Changing the orientation of the incident light 110 with respect to the filter 100 and the interference coating or alternatively changing the orientation of the filter with respect to the incident light can alter the spectral responsivity 112 of the filter. As illustrated in
With further tilt, the spectral responsivity 112 continues to change. Further tilt of the filter 100 of
Accordingly, progressively tilting or reorienting the filter 100 with respect to the incident light can change the transmission or reflection properties of the filter and thus changes the spectral distribution of light transmitted or reflected from the filter. For example, if white light is transmitted through the filter 100, a first wavelength band may be selectively pass through the filter and output therefrom. If that filter 100 is tilted slightly, a second wavelength band shifted slightly in wavelength with respect to the first wavelength band may be selectively passed through the filter and output therefrom. If that filter 100 is tilted slightly more, a third wavelength band shifted slightly more in wavelength with respect to the first wavelength band may be selectively passed through the filter and output therefrom.
The interference filter 100 need not be limited to the filter shown in
The substrate 102 on which the layers are may comprise glass, plastic, or other materials. In some embodiments the filter 100 is transmissive. Accordingly, the substrate 102 may be transmissive. In other cases, the filter 100 is reflective. Likewise, although transmission spectra 112 are shown in
Accordingly, actuators such as motors, piezos, etc. may be used to tilt and thereby reorient the filters in a controlled manner with respect to the incident light. Electrical signals may be applied to the actuators, e.g., motors, piezos, etc., to cause rotation. The electrical signal may be provided by electronics such as control electronics that controls the amount of tilt of the filter(s) and hence the amount of change of spectral responsivity of the filter and thus the spectral distribution of the light output (e.g., transmitted through or reflected from) the filter or filters. In certain embodiments, multiple filters (e.g., a high pass filter and a low pass filter) can be placed in a single light path. For example, the multiple filters can be stacked on a single surface, on opposite sides of a plate or element, and/or coated on a surface or element and embedded within an epoxy bond. The electronics may also control the light emitters (e.g., LEDs, laser diodes), for example, the amount of light output by the light emitter. Such electronics, may for example, control the amount of electrical power that drives the emitters.
Accordingly, illumination systems may include light sources such as LEDs that output light that is directed along one or more paths. Tunable filters such as described above may be included in the one or more paths to alter the spectrum of the light from the light sources that propagate along the one or more paths. These paths maybe brought together to provide an aggregate beam having the desired spectral distribution.
In some examples, therefore, thin film coatings, such as interference coatings, applied to one or more plane parallel plates or other substrate are placed in the paths of corresponding beams (e.g., collimated beams) and can be adjustably tilted to vary the color or waveband distribution.
The first output face 152a of the first waveguide 150a is configured to emit light directed towards the first lens assembly 160a which is configured to substantially collimate the light emitted from the first output face 152a and to direct the collimated light along the optical path 170 through the plurality of filters 100. Each filter 100 of the plurality of filters 100 comprises at least one interference plate 102 having at least one dichroic coating applied to at least one face of the plate 102, and the plate 102 is configured to be controllably rotated (e.g., tilted) in at least one direction. The angular and/or rotational differences of the plates 102 are configured to be controllably adjusted such that the filters 100 controllably interact with the light received from the first lens assembly 160a to modify (e.g., shift; compress) the spectral distribution of the light in an advantageous manner. For example, referring to
The plurality of filters 100 has a center axis 170 along which the light is propagating from the first lens assembly 160a to the second lens assembly 160b in a region between the first lens assembly 160a and the second lens assembly 160b and the plates 102 of the plurality of filters 100 are located along the center axis 170. The various views of the color mixing assembly 140 in
In various embodiments, the plurality of filters 100 can comprise one or more dichroic filters. In some embodiments, the plurality of filters 100 can comprise one or more polarization components. Rotating or tilting one or more components of the plurality of filters 100 (e.g., the plate 102) about the different rotational axes can induce a spectral change in the filter output. For example, rotating or tilting one or more components of the plurality of filters 100 (e.g., the plate 102) can attenuate, reduce or extinguish a portion of the signal output from the plurality of filters 100. As another example, rotating or tilting one or more components of the plurality of filters 100 (e.g., the plate 102) can shift the spectrum of the signal output from the plurality of filters 100.
In various embodiments, the plurality of filters 100 comprising one or more dichroic filters can be sensitive to polarization of light output from the one or more light sources. In such embodiments, rotating or tilting (e.g., rotating azimuthally) the one or more components of the plurality of filters 100 (e.g., the plate 102) can change the spectral composition of the light output from the plurality of filters 100. For example, if in a particular orientation of the various components of the plurality of filters 100, the output from the plurality of filters 100 can comprise a first amount of light in a first wavelength and a second amount of light in a second wavelength. When one or more components of the plurality of filters 100 is rotated or tilted, the output from the plurality of filters 100 can include different amounts of light in the first and the second wavelengths. This effect may result because the filters may be polarization dependent in some cases. The resultant change in transmission of different wavelengths through the filter(s) can thus modify the spectral composition of the output of the filters. By increasing and/or decreasing the intensity of different wavelengths output by one or more such filters, for example, the overall shape of the spectral distribution can be altered. For example, the magnitude of certain spectral wavelengths can be reduced compared to other wavelengths. Accordingly, various optical emitters can be tailored to emit light having a desired spectral characteristic and/or intensity characteristic which when combined with rotation or tilt of the one or more components of the plurality of filters 100 can provide light with desired illumination characteristics (e.g., spectral characteristic and/or intensity characteristic).
In certain embodiments, the reduced numerical aperture, or angular output, of the color mixing assembly 140 (e.g., whether by lens assemblies 160a, 160b of
The flux energy exiting the plurality of filters 100 is coupled to the waveguide 150b by the taper 180b. As shown in
Each of the two plates 102 of the plurality of filters 100 can be configured to be controllably rotated (e.g., tilted) with respect to one another, thereby permitting modification (e.g., shifting; compressing; blocking; passing) portions of the flux energy propagating through the color mixing assembly 140. For example, each of the two plates 102 can be configured to be controllably rotated (e.g., tilted) about one or more axes (e.g., the center axis 170 of the plurality of filters 100; an axis perpendicular to the center axis 170 and parallel to the plate 102; an axis perpendicular to the center axis 170).
The one or more plates (filters) can be coupled to an electrical controller configured to simultaneously change the power provided to some or all of the LEDs in groups or together as the plates are tilted. The light source can also communicate with a control device which may display spectral power distribution to a visualization display. Certain such embodiments advantageously provide high power densities using arrays or assortments of low-cost, high-output LED dies. In certain embodiments, one or more LEDs can be placed in direct contact with one or more waveguides and can direct their flux energy in the direction of the long axis of the waveguide, with the flux energy captured in the waveguide by total internal reflection.
In certain designs, for example, the illumination system or light source may contain a communication bus, which communicates with one or more cameras. The color responses can vary greatly between cameras, and in certain cases, an input profile can be provided specifically for the camera. Certain configurations can provide an illumination system that tailors its output for different cameras used in switching the resultant visualization. The illumination system may, for example, adjust the spectral or color waveband distribution depending on which camera is being used to generate the image being viewed by the user.
In certain illumination systems, the variable spectral output generated using the tilted plates can be advantageously used with corresponding filters in the one or more cameras. For example, autofluorescence and exogenous agents utilize intense excitation sources that can obscure the emission of dyes and agents used in many studies. In such circumstances, the camera can include blocking filters to be used in conjunction with the light source, and the variable output can be adjusted accordingly. For example, the cameras can include filters or detectors that are configured to block light below 700 nm, such that autofluorescence largely disappears in images with wavelengths above 700 nm, so fluorescence imaging in the infrared reduces background “noise” caused by tissue autofluorescence.
Furthermore, color rendering in normal visualization and false-color and pseudo-color rendering can benefit from variable filtering with tilted plates in some instances. For example, the color rendering in normal visualization may be more medically useful to the physician if the color temperature of the light is modified, and/or if the illumination or brightness level can be varied or modified (e.g., by excluding, enhancing, or otherwise modifying one or more portions of the waveband) by the introduction of one or more variable filters used alone or in combination with one another (e.g., blocking or passing filters). In certain embodiments, the illumination system is configured to be used with a visualization system that incorporates false color and/or pseudo-color images.
As used herein, “false color” refers to a group of color rendering methods used to display images in color which were recorded in the visible or non-visible parts of the electromagnetic spectrum, and a false-color image is an image that depicts an object in colors that differ from those a true-color image would show. A false-color image can be created using solely the visual spectrum (e.g., to accentuate color differences), and/or using data from electromagnetic radiation outside the visual spectrum (e.g., infrared, ultraviolet, X-ray), with the choice of spectral bands governed by the physical properties of the object under investigation. In addition, variants of false color (e.g., pseudo-color, density slicing, and choropleths) can be used for information visualization of either data gathered by a single grayscale channel or data not depicting parts of the electromagnetic spectrum (e.g., elevation in relief maps or tissue types in magnetic resonance imaging). In contrast to a true-color image, a false-color image sacrifices natural color rendition in order to ease the detection of features that are not readily discernible otherwise (e.g., the use of near infrared for detecting emission from an exogeneous dye; imaging tissue features hidden below the surface which are visible in the near infrared, but not visible in visible light, such as in a range of 400 nm-700 nm).
In certain designs, the illumination device can include one or more tilting planes and a mix of phosphor-converted LEDs (e.g., white LEDs; blue or purple LEDs coated with a phosphor to reemit over a broader and longer wave band range), multi-colored LEDs (e.g., a plurality of LEDs of two or more different colors), and/or one or more other excitation sources (e.g., near-IR). For example, in photodynamic therapy applications, which utilize illumination in the UV and blue regions (e.g., soret band range), suitable excitation sources can be added to the device and controlled as other modes. Additionally, in other examples, near-IR excitation sources can be used with visual illumination or narrow-band imaging (NBI).
Certain embodiments described herein can utilize one or more color sensors having a color scheme division of the spectrum. Examples of color scheme divisions include a red-green-blue (RGB) color scheme division, a cyan-magenta-yellow-black (CMYK) color scheme division, a hue-saturation-value (HSV) color scheme division, or another color scheme division of the useful spectrum. Each color sensor can have one or more portions that are responsive to flux from corresponding portions of the spectrum (e.g., from green or cyan), or one or more portions that are responsive to one or more corresponding colored LEDs or groupings of LEDs. The color sensor can be configured to receive a portion of the total flux from the at least one optical emitter. For example, a portion of the mixing assembly (e.g., waveguide; mixing rod) can use total internal reflection to move flux in a direction from the light source to the output and a portion of the surface of the mixing assembly can comprise a dichroic coating which passes one or more wavelengths of interest to a color sensor. This portion of the flux can be coupled directly to the color sensor (e.g., by contact; via a fiber optic assembly; via a waveguide or mixing rod) to allow the color sensor to sample the flux for its spectral properties. In certain embodiments, the output spectrum of the light source can be managed by sampling the subdivisions of the flux in the waveguide (e.g., mixing rod) and by adjusting the power supplied to one or more of the LEDs (e.g., via the microprocessor and user interface), for example, to adjust the spectral characteristics of the light based on the samples obtained using the wavelength specific or color sensors.
In the design shown in
For example, the at least one sub-source schematically illustrated in
The plurality of optical fibers can be mechanically coupled together (e.g., contained in a matrix of adhesive such as epoxy or fused by temperature) in at least one first end assembly (e.g., at least one input receptacle) containing the first end portions and at least one second end assembly (e.g., at least one output receptacle) containing the second end portions. For example, as schematically illustrated by
In certain embodiments, a first set of the first end portions can be in optical communication with the light emitters of a first sub-source and a second set of the first end portions can be in optical communication with the light emitters of one or more other sub-sources (e.g., a second sub-source; a third sub-source; N sub-sources). For example, a first set of the first end portions in a square end assembly and a second set of the first end portions in a different square end assembly can receive the light flux from the respective light emitters, and the second end portions of these optical fibers can be gathered into one or more circular end assemblies (e.g., to facilitate mixing of the received light flux from the respective light emitters). Such mixing may be accomplished, for example, by having the relative locations and/or order of different fibers in the first set of the first end portions be different from the relative locations and/or order of those same fibers in the second set of the first end portions In certain such embodiments, combining the light flux from various sub-sources (e.g., having differing color spectrums, power spectral densities, etc.) at the first end portions of the first end assemblies to be emitted from the second end portions of the second end assemblies which may have different arrangement and/or order, advantageously increases randomization of the flux output.
The plurality of optical fibers can be flexible (e.g., configured to be moved such that the second end portions are positioned at various selected locations relative to the first end portions). For example, the flexible plurality of optical fibers can be configured to allow the first end portions to be coupled to (e.g., adjacent to) the plurality of sub-sources (e.g., such that each first end portion is in optical communication with a corresponding one or more of the light emitters of a sub-source) and the second end portions to be coupled to (e.g., adjacent to) a filter assembly, lens assembly, mixer assembly, or an assembly combining any combination of filters, lenses and/or mixers (e.g., such that each second end portion is in optical communication with a corresponding portion of the filter or lens assembly, as described herein). For example, the individual optical fibers making up the fiber matrix can each have an outer diameter or lateral dimension selected to provide a desired flexibility (e.g., an outer diameter or lateral dimension of 20 microns, 30 microns, 50 microns, 70 microns, 80 microns, or in any range formed by any of these values). In certain other embodiments, the plurality of optical fibers can be fixed and the at least one sub-source can be configured to move, such that light emitters of a selected one or more sub-sources of the at least one sub-source are placed in optical communication with at least one selected set of optical fibers.
In certain embodiments, the sum of the areas of the sub-sources (e.g., areas of the input square formats) is substantially equal to the area of the output (e.g., circular output format) that is in optical communication with the sub-sources. In certain other embodiments, the first end portions of the individual optical fibers can be tapered (e.g., such that the numerical aperture of the fiber matrix is greater than or less than the input face of the fiber optic matrix).
In some implementations, the plurality of optical fibers could be heated and drawn producing a taper and/or tapers that could be combined together. In some implementations, the tapers could be different from one another and combined. The numerical aperture (NA) of a fiber may change as the area of the fiber changes. According, by tapering a fiber and producing a smaller diameter or cross-sectional area, the numerical aperture at that end can be caused to be increased. Decreasing the area of the second end portion, for example, may increase the numerical aperture of the second end portion and thus may increase the output angle or divergence angle of light exiting the optical fiber at the second end portion. Alternatively, one could orient the taper the other way. The first end portion of the fiber may be tapered to produce a smaller diameter or cross-sectional area at the first end compared to the first end portion. Consequently, the numerical aperture at the first end portion can be caused to be increased relative to the second end portion. The first end portion can thus accept more light from an LED by using the smaller end at the source and using the larger end where light may be output to focusing, collimating and/or mixing optics. Tapering and reducing the cross-section fiber at the input (e.g., reducing the cross-sectional area at the first end portion compared to the second end portion) can be used to capture more illumination or at the output (e.g., reducing the cross-sectional area at the second end portion compared to the first end portion) can be used to match the acceptance angle of an optical system, thereby improving efficiency.
Having different shaped formats for the first and second end assemblies can be useful in some instances to address the shape of structures in which emitters are packages. Emitters such as light emitting diodes (LEDs) may be included in square shaped LED sources such as LED arrays. As disclosed herein, a number of small LEDs can be optically coupled to a plurality of fiber matrices having square shape and then transmitted some distance from the emitters to a surgical device or transmitted internally within a surgical device. Light from the emitters may propagate through the fibers to one or more of the second end assemblies, which may be circular in some implementations as discussed herein. In some implementations, the number of second end assemblies including the second end portions is less than the number first end portions of fiber, which may be disposed proximal to the emitters. For example, one could have a 5×5 array of LED's coupled with one or more square fiber matrices and then gather these 25 fibers together into 1, 2, 3, 4, etc. circular second assemblies.
Systems, devices, and apparatus disclosed herein may be used to distribute light from one or more first end assemblies into a plurality of second end assemblies such as circular assemblies. Such systems, devices, and apparatus may be configured to directing light into focusing optics having a smaller diameter than the aggregate area of the emitters from which light originates. For example, the coupling fibers can permit coupling the optical power of a large LED or LED array into a plurality (e.g., 2, 3, 4, etc.) of focusing optic assemblies that individually have smaller areas than the larger LED or LED array. Similarly, the coupling fibers can permit coupling the optical power of one or more first end assemblies into a plurality (e.g., 2, 3, 4, etc.) of second end assemblies individually having smaller areas than the total cross-sectional area of the one or more first end assemblies.
In certain embodiments, sub-sources (e.g., arrays of sub-sources) can be configured to be moved individually or as a group to select at least one sub-source (e.g., at least one array of sub-sources) to be in optical communication with the plurality of first end portions in the at least one first end receptacle. For example, the sub-sources can be mounted on a support configured to move (e.g., rotate about a hub as the center of rotation; slide along a track), with the support configured to be positioned to place at least one sub-source (e.g., an array of sub-sources) in optical communication with the plurality of first end portions. Different sub-sources on the support can have characteristics that are different from the characteristics of the other sub-sources (e.g., one array of sub-sources can comprise light emitters with phosphors to emit white light; another array of sub-sources can comprise light emitters having a different color spectrum, power spectral density, etc.). These sub-sources (e.g., arrays of sub-sources) can be at different positions on the support (e.g., four arrays of sub-sources at the “12 o'clock,” “3 o'clock,” “6 o'clock,” and “9 o'clock” positions of a rotating support), and the support can be positioned to place the array(s) having the desired characteristics (e.g., color spectrum) in optical communication with the plurality of first end portions. In certain other embodiments, the plurality of optical fibers can be fixed and the sub-sources (e.g., arrays of sub-sources) can be configured to be moved as a group to select at least one sub-source (e.g., at least one array of sub-sources) to be in optical communication with the plurality of first end portions in the at least one first end receptacle.
In certain embodiments, the portion of the illumination device advantageously allows the packing fraction of the optical fibers to be dimensionally less than the spacing of sub-sources. In some cases, the spacing of illumination devises or emitters can be impacted by thermal management considerations.
In some implementations, the light emitters are generally small and can be moved while the fiber optic matrix remains stationary and provides the light flux to additional optical systems or sub-systems (e.g., collimating assembly, mixing assembly, or focusing lens assembly or combinations thereof). In certain embodiments, the portion of the illumination device advantageously provides light flux from a square or rectangular array of sub-sources to optical systems or sub-systems that have different geometries (e.g., systems having a circular aperture or cross-section or field of view and/or that possibly see or transmit an image circle or light bundle).
The illumination device may comprise an illuminator that may be mounted on a stand or attached to different fixtures such as supports. The illumination device can be brought near the patient possibly to supplement overhead surgical lighting (e.g., used by the physician sans optical devices or with non-illuminated magnification devices, such as loupes, or to supplement other medical imaging modalities such as endoscopes, exoscopes, or cameras providing surgical microscope views). In addition or alternatively, the illumination device may be integrated with other medical imaging devices such as cameras providing surgical microscope views, etc.)
A range of advantages may be obtained using designs and configurations disclosed herein. For example, designs disclosed herein may facilitate mixing of light from LEDs that having different color that are selectively activated to provide a desired spectrum. Certain color lights may be added using selectively activated color emitters (e.g., LEDs) to supplement an otherwise discontinuous spectrum of white phosphor LEDs.
Additionally, a plurality of smaller emitters (e.g., LEDs) with gaps between them may have less thermal load than a single larger emitter (e.g., LED). Systems, devices, and apparatus disclosed herein may be used to combine light from such a plurality of smaller emitters. Systems, devices, and apparatus disclosed herein may be configured to direct light into smaller diameter focusing optics. Coupling fibers for example can permit coupling the power of a large LED into four smaller focusing optics.
A wide range of variations in the illumination device are possible. For example, the shapes and arrangements of the array of sub-sources as well as fiber optic matrix may be different. For example, shapes different from those disclosed for each of the components are possible. Likewise shapes other than square, rectangular, circular are possible. Additionally, although movement of the emitters has been described above, in some implementations the fiber may be moved. For example, the first end portions (e.g., the first end assembly) can be moved with respect to the emitters, sub-sources, and or second end portion in the second end assembly. Also, one or both of the first and second end assemblies can merely comprise fused fibers and does not include any extra components attached to the fibers. Additionally, any systems, devices, components, and/or features described herein can be combined with any other systems, devices, components, and/or features described herein. For example, any systems, devices, components, and/or features described in connection with
In certain embodiments, the at least one PWM circuit can be used to control the optical emitters to provide flicker-free illumination. Time-variant light artifacts (TLAs), commonly called fluctuations or flicker, are noticeable to most humans at frequencies below 70 Hz. Some people are sensitive in their central vision region to TLAs with frequencies up to 100 Hz, while using peripheral vision, TLAs can be perceived with frequencies up to 200 Hz. For wide field of view imaging systems, it is desirable to manage the illumination to improve (e.g., optimize) “time variant light quality,” especially since such wide field of view imaging systems engage the peripheral vision of the user. By comparison, endoscopic images viewed through ocular systems have narrow apparent fields of view (e.g., 10 to 30 degrees). Viewing a medical image on a monitoring screen in 2D or 3D (e.g., attached to an arm and surgical stand) may well engage fields of view of 30 to 45 degrees. A surgical microscope or electronic near eye display (e.g., fixed on an arm or worn) can have an apparent field of view of 60 to 90 degrees, and immersive displays (e.g., head mounted or fixed on an arm) can engage nearly the entire periphery of a user's vision system. Thus, in certain embodiments described herein the illumination system utilizes the at least one PWM circuit to control the generated light to conform to user requirements for perceptually flicker free illumination (e.g., substantially above 200 Hz). For example, the at least one PWM circuit can be configured to control the generated light to direct light onto the optical emitters at a pulse rate sufficiently fast to avoid detection of flicker by the user, in one or both of the user's central viewing region and the user's peripheral viewing region.
In certain embodiments, the at least one PWM circuit can be used to compensate for differences between the color characteristics of different medical cameras. For example, single-chip medical cameras and three-chip medical cameras have different color characteristics due to their color separation filtering. In some cases, for example, single-chip cameras can use a Bayer filter arrangement with different color filters over different pixels in a repeating pattern, while three-chip cameras can use three dichroic filters arranged to produce three different color channels (e.g., a red, green, or blue channel) each with its own sensor array. The pixels in these sensor arrays used in a three-chip camera have their respective color channels that are sensitive primarily in different respective portion of the spectrum (e.g., red, green, blue, etc.) though there can be spectral or wavelength overlap among the different sensor arrays. The output in color space of these two families of cameras can produce slightly different responses. Additionally, medical cameras from different manufacturers may use different sensor arrays which can add to the differences. Using the at least one PWM circuit to compensate for differences between different sensor arrays having different spectral characteristics or spectral responsivities. For example, using the at least one PWM circuit to compensate for differences between the color characteristics of these different medical cameras can advantageously allow better color matching between single-chip sensors and three-chip sensors and between the products from different camera manufacturers. The modulation circuitry can modulate the at least one light source (e.g. at least one LED) differently for different sensor arrays or cameras.
Various optical emitters can be configured to output illumination having one or more characteristics (e.g., intensity, wavelength, etc.). For example, some optical emitters can be configured to output optical power that has a spectral distribution similar to a CIE standard Illuminant D65. The characteristics of the light output from an optical emitter can be configured to match the detection capabilities of the various cameras that are configured to view the illumination output from the optical emitter. The optical emitter can be configured to adjust the characteristics of the light output (e.g., using the modulation circuitry) to more closely match the detection capabilities of the camera/sensor viewing the illumination output from the optical emitter. For example, the optical emitter can comprise a look up table of settings that includes the illumination characteristics that more closely match the various cameras/sensors that can view illumination output from the optical emitter. Various cameras/sensors can identify themselves over a communication link or bus, and the optical emitter can adjust the characteristics of the light output to more closely match the detection capabilities of the identified cameras/sensors. This feature can be advantageous when one or more cameras/sensors are switched on or off or are switched from being used to present images to not being used to present images or vice versa.
In certain embodiments, the at least one PWM circuit can be used to control the optical emitters to conform to various regulations regarding their use. For example, illumination is a time-based quantity, and the production of heat in tissue caused by the illumination is also a time-based quantity. For another example, the optical emitters can comprise one or more laser diodes (e.g., for excitation of an exogeneous dye), in which case the illumination source may potentially be subject to compliance with various regulatory requirements.
As shown in
Optical signals outputted from the optical emitters are transmitted to a color mixing assembly and filters configured to generate light having a corresponding spectrum and to provide this light to the fiber optics.
In the example light source shown in
The light from the outputs of the plurality of sub-sources is directed to the one or more filters inputted into the color mixing assembly. For example, the plurality of sub-sources can generate corresponding light beams, the light beams can be transmitted through corresponding filters of the one or more filters to the color mixing assembly. In some cases, the color mixing assembly combines the light beams into a single composite beam. In some cases, the color mixing assembly can comprise at least one collimator configured to collimate the light beams to a single composite light beam. In certain designs, the light source further comprises an optical focusing assembly to converge the composite light beam and to transmit the composite light beam to a receiving fiber optic conduit or cable.
The color sensor can be operatively coupled to the outputs of the plurality of sub-sources (e.g., the N LED sources channels; the laser diode channel) and can be configured to detect and report on the spectral properties of the outputs of the individual sub-sources and on the overall output to possibly be recorded, controlled, and displayed. Information generated by the color sensor can be provided to the micro-processor, which in response, can transmit control signals to the optical emitters of the plurality of sub-sources and the one or more filter motors. For example, the color sensor can comprise one or more power output sensors configured to detect the output of one or more output channels (e.g., one or more of the N LED sources channels and the laser diode channel) and can be operatively coupled to the micro-processor or other electronics (e.g., as shown in
In one example, Mode A as shown in
In another example, Mode B as shown in
In another example, Mode C (e.g., which can be available as an additional modality to either Mode A or B), as shown in
In another example, Mode D, as shown in
The controller subsystem can be configured to allow the user to choose one or more modes or combinations of modes, including those shown in
Any systems, devices, components, and/or features described herein can be combined with any other systems, devices, components, and/or features described herein. For example, any systems, devices, components, and/or features described in connection with
An illumination device comprising:
The illumination device of Example 1, wherein at least one sub-source of the plurality of sub-sources comprises at least one solid-state semiconductor optical emitter producing monochromatic visible light when an electric current is provided.
The illumination device of Example 1 or Example 2, wherein at least one sub-source of the plurality of sub-sources comprises at least one solid-state optical emitter containing phosphor and producing a white light output.
The illumination device of any of Examples 1-3, wherein all the sub-sources comprise at least one colored LED.
The illumination device of any of Examples 1-4, wherein all the sub-sources comprise at least one laser diode.
The illumination device of any of Examples 1-5, wherein the at least one filter comprises an interference filter.
The illumination device of any of Examples 1-6, wherein the at least one filter comprises at least one plane-parallel plate with one or both surfaces coated with a thin film coating stack comprising a plurality of layers with different indices of refraction, wherein tilting of the plate relative to the light beam transmitted through the plate selectively passes or blocks certain wavelength regions of the light beam.
The illumination device of Example 7, wherein the at least one plate is positioned in a collimated beam path of the light beam.
The illumination device of any of Examples 1-8, wherein at least one sub-source of the plurality of sub-sources comprises at least one optical emitter and at least one pulse-width modulation (PWM) circuit configured to control the at least one optical emitter to improve time variant light quality of the at least one sub-source.
The illumination device of any of Examples 1-9, wherein at least one sub-source of the plurality of sub-sources comprises at least one optical emitter and at least one pulse-width modulation (PWM) circuit configured to control the at least one optical emitter to conform to user requirements for perceptually flicker free illumination.
The illumination device of any of Examples 1-10, wherein at least one sub-source of the plurality of sub-sources comprises at least one optical emitter and at least one pulse-width modulation (PWM) circuit configured to control the at least one optical emitter to provide perceptually flicker free illumination at frequencies substantially above 200 Hz.
The illumination device of any of Examples 1-11, wherein the color mixing assembly comprises a collimator.
The illumination device of any of Examples 1-12, further comprising an optical focusing assembly to converge the composite light beam and to transmit the composite light beam to a receiving fiber optic conduit or cable.
The illumination device of any of Examples 1-13, wherein the plurality of sub-sources comprises at least one sub-source comprising a plurality of light emitters configured to produce light flux, the illumination device further comprising a plurality of optical fibers, each optical fiber of the plurality of optical fibers comprising a first end portion configured to receive the light flux from a corresponding light emitter and a second end portion configured to emit the received light flux, the light emitters arranged in a first pattern, the first end portions arranged in the first pattern, and the second end portions are arranged in a second pattern different from the first pattern.
An illumination device comprising:
The illumination device of Example 14 or Example 15, wherein the at least one sub-source comprises an array of sub-sources.
The illumination device of any of Examples 14-16, wherein the array of sub-sources is arranged in a rectilinear, square, or rectangular first sub-pattern, the light emitters of each sub-source arranged in a rectilinear, square, or rectangular second sub-pattern, the first pattern comprising the first sub-pattern and the second sub-pattern, and the second end portions are arranged in a circular pattern.
The illumination device of any of Examples 14-17, wherein the plurality of optical fibers are mechanically coupled together in at least one first end assembly containing the first end portions and at least one second end assembly containing the second end portions.
The illumination device of Example 18, wherein the at least one first end assembly has a non-round format and the at least one second end assembly has a round format or a different non-round format.
The illumination device of Example 18, wherein the at least one first end assembly has a square format and the at least one second end assembly has a round format.
The illumination device of any of Examples 14-20, wherein the plurality of optical fibers are configured to be moved such that the second end portions are positioned at various selected locations relative to the first end portions.
The illumination device of any of Examples 14-21, wherein the first end portions are tapered.
The illumination device of any of Examples 14-16, wherein the plurality of optical fibers are mechanically coupled together in a plurality of end assemblies containing the first end portions and one second end assembly containing the second end portions.
The illumination device of any of Examples 14-16, wherein the plurality of optical fibers are mechanically coupled together in a plurality of end assemblies containing the first end portions and a plurality of second end assemblies containing the second end portions.
The illumination device of any of Examples 14-16, wherein the first end portions are tapered with respect to the second end portions such that the first end portions are smaller than the second end portions.
The illumination device of any of Examples 14-16, wherein the second end portions are tapered with respect to the first end portions such that the second end portions are smaller than the first end portions.
Although described above in connection with particular embodiments, it should be understood the descriptions of the embodiments are illustrative and are not intended to be limiting. Various modifications and applications may occur to those skilled in the art without departing from the true spirit and scope of the invention.
This application claims the benefit of priority to U.S. Provisional Appl. No. 62/503,262 filed May 8, 2017 and to U.S. Provisional Appl. No. 62/517,089 filed Jun. 8, 2017, both of which are incorporated in their entireties by reference herein.
Number | Name | Date | Kind |
---|---|---|---|
497064 | Van Meter | May 1893 | A |
2826114 | Bryan | Mar 1958 | A |
3050870 | Heilig | Aug 1962 | A |
3108781 | Saffir | Oct 1963 | A |
3128988 | Mandroian | Apr 1964 | A |
3141650 | Saffir | Jul 1964 | A |
3405990 | Nothnagle et al. | Oct 1968 | A |
3409346 | Stapsy | Nov 1968 | A |
3664330 | Deutsch | May 1972 | A |
4056310 | Shimizu et al. | Nov 1977 | A |
4063557 | Wuchinich et al. | Dec 1977 | A |
4087198 | Theis, Jr. | May 1978 | A |
4167302 | Karasawa | Sep 1979 | A |
4176453 | Abbott | Dec 1979 | A |
4223676 | Wuchinich et al. | Sep 1980 | A |
4226228 | Shin et al. | Oct 1980 | A |
4344746 | Leonard | Aug 1982 | A |
4354734 | Nkahashi | Oct 1982 | A |
4395731 | Schoolman | Jul 1983 | A |
4562832 | Wilder et al. | Jan 1986 | A |
4651201 | Schoolman | Mar 1987 | A |
4655557 | Takahashi | Apr 1987 | A |
4665391 | Spani | May 1987 | A |
4684224 | Yamashita et al. | Aug 1987 | A |
4703314 | Spani | Oct 1987 | A |
4718106 | Weinblatt | Jan 1988 | A |
4750488 | Wuchinich et al. | Jun 1988 | A |
4750902 | Wuchinich et al. | Jun 1988 | A |
4779968 | Sander | Oct 1988 | A |
4783156 | Yokota | Nov 1988 | A |
4786155 | Fantone et al. | Nov 1988 | A |
4813927 | Morris et al. | Mar 1989 | A |
4873572 | Miyazaki et al. | Oct 1989 | A |
4900301 | Morris et al. | Feb 1990 | A |
4905670 | Adair | Mar 1990 | A |
4920336 | Meijer | Apr 1990 | A |
4922902 | Wuchinich et al. | May 1990 | A |
4986622 | Martinez | Jan 1991 | A |
4989452 | Toon et al. | Feb 1991 | A |
5016098 | Cooper et al. | May 1991 | A |
5032111 | Morris et al. | Jul 1991 | A |
5047009 | Morris et al. | Sep 1991 | A |
5098426 | Sklar et al. | Mar 1992 | A |
5143054 | Adair | Sep 1992 | A |
5151821 | Marks | Sep 1992 | A |
5176677 | Wuchinich et al. | Jan 1993 | A |
5201325 | McEwen et al. | Apr 1993 | A |
5221282 | Wuchinich | Jun 1993 | A |
5251613 | Adair | Oct 1993 | A |
5327283 | Zobel | Jul 1994 | A |
5354314 | Hardy et al. | Oct 1994 | A |
5417210 | Funda et al. | May 1995 | A |
5441059 | Dannan | Aug 1995 | A |
5464008 | Kim | Nov 1995 | A |
5523810 | Volk | Jun 1996 | A |
5537164 | Smith | Jul 1996 | A |
5553995 | Martinez | Sep 1996 | A |
5575789 | Bell et al. | Nov 1996 | A |
5584796 | Cohen | Dec 1996 | A |
5593402 | Patrick | Jan 1997 | A |
5601549 | Miyagi | Feb 1997 | A |
5625493 | Matsumura et al. | Apr 1997 | A |
5634790 | Pathmanabhan et al. | Jun 1997 | A |
5667481 | Villalta et al. | Sep 1997 | A |
5697891 | Hori | Dec 1997 | A |
5712995 | Cohn | Jan 1998 | A |
5716326 | Dannan | Feb 1998 | A |
5743731 | Lares et al. | Apr 1998 | A |
5743846 | Takahashi et al. | Apr 1998 | A |
5747824 | Jung et al. | May 1998 | A |
5751341 | Chaleki | May 1998 | A |
5797403 | DiLorenzo | Aug 1998 | A |
5803733 | Trott et al. | Sep 1998 | A |
5822036 | Massie et al. | Oct 1998 | A |
5825534 | Strahle | Oct 1998 | A |
5835266 | Kitajima | Nov 1998 | A |
5841510 | Roggy | Nov 1998 | A |
5861983 | Twisselman | Jan 1999 | A |
5889611 | Zonneveld | Mar 1999 | A |
5897491 | Kastenbauer et al. | Apr 1999 | A |
5909380 | Dubois | Jun 1999 | A |
5913818 | Co et al. | Jun 1999 | A |
5928139 | Koros et al. | Jul 1999 | A |
5949388 | Atsumi | Sep 1999 | A |
5982532 | Mittelstadt et al. | Nov 1999 | A |
6016607 | Morimoto et al. | Jan 2000 | A |
6023638 | Swanson | Feb 2000 | A |
6088154 | Morita | Jul 2000 | A |
6139493 | Koros et al. | Oct 2000 | A |
6152736 | Schmidinger | Nov 2000 | A |
6152871 | Foley et al. | Nov 2000 | A |
6176825 | Chin et al. | Jan 2001 | B1 |
6217188 | Wainwright et al. | Apr 2001 | B1 |
6246898 | Vesely et al. | Jun 2001 | B1 |
6293911 | Imaizumi et al. | Sep 2001 | B1 |
6317260 | Ito | Nov 2001 | B1 |
6319223 | Wortrich et al. | Nov 2001 | B1 |
6340363 | Bolger et al. | Jan 2002 | B1 |
6350235 | Cohen et al. | Feb 2002 | B1 |
6354992 | Kato | Mar 2002 | B1 |
6398721 | Nakamura | Jun 2002 | B1 |
6405072 | Cosman | Jun 2002 | B1 |
6434329 | Dube et al. | Aug 2002 | B1 |
6443594 | Marshall et al. | Sep 2002 | B1 |
6450706 | Chapman | Sep 2002 | B1 |
6450950 | Irion | Sep 2002 | B2 |
6491661 | Boukhny et al. | Dec 2002 | B1 |
6508759 | Taylor et al. | Jan 2003 | B1 |
6517207 | Chapman | Feb 2003 | B2 |
6525310 | Dunfield | Feb 2003 | B2 |
6525878 | Takahashi | Feb 2003 | B1 |
6527704 | Chang et al. | Mar 2003 | B1 |
6538665 | Crow et al. | Mar 2003 | B2 |
6549341 | Nomura et al. | Apr 2003 | B2 |
6561999 | Nazarifar et al. | May 2003 | B1 |
6582358 | Akui et al. | Jun 2003 | B2 |
6587711 | Alfano et al. | Jul 2003 | B1 |
6589168 | Thompson | Jul 2003 | B2 |
6618207 | Lei | Sep 2003 | B2 |
6626445 | Murphy et al. | Sep 2003 | B2 |
6633328 | Byrd et al. | Oct 2003 | B1 |
6635010 | Lederer | Oct 2003 | B1 |
6636254 | Onishi et al. | Oct 2003 | B1 |
6661571 | Shioda et al. | Dec 2003 | B1 |
6668841 | Chou | Dec 2003 | B1 |
6698886 | Pollack et al. | Mar 2004 | B2 |
6720988 | Gere et al. | Apr 2004 | B1 |
6757021 | Nguyen-Nhu | Jun 2004 | B1 |
6805127 | Karasic | Oct 2004 | B1 |
6817975 | Farr et al. | Nov 2004 | B1 |
6824525 | Nazarifar et al. | Nov 2004 | B2 |
6847336 | Lemelson et al. | Jan 2005 | B1 |
6869398 | Obenchain et al. | Mar 2005 | B2 |
6873867 | Vilsmeier | Mar 2005 | B2 |
6892597 | Tews | May 2005 | B2 |
6903883 | Amanai | Jun 2005 | B2 |
6908451 | Brody et al. | Jun 2005 | B2 |
6985765 | Morita | Jan 2006 | B2 |
6996460 | Krahnstoever et al. | Feb 2006 | B1 |
7034983 | Desimone et al. | Apr 2006 | B2 |
7050225 | Nakamura | May 2006 | B2 |
7050245 | Tesar et al. | May 2006 | B2 |
7054076 | Tesar et al. | May 2006 | B2 |
7116437 | Weinstein et al. | Oct 2006 | B2 |
7125119 | Farberov | Oct 2006 | B2 |
7150713 | Shener et al. | Dec 2006 | B2 |
7150714 | Myles | Dec 2006 | B2 |
7154527 | Goldstein et al. | Dec 2006 | B1 |
7155316 | Sutherland | Dec 2006 | B2 |
7163543 | Smedley et al. | Jan 2007 | B2 |
7226451 | Shluzas et al. | Jun 2007 | B2 |
7244240 | Nazarifar et al. | Jul 2007 | B2 |
7278092 | Krzanowski | Oct 2007 | B2 |
7298393 | Morita | Nov 2007 | B2 |
7306559 | Williams | Dec 2007 | B2 |
7307799 | Minefuji | Dec 2007 | B2 |
7326183 | Nazarifar et al. | Feb 2008 | B2 |
7471301 | Lefevre | Dec 2008 | B2 |
7480872 | Ubillos | Jan 2009 | B1 |
7494463 | Nehls | Feb 2009 | B2 |
7518791 | Sander | Apr 2009 | B2 |
7537565 | Bass | May 2009 | B2 |
7538939 | Zimmerman et al. | May 2009 | B2 |
7559887 | Dannan | Jul 2009 | B2 |
7621868 | Breidenthal et al. | Nov 2009 | B2 |
7633676 | Brunner et al. | Dec 2009 | B2 |
7644889 | Johnson | Jan 2010 | B2 |
7651465 | Sperling et al. | Jan 2010 | B1 |
7713237 | Nazarifar et al. | May 2010 | B2 |
7764370 | Williams et al. | Jul 2010 | B2 |
7766480 | Graham et al. | Aug 2010 | B1 |
7777941 | Zimmer | Aug 2010 | B2 |
7785253 | Arambula | Aug 2010 | B1 |
7786457 | Gao | Aug 2010 | B2 |
7806865 | Wilson | Oct 2010 | B1 |
7844320 | Shahidi | Nov 2010 | B2 |
7872746 | Gao et al. | Jan 2011 | B2 |
7874982 | Selover et al. | Jan 2011 | B2 |
7896839 | Nazarifar et al. | Mar 2011 | B2 |
7907336 | Abele et al. | Mar 2011 | B2 |
7927272 | Bayer et al. | Apr 2011 | B2 |
7932925 | Inbar et al. | Apr 2011 | B2 |
7956341 | Gao | Jun 2011 | B2 |
8009141 | Chi et al. | Aug 2011 | B1 |
8012089 | Bayat | Sep 2011 | B2 |
8018523 | Choi | Sep 2011 | B2 |
8018579 | Krah | Sep 2011 | B1 |
8027710 | Dannan | Sep 2011 | B1 |
8038612 | Paz | Oct 2011 | B2 |
8070290 | Gille et al. | Dec 2011 | B2 |
8088066 | Grey et al. | Jan 2012 | B2 |
8136779 | Wilson et al. | Mar 2012 | B2 |
8149270 | Yaron et al. | Apr 2012 | B1 |
8159743 | Abele et al. | Apr 2012 | B2 |
8169468 | Scott et al. | May 2012 | B2 |
8187167 | Kim | May 2012 | B2 |
8187180 | Pacey | May 2012 | B2 |
8194121 | Blumzvig et al. | Jun 2012 | B2 |
8221304 | Shioda et al. | Jul 2012 | B2 |
8229548 | Frangioni | Jul 2012 | B2 |
8294733 | Eino | Oct 2012 | B2 |
8295693 | McDowall | Oct 2012 | B2 |
8351434 | Fukuda et al. | Jan 2013 | B1 |
8358330 | Riederer | Jan 2013 | B2 |
8405733 | Saijo | Mar 2013 | B2 |
8408772 | Li | Apr 2013 | B2 |
8409088 | Grey et al. | Apr 2013 | B2 |
8419633 | Koshikawa et al. | Apr 2013 | B2 |
8419634 | Nearman et al. | Apr 2013 | B2 |
8430840 | Nazarifar et al. | Apr 2013 | B2 |
8439830 | McKinley et al. | May 2013 | B2 |
8460184 | Nearman et al. | Jun 2013 | B2 |
8464177 | Ben-Yoseph | Jun 2013 | B2 |
8482606 | Razzaque | Jul 2013 | B2 |
8498695 | Westwick et al. | Jul 2013 | B2 |
8521331 | Itkowitz | Aug 2013 | B2 |
8702592 | Langlois et al. | Apr 2014 | B2 |
8702602 | Berci et al. | Apr 2014 | B2 |
8734328 | McDowall | May 2014 | B2 |
8786946 | Nakamura | Jul 2014 | B2 |
8827899 | Farr et al. | Sep 2014 | B2 |
8827902 | Dietze, Jr. et al. | Sep 2014 | B2 |
8836723 | Tsao et al. | Sep 2014 | B2 |
8858425 | Farr et al. | Oct 2014 | B2 |
8876711 | Lin et al. | Nov 2014 | B2 |
8878924 | Farr | Nov 2014 | B2 |
8882662 | Charles | Nov 2014 | B2 |
8976238 | Ernsperger et al. | Mar 2015 | B2 |
8979301 | Moore | Mar 2015 | B2 |
9033870 | Farr et al. | May 2015 | B2 |
9216068 | Tesar | Dec 2015 | B2 |
9492065 | Tesar et al. | Nov 2016 | B2 |
9615728 | Charles et al. | Apr 2017 | B2 |
9629523 | Tesar et al. | Apr 2017 | B2 |
9642606 | Charles et al. | May 2017 | B2 |
9681796 | Tesar et al. | Jun 2017 | B2 |
9723976 | Tesar | Aug 2017 | B2 |
9782159 | Tesar | Oct 2017 | B2 |
9936863 | Tesar | Apr 2018 | B2 |
10022041 | Charles et al. | Jul 2018 | B2 |
10028651 | Tesar | Jul 2018 | B2 |
10231607 | Charles et al. | Mar 2019 | B2 |
10555728 | Charles et al. | Feb 2020 | B2 |
10568499 | Tesar | Feb 2020 | B2 |
10702353 | Tesar | Jul 2020 | B2 |
20010055062 | Shioda et al. | Dec 2001 | A1 |
20020013514 | Brau | Jan 2002 | A1 |
20020049367 | Irion et al. | Apr 2002 | A1 |
20020065461 | Cosman | May 2002 | A1 |
20020082498 | Wendt et al. | Jun 2002 | A1 |
20030055410 | Evans et al. | Mar 2003 | A1 |
20030059097 | Abovitz et al. | Mar 2003 | A1 |
20030078494 | Panescu et al. | Apr 2003 | A1 |
20030088179 | Seeley et al. | May 2003 | A1 |
20030102819 | Min | Jun 2003 | A1 |
20030103191 | Staurenghi et al. | Jun 2003 | A1 |
20030142204 | Rus et al. | Jul 2003 | A1 |
20030147254 | Yoneda | Aug 2003 | A1 |
20040017607 | Hauger et al. | Jan 2004 | A1 |
20040027652 | Erdogan | Feb 2004 | A1 |
20040036962 | Brunner et al. | Feb 2004 | A1 |
20040070822 | Shioda et al. | Apr 2004 | A1 |
20040087833 | Bauer et al. | May 2004 | A1 |
20040111183 | Sutherland | Jun 2004 | A1 |
20040196553 | Banju et al. | Oct 2004 | A1 |
20040230191 | Frey et al. | Nov 2004 | A1 |
20050018280 | Richardson | Jan 2005 | A1 |
20050019722 | Schmid et al. | Jan 2005 | A1 |
20050026104 | Takahashi | Feb 2005 | A1 |
20050031192 | Sieckmann | Feb 2005 | A1 |
20050033117 | Ozaki et al. | Feb 2005 | A1 |
20050052527 | Remy et al. | Mar 2005 | A1 |
20050063047 | Obrebski et al. | Mar 2005 | A1 |
20050064936 | Pryor | Mar 2005 | A1 |
20050065435 | Rauch et al. | Mar 2005 | A1 |
20050095554 | Wilkinson | May 2005 | A1 |
20050107808 | Evans et al. | May 2005 | A1 |
20050171551 | Sukovich et al. | Aug 2005 | A1 |
20050215866 | Kim | Sep 2005 | A1 |
20050228231 | MacKinnon et al. | Oct 2005 | A1 |
20050228232 | Gillinov et al. | Oct 2005 | A1 |
20050279355 | Loubser | Dec 2005 | A1 |
20060004261 | Douglas | Jan 2006 | A1 |
20060020213 | Whitman et al. | Jan 2006 | A1 |
20060025656 | Buckner et al. | Feb 2006 | A1 |
20060069315 | Miles et al. | Mar 2006 | A1 |
20060069316 | Dorfman et al. | Mar 2006 | A1 |
20060085969 | Bennett et al. | Apr 2006 | A1 |
20060092178 | Tanguya, Jr. et al. | May 2006 | A1 |
20060114411 | Wei et al. | Jun 2006 | A1 |
20060129140 | Todd et al. | Jun 2006 | A1 |
20060152516 | Plummer | Jul 2006 | A1 |
20060235279 | Hawkes et al. | Oct 2006 | A1 |
20060236264 | Cain et al. | Oct 2006 | A1 |
20060241499 | Irion et al. | Oct 2006 | A1 |
20060276693 | Pacey | Dec 2006 | A1 |
20060293557 | Chuanggui et al. | Dec 2006 | A1 |
20070010716 | Malandain | Jan 2007 | A1 |
20070019916 | Takami | Jan 2007 | A1 |
20070038080 | Salisbury, Jr. et al. | Feb 2007 | A1 |
20070086205 | Krupa et al. | Apr 2007 | A1 |
20070129608 | Sandhu | Jun 2007 | A1 |
20070129719 | Kendale et al. | Jun 2007 | A1 |
20070153541 | Bennett et al. | Jul 2007 | A1 |
20070173853 | MacMillan | Jul 2007 | A1 |
20070238932 | Jones et al. | Oct 2007 | A1 |
20070282171 | Karpowicz et al. | Dec 2007 | A1 |
20080015417 | Hawkes et al. | Jan 2008 | A1 |
20080058606 | Miles et al. | Mar 2008 | A1 |
20080081947 | Irion et al. | Apr 2008 | A1 |
20080091066 | Sholev | Apr 2008 | A1 |
20080094583 | Williams et al. | Apr 2008 | A1 |
20080096165 | Virnicchi et al. | Apr 2008 | A1 |
20080097467 | Gruber et al. | Apr 2008 | A1 |
20080123183 | Awdeh | May 2008 | A1 |
20080151041 | Shafer et al. | Jun 2008 | A1 |
20080183038 | Tilson et al. | Jul 2008 | A1 |
20080195128 | Orbay et al. | Aug 2008 | A1 |
20080221394 | Melkent et al. | Sep 2008 | A1 |
20080221591 | Farritor et al. | Sep 2008 | A1 |
20080266840 | Nordmeyer et al. | Oct 2008 | A1 |
20080269564 | Gelnett | Oct 2008 | A1 |
20080269730 | Dotson | Oct 2008 | A1 |
20080278571 | Mora | Nov 2008 | A1 |
20080300465 | Feigenwinter et al. | Dec 2008 | A1 |
20080303899 | Berci | Dec 2008 | A1 |
20080310181 | Gurevich | Dec 2008 | A1 |
20080319266 | Poll et al. | Dec 2008 | A1 |
20090030436 | Charles | Jan 2009 | A1 |
20090034286 | Krupa et al. | Feb 2009 | A1 |
20090040783 | Krupa et al. | Feb 2009 | A1 |
20090052059 | Lin | Feb 2009 | A1 |
20090105543 | Miller et al. | Apr 2009 | A1 |
20090137893 | Seibel et al. | May 2009 | A1 |
20090137989 | Kataoka | May 2009 | A1 |
20090149716 | Diao et al. | Jun 2009 | A1 |
20090156902 | Dewey et al. | Jun 2009 | A1 |
20090185392 | Krupa et al. | Jul 2009 | A1 |
20090190209 | Nakamura | Jul 2009 | A1 |
20090190371 | Root et al. | Jul 2009 | A1 |
20090209826 | Sanders et al. | Aug 2009 | A1 |
20090238442 | Upham et al. | Sep 2009 | A1 |
20090244259 | Kojima et al. | Oct 2009 | A1 |
20090245600 | Hoffman et al. | Oct 2009 | A1 |
20090248036 | Hoffman et al. | Oct 2009 | A1 |
20090258638 | Lee | Oct 2009 | A1 |
20090304582 | Rousso et al. | Dec 2009 | A1 |
20090318756 | Fisher et al. | Dec 2009 | A1 |
20090326322 | Diolaiti | Dec 2009 | A1 |
20090326331 | Rosen | Dec 2009 | A1 |
20100013910 | Farr | Jan 2010 | A1 |
20100013971 | Amano | Jan 2010 | A1 |
20100081919 | Hyde et al. | Apr 2010 | A1 |
20100107118 | Pearce | Apr 2010 | A1 |
20100128350 | Findlay et al. | May 2010 | A1 |
20100161129 | Costa et al. | Jun 2010 | A1 |
20100168520 | Poll et al. | Jul 2010 | A1 |
20100182340 | Bachelder et al. | Jul 2010 | A1 |
20100198014 | Poll et al. | Aug 2010 | A1 |
20100198241 | Gerrah et al. | Aug 2010 | A1 |
20100208046 | Takahashi | Aug 2010 | A1 |
20100245557 | Luley, III et al. | Sep 2010 | A1 |
20100249496 | Cardenas et al. | Sep 2010 | A1 |
20100286473 | Roberts | Nov 2010 | A1 |
20100305409 | Chang | Dec 2010 | A1 |
20100312069 | Sutherland et al. | Dec 2010 | A1 |
20100318099 | Itkowitz et al. | Dec 2010 | A1 |
20100331855 | Zhao et al. | Dec 2010 | A1 |
20110034781 | Loftus | Feb 2011 | A1 |
20110038040 | Abele et al. | Feb 2011 | A1 |
20110042452 | Cormack | Feb 2011 | A1 |
20110046439 | Pamnani et al. | Feb 2011 | A1 |
20110063734 | Sakaki | Mar 2011 | A1 |
20110065999 | Manzanares | Mar 2011 | A1 |
20110071359 | Bonadio et al. | Mar 2011 | A1 |
20110080536 | Nakamura et al. | Apr 2011 | A1 |
20110115882 | Shahinian et al. | May 2011 | A1 |
20110115891 | Trusty | May 2011 | A1 |
20110144436 | Nearman et al. | Jun 2011 | A1 |
20110178395 | Miesner et al. | Jul 2011 | A1 |
20110184243 | Wright et al. | Jul 2011 | A1 |
20110190588 | McKay | Aug 2011 | A1 |
20110234841 | Akeley et al. | Sep 2011 | A1 |
20110249323 | Tesar et al. | Oct 2011 | A1 |
20110257488 | Koyama et al. | Oct 2011 | A1 |
20110263938 | Levy | Oct 2011 | A1 |
20110264078 | Lipow et al. | Oct 2011 | A1 |
20110288560 | Shohat et al. | Nov 2011 | A1 |
20110298704 | Krah | Dec 2011 | A1 |
20110301421 | Michaeli et al. | Dec 2011 | A1 |
20110316994 | Lemchen | Dec 2011 | A1 |
20120029280 | Kucklick | Feb 2012 | A1 |
20120035423 | Sebastian et al. | Feb 2012 | A1 |
20120035638 | Mathaneswaran et al. | Feb 2012 | A1 |
20120040305 | Karazivan et al. | Feb 2012 | A1 |
20120041272 | Dietze, Jr. et al. | Feb 2012 | A1 |
20120041534 | Clerc et al. | Feb 2012 | A1 |
20120059222 | Yoshida | Mar 2012 | A1 |
20120065468 | Levy et al. | Mar 2012 | A1 |
20120087006 | Signaigo | Apr 2012 | A1 |
20120088974 | Maurice | Apr 2012 | A1 |
20120089093 | Trusty | Apr 2012 | A1 |
20120097567 | Zhao et al. | Apr 2012 | A1 |
20120108900 | Viola et al. | May 2012 | A1 |
20120116173 | Viola | May 2012 | A1 |
20120127573 | Robinson et al. | May 2012 | A1 |
20120130399 | Moll et al. | May 2012 | A1 |
20120134028 | Maruyama | May 2012 | A1 |
20120157775 | Yamaguchi | Jun 2012 | A1 |
20120157787 | Weinstein et al. | Jun 2012 | A1 |
20120157788 | Serowski et al. | Jun 2012 | A1 |
20120158015 | Fowler et al. | Jun 2012 | A1 |
20120190925 | Luiken | Jul 2012 | A1 |
20120197084 | Drach et al. | Aug 2012 | A1 |
20120230668 | Vogt | Sep 2012 | A1 |
20120232352 | Lin et al. | Sep 2012 | A1 |
20120245432 | Karpowicz et al. | Sep 2012 | A1 |
20120265023 | Berci et al. | Oct 2012 | A1 |
20120320102 | Jorgensen | Dec 2012 | A1 |
20120330129 | Awdeh | Dec 2012 | A1 |
20130012770 | Su | Jan 2013 | A1 |
20130027516 | Hart et al. | Jan 2013 | A1 |
20130041226 | McDowall | Feb 2013 | A1 |
20130041368 | Cunningham et al. | Feb 2013 | A1 |
20130060095 | Bouquet | Mar 2013 | A1 |
20130066304 | Belson et al. | Mar 2013 | A1 |
20130072917 | Kaschke et al. | Mar 2013 | A1 |
20130076863 | Rappel | Mar 2013 | A1 |
20130077048 | Mirlay | Mar 2013 | A1 |
20130085337 | Hess et al. | Apr 2013 | A1 |
20130159015 | O'Con | Jun 2013 | A1 |
20130197313 | Wan | Aug 2013 | A1 |
20130245383 | Friedrich et al. | Sep 2013 | A1 |
20130298208 | Ayed | Nov 2013 | A1 |
20130331730 | Fenech et al. | Dec 2013 | A1 |
20140005488 | Charles et al. | Jan 2014 | A1 |
20140081659 | Nawana et al. | Mar 2014 | A1 |
20140168785 | Belgum | Jun 2014 | A1 |
20140168799 | Hurbert et al. | Jun 2014 | A1 |
20140179998 | Pacey et al. | Jun 2014 | A1 |
20140187859 | Leeuw et al. | Jul 2014 | A1 |
20140198190 | Okumu | Jul 2014 | A1 |
20140247482 | Doi et al. | Sep 2014 | A1 |
20140275801 | Menchaca et al. | Sep 2014 | A1 |
20140276008 | Steinbach et al. | Sep 2014 | A1 |
20140285403 | Kobayashi | Sep 2014 | A1 |
20140316209 | Overes et al. | Oct 2014 | A1 |
20140327742 | Kiening et al. | Nov 2014 | A1 |
20140347395 | Tsao et al. | Nov 2014 | A1 |
20140362228 | McCloskey et al. | Dec 2014 | A1 |
20140378843 | Valdes et al. | Dec 2014 | A1 |
20150025324 | Wan | Jan 2015 | A1 |
20150080982 | Van Funderburk | Mar 2015 | A1 |
20150087918 | Vasan | Mar 2015 | A1 |
20150094533 | Kleiner et al. | Apr 2015 | A1 |
20150112148 | Bouquet | Apr 2015 | A1 |
20150141755 | Tesar | May 2015 | A1 |
20150297311 | Tesar | Oct 2015 | A1 |
20150300816 | Yang et al. | Oct 2015 | A1 |
20160018598 | Hansson | Jan 2016 | A1 |
20160089026 | Heerren | Mar 2016 | A1 |
20160139039 | Ikehara et al. | May 2016 | A1 |
20160220324 | Tesar | Aug 2016 | A1 |
20170020627 | Tesar | Jan 2017 | A1 |
20170143442 | Tesar | May 2017 | A1 |
20170258550 | Vazales | Sep 2017 | A1 |
20180055348 | Tesar et al. | Mar 2018 | A1 |
20180055502 | Charles et al. | Mar 2018 | A1 |
20180064316 | Charles et al. | Mar 2018 | A1 |
20180064317 | Tesar | Mar 2018 | A1 |
20180070804 | Tesar | Mar 2018 | A1 |
20180256145 | Tesar | Sep 2018 | A1 |
20180353059 | Tesar | Dec 2018 | A1 |
20180368656 | Austin et al. | Dec 2018 | A1 |
20190046021 | Charles et al. | Feb 2019 | A1 |
20190053700 | Tesar | Feb 2019 | A1 |
20190380566 | Charles | Dec 2019 | A1 |
Number | Date | Country |
---|---|---|
2336380 | Sep 1999 | CN |
101518438 | Sep 2009 | CN |
102495463 | Jun 2012 | CN |
202920720 | May 2013 | CN |
103 41 125 | Apr 2005 | DE |
10 2010 030 285 | Dec 2011 | DE |
10 2010 044 502 | Mar 2012 | DE |
0 293 228 | Nov 1988 | EP |
0 233 940 | Nov 1993 | EP |
0 466 705 | Jun 1996 | EP |
1 175 106 | Jan 2002 | EP |
1 333 305 | Aug 2003 | EP |
2 641 561 | Sep 2013 | EP |
49-009378 | Mar 1974 | JP |
03-018891 | Jan 1991 | JP |
06-315487 | Nov 1994 | JP |
07-194602 | Aug 1995 | JP |
07-261094 | Oct 1995 | JP |
08-131399 | May 1996 | JP |
2001-087212 | Apr 2001 | JP |
2001-117049 | Apr 2001 | JP |
2001-161638 | Jun 2001 | JP |
2001-161640 | Jun 2001 | JP |
2002-011022 | Jan 2002 | JP |
3402797 | May 2003 | JP |
2003-322803 | Nov 2003 | JP |
2004-024835 | Jan 2004 | JP |
3549253 | Aug 2004 | JP |
2004-305525 | Nov 2004 | JP |
2007-068876 | Mar 2007 | JP |
2009-288296 | Dec 2009 | JP |
4503748 | Jul 2010 | JP |
2010-206495 | Sep 2010 | JP |
2011-118741 | Jun 2011 | JP |
WO 87001276 | Mar 1987 | WO |
WO 91012034 | Aug 1991 | WO |
WO 99017661 | Apr 1999 | WO |
WO 00078372 | Dec 2000 | WO |
WO 01072209 | Oct 2001 | WO |
WO 2007047782 | Apr 2007 | WO |
WO 2008073243 | Jun 2008 | WO |
WO 2009051013 | Apr 2009 | WO |
WO 2010079817 | Jul 2010 | WO |
WO 2010114843 | Oct 2010 | WO |
WO 2010123578 | Oct 2010 | WO |
WO 2011069469 | Jun 2011 | WO |
WO 2012047962 | Apr 2012 | WO |
WO 2012078989 | Jun 2012 | WO |
WO 2013049679 | Apr 2013 | WO |
WO 2013109966 | Jul 2013 | WO |
WO 2013116489 | Aug 2013 | WO |
WO 2014004717 | Jan 2014 | WO |
WO 2014060412 | Apr 2014 | WO |
WO 2014189969 | Nov 2014 | WO |
WO 2015042460 | Mar 2015 | WO |
WO 2015042483 | Mar 2015 | WO |
WO 2015100310 | Jul 2015 | WO |
WO 2016090336 | Jun 2016 | WO |
WO 2016154589 | Sep 2016 | WO |
WO 2017091704 | Jun 2017 | WO |
WO 2018208691 | Nov 2018 | WO |
WO 2018217951 | Nov 2018 | WO |
Entry |
---|
Aesculap Inc.; Aesculap Neurosurgery Pneumatic Kerrison; http://www.aesculapusa.com/assets/base/doc/doc763-pneumatic_kerrison_brochure.pdf; 2008; in 12 pages. |
Aliaga, Daniel G.; “Image Morphing and Warping”; Department of Computer Science; Purdue University; Spring 2010; in 61 pages. |
“ARRI Medical Shows SeeFront 3D Display with HD 3D Surgical Microscope”; dated Jun. 9, 2013; downloaded from http://www.seefront.com/news-events/article/arri-medical-shows-seefront-3d-display-with-hd-3d-surgical-microscope/ in 2 pages. |
“Arriscope: A New Era in Surgical Microscopy”; Arriscope Brochure published May 20, 2014 in 4 pages. |
AustriaMicroSystems; “A55050: Smallest Magnetic Rotary Encoder for μA Low Power Applications”; www.austriamicrosystems.com/AS5050 printed Nov. 2012 in 2 pages. |
Bayonet Lock Video; 00:16 in length; Date Unknown; Received Oct. 15, 2014 [Screenshots captured at 00:00, 00:02, 00:05, 00:08, and 00:16]. |
BellowsTech; “Actuators”; www.bellowstech.com/metal-bellows/actuators/ printed Jul. 17, 2012 in 4 pages. |
“Carl Zeiss Unveils $99 VR One Virtual Reality Headset”; www.electronista.com/articles/15/10/10/zeiss.vr.one.able.to.accept.variety.of.smartphones.using.custom.trays printed Oct. 13, 2014 in 2 pages. |
Design boom; “Bright LED”; http://www.designboom.com/project/fiber-optics-light-glove/; Sep. 28, 2007. |
Fei-Fei, Li; Lecture 10: Multi-View Geometry; Stanford Vision Lab; Oct. 24, 2011; in 89 pages. |
“Fuse™ . Full Spectrum Endoscopy™” ; http://www.endochoice.com.Fuse printed Oct. 7, 2013 in 3 pages. |
Hardesty, Larry; “3-D Cameras for Cellphones: Clever math could enable a high-quality 3-D camera so simple, cheap and power-efficient that it could be incorporated into handheld devices”; MIT News Office; http://web.mit.edu/newsoffice/2011/lidar-3d-camera-cellphones-0105.html; Jan. 5, 2012; in 4 pages. |
Hartley et al.; “Multiple View Geometry in Computer Vision: Chapter 9—Epipolar Geometry and the Fundamental Matrix”; http://www.robots/ox.ac.uk/˜vgg/hzbook2/HZepipolar.pdf; Mar. 2004; 2nd Edition; Ch. 9; pp. 239-261. |
Heidelberg Engineering; “MultiColor: Scanning Laser Imaging”; http://www.heidelbergengineering.com/us/products/spectralis-models/imaging-modes/multicolor/; Copyright © 2013; printed Apr. 5, 2013. |
Kramer, Jennifer; “The Right Filter Set Gets the Most out of a Microscope”; Biophotonics International; Jan./Feb. 1999; vol. 6; pp. 54-58. |
Krishna, Golden; “Watch: What Good is a Screen?”; http://www.cooper.com/author/golden_krishna as printed Jul. 9, 2014 in 62 pages. |
Lang et al.; “ZEISS Microscopes for Microsurgery”; Springer-Verlag; Berlin, Heidelberg; 1981. |
Leica Microsystems; “Images TrueVision Integrated 3D”; http://www.leica-microsystems.com/products/surgical-microscopes/neurosurgery-spine/details/product/truevision-integrated-3d/gallery/; Nov. 26, 2014; in 3 pages. |
Leica Microsystems; “Leica Microsystems' Ophthalmic Surgical Microscopes with TrueVision 3D Technology Available Globally”; http://leica-microsystems.com/products/surgical-microscopes/neurosurgery-spine/details/product/truevision-integrated-3d/news/; Sep. 18, 2014; in 5 pages. |
Lutze et al.; “Microsystems Technology for Use in a Minimally Invasive Endoscope Assisted Neurosurgical Operating System —MINOP II”; 2005; http://web.archive.org/web/20151120215151/http://www.meditec.hia.rwth-aachen.de/fileadmin/content/meditec/bilder/forschung.aktuelle_projekte/robotische/Exoscope_Aesculap/pdf; Nov. 20, 2015 in 4 pages. |
Male Bayonet Video; 00:04 in length; Date Unknown; Received Oct. 10, 2014 [Screenshots captured at 00:00, 00:01, 00:02, 00:03, and 00:04]. |
MediTec; “MINOP II—Robotical Microscope Platform”; http:web.archive.org/web/20151120213932/http://www.meditec.hia.rwth-aachen.de/en/research/former-projects/minop-II/; Nov. 20, 2015 in 3 pages. |
Melexis; “MLX75031 Optical Gesture and Proximity Sensing IC”; http://melexis.com/optical-sensors/optical-sensing.mlx75031-815.aspx?sta printed Mar. 15, 2013 in 1 page. |
MMR Technologies; “Micro Miniature Refrigerators”; http://www.mmr-tech.com/mmr_overview.php; Copyright © 2011; printed Feb. 11, 2013. |
Moog; “Surgical Handpieces: Therapeutic Ultrasonic Devices”; http://www.moog.com/products/surgical-hpieces/ printed Sep. 25, 2013 in 1 page. |
Morita; “TwinPower Turbine® High Speed Handpieces Standard, 45°, and Ultra Series Head Designs”; J. Morita Mfg. Corp., http://www.morita.com/usa/root/img/pool/pdf/product_brochures/twinpower_brochure_I-264_0512_web.pdf; May 2012; in 20 pages. |
“Narrow Band Imaging”; http://web.archive.org/web/20150701233623/https://en.wikipedia.org/wiki/Narrow_band_imaging printed Jul. 1, 2015 in 1 page. |
Olympus; “Olympus Introduces the World's First and Only Monopolar, Disposable Tonsil Adenoid Debrider (DTAD)”; http://www.olympusamerica.com/corporate/corp_presscenter_headline.asp?pressNo=926; Sep. 11, 2012; in 2 pages. |
OmniVision; “OV2722 full HD (1080p) product brief: 1/6-Inch Native 1080p HD CameraChip Sensor for Ultra-Compact Applications”; http://web.archive.org/web/20120730043057/http://www.ovt.com/download_document.php?type=sensor&sensorid=119; May 2012 in 2 pages. |
Orthofix; “ProView Map System Retractors”; www.us.orthofix.com/products/previewtractors.asp?cid=39; Copyright © 2010; printed Apr. 1, 2013. |
OrtusTech; “Sample Shipment Start: World's Smallest Size Full-HD Color TFT LCD”; http://ortustech.co.jp/english/notice/20120427.html printed May 22, 2012 in 2 pages. |
“Portion”; Definition; American Heritage® Dictionary of the English Language; Fifth Edition; 2016; Retrieved Apr. 12, 2018 from https://www.thefreedictionary.com/portion in 1 page. |
Purcher, Jack; “Apple Wins a Patent for an Oculus Rift-Like Display System”; http://www.patentlyapple.com/patently-apple/2014/09/apple-wins-a-patent-for-an-oculus-rift-like-display-system.html; Sep. 9, 2014. |
Rustum, Dr. Abu; ICG Mapping Endometrial Cancer; Pinpoint Endometrium Ca Lenfedenektomi MSKCC May 2013; Memorial Sloan Kettering Cancer Center; May 2013; Published to YouTube.com Sep. 1, 2013; in 2 pages; http://web.archive.org/web/20150402210857/https://www.youtube.com/watch?v=DhVhvaUCe4I. |
Saab, Mark; “Applications of High-Pressure Balloons in the Medical Device Industry”; http://www.ventionmedical.com/documents/medicalballoonpaper.pdf; Copyright © 1999; in 19 pages. |
Savage, Lynn; “Sound and Light, Signifying Improved Imaging”; www.photonics.com/Article.aspx?AID=45039; Nov. 1, 2010; in 6 pages. |
Sun et al.; “Neurotoxin-Directed Synthesis and in Vitro Evaluation of Au Nanoclusters”; RSC Advances, 2015; vol. 5, No. 38; pp. 29647-29652. |
Timm, Karl Walter; “Real-Time View Morphing of Video Streams”; University of Illinois; Chicago, Illinois; 2003; in 168 pages. |
TrueVision Microscopes; http://truevisionmicroscopes.com/images/productsnew/0810a-f.jpg; printed Nov. 26, 2014 in 1 page. |
TrueVision; “About TrueVision”; http://web.archive.org/web/20071208125103/http://www.truevisionsys.com/about.html; as viewed Dec. 8, 2007 in 2 pages. |
TrueVision; “Leica Microsystems and TrueVision® 3D Surgical create the first 3D digital hybrid microscope”; Press Release; Oct. 5, 2012; in 2 pages. |
TrueVision; “TrueVision Technology”; http://web.archive.org/web/20071208125125/http://www.truevisionsys.com/technology.html; as viewed Dec. 8, 2007 in 2 pages. |
Whitney et al.; “Pop-up book MEMS”; Journal of Micromechanics and Microengineering; Oct. 14, 2011; vol. 21; No. 115021; in 7 pages. |
Wikipedia; “Zoom Lens”; http://en.wikipedia.org/wiki/Optical_Zoom; printed Oct. 7, 2014 in 3 pages. |
Zeiss; “Informed for Medical Professionals, Focus: Fluorescence”; Carl Zeiss; 2nd Issue; Oct. 2006; 30-801-LBW-GFH-X-2006; Printed in Germany; in 32 pages. |
Zeiss; “Ophthalmic Surgery in Its Highest Form, OPMI® VISU 210”; Carl Zeiss, 2005, 30-097/III-e/USA Printed in Germany AW-TS-V/2005 Uoo; in 19 pages. |
Zeiss; “SteREO Discovery. V12, Expanding the Boundaries”; Carl Zeiss, Sep. 2004; 46/0008 e Sep. 2004, in 6 pages. |
Zeiss; “Stereomicroscopes: Stemi SV 6, SV 11, SV 11 Apo”; The Profile; 1999; in 30 pages. |
Zeiss; “Time for a Change: OPMI® pico for ENT”; Carl Zeiss, 2005, 30-451/III-e Printed in Germany LBW-TS-V/2005 Uoo, in 8 pages. |
Zhang, Michael; “LIFX: A WiFi-Enabled LED Bulb that May Revolutionize Photographic Lighting”; http://www.petapixel.com/2012/09/22/lifx-a-wifi-led-bulb-that-may-revolutionize-photographic-lighting/ printed Sep. 28, 2012 in 9 pages. |
Zhang, Sarah; “The Obscure Neuroscience Problem That's Plaguing VR”; http://web.archive.org/web/20150812172934/http://www.wired.com/2015/08/obscure-neuroscience-problem-thats-plaguing-vr; Aug. 11, 2015 in 5 pages. |
Preliminary Amendment in U.S. Appl. No. 16/357,081, dated Sep. 4, 2019. |
Official Communication in European Application No. 13808996.6, dated Jan. 4, 2016. |
Official Communication in European Application No. 13808996.6, dated Apr. 14, 2016. |
Official Communication in European Application No. 13808996.6, dated Feb. 21, 2017. |
Official Communication in European Application No. 13808996.6, dated Jun. 6, 2017. |
Official Communication in European Application No. 13808996.6, dated Jun. 15, 2018. |
Official Communication in European Application No. 13808996.6, dated May 13, 2019. |
Official Communication in Japanese Application No. 2015-520471, dated May 9, 2017. |
Official Communication in Japanese Application No. 2015-520471, dated Nov. 21, 2017. |
Notice of Decision or Rejection in Japanese Application No. 2015-520471, dated Jul. 24, 2018. |
International Search Report and Written Opinion in PCT Application No. PCT/US2013/047972, dated Jan. 3, 2014. |
International Preliminary Report on Patentability in PCT Application No. PCT/US2013/047972, dated Jan. 8, 2015. |
Preliminary Amendment in U.S. Appl. No. 15/483,995, dated Nov. 21, 2017. |
Office Action in U.S. Appl. No. 15/483,995, dated Mar. 9, 2018. |
Amendment in U.S. Appl. No. 15/483,995, dated Sep. 7, 2018. |
Final Office Action in U.S. Appl. No. 15/483,995, dated Nov. 29, 2018. |
Amendment in U.S. Appl. No. 15/483,995, dated May 28, 2019. |
Office Action in U.S. Appl. No. 15/483,995, dated Jun. 13, 2019. |
Office Action in U.S. Appl. No. 15/645,589, dated Feb. 9, 2018. |
Amendment in U.S. Appl. No. 15/645,589, dated Aug. 7, 2018. |
Final Office Action in U.S. Appl. No. 15/645,589, dated Nov. 28, 2018. |
Amendment in U.S. Appl. No. 15/645,589, dated May 28, 2019. |
Office Action in U.S. Appl. No. 15/645,589, dated Jun. 13, 2019. |
Preliminary Amendment filed in U.S. Appl. No. 16/036,665, dated Nov. 1, 2018. |
Office Action in U.S. Appl. No. 15/626,516, dated Mar. 14, 2018. |
Amendment in U.S. Appl. No. 15/626,516, dated Sep. 13, 2018. |
Final Office Action in U.S. Appl. No. 15/626,516, dated Jan. 15, 2019. |
Response in U.S. Appl. No. 15/626,516, dated Jul. 15, 2019. |
Restriction Requirement in U.S. Appl. No. 15/495,484, dated May 14, 2019. |
Amendment in U.S. Appl. No. 15/589,058, dated Nov. 15, 2017. |
Office Action in U.S. Appl. No. 15/589,058, dated Dec. 8, 2017. |
Amendment in U.S. Appl. No. 15/589,058, dated Jun. 7, 2018. |
Final Office Action in U.S. Appl. No. 15/589,058, dated Aug. 27, 2018. |
Amendment in U.S. Appl. No. 15/589,058, dated Feb. 26, 2019. |
Office Action in U.S. Appl. No. 15/589,058, dated Mar. 5, 2019. |
Amendment in U.S. Appl. No. 15/589,058, dated Sep. 5, 2019. |
Official Communication in European Application No. 14800423.7, dated Feb. 8, 2017. |
International Search Report and Written Opinion in PCT Application No. PCT/US2014/038839, dated Oct. 17, 2014. |
International Preliminary Report on Patentability in PCT Application No. PCT/US2014/038839, dated Dec. 3, 2015. |
Preliminary Amendment in U.S. Appl. No. 16/042,318, dated Nov. 8, 2018. |
Office Action in U.S. Appl. No. 16/042,318, dated May 8, 2019. |
Preliminary Amendment in U.S. Appl. No. 14/491,935, dated Feb. 5, 2015. |
Restriction Requirement in U.S. Appl. No. 14/491,935, dated Sep. 8, 2017. |
Restriction Requirement and Election of Species Response in U.S. Appl. No. 14/491,935, dated Jan. 8, 2018. |
Office Action in U.S. Appl. No. 14/491,935, dated May 13, 2019. |
Partial Supplementary European Search Report in European Application No. 14845427.5, dated May 4, 2017. |
Extended European Search Report in European Application No. 14845427.5, dated Aug. 8, 2017. |
Extended European Search Report in European Application No. 14846410.0, dated Jun. 23, 2017. |
Official Communication in European Application No. 14846410.0, dated Jul. 18, 2018. |
Official Communication in European Application No. 14846410.0, dated Mar. 20, 2019. |
Official Communication in Japanese Application No. 2016-544032, dated Jun. 26, 2018. |
International Search Report and Written Opinion in PCT Application No. PCT/US2014/056643, dated Dec. 11, 2014. |
International Preliminary Report on Patentability and Written Opinion in PCT Application No. PCT/US2014/056643, dated Mar. 31, 2016. |
Invitation to Pay Additional Fees in PCT Application No. PCT/US2014/056681, dated Jan. 14, 2015. |
International Search Report and Written Opinion in PCT Application No. PCT/US2014/056681, dated Mar. 20, 2015. |
International Preliminary Report on Patentability and Written Opinion in PCT Application No. PCT/US2014/056681, dated Mar. 31, 2016. |
Preliminary Amendment in U.S. Appl. No. 14/581,779, dated Jul. 6, 2015. |
Restriction Requirement in U.S. Appl. No. 14/581,779, dated Oct. 31, 2017. |
Restriction Requirement and Election of Species Response in U.S. Appl. No. 14/581,779, dated Jan. 2, 2018. |
Office Action in U.S. Appl. No. 14/581,779, dated Apr. 24, 2018. |
Amendment in U.S. Appl. No. 14/581,779, dated Sep. 24, 2018. |
Final Office Action in U.S. Appl. No. 14/581,779, dated Jan. 4, 2019. |
Amendment in U.S. Appl. No. 14/581,779, dated Jul. 2, 2019. |
Office Action in U.S. Appl. No. 14/581,779, dated Aug. 5, 2019. |
Extended European Search Report in European Application No. 14873324.9, dated Aug. 25, 2017. |
Official Communication in Japanese Application No. 2016-542194, dated Nov. 6, 2018. |
Decision of Rejection in Japanese Application No. 2016-542194, dated May 14, 2019. |
Invitation to Pay Additional Fees in PCT Application No. PCT/US2014/072121, dated Mar. 2, 2015. |
International Search Report and Written Opinion in PCT Application No. PCT/US2014/072121, dated May 1, 2015. |
International Preliminary Report on Patentability and Written Opinion in PCT Application No. PCT/US2014/072121, dated Jul. 7, 2016. |
Preliminary Amendment in U.S. Appl. No. 14/960,276, dated Apr. 18, 2016. |
Office Action in U.S. Appl. No. 14/960,276, dated Jul. 28, 2017. |
Amendment in U.S. Appl. No. 14/960,276, dated Jan. 26, 2018. |
Office Action in U.S. Appl. No. 14/960,276, dated Mar. 8, 2018. |
Amendment in U.S. Appl. No. 14/960,276, dated Sep. 7, 2018. |
Office Action in U.S. Appl. No. 14/960,276, dated Nov. 2, 2018. |
Amendment in U.S. Appl. No. 14/960,276, dated May 2, 2019. |
Final Office Action in U.S. Appl. No. 14/960,276, dated Jun. 7, 2019. |
Extended European Search Report in European Application No. 15865454.1, dated Jun. 27, 2018. |
International Search Report and Written Opinion in PCT Application No. PCT/US2015/064133, dated Feb. 9, 2016. |
International Preliminary Report on Patentability and Written Opinion in PCT Application No. PCT/US2015/064133, dated Jun. 15, 2017. |
Preliminary Amendment in U.S. Appl. No. 15/081,653, dated Oct. 11, 2016. |
Office Action in U.S. Appl. No. 15/081,653, dated Mar. 28, 2018. |
Amendment in U.S. Appl. No. 15/081,653, dated Sep. 27, 2018. |
Final Office Action in U.S. Appl. No. 15/081,653, dated Nov. 16, 2018. |
Final Amendment in U.S. Appl. No. 15/081,653, dated May 15, 2019. |
Office Action in U.S. Appl. No. 15/081,653, dated Jul. 12, 2019. |
Extended European Search Report in European Application No. 16769809.1, dated Nov. 23, 2018. |
International Search Report and Written Opinion in PCT Application No. PCT/US2016/024330, dated Jul. 1, 2016. |
International Preliminary Report on Patentability and Written Opinion in PCT Application No. PCT/US2016/024330, dated Oct. 5, 2017. |
Preliminary Amendment in U.S. Appl. No. 15/360,565, dated Feb. 6, 2017. |
Office Action in U.S. Appl. No. 15/360,565, dated Aug. 10, 2018. |
Amendment in U.S. Appl. No. 15/360,565, dated Feb. 8, 2019. |
Office Action in U.S. Appl. No. 15/360,565, dated May 22, 2019. |
Extended European Search Report in European Application No. 16869253.1, dated May 29, 2019. |
Invitation to Pay Additional Fees in PCT Application No. PCT/US2016/063549, dated Feb. 2, 2017. |
International Search Report and Written Opinion in PCT Application No. PCT/US2016/063549, dated Apr. 14, 2017. |
International Preliminary Report on Patentability and Written Opinion in PCT Application No. PCT/US2016/063549, dated Jun. 7, 2018. |
International Search Report and Written Opinion in PCT Application No. PCT/US2018/031442, dated Sep. 14, 2018. |
International Search Report and Written Opinion in PCT Application No. PCT/US2018/034227, dated Jul. 30, 2018. |
Official Communication in Japanese Application No. 2018-218745, dated Feb. 25, 2020. |
Amendment in U.S. Appl. No. 15/483,995, dated Dec. 12, 2019. |
Final Office Action in U.S. Appl. No. 15/483,995, dated Feb. 20, 2020. |
Office Action in U.S. Appl. No. 15/645,589, dated Dec. 26, 2019. |
Preliminary Amendment filed in U.S. Appl. No. 16/036,665, dated Sep. 5, 2019. |
Office Action in U.S. Appl. No. 16/036,665, dated Sep. 26, 2019. |
Amendment filed in U.S. Appl. No. 16/036,665, dated Mar. 26, 2020. |
Amendment in U.S. Appl. No. 15/626,516, dated Jan. 24, 2020. |
Notice of Allowance in U.S. Appl. No. 15/626,516, dated Mar. 9, 2020. |
Response to Restriction Requirement in U.S. Appl. No. 15/495,484, dated Nov. 13, 2019. |
Office Action in U.S. Appl. No. 15/495,484, dated Nov. 27, 2019. |
Restriction Requirement in U.S. Appl. No. 15/948,842, dated Jan. 22, 2020. |
Preliminary Amendment filed in U.S. Appl. No. 15/724,100, dated Jun. 5, 2018. |
Office Action in U.S. Appl. No. 15/724,100, dated Oct. 9, 2019. |
Amendment filed in U.S. Appl. No. 15/724,100, dated Apr. 9, 2020. |
Amendment in U.S. Appl. No. 14/491,935, dated Nov. 13, 2019. |
Final Office Action in U.S. Appl. No. 14/491,935, dated Feb. 24, 2020. |
Amendment in U.S. Appl. No. 14/960,276, dated Dec. 6, 2019. |
Notice of Allowance in U.S. Appl. No. 14/960,276, dated Dec. 19, 2019. |
Corrected Notice of Allowability in U.S. Appl. No. 14/960,276, dated Feb. 12, 2020. |
Amendment in U.S. Appl. No. 15/081,653, dated Jan. 10, 2020. |
Final Office Action in U.S. Appl. No. 15/081,653, dated Jan. 31, 2020. |
Amendment in U.S. Appl. No. 15/360,565, dated Nov. 21, 2019. |
Office Action in U.S. Appl. No. 15/360,565, dated Jan. 30, 2020. |
International Preliminary Report on Patentability and Written Opinion in PCT Application No. PCT/US2018/031442, dated Nov. 21, 2019. |
International Preliminary Report on Patentability and Written Opinion in PCT/US2018/034227, dated Dec. 5, 2019. |
Office Action in U.S. Appl. No. 16/357,081, dated Jul. 8, 2020. |
Amendment in U.S. Appl. No. 15/483,995, dated Aug. 19, 2020. |
Office Action in U.S. Appl. No. 15/483,995, dated Sep. 4, 2020. |
Amendment in U.S. Appl. No. 15/645,589, dated Jun. 26, 2020. |
Notice of Allowance in U.S. Appl. No. 15/645,589, dated Jul 14, 2020. |
Office Action in U.S. Appl. No. 16/036,665, dated Jul. 13, 2020. |
Notice of Allowance in U.S. Appl. No. 15/626,516, dated Jun. 29, 2020. |
Amendment in U.S. Appl. No. 15/495,484, dated May 27, 2020. |
Notice of Allowance in U.S. Appl. No. 15/495,484, dated Jun. 16, 2020. |
Response to Restriction Requirement in U.S. Appl. No. 15/948,842, dated Jul. 21, 2020. |
Office Action in U.S. Appl. No. 15/948,842, dated Aug. 24, 2020. |
Office Action in U.S. Appl. No. 15/724,100, dated Apr. 22, 2020. |
Amendment in U.S. Appl. No. 15/724,100, dated Jun. 22, 2020. |
Notice of Allowance in U.S. Appl. No. 15/724,100, dated Jul. 6, 2020. |
Amendment in U.S. Appl. No. 14/491,935, dated Aug. 24, 2020. |
Notice of Allowance in U.S. Appl. No. 14/491,935, dated Sep. 2, 2020. |
Amendment in U.S. Appl. No. 14/581,779, dated Feb. 4, 2020. |
Final Office Action in U.S. Appl. No. 14/581,779, dated Apr. 29, 2020. |
Amendment in U.S. Appl. No. 15/081,653, dated Jul. 30, 2020. |
Office Action in U.S. Appl. No. 15/081,653, dated Sep. 17, 2020. |
Amendment in U.S. Appl. No. 15/360,565, dated Jul. 29, 2020. |
Notice of Allowance in U.S. Appl. No. 15/360,565, dated Aug. 13, 2020. |
Burle Industries, Technical Memorandum 100—Fiber Optics: Theory and Applications, archived Feb. 21, 2007, in 20 pages https://web.archive.org/web/20070221125354/http://www.burle.com/cgi-bin/byteserver.pl/pdf/100r.pdf. |
Number | Date | Country | |
---|---|---|---|
20180318033 A1 | Nov 2018 | US |
Number | Date | Country | |
---|---|---|---|
62503262 | May 2017 | US | |
62517089 | Jun 2017 | US |