This patent specification generally relates mainly to a medical device for use in tissue examinations. More particularly, some embodiments relate to devices and methods for fluorescence imaging in medical applications such as visually detecting tissues such as tumors, nerves, and vessels during surgical procedures.
Endoscopic fluorescence imaging systems can be used to detect tissue such as tumors and vessels during surgical procedures. Infrared dyes can be used as tagging dyes for marking tissue. Some endoscopic fluorescence imaging systems are capable of acquiring high resolution images in the normal white light visible spectrum, while simultaneously acquiring and overlaying the infrared signal on top of normal visible spectrum images in order to provide a contrast to a surgeon while operating. Some systems are designed to detect unbound intravascular indocyanine green (ICG), an FDA approved NIR (near infrared) fluorescent dye. ICG is typically intravenously administered in high doses, and imaging is performed 30-60 minutes after injection. The intravascular fluorescent load achieved with this approach is high, and approved clinical imaging devices have adequate sensitivity for these applications. Examples of such systems include a fluorescent module incorporated into operating microscopes (OPMI Pentero Infrared 800, Carl Zeiss), as well at the SPY® and Pinpoint® systems (Novadaq), and the FluoBeam® 800 (Fluoptics) hand-held unit. While these systems may have adequate sensitivity for intravascular imaging, they may lack practical use in other applications such as targeted tumor-specific NIR fluorescence due to low sensitivity. In simultaneous visible and NIR capture imaging systems, one camera captures the image in the visible spectrum and second camera captures the fluorescent image. This is achieved by splitting the incident light from the field into two channels using a beam-splitter. One beam transmits the NIR fluorescent light to one of the cameras, while the other beam of visible light passes through the beam splitter into the second camera. See, e.g., U.S. Pat. No. 8,961,403 B2.
U.S. Pat. No. 9,407,838 discusses a system suitable for lab analysis or high-end surgical applications that can simultaneously record a visible light image and an infrared light image from fluorescent dye. The discussed system simultaneously uses a laser for emitting excitation light for an infrared or near-infrared fluorophore and a visible light source. The discussed system also includes a notch beam splitter, a notch filter, a synchronization module, an image sensor for simultaneously detecting both visible light and infrared light, an image processing unit for image subtraction after capture, an image displaying unit, and light-conducting channels.
The subject matter described or claimed in this patent specification is not limited to embodiments that solve any specific disadvantages or that operate only in environments such as those described above. Rather, the above background is only provided to illustrate one exemplary technology area where some embodiments described herein may be practiced.
According to some embodiments, a single-use, disposable cannula for multi-band imaging of a patient's bladder has a distal tip and comprises: a light source configured to illuminate said bladder with white light during first time intervals and with non-white excitation light causing fluorescence from selected tissue during second time intervals time-interleaved with said first time intervals; and an imaging structure configured to receive both said fluorescence and reflections of said white light from the bladder; wherein said imaging structure comprises a single, multi-pixel, backside-illuminated, two-dimensional light sensor array and a readout circuit electrically and physically integrated therewith into a circuit stack; wherein said imaging structure is configured to respond to said reflections to generate a white light image of the bladder and to said fluorescence to produce a fluorescence image of the bladder; and wherein the white light and fluorescence images are both spatially and temporally registered with each other.
According to some embodiments: the imaging structure includes respective color filters for pixels of said sensor array, causing some of said pixels to receive said fluorescent and others to receive said reflections; the cannula includes a global shutter configured to essentially concurrently read the pixels of said sensor array; the cannula includes a quasi-global shutter configured to essentially concurrently read only one or more selected subsets of the pixels of said sensor array; an agent introduced in the bladder preferentially induces cancerous tissue to emit said fluorescence; said second time intervals are longer than said first time intervals; the excitation light has a wavelength in the range 350-450 nanometers; the fluorescence has a wavelength in the range of 580-720 nanometers; and/or the sensor array receives only the reflected white light during said first time intervals and only the fluorescence during said second time intervals.
According to some embodiments, the cannula is combined with a handle to which the cannula is releasably secured through electrical and mechanical couplers tool-free by hand and detached tool-free by hand, and said handle may further comprise a physically integral video screen coupled with said sensor array to receive and display said white light and fluorescent images.
According to some embodiments: the cannula further includes a shield keeping said excitation light from said sensor array; said white light and excitation light illuminate the same field of illumination in the bladder; and/or said imaging structure comprises a spatially repeating pattern of red, green, and blue pixel filters through which light from the bladder passes to reach said sensor array.
According to some embodiments, the cannula is enclosed in a sterile packaging and is a single-use, disposable unit.
According to some embodiments: the cannula further includes a source of a second, different excitation light causing fluorescence from the bladder during third time intervals interleaved in time with said first and second time intervals, and said imaging structure is configured to receive fluorescence from the bladder during the second and third time intervals and produce spatially registered white light and two fluorescence images.
According to some embodiments, the cannula comprises a distal portion at which said imaging structure is situated and a proximal portion, and further comprises an inlet port that is at the proximal portion of the cannula and is configured to receive insufflating gas, an outlet port that is at the distal portion of the cannula, and a gas conduit between said proximal and distal ports, wherein said distal port is configured to direct gas delivered thereto through said conduit in a flow over said imaging structure that clears a field of view of the imaging portion.
According to some embodiments, said distal port is configured to extend said gas flow in a distal direction to aid in moving said distal portion of the cannula through a patient's body passageway by helping dilate the passageway; said distal portion of the cannula comprises an outer shell that surrounds said imaging structure and said gas conduit comprises spacing between the outer shell and the imaging structure; said spacing radially surrounds the entire imaging structure; said spacing is only at one or more arcs around the imaging structure; said outer shell extends distally further than said imaging structure and comprises a lip bent radially inwardly to direct said gas glow over the imaging structure; and/or said lip extends over only a part of the circumference of said outer shell.
According to some embodiments, the cannula further includes a manually adjustable gas flow control having an output for receiving gas from a source and an output connected for gas flow to said input port; and/or further includes a pressure gauge showing gas pressure fed to said input port. The source of the insufflating gas can be a conventional threaded CO2 cartridge that contains less than 10 grams of carbon dioxide, thus helping keep an entire set of a cannula, handle and gas source easily hand-held and portable.
According to some embodiments, an endoscope comprises a single-use, disposable cannula for multi-band imaging of a patient's bladder and a reusable handle that is releasably connected to said cannula through electrical and mechanical connectors, wherein (a) said cannula has a distal tip that comprises: a light source configured to illuminate said bladder with white light during first time intervals and with non-white excitation light causing fluorescence from selected tissue during second time intervals time-interleaved with said first time intervals; and an imaging structure configured to receive both said fluorescence and reflections of said white light from the bladder and in response to produce a white light image of the bladder and a fluorescence image of the bladder that are both spatially and temporally registered with each other; an input port for insufflating gas, a distal outlet port for said gas at a distal portion of the cannula, and a gas conduit connecting the input and distal ports; wherein said distal port is configured to direct a flow of said gas over a field of view of said imaging structure to clear debris from said field of view; and (b) said handle comprises an integral display screen configured to display images taken with said imaging structure.
According to some embodiments, in said endoscope: said distal port comprises an outer shell that at least partly surrounds said imaging structure and directs said gas over a distal face of the imaging structure; said conduit comprises space between the outer shell and the imaging structure; and/or said distal port is further configured to direct gas flow distally of said distal tip of the cannula to aid in moving said distal tip through a patient's body passageway.
According to some embodiments, the endoscope further includes a gas flow controller having an input for gas and an output feeding gas to said distal port of the cannula; and/or said imaging structure comprises an imaging sensor and a processor in a stacked arrangement.
According to some embodiments, a method of imaging a patient's inner bladder wall comprises: Illuminating said inner bladder wall with white light during first time intervals and with non-white excitation light causing fluorescence from selected tissue during second time intervals time-interleaved with said first time intervals; receiving both said fluorescence and reflections of said white light from the bladder wall at an imaging structure that is at a tip of a cannula, and in response producing a white light image of the bladder wall and a fluorescence image of the bladder wall that are both spatially and temporally registered with each other; and supplying insufflating gas at a distal port of said cannula to create a gas flow over a field of view of the imaging structure that aids in clearing debris from said field of view.
According to some embodiments, said supplying step further comprises creating a gas flow that extends distally of said distal tip of the cannula to aid in moving said distal tip through a patient's body passageway.
As used herein, the grammatical conjunctions “and”, “or” and “and/or” are all intended to indicate that one or more of the cases, object or subjects they connect may occur or be present. In this way, as used herein the term “or” in all cases indicates an “inclusive or” meaning rather than an “exclusive or” meaning.
As used herein the terms “surgical” or “surgery” refer to any physical intervention on a patient's tissues and does not necessarily involve cutting a patient's tissues or closure of a previously sustained wound.
To further clarify the above and other advantages and features of the subject matter of this patent specification, specific examples of embodiments thereof are illustrated in the appended drawings. It should be appreciated that these drawings depict only illustrative embodiments and are therefore not to be considered limiting of the scope of this patent specification or the appended claims. The subject matter hereof will be described and explained with additional specificity and detail through the use of the accompanying drawings in which:
A detailed description of examples of preferred embodiments is provided below. While several embodiments are described, the new subject matter described in this patent specification is not limited to any one embodiment or combination of embodiments described herein, but instead encompasses numerous alternatives, modifications, and equivalents. In addition, while numerous specific details are set forth in the following description in order to provide a thorough understanding, some embodiments can be practiced without some or all of these details. Moreover, for the purpose of clarity, certain technical material that is known in the related art has not been described in detail in order to avoid unnecessarily obscuring the new subject matter described herein. It should be clear that individual features of one or several of the specific embodiments described herein can be used in combination with features of other described embodiments or with other features. Further, like reference numbers and designations in the various drawings indicate like elements.
In medical imaging, fluorescence techniques allow visualization of features that are invisible or are not easily visible under conventional white light. According to some embodiments, a video endoscope system is provided for fluorescence endoscopy. A protocol is also described to combine the fluorescence endoscopy with white light endoscopy. According to some embodiments, dual color band or multi-color band imaging systems are described herein that provide improved visualization of tissue using combined fluorescence and white light endoscopy.
According to some embodiments, endoscope 200 can be used for differential imaging of a patient's bladder to determine the presence and characteristics of cancerous tissue. In this example of use, the color filter array 302 is configured to enhance sensitivity to pink-red light (about 610 nm wavelength) by selecting a pattern that preferentially passes pink-red to sensor array 304. The image provided by pink-red light preferentially shows cancerous tissue emitting fluorescent light in that color, typically due to the appropriate dye or other agent introduced in the patient at an appropriate time before imaging. Such dyes or other agents are known in the art of fluorescence medical imaging.
According to some embodiments, endoscope 200 can be used for differential imaging of a patient's nerves to assist in surgery where it may be desirable to identify nerve tissue so as to avoid damaging such tissue or to perform procedures on such tissue. In this example of use, the color filter array 302 is configured to enhance sensitivity to dark green light (about 510 nm wavelength) by selecting a pattern that preferentially passes dark green to sensor array 304. A filter such as in
According to some embodiments, light sources 234 can provide light other than white light, sources 232 can provide different color(s) excitation light, and color filter 302 can preferentially pass light in different color(s) to sensor 304, to thereby preferentially image selected tissue with light of a first wavelength range incident on sensor 304 and other selected tissue with light of a second wavelength range, different from the first range, incident on sensor 304.
According to some embodiments, stack 400 can be a stacked back-illuminated structure similar to a stacked BSI CMOS device from Sony in the family of devices offered under the trade designation Exmor RS sensors. Preferably, stack 400 is an integrated, single-chip device comprising individual photo-diodes, each under a respective color filter through which light from tissue passes before impinging on the photo-diode, metal wiring under the photodiodes, and image processing circuitry under the metal wiring to read the electrical output of the photo-diodes and convert it to image information to be sent for further processing and/or display. One example of such stack is designated Sony Exmor RS sensor stack IMX 398, which comprises a 12 MP sensor (4608×3456) and has a 6.4 mm diagonal dimension. The stack comprises a sensor layer and a logic layer that is behind the sensor layer and contains readout circuits to read out the electrical signals that the sensor pixels provide in response to light. For use in endoscope 200, the diagonal dimension of sensor stack 400 preferably is no more than 3 mm, more preferably no more than 2 mm, and even more preferably no more than 1.5 mm. This can be accomplished by reducing the number of pixels in the sensor, for example to a number sufficient to provide lower spatial resolution such as 400×400, or by shrinking the dimensions of sensor elements such as photo-diodes, or both.
According to some embodiments, the stacked arrangement can include one or more additional filters 440 to further enhance combined fluorescence and white light endoscopy imaging. For example, filters 440 often include an infrared (IR) filter configured to suppress IR sensitivity, or a different color filter configured to suppress sensitivity to a different color as required for a specific tissue or specific use of endoscope 200. Filters 440 can also include a band pass filter that is configured to allow passage of wavelengths around 600 nm, or some other wavelength(s) that coincide with fluorescent light coming from the tissues of interest. Further examples of possible filters are shown and described with respect to
The reduction in region 522 has been found to be useful in reducing the amount of blue light “background” or “noise” that is recorded by the “red pixels” (the pixels associated with “R” in the color filter array). As can be seen in
According to some embodiments, the time periods can alternate between white and a color but in other embodiments the periods can be interspersed in a different sequence, for example in the sequence T-white, T-blue, T-blue, T-white, T-blue, T-white, etc. In addition, two or more colors can be included in the same sequence of time intervals, for example to form a sequence T-white, T-blue, T-red, T-white, etc.
According to some embodiments, the image processing can be configured differently for the white and red color band frames to further enhance visualization. For example, during the T-Blue intervals (612 and 616) the relative weights of the three-color channels are manipulated to enhance the visibility of the fluorescent tissue. The red channels can be boosted while the blue channels can be suppressed, by adjusting their relative gains. This will enhance the fluorescent tissue while reducing blue reflectance from the excitation light source (the blue LEDs).
According to some embodiments, in addition to alternating the white and blue light illumination, the duration of the blue (and/or other color(s)) and white light intervals can be manipulated to provide enhanced imaging for certain applications. For example, in some cases the fluorescence image may be too weak compared to the white image. In such cases the T-White and T-Blue interval timing can be configured such that the T-Blue intervals 612 and 616 are longer than the T-White intervals 610 and 614. In some examples, the T-Blue intervals can be 2 or more times longer than the T-White intervals so that the fluorescence image in enhanced over the white image.
According to some embodiments, quasi-global shuttering can be used in some cases instead of full global shuttering. Especially in case of a lower cost, smaller sized pixel array, quasi global shuttering can be used wherein the pixels in an entire column (or row) are read out in series, but all of the columns (or rows) are read out simultaneously. In this case each column (or row) has a dedicated analog to digital converter (ADC). For example, if the array size is 400×400 pixels (and the pixel size is about 2.2 um×2.2 um to 3.0 um×3.0 um) with a pixel read-out time of 5 u secs, each column (or row) can be read-out in about 2 ms, which leaves plenty of time for exposure (30+ ms for exposure at 30 frames per second). Note that in such quasi-global shuttering embodiments, the sensor readout in the T-Blue intervals (612 and 616) will include all of the pixel data, and the non-red pixel data can simply be ignored when forming the red color band frames.
According to some embodiments, the blue camera module 812 is optimized to maximize sensitivity to the fluorescence light, while minimizing interference from other light sources. Since in this example the CMOS sensor does not have a CFA which would cause loss of incoming light, a filter can be used to block the undesirable blue light from entering the image sensor. According to some embodiments, a combined filter or separate filter can also be used to block undesired spurious fluorescence not originated from the targeted tissue. A combined filter or separate filter can also be used to block undesired spurious phosphorescence light from entering the blue camera. According to some embodiments, a band pass filter can be used that blocks all the wavelengths below about 580 nm and in the infrared band. One or more filters can be placed either in front of the camera lens (e.g. between the outermost element and the iris, or outside the iris. Alternatively, or in addition, the filter(s) can form part of the sensor lens stack (such as shown with filter(s) 440 in
The endoscope 200 includes a handle portion 940 that is sized and shaped for easy grasping by the endoscope operator (e.g. doctor or other medical professional). According to some embodiments, the cannula 920 includes a fluid channel which is fluidly connected to a proximal fluid port (not shown) and port 220 (shown in
A distal portion of cannula 920 can be bent so tip 204 can point to the tissue to be imaged, as in the case of the tip portion of the cannula in
If desirable to change the orientation of tip 204 relative to the long axis of cannula 920, endoscope 200 can be provided with a facility to deflect tip 204 relative to cannula 920 before and/or during a patient examination. For example, a distal portion of cannula 920 can be made of a material that can be bent and retains its shape after being bent, so that a desired angle between tip 204 and the long axis of cannula 920 can be set before introducing cannula 920 into a patient. If desirable to change the angle while cannula 920 is in a patient, endoscope 200 can be provided with a tip deflecting mechanism, for example of the type discussed in U.S. Pat. No. 9,549,666 B2, which is hereby incorporated by reference. Deflection of tip 204 relative to the long axis of cannula 920 can be arranged so it can be in a single plane, e.g., left-right deflection using two cables to pull tip 204 to the left or to the right (or up-down), or it can be to any angle, using more cables or an arrangement similar to that in said U.S. Pat. No. 9,549,666 B2.
Endoscope portions such as 200 and 800 can be used in endoscopes having other configurations, for example in endoscopes that have straight cannulas, have different handles, and different image displays, and in endoscopes in which the cannula is re-usable rather than being a single-use, disposable cannula.
In
In
It has been found that white light and fluorescence endoscopy with gas insufflation can result in substantial advantages over liquid insufflation. For example, in endoscopy insufflation using gas such as CO2 can result in widening the field of view (FOV) of the lens when compared to fluid medium being used for distention. The increase in FOV can be attributed to a greater index of refraction mismatch between the lens material (e.g. glass or polymer) and gas (e.g. CO2) when compared to liquid (e.g. saline). It has been found in some cases that the FOV can be increased by 15%, 20%, 30% or greater by using gas instead of liquid.
Using gas instead of liquid for insufflation can also keep the patient dry, which can reduce the risk of fluid damage to various devices used in the medical procedure. There can be significant cost savings using CO2 instead of liquid such as saline. Portability can be increased.
In the case of fluorescence imaging, a lack of fluid medium reduces the effect of optical scattering and of secondary undesired light sources such as phosphorescence. In a liquid medium such as water, absorption increases significantly from blue to red, which decreases the signal of desired fluorescence when using those wavelengths. In water, absorption increases to near 0.5 (m−1) around 600 nm. In comparison, CO2 gas is almost transparent to visible light. The decrease in photon absorption/increase in transmission of gas over liquid for the wavelengths of interest (e.g. blue light endoscopy) can lead to significant increases in the signal to noise ratio.
One potential drawback of using gas rather than liquid for insufflation is that the endoscope lens can more easily become tainted with human body fluid such as sticky mucosa or blood. This may cause the resulting image to become blurry. According to some embodiments, when using liquid for distention/insufflation, the liquid flow or the liquid itself and sometimes, in combination of hydrophobic coating of the lens surface, is used to keep the lens relatively clean.
According to some embodiments, when using gas for distension/insufflation the distal tip is configured to direct the flow of the gas to have pattern such that the lens surface can be kept clean. Examples of such designs are shown in
According to some embodiments, since the exit gas flow is directed towards the lens, LEDs and/or port, rather than distally toward the object to be visualized, intermittent higher gas pressure can be used to “blow away” or remove any sticky debris that may adhere to the surfaces of the lens, LEDs and/or port.
Although the foregoing has been described in some detail for purposes of clarity, it will be apparent that certain changes and modifications may be made without departing from the principles thereof. It should be noted that there are many alternative ways of implementing both the processes and apparatuses described herein. Accordingly, the present embodiments are to be considered as illustrative and not restrictive, and the body of work described herein is not to be limited to the details given herein, which may be modified within the scope and equivalents of the appended claims.
This patent application claims the benefit of and incorporates by reference each of the following provisional applications: U.S. Prov. Ser. No. 62/647,817 filed Mar. 25, 2018; U.S. Prov. Ser. No. 62/654,295 filed Apr. 6, 2018; U.S. Prov. Ser. No. 62/671,445 filed May 15, 2018; and U.S. Prov. Ser. No. 62/816,366 filed Mar. 11, 2019. This patent application is a continuation (with added subject matter) of International Patent Application No. PCT/US17/53171 filed Sep. 25, 2017, which claims the benefit of and incorporates by reference each of the following provisional applications: U.S. Prov. Ser. No. 62/399,429 filed Sep. 25, 2016; U.S. Prov. Ser. No. 62/399,436 filed Sep. 25, 2016; U.S. Prov. Ser. No. 62/399,712 filed Sep. 26, 2016; U.S. Prov. Ser. No. 62/405,915 filed Oct. 8, 2016; U.S. Prov. Ser. No. 62/423,213 filed Nov. 17, 2016; U.S. Prov. Ser. No. 62/424,381 filed Nov. 18, 2016; U.S. Prov. Ser. No. 62/428,018 filed Nov. 30, 2016; U.S. Prov. Ser. No. 62/429,368 filed Dec. 2, 2016; U.S. Prov. Ser. No. 62/485,454 filed Apr. 14, 2017; U.S. Prov. Ser. No. 62/485,641 filed Apr. 14, 2017; U.S. Prov. Ser. No. 62/502,670 filed May 6, 2017; U.S. Prov. Ser. No. 62/550,188 filed Aug. 25, 2017; U.S. Prov. Ser. No. 62/550,560 filed Aug. 25, 2017; U.S. Prov. Ser. No. 62/550,581 filed Aug. 26, 2017; and U.S. Prov. Ser. No. 62/558,818 filed Sep. 14, 2017. All of the above-referenced non-provisional, provisional and international patent applications are hereby incorporated in this application by reference and are collectively referenced herein as “the commonly assigned incorporated applications.”
Number | Name | Date | Kind |
---|---|---|---|
4854302 | Allred, III | Aug 1989 | A |
4979497 | Matsura | Dec 1990 | A |
5010876 | Henley | Apr 1991 | A |
5188093 | Lafferty | Feb 1993 | A |
5281214 | Wilkins | Jan 1994 | A |
5323767 | Lafferty | Jun 1994 | A |
5329936 | Lafferty | Jul 1994 | A |
5390117 | Graf et al. | Feb 1995 | A |
5486155 | Muller | Jan 1996 | A |
5549547 | Cohen | Aug 1996 | A |
5569163 | Francis | Oct 1996 | A |
5666561 | Stephenson | Sep 1997 | A |
5667472 | Finn | Sep 1997 | A |
5667476 | Frassica et al. | Sep 1997 | A |
5785644 | Grabover | Jul 1998 | A |
5860953 | Snoke | Jan 1999 | A |
5873814 | Adair | Feb 1999 | A |
5928137 | Green | Jul 1999 | A |
5935141 | Weldon | Aug 1999 | A |
5957947 | Wattiez | Sep 1999 | A |
6007531 | Snoke | Dec 1999 | A |
6007546 | Snow | Dec 1999 | A |
6017322 | Snoke | Jan 2000 | A |
6033378 | Lundquist | Mar 2000 | A |
6059719 | Yamamato et al. | May 2000 | A |
6095970 | Hidaka | Aug 2000 | A |
6174307 | Daniel | Jan 2001 | B1 |
6210416 | Chu | Apr 2001 | B1 |
6211904 | Adair | Apr 2001 | B1 |
6221007 | Green | Apr 2001 | B1 |
6221070 | Tu et al. | Apr 2001 | B1 |
6261226 | McKenna | Jul 2001 | B1 |
6280386 | Alfano et al. | Aug 2001 | B1 |
6331174 | Reinhard | Dec 2001 | B1 |
6387043 | Yoon | May 2002 | B1 |
6398743 | Halseth | Jun 2002 | B1 |
6507699 | Lemoine | Jan 2003 | B2 |
6518823 | Kawai | Feb 2003 | B1 |
6793882 | Verschuur | Sep 2004 | B1 |
6917380 | Tay | Jul 2005 | B1 |
7256446 | Hu | Aug 2007 | B2 |
7428378 | Warpakowski | Sep 2008 | B1 |
7507205 | Borovsky | Mar 2009 | B2 |
7591799 | Selkee | Sep 2009 | B2 |
7606609 | Muranushi | Oct 2009 | B2 |
7780650 | Frassica | Aug 2010 | B2 |
7798995 | Yue | Sep 2010 | B2 |
7931616 | Selkee | Apr 2011 | B2 |
7946981 | Cubb | May 2011 | B1 |
8052609 | Harhen | Nov 2011 | B2 |
8057464 | Chen | Nov 2011 | B2 |
8187171 | Irion | May 2012 | B2 |
8197398 | Scholly | Jun 2012 | B2 |
8235975 | Chen | Aug 2012 | B2 |
8361775 | Flower | Jan 2013 | B2 |
8460182 | Ouyang | Jun 2013 | B2 |
8523808 | Selkee | Sep 2013 | B2 |
8696552 | Whitman | Apr 2014 | B2 |
8803960 | Sonnenschein | Aug 2014 | B2 |
8834357 | Oskin | Sep 2014 | B2 |
8845522 | McIntyre | Sep 2014 | B2 |
8952312 | Blanqart | Feb 2015 | B2 |
8998844 | Reed | Apr 2015 | B2 |
9649014 | Ouyang | May 2017 | B2 |
9736342 | Mueckl | Aug 2017 | B2 |
9895048 | Ouyang | Feb 2018 | B2 |
10278563 | Ouyang | May 2019 | B2 |
10292571 | Ouyang | May 2019 | B2 |
20010007051 | Nakashima | Jul 2001 | A1 |
20010049509 | Sekine | Dec 2001 | A1 |
20030016284 | Squilla | Jan 2003 | A1 |
20030023142 | Grabover | Jan 2003 | A1 |
20030078476 | Hill | Apr 2003 | A1 |
20030078502 | Miyaki et al. | Apr 2003 | A1 |
20030151680 | McDermott | Aug 2003 | A1 |
20030199735 | Dickopp | Oct 2003 | A1 |
20040054254 | Miyake | Mar 2004 | A1 |
20040054259 | Hasegawa | Mar 2004 | A1 |
20040138558 | Dunki-Jacobs | Jul 2004 | A1 |
20040162572 | Sauer | Aug 2004 | A1 |
20050010178 | Katz | Jan 2005 | A1 |
20050264687 | Murayama | Jan 2005 | A1 |
20050049459 | Hern | Mar 2005 | A1 |
20050085695 | Sherner | Apr 2005 | A1 |
20050154262 | Banik | Jul 2005 | A1 |
20050159646 | Nordstrom | Jul 2005 | A1 |
20050177027 | Hirata | Aug 2005 | A1 |
20050277874 | Selkee | Dec 2005 | A1 |
20050277875 | Selkee | Dec 2005 | A1 |
20060052710 | Miura | Mar 2006 | A1 |
20060063976 | Aizenfeld | Mar 2006 | A1 |
20060114986 | Knapp | Jun 2006 | A1 |
20060152601 | Parekh | Jul 2006 | A1 |
20060167340 | Peas | Jul 2006 | A1 |
20060171693 | Todd | Aug 2006 | A1 |
20060173245 | Todd | Aug 2006 | A1 |
20060259124 | Matsuoka | Nov 2006 | A1 |
20060287576 | Tsuji | Dec 2006 | A1 |
20070060789 | Uchimura | Mar 2007 | A1 |
20070081920 | Murphy | Apr 2007 | A1 |
20070117437 | Boehnlein | May 2007 | A1 |
20070129604 | Hatcher | Jun 2007 | A1 |
20070162095 | Kimmel | Jul 2007 | A1 |
20070167678 | Moskowitz | Jul 2007 | A1 |
20070167868 | Sauer | Jul 2007 | A1 |
20070173693 | Refael | Jul 2007 | A1 |
20070188604 | Miyamoto | Aug 2007 | A1 |
20070197875 | Osaka | Aug 2007 | A1 |
20070210162 | Keen | Sep 2007 | A1 |
20070225556 | Ortiz | Sep 2007 | A1 |
20070238927 | Ueno | Oct 2007 | A1 |
20080004642 | Birk | Jan 2008 | A1 |
20080071144 | Kimmel | Mar 2008 | A1 |
20080097550 | Dicks | Apr 2008 | A1 |
20080108869 | Sanders | May 2008 | A1 |
20080195125 | Orbay | Aug 2008 | A1 |
20080195128 | Orbay | Aug 2008 | A1 |
20080225410 | Ning | Sep 2008 | A1 |
20080234547 | Irion et al. | Sep 2008 | A1 |
20080255416 | Gilboa | Oct 2008 | A1 |
20080262306 | Kawai | Oct 2008 | A1 |
20080300456 | Irion | Dec 2008 | A1 |
20090027489 | Takemura | Jan 2009 | A1 |
20090065565 | Lemoine | Mar 2009 | A1 |
20090076321 | Suyama | Mar 2009 | A1 |
20090076328 | Root | Mar 2009 | A1 |
20090080214 | Watanabe | Mar 2009 | A1 |
20090105538 | Van Dam | Apr 2009 | A1 |
20090118580 | Sun | May 2009 | A1 |
20090118641 | Van Dam | May 2009 | A1 |
20090149713 | Niida | Jul 2009 | A1 |
20090225159 | Schneider | Sep 2009 | A1 |
20090227897 | Wendt | Sep 2009 | A1 |
20090286412 | Ikeda | Nov 2009 | A1 |
20090287663 | Takeuchi | Nov 2009 | A1 |
20100069834 | Schultz | Mar 2010 | A1 |
20100094216 | Yue | Apr 2010 | A1 |
20100095969 | Schwartz | Apr 2010 | A1 |
20100101569 | Kim | Apr 2010 | A1 |
20100121142 | Ouyang | May 2010 | A1 |
20100157039 | Sugai | Jun 2010 | A1 |
20100160914 | Bastian | Jun 2010 | A1 |
20100168827 | Schultz | Jul 2010 | A1 |
20100191051 | Miyake | Jul 2010 | A1 |
20100191053 | Garcia | Jul 2010 | A1 |
20100234736 | Corl | Sep 2010 | A1 |
20100026201 | Frangioni | Oct 2010 | A1 |
20110009694 | Schultz | Jan 2011 | A1 |
20110034769 | Adair | Feb 2011 | A1 |
20110037876 | Talbert | Feb 2011 | A1 |
20110054446 | Schultz | Mar 2011 | A1 |
20110092775 | Deshmukh | Apr 2011 | A1 |
20110105839 | Hoffman | May 2011 | A1 |
20110112622 | Phan | May 2011 | A1 |
20110130627 | McGrail | Jun 2011 | A1 |
20110211115 | Tsai | Sep 2011 | A1 |
20110213206 | Boutillette | Sep 2011 | A1 |
20110245602 | Brannon | Oct 2011 | A1 |
20110288482 | Farrell | Nov 2011 | A1 |
20120016191 | Ito | Jan 2012 | A1 |
20120040305 | Karazivan | Feb 2012 | A1 |
20120053515 | Crank | Mar 2012 | A1 |
20120100729 | Edidin | Apr 2012 | A1 |
20120165627 | Yamamoto | Jun 2012 | A1 |
20120165916 | Jordan | Jun 2012 | A1 |
20120178991 | Clark | Jul 2012 | A1 |
20120226103 | Gunday | Sep 2012 | A1 |
20120236138 | Liu | Sep 2012 | A1 |
20120245242 | Peiffer | Sep 2012 | A1 |
20120245418 | Boulais | Sep 2012 | A1 |
20120253116 | Sniffin | Oct 2012 | A1 |
20120259203 | Devereux | Oct 2012 | A1 |
20120286020 | Smith | Nov 2012 | A1 |
20120289858 | Ouyang | Nov 2012 | A1 |
20130035553 | Kongstorum | Feb 2013 | A1 |
20130046142 | Remijan | Feb 2013 | A1 |
20130057667 | McGrath | May 2013 | A1 |
20130150672 | Fujitani | Jun 2013 | A1 |
20130172676 | Levy | Jul 2013 | A1 |
20130225921 | Liu | Aug 2013 | A1 |
20130253402 | Badawi | Sep 2013 | A1 |
20130289559 | Reid | Oct 2013 | A1 |
20130324973 | Reed | Dec 2013 | A1 |
20130345514 | Manion | Dec 2013 | A1 |
20140022649 | Echhardt | Jan 2014 | A1 |
20140107416 | Bimkrant | Apr 2014 | A1 |
20140111634 | Mueckl | Apr 2014 | A1 |
20140154399 | Weikart | Jun 2014 | A1 |
20140180007 | Edidin | Jun 2014 | A1 |
20140213848 | Moskowitz | Jul 2014 | A1 |
20140228635 | Tuliakov | Aug 2014 | A1 |
20140275763 | King | Sep 2014 | A1 |
20140296866 | Salman | Oct 2014 | A1 |
20140323991 | Tang | Oct 2014 | A1 |
20150005575 | Kobayashi | Jan 2015 | A1 |
20150011830 | Hunter | Jan 2015 | A1 |
20150018622 | Tesar | Jan 2015 | A1 |
20150018710 | Furlong | Jan 2015 | A1 |
20150088001 | Lindvold et al. | Mar 2015 | A1 |
20150150441 | Ouyang | Jun 2015 | A1 |
20150164313 | Ouyang | Jun 2015 | A1 |
20150196197 | Kienzle | Jul 2015 | A1 |
20150238251 | Shikhman | Aug 2015 | A1 |
20150297311 | Tesar | Oct 2015 | A1 |
20160007833 | Huang | Jan 2016 | A1 |
20160073853 | Venkatesan et al. | Mar 2016 | A1 |
20160077008 | Takasu et al. | Mar 2016 | A1 |
20160174819 | Ouyang | Jun 2016 | A1 |
20160334694 | Liu | Nov 2016 | A1 |
20160367119 | Ouyang | Dec 2016 | A1 |
20170086651 | Sato | Mar 2017 | A1 |
20170188793 | Ouyang | Jul 2017 | A1 |
20170188795 | Ouyang | Jul 2017 | A1 |
20170215699 | Ouyang | Aug 2017 | A1 |
20170295347 | Schneider | Oct 2017 | A1 |
20170310858 | Mueckl | Oct 2017 | A1 |
20180132700 | Ouyang | May 2018 | A1 |
20180184892 | Truckai | Jul 2018 | A1 |
20180235441 | Huang | Aug 2018 | A1 |
20180256009 | Ouyang | Sep 2018 | A1 |
20190000308 | Duckett, III | Jan 2019 | A1 |
20190029497 | Mirza | Jan 2019 | A1 |
20190110686 | Kato | Apr 2019 | A1 |
20190142262 | Inglis | May 2019 | A1 |
20190216325 | Ouyang | Jul 2019 | A1 |
20190223691 | Takatsuji | Jul 2019 | A1 |
20190246873 | Lu | Aug 2019 | A1 |
20190246884 | Lu et al. | Aug 2019 | A1 |
20190282073 | Truckai | Sep 2019 | A1 |
20190320879 | Langell | Oct 2019 | A1 |
20190374095 | Lord | Dec 2019 | A1 |
20200204776 | Themelis | Jun 2020 | A1 |
20200214739 | Shi | Jul 2020 | A1 |
20200275827 | Weise | Sep 2020 | A1 |
20210228806 | Streeter | Jul 2021 | A1 |
20210401277 | Ouyang | Dec 2021 | A1 |
Number | Date | Country |
---|---|---|
102858275 | Jan 2013 | CN |
1690512 | Aug 2006 | EP |
2560589 | Apr 2010 | EP |
3384879 | Apr 2011 | EP |
2749258 | Jul 2014 | EP |
3078354 | Oct 2016 | EP |
2009148420 | Jul 2009 | JP |
2011133792 | Oct 2011 | WO |
2012060932 | May 2012 | WO |
2014031192 | Feb 2014 | WO |
2014065901 | May 2015 | WO |
2016032729 | Mar 2016 | WO |
2016040131 | Mar 2016 | WO |
2016137838 | Sep 2016 | WO |
WO 2016137838 | Sep 2016 | WO |
2018136950 | Jul 2018 | WO |
2019237003 | Dec 2019 | WO |
Entry |
---|
Jul. 1, 2019 International Preliminary Report on Patentability in connection with PCT/US2017/053171 and dated Mar. 8, 2018 Article 34 Amendment and Demand for International Preliminary Examination Under Chapter II of PCT. |
International Search Report and Written Opinion of PCT/US2016/18670, dated Jul. 12, 2016. |
International Search Report and Written Opinion of PCT/US2018/014880, dated Jun. 6, 2018. |
International Search Report and Written Opinion of PCT/US2018/065396, dated Feb. 24, 2017. |
International Search Report and Written Opinion of PCT/US2021/050095 dated Dec. 17, 2021. |
International Search Report and Written Opinion of PCT/US2019/036060 dated Aug. 27, 2019. |
International Search Report and Written Opinion of PCT/US2017/053171 dated Dec. 5, 2017. |
International Preliminary Report on Patentability of PCT/US2017/053171 completed on Jul. 1, 2019. |
Extended European Search Report of European Patent Application No. EP19816177 completed Feb. 2, 2022. |
International Search Report and Written Opinion of the International Searching Authority dated Dec. 5, 2017 in connection with PCT/US17/53171. |
Mar. 6, 2018 Letter Accompanying Amendment under Article 34 and Demand For International Preliminary Examination under Chapter II of the PCT in connection with PCT/US17/53171. |
Number | Date | Country | |
---|---|---|---|
20190216325 A1 | Jul 2019 | US |
Number | Date | Country | |
---|---|---|---|
62647817 | Mar 2018 | US | |
62654295 | Apr 2018 | US | |
62671445 | May 2018 | US | |
62816366 | Mar 2019 | US | |
62399429 | Sep 2016 | US | |
62399436 | Sep 2016 | US | |
62399712 | Sep 2016 | US | |
62405915 | Oct 2016 | US | |
62423213 | Nov 2016 | US | |
62424381 | Nov 2016 | US | |
62428018 | Nov 2016 | US | |
62429368 | Dec 2016 | US | |
62485454 | Apr 2017 | US | |
62485641 | Apr 2017 | US | |
62502670 | May 2017 | US | |
62550188 | Aug 2017 | US | |
62550560 | Aug 2017 | US | |
62550581 | Aug 2017 | US | |
62558818 | Sep 2017 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/US2017/053171 | Sep 2017 | US |
Child | 16363209 | US |