Patent Grant
11051755
The invention described herein relates generally to an imaging device, in particular, an imaging means for enhancing visualization of components covered by living tissue thin opaque films. More particularly, the present invention is directed to enhancing the visualization of veins, arteries and other subcutaneous structures of the body for inter alia facilitating fluid insertion into or extraction from the body or otherwise visualizing subcutaneous structures for diagnosis of the medical condition of a patient or administration of medical treatment to a patient.
A visit to a doctor's office, a clinic or a hospital may necessitate vascular access that is, the insertion of a needle or catheter into a patient's vein or artery. These procedures may be required for many reasons including: to administer fluids, drugs or solutions, to obtain and monitor vital signs, to place long-term access devices, and to perform simple venipunctures. Vascular access ranks as the most commonly performed invasive medical procedure in the U.S.—over 1.4 billion procedures annually—as well as the top patient complaint among clinical procedures. The overwhelming majority of vascular access procedures is performed without the aid of any visualization device and relies on what is observed through the patient's skin and by the clinician's ability to feel the vessel—basically educated guesswork.
Medical literature reports the following statistics: 28% first attempt IV failure rate in normal adults, 44% first attempt IV failure in pediatrics, 43% of pediatric IVs require three or more insertion attempts, 23% to 28% incidence of extravasations/infiltration, 12% outright failure rate in cancer patients, 25% of hospital in-patients beyond three days encounter difficult access. The miniature vein enhancer of the present invention may be used by a practitioner to locate a vein and is particularly useful when trying to locate a vein in the very old, very young or obese patients. More than fifty percent of attempts to find a vein in the elderly, who have a generally high percentage of loose, fatty tissue, and in children, who have a generally high percentage of small veins and “puppy fat”, are unsuccessful. The present invention is aimed at reducing and/or preventing the discomfort and delay associated with botched attempts to pierce veins for injections and blood tests. In addition, the present invention can cut the time it takes to set up potentially life-saving intravenous drip. During venous penetration, whether for an injection or drip, it is essential to stick a vein in exactly the right location. If a practitioner is only slightly off center, the needle will more than likely just roll off and require a re-stick.
It is known in the art to use an apparatus to enhance the visual appearance of the veins in a patient to facilitate insertion of needles into the veins. An example of such a system is described in U.S. Pat. Nos. 5,969,754 and 6,556,858 incorporated herein by reference as well as a publication entitled “The Clinical Evaluation of Vein Contrast Enhancement”. Luminetx is currently marketing such a device under the name “Veinviewer Imaging System.”
The Luminetx Vein Contrast Enhancer (hereinafter referred to as LVCE) utilizes an infrared light source (generated by an array of LEDs) for flooding the region to be enhanced with infrared light. A CCD imager is then used to capture an image of the infrared light reflected off the patient. The resulting captured image is then projected by a visible light projector onto the patient in a position closely aligned with the image capture system. Given that the CCD imager and the image projector are both two dimensional, and do not occupy the same point in space, it is relatively difficult to design and build a system that closely aligns the captured image and the projected image.
A further characteristic of the LVCE is that both the imaging CCD and the projector have fixed focal lengths. Accordingly, the patient must be at a relatively fixed distance relative to the LVCE. This necessitates that the LVCE be positioned at a fixed distance from the region of the patient to be enhanced.
The combination of the size of the LVCE and the fixed focal arrangement precludes using the LVCE as small portable units that are hand held.
Other patents such as U.S. Pat. No. 6,230,046, issued to Crane et al., implement a light source for illuminating or trans-illuminating the corresponding portion of the body with light of selected wavelengths and a low-level light detector such as an image intensifier tube (including night vision goggles), a photomultiplier tube, photodiode or charge coupled device, for generating an image of the illuminated body portion, and optical filter(s) of selected spectral transmittance winch can be located at the light source(s), detector, or both.
All cited references are incorporated herein by reference in their entireties. Citation of any reference is not an admission regarding any determination as to its availability as prior art to the claimed invention.
The present invention is directed to technologies and processes associated with the use of one or more moving laser light sources to detect the presence of blood-filled structures, such as venous or arterial structures, below the surface of the skin and to project an image back on to the skin that shows the operator the pattern of detected structures. The present approach uses one or more laser light sources that are scanned over the body using mirrors and a light detector that measures the reflections of the laser light and uses the pattern of reflections to identify the targeted blood rich structures. Various preferred approaches are described for the main subsystems of the design as well as various alternative techniques for accomplishing the objects of this invention.
Using One or More Lasers to Capture and Project an Image
Blood vessels, both venous and arterial, absorb red, near infrared and infrared (IR) light to a greater degree than surrounding tissues absorb those wavelengths of light. Therefore when illuminating the surface of the body with infrared light blood rich tissues such as veins will absorb more of this light and other tissues will reflect more of this light. Analysis of this pattern of reflections enables the veins to be located. The present invention includes both a positive or negative image that is projected in the presence of a vein. Thus, a vein can be represented by a bright area and the absence of a vein can be presented as a dark area and vice versa.
A laser diode is preferred in the present invention as it emits light over a known, narrow wavelength range and when appropriately focused projects a small spot that varies very little in size over a wide range of distances. This is an effect that is commonly seen in laser pointers and laser gun sights.
Additionally, the use of laser as opposed to other techniques known in the art such as the Luminetx product allows finer control over the scanning for blood vessels. Since the laser is only striking a single spot on the body, the laser that is used to detect the presence of blood can be modulated on the fly wherein the intensity can be increased or decreased on a spot by spot basis. In a camera based solution, since the infrared light floods the area being scanned, no such control is possible.
Mirrors
Through the use of movable mirrors, the laser spot can be rapidly moved across the target area of the body. As the spot moves across the body there will be a modulation of the amplitude of the reflected light that is proportional to the attributes of that point on the body. For example, red, near IR and IR light will be absorbed and reflected in proportion to the amount of blood at the point at which the laser strikes the body. The invention uses this modulation to determine the location of veins. Other wavelengths of light will be reflected in proportion to the topology of the body at the point at which the laser strikes and can be used for enhancing vein detection.
Scan Mirrors
The invention uses one or more moving mirrors to move the laser light spot across the patient's skin in a variety of different possible patterns. The laser light is projected from a light generator on to the mirror and as the mirror is moved, the projected spot of light moves as a function of the angle of the mirrors at a given moment in time. The light is projected on to one or more mirrors moving in a coordinated way so as to generate a pattern of light on the target surface such as the patient's skin. Many patterns are possible by changing mirror attributes such as mirror size, position in relationship to each other and to the laser or lasers, the degree of the mirror's angle and the speed of mirror movement.
Random vs. Fixed Patterns
A scanning method implemented with the present invention is unique in its approach to scanning the target area. In general, the lower the level of precision required in positioning the laser spot, the easier and less costly it is to produce the pattern.
Coaxial Lasers
In a preferred embodiment, instead of a laser projector there is no need for a reproducible scan pattern so that from frame to frame the laser scan lines do not need to fall reproducibly upon the scan lines of the prior frame, thus, there is no need to know the instantaneous position of the laser. The reason being, the light used for detection and for projection are either from the same light source or from multiple coaxially aligned light sources and the vein detection is performed in near real time. The projected visible light can be modulated in real time so that whatever location is being imaged is instantaneously being projected and only a small offset between detection and projection occurs which will not be noticeable to the user. Therefore, since the image projection happens within the scan, it doesn't matter if the scan pattern on the next traversal of the area proceeds in the same way the previous scan pattern did.
Parallel Lagging Projection Laser
If small additional processing time is required, rather than coaxially arranging the scan and projection lasers, the system can hold them parallel with a small gap in one direction. In this way, the spots follow closely behind each other as the mirrors move, but there is additional time between when the detection spot hits a point on the body and when the closely following projection spot hits the body.
Repeatable Patterns
In other embodiments, there are benefits to knowing the instantaneous position of the laser spot. In such embodiments, the desire would be to delay the projection of the image so that analysis that requires additional time can be performed.
A raster pattern is one type of repeatable pattern. In such a pattern, there are a number of different delay strategies.
These differing approaches each have benefits. The shorter the time delay between capture and projection, the less complicated the system needs to be in terms of processing and memory. As the delay increases, more information needs to be stored and processed, and hand jitter becomes more of an issue. If the frame rate is fast enough, the user would not notice the lag even with the occurrence of hand jitter. Hand jitter is the result of motion of the hand holding the scanner in relationship to the body. In typical systems with frame rates of 30-60 Hz one or two frame delay is practical. If additional frames are needed for processing, than the frame rate can be increased to minimize the delay. Alternatively, the system can use digital or optical image stabilization well known in the art to maintain alignment from frame to frame. One method would be to use accelerometers can be used to determine the amplitude and direction of the movement from frame to frame. Many other techniques are well known in the art.
The positive side of frame-level or multi-frame delay is that more complex algorithms can be used to identify the veins such as edge detection and line detection algorithms that are well known in the art.
Averaging Across Frames
One embodiment of a system that uses repeatable scanning is one in which the image is averaged across two or more frames, thereby increasing the quality of the image captured and therefore increases the ability of the system to accurately detect the position of blood vessels.
Pattern Generation
Many patterns of scanning are possible. For example, the patterns can be based on raster, collapsing ellipse, spirals, lissajous or random. Tradeoffs between pattern and system complexity can be made to create multiple products of differing cost and performance. For example, if the mirrors are run at their natural resonance frequency, the system minimizes the power needed to move the mirrors thereby either extending battery life or reducing the battery size needed and thereby reducing size, weight and cost.
Referring to
The MPH 2 may include a single colored laser 180, for example a 630 nm semiconductor red laser, is projected into combiner 181. A semiconductor laser 183 is also projected into the combiner 181. Laser 183 may have a frequency from 700 nm to 1000 nm, with a preferred frequency of 740 nm. An illustrative example of a semiconductor 740 nm laser is Sacher Lasertechnik's Fabry Perot Diode Laser 740 nm, 10 mw, model number FP-0740-10. The combiner 181 outputs a combined laser beam 184 which is the combination of the 630 nm red and the 740 nm laser beams. Combiners for combining two lasers of different frequencies are well known in the art and will not be further described herein. The combined laser beam 184 is positioned to hit off mirror 172 and then to hit the MEMS scanner 173. The MEMS scanner 173 moves in a raster pattern thereby causing the combined laser beam to move along optical path 5 forming a raster pattern at the field of view 4. A photodetector 182 which is responsive to the 740 nm frequency is provided and receives 740 nm light reflected off objects in the field of view. The photodetector 182 outputs an analog signal representing the amount of 740 nm light received. An illustrative example of a photodetector is Roithner Lasertechnik's model number EPD-740-1.
The oscillation of the MEMS scanner 173 is controlled by electronics so that the reflected laser beam is moved in a pattern.
Raster Pattern Generation
In
A preferred embodiment uses 20 KHz for waveform 1258 and 60 Hz for waveform 1259. Other preferred embodiments can use 7 KHz to 35 KHz for waveform 1258 and 45 Hz to 90 Hz for waveform 1259.
Lissajous Pattern Generation
Referring to
X=A sin(at+phase), Y=B sin(bt)
The two axes are modulated based on this relationship where various values of A, B and the phase offset control the specifics and density of the projected lissajous pattern. Waveform 1270 shows the X value over time and waveform 1271 shows the Y value over time. In the equation, A is the amplitude of waveform 1270 and B is the amplitude of waveform 1271, at and bt are the angle of the sine waves over time and phase is the phase shift (angle offset) between the two waveforms 1270/1271. Many values of these variables can be used for a scanning application, but a preferred embodiment would select values that move the mirror at its resonant frequencies so as to minimize power consumption.
A preferred embodiment uses 400 Hz for waveform 1270 and 60 Hz for waveform 1271. Other preferred embodiments can use 300 KHz to 35 KHz for waveform 1270 and 45 Hz to 90 Hz for waveform 1271.
Collapsing Ellipse Pattern Generation
In
A preferred embodiment uses 8 KHz for waveform 1280 and 8 KHz for waveform 1281. Other preferred embodiments can use 7 KHz to 35 KHz for waveform 1280 and 7 KHz to 35 KHz for waveform 1281.
Spiral Pattern Generation
The spiral pattern 1290 in
A preferred embodiment uses 8 KHz for waveform 1295 and 8 KHz for waveform 1296. Other preferred embodiments can use 7 KHz to 35 KHz for waveform 1295 and 7 KHz to 35 KHz for waveform 1296.
Bounce Mirrors
In addition to moving mirrors, one or more fixed mirrors may be used in the design of the invention. This allows many different arrangements of the light sources to minimize overall size or to otherwise optimize the positioning of the components of the device.
Referring to
In
Note that the laser beam 21 can be redirected by one or more bounce mirrors as shown in
Different embodiments will use one or more laser colors and sources to perform detection and projection. One embodiment of the invention uses two lasers to perform its functions where one laser is selected to have optimum performance at blood detection (e.g., 740 nm) and the second laser has optimum characteristics to project the resulting image to the user (e.g., 638 nm). The major benefits of this embodiment include the ability to modulate the detection and visible lasers simultaneously, and the ability to select lasers that have ideal characteristics for the function to be performed (rather than a trade off between detection and visibility as will be seen in a single laser embodiment). The laser sources (e.g.,
Combining Lasers with Polarization or Dielectric Mirror
A key element of this embodiment is a mirror system that in addition to moving the light spot as previously described provides a mechanism that causes the two laser beams to become coaxial so that both lasers strike the same point on the patients skin. There are many different ways to align co-axially the visible laser and the infrared laser including the use of dielectric mirrors.
Combining Lasers with Dielectric Mirrors
Dielectric mirrors are specially coated mirrors that can reflect selected wavelengths (or wavelength ranges) of light while allowing other wavelengths to pass through the mirror. In this embodiment one or more coated mirrors are used in the optical path to make the separate laser sources coaxial so that when they strike the moving mirror subsystem, they then strike the same spot on the skin.
Furthermore, separate control systems are provided to modulate the intensities of the lasers. The laser intensities can be independently modulated to control the desired characteristics such as depth of detection and the brightness of the projected image providing a great degree of control over these desirable characteristics.
Additional embodiments are possible where additional lasers are added to provide for further refinement of the detection and presentation of the detected blood. For example an additional laser could be used to determine range to the surface of the skin so that finer control over the depth of detection can be performed. Another example is the use of a second color of visible light so that additional information about useful attributes such as depth of the blood vessel can be presented to the user.
Similar assemblies can be repeated multiple times for creating coaxial combinations of more than two lasers if needed for the specific marketing or technical requirements of the product.
Combining Lasers with Polarized Elements
A characteristic of laser light is that it is polarized in a known orientation. By carefully controlling the orientation of the laser light, dielectric elements that reflect and pass light polarized in specific orientations can be used to coaxially align the lasers.
With regard to the polarized approach, referring to
In
Similar assemblies can be repeated multiple times for creating coaxial combinations of more than two lasers if needed for the specific marketing or technical requirements of the product. Additionally, the visible and infrared lasers may be swapped if desired and the parameters of the assembly adjusted appropriately.
Multiple Lasers in a Single Package
Laser diodes that combine more than one laser into a single package can also be used as the laser light source. This eliminates the need for additional beam combining elements in the system. For example, Sanyo DL-1195-251 provides both a red and an infrared laser in a single package.
Multiple Source Array for 1d Scanning
All the embodiments so far have related to a visible laser point source and a IR laser point source bouncing off multiple mirrors, or a single mirror moving in multiple directions, to create a two-dimensional scanning pattern where both the X and Y axis of the two dimensional imaging area is scanned with the single coaxial source of laser light. Rapid scanning causes the eye to integrate this into a single image. In such a system, the beams need to be actively steered in both the x and y directions in the desired pattern. Since there is only reflection from the point at which the laser is currently striking, the photo detector sub system can make inferences about the presence of veins at that particular spot on the target.
An alternative embodiment would be to use a linear array of visible laser sources and a linear array of IR laser sources which then are reflected off a single mirror moving on a single axis. The effect of putting these lasers side by side is to eliminate the need to move the laser point in both the X and Y directions. An appropriate density of laser sources will be required so that the image presented to the user achieves a desirable resolution. These sources could be from individual lasers for each desired line of resolution or from a lower resolution array optically split into a sufficient number of sources to achieve the desired resolution. Many laser arrays known in the art could be used including a VCSEL array.
Using a laser array, you “paint” an entire field of view with the broad brush (the array of laser sources). An advantage of this approach is (i), the mirrors are less complex, and (ii) that the collection of the reflected IR light could also be by means of a retro collective mirror. A retro collective mirror has a field of view corresponding to the array of lasers, and moves in concert with the movement of the array of lasers. A retro collective unit has a significantly improved signal to noise ratio since it is only receiving signal input at any given time directly in a line of sight with the lasers, thereby minimizing the effect of ambient light and other noise sources. A retro collective mirror is inherently larger than a mirror that simply moves the beam. This is to allow for a large light collection area. However due to inertia, as the mirror is made larger, it can no longer be moved as fast as needed for a single laser. This arrangement of multiple lasers allows the system to eliminate the fast moving mirror.
As shown in
In addition to the paired visible and IR lasers, the array of lasers could be a single wavelength array of sources that use one wavelength to detect and project as described elsewhere.
In addition to lasers, if the distance to the object being scanned is tightly controlled, then LEDs could be used in place of lasers.
Using Light Valves
A device called a grating light valve, such as those made by Silicon Light Machines (http://www.siliconlight.com), can be used in a similar manner to an array of laser sources. These light valves, typically based on MEMS technology, are basically mirrors that can be set to a reflective or non reflective state. They are typically packaged as an array of light valves 1506 as shown in
Referring to
This embodiment can also be combined with a retro collective mirror system to enhance the collection of the reflected light.
Single Laser
In another embodiment, the invention uses a single laser that emits light at a wavelength that is long enough that it is still differentially absorbed by blood but is still visible to the human eye. This embodiment is very important in that it enables building a system with only a single laser. All the complexity associated with aligning multiple lasers is eliminated thereby greatly reducing cost, engine size, unit size and power consumption.
Light emitted at 635 nm is one possible choice. In this embodiment, the laser spot performs the dual function of detecting the presence of blood and displaying that presence of blood to the user. It has been determined that a portion of a 635 nm laser penetrates into the tissue and is absorbed by the veins. Accordingly the 635 nm laser can functions as did the infrared lasers for the purpose of imaging the veins. A portion of the 635 nm light does not penetrate the skin and is reflected off of the skin so that it is visible to the user. This portion of the light functions as did the visible laser in the dual laser system.
Single Laser Always On
A novel mechanism is used to allow the single laser to be used for both functions. In this embodiment the laser is never completely turned off. Accordingly, even when the image to be displayed is black, the laser is still powered on at a very low level. The low level is strong enough that it can still be detected by the photo detectors so that the device can still image the veins, but not strong enough to create a distracting visible image (so blacks may appear as a faint red color). When the intensity of the 635 nm laser is subsequently increased to project a bright portion of the visible image, the gain of the analog circuitry associated with the received signal (from the photo detectors) is reduced in proportion. Conversely, when the intensity of the 635 nm laser is subsequently decreased to project a darker portion of the visible image, the gain of the analog circuitry associated with the received signal is increased accordingly. In this manner, the received signal (as measured after the analog circuitry) remains relatively constant regardless of the intensity of the projected image.
Referring to
Typically in this configuration, neither repeatability nor knowledge of the specific beam position at a given time is required since the processing is done in real time as the light beam reads and paints the skin. However, the delay techniques that were discussed previously can be applied to a single laser configuration.
The photo detector 76 is positioned to measure the light 75 reflected from the skin. Since this is a scanning point source, the reflected light is an instantaneous representation of the reflection from a single point 82 on the body. Note that the beam penetrates some distance into the body so the reflected signal is a composite of both surface and subsurface features. The output of the photo detector 77 is fed into a detection circuit 78 [that uses techniques that are well known in the art] to determine a change in the amplitude of reflected light and therefore detecting the relative amount of blood at the point 82 at which the laser is currently scanning.
The detection circuit 78 provides an output 79 to the power supply 80 to the laser source 70. As soon as a vein is detected at the point 82, the power is increased to the laser source 70 which increases the output of the laser so that it is visible to the operator. As soon as the detection circuit 78 detects that the point 82 is no longer over a vein, then the control output 79 is changed so that the laser 70 outputs a light level that is sufficient for detection, but is no longer visible, or is dimly visible, to the operator. The detection circuitry includes the functionality to cancel out the increased reflection when the laser is brightened and the decreased reflection when the laser is dimmed so that the action of projecting the image does not interfere with the ability to detect the veins.
If desired, the sense of on and off can be inverted, whereby the laser is brightly lit when no vein is detected and dim when a vein is detected.
Following the reflected signal, at 90 the system is seeing a varying analog signal that is representative of a reflection pattern indicative of a beam that is not crossing a vein. Since different individuals based on skin color, skin condition and place on the body will reflect different amounts of light as this baseline 90, the detection circuitry is designed so that it can determine this baseline in real time. At 91, there is an amplitude drop off as the beam crosses a part of the body where blood is absorbing sufficient light that the detection circuit 78 determines that the beam is over a vein. An internal representation or flag 97 that the beam is over a vein is set and the output to the laser power supply 79 is changed so that the laser amplitude is increased 89 to the bright condition thereby projecting the vein position. Once the beam is brightened, there is a corresponding rise in the amplitude of the reflected light 92. Internally, the detection circuit 78 corrects for that amplitude 96 to eliminate false readings and to prevent saturation of the detection chain 76, 77, 79.
As the beam 73 continues to move, as long as the reflected level continues within the range for vein presence 92, the laser will stay in its high state 89. The beam will eventually move off of the vein and the reflection will increase once again 93 indicating that the beam has moved off of the vein. The detection circuitry 78 will then cause the laser power supply 80 to return to the dim state 88. The reflected signal will now be reduced 94, the detected vein flag will be turned off 98. This process will continue to repeat for the duration of scanning.
Single Laser PWM
It is desirable in some embodiments to have greater control over the intensity of the beam when it is being used for detection. In a single laser system, it is required that the beam intensity be low enough in the dark areas of the image so that they appear clearly different from the lit areas. It would be desirable in certain circumstances such as different skin coloration or the desire to scan more deeply below the skin to bring the intensity of the light up for scanning. In this embodiment, the modulation of the laser between detection and projection can be in real time where the invention time slices the laser between detection and projection so that both functions are performed on the same pass of the laser over the skin.
In
In addition to modulation between detection and presentation modes as described, the laser can also be modulated within each of these domains to provide for variable detection characteristics such as changing the depth of penetration and detection through the skin and changing the intensity of the projection intensity to allow for variations in user preference, ambient lighting conditions and skin color.
Another embodiment of the single laser approach is to time slice the laser output so that very short pulses of high intensity are emitted followed by longer periods of projection intensity. Projection intensity is the light output level that the system wishes the user to see. Vein detection occurs at the bright pulses, but since they are very short, and the eye has a slow response time, they will not perceptibly interfere with the desired projection image. The advantage of this embodiment is that it allows higher intensity for the detection phase allowing for deeper structures to be imaged and allows the system to adjust for skin characteristics.
Alternating Line & Alternating Frame
The techniques discussed previously for alternating lines and frames between detection and presentation in a multiple laser system can also be applied in a single laser system.
The use of these delay techniques allows all of the advanced vein detection techniques to be applied by allowing extra time between detection and projection as previously discussed as well as the improvements yielded by the additional control of laser intensity provided.
Using LEDs Instead of Lasers
As previously discussed a major benefit of lasers was that the beam remains a constant size over a very wide range of distances between the light source and the surface of the patient's body. An alternative embodiment can be created that is of lower cost which uses tightly focused light emitting diodes (LEDs).
In
The disadvantage is that the distance between the scanner and the body surface will need to be much more tightly controlled than in a laser embodiment. Several controlling mechanisms are possible such as a physical device that is placed against the skin. One possible mechanism is shown in
In an alternate construction, as shown in
Additional features include:
IR Camera, LED Projector
Another useful embodiment of the invention is based on the use of LED projection with alternative types of detection. Given the need for tight control to be maintained of working distance, or to provide an auto focus mechanism in an LED embodiment, the detection subsystem can be replaced with a camera element that is sensitive to IR light and an IR light source to illuminate the target area. In this embodiment, the image would be captured using the camera, processed to detect vein positions within the field of view and an LED implementation as described earlier would be used to project the image back on the patient's body.
Auto-Focusing in Non-Laser Embodiments
As discussed, a key benefit of using lasers is that they are inherently focused over a wide working range. As discussed above, since LED's do not remain focused over a long working range, the use of LEDs requires tight control of distance to the body area to be imaged. Auto-focus lenses, such as those seen on cameras, could be integrated into the design so that a broader working range can be provided. Typically however an LED implementation is used to minimize cost so that normally the expense of auto-focusing would have limited application. However, other embodiments of vein enhancement systems such as that described in U.S. Pat. Nos. 5,969,754 and 6,556,858 would benefit from the use of auto-focus technology and have a cost basis that support such an implementation.
Photo Detector
In addition to the subsystems that project the laser or laser spots on to the patient's skin, a further subsystem provides the detection of the light that is reflected from both the skin and the subsurface features of the patient's body. As previously mentioned, blood rich areas of the body such as veins absorb light in the infrared spectrum to a greater degree than surrounding tissues. The invention uses one or more photo detectors to measure the varying amount of reflection from the target. Light sensitive devices including photo diodes, CCD camera elements and CMOS camera elements and LEDs can be used as the photo detector to perform these measurements. The present invention can implement multiple photo detectors spatially separated so as to increase sensitivity, and reduce the interference associated with speckle, and specular reflection. However, as mentioned previously, one can achieve a reasonable result by using a single photo diode; this will depend on the desired output and/or operating needs.
The characteristics of the photo detector(s) will vary between embodiments. Photo detectors can be selected with narrow band characteristics so that only the detection laser is received by the detector. This would also have the advantage of making the system less sensitive to ambient light. Detector characteristics can be determined through selection of the photo detector itself or through the use of filter materials placed in front of the detector. Another alternative approach would be to use a photo detector that is sensitive to a broad range of wavelengths and then by modulating the transmitted laser light, the system would be able to determine which laser, and therefore light wavelength, was being detected at a given moment in time.
Variations on the Number of Photo Detectors Used
Different embodiments may use different numbers of photo detectors based on the technical and business needs of the specific implementation. For example, a single photo detector might be used to minimize size or cost. Multiple photo detectors may be implemented so that they are spatially separated so that the system is less sensitive to specular reflection. Skin is somewhat shiny and causes unwanted specular rejection. In an embodiment where the photo detectors are separated, they each see the returned signal from a slightly different angle so that the effect of specular reflection is minimized.
The larger the area of a photo diode (one type of photo detector) the lower the speckle noise seen by the system since the random pattern of speckles are integrated as a single reflection since they all strike the photo detector simultaneously. The larger area means that the small speckles are a smaller percentage of the total area and therefore have less of an impact on the signal. However, larger photo diodes have more capacitance and are therefore slower, which is undesirable in many embodiments of the invention. By using multiple photo diodes, the detector area is increased, providing the reduction in speckle noise, without the negative impact on the speed of the detector. This is due to the smaller capacitance of the smaller photo diode and the fact that each photo diode being able to have its own pre-amplifier circuit.
A further benefit of having multiple photo diodes is that the received signal is increased without the need for additional amplifier gain and the associated noise that it would introduce into the system.
A further benefit of having multiple photo diodes is that as the laser point moves across the human limb, the curvature of the limb causes an increasing amount of the light to be reflected away from the scanner as the beam moves to the sides of the limb. The addition of spatially separated photo detectors adds additional collection area nearer to the spot being scanned and allows more of the reflected light to be captured. In addition, having two separately placed photo detectors reduces the impact of specular reflection.
As an alternative to the addition of a photo detector, collection mirrors can be used in the collection path so that light is collected from spatially separate points and are then reflected on to a single photo detector shared by two or more collection mirrors.
Array of Photo Diodes
In one embodiment, there is an array of smaller photo detectors arranged so that there is more collection area towards the outside of the detection area (where the roll off of signal due to the curved body and the angle of the laser occurs) and less towards the center where the reflection is more direct and intense. An example pattern is shown in
Fresnel Lenses—Tailored Response Over the Field of View
Another technique to control the variation of reflection due to the change in laser angle across a scan line is to use specially configured lenses over the photo diodes. In this example a lens is cut from a standard fresnel lens in a pattern that increases the amount of collected light as the angle from the center of the photo diode increases thereby flattening the received signal.
As shown in
Electronic Filter
The frequency domain of the signal caused by the angle change as the laser sweeps is slightly different than the signal caused by the presence of a vein. Through the use of electronic filters, well known in the art, such as switched cap filters, the impact of this signal can be reduced early in the signal processing chain, importantly prior to the vein detection circuitry.
Measuring Topology with an Additional Laser
In the prior descriptions, a simplified model of the reflection of the laser light was presented. In fact, there are varying degrees of absorption of light from all of the structures illuminated including the skin, the blood vessels and other surface and subsurface structures of the body. Additionally, since the body is a three dimensional structure, the range to the point on the surface being scanned varies in real time as the imaging point is scanned. For example, the curved shape of the arm would result in less returned reflection towards the edge of the arm as that surface curves away from the scanning device. The result is that these variable reflections off of these body structures add signals that must be filtered out to accurately detect the vein structure. Furthermore, as the beam sweeps across the body, when the beam is at the center point of its sweep, the reflected light received at the photo detector is greater than when the angle of the beam is at its maximum deflection and therefore more light is reflected away from the photo detector.
There many techniques that can be used to eliminate or cancel out these undesirable signals.
The reflected signal received by the infrared photo detector is representative of both the veins and the surface topology of the patient's body. Put another way, the surface of the patient affects the reflected infrared signal. This is not desirable in that in most applications the user is only interested in the veins of the patient and not the surface topology. It has been observed that the short wavelength light such as blue and ultraviolet are reflected by the skin and is mainly representative of the surface topology of the patient and has no vein information contained therein. By utilizing a second coaxial laser light source at a short but visible wavelength and a second photo detector subsystem for receiving the short wavelength light reflected signal, the short wavelength light signal (which contains information about the topology of the skin) can be subtracted from the infrared signal (topology+veins) yielding a signal that is solely the veins (topology+veins−topology=veins). This works in that since the beams are coaxial, they will be affected by the topology of the target area symmetrically.
This approach is particularly useful in a system that does not have a microcomputer for storing a complete image and for performing image processing on that image to enhance the veins (and reject all other types of signals) but also has benefit to a stored image system.
Referencing
The output of the photo detectors 526, 527 are amplified and conditioned by pre amplifier circuits 631, 632 and then fed through the differential amplifier 534 which subtracts out the surface topology represented by the reflected short wavelength light yielding an output 535 that is primarily based on the reflected vein pattern.
The simplest embodiment would use a red laser for both detection and projection as described earlier in conjunction with the short wavelength laser.
An Implementation with Three Lasers
As a further embodiment, a three laser system can be built to further enhance the captured and projected image. In this embodiment, three lasers are used: ultraviolet (e.g., 407 nm for imaging the skin topology), visible (e.g., 630 nm providing the visible light for image projection), and infrared (e.g. 740 nm for imaging the veins). Two photo detectors are used. One is for receiving the ultraviolet, and one is for receiving the infrared light. The ultraviolet laser has absolutely no penetrating qualities into the skin and therefore the reflection very faithfully reflects the patient's topology. This signal is then subtracted from the infrared signal to yield just the vein signal. This embodiment is further advantaged in that the wavelengths of the ultraviolet and infrared lasers are very far apart from each other, and therefore, there is no inadvertent signal pickup by the respective photo detectors.
This implementation would operate in a substantially similar way to what was previously described for
Many combinations of multiple lasers and detectors are possible that each provide optimizations based on the type and depth of stricture being scanned for, for example adding additional visible lasers for additional projected information as described elsewhere.
Long Pass Photo Detector Filter, Photo Detector Sees Only IR Light
One goal of the photo detector design is to acquire only the desired signal such as the vein pattern without interference from the reflected light from other objects in view such as the topology of the body or ambient light.
Many techniques are possible. In some embodiments, a photo detector will be selected that is matched to the wavelength of the infrared laser. In another embodiment, a filter that has the ability to block all light other than the wavelength of the infrared laser can be placed in front of the photo detector so that only the infrared light passes into the photo detector. In a third embodiment, the amplitude of the laser light is modulated either in the time or frequency domain, thereby allowing the system to know which laser is being seen by the photo detectors. The third embodiment has the benefit of allowing a photo detector that is capable of detecting a broad spectrum of light (e.g., a photo detector that is responsive to both 638 nm laser and 740 nm lasers). This allows a broader range of photo detector devices to be used that are selected for other desirable characteristics such as low cost, small size or greater sensitivity.
Special Laser Handling
As a mirror moves back and forth as it scans the laser beam it decelerates before it reaches a full stop then reverses direction and accelerates again. During some portion of the outer extremes of travel the mirror is moving too slowly for the information returned by the reflected laser to be used. In addition, the output power at these extremes is more dangerous because it is spread over a smaller area. Therefore reducing or blocking laser power in these extremes helps to ensure that it stays within government mandated safety limits. Furthermore, the laser current needed is proportional to the temperature of the laser. This is important in a battery powered device in that the amount of current needed to run a cooler laser is lower and therefore the battery lasts longer.
In the preferred embodiment, one or more of the lasers are turned off during the unused portion at the ends of the scan lines. The benefits of this are:
An alternative embodiment would leave the laser on all the time, but change the size of the exit window aperture so that the brighter parts of the scan are clipped off by the window. This embodiment is safer than the preferred embodiment in that the failure mode is less likely to occur, but there is none of the power savings. There are useful benefits to the internal reflection cause by clipping the output however. These include:
A further embodiment would be to proportionally reduce the power at the mirror slows so that the brightness is kept constant. This would be useful if a border demarking the edge of the image was desired or if some system data was to be displayed in this border area.
Safety
In some embodiments, it is desirable to maximize the cutout of the laser so that a greater signal or greater penetration into the body is needed. All laser projection devices have governmental safety agency regulations dictating power output limitations. These limitations are typically expressed as a maximum output of the laser at a given distance from the eye over some period of time. Therefore, a number of techniques that control power output and the time profile of the output can be used to ensure that the device meets these safety criteria.
The balance between high power (yielding brighter images or greater 3d penetration) and safety are an important part of the design of the device.
In one possible embodiment, physical barriers can be placed in the design of the product that prevents the user's eye from getting close to the origin of the laser projections. If a user's eye can not get close to the source of the laser, the laser power may be increased. For example, in an embodiment, protruding bars (think of a football helmet cage) can be placed in the direction of the optical path that prevents the user from placing an eye too close to the lasers. Accordingly, the laser power can be increased.
In an alternative approach, signal processing can be utilized to control the power output. By way of example, veins have a very distinctive pattern, (e.g., they are tubular shaped). An embodiment can be created in which the acquired image pattern is stored in a computer memory, image processed to determine whether veins are present, and only upon confirmation of vein being present is the image projected. In this manner, the visible laser is not turned on if the unit is aimed at a user's eye (no vein pattern detected).
In a further embodiment, the power of the infrared laser can be set initially low to detect the presence of surface veins, and only after they are detected is the power of the infrared laser increased (to image deeper veins) and the visible laser turned on to project the vein pattern.
An additional alternative method is to only turn on the device a when a proximity sensor determines the surface, or eye of a user, is a predetermined distance away from the origin of the lasers, for example an Agilent HSDL-9100 proximity detector. The power of the laser can be set so that it is safe at the threshold distance. There are many range detectors known in the art such based on optical and ultrasonic techniques that can be used in the invention.
An additional alternative method is to turn the lasers on for a short duration to determine if a vein pattern is in view before turning the lasers on for an extended period to image the vein pattern.
Since the moving mirrors are subject to inertia, they will move more slowly towards the end of their movement than they do at the center of movement. Therefore, the laser intensity over time is higher at the edges than it is in the middle. The system can be designed to manage the bright edges as follows:
In all of these embodiments, these techniques can be applied to one or more of the lasers in the system. Furthermore they can be done independently, for example, the visible laser is left on to show the border line, while the IR laser is shut off at the edges.
Ergonomics
The basic invention provides for the detection of and the projection of an image of the pattern of blood vessels directly on to the patient's body. In this manner, the practitioner has a direct sense of where the veins are and where the center line of the vein is so that they may easily and accurately perform venipuncture. One intention of the invention is to be as easy to use as possible. One expression of ease of use is to ensure that the device enhances and doesn't interfere with the normal work process of finding and accessing the vein.
The integration of the detector and projector into a single device also improves on the Crane Patent. In Crane, the vein enhancer implements two separate devices, one for illumination and/or trans illumination and a separate device used for detecting the low light. Such a configuration is awkward and difficult to operate. In addition, having two separate devices increases the likelihood losing one of them.
Scanning Activation Techniques
Several techniques can be applied to allow the user to control operating characteristics of the device such as on/off and gain. This user input is very important from both a safety and operational standpoint. The gain of the scanning system will need to be changed based on skin color and condition as well as the depth of detection desired by the operator. The gain of the projection will also need to be adjusted based on ambient light conditions and skin color and condition.
These include
Gravity Tilt for Aiming Projection on Skin.
In the present invention there are described a number of novel mechanisms to automatically maintain the position of the imaged area as the practitioner moves the needle to perform venipuncture. It will be appreciated by those skilled in the art that the present invention is not limited to locating veins, arteries and other blood-rich structures and either implicitly or explicitly focused on placing a needle into the structure. There are many procedures, such as an intramuscular injection, where it is desirable not to puncture a vein. The invention can be used to avoid hitting a vein in this case.
Gravity Adjusted
One such mechanism is to mount the imaging head on pivot-able mechanism mounted to the needle protector. The mechanism is arranged so that the force of gravity biases the projection angle at a predetermined angle to the earth's surface. As the needle is moved, the field of view continues to remain at a constant angle to the surface of the earth.
Computer Control Using Orientation Detection
Another mechanism would be to use electronic devices including tilt switches and/or accelerometers to monitor movement of the scanning element. A mechanism such as a switch press could be used by the practitioner to indicate that the scanner should go into a mode where it attempts to maintain the field of view on a fixed position on the body. As movement is detected, the device moves the scan area to compensate for the practitioners hand movement.
Several movement control mechanisms are possible. In one embodiment, positioning actuators can move the scan element in two dimensions thereby moving the imaging/projection area. In another embodiment, the internal mirror arrangement can be such that a bias is added or subtracted from the mirror's travel, thereby changing where the projected image is placed. In another embodiment, a combination of both techniques can be used. In another embodiment, an engine with higher than necessary resolution for vein location can be used and a window is moved within the higher resolution space.
Computer Control Using Feature Detection
The previous embodiment relies on the system detecting a change in its position by measuring the movement of the scan head. In another embodiment, as the image of the vein structure is captured, the system can identify unique patterns in the structure of the captured image. For example, the system could look at a cross point between two veins. In a frame to frame comparison, the change in position within the imaging field of this unique pattern can be determined and then the scan position can be moved by one of the techniques previously described so that the unique pattern is kept in a constant position within the imaging field of view.
Florescent Cream on Skin
In the embodiments previously described, the projection of the image relies on repeated scanning of a visible light source over the area of the body being scanned. It is known in the art that there are materials that emit visible light when energized by a violet or ultraviolet light source. These materials can continue to emit light for a period of time, up to several minutes, after the energizing light source is removed. Furthermore, these materials can be mixed into a gel, cream or liquid base so that it can be applied to the surface of the skin. In addition, the florescent material can be combined with the antiseptic that is already used in venipuncture.
An embodiment of the invention can be made where a violet or ultra violet laser (e.g., 407 nm) can replace the 630 nm laser. The practitioner can apply the florescent material to the surface of the skin and then the scanner can be passed over the area to scan the veins. The device uses the violet/UV laser to activate a pattern that matches the vein position on the treated skin.
This embodiment is very useful and unique for several reasons. First, the image of the vein position is maintained even after the device is turned off and put away, thereby freeing both hands for the venipuncture. Secondly, the size of the imaged area is now limited by the area that the florescent material is applied to, not by the projection area of the device. Third, if the procedure is taking too long, the image can be reactivated by rescanning the area.
Still further, a three laser system can be built, comprising a visible laser for presenting the vein image and a near IR for detecting the position of the veins and a violet/ultra violet for energizing the florescent materials. All lasers are arranged to project along a single axis. Without the violet/ultra violet laser turned on the system operates as described in previous embodiments. However, once an acceptable image is viewed, the 407 nm can be energized to paint the same image as that projected by the 630 nm laser, thereby energizing the florescent material to emit the vein image.
It is known in the art that there are chemical dyes that can change color by exposure to light. Such a material can be substituted in the above embodiments in place of a florescent material.
Distance Aware User Interface
Several control mechanisms that can be used to adjust various operating parameters for the unit are previously described. Another embodiment is to use sensors well known in the art to determine distance to the body surface being scanned. For example, an IRDA module typically used in a laptop computer could be used to sense distance by using the amount of reflection from the IR led back to the photo sensor as a proxy for distance.
These can be added to the device or in a preferred embodiment, the average intensity of one or more of the lasers already in the device can be used to approximate the distance based on the amount of light reflected. This average intensity would vary based on distance.
When the scanner is close, say 6″, the scanning angle can be set to maximum and the IR power, signal gain and differentiation levels are set to medium. As the scanner moves away from the body, the scanning angle can be reduced in proportion to the distance. In this way, if the target were for example the arm, the scanned area would not grow as distance increases. This would prevent wasting detection area by preventing the imaged area from growing bigger than the arm.
When unit is moved closer than 6″, the level of differentiation, and gain is increased. This is OK to do at close range but at far distances this would cause more false positives—veins would be indicated in places that they do not exist. However, at close range this will show deeper veins. This provides a very intuitive user experience. Move closer—see deeper. Other inventions that use fixed focal length systems and therefore must be kept at a single distance from the body cannot provide this user interface.
Electronics
Time Division Multiplexing Two or More Lasers
In the system design, the photo detector can be selected or filtered so that it is responsive to the infrared laser but not the visible laser. In the manner both lasers can be on at the same time without having the visible laser couple into the photo detector. In some cases, useful attributes of a photo detector such as size or cost would make it preferable to use a photo detector which is responsive to both the visible laser and the infrared laser. In this embodiment, both of the lasers can be pulsed on and off at high rates without affecting the apparent quality of the image (visible light projection) or the quality of the acquired image (the reflections of the IR laser). By synchronizing the two lasers so that while one is on, the other is off, the image acquisition circuits (photo diode and amplifiers) can be arranged to only see signals from the appropriate laser. In this manner the other lasers do not interfere at all with the signal acquisition apparatus.
Frequency Modulation of Lasers
Through the use of amplitude modulation on the transmitted laser, simple filter circuits can be used in the photo detection subsystem to allow one or more laser signals to be differentiated from ambient light and from other laser signals in the system. In
In the photo detector subsystem, the output of the photo detector can be DC coupled so that no low frequency or DC bias signals pass through to the next stage in the circuit. In this manner, any light, including ambient light that doesn't exhibit the high frequency modulation, is not seen by subsequent stages of the circuit.
Another mechanism to differentiate between lasers is shown in
User Adjustments
The system can be arranged as either a binary system or grayscale system. In a grayscale system, the infrared laser signal received by the photo detector is simply echoed and re-transmitted by the visible laser. In this manner, various levels of intensity can be shown. Accordingly, the image of a vein may vary in intensity as a function of the magnitude of signal received.
In a binary system, the projected image is either on or off. To determine whether the projected image should be on or off, a comparator with a trip point is placed after the photodiode. If the signal crosses the trip point the visible laser is turned on and when it falls below the trip point it is turned off.
The system can set these parameters automatically based on built-in rule sets or a user input device like a dial, or push buttons, or any other means of user input could be placed on the device, and the user manually adjusts the trip point (essentially making the device more or less sensitive.)
Some of the parameters that will often need to be controlled to deal with patient and environmental variability include:
Throughout all the embodiments, when we discuss adjusting the power of a laser, such adjustment could be made by either adjusting the current to the laser, or alternatively, modulating the laser on and off at a rapid rate (pulse width modulation or PWM). Depending upon the duty cycle, the average laser intensity will be changed. With respect to the visible laser, the human eye integrates the signal and, provided the frequency of the PWM is faster than the eye integration time, the laser will appear as if it was always on, but brighter or dimmer as the on cycle time increases respectively.
The system will also need to adjust the power of the infrared laser. This can be done by adjusting the current to the laser, or alternatively, by PWM. Provided that the PWM modulation is faster than the response time of the receiving means (photodiode plus amplifiers), the modulation will have the same effect upon the received signal as if you reduced the current to the laser.
Simplified Scanning
There are various methods that can be employed for creating a scanned laser pattern. In many embodiments, it is desirable for the scan pattern to be the same from frame to frame and for the system to be able to determine the instantaneous position of the lasers. Such an implementation would allow time consuming processing and integration of data across frames to occur.
In general however, the lower level of position precision that is required, the easier it is to produce the pattern, the lower the system complexity becomes and the lower the cost becomes. In an embodiment without image memory, since one does not need to remember the specific signal at a specific position over time, there is no need for a reproducible scan pattern. Therefore, from frame to frame the laser scan lines do not need to fall reproducibly upon the scan lines of the prior frame and there is no need to know the instantaneous position of the laser. The reason one does not need a reproducible scan pattern or instantaneous position information is that the visible light is coaxially aligned to the infrared laser. The visible light is a function of the received image in real time. Accordingly, whatever location is being imaged is instantaneously being projected.
Scan Amplitude Modulation Scanning
One such simplified modulation scanner which is well suited to this invention is amplitude modulated circular mirror. In this case a mirror is arranged to run at resonance in a circular or oval pattern. The magnitude of the circle is then amplitude modulated at a rate high enough to avoid appearance of flicker. Accordingly, a scan pattern is formed which starts with small concentric circles and grows sequentially larger until reaching a limit and then collapses sequentially to the smallest circle.
Such a pattern has many advantages over a traditional raster scan pattern. Rather than a rectangular shape which would be typical of a raster scan, this method can be used to generate circular or oval pattern shapes. The mirror in this design is always moving and the laser is always actively painting—there are no required off times as the mirrors move into position for the next scan line. The pattern can be adjusted so that it spends more time scanning near the center of the pattern so a brighter, denser, better defined image appears in the center of the scan area. Additionally, the mirror operates at resonance which provides the lowest power dissipation, which is important in handheld battery operated devices.
System Gain Adjustment
It is necessary to adjust the gain of the system during operation in order to ensure that the amount of reflected light is within the proper operating range of the photo detectors.
One method of adjusting the gain is to maintain a constant output from the detection laser and adjust the gain of the photo diode amplification circuitry so as to get an appropriate signal that is neither too low for detection nor too high so that the photo detector or circuit saturates. This approach can become fairly complex due to the speed requirements of the gain adjustment.
Another method is to fix the gain of the photo detection circuitry but adjust the power output of the IR laser so that an appropriate signal is output from the photo detection circuitry (once again not to low or saturated). It is much easier to design circuits that adjust the IR laser due to the extremely high modulation bandwidth of the lasers. As previously discussed, the laser can be adjusted either by analog or digital means.
A laser must be calibrated in that its intensity is sensitive to ambient conditions such as temperature. Some laser diodes have internal mirrors to perform the calibration. An alternative technique is to use the housing of the scanner to block a portion of the light, perhaps an outer scan line and reflect that light back to the photo detector. That reflected light can be used for calibration.
Stored Image, Allows Multi-Scan Averaging
In some embodiments of the invention, the system will have a microprocessor and memory buffer so that the reflected light from the scanning laser will be kept as a representation in memory. By averaging the image over multiple scans, the system can form an image with greater resolution than it could have by only using a single pass of the laser. In order for this to be done, the system needs to ensure that the image elements being captured from scan to scan represent the same physical location on the patient.
The benefit to the system design is that the gain of the photo detector and subsequent analog circuits can be reduced.
There are several ways to do this. One is to provide a mechanical stabilization, similar to what was described for the LED implementation (
For example, you can identify a specific point or a group of points within the image in a single frame, for example the cross point between two veins. The system can then adjust the position of the image from frame to frame so that the image elements averaged together represent the same position on the body.
Windowed Vein Tracking
Since veins are linear structures, a novel technique can be used to accurately identify veins and to separately highlight one or more veins and ignore others without using image memory or signal processing techniques. Referring to
A series of scan lines are shown 1806, 1810 and 1813. Each scan line occurs sequentially in time with 1806 first, 1810 second and 1813 last. This technique relies on the fact that once a vein's position is found on a scan line, an assumption can be made where the vein is likely to be on a subsequent scan line. The vein signal can be expected to occur within a small distance to the right or left of the position seen on the previous scan line. Therefore the system can apply a windowing technique wherein vein signals that occur outside the window are given a lower priority or are ignored completely
Referring to
The signal 1800 is caused by vein 1814 and signal 1801 is caused by vein 1802. This simplified example is for a system that is designed to only show the single largest vein in the field of view. By using a system capable of keeping track of multiple windows, multiple veins could be tracked. Alternatively, the sense can be inverted and the vein within the window could be ignored.
Vein 1802 is selected as the vein of interest by some criteria, set in the system or by the user, such as size of vein or the central location of the vein in the field of view. Based on the vein's position as detected by the pulse 1801 on the reflection signal 1804, a window signal 1807 is created that ignores vein reflections that occur outside of the detection window 1805 on the next scan line 1810/1808. Referring to signal 1808, vein 1814 is ignored since it falls outside the window and vein 1802 is detected since it falls within the window. However, since the vein is traveling at an angle with relation to the scan pattern, the vein is now offset within the window. In order to track the vein on subsequent scan lines, the system now re-centers the window 1811 so that when it is applied to the next scan line 1813/1312, the vein falls within the window. This process repeats for the entire field of scanning.
A user interface can be implemented allowing the user to select a number of veins to detect simultaneously and to switch focus from vein to vein. Also, the user could control the width of the window to optimize the detection of the vein. Additionally, the user can turn this feature on and off so that they can either see all veins or just a specific vein or veins. Since there is inherent directionality to the procedure, the user can rotate the scanner to see only those veins at a particular orientation.
Diagrammatic Walkthrough
Walk Through of the Engine
In
Referring to
In
An optional connector 1017 is mounted to the side of the engine to allow it to be used in an embodiment of the device that allows the scan head to be removed from the portable handheld device and mounted on an alternative base such as a tabletop stand.
The detector deck 1020 is a printed circuit assembly that holds the photo detectors 1021/1022 as well as other electronic components necessary for the operation of the engine. For example, the pre-amplifier circuitry for the photo detectors will typically be mounted in close proximity to the detectors 1021/1022 so that noise in the system is minimized.
The photo detectors 1021/1022 are shown with integrated dome-shaped lenses to increase sensitivity in the direction of the reflected laser. Various schemes both with and without lenses can be implemented in engine embodiments. In addition, filters can be placed in front of the photo detectors so that the wavelength of light they respond to can be specified.
In
The holder assembly 1041 is comprised of a fixed platform 1031 that is fastened to the optical deck in a fixed manner. The mirror 1032 is attached to a wedge 1034 that is angled in the desired manner to reflect the beam in the appropriate direction. The wedge is fixed to a floating deck 1033 which is attached to the fixed platform 1031 through a number of screw 1035 and spring 1036 assemblies. The spring 1036 is placed around the screw 1035 and is compressed by the two platforms 1033/1031 so that the springs provide a constant force against the two platforms ensuring that they are held as far apart as the screws will allow. The screws (e.g., 1039) pass through an unthreaded hole in the floating deck and into a threaded hold in the fixed platform 1031. By tightening or loosening the screws, the decks are moved closer or further apart. Through the use of multiple screws, several degrees of freedom of adjustment are obtained, thereby allowing the beam to be properly aligned along the desired path.
In this design, three of these bounce mirror assemblies are used. This design uses mechanical screws to fine tune the position of the mirrors and in practice would be locked in place once positioned with an adhesive material such as locktite. High volume configurations of the product could use robotic assembly and the mirrors would be positioned and then welded, epoxied or glued into place eliminating the cost and complexity of the screw/spring assembly.
Referring to
The second laser 1088 emits its beam along path 1089 which then is reflected off of mirror 1090 along path 1091. The beam 1091 strikes the dielectric mirror 1084 which as been coated to reflect the wavelength of light emitted by laser 1088. Therefore, the beam is reflected along path 1085. At this point the two lasers are now coaxial. The beams 1085 are reflected off of mirror 1086 and are reflected along path 1087 so that it strikes the moving mirror that is part of assembly 1087. This fast-moving mirror is oriented to provide the x-axis scanning. The light is reflected onto the mirror in assembly 1092 which is a slower moving mirror that provides the scanning in the y-axis. In this diagram, the resulting scanned beam pattern exits out towards the back of the drawing.
In
In
The engine uses extensions 1153, 1155, 1157 on the circuit board to provide mounting features so that the entire engine assembly can be firmly mounted into a housing. The extensions could also have been on the detector deck or optical deck or on one or more of the mechanical components of the engine. Holes such as 1154 are provided so that either a screw or a boss can be used to align and hold the engine in the housing. The extensions can be held in place with screws or by captivating them in a feature of the housing. The extensions can be made in a range of shapes so that they do not interfere with features in the housing. For example, the notch 1156 is designed so as not to interfere with a boss in the housing.
In the current design, the high speed mirror 1111 is implemented with a Texas Instruments TALP3400 and the low speed mirror 1111 is implemented with a Texas Instruments TALP4500. The red laser diode 1111 is a Sanyo DL-LS1148 and the infrared laser diode is a Sanyo GH0781JA2C. The laser lens 1111 is a Thorlabs, Inc. 350150-B and the photo diodes 1111/1111 are Hamamatsu S6968-01.
Referring to
The handle is composed of a top housing 1608 and a bottom housing 1609 that are snapped and screwed together to form a single unit. The battery door cover 1607 completes the handle package. This door cover 1607 is designed to be removed by the user with the latch 1607. There is also provision for a screw hole in the battery door and a matching hole in the inner housing should the deploying organization wish to prevent the end user from accessing the battery.
In the top portion of the handle, two LED openings are provided 1603, 1604. These are illuminated by LEDs on a board inside the handle and provide important status information to the user. The openings at 1603 and 1604 can be filled with a light pipe or pipes to bring the light up to the top surface and can be covered either with a molded light pipe or with a label that fits into the opening at 1612. An inset area is provided at 1602 that allows for a label to be positioned providing a company logo, a product model identifier or other user viewable indicia. Since the top and bottom are separable, it may be desirable to repeat identical or other labeling information on the handle part as well. Additional labels can be placed on the inside of the battery door, battery compartment or on or near the scanner opening on the other side of the scan head 1605.
As seen in the engine design discussions, thermal management of the laser is critical to minimizing power consumption and life of the laser. Therefore, openings 1601 are provided on both sides of the scan head to allow convection cooling of the scan engine. In certain embodiments, it might be desirable to have a fully sealed unit. In this case, the openings will be eliminated and other techniques well known in the art will be used to cool the lasers. For example, the heat sinks on the engine can be continued on the outside of the housing.
Views of the handle 1620 separated from the head 1621 are shown in
Further screw holes are seen at 1634, 1633, 1632 that hold the top and bottom plastic pieces of the scan head together. Internal mating bosses are provided in the lower half of the scan head housing.
Mating latches 1626/1625 and holes 1623/1624 hold the scan head and handle together. The latches 1625/1626 are internally sprung so that when the buttons 1610 in
Two mating electrical connectors 1635 and 1622 are provided so that the battery, switch and other electronics in the handle 1620 connect to the electronics in the head 1621. A shoulder 1637 and a matching inset 1636 are provided to ensure proper alignment of the connectors as the head and handle are separated and re-connected.
In
The lenses for the photo detectors are shown at 1650. They are aligned in the same plane as the emitted laser path 1651 so that they can pick up the reflected light from the target area. In
The battery door spring mechanism is shown at 1675. The loop in the mechanism provides force in the forward direction (towards the head) thereby engaging the latch. A second view of the door and the latch mechanism is shown in drawing 27b with the tongue 1697 that engages the handle top housing 1698 and the clip on the latch 1700 that engages the handle top housing at the other end of the battery door.
One of several screw bosses 1695 is used to connect the top and bottom halves of the housings. Furthermore, an alignment standoff is shown at 1699.
Referring to
Further detail of the spring latch mechanism described earlier can be seen at 1688 and the contact point/stud for the electrical switch from the trigger is shown at 1690.
Ribbing that performs the multiple function of strengthening the housing and locating the battery is shown at 1689 and 1692.
Referring to
In this embodiment, a raster pattern is implemented. A mirror drive subsystem 1738/1733 is controlled 1738/1735 by the electronics to drive the X mirror 1740 at a higher speed than the Y mirror 1734 to create the raster pattern. The electronics will control mirror on and off, and the mirror will report back when it begins its scan. The mirror drive systems 1739/1733 provides the drive waveform to the mirrors 1740/1734 that cause them to oscillate at the proper speed and in synchrony. This consists of sine wave to the mirrors. The drive circuitry also contains detection circuitry that uses a feedback path 1737/1736 from the mirrors to detect that the mirrors are in motion. In this manner, if a mirror has failed to move, the engine can shut down the lasers to ensure user safety.
The lasers are also controlled by the main electronics 1747 through a set of drive circuits 1746/1742. These circuits provide the ability to set the intensity of the lasers 1744/1741 from off through maximum intensity. In this embodiment, the lasers contain internal mirrors for calibration and which are read back from the lasers 1745/1743 and through the drive circuits 1748/1750 into the main electronics. The reverse path is used to control the drivers and lasers.
In this embodiment, a proximity sensor 1725 to detect that there is a surface within working range. The main electronics reads 1729 the sensor to ensure that the lasers are not turned on if there is an object either too close or no object within proximity of the front face of the scanner.
The photo detection subsystem consists of a pair of photo diodes 1727 and an amplifier 1726 that is fed through 1730 the main electronics for vein detection. A control for setting gain is provided through 1730.
Since this is a portable device, power is provided from a battery 1731, which provides 1752 power to a control circuit 1732 which provides voltage regulation and delivers 1751 the appropriate voltages to the electronics
This application is a continuation of U.S. application Ser. No. 14/855,502, filed on Sep. 16, 2015, which, is a continuation of U.S. application Ser. No. 14/168,158, filed on Jan. 30, 2014, which is a continuation of U.S. application Ser. No. 13/649,234, filed Oct. 11, 2012, now issued as U.S. Pat. No. 8,706,200, which is a continuation of U.S. application Ser. No. 11/807,255, filed on May 25, 2007, now issued as U.S. Pat. No. 8,380,291, which is a continuation-in-part of U.S. application Ser. No. 11/478,322, filed on Jun. 29, 2006, now issued as U.S. Pat. No. 8,478,386, and also claims priority on provisional patent application entitled Three Dimensional Imaging of Veins, U.S. Application Ser. No. 60/817,623, filed on Jun. 29, 2006, all disclosures of which are hereby incorporated by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 3136310 | Meltzer | Jun 1964 | A |
| 3349762 | Kapany | Oct 1967 | A |
| 3511227 | Johnson | May 1970 | A |
| 3527932 | Thomas | Sep 1970 | A |
| 3818129 | Yamamoto | Jun 1974 | A |
| 3984629 | Gorog | Oct 1976 | A |
| 4030209 | Dreiding | Jun 1977 | A |
| 4057784 | Tafoya | Nov 1977 | A |
| 4109647 | Stern et al. | Aug 1978 | A |
| 4162405 | Chance et al. | Jul 1979 | A |
| 4182322 | Miller | Jan 1980 | A |
| 4185808 | Donohoe et al. | Jan 1980 | A |
| 4213678 | Pomerantzeff et al. | Jul 1980 | A |
| 4265227 | Ruge | May 1981 | A |
| 4312357 | Andersson et al. | Jan 1982 | A |
| 4315318 | Kato et al. | Feb 1982 | A |
| 4321930 | Jobsis et al. | Mar 1982 | A |
| 4393366 | Hill | Jul 1983 | A |
| 4495949 | Stoller | Jan 1985 | A |
| 4502075 | DeForest et al. | Feb 1985 | A |
| 4510938 | Jobsis et al. | Apr 1985 | A |
| 4536790 | Kruger et al. | Aug 1985 | A |
| 4565968 | Macovski | Jan 1986 | A |
| 4567896 | Barnea et al. | Feb 1986 | A |
| 4576176 | Epstein | Mar 1986 | A |
| 4590948 | Nilsson | Mar 1986 | A |
| 4586190 | Tsuji | Apr 1986 | A |
| 4596254 | Adrian et al. | Jun 1986 | A |
| 4619249 | Landry | Oct 1986 | A |
| 4669467 | Willett et al. | Jun 1987 | A |
| 4697147 | Moran et al. | Sep 1987 | A |
| 4699149 | Rice | Oct 1987 | A |
| 4703758 | Omura | Nov 1987 | A |
| 4766299 | Tierney et al. | Aug 1988 | A |
| 4771308 | Tejima et al. | Sep 1988 | A |
| 4780919 | Harrison | Nov 1988 | A |
| 4799103 | Muckerheide | Jan 1989 | A |
| 4817622 | Pennypacker et al. | Apr 1989 | A |
| 4846183 | Martin | Jul 1989 | A |
| 4861973 | Hellekson et al. | Aug 1989 | A |
| 4862894 | Fujii | Sep 1989 | A |
| 4899756 | Sonek | Feb 1990 | A |
| 4901019 | Wedeen | Feb 1990 | A |
| 4926867 | Kanda et al. | May 1990 | A |
| RE33234 | Landry | Jun 1990 | E |
| 4938205 | Nudelman | Jul 1990 | A |
| 5074642 | Hicks | Dec 1991 | A |
| 5088493 | Giannini et al. | Feb 1992 | A |
| 5103497 | Hicks | Apr 1992 | A |
| 5146923 | Dhawan | Sep 1992 | A |
| 5174298 | Dolfi et al. | Dec 1992 | A |
| 5184188 | Bull et al. | Feb 1993 | A |
| 5214458 | Kanai | May 1993 | A |
| 5222495 | Clarke et al. | Jun 1993 | A |
| 5261581 | Harden, Sr. | Nov 1993 | A |
| 5293873 | Fang | Mar 1994 | A |
| 5339817 | Nilsson | Aug 1994 | A |
| 5371347 | Plesko | Dec 1994 | A |
| 5406070 | Edgar et al. | Apr 1995 | A |
| 5418546 | Nakagakiuchi et al. | May 1995 | A |
| 5423091 | Lange | Jun 1995 | A |
| 5436655 | Hiyama et al. | Jul 1995 | A |
| 5445157 | Adachi et al. | Aug 1995 | A |
| D362910 | Creaghan | Oct 1995 | S |
| 5485530 | Lakowicz et al. | Jan 1996 | A |
| 5487740 | Sulek et al. | Jan 1996 | A |
| 5494032 | Robinson et al. | Feb 1996 | A |
| 5497769 | Gratton et al. | Mar 1996 | A |
| 5501680 | Kurtz | Mar 1996 | A |
| 5504316 | Bridgelall et al. | Apr 1996 | A |
| 5519208 | Esparza et al. | May 1996 | A |
| 5541820 | McLaughlin | Jul 1996 | A |
| 5542421 | Erdman | Aug 1996 | A |
| 5598842 | Ishihara et al. | Feb 1997 | A |
| 5603328 | Zucker et al. | Feb 1997 | A |
| 5608210 | Esparza et al. | Mar 1997 | A |
| 5610387 | Bard et al. | Mar 1997 | A |
| 5625458 | Alfano et al. | Apr 1997 | A |
| 5631976 | Bolle et al. | May 1997 | A |
| 5655530 | Messerschmidt | Aug 1997 | A |
| 5678555 | O'Connell | Oct 1997 | A |
| 5716796 | Bull et al. | Feb 1998 | A |
| 5719399 | Alfano et al. | Feb 1998 | A |
| 5740801 | Branson | Apr 1998 | A |
| 5747789 | Godik | May 1998 | A |
| 5756981 | Roustaei et al. | May 1998 | A |
| 5758650 | Miller et al. | Jun 1998 | A |
| 5772593 | Hakamata | Jun 1998 | A |
| 5787185 | Clayden | Jul 1998 | A |
| 5814040 | Nelson et al. | Sep 1998 | A |
| 5836877 | Zavislan | Nov 1998 | A |
| 5847394 | Alfano et al. | Dec 1998 | A |
| 5860967 | Zavislan et al. | Jan 1999 | A |
| 5865828 | Jeng | Feb 1999 | A |
| 5929443 | Alfano et al. | Jul 1999 | A |
| 5946220 | Lemelson | Aug 1999 | A |
| 5947906 | Dawson, Jr. et al. | Sep 1999 | A |
| 5966204 | Abe | Oct 1999 | A |
| 5966230 | Swartz | Oct 1999 | A |
| 5969754 | Zeman | Oct 1999 | A |
| 5982553 | Bloom | Nov 1999 | A |
| 5988817 | Mizushima et al. | Nov 1999 | A |
| 5995856 | Mannheimer et al. | Nov 1999 | A |
| 5995866 | Lemelson | Nov 1999 | A |
| 6006126 | Cosman | Dec 1999 | A |
| 6032070 | Flock et al. | Feb 2000 | A |
| 6056692 | Schwartz | May 2000 | A |
| 6061583 | Ishihara et al. | May 2000 | A |
| 6083486 | Weissleder et al. | Jul 2000 | A |
| 6101036 | Bloom | Aug 2000 | A |
| 6113536 | Aboul-Hosn et al. | Sep 2000 | A |
| 6122042 | Wunderman et al. | Sep 2000 | A |
| 6132379 | Patacsil | Oct 2000 | A |
| 6135599 | Fang | Oct 2000 | A |
| 6141985 | Cluzeau et al. | Nov 2000 | A |
| 6142650 | Brown et al. | Nov 2000 | A |
| 6149061 | Massieu et al. | Nov 2000 | A |
| 6149644 | Xe | Nov 2000 | A |
| 6171301 | Nelson et al. | Jan 2001 | B1 |
| 6178340 | Svetliza | Jan 2001 | B1 |
| 6179260 | Ohanian | Jan 2001 | B1 |
| 6230046 | Crane et al. | May 2001 | B1 |
| 6240309 | Yamashita et al. | May 2001 | B1 |
| 6251073 | Imran et al. | Jun 2001 | B1 |
| 6263227 | Boggett et al. | Jul 2001 | B1 |
| 6272376 | Marcu et al. | Aug 2001 | B1 |
| 6301375 | Choi | Oct 2001 | B1 |
| 6305804 | Rice et al. | Oct 2001 | B1 |
| 6314311 | Williams et al. | Nov 2001 | B1 |
| 6334850 | Amano et al. | Jan 2002 | B1 |
| 6353753 | Flock et al. | Mar 2002 | B1 |
| 6424858 | Williams | Jul 2002 | B1 |
| 6436655 | Bull et al. | Aug 2002 | B1 |
| 6438396 | Cook et al. | Aug 2002 | B1 |
| 6463309 | Ilia | Oct 2002 | B1 |
| 6464646 | Shalom et al. | Oct 2002 | B1 |
| 6523955 | Eberl et al. | Feb 2003 | B1 |
| 6542246 | Toida | Apr 2003 | B1 |
| 6556854 | Sato et al. | Apr 2003 | B1 |
| 6556858 | Zeman | Apr 2003 | B1 |
| 6599247 | Stetten | Jul 2003 | B1 |
| 6631286 | Pfeiffer et al. | Oct 2003 | B2 |
| 6648227 | Swartz et al. | Nov 2003 | B2 |
| 6650916 | Cook et al. | Nov 2003 | B2 |
| 6689075 | West | Feb 2004 | B2 |
| 6690964 | Bieger et al. | Feb 2004 | B2 |
| 6702749 | Paladini et al. | Mar 2004 | B2 |
| 6719257 | Greene et al. | Apr 2004 | B1 |
| 6755789 | Stringer et al. | Jun 2004 | B2 |
| 6777199 | Bull et al. | Aug 2004 | B2 |
| 6782161 | Barolet et al. | Aug 2004 | B2 |
| 6845190 | Smithwick et al. | Jan 2005 | B1 |
| 6882875 | Crowley | Apr 2005 | B1 |
| 6889075 | Marchitto et al. | May 2005 | B2 |
| 6913202 | Tsikos et al. | Jul 2005 | B2 |
| 6923762 | Creaghan, Jr. | Aug 2005 | B1 |
| 6971579 | Barkan | Dec 2005 | B2 |
| 6980852 | Jersey-Willuhn et al. | Dec 2005 | B2 |
| 7092087 | Kumar et al. | Aug 2006 | B2 |
| 7113817 | Winchester, Jr. et al. | Sep 2006 | B1 |
| 7158660 | Gee, Jr. et al. | Jan 2007 | B2 |
| 7158859 | Wang et al. | Jan 2007 | B2 |
| 7204424 | Yavid et al. | Apr 2007 | B2 |
| 7225005 | Kaufman et al. | May 2007 | B2 |
| 7227611 | Hull et al. | Jun 2007 | B2 |
| 7239909 | Zeman | Jul 2007 | B2 |
| 7247832 | Webb | Jul 2007 | B2 |
| 7280860 | Ikeda et al. | Oct 2007 | B2 |
| 7283181 | Allen et al. | Oct 2007 | B2 |
| 7302174 | Tan et al. | Nov 2007 | B2 |
| 7333213 | Kempe | Feb 2008 | B2 |
| D566283 | Brafford et al. | Apr 2008 | S |
| 7359531 | Endoh et al. | Apr 2008 | B2 |
| 7376456 | Marshik-Geurts et al. | May 2008 | B2 |
| 7428997 | Wiklof et al. | Sep 2008 | B2 |
| 7431695 | Creaghan | Oct 2008 | B1 |
| 7448995 | Wiklof et al. | Nov 2008 | B2 |
| 7532746 | Marcotte et al. | May 2009 | B2 |
| 7545837 | Oka | Jun 2009 | B2 |
| 7559895 | Stetten et al. | Jul 2009 | B2 |
| 7579592 | Kaushal | Aug 2009 | B2 |
| 7608057 | Woehr et al. | Oct 2009 | B2 |
| 7699776 | Walker et al. | Apr 2010 | B2 |
| 7708695 | Akkermans et al. | May 2010 | B2 |
| 7792334 | Cohen et al. | Sep 2010 | B2 |
| 7846103 | Cannon, Jr. et al. | Dec 2010 | B2 |
| 7848103 | Zhan | Dec 2010 | B2 |
| 7904138 | Goldman et al. | Mar 2011 | B2 |
| 7904139 | Chance | Mar 2011 | B2 |
| 7925332 | Crane et al. | Apr 2011 | B2 |
| 7966051 | Xie et al. | Jun 2011 | B2 |
| 8032205 | Mullani | Oct 2011 | B2 |
| 8078263 | Zeman et al. | Dec 2011 | B2 |
| 8187189 | Jung et al. | May 2012 | B2 |
| 8199189 | Kagenow et al. | Jun 2012 | B2 |
| 8320998 | Sato | Nov 2012 | B2 |
| 8336839 | Boccoleri et al. | Dec 2012 | B2 |
| 8364246 | Thierman | Jan 2013 | B2 |
| 8467855 | Yasui | Jun 2013 | B2 |
| 8480662 | Stolen et al. | Jul 2013 | B2 |
| 8494616 | Zeman | Jul 2013 | B2 |
| 8498694 | McGuire, Jr. et al. | Jul 2013 | B2 |
| 8509495 | Xu et al. | Aug 2013 | B2 |
| 8609495 | Xu et al. | Aug 2013 | B2 |
| 8537203 | Seibel et al. | Sep 2013 | B2 |
| 8548572 | Crane | Oct 2013 | B2 |
| 8630465 | Wieringa et al. | Jan 2014 | B2 |
| 8649848 | Crane et al. | Feb 2014 | B2 |
| 20010006426 | Son et al. | Jul 2001 | A1 |
| 20010056237 | Cane et al. | Dec 2001 | A1 |
| 20020016533 | Marchitto | Feb 2002 | A1 |
| 20020111546 | Cook | Aug 2002 | A1 |
| 20020118338 | Kohayakawa | Aug 2002 | A1 |
| 20020188203 | Smith et al. | Dec 2002 | A1 |
| 20030018271 | Kimble | Jan 2003 | A1 |
| 20030037375 | Riley et al. | Feb 2003 | A1 |
| 20030047683 | Kaushal | Mar 2003 | A1 |
| 20030052105 | Nagano et al. | Mar 2003 | A1 |
| 20030120154 | Sauer et al. | Jun 2003 | A1 |
| 20030125629 | Ustuner | Jul 2003 | A1 |
| 20030156260 | Putilin et al. | Aug 2003 | A1 |
| 20040015062 | Ntziachristos et al. | Jan 2004 | A1 |
| 20040015158 | Chen et al. | Jan 2004 | A1 |
| 20040022421 | Endoh et al. | Feb 2004 | A1 |
| 20040046031 | Knowles et al. | Mar 2004 | A1 |
| 20040171923 | Kalafut et al. | Sep 2004 | A1 |
| 20040222301 | Willins et al. | Nov 2004 | A1 |
| 20040237051 | Clauson | Nov 2004 | A1 |
| 20050017924 | Utt et al. | Jan 2005 | A1 |
| 20050023356 | Wiklof | Feb 2005 | A1 |
| 20050033145 | Graham et al. | Feb 2005 | A1 |
| 20050043596 | Chance | Feb 2005 | A1 |
| 20050047134 | Mueller et al. | Mar 2005 | A1 |
| 20050085732 | Sevick-Muraca et al. | Apr 2005 | A1 |
| 20050085802 | Gruzdev et al. | Apr 2005 | A1 |
| 20050113650 | Pacione et al. | May 2005 | A1 |
| 20050131291 | Floyd et al. | Jun 2005 | A1 |
| 20050135102 | Gardiner et al. | Jun 2005 | A1 |
| 20050141069 | Wood et al. | Jun 2005 | A1 |
| 20050143662 | Marchitto et al. | Jun 2005 | A1 |
| 20050146765 | Turner et al. | Jul 2005 | A1 |
| 20050154303 | Walker et al. | Jul 2005 | A1 |
| 20050157939 | Arsenault et al. | Jul 2005 | A1 |
| 20050161051 | Pankratov et al. | Jul 2005 | A1 |
| 20050168980 | Dryden et al. | Aug 2005 | A1 |
| 20050174777 | Cooper et al. | Aug 2005 | A1 |
| 20050175048 | Stern et al. | Aug 2005 | A1 |
| 20050187477 | Serov et al. | Aug 2005 | A1 |
| 20050215875 | Khou | Sep 2005 | A1 |
| 20050265586 | Rowe et al. | Dec 2005 | A1 |
| 20050281445 | Marcotte et al. | Dec 2005 | A1 |
| 20060007134 | Ting | Jan 2006 | A1 |
| 20060020212 | Xu et al. | Jan 2006 | A1 |
| 20060025879 | Viswanathan et al. | Feb 2006 | A1 |
| 20060052690 | Sirohey et al. | Mar 2006 | A1 |
| 20060081252 | Wood | Apr 2006 | A1 |
| 20060100523 | Ogle et al. | May 2006 | A1 |
| 20060103811 | May et al. | May 2006 | A1 |
| 20060122515 | Zeman et al. | Jun 2006 | A1 |
| 20060129037 | Kaufman et al. | Jun 2006 | A1 |
| 20060129038 | Zelenchuk et al. | Jun 2006 | A1 |
| 20060151449 | Warner, Jr. et al. | Jul 2006 | A1 |
| 20060173351 | Marcotte et al. | Aug 2006 | A1 |
| 20060184040 | Keller et al. | Aug 2006 | A1 |
| 20060206027 | Malone | Sep 2006 | A1 |
| 20060232660 | Nakajima et al. | Oct 2006 | A1 |
| 20060253010 | Brady et al. | Nov 2006 | A1 |
| 20060271028 | Altshuler et al. | Nov 2006 | A1 |
| 20060276712 | Stothers et al. | Dec 2006 | A1 |
| 20070015980 | Numada et al. | Jan 2007 | A1 |
| 20070016079 | Freeman et al. | Jan 2007 | A1 |
| 20070070302 | Govorkov et al. | Mar 2007 | A1 |
| 20070115435 | Rosendaal | May 2007 | A1 |
| 20070129634 | Hickey et al. | Jun 2007 | A1 |
| 20070176851 | Willey et al. | Aug 2007 | A1 |
| 20070238957 | Yared | Oct 2007 | A1 |
| 20080045841 | Wood et al. | Feb 2008 | A1 |
| 20080147147 | Griffiths et al. | Jun 2008 | A1 |
| 20080194930 | Harris et al. | Aug 2008 | A1 |
| 20080214940 | Benaron | Sep 2008 | A1 |
| 20090018414 | Toofan | Jan 2009 | A1 |
| 20090082629 | Dotan | Mar 2009 | A1 |
| 20090171205 | Kharin et al. | Jul 2009 | A1 |
| 20100051808 | Zeman et al. | Mar 2010 | A1 |
| 20100061598 | Seo | Mar 2010 | A1 |
| 20100087787 | Woehr et al. | Apr 2010 | A1 |
| 20100177184 | Berryhill et al. | Jul 2010 | A1 |
| 20100312120 | Meier | Dec 2010 | A1 |
| 20110275932 | Leblond et al. | Nov 2011 | A1 |
| 20130147916 | Bennett et al. | Jun 2013 | A1 |
| 20140039309 | Harris et al. | Feb 2014 | A1 |
| 20140046291 | Harris et al. | Feb 2014 | A1 |
| 20140194747 | Kruglick | Jul 2014 | A1 |
| Number | Date | Country |
|---|---|---|
| 2289149 | May 1976 | FR |
| 1298707 | Feb 1972 | GB |
| 1507329 | Apr 1978 | GB |
| S60-108043 | Jun 1985 | JP |
| 04-042944 | Feb 1992 | JP |
| 07-255847 | Oct 1995 | JP |
| 08-023501 | Jan 1996 | JP |
| 08-164123 | Jun 1996 | JP |
| 2000-316866 | Nov 2000 | JP |
| 2002-328428 | Nov 2002 | JP |
| 2002-345953 | Dec 2002 | JP |
| 2004-237051 | Aug 2004 | JP |
| 2004-329786 | Nov 2004 | JP |
| 2006-102360 | Apr 2006 | JP |
| 2003-0020152 | Mar 2003 | KR |
| 2003-0020152 | Nov 2004 | KR |
| WO 1994 22370 | Oct 1994 | WO |
| WO 1996 39925 | Dec 1996 | WO |
| WO 1998 26583 | Jun 1998 | WO |
| WO 1999 48420 | Sep 1999 | WO |
| WO 2001-82786 | Nov 2001 | WO |
| WO 2003-009750 | Feb 2003 | WO |
| WO 2005-053773 | Jun 2005 | WO |
| WO 2007-078447 | Jul 2007 | WO |
| Entry |
|---|
| Wiklof, Chris, “Display Technology Spawns Laser Camera,” LaserFocusWorld, Dec. 1, 2004, vol. 40, Issue 12, PennWell Corp., USA. |
| Nikbin, Darius, “IPMS Targets Colour Laser Projectors,” Optics & Laser Europe, Mar. 1006, Isue 137, p. 11. |
| http://sciencegeekgirl.wordpress.com/category/science-myths/page/2/ Myth 7: Blood is Blue. |
| http://www.exploratorium.edu/sports/hnds_up/hands6.html “Hands Up! to Do & Notice: Getting the Feel of Your Hand”. |
| http://www.wikihow.com/See-Blook-Veins-in-Your-Hand-With-a-Flashlight “How to See Blood Veins in Your Hand With a Flashlight”. |
| Number | Date | Country | |
|---|---|---|---|
| 20190159679 A1 | May 2019 | US |
| Number | Date | Country | |
|---|---|---|---|
| 60817623 | Jun 2006 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14855502 | Sep 2015 | US |
| Child | 16238646 | US | |
| Parent | 14168158 | Jan 2014 | US |
| Child | 14855502 | US | |
| Parent | 13649234 | Oct 2012 | US |
| Child | 14168158 | US | |
| Parent | 11807255 | May 2007 | US |
| Child | 13649234 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11478322 | Jun 2006 | US |
| Child | 11807255 | US |
