1. The Field of the Invention
The present invention relates generally to an apparatus for visualization of microscopic samples and fields, in pathologic and scientific procedures, general or diagnostic medical or industrial procedures using microscopes. More particularly, embodiments of the invention relate to use of portable, pluggable and removable microscope systems, which are completely disposable, as a means of image capture.
2. The Relevant Technology
Microscopy is used in pathological procedures in the laboratory, as well as in surgical rooms for real time diagnostic procedure concurrent to the surgical procedures. Currently, most pathologic procedures are done in the laboratory where biological specimens are sent to the lab for examination and diagnostic results. Varieties of clinical methods are used to prepare samples and variety of microscopic imaging methods are used to gain information on the specimens.
These microscopes are generally not portable and only include specimen holders that are used to ready the specimen for observation, process and storage, that are generally disposable. The microscope itself and all the other tools used are to be cleaned and maintained. Microscope illuminators and other special components need to be adjusted, changed and maintained for use in different microscopic procedures. Computerized microscopes which have large control units also requiring maintenance are used to do automated microscopic imaging, data collection, and automatic diagnostic procedures. Thus, the variety of equipment used together to perform a single pathologic task, are generally not portable and rather expensive, reducing the availability of these equipment, to perform simple microscopic procedures in the field in a cost effective and timely manner.
Biological samples to be sent for microscopic evaluation also need to be preserved for the time it takes to send the samples to the lab and obtain results. Also care must be taken for the samples to not be cross-contaminated with other biological and chemical elements during transport. Due to delicate and complicated nature of current microscopic illumination and imaging technology, current high performance microscopes are often limited in cleaning and sterilized capability, reducing the chance of cross contamination.
These and other limitations are overcome by embodiments of the invention which relate to removable, pluggable, and completely disposable illumination and vision systems that can be housed within the body of a single use removable body, and subsequently attached to various control, computing, display, and communication device, including various handheld UMPC (Ultra Mobile Personal Computer), MID (Mobile Internet Device), PDA (Personal Digital Assistant), Smart cellular Phone, Slate or Tablet PC, as single use disposable microscopy unit. Disposable illumination and vision systems according to some embodiments of the invention include one or more solid state light sources, illumination optics, imaging optics, and image capture devices, collectively referred to as Opto-Electronic (OE) illumination and vision (imaging) modules. Removable and pluggable OE illumination and vision modules may additionally include accompanying electronics for process and transfer of the image. Moreover the complete OE vision module and electronics could be housed in a disposable body, where the complete device including the connecting cable can be disposed of after use. Embodiments of the invention also relate to the layouts and functionality of such removable and pluggable vision systems within the body of a disposable microscope or other disposable medical devices, or within a disposable container in which the removable and pluggable OE illumination and vision modules are housed, and plugged onto a separate non-disposable medical device or controller. Embodiments of the invention additionally relate to general layouts of such removable and pluggable vision systems incorporating mechanisms enabling stereoscopic, hyper or varying Field of View (FOV) visual systems, spectral imaging microscopy, UV, IR, polarizing and photoluminescence microscopes.
Embodiments of the invention alternately or additionally include mobile and wearable displays that take advantage of the above embodiments. Some embodiments of mobile and wearable displays can enable hands free, portable microscopic procedures to be performed on-the-go, in cars, ambulances, air transport, or other mobile locations, with minimal setup needs and/or in remote locations, with full connectivity.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
To further clarify the above and features of the present invention, a more particular description of the invention will be rendered by reference to specific embodiments thereof which are illustrated in the appended drawings. It is appreciated that these drawings depict only typical embodiments of the invention and are therefore not to be considered limiting of its scope. The invention will be described and explained with additional specificity and detail through the use of the accompanying drawings in which:
a illustrates a miniature OE illumination and imaging module, together constituting a functional microscope, remotely plugged into a portable display and control unit;
b illustrates a multi functional, portable display and control unit, operating the disposable microscope of
a illustrates the miniature microscope of
b illustrates the miniature microscope of
a and 7b illustrate the disposable body of
a-11c illustrate an embodiment of an adjustable, quick mount mechanism for the portable display in
Example embodiments of the invention are directed to disposable solid state opto-electronic vision modules, that can include monochromatic, polychromatic visible, Ultra Violet (UV), and/or Infra Red (IR) solid state light sources such as high power Light Emitting Diodes (LEDs), and Laser Diodes, Vertical Cavity Surface Emitting Lasers (VCSELs), as a means of illumination and one or more opto-electronic imaging systems for image capture in diagnostic or pathological microscopic procedures, or other functional magnifier or microscopy systems.
In various microscope geometries, it is also possible to install and remove the entire opto-electronic vision system along with the LED illumination system, associated processing electronics, and cable connection for power and control of the device, within the disposable housing, allowing implementation of a removable and pluggable opto-electronic or electro-optic (OE or EO) illumination and/or vision module, as an entirely disposable unit, as described more fully below. The removability and pluggability of such miniature OE vision modules described herein can provide instantly upgradeable illumination and image capture systems performing various microscopic sampling and examination on-the-go.
These removable and pluggable OE illumination and vision modules can be incorporated within a protective disposable cover or box, where the OE illumination and imaging module is protected form the background (outside) light and other environmental effects. The OE illumination and vision module schemes of the present invention, made for specific microscopic evaluation and examination, can allow variety of pathologic procedures to be performed on the same or various specimens as described below.
a and 1b represent the basic building blocks of a miniature disposable microscope. The OE illumination and vision module 100, comprising a camera and housing (imaging module) 101, within which is disposed one or more objective lens 108a and imaging lenses 108b, and an image sensor 106. Where the combination objective lens 108a and imaging lens 108b, image the specimen under observation with the required magnification onto the image sensor 106. A clear optical window 103 denotes last surface of the objective lenses 108a, which along with the imaging lenses 108b, and image sensor 106, within the camera housing of imaging module 101, are all aligned and mounted on a rigid, flexible, or combination electronic processing board 107. The pluggable OE vision module 100 can be housed within a disposable package or housing, where the illumination module 102 can have its' own flexible circuitry 104, receiving power from connection 109 and electronic board 107. Flex circuitry can be used to provide power and control signals to the OE vision module 100 and to transmit imaging signals to a portable control and display unit 110, where part of the cable 105 can be freely enclosed in the disposable package or housing, and part of the cable can be outside the disposable device package, where the entire cable can be disposable along with the disposable microscopic vision module 100.
The portable control and display unit 110 generally includes a display screen, a housing, illumination and imaging control electronics, image processing electronics, and/or a power supply, such as a battery. Such compact imaging and illumination modules (100) without means of power or control electronics of their own, can be made in a compact and low cost form to make it easily introduced into a disposable package or housing, plugged into a control unit using cable 105, and then removed and disposed of after a single use. Standard low cost and proven digital electronics can be used on the flexible or rigid electronic board 107, to convert the parallel digital video signals from a high resolution digital sensor 106, for example to high speed USB (Universal Serial Bus) video class camera signals (UVC, or USB Video Class format), similar to USB Web cameras. In some embodiments, flex circuitry 105 communicatively couples the portable control and display unit 110 to one or multiple OE imaging module(s) 101 to communicate power and control signals, as well as high speed digital video imaging signals between the portable control and display unit 110 and the OE imaging module(s) 101. As such, the flex circuitry 105 serves as one example of a means for communicatively coupling the portable control and display unit 110 to the OE imaging module(s) 101. Additionally, flex circuitry 105 further communicatively couples the portable control and display unit 110 to one or more OE illumination modules 102 to communicate power and control signals between the portable control and display unit 110 and the OE illumination modules 102 (to turn on/off or vary illumination brightness for example). As such, the flex circuitry 105 further serves as an example of a means for communicatively coupling the portable control and display unit 110 to number of OE illumination modules 102.
For any of the high digital speed communication methods used in cable 105 between the display and control device 110 and OE illumination and vision module 100, appropriate connection can be made at the display and control unit, where the entire cable 105 can be also disposed of, along with the OE illumination and vision module 100 that is housed in a disposable device housing. Using standard USB communication protocols and connections (with or without a USB HUB) to the display and control unit, allows the display and control unit be or function as a computing and processing unit such as a UMPC (Ultra Mobile Personal Computer), MID (Mobile Internet Device), a Tablet Computer, or mini PC or a PDA (Personal Digital Assistant) accommodating such USB communication port used as a USB HOST. Use of such established video communication protocols such as UVC, for example in case of a high speed USB connection, makes the display and control unit to be a device readily available with multiple other connectivity solutions already available in a mobile form. As illustrated in
Alternatively where an imaging system with Auto Focusing (AF) capability is necessary, compact autofocus mechanism could be also integrated in camera imaging module 101, where certain or all lens elements 108a and 108b are to be moved axially (along the optical axis), with respect to camera sensor 106, with drive and control signals from the control unit 110. Control unit 110 can be programmed to detect best focus of the remote camera imaging module 101, with the imaging data it's provided from the camera, and run it as if it's a local camera lens module within the control unit 110.
Removable and pluggable OE illumination and vision modules with protective disposable covers, where a biological sample possibly posing a biohazard is to the examined inside it, can enable numerous advantages. For instance, the disposable package housing the OE module can be a fully sealed sterile cavity, where once the biohazard specimen is introduced inside it and tested, it can be disposed of upon removal of the pluggable OE module from the control and display device 110. Where subsequently a new protected and sterile OE module (disposable microscope) can be plugged onto the control and display device for subsequent use with new specimens, thereby eliminating the likelihood of exposure to biohazard specimens, or any cross contamination between specimens.
Different OE vision and illumination modules, with various functionalities such as type of illumination, imaging magnification, and image processing can also be plugged into the same control and display module, one at a time or concurrently, depending on the procedure or examination to be performed, providing means to readily choose from a variety of application specific microscopic imaging capabilities. For instance, white light illumination or multi-spectral visible OE modules can be used for traditional imaging in the visible range.
A pluggable and disposable microscope with the OE imaging and illumination module, using additional deep blue or UV illumination could be used to induce bio-fluorescence in the specimen under observation, and detect spectral emission from the specimen, at the same time as the visible imaging, to gain further information regarding the object, such as the tissue type and identifying lesions. An IR illumination can be used in the OE vision and illumination module of the disposable microscope, to image inside tissue or through scattering substances or fluids, to give additional in depth view. Different UV, visible and IR wavelength illumination with varying penetration depths can be used for depth dependent imaging inside the tissue. Various spectral component captured in 2D images, can be subsequently processed and put together to reconstruct a 3D view of inside the body.
Use of such removable and pluggable OE illumination and vision systems inside a miniature disposable package, replaces a variety of conventional instruments otherwise needed for the same purpose, such as an external light source, fiber light guides, means of microscopic illumination, various microscope objectives, microscope eyepiece, and/or electronic cameras. Further, the removable and pluggable OE illumination and vision systems according to some embodiments of the invention can be used to perform tissue analysis in the same location as the biopsy or sampling procedure is performed, thereby eliminating the need transfer tissue for biopsy, and then performing a biopsy on tissue at a laboratory. This enables timely analysis without the delay typically required to obtain a biopsy report, and further allows for real-time surgical procedures to be performed concurrently, instead of possible follow-on surgical procedures after review of biopsy reports.
LED sources can provide illumination in a wide range of the electromagnetic spectrum, from UV, to visible and IR, where the individual LEDs in a specific spectral range can be independently controlled in time and the corresponding images independently processed based on individual captured frames. Each LED spectral component can be independently designed in the LED, or obtained with independent processing of each LED spectrum, via secondary photo-luminescence process on blue or UV LEDs, or using edge or band pass spectral color filters such as multilayer dielectric optical filter coatings. For imaging in the visible region, Red, Green, and Blue LEDs in primary colors can be used with or without other non-primary colors such as amber or cyan where the multiple spectral LEDs together form a white illumination.
By using multiple color LEDs, or VCSELs (Vertical Cavity Surface Emitting Lasers) as the OE illuminator 102 in the disposable microscope, and synchronizing a black and white image capture device to grab the synchronized color component images, the use of color camera chips or high resolution 3 CCD or 3 CMOS imaging devices are eliminated. In this case, a single CCD or CMOS image capture device is used to capture the three or more images in a time synchronized fashion, where each color component image takes advantage of the full image capture device resolution by incorporating all the pixels in each color image component. Simple black and white image capture devices are also cheaper to use, especially compared to 3 chip image capture devices, where in effect the resolution of a synchronized black and white imaging CCD or CMOS using synchronized color illumination provided by the LEDs is equivalent to a same pixel 3 chip image capture device.
Using color synchronized image capture devices also allows the use of much higher resolution image capture devices, as well as possible image processing of multiple frames, allows one to obtain much higher resolution image from a single sensor chip disposable microscope device. A variety of illumination configurations are possible using LED chips, where the uniformity, angle and extent of the illumination are freely controlled by the positioning and design of the LED light sources. Various illumination configurations can reproduce the bright field and dark field illumination of traditional microscopes.
a represents the disposable microscope of
Multiple and various illuminators can be used within the disposable microscope, where the independent VCSELS or LEDs can be turned on concurrently or sequentially, for best observable imaging.
Infra Red (IR), Ultraviolet (UV) LEDs, or narrow spectral band VCSELs can be used based on their transmission characteristics in the medium of the object under examination inside the disposable microscope, such as wavelength dependent penetration depth inside the medium or the effect they have on the object of interest (such as inducing fluorescence). With a disposable microscope equipped with a full range of LED wavelengths, or a specific range of illumination wavelength, it is possible to obtain a full spectral image of the object by turning the various LEDs on and off at specified times, and in a controlled spectral range depending on application, while a time synchronized imaging process captures various spectral images based on the illumination that is on, at the time of capture.
Another embodiment of an OE illumination and vision module of
Both Polarizer and Analyzer 402b are disk shape optical polarizers that can be made rotatable inside the disposable microscope housing, changing its polarization axis, manually by rotating the disk as the extension of the disk shape body extrudes outside the microscope housing. The housing interface where the disks extrude out to be accessible for manual manipulation is depicted by dashed lines 405, in
a represents the disposable housing of
Other sliding and manipulation mechanisms such as joy stick or linear manipulators with various manipulation distance ratios can be devised on the disposable housing 602a, 602b to scan a specimen under observation with respect to the imaging EO imaging module 101.
In
The electrical connection 109 of the OE illumination and imaging module 101 and illumination modules 102a, 102b, and 102c, can all be controlled through USB type communication and power protocols by the control and display module 110, with well established mobile web camera and camera flash (illumination) applications in video conferencing. If higher power is necessary to power the illumination sources, an extra power line could be used in cable 105, specifically to power the illuminators. Multiple color LEDs 102a, 102b and 102c can be used, where the display and control unit 110 synchronizes the on/off timing of each color LED with the frame rates of a black and white camera sensor 106 in the imaging module 101. Such disposable microscope could be used for spectral imaging with narrow band LED light output in the illuminator module, or with wider wavelength band illumination in the visible range time synchronized with a black and white image sensor 106, to provide full color vision where each color frame takes advantage of the full resolution of the image sensor 106.
In these and other embodiments, the portable control and display unit 110 can be used to house all the control electronics and software necessary to power the OE imaging module(s) 101, control illumination and imaging functionality of illumination module(s) 102, data transmission control (using standard network device protocol such as a in a USB host driving one or more web cameras with on board illumination), as well as any image processing and/or display functionalities. For instance, the portable control and display unit 110 can include illumination and imaging control electronics that provide illumination and/or imaging control of multiple OE illumination modules 102 and/or the OE imaging modules 101 in the same disposable microscope housing 602a and 602b. Alternately or additionally, the portable control and display unit 110 can include image processing electronics that provide image processing of image data received from multiple OE imaging modules 101 providing stereo or hyper fields of view microscopes.
The portable control and display unit 110 can be a portable display unit used in a fixed position in a medical facility, or as a mobile application with an LCD, OLED display (Organic LED display), or other display unit capable of displaying 2D or 3D (stereoscopic) images. The portable control and display unit 110 can alternately or additionally be worn by a user, with a wired or wireless connection to the input devices (e.g., the OE vision module(s) 100), where the user can observe 2D or 3D stereo images and video conveniently by looking at the display mounted on an arm of the user, or otherwise mounted (clipped on) to the user, with their hands free to perform other tasks.
The portable control and display unit 110 can be electrically powered using a power cable, or use rechargeable or disposable batteries. In all the embodiments, the electrical power supply of the portable control and display unit 110, whether from a power cable or battery, provides power for the portable control and display unit 110 as well as the OE illumination and imaging modules 102, and 101 to which the portable control and display unit 110 is attached via cable 105. Single or multiple OE illumination 102 and imaging modules 101 can be connected to the portable control and display unit 110, which portable control and display unit 110 can be configured to provide synchronized control of complete illumination and image capture, and with varying integration time. The portable control and display unit 110 could also provide means for local and transferable means of image and video storage, with magnetic and/or electrical storage devices within its housing. A user interface can be provided on the portable control and display unit 110 and may include hard or soft electronic keys, a mechanical or laser mouse or joystick, a touch screen, and/or voice activated command electronics. The user interface can be employed to adjust, control, display, process, transfer, store or retrieve the image and video data. The portable control and display unit 110 can alternately or additionally comprise a multifunctional unit that is used as both a general portable display and one or more of: a cell phone, a mini computer with wireless capabilities, a GPS unit, a personal digital assistant (PDA), a note-taking device, a dictation device, a video conferencing device, or the like.
The user interface devices described above, including hard or soft electronic keys, a mouse or joystick, a touch screen, and voice activated command electronics all serve as examples of input and/or output means that can be included in the portable control and display unit 110. The portable control and display unit 110 can alternately or additionally include computing means, such as a processor, microprocessor, controller, or the like. Alternately or additionally, the portable control and display unit 110 can include cellular communication capabilities and/or wireless connectivity. Portable display unit 110 can also be used as a projector of images onto another form of screen.
In some embodiments that include stereoscopic or 3D image capture, as illustrated in
Alternatively the display unit 110 could be a 3D display, where the left and right eye images are displayed with different polarization characteristics, and a matching polarized viewing glasses 900, with each glass 904 and 906 matching the left and right image polarization, is used to view the 3D information on the 3D display.
An independent 3D viewer 1050, illustrated in
In disposable microscope embodiments where top illuminators are used, such as bright field illuminator in
The portable control and display unit 110 may comprise a flat panel LCD screen, or other suitable screen such as OLED display, where a separate sterile disposable cover could be draping the portable control and display unit, preserving all user interface and electrical connection functionalities. Alternately or additionally, the portable control and display unit 110, or it's separate sterile cover can have multiple positioning and attachment possibilities, for ease of use, while various specimen preparations need to take place, various microscopy tasks are being performed, the location the procedure is being performed, and the type of user interface necessary. In fixed office or surgical environments, the portable control and display unit 110 can be fixed to a wall, mounted on an IV post, clipped onto as patient cover or drape, or can be hung from a frame structure, with tilt and rotation capabilities and in a removable and portable form. Alternately or additionally, a fixed control and display unit can be employed to control OE illumination and imaging modules 102 and 101 and/or to display image data captured by OE vision modules 100.
a-11c, illustrate “wearable” configurations of the portable control and display unit 110 where the portable control and display unit 110 is attached to the arm or wrist of a user via a wearable attachment device. In more detail,
b illustrates a wearable attachment device comprising a wide elastic band and Velcro strip 1104 that acts as a cover to the bracelet 1102. As illustrated in
The convenient and flexible Velcro based wearable attachment device of
Alternately or additionally, as shown in
The present invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within
This patent application: is a continuation-in-part of U.S. patent application Ser. No. 12/759,169, field Apr. 13, 2010, and entitled DISPOSABLE ENDOSCOPE AND PORTABLE DISPLAY, which is a continuation-in-part of U.S. patent application Ser. No. 12/413,457, field Mar. 27, 2009, and entitled PLUGGABLE VISION MODULE AND PORTABLE DISPLAY FOR ENDOSCOPY, which claims benefit of U.S. Provisional Patent Application Ser. No. 61/082,432, filed Jul. 21, 2008 and entitled INDIVIDUAL STEREO VIEWER. U.S. patent application Ser. No. 12/413,457 is also a continuation-in-part of U.S. patent application Ser. No. 12/111,107, filed Apr. 28, 2008 and entitled OPTO-ELECTRONIC ILLUMINATION AND VISION MODULE FOR ENDOSOPY, which is a continuation-in-part of U.S. patent application Ser. No. 11/233,684, filed Sep. 23, 2005 and entitled SOLID STATE ILLUMINATION FOR ENDOSCOPY, which claims the benefit of U.S. Provisional Patent Application Ser. No. 60/612,889, filed Sep. 24, 2004 and entitled SOLID STATE ILLUMINATION FOR ENDOSCOPY. The above-identified patent applications are hereby incorporated herein by reference in their entirety.
Number | Date | Country | |
---|---|---|---|
61082432 | Jul 2008 | US | |
60612889 | Sep 2004 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 12759169 | Apr 2010 | US |
Child | 12771087 | US | |
Parent | 12413457 | Mar 2009 | US |
Child | 12759169 | US | |
Parent | 12111107 | Apr 2008 | US |
Child | 12413457 | US | |
Parent | 11233684 | Sep 2005 | US |
Child | 12111107 | US |