The present invention relates generally to medical imaging and more particularly to image processing systems and methods for surgical and other applications.
Various medical imaging systems and methods have been developed to assist surgeons in performing surgical procedures. For example, surgeons may utilize endoscopes, laparoscopes, ultrasound probes and/or optical imaging systems to provide enhanced visualization of the surgical site during an operation. Prior to surgery, the imaging system is moved into the operating room and connected to any necessary inputs such as a power supply. In some cases, more than one imaging system is used, or an imaging system may be brought into the operating room in the middle of a surgery. The imaging system may include, for example, a wheeled cart, a computer with storage, an imaging head or probe, and a monitor or display.
An example of an operating room (OR) layout is depicted in
The space limitations of the operating room can create significant challenges in management of the operating room and the various systems used by the surgeon during the operation. It may be difficult, for example, to position one or more imaging systems in the location most useful to the surgeon. Also, the various systems typically include redundant subsystems or components, such as displays, computers, power supplies, data storage devices, and so on. The redundancy of the various systems compounds the problem of limited space. The present invention addresses these aspects of known systems.
The invention relates to an imaging system for use in operating rooms and other applications. According to one example, the imaging system comprises an imaging head comprising an imaging sensor that receives image information from a subject and converts the image information into an image signal. The imaging system also comprises a control unit that receives the image signal from the imaging head. The control unit comprises a processor programmed to control the operation of the system and to generate a plurality of image frames for transmission to a separate monitor, a video interface designed to transmit the plurality of image frames to the monitor, and a power interface designed to receive power from a separate power supply. The imaging system also comprises a connector, such as a cable, that connects the imaging head and the control unit. The control unit may be adapted to interface with an imaging control workstation having a standard interface that receives the control unit. The control unit may also be adapted to interface with a separate, standalone imaging modality providing the separate monitor and the separate power supply. The imaging system may provide the advantages of reducing the cost of the imaging system and the required operating room floor space through shared resources, such as shared data storage, data processing, user interfaces, and network interfaces, provided by the imaging control workstation or the standalone imaging modality.
These and other features and aspects of exemplary embodiments of the invention will become better understood when reading the following detailed description with reference to the accompanying drawings, in which like characters represent like parts throughout the drawings, and wherein:
While the drawings illustrate system components in a designated physical relation to one another or having electrical communication designation with one another, and process steps in a particular sequence, such drawings illustrate examples of the invention and may vary while remaining within the scope of the invention.
An imaging system, according to one embodiment of the invention, is shown in
As shown in
Referring again to
The white light source 232 typically comprises a light source adapted to illuminate the patient with a desired range of wavelengths. The white light source 232 may comprise an incandescent, halogen, or fluorescence light source, for example. The excitation light source 233 may be any light source that emits an excitation light capable of causing a fluorescent emission from a fluorescent substance in the patient. The excitation light source 233 may include, for example, light sources that use light emitting diodes, laser diodes, lamps, and the like. The white light source 232 and the excitation light source 233 may each comprise a multitude of light sources and/or a combination of light sources, such as arrays of light emitting diodes (LEDs), lasers, laser diodes, lamps of various kinds, or other known light sources. Either or both of the white light source 232 and the excitation source 233 may include filters (not shown in
According to other embodiments of the invention, the imaging system 200 includes multiple fluorescent channels (e.g., more than one excitation source and more than one fluorescent emission), and the white light channel may be present or absent. The white light channel may also be referred to as the “color” imaging channel or the RGB channel, for red/green/blue. The white light source may be the ambient room light or the surgical luminary 121, but typically the imaging system 200 includes a white light source 232 to allow custom filtration and control of the white light intensity and spectrum, to optimize the cross-talk to the fluorescent channel or channels. The cross-talk to the fluorescent channel or channels may be caused by an illumination of the fluorescent substance from the white light source 232 (e.g., in the fluorescent emission spectrum) which may be reflected back to the fluorescent detection camera 219 and thus contaminate the fluorescent signal. Moreover, an excitation frequency of the fluorescent substance may be in a narrow band of the optical light frequency and the emission of the fluorescent light may be separated by a narrow bandwidth (e.g., typically approximately 20 nm). Also, the fluorescent signal may be affected by a combination of factors including, for example, excitation spectrum, absorption of the excitation by the fluorescent substance, emission of the fluorescent substance back to the fluorescent camera 219 which detects the fluorescence, and the like. Therefore, cross-talk to the fluorescent channel or channels may be optimized by filtering and controlling the white light intensity and spectrum.
The white light source 232 and the excitation light source 233 transmit light through the cable 250 to the light distribution unit 212 in the imaging head 210. The cable 250 may include, for example, fiber optic cables for transmitting the white light and the excitation light from the control unit 230 to the imaging head 210. The cable 250 typically contains one or more fiber optic cables to carry the light from the control box 230 to the imaging head 210. The cable 250 also typically contains camera wires to connect the cameras 218, 219 to the controls 234. The cable 250 may also include a power connector, although that function may also be supplied by the camera wires. The cable 250 may also include other components, such as to provide cooling functions.
The light distribution system 212 in the imaging head 210 typically includes one or more lenses to redistribute the light received through the cable 250 in a desired manner to the patient. For example, the light distribution system 212 may receive light through a fiber optic cable within the cable 250 and distribute it over a larger cross sectional area. The light distribution system 212 may distribute the received light in order to better illuminate the surgical table 100, minimize a lighting hazard by reducing the intensity of the received light, and/or improve the safety of the imaging system 200. The light distribution system 212 can be designed to produce a distribution of the light that is tailored for the particular operation being performed. For example, in an optical imaging system, the light distribution system 212 may include a first lens that receives white light, for example, and which distributes the white light in a desired intensity to the patient. The light distribution system 212 may include a second lens to distribute an excitation light over a desired area to excite a fluorescent contrast agent in the patient. The second lens may focus the light so that it maintains a relatively high intensity when it reaches the patient. In this way, the light distribution system 212 is effective at transmitting the excitation light with a desired intensity to the patient,
The light distribution system 212 in the imaging head can provide the benefit of reducing or minimizing the thermal loads on the imaging head 210 and the size of the imaging head 210, as compared with a system in which the actual white light source and/or the excitation light source are located in the imaging head 210.
In some cases, however, there may be other advantages to providing the white light source and/or the excitation source in the imaging head 210, such as to avoid transmitting the light through fiber optic cables. According to this embodiment, the imaging head 210 includes a white light source and/or an excitation light source.
Referring again to
Examples of fluorescent contrast agents are known in the art and are described, for example, in U.S. Pat. No. 6,436,682 entitled “Luciferases, fluorescent proteins, nucleic acids encoding the luciferases and fluorescent proteins and the use thereof in diagnostics, high throughput screening and novelty items”; P. Varghese, A. T. Abdel-Rahman, S. Akberali, A. Mostafa, J. M. Gattuso, and R. Carpenter, “Methylene Blue Dye—A Safe and Effective Alternative for Sentinel Lymph Node Localization,” Breast J. January-February 2008;141:61-7, PMID: 18186867 PubMed—indexed for MEDLINE; F. Aydogan, V. Celik, C. Uras, Z. Salihoglu, and U. Topuz, “A Comparison of the Adverse Reactions Associated with Isosulfan Blue Versus Methylene Blue Dye in Sentinel Lymph Node Biopsy for Breast Cancer, Am. J. Surg. February 2008;1952:277-8, PMID: 18194680 PubMed—indexed for MEDLINE; and as commercially available products such as Isosulfan Blue or Methylene Blue for tissue and organ staining.
The imaging head 210 also includes a lens 214 and a beam splitter 216, according to an exemplary embodiment of the invention. The fluorescence emission from the fluorescent substance in the patient and the visible light reflected from the patient are received through the lens 214 and then propagate to the beam splitter 216. The lens 214 is configured to focus an image onto the video camera 218 and the fluorescence camera 219. The lens 214 may be any lens suitable for receiving light from the surgical field and focusing the light for image capture by the video camera 218 and the fluorescence camera 219. The lens 214 may be designed for manual or automatic control of zoom and focus. The beam splitter 216 splits the image information into different paths either spectrally, for example with the use of dichroic filters, or by splitting the image with a partially reflective surface. The beam splitter 216 divides the fluorescence emission from the remainder of the light. The fluorescence emission typically travels through a filter (not shown) and then to the fluorescence camera 219. The filter is configured to reject the reflected visible and excitation light from being detected by the fluorescence camera 219 while allowing the emitted fluorescent light from the patient to be detected by the fluorescence camera 219. The fluorescence camera 219 may be any device configured to acquire fluorescence image data, such as a charge coupled device (CCD) camera, a photo detector, a complementary metal-oxide semiconductor (CMOS) camera, and the like. The fluorescence camera 219 may be analog or digital. The fluorescence camera 219 receives the filtered fluorescence emission and converts it to a signal that is transmitted to an image processing engine, as will be described further below. Typically both the excitation and detection components of the fluorescent channel have optical spectral filters to optimize the signal to noise ratio.
The remainder of the light passes through a second filter (not shown) and then to the video camera 218. The second filter preferably ensures that the excitation light and fluorescence emission is rejected from detection to allow for accurate representation of the visible reflected light image. The video camera 218 may be any device configured to acquire reflectance image data, such as a charge coupled device (CCD) camera, a photo detector, a complementary metal-oxide semiconductor (CMOS) camera, and the like. The video camera 218, which may be analog or digital, receives the filtered reflected light and converts it to a signal or image data that is transmitted to an image processing engine, as will be described further below.
During surgery, the surgeon positions the imaging head 210 to illuminate the patient via a white light generated by the white light source 232 and an excitation light generated by the excitation light source 233 transferred through the cable 250 over a desired area to excite a fluorescent contrast agent in the patient, and to acquire reflectance images and fluorescent images of the patient. The video camera 218 and the fluorescence camera 219 can be used to acquire data used to generate a merged image in which a fluorescence image is superimposed on a reflectance image (i.e., an image comprised of light reflected from the surgical site in the patient). The merged image may assist the surgeon in visualizing the area to be treated and in discriminating certain tissues and vessels during surgery. Examples of methods for creating such a merged image are disclosed, for example, in U.S. Application No. 61/039,038, filed Mar. 24, 2008, entitled “Image Processing Systems and Methods for Surgical Applications,” and U.S. application Ser. No. 12/054,214, filed Mar. 24, 2008, entitled “Systems and Methods for Optical Imaging,” both of which are hereby incorporated by reference in their entireties.
Referring again to
The power unit 235 provides power conditioning and distribution. For example, the power unit 235 may receive as input a conventional alternating current (AC) 120 volt, 60 Hz power supply 260 and may output any desired voltage and current for the control unit 230, the imaging head 210, and the various individual components of these units 230, 210. The cable 250 may include the appropriate wires and/or power transmission channels to transmit the desired power from the power unit 235 to the various components of the imaging head 210.
The system controller 236 controls the operation of the imaging system 200, including the control unit 230 and the imaging head 210. For example, the system controller 236 may control the timing of the imaging system operation, the types of data acquisition, and the data flow. The system controller 236 receives video signals from the video camera 218 and the fluorescent camera 219 of the imaging head 210 through the cable 250 and processes the signals. The system controller 236 may include an image processing engine (e.g., a software module that runs on the system controller 236 and/or additional hardware) that executes various image processing routines on the data acquired with the cameras 218, 219, such as those routines disclosed in the aforementioned U.S. Application No. 61/039,038 and Ser. No. 12/054,214. The image processing engine may utilize the memory 237 for storing, among other things, image data and various computer programs for image processing. The memory 237 may be provided in various forms, such as RAM, ROM, hard drive, flash drive, etc. The memory 237 may comprise different components for different functions, such as a first component for storing computer programs, a second component for storing image data, etc. The image processing engine may include hardware, software or a combination of hardware and software. The image processing engine is programmed to execute various image processing methods. The methods typically involve acquiring frames of image data at different points in time. According to one embodiment, the frames of image data include reflectance data and fluorescence data. The reflectance data sets and the fluorescence data sets may be used to generate a merged image in which the fluorescence image data are overlaid onto the reflectance image data. The merged image assists the surgeon in visualizing certain tissues which emit fluorescent light during surgery.
The control box 230 of the imaging system 200 may include one or more interfaces 260-264, as shown in
The power interface 260 may comprise an electrical connector that receives a power supply from the power source 360 in the control workstation 300. The received power may be, for example, an alternating current (AC) 120 volt, 60 Hz power supply, or other conventional power supply.
The control interface 261 may link one or more components in the control box 230, directly or indirectly, with one or more components in the control workstation 300. For example, the control interface 261 may link the processor 236 and/or the memory 237 in the control box 230 with the processor 370 and/or the database 350 in the control workstation 300. The processor 370 in the control workstation 300 may also facilitate communications between the control box 230 and other components of the control workstation 300, such as the display 310, user interfaces 320 and external connections 330. The control box 230 can thus gain the benefit of the processing functionality, outputting functionality and/or archiving functionality provided by the control workstation 300. The control interface 261, for example, allows the control box 230 to utilize more advanced user interfaces provided by a dedicated or shared processor or user interface function, such as voice control, in the control workstation 300.
The video output ports 262, 263 on the control box 230 can be configured to interface with the display 310 in the control workstation 300, as shown in
The cable 250 shown in
The functionality provided by the control workstation 300 may include the ability to supply conditioned power, at several voltages or configurable voltages, to the control boxes (230, 270, 280) and imaging heads (210, 271, 281).
The functionality provided by the control workstation 300 may also include the ability to physically hold the control boxes 230, 270, 280 using a standard physical slot and standard connections. This design allows physical transport and storage of the control boxes 230, 270, 280 and imaging heads 210, 271, 281 together with the imaging workstation functions. The ability to physically dock the imaging modality with the imaging workstation 300 allows the integrated system to move easily from room to room.
The functionality provided by the control workstation 300 may also include the ability to physically connect the data transfer and control interfaces easily between the control workstation 300 and the control boxes 230, 270, 280. The control workstation 300 may include standard physical interfaces, such as standard cables and connectors, and/or a specific standard for connector layout, resulting in a standard interface design. The standard interface design may comprise, for example, a universal slot docking slot with standard physical dimensions.
The functionality provided by the control workstation 300 may also include standard data and control interfaces. The control workstation 300 may provide data interfaces, such as the ability to capture images from the control box or boxes and to interface to the room or to an image network. The control workstation 300 may supply such functions as image archives networking, graphical user interface, and advanced image processing. The data and control interfaces may be implemented using standard software interfaces such as HL7 or DICOM to allow data interchange. The control workstation 300 may be configured to display the images on its display 310 or on one or more displays or monitors 122, 131, 140 in the operating room, for example.
The control workstation 300 may also provide image processing functions such as prior image list/select, movie view or review, image fusion, and image annotation. These functions may be supplied once in the control workstation 300 and then used by multiple modalities.
The standard expansion slot 340 may receive one or more imaging devices. For example, the standard expansion slot 340 may receive the optical control box 230, the intraoperative ultrasound control box 270, the endoscope control box 280, and/or other imaging devices. More than one expansion slot 340 may be included in the control workstation 300.
In an exemplary embodiment, the work station 300 may include a database 350 to archive images generated by various imaging procedures. Also, the database 350 may copy the images generated by various imaging procedures. The database may comprise memory such as a hard disk drive, flash drive, RAM, ROM, etc. and associated database software, for example.
The working station 300 may also include a power source 360 coupled to an external power source (e.g., AC power source, or DC power source). The power source 360 may be a variable power source configured to supply different power levels for different modalities. Also, the power source 360 may be configured to supply different power levels as selected by a user using the user interface 320.
According to exemplary embodiments of the invention shown in
The ultrasound control box 270 may include features to assist a surgeon in visualizing the anatomy of the patient in real time using ultrasonic waves. The ultrasound probe 271 may include transducers that generate ultrasonic waves and receive ultrasonic waves reflected from the patient. The ultrasonic control box 270 processes the received waves to generate ultrasonic images. The ultrasound control box 270 may produce tomographic ultrasound images (TUT) that display multiple parallel slices within a volume data set. The ultrasound control box 270 may generate high-definition, multi-dimensional images that may be viewed in different planes, as will be appreciated by those skilled in the art. When the ultrasound control box 270 is connected to the control workstation 300, the integrated system provides the various enhanced functionality described above for the ultrasonic imaging modality, such as user interfaces, displays, external connections, storage and archiving, image processing capabilities, etc.
The endoscope imaging system 280, 281, 282 may include features to assist a surgeon in visualizing the anatomy of a patient in real time using an endoscope. The endoscope may be used in endoscopic surgery, which can be significantly less invasive as compared with open surgery. The endoscope is inserted into a small incision in the patient, as known in the art, to minimize the invasive nature of the surgery. The endoscope control box 280 or the endoscope 281 may include a light source for illuminating organs, tissues, and/or vessels of the patient. The endoscope 281 may include proximal detectors or distal detectors. Proximal detectors are located near the top end of the endoscope proximate to the surgeon. Distal detectors are located at the bottom end of the endoscope away from the surgeon. The detectors receive light reflected from a surgical site in the patient, and generate image signals which are processed to produce real time images of the patient, as is known in the art. When the endoscope control box 280 is connected to the control workstation 300, the integrated system provides the various enhanced functionality described above for the endoscopic imaging modality, such as user interfaces, displays, external connections, storage and archiving, image processing capabilities, etc. The endoscopic imaging system described herein can also be modified to include a laparoscope. A laparoscope is typically inserted into an incision in the abdomen to provide access to an interior of the abdomen in a minimally invasive procedure.
The control boxes of the various modalities 230, 270, 280 may be configured in a set of expansion slots 340 either serially (docking and undocking control boxes into the same slot as needed for individual interventions), or in parallel (docking multiple control boxes for the same or different imaging modalities into multiple expansion slots 340). This arrangement allows one control workstation 300 to serve multiple control boxes and imaging heads. The control workstation 300 can thus provide the advantages of reducing the operating room floor space needed by the imaging equipment, and reducing cost of equipment through sharing of storage disks, interfaces, computing resources, power supplies, displays, and/or cabinet hardware, etc. Multiple expansion slots 340 can facilitate the configuration of the control workstation 300.
The image processing engine which processes the image data acquired by the image detectors has been described above as residing in the control box. However, according to other embodiments of the invention, some or all of the image processing functionality can be performed by the imaging control workstation 300. For example, the imaging control workstation 300 may perform image processing functionality such as image manipulation and formatting, image merge, image storage, image analysis, video distribution, image archiving, etc.
According to another embodiment of the invention, the control box (230, 270, 280) is connected to a standalone imaging modality that provides one or more of the following functions. power conditioning, power distribution power supply, user interfaces, network, communication, and/storage interface(s), interfaces to the room video distribution system, computing, image processing, and display functions, e.g., with a separate monitor. The standalone imaging modality may include a standard interface, such as the standard interface described above in the expansion slot 340 of the control workstation 300. The standard interface on the standalone imaging modality may connect to the standard interface on the control box 230, 270, 280, enabling the standalone imaging modality to provide one or more of the aforementioned functions. This arrangement can provide the benefits of minimizing operating room floor space and reducing cost by sharing imaging resources, such as sharing of storage disks, interfaces, power supplies, cabinet hardware, etc.
According to another embodiment of the invention, the imaging control workstation 300 is connected to a standalone imaging modality, such as a surgical c-arm. In this configuration, the imaging modality is not placed into the standard expansion slot 340, since it is too large, but this arrangement can still provide the same benefits of minimizing operating room floor space and reducing cost by sharing imaging resources for the control workstation 300, such as sharing of storage disks, interfaces, power supplies, cabinet hardware, etc. The standalone imaging modality may include a standard interface (such as the standard interface on the control box 230) which connects to a standard interface on the control workstation 300.
Referring again to
While the foregoing description includes details and specific examples, it is to be understood that these have been included for purposes of explanation only, and are not to be interpreted as limitations of the present invention. For example, there are various types of image data and sensors that can be used in various embodiments of the present invention. In addition, although the above-described embodiments relate primarily to surgical applications, exemplary embodiments of the present invention can be adapted for non-surgical applications Modifications to the embodiments described herein can be made without departing from the spirit and scope of the invention, which is intended to be encompassed by the following claims and their legal equivalents.
This patent application claims priority to U.S. Provisional Patent Application No. 61/093,197, filed on Aug. 29, 2008, which is hereby incorporated by reference herein in its entirety.
Number | Date | Country | |
---|---|---|---|
61093197 | Aug 2008 | US |