The invention relates to a modular camera control device for processing video signals from a variety of camera types and, more particularly, the invention relates to the reprogramming of the modular camera control device.
The field of endoscopy, to which the present invention relates, includes medical diagnostic and therapeutic disciplines that utilize endoscopes to view otherwise inaccessible body cavities using minimally invasive surgical procedures. Endoscopic cameras are typically small and lightweight for ease of use by medical professionals. Typically, the camera is connected to a Camera Control Unit (“CCU”), with the CCU processing and displaying the imaging data from the camera. Often, each medical procedure requires a different camera types, leading to a large inventory of cameras. Additionally, each camera type must be compatible with the CCU to function correctly. Each CCU has software to process and operate a variety of camera technologies, and as new technologies become available, the CCU may need updated software to properly process images from new camera technology. Additionally, the CCU hardware may become outdated, thus requiring an entirely new CCU to process the images both old and new camera technologies used by a physician.
CCUs can be designed with robust reprogramability and reconfigureability capabilities, this way, an older model CCU can be upgraded or configured to work with new camera technology. However, rather than reprogramming or reconfiguring a CCU, it is often less costly to replace the older module CCU with a new one because the configuration management of the CCU is often a time and labor intensive process that is difficult to manage efficiently. Furthermore, as software feature business models become prevalent, it becomes more and more difficult to manage which customers purchased what software features.
In known systems, cameras, such as charge coupled devices and the like, used during endoscopic surgery are typically referred to as heads or camera heads. To achieve the desired size and weight of the camera heads, camera head and/or integrated endoscope-camera assembly electronics are typically separated physically from the majority of circuitry required to process and output high-quality, color video images, which is typically housed in the CCU. In known systems, CCUs may be placed on or in carts, in or on ceiling boom arms, or may be permanently wall mounted.
Although current CCU devices allow for upgradeability, each new camera head may include software required to update a CCU to be compatible with that (or an identical) camera head. Since many procedures require different cameras, and different camera types, the CCU must be properly maintained and updated to be compatible with each camera. Therefore, it is important to have an efficient way to manage software updating and reprogramming of camera heads and/or imaging devices.
When image data is, acquired, or picked up, it is sent by the camera head to the CCU. Upon receiving the image data from the camera head, the CCU normally processes the signal to display the acquired image on a viewing device. Generally, the image is used by a medical professional and/or for storage on various media (video cassette recorder, floppy disk, hard drives, flash drives, compact disks, digital video disks, and the like) and/or for transmission to remote locations in various manners, such as by the Intranet, Internet, radio transmission, and the like.
Additionally, the CCU may send commands to the camera head to adjust various settings (i.e. color balance, electronic shutter for light sensitivity, and other optical and electronic characteristics).
Traditionally, CCUs are compatible with a limited number of camera heads. A CCU's hardware is usually difficult to configure for proper communication with varying types of camera heads because camera heads use varying types of imaging devices that can differ in pixel resolution, timing requirements (i.e. PAL, NTSC, Progressive, and other formats), signal output type (i.e. analog or digital), physical size, and in other characteristics.
Analog video system types differ in scanning principles, resolution capability, sampling rates, aspect ratios, synchronization, bandwidth, and the like. Moreover, video system types may differ between broadcast, closed circuit, and computer applications. Analog video systems are typically classified as either composite (luminance and chrominance components multiplexed into a single signal) or component (separate signals for each chrominance component, and synchronization signals). In broadcasting applications, composite formats are generally used. For closed circuit systems (such as video production and editing, medical, industrial, and scientific applications) typically component formats are used. The primary composite analog video standards usually used are PAL, NTSC, and SECAM, with one specific standard used in different geographical areas.
Digital video systems are typically differentiated by their application. Advanced television (ATV), high definition television (HDTV), and computer systems may differ in format and signal characteristics. In some areas, digital video formats and standards are currently being developed and adopted. The Society of Motion Picture and Television Engineers (SMPTE) is typically in the business of defining and adopting voluminous digital video formal standards. As each is adopted, various applications, and application improvements generally will also be realized. Some digital video standards currently in use are: IEEE-1394 FireWire®, ISO/IEC IS 13818, International Standard (1994), MPEG-2, and ITU-R BT.601-4 (1994) Encoding Parameters of Digital Television for Studios.
Furthermore, there may be variability from device to device of the same type, which may affect camera head performance. Additionally, commands sent from the CCU to the camera head are generally unique depending upon the camera head type being used. Moreover, as repairs, modifications, or improvements are made to camera heads, the CCU, which was originally designed to be compatible with the older camera head, may become incompatible and may require upgrading as well.
This overall variability in camera heads, either caused by imaging device technologies or by CCU command characteristics, often results in a CCU being specifically designed to be compatible with the camera head type utilized. Also, consumers may desire different capabilities related to specific applications of the cameras, such as medical, industrial, and scientific uses. Capabilities include picture in picture, reverse video (image flip), electronic zoom, still image capture, and stereoscopic video interface.
Moreover, CCUs are typically designed for use with camera head technologies currently in existence, and not designed to anticipate and accommodate camera heads yet to be developed. Hence, CCUs are typically not designed to be compatible with future camera head technologies; particularly, image device and image signal transmission technologies. These differences between older and newer camera heads also contribute to compatibility problems.
Because CCUs are usually compatible with limited quantities of camera heads, CCUs are typically discarded in favor of ones that were designed concurrently and/or to be compatible with particular camera head technologies. Consequently, CCUs have become an added expense often associated with changing imaging devices or camera heads. Further, it is typically desired for camera heads to be improved due to the demand from consumers to have the latest technology and advancement in equipment. Moreover, CCUs used in medical and veterinary fields are increasingly being mounted permanently in equipment bays or carts and/or permanently mounted within the walls of surgical operating rooms themselves. The expense associated with replacing CCUs to maintain compatibility with camera heads is subsequently passed onto consumers.
Thus there exists a need for a modular system that overcomes the disadvantages of the prior art. It is further desired that the camera head or CCU may be updated or reprogrammed in an efficient and cost effective manner, rather than replacing the older camera head or CCU with a newer module. It is yet further desirable to provide a modular system, including camera heads and CCUs, that is readily compatible with existing and future imaging technologies and that allows for camera heads and CCUs to be backwards and forwards compatible.
Accordingly, it is an object of the present invention to provide a camera control device having a modular architecture capable of being updated.
Another object of the present invention is to provide a modular camera control device capable of processing and displaying data from a variety of camera types and imaging sources both existing and developed in the future.
Another object of the present invention is to provide a modular camera control device that can be updated in an efficient manner.
Another object of the present invention is to reduce the total cost of ownership for a visualization system.
Another object of the present invention is to increase the likelihood that a newly purchased visualization system will work with existing equipment.
Another object of the present invention is to provide a modular camera control device that may be efficiently updated for expanded software or hardware functionality purchased by the consumer.
Yet another object of the present invention is to provide a modular camera control device that may be updated in field.
These and other objects of the invention are achieved by providing a reprogrammable modular imaging device having a control module and one or more input modules, each input module having a processor and connected to the control module. Image data is received by the input module for processing and transmission the control module. A program is received by the control module to reprogram the processor.
Other objects of the present invention are achieved by providing a reprogrammable modular imaging device having a processor and one or more input modules connected to the control module. Image data is received by the control module for display formatting by the processor, and a program is received by the control module to reprogram the processor.
Further objects of the present invention are achieved by providing a reprogrammable modular imaging device having a control module with a processor and one or more input modules with a processor. The input modules are connectable to the control module. Image data is received by the least one input module for processing and transmission to the control module. Processed image data is received by the control module for display formatting, and a program is received by the control module to reprogram the processor of the control module and the processor of the input module.
The image data may be raw image data, and the input module may transmit processed image data to the control module in a format readable by the control module. The processed image data can be in a format readable by the control module.
A camera is connectable to the input module for transmitting image data, and a display can be connected to the control module for displaying processed and formatted image data. The camera can have a processor and a program may be received by the control module to reprogram the processor of the camera. The program can be received by the control module through an upgrade port. The input module may receive the program from the control module. The reprogram of the processor can reconfigure the processor, enable a soft feature and disable a soft feature. A module link connecting the control module to the input module allows the input module to receive the program from the control module. Data and commands may be transmitted through the module link.
The program received by the control module may come through a network connection. The program may also be retrieved by the control module through a network connection or a mass storage device. The network connection may optionally be wireless. The program may also reprogram the modular imaging device to be compatible with an alternate image source or alternate image module. Further, the processor can receive an authorization for the reprogram.
A modular architecture of the camera control device allows the consumer increased flexibility. The modular camera control device allows upgradeability and compatibility with a multitude of camera heads that are supported by a plurality of input modules. The camera heads and input modules may be existing or yet to be developed. Formerly, when a new imaging technology became available, a camera control unit could be incompatible with the new technology due to a variety of constraints, for example, incompatible hardware.
By using a modular architecture, the new technology can be supported by an input module that is compatible with the control module. In order to streamline the flexibility of the modular architecture, it is important to have an efficient way to re-program or re-configure the modular camera control device software, firmware, drivers etc. Further, because the program is loaded onto the control module, there is no need for the user to follow a particular set of steps to configure both old and new modules to work together. Instead, the user loads a program or a compiled file having a number of programs onto the control module. The program is installed for each module that needs updating without the need to separately, boot, install, configure, program, re-boot, etc., each module. The compiled file with a number of programs contains all files necessary for updating the modular unit, and data links between the control module and each input module allow for reprogramming as necessary.
A compatibility check can be done for software and hardware with limited interaction from the user. The modular architecture increases the likelihood that existing visualization technology and yet to be developed visualization will be able to operate with some if not all of the same image processing hardware. This results in decreased capital costs for physicians, medical offices, surgery centers, and hospitals.
The control module is designed to accommodate general image processing and display functions for multiple camera types or families. These general functions include, for example, user interface, image capture and streaming functionality as well as input/output functionality for the display/monitor interfaces, system interface and control, and network connectivity. The control module can be designed to accommodate one or multiple imaging modules.
In the example of a control module that supports only one input module at a time, the overall modular device can be purchased at a lower initial cost. If the consumer wishes to purchase different camera or input module types, the modular device may be re-programmed to work with different imaging technology. If the control module supports multiple input modules, the consumer may still purchase new imaging technology, cameras and/or input modules, and still use the same control module once the reprogramming is completed.
The input modules support all functions required for a group or family of image sources, such as cameras or auxiliary inputs. The input module provides compatibility between the family of image sources and the control module. Over the life of the system, additional input modules may be purchased to support emerging imaging technology such as 3D imaging, advanced fluorescence imaging, solid-state variable direction of view endoscopes, wireless camera heads and the like.
The group of input modules connected to the control module may include an auxiliary input module. This module supports a variety of video sources such as third party camera control units, C-Arm, X-Ray, Ultrasound, Personal Computers and the like. Supported input formats may include, DVI, VGA, S-Video, Composite, 3G-SDI and the like. Inputs may be both automatically and manually selected. The auxiliary module provides increased backward compatibility, forward compatibility and third party image source compatibility.
The re-programmability function of the modular architecture allows for economical-minded buyers to progressively upgrade their imaging technology, rather than being required to purchase a camera control unit that is compatible with the entire range of imagers that the buyer would wish to purchase in the future. The efficient re-programmability function allows for hardware upgrades, reconfiguration and software feature upgrades. The re-programmability function further minimizes the likelihood that newly purchased visualization technology will become obsolete while increasing backward compatibility of upgrades. Further, the cost of ownership and upgrade, such as acquisition, back-up, and maintenance, is reduced.
The re-programmability of the modular device further allows software features to be selectively activated in a cost effective manner. Since the reprogramming step is relatively simple compared to the prior art, it is easier to sell software features to the end user. The modular device can retrieve or receive a program through a LAN connection, or USB storage device, allowing the manufacturer or software provider to reprogram the system remotely. Further, the modular camera control device may be connected to an Internet/Ethernet connection, allowing updates to be purchased, downloaded or verified online, with the files sent to the control device through the data connection.
By loading a program on the processor of the input module and/or the control module, a number of features can be modified. The program can reconfigure and/or reprogram: hardware, drivers, input/output interfaces, user interfaces, display features, camera features, camera processors, color and white balance functions, and software features. The program can also modify the modular imaging device to be compatible with alternate input modules and alternate image sources such as a new camera type. In the example of a reprogrammed input module, the control module sends commands and a program to reprogram the processor. A confirmation of reprogramming status may be sent to the control module from the input module.
The control module 2100 is responsible for display formatting processed image data received from the input module 2200, 2300, 2400. The control module may perform a number of commands and functions such as Zoom, PIP, GUI, display overlay, printer driver and video and still recording. The data link 1000 receives and sends processed image data, commands, software updates and other data between the control module 2100 and the input module 2200, 2300, 2400. Optionally, an auxiliary module 2400 may be connected to the control module 2100.
Each control module 2100 and input modules 2200, 2300 and 2400 have a power plug 2110, 2210, 2310 and 2410 respectively. Control module 2100 has four slots 2110, 2120, 2130, 2140 for receiving the cable 1000. Each of slots 2110, 2120, 2130 and 2140 can be connected to a separate input module.
If an auxiliary input module 2400 is connected, the program can also reprogram the auxiliary input module processor 2442. The auxiliary module 2400 may allow one or more auxiliary sources 2430, 2440, 2450, 2460 and 2470 to connect to various other input and output devices. Examples of auxiliary sources may include 3G-SDI sources, an existing camera control unit, a room camera, a computer or other data sources as desired.
The camera such as endoscope 4000 and the input module 2300 are connected with a link 4500. As shown in the Figures, the link is a cable, however other data transmission devices such as wireless, optical or other can be used as would be apparent to one of skill in the art. Control module 2100 also has various output and input elements 2150, 2160, 2170, 2180, 2190 and 2195 to connect to various other input and output devices. Example input/output elements may include DVI output for a DVI monitor or recorder, and a 3G SDI output for 3G SDI monitors or recorders. As shown, the control module is connected to a display 3050 with a cable 3010.