The invention relates to a camera control unit capable of processing a video signal from many different types of video cameras and, more particularly, the invention relates to an integrated camera control system that can save images to numerous types of storage devices.
A camera and a camera control unit (CCU) are generally used in conjunction with each other to capture and process images, whether still frames or video clips. The camera typically includes a charge couple device (CCD) for receiving reflected light and generating an image signal, which is sent to the control unit. The image signal may be sent to the control unit via a hardwired cable or via a wireless connection. Upon receiving the image signal, the CCU processes it into image data, which may comprise one of many different formats. The CCU is also used to send commands to the camera.
It is known to provide a CCU that is capable of coupling to a number of different cameras, where each camera may have different camera settings and image signal formats. The CCU is able to detect the type of camera attached and adjust itself to function properly with the camera that is currently attached. Once the CCU determines the type of camera attached to it, the CCU will then look to receive camera settings data, either from the camera or from another location. Once the CCU adjusts to the particular camera, the CCU may then correctly process the image data sent from the camera.
However, while certain cameras may require particular settings to function properly, exact settings are typically not required. In fact, users, such as a surgeon, may often slightly or even significantly, adjust the settings of the camera to their personal optimum desired settings. This can be quite time consuming for the user, especially when the user is performing multiple procedures during the day and must readjust the settings every time new equipment is used from operating room to operating room.
Typically, the CCU is coupled to a display, located adjacent to the operator, such that the formatted image signal is presented on the display so that the operator can view it. Some systems have also provided for saving of image signals on the CCU for later retrieval. However, a limitation of existing systems is that they are generally limited to function with equipment that is currently in use and are not provided to seamlessly integrate with newer equipment. The difference between older and newer equipment may contribute toward compatibility problems between the CCU and the new equipment.
It is also known to provide control of medical equipment via various control interfaces that may be located in the sterile environment. For example, an image may be presented to the user on a display while the user may enter commands via a keyboard or the like. However, current systems do not allow the user to do is manipulate the image(s)/video presented to the user on the display. It may be highly desirable, for example, to save certain portions of a video clip or certain image frames to a particular save location for easy access by the user. It may also be advantageous to manipulate the video clip or certain image frames, for example, to crop, zoom, or add a highlighting box to a particular location, etc., prior to saving the image to a particular location.
Accordingly, what is desired then is a system and method that allows for image data to be saved to a selected location that may be easily accessible to the user.
It is also desired to provide a system and method that provides an output interface that will be compatible with future devices and technology.
It is further desired to provide a system and method that allows a user to quickly and easily update system settings based on the user's personal preferences.
It is still further desired to provide a system and method that allows the user to manipulate image data that is saved to a selected location.
These and other objects are achieved, in one embodiment, by the provision of a CCU that incorporates a USB port for porting/saving of images data that is selected by the user. For example, selected image data, whether a video clip(s) or a still frame(s), may be sent to the USB port. The user may provide storage device that will provide easy accessibility to the data, such as, for example, but not limited to, a USB flash/thumb device or a USB external hard drive. In this manner, the physician can simply unplug the USB device from the CCU and take the selected image data with them for review and analysis. This can be very helpful for the user, who may not have a network connection to the hospital system and does not want to wait for the data to finally be made available.
Alternatively, it is conceived that a network device may be plugged into the USB port such that the user may directly download the selected images from the hospital system to which the user's computer is connected to.
Still further, as technology changes and new equipment becomes available, the USB port will provide for a universal data coupling that will be compatible with future technologies as it uses an industry standard data format that can be used by new equipment.
In another embodiment, the CCU is provided with another USB port (or it may be the same USB port discussed above), in which the user (physician) may insert a USB flash/thumb device or a USB external hard drive that includes the user's personal setting preferences. For example, when the camera is coupled to the CCU, the CCU will detect the type of camera coupled to it, retrieve the particular settings (e.g. camera's optical characteristics, such as focal distance, resolution, light balance, or color), and adjust its settings accordingly. However, the user (physician) may have a personal preference for settings that differ from the default settings. Accordingly, the user may have their particular preferences saved to a USB flash/thumb device that the user merely has to insert into the USB port. The CCU may then either automatically upload the users preference settings, or the user can instruct the CCU to upload the users preference settings. This will save the user the time of having to adjust settings, which can be significant if the user is performing multiple procedures throughout the day.
The CCU may, in one embodiment, be provided with software executing on the CCU for determining when the camera is coupled to the CCU. Likewise, software may be provided on the CCU for determining when the USB flash/thumb device is coupled to the USB port. The information retrieved from the USB flash/thumb device may comprise data setting, a program(s), or instructions relating to where to retrieve any of the aforementioned information. The retrieved data and/or program(s) execute on the CCU for setting the users preference settings.
It is contemplated that the CCU may comprise, for example, a Field Programmable Gate Array (FPGA) (e.g. a configurable hardware device) or a Digital Signal Processor (DSP) (e.g. a soft configurable device) that may be programmed depending upon the USB flash/thumb device attached thereto.
The system may further be provided such that the user can manipulate the video clip(s) and/or still frame(s) that are saved to the particular storage location. For example, the user may be presented with a video feed of a surgical area in which an endoscope if positioned. The video is presented to the user on a display. The user may then decide that either a portion of video should be recorded or that a still frame(s) can be taken of the area. If the user decides, for example, to take a still frame picture, the picture may be presented to the user on the display. The user can save the still frame as desired and described above. In addition, it is contemplated that the user may desire to manipulate the still frame in some manner, including, for example, cropping the still frame, enlarging a particular area of the still frame, or providing a box or the like around a particular portion of the image to highlight a portion of the surgical area. It is further contemplated that this functionality can be done either before or after the image is saved. In any event, it provides the user with increased functionality with regard to saving and/or manipulating the still frame or video clip. It is still further contemplated that the user can add or append written text or audio commentary to the still frame or video clip as desired.
While the device has been described using a display and keyboard, it is still further contemplated that the video system may use an integrated touch screen controlling system for presentation of image data, control of the imaging device(s), manipulation of the image data and saving of the image data as desired.
For this application the following terms and definitions shall apply:
The term “data” as used herein means any indicia, signals, marks, symbols, domains, symbol sets, representations, and any other physical form or forms representing information, whether permanent or temporary, whether visible, audible, acoustic, electric, magnetic, electromagnetic or otherwise manifested. The term “data” as used to represent predetermined information in one physical form shall be deemed to encompass any and all representations of the same predetermined information in a different physical form or forms.
The term “network” as used herein includes both networks and internetworks of all kinds, including the Internet, and is not limited to any particular network or inter-network.
The terms “first” and “second” are used to distinguish one element, set, data, object or thing from another, and are not used to designate relative position or arrangement in time.
The terms “coupled”, “coupled to”, and “coupled with” as used herein each mean a relationship between or among two or more devices, apparatus, files, programs, media, components, networks, systems, subsystems, and/or means, constituting any one or more of (a) a connection, whether direct or through one or more other devices, apparatus, files, programs, media, components, networks, systems, subsystems, or means, (b) a communications relationship, whether direct or through one or more other devices, apparatus, files, programs, media, components, networks, systems, subsystems, or means, and/or (c) a functional relationship in which the operation of any one or more devices, apparatus, files, programs, media, components, networks, systems, subsystems, or means depends, in whole or in part, on the operation of any one or more others thereof.
The term “surgical suite” as used herein means an integrated surgical system that includes one or more controllers; a bus; one or more medical devices (e.g. cutting/cauterizing tool(s), irrigation tool(s), aspiration tool(s), visualization tool(s), recording and/or printing devices, etc.); where the various devices are coupled to the bus and controlled by an interface device.
In one advantageous embodiment a video imaging system is provided comprising a camera for generating image data, said camera including a camera storage having camera data for identifying the camera. The system further comprises a camera control unit coupled to the camera and receiving the camera data, the camera control unit adjusting internal settings based on received camera information such that the camera control unit receives and processes the image data. The system also comprises an interface port located in the camera control unit and a detachable storage device coupled to the interface port receiving selected image data that is stored thereon. The system is provided such that the interface port is selected from the group consisting of: a USB port, a Firewire port, a serial ATA port and combinations thereof.
In another advantageous embodiment a method for storing image data is provided comprising the steps of storing camera data on a camera, coupling the camera to a camera control unit and transmitting the camera data to the camera control unit. The camera control unit further receives camera information. The method also comprises the steps of configuring the camera control unit based on the received camera information, generating image data with the camera and transmitting the image data to the camera control unit. Finally, the method comprises the steps of coupling a detachable storage device to an interface port located in the camera control unit and saving select image data on the detachable storage device. The method is provided such that the interface port is selected from the group consisting of: a USB port, a Firewire port, a serial ATA port and combinations thereof.
Other objects of the invention and its particular features and advantages will become more apparent from consideration of the following drawings and accompanying detailed description.
Referring now to the drawings, wherein like reference numerals designate corresponding structure throughout the views.
It is contemplated that a camera storage 16 is located on camera 12. The camera storage 16 may comprise any type of storage device for storing camera data thereon. For example, camera storage 16 may comprise RAM, ROM, may be permanently located in camera 12 or may comprise a detachable storage device. Camera information 18 is saved on camera storage 16. Camera information 18 may comprise factory settings for camera 12. In this manner, upon connection of camera 12 to CCU 14, camera information 16 is transmitted to CCU 14 that identifies the type of camera and provides the correct settings for CCU 14 to receive and process information received from the particular camera attached. The CCU 14 is therefore self-configurable to automatically detect the type of camera attached to it. CCU 14 is provided with a processor 20 that receives the camera information 16 and a programmable/configurable controller 22 that is programmed/configured based on the received camera information 16. It should further be noted that camera information may comprise a software program(s) or may comprise data that is used by a program resident on and executing on processor 20. Alternatively, camera information may comprise a first program that is transmitted from camera 12 to CCU 14 for configuring the processor 20 and a second program that runs on programmable/configurable controller 22.
Also depicted in
Interface port 26 is further illustrated on CCU 14. The interface port 26 may comprise a USB port, a firewire port, or a serial ATA port. Port 26 is provided, in one advantageous embodiment, to receive a standard USB connector. In one embodiment, USB port receives detachable storage device 28 that may comprise, a USB flash/thumb device or a USB external hard drive. It is contemplated that the detachable storage device 28 may be set to receive selected image data transmitted from camera 12 to CCU 14. In still another embodiment, it is contemplated that interface port 26 may comprise a wireless coupling to a detachable storage device 28.
Once the CCU 14 is properly programmed/configured to properly process the image data generated by the camera 12 and transmitted to CCU 14, CCU 14 may be programmed to direct selected image data to the detachable storage device 28. For example, a user (physician) may be performing a procedure. It may be advantageous to record a video clip of a portion of the procedure. Alternatively, it may be desired to save one or more still frame images of the procedure for the physician to refer to at a later time. The physician may, select certain portions of the procedure to save (e.g. in video and/or still frame format) to detachable storage device 28. In this manner, the physician can quickly and easily obtain the information on the procedure for immediate review and analysis whether right there in the operating room, immediately after the procedure at the hospital, or even on the physicians computer at their office or home as it is saved to the physicians detachable storage device 28. This is highly advantageous as the physician does not have to wait for the images to be processed on the hospital system in order to access the information, saving time for the doctor.
In yet another embodiment, it is contemplated that a network connection 30 may be coupled to USB port 26 such that the selected information may be transmitted to a storage device via the network. Additionally, the CCU 14 may be coupled to a surgical suite and provided to control various pieces of equipment, such as, via for example, but not limited to, a touch screen controller or the like.
Referring now to
Also depicted in
It is still further contemplated that the display 36 may, on another embodiment, comprise a touch screen controller where some or all of interface controls may be accessible. For example, image data may be provided on display 36 as well as various controls for controlling the connected surgical equipment.
Printer 38 is still further illustrated connected to CCU 14. Printer 38 may comprise virtually any type of printer (e.g. color printer) for printing out still frames corresponding to the image data sent to the CCU 14. The printer could be locally positioned in the operating room, it could be rack mounted, or could be coupled to the system 10 via a network connection at a remote location. It is further contemplated that printer 38 may comprise one or more printers as desired.
Referring back to detachable storage device 28, it is contemplated that not only can select image data be stored thereon, but user settings data may be saved on the detachable storage device 28. While the system 10 is designed to automatically identify the type of camera 12 coupled to CCU 14 and correspondingly adjust CCU 14 according to the identified camera, the physician may have personal preferences for the operation of camera 12 that differ from the default (factory) settings. In this event, the user can set their personal preferences and save these to the detachable storage device 28. Upon coupling the detachable storage device to USB port 26, processor 20 can detect and upload the information and adjust the settings to correspond to the physician's personal preferences. This can be done automatically, or the user may instruct the system 10 to update system configuration according to the personal preferences saved on the detachable storage device 28. In any event, this will save the user the time of having to adjust settings, which can be significant if the user is performing multiple procedures throughout the day on different systems in different operating rooms. The saving of select image data and the sending of user settings data from detachable storage device 28 is further illustrated in
It is contemplated that the user settings data may comprise data system 10 may use to properly set programmable/configurable controller 22, or may comprise a software program(s) that is uploaded onto CCU 14 for executing on the processor 20 and/or programmable/configurable controller 22. For example, in one embodiment it is contemplated that a first program is uploaded to processor 20 for programming the processor, and a second program is uploaded and executed by the processor 20 for proper programming of the programmable/configurable controller 22.
Referring now to
While two different USB ports are illustrated in
Referring back to
Although the invention has been described with reference to a particular arrangement of parts, features and the like, these are not intended to exhaust all possible arrangements or features, and indeed many other modifications and variations will be ascertainable to those of skill in the art.
The present application is a continuation of pending of U.S. patent application Ser. No. 12/267,302, filed on Nov. 7, 2008, which in turn is a continuation-in-part of pending U.S. patent application Ser. No. 10/034,273, filed on Dec. 28, 2001, which is a continuation-in-part of U.S. patent application Ser. No. 10/039,931, filed on Nov. 9, 2001, now U.S. Pat. No. 7,212,227, issued on May 1, 2007. The content of all prior applications is incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
4816909 | Kimura et al. | Mar 1989 | A |
5584292 | Cheung | Dec 1996 | A |
5604530 | Saito et al. | Feb 1997 | A |
5627583 | Nakamura et al. | May 1997 | A |
5754422 | Lowles et al. | May 1998 | A |
5812188 | Adair | Sep 1998 | A |
5868666 | Okada et al. | Feb 1999 | A |
5871439 | Takahashi et al. | Feb 1999 | A |
5896166 | D'Alfonso et al. | Apr 1999 | A |
6184922 | Saito et al. | Feb 2001 | B1 |
6215517 | Takahashi et al. | Apr 2001 | B1 |
6224542 | Chang et al. | May 2001 | B1 |
6249311 | Rouse, Jr. et al. | Jun 2001 | B1 |
6295082 | Dowdy et al. | Sep 2001 | B1 |
6313868 | D'Alfonso et al. | Nov 2001 | B1 |
6360362 | Fichtner et al. | Mar 2002 | B1 |
6452629 | Aizawa et al. | Sep 2002 | B1 |
6638212 | Oshima | Oct 2003 | B1 |
6707490 | Kido et al. | Mar 2004 | B1 |
6710799 | Abnet et al. | Mar 2004 | B2 |
6750902 | Steinberg et al. | Jun 2004 | B1 |
7212227 | Amling et | May 2007 | B2 |
20010051762 | Murata et al. | Dec 2001 | A1 |
20020095501 | Chiloyan et al. | Jul 2002 | A1 |
20030076410 | Beutter et al. | Apr 2003 | A1 |
20030081950 | Gennetten et al. | May 2003 | A1 |
20030220947 | Doui | Nov 2003 | A1 |
20040028390 | Chatenever et al. | Feb 2004 | A9 |
20040141054 | Mochida et al. | Jul 2004 | A1 |
20040201743 | Amling et al. | Oct 2004 | A1 |
20040218065 | Schinner | Nov 2004 | A1 |
20040225185 | Obata et al. | Nov 2004 | A1 |
20050177669 | Peters et al. | Aug 2005 | A1 |
20050228293 | Cahill et al. | Oct 2005 | A1 |
20050278461 | Ohta | Dec 2005 | A1 |
20060034600 | Wang | Feb 2006 | A1 |
20060055793 | Adler et al. | Mar 2006 | A1 |
20060092312 | Tanaka | May 2006 | A1 |
20070124459 | Kasama | May 2007 | A1 |
20080091065 | Oshima et al. | Apr 2008 | A1 |
20080117442 | Kosaka et al. | May 2008 | A1 |
20080218959 | Wu et al. | Sep 2008 | A1 |
20090080562 | Franson | Mar 2009 | A1 |
20090231684 | Gonthier et al. | Sep 2009 | A1 |
20110169987 | Gann | Jul 2011 | A1 |
Number | Date | Country |
---|---|---|
0994614 | Apr 2000 | EP |
1311117 | May 2003 | EP |
1679030 | Jul 2006 | EP |
1739579 | Jan 2007 | EP |
1909490 | Apr 2008 | EP |
63153039 | Jun 1988 | JP |
5277065 | Oct 1993 | JP |
6285017 | Oct 1994 | JP |
11047089 | Feb 1999 | JP |
11298907 | Oct 1999 | JP |
2000165960 | Jun 2000 | JP |
2000175089 | Jun 2000 | JP |
2000325293 | Nov 2000 | JP |
2001099627 | Apr 2001 | JP |
2001157200 | Jun 2001 | JP |
2001350104 | Dec 2001 | JP |
2002326679 | Nov 2002 | JP |
2003288211 | Oct 2003 | JP |
2004007368 | Jan 2004 | JP |
2004191911 | Jul 2004 | JP |
2005519719 | Jul 2005 | JP |
2006128968 | May 2006 | JP |
2006243997 | Sep 2006 | JP |
2006334247 | Dec 2006 | JP |
2007013574 | Jan 2007 | JP |
2007028188 | Feb 2007 | JP |
03099111 | Dec 2003 | WO |
Entry |
---|
Anonymous: “Datacube introduces world•s highest performance CameraLink frame grabber” Internet Article, •Online! Oct. 30, 2001, XP002362612 Retrieved from the Internet: URL:www.datacube.com/downloads/MaxRevProdIntro.htm •retrieved on Jan. 12, 2006! *the whole document*. |
Anonymous: “MaxRevolution datasheet” Internet Article, •Online! pp. 1-2, Retrieved from the Internet: URL:http://www.datacube.com/downloads/Datasheet—MaxRevolution.pdf • retrieved on Jan. 12, 2006 * the whole document*. |
Definition of “software”, The IEEE Standard Dictionary of Electrical and Electronics Terms, Sixth Edition, 1996, p. 1006. European Search Report; Jan. 20, 2006; 3 pages. |
Description of “software”, The IEEE Standard Dictionary of Electrical and Electronics Terms, Sixth Edition, 1996, p. 1006. |
European Search Report; EP 09 17 5038; Jan. 25, 2010; 9 pages. |
European Search Report; Jan. 23, 2006; 4 pages. |
European Search Report, EP07019564, Sep. 8, 2008, 2 Pages. |
Laurence J. Thorpe, et al.; “The All-Digital Camcorder—The Arrival of Electronic Cinematography”; SMPTE Journal, vol. 105, No. 1; Jan. 1, 1996; pp. 13-30. |
Number | Date | Country | |
---|---|---|---|
20120162472 A1 | Jun 2012 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 12267302 | Nov 2008 | US |
Child | 13408635 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 10034273 | Dec 2001 | US |
Child | 12267302 | US | |
Parent | 10039931 | Nov 2001 | US |
Child | 10034273 | US |