General purpose distributed operating room control system

Information

  • Patent Grant
  • 6646541
  • Patent Number
    6,646,541
  • Date Filed
    Tuesday, August 6, 1996
    28 years ago
  • Date Issued
    Tuesday, November 11, 2003
    21 years ago
Abstract
A control system for controlling a plurality of medical devices. The control system includes a controller that receives select and control commands from an input device. The controller compares the select commands and control commands to corresponding lists of commands. The controller provides an output signal to control the medical device if there is a match between the commands and the lists of commands.
Description




BACKGROUND OF THE INVENTION




REFERENCE TO PARENT APPLICATION




1. Field of the Invention




The present invention generally relates to control systems. More particularly, the present invention relates to a control system and apparatus that allows multiple surgical devices to be controlled from one or more input devices. Even more particularly, the present invention provides a run-time configurable control system allowing operating room component connectivity and control.




2. Description of Related Art




Many surgical procedures are performed with multiple instruments. For example, some laproscopic procedures are performed utilizing a robotic arm system produced by Computer Motion, Inc. of Goleta, Calif. to hold and move an endoscope. The surgeon may also use a laser to cut tissue, an electrocautery device to cauterize the tissue, and lights to illuminate the surgical site.




Each instrument has a unique control interface for its operation. Therefore, the surgeon must independently operate each device. For example, the surgeon must utilize a foot pedal to control the electrocautery device, a separate foot pedal to operate the robotic arm, and yet another interface to operate the laser.




Operating multiple devices may distract the surgeon, thereby reducing the efficiency of performing various procedures. Additionally, it is cumbersome utilizing various devices where each device has a separate user interface. If a new device is introduced into the operating room environment, the doctor must learn how to use the new user interface. Additionally, there is currently no known run time configurable system for operating more than one specific operating room device via voice control. As such, if there are two or more devices in the operating room that are voice controlled, the doctor has to remove the microphone used for one device and replace it with the microphone for the other device. Obviously, this creates many problems associated with productivity. Additionally, the necessity of actually switching between many user interfaces takes a measurable amount of time and as such, extends the time that a patient is under anesthesia, which may add to the danger of a procedure.




Therefore, what is needed in the art is a general purpose platform for controlling a plurality of devices such that devices can be added or subtracted from the platform depending upon the environment into which the platform, also known as a control system is introduced. The system may additionally be automatically configured at start up. Additionally, what is needed is a system and method for selecting and operating one of the plurality of the attached devices, namely operating room devices. It is to the solution of the hereinabove mentioned problems to which the present invention is directed.




SUMMARY OF THE INVENTION




In accordance with the present invention there is provided a control system for selecting from and controlling a plurality of devices in an operating room, the control system comprising:




a master controller, the master controller comprising:




a) means for receiving selection commands from a user wherein each selection command is associated with one specific device in electrical communication with the master controller;




b) means for receiving control commands from a user;




c) means for converting selection commands and control commands into corresponding selection signals and control signals;




d) means for routing control signals to a device specified by a selection command received by the means for receiving selection commands.




In accordance with a first aspect of the present invention, there is provided a master controller for selecting and controlling a plurality of devices. Each of the plurality of devices to be controlled are in electrical communication or in wireless communication with the master controller, either directly or via a slave controller which will be discussed in more detail hereinbelow with respect to the second aspect of the present invention.




The master controller includes means for receiving selection commands issued by a user. The selection commands available to the user are based upon the devices in electrical communication with the master controller. The master controller may recognize those devices that are in electrical communication therewith upon startup of the master controller. This will be described in detail in the description of the preferred embodiment. Each device in electrical communication with the master controller is represented by a correspondingly available selection command.




The master controller additionally includes means for receiving control commands from the user. Both the means for receiving selection commands and the means for receiving control commands from a user may be included in a voice control interface (VCI) for receiving voice commands. The system may additionally employ a foot pedal, a hand held device, or some other device which receives selection or control commands or inputs indicative of such commands from a user. The VCI provides signals indicative of a user's selection of a specific device and signals indicative of control commands the user wishes to supply to the device specified by a specific selection command. These are known, respectively, as selection signals and control signals. If the user is using a foot pedal, hand controller or some other input device, the VCI is not utilized as the inputs are already in the form of electrical signals as opposed to voice input. Alternatively, a combination of devices may be used to receive selection and control commands and to provide selection and control signals indicative of such commands.




The master controller additionally includes means for routing control signals to a device specified by a selection command. For example, if the user wants to operate the laser, a device used in many surgeries and contemplated as being included as one of the devices that may be operated via the control system of the present invention, then the user may issue a selection command indicating such, i.e. speak the word “laser” or the words “select laser”. As such, the name of the device may serve as the selection command, or the selection command may be the combination of two or more words.




Subsequent to receiving a selection command from the user and converting the selection command into a selection signal, if necessary, the master controller then routes control commands, or control signals for a selected device indicative of control commands received from the user to the device specified by the preceding selection command. In this exemplary instance, control signals would be routed to the laser. Preferred structures for both selection commands and control commands are disclosed herein in the detailed description of the preferred embodiment of the present invention.




Additionally, a controller may include means for ensuring that control signals indicative of control commands issued subsequent to the receipt of a selection command are, in fact, valid control signals. This is accomplished via a database of valid control commands and grammars that are either prestored in the master, or are prestored in a slave prior to or at system startup which is described hereinbelow.




A second aspect of the present invention is at least one slave electrically connected to the master controller. Each slave controller connected to the master controller operates similarly to the master controller for specific devices electrically connected thereto; additionally, the slave controllers may receive control commands directly from the user if they are to be used as a stand alone unit. However, if they are utilized as slaves then control commands are received at the master controller and converted into control signals and transmitted from the master controller to the slave controller that has the device specified by the last selection command received by the master controller connected thereto . This allows the control system of the present invention to operate with a plurality of different devices without the master controller requiring any knowledge of the devices connected to the slave controllers prior to startup of the control system.




The slave controllers are connected to the master controller just like any other device; however, each slave controller provides the master controller information relating to the specific devices that are connected thereto, so the master controller, generally at startup, is provided information as to exactly what devices are connected to the system. The selection commands available to the user include all devices connected to each of the slave controllers as well as the devices directly connected to the master controller. By providing an open architecture such as that generally set out hereinabove, and more particularly, a master controller and slave controllers, various devices may be controlled from a single controller, or a plurality of controllers, such that a doctor utilizing the control system will not have to switch between different control systems or interfaces, or at a minimum will have an easier interface to control each of the devices. It is additionally envisioned that the main means for selecting and controlling each of the devices will be a voice recognition system which will be described in detail hereinbelow.




Also, the control system may include audio and video outputs which are capable of alerting the user to errors in selecting, or controlling specific devices. The audio and video outputs may additionally be used to alert the user to problems with each of the specific devices as well as to provide status notices as to which device(s) are available, which devices are active, as well as a host of other device operation information which will be discussed further hereinbelow.











For a more complete understanding of the present invention, reference is made to the following detailed description and accompanying drawings. In the drawings, like reference characters refer to like parts, in which:




BRIEF DESCRIPTION OF THE DRAWINGS





FIG. 1

is a block diagram of a master controller in electrical communication with both slave controllers and operating room devices in accordance with the present invention;





FIG. 2

is a block diagram of the voice control interface in accordance with the present invention;





FIG. 3

is a schematic of the voice control interface card in accordance with the present invention;





FIG. 4

is a schematic diagram of a master controller in accordance with a the present invention;





FIG. 5

is an exemplary tree diagram of a grammar for operating a device in accordance with the present invention.











DESCRIPTION OF THE PREFERRED EMBODIMENTS




In accordance with the present invention, there is shown in

FIG. 1

an operating room control system, generally at


10


, in accordance with the present invention. The operating room control system, or control system


10


, generally comprises a master controller


12


, which is preferably attached to at least one slave controller


14


. Although the exemplary preferred embodiment is shown as having both a master controller


12


and at least one slave controller


14


in electrical communication therewith, the control system


10


may be implemented with only a master controller


12


as will be described hereinbelow.




The master controller


12


is electrically connected to and in electrical communication with a plurality of devices


16


via a plurality of communication ports


46


. Alternatively, the master controller


12


may be connected to any slave or specific medical device via wireless communications systems such as IR or RF signal transmitters and receivers on each of the master


12


, slaves


14


, and devices


16


. Some of these devices


16


may be at least one slave controller


14


the operation of which will be described hereinbelow. Other devices that are intended to be electrically connected to the master


10


controller


12


, either directly or via the at least one slave controller


14


include devices that are commonly found in an operating room environment.




For purposes of non-limiting example, directly connected to the master controller


12


in

FIG. 1

is an electrocautery device


18


. A robotic arm


20


for holding and manipulating an endoscope, such as that produced by Computer Motion of Goleta, Calif. and marketed under the tradename AESOP is electrically connected with the master controller


12


via one of the at least one slave controllers


14


. Also in electrical communication with the master controller


12


via a slave controller is an operating room table


22


, an insulator


24


, and an operating room lighting system


26


. It is envisioned that any electrically controlled device utilized in an operating room environment may be attached to the master controller


12


either directly or via one of the at least one slave controllers


14


.




The master controller


12


is configured to provide a main user interface for each of the devices electrically connected thereto. As such, a doctor can manipulate the operating room environment in a simpler and more direct fashion. Currently, each device in an operating room includes a separate interface. The proximity of the doctor to each interface requires a substantial amount of movement either on the part of the doctor or a nurse to effectuate changes required by the doctor during a medical procedure.




For example, if the doctor needs the lights dimmed slightly, then a nurse currently has to approach the lighting system of the operating room and dim the lights. It would be highly advantageous for the doctor to be able to control such changes directly to keep movement in the operating room to a minimum to increase sterility, and because direct control by the doctor of the operating room environment and the devices he or she is using ensures the highest degree of safety with the smallest amount of error due to miscommunication between people in the operating room. Minimization of movement in an operating room environment is additionally advantageous to reduce the risk of contamination of specific sterile instruments, as well as the operative site itself.




To effectuate such a control system


10


, the master controller


12


generally comprises a voice control interface (VCI)


32


. The VCI


32


includes means


28


for receiving selection commands from a user wherein each selection command is associated with one specific device in electrical communication with the master controller


12


. This is accomplished by providing the master controller


12


a list of the devices that are in electrical communication therewith upon start-up of the control system


10


. The process and hardware for providing the master controller


12


with such a list will be described hereinbelow.




As shown in

FIG. 2

, The VCI


32


additionally comprises means


30


for receiving control commands from a user. In the preferred embodiment, both the means


28


for receiving selection commands and the means


30


for receiving control commands may coexist in the VCI


32


as a microphone


34


, for receiving the actual speech of the user, an analog to digital converter


36


for converting the analog speech into a digital representation thereof, a feature extractor


38


for converting the digital representation to a digital representation that is suited for decoding, and a decoder


40


for comparing the features of the transformed digital representation of the speech to a set of presaved user models


41


to determine whether the speech received at the microphone


34


was a selection command, a control command, or some other speech to be ignored by the master controller


12


. Such “other speech” would include extraneous noise, speech between the doctor and another person in the operating suite, as well as speech of other people in the operating suite in general.




Feature extractors, such as the one employed in the present invention, are well known in the art of voice recognition. Feature vectors are preferably generated by the feature extractor


38


utilizing techniques such as Mel-Cepstrum, or linear prediction. It is to be appreciated that such techniques are well-known and are employed in the feature extractor


38


to develop feature vectors that represent speech received by the VCI


32


.




Additionally, voice software is also available that provides extractors and decoders such as the ones set out in the present application. As such, although a specific implementation is presented herein for voice recognition, it may be carried out by the inclusion of a pre-made voice recognition system that is purchased from a vendor such as Creative labs under the tradename VOICE BLASTER, Dragon Dictate produced by Dragon Systems, or VOICE PAD produced by Kurzweil Al of Massachusetts, each of these companies produce front-end voice recognition systems.




The decoder


40


utilizes the information produced by the feature extractor


38


, by matching the stored user models


41


to the output of the feature extractor


38


utilizing a well-known method, such as a Hidden Markov Modeling. One Hidden Markov Model (HMM) is created for each phoneme. The HMMs are trained to identify their respective phonemes given the Mel-Cepstrum output from the feature extractor


38


. The use of Hidden Markov Models for voice recognition is generally well known.




The stored user models


41


used by the decoder


40


may be placed in a memory


44


associated with the VCI itself. As depicted in

FIG. 3

, such a memory


44


may be incorporated onto a VCI board


46


as an EPROM, a PROM or some other programmable memory storage device. However, it is preferable to store the models on a transportable memory device


45


, such as a disk, transportable storage medium or the like. It is even more preferable that the transportable memory device be a PCMCIA format card


48


as data transfer times are reduced and the ruggedness of the system is increased. PCMCIA format cards retain data better than floppy disks. Additionally, the configuration of currently produced PCMCIA cards allows for additional program data to be stored on the PCMCIA format card and downloaded into the master controller


12


when system changes are made (i.e. upgrades to the system software etc. ). Therefore, the use of such a PCMCIA form factor card is preferable in the control system


10


of the present invention.





FIG. 3

depicts, in more detail, the VCI


32


. Once the user's speech has been digitized at the A/D converter


36


, it is fed to the feature extractor


38


. The feature extractor


38


functions as set out hereinabove. In more detail, the feature extractor


38


converts the digitized signal into a representation that is suitable for decoding (e.g. Mel-Cepstrum). This representation is then passed to the decoder


40


which compares the representations produced at the feature extractor


38


to the models stored on a memory


44


which contains the user models


41


. The memory


44


may be supplied the models


41


via a downloading process from the transportable memory device


45


. The models stored in the memory


44


constitute a lexicon, which is the entire set of valid pronunciations, or all of the valid words that the master


12


is to recognize. Because the lexicon is stored on a transportable data storage medium


41


, the lexicon may be added to or subtracted from depending upon the devices that are to be connected to the master controller


12


. In this fashion, if new equipment is purchased at a date subsequent to the purchase of the master controller


12


, then new words may be added to the lexicon through a well-known data acquisition technique, wherein the user speaks the words that are to be added to the lexicon and they are used to update the user models


41


on the transportable memory


45


.




Most preferable to the implementation of the present system


10


, there is provided one master controller


12


and at least one slave


14


controller. In such a configuration, which will be discussed in more detail hereinbelow, once the master controller or master


12


receives a selection command, all speech received at the VCI


32


of the master


12


that is not a new selection command is fed to the feature extractor of the appropriately attached slave


14


. In this way, a plurality of devices may be attached to several different controllers and the lexicon stored in each controller does not have to be downloaded into the master


12


. The master


12


only contains the lexicon of all the devices that may be connected to the system


10


as well as the lexicon for the commands of those devices that are directly attached to the master


12


as opposed to being attached to a slave


14


which is, in turn, attached to the master


12


.




All the other controllers, which for purposes herein, are referred to as slaves


14


, include the lexicon for the devices that are directly connected thereto. For example, in

FIG. 1

, one slave includes the lexicon for the control commands and the select commands for a robotic arm and an operating table. This way, that controller can have a microphone plugged into the VCI which is included in the unit and it may serve as a solo unit. Or, depending upon the configuration of the control system


10


, it may actually server as a master. The entire system


10


is configurable at startup and as such is expandable. Every controller preferably includes a VCI.




The decoder


40


additionally contains a language model. This term is well-known on the art and will be explained further hereinbelow. In essence, certain words may be validly said in certain orders. The language model is implemented by developing a network representing all the valid possibilities of word combinations and decoding the extracted vectors along each path in the network. Whichever path has the highest probability of matching the incoming speech, the information associated with that path is selected by the decoder


40


. It is to additionally be appreciated that to carry out the present invention, a silence path is available and an unrecognized command path is provided as well. As such, even though a user speaks, if valid commands are not given, the system


10


will not respond.





FIG. 5

sets out one exemplary language model for the proper operation of the robotic arm


20


. Such language models are developed for each device in electrical communication with the master controller


12


. Once again, a device may be in wireless communication with the master controller


12


. It is preferable to store the language models for each device in their respective controller. For example, if a device is directly connected to a slave


14


then the control language model (that language model containing the language used to control the device) for the device is stored in the slave VCI. If the device is directly connected to the master


12


then the control language model is included in the VCI of the master


12


. It is to be appreciated that the select language model must be stored in the master


12


for all the possible devices that may be directly connected to the master


12


as opposed to being connected to a slave. As such, depending upon what devices are connected to the system at any given time, a user may select from any of the connected devices. If a device is not connected, the system will recognize this upon startup and will not attempt to access the device as it is not there. This will be discussed in more detail hereinbelow.




If a device is connected directly to the master controller


12


, then it is preferable to store the language model for controlling the device either in the VCI itself, or in the transportable memory


45


. The advantages of this configuration are set out hereinbelow with respect to the startup of the control system


10


.




If a select command is given for a device that is directly connected to the master


12


, then the information is passed to the decoder in the master


12


and the decoder


40


generates a packet


50


of information. The packet includes the address of the device to be operated, a code representing the specific operation, and a checksum to ensure that as the packet


50


is transferred over various busses, the data does not become corrupted. Such information packaging is well-known although the specific package set out hereinabove has heretofore not been utilized to control one of a plurality of medical devices. Data checking using a checksum is also well-known in the art.




The decoder


40


, upon decoding a valid selection command, activates the address of the device which has been stored in a lookup table and is related to the device. This is accomplished as follows. At startup every controller, whether the master


12


or a slave


14


knows the addresses of its communication ports. It sends a query to each communication port to see if a device is connected thereto. If so, an adapter connected to the device specifies the name of the device and an indication that it is functioning properly. Such adapters are well known in the electrical arts and as such will not be further discussed herein. Every slave controller establishes a lookup table of addresses and associated device codes or names. The device codes or names are transmitted to the master


12


which includes all the devices and the corresponding address of the port to which the associated slave controller is connected to the master


12


.




The addresses of all devices available are initially stored in a memory associated with the VCI such that a multiplexer may be used to activate a specific address or make that address accessible. In this fashion, once the master


12


receives a valid selection command, which it is able to identify, it then routes all the control commands to the VCI of the appropriate slave controller in the case where the device selected is connected to a slave controller. If the selected device is connected directly to the master


12


then the control commands are fed through the decoder


40


of the master


12


and the control information packet is produced and sent to the device via the central processor


44


of the master


12


. In this fashion, the VCI of a slave is fed control signals and processes those signals as though they were received from the A/D converter, which is where the input to the slave is routed. Every slave can be attached to one master, and that master, can, in turn be attached to another master, thus providing a daisychain of slaves all of which are connected to one master having a microphone attached thereto.




In addition to the VCI


32


, the master controller


12


comprises means


42


for routing control signals to a device specified by a selection command received at the VCI


32


.

FIG. 4

depicts the master controller


12


having one slave controller


14


and two medical devices in electrical communication therewith. The master controller includes the VCI


32


as well as the means


42


for routing control signals. Once the speech has been extracted and decoded into either a selection command, or a control command, the specific command is transmitted to the Central Processor


44


of the master controller


12


.




In the preferred embodiment, the means


42


for routing control signals is incorporated into the central processor


44


of the master controller


12


. The means


42


for routing is essentially an addressable multiplexer and has a memory of the addresses for each device and their associated one of the plurality of communication ports


46


to which they are connected. If the addresses are stored in the decoder


40


, then the central processor


44


will be in communication with that memory.




The means


42


for routing, takes the packet


50


of information or the control signal, if the information is to be sent to a slave


14


, checks which of the plurality of communication ports


46


it is to direct the information to and then directs the information to the desired one of the plurality


46


of ports.




The addresses and their associated ports are uploaded into the master


12


upon startup of the system. This procedure is embedded in the software and such a procedure is well-known in the art.




For example, in

FIG. 4

, an electrocautery device


18


transmits an address to the master controller


12


. The address is received at a one of a plurality of communication ports


46


, the address is saved in the memory along with the associated communication port number. It is to be appreciated that the valid selection commands are stored on the transportable memory. For devices directly connected to the master, the language model may be stored in a memory in the master


12


or in the transportable memory. Language models are stored in associated slaves for devices that are directly connected to a slave


14


. In this fashion, upon startup, the master


12


knows all devices that are connected to the system, as each slave sends to the master the addresses of each device and the name (i.e. coded phonemes that constitute the device) of the device. The names of the devices are uploaded into the master so that the validity of selection commands may take place in the master


12


. However, language models for the validity of control commands are not transmitted to the master


12


as this would take much time and slow the control system


10


down. Therefore, the master controller


12


actually contains a subset of the grammar necessary to operate the devices in connection therewith, but that language model is limited to only the device names. The information regarding valid sequences of control commands (i.e. their control language model) is stored on each slave controller to which they are connected. Of course, if the device


14


is directly connected to the master, then the language model is stored at the master


12


as described hereinabove.




The control system


10


in accordance with the present invention provides a way to configure and reconfigure an operating room in a very simple fashion. Additionally, it is to be appreciated that the system


10


provides an intuitive interface whereby a user can select a device to control and then subsequently control that device. The system checks to ensure that control commands received for a specific device are valid.




Additionally, the system


10


requires the inclusion of adapters


52


placed intermediate a specific one of the plurality of devices


16


and a slave or the master


12


. The adapters


52


transmit signals to their respective slave


14


or master


12


indicative of the address of the device, and translate control signals sent from the controller to which they are connected to signals understood by the particular device for which they are intended. Such adapters are easily constructed and are well-known in the art. Additionally, such adapters may be included either in the respective slave


14


or master


12


or attached to the particular one of the plurality of devices


16


itself. There is substantial advantage to attaching the adapters


52


to the devices


16


as then the devices may be attached to any port, whereas, if the adapters are attached interior the controller


12


,


14


, the specific device for which they were designed must be attached to the specific one of the plurality of communication ports


46


.




If new devices are added to the system, or if improvements or upgrades are made to the system software, such changes may be incorporated into a PCMCIA format card, such as the card that stores the user voice models. The card may be inserted into the same interface, however, system software may be uploaded into the master to make the upgrade without having to disassemble the master. This is accomplished by incorporating a serial interface on the PCMCIA format card. As such, the central processor


44


additionally checks upon startup whether there is a system upgrade to be made by checking the data being supplied by the PCMCIA format card. Checking the activity of a serial interface is well known, however it is not heretofore known to incorporate a serial interface on a single PCMCIA format card. Therefore, the combination is seen to be novel. Additionally, it is heretofore not known to incorporate voice models on such a PCMCIA format card.




Each of the at least one slave


14


is substantially similar to the master controller


12


. And, each of the plurality of slaves


14


may include the full VCI so that each slave


14


can operate as a master. Alternatively, although not preferred, the slaves may not include the feature extractor, and only contain a subset of the language model (i.e. control commands) relating to the operation of each specific device. This is all that may be necessary in the slave because the slave receives from the master controller the specific address a command is to be sent and that it is in fact a command. Therefore, the slave only needs to check to ensure that it is a valid command for the specific device. In this fashion, devices may be directly connected to the master, or they may be connected to a slave which is in communication with the master


12


.




Finally, the system


10


may include output means including a video monitor


86


and a speaker


88


. The speaker may be incorporated into the VCI


32


via a D/A converter


90


such that the system may communicate to the user any errors committed by the user in operating or selecting a specific device. Additionally, the output means may communicate system errors or the malfunction of a specific device. Such information is included in each specific adapter and is specific to the device attached to the adapter. It is to be appreciated that such communications would be transmitted to the master where they would be either additionally or visually displayed. The system and controller in accordance with the invention may additionally include a foot controller, a hand controller or other well-known controllers. Each of these controllers may be used to control any of the devices connected to the master or a slave, as is described in the patent application incorporated herein by reference. As such, the VCI may only be used to select certain devices, and once selected the device may be controlled via one of the well-known controllers. Ultimately, the flexibility of such a system can reduce costs and increase the safety of surgical procedures.




While certain exemplary embodiments of the present invention have been described and shown on the accompanying drawings, it is to be understood that such embodiments are merely illustrative of and not restrictive on the broad invention, and that this invention not be limited to the specific constructions and arrangements shown and described, since various other modifications may occur to those ordinarily skilled in the art. As such,



Claims
  • 1. A control system for controlling a plurality of medical devices through a single interface, comprising:a plurality of medical devices; an input device; a controller coupled to the input device and the plurality of medical devices, the controller to receive an audible select command and a voice qualifier corresponding to one of the medical devices and an audible control command corresponding to a control of one of the medical devices from the input device, said controller provides an output signal corresponding to the audible control command to said medical device selected by the audible select command only if the voice qualifier accompanies the audible control command.
  • 2. The control system of claim 1 wherein the input device is a speech circuit that receives voice signals, and converts the voice signals to select and control signals.
  • 3. The control system of claim 1, where the plurality of medical device comprise one or more of the following: one or more robotic arms, operating room table, electro-cautery device, laser, insufflator, and lighting system.
  • 4. The control system of claim 1, wherein at system startup, the controller receives signals from each of the plurality of medical devices coupled thereto and stores the select signals corresponding to the plurality of medical devices in a memory.
  • 5. The control system of claim 1, wherein the controller is coupled to the one or more of the plurality of medical devices via wireless communications.
  • 6. The control system of claim 1, wherein the controller transmits one or more packets of information to the medical device for controlling the medical device if there is a match.
  • 7. A device for receiving input commands and controlling a plurality of devices used in an operating room environment, through a single audible interface, comprising:a controller to receive an audible select command and a voice qualifier corresponding to one of the devices and an audible control command corresponding to a control of one of the devices, said controller provides an output signal corresponding to the audible control command to said medical device selected by the audible select command only if the voice qualifier accompanies the audible control command.
  • 8. The device of claim 7, wherein at system startup, the controller to receive signals from each of the plurality of devices coupled thereto and stores the select signals corresponding to the plurality of devices in a memory.
  • 9. The device of claim 7, wherein the controller is coupled to the one or more of the plurality of devices via wireless communications.
  • 10. The device of claim 7, wherein the controller to transmit one or more packets off information to the device for controlling the device if there is a match.
REFERENCE TO CROSS-RELATED APPLICATIONS

This application is a continuation-in-part of application Ser. No. 08/310,665, filed on Sep. 22, 1994, pending.

US Referenced Citations (186)
Number Name Date Kind
977825 Murphy Dec 1910 A
3171549 Orloff Mar 1965 A
3280991 Melton et al. Oct 1966 A
4058001 Waxman Nov 1977 A
4128880 Cray, Jr. Dec 1978 A
4221997 Flemming Sep 1980 A
4367998 Causer Jan 1983 A
4401852 Noso et al. Aug 1983 A
4456961 Price et al. Jun 1984 A
4460302 Moreau et al. Jul 1984 A
4474174 Petruzzi Oct 1984 A
4491135 Klein Jan 1985 A
4503854 Jako Mar 1985 A
4517963 Michel May 1985 A
4523884 Clement et al. Jun 1985 A
4586398 Yindra May 1986 A
4604016 Joyce Aug 1986 A
4616637 Caspari et al. Oct 1986 A
4624011 Watanabe et al. Nov 1986 A
4633389 Tanaka et al. Dec 1986 A
4635292 Mori et al. Jan 1987 A
4641292 Tunnell et al. Feb 1987 A
4655257 Iwashita Apr 1987 A
4672963 Barken Jun 1987 A
4676243 Clayman Jun 1987 A
4728974 Nio et al. Mar 1988 A
4750136 Arpin Jun 1988 A
4762455 Coughlan et al. Aug 1988 A
4791934 Brunnett Dec 1988 A
4791940 Hirschfeld Dec 1988 A
4794912 Lia Jan 1989 A
4815006 Andersson et al. Mar 1989 A
4815450 Patel Mar 1989 A
4837734 Ichikawa et al. Jun 1989 A
4852083 Niehaus et al. Jul 1989 A
4853874 Iwamoto et al. Aug 1989 A
4854301 Nakajima Aug 1989 A
4860215 Seraji Aug 1989 A
4863133 Bonnell Sep 1989 A
4883400 Kuban et al. Nov 1989 A
4930494 Takehana et al. Jun 1990 A
4945479 Rusterholz et al. Jul 1990 A
4949717 Shaw Aug 1990 A
4954952 Ubhayakar et al. Sep 1990 A
4965417 Massie Oct 1990 A
4969709 Sogawa et al. Nov 1990 A
4969890 Sugita et al. Nov 1990 A
4979933 Runge Dec 1990 A
4979949 Matsen, III et al. Dec 1990 A
4980626 Hess et al. Dec 1990 A
4989253 Liang et al. Jan 1991 A
4996975 Nakamura Mar 1991 A
5019968 Wang et al. May 1991 A
5020001 Yamamoto et al. May 1991 A
5065741 Uchiyama et al. Nov 1991 A
5078140 Kwoh Jan 1992 A
5086401 Glassman et al. Feb 1992 A
5091656 Gahn Feb 1992 A
5097829 Quisenberry Mar 1992 A
5097839 Allen Mar 1992 A
5098426 Sklar et al. Mar 1992 A
5105367 Tsuchihashi et al. Apr 1992 A
5109499 Inagami et al. Apr 1992 A
5123095 Papadopoulos et al. Jun 1992 A
5131105 Harrawood et al. Jul 1992 A
5142930 Allen et al. Sep 1992 A
5145227 Monford, Jr. Sep 1992 A
5166513 Keenan et al. Nov 1992 A
5175694 Amato Dec 1992 A
5182641 Diner et al. Jan 1993 A
5184601 Putman Feb 1993 A
5187574 Kosemura et al. Feb 1993 A
5196688 Hesse et al. Mar 1993 A
5201325 McEwen et al. Apr 1993 A
5201743 Haber et al. Apr 1993 A
5217003 Wilk Jun 1993 A
5221283 Chang Jun 1993 A
5228429 Hatano Jul 1993 A
5230623 Guthrie et al. Jul 1993 A
5236432 Matsen, III et al. Aug 1993 A
5251127 Raab Oct 1993 A
5257999 Slanetz, Jr. Nov 1993 A
5271384 McEwen et al. Dec 1993 A
5279309 Taylor et al. Jan 1994 A
5282806 Haber et al. Feb 1994 A
5289273 Lang Feb 1994 A
5289365 Caldwell et al. Feb 1994 A
5299288 Glassman et al. Mar 1994 A
5300926 Stoeckl Apr 1994 A
5303148 Mattson et al. Apr 1994 A
5304185 Taylor Apr 1994 A
5305203 Raab Apr 1994 A
5305427 Nagata Apr 1994 A
5309717 Minch May 1994 A
5313306 Kuban et al. May 1994 A
5320630 Ahmed Jun 1994 A
5335313 Douglas Aug 1994 A
5337732 Grundfest et al. Aug 1994 A
5339799 Kami et al. Aug 1994 A
5343385 Joskowicz et al. Aug 1994 A
5343391 Mushabac Aug 1994 A
5345538 Narayannan et al. Sep 1994 A
5357962 Green Oct 1994 A
5368015 Wilk Nov 1994 A
5368428 Hussey et al. Nov 1994 A
5371536 Yamaguchi Dec 1994 A
5382885 Salcudean et al. Jan 1995 A
5388987 Badoz et al. Feb 1995 A
5395369 McBrayer et al. Mar 1995 A
5397323 Taylor et al. Mar 1995 A
5402801 Taylor Apr 1995 A
5403319 Matsen, III et al. Apr 1995 A
5408409 Glassman et al. Apr 1995 A
5410638 Colgate et al. Apr 1995 A
5417210 Funda May 1995 A
5417701 Holmes May 1995 A
5422521 Neer et al. Jun 1995 A
5431645 Smith et al. Jul 1995 A
5434457 Josephs et al. Jul 1995 A
5442728 Kaufman et al. Aug 1995 A
5445166 Taylor Aug 1995 A
5451924 Massimino et al. Sep 1995 A
5455766 Scheller et al. Oct 1995 A
5458547 Teraoka et al. Oct 1995 A
5458574 Machold et al. Oct 1995 A
5476010 Fleming et al. Dec 1995 A
5490117 Oda Feb 1996 A
5506912 Nagasaki et al. Apr 1996 A
5512919 Araki Apr 1996 A
5515478 Wang May 1996 A
5544654 Murphy et al. Aug 1996 A
5553198 Wang et al. Sep 1996 A
5562503 Ellman et al. Oct 1996 A
5571110 Matsen, III et al. Nov 1996 A
5572999 Funda et al. Nov 1996 A
5609560 Ichikawa et al. Mar 1997 A
5626595 Sklar et al. May 1997 A
5629594 Jacobus et al. May 1997 A
5630431 Taylor May 1997 A
5631973 Green May 1997 A
5636259 Khutoryansky et al. Jun 1997 A
5649956 Jensen et al. Jul 1997 A
5657429 Wang et al. Aug 1997 A
5658250 Blomquist et al. Aug 1997 A
5676673 Ferre et al. Oct 1997 A
5695500 Taylor et al. Dec 1997 A
5696574 Schwaegerle Dec 1997 A
5696837 Green Dec 1997 A
5718038 Takiar et al. Feb 1998 A
5727569 Benetti et al. Mar 1998 A
5735290 Sterman et al. Apr 1998 A
5737711 Abe Apr 1998 A
5749362 Funda et al. May 1998 A
5754741 Wang et al. May 1998 A
5762458 Wang et al. Jun 1998 A
5774841 Salazar et al. Jun 1998 A
5776126 Wilk et al. Jul 1998 A
5779623 Bonnell Jul 1998 A
5792135 Madhani et al. Aug 1998 A
5792178 Welch et al. Aug 1998 A
5797900 Madhani et al. Aug 1998 A
5800423 Jensen Sep 1998 A
5807284 Foxlin Sep 1998 A
5807377 Madhani et al. Sep 1998 A
5807378 Jensen et al. Sep 1998 A
5808665 Green Sep 1998 A
5810880 Jensen et al. Sep 1998 A
5813813 Daum et al. Sep 1998 A
5814038 Jensen et al. Sep 1998 A
5817084 Jensen Oct 1998 A
5825982 Wright et al. Oct 1998 A
5836869 Kudo et al. Nov 1998 A
5844824 Newman et al. Dec 1998 A
5855583 Wang et al. Jan 1999 A
5859934 Green Jan 1999 A
5860995 Berkelaar Jan 1999 A
5876325 Mizuno et al. Mar 1999 A
5878193 Wang et al. Mar 1999 A
5882206 Gillio Mar 1999 A
5887121 Funda et al. Mar 1999 A
5931832 Jensen Aug 1999 A
5950629 Taylor et al. Sep 1999 A
5970457 Brant et al. Oct 1999 A
6024695 Taylor et al. Feb 2000 A
6278975 Brant et al. Aug 2001 B1
6463361 Wang et al. Oct 2002 B1
Foreign Referenced Citations (11)
Number Date Country
0239409 Sep 1987 EP
0424687 Feb 1991 EP
0424687 May 1991 EP
0776738 Jan 1992 EP
A-0494943 Aug 1995 EP
WO 9220295 Nov 1992 WO
WO 9313916 Jul 1993 WO
WO 9418881 Sep 1994 WO
WO 9426167 Nov 1994 WO
WO 9715240 May 1997 WO
WO 9825666 Jun 1998 WO
Non-Patent Literature Citations (39)
Entry
Aicha Guerrouad, “Voice Control in the Surgery Room,” IEEE Engineering in Medicine & Biology Society 11th Annu International Conference 1989.*
Transcript of a video presented by SRI at the 3rd World Congress of Endoscopic Surgery in Bordeaux on Jun. 18-20, 1992, in Washington on Apr. 9, 1992, an in San Diego, CA on Jun. 4-7, 1992 entitled “Telepresence Surgery—The Future of Minimally Invasive Medicine”.
Statutory Declaration of Dr. Philip S. Green, presenter of the video entitled “Telspresence Surgery —The Future of Minimally Invasive Medicine”.
Abstract of a presentation “Telepresence: Advanced Teleoperator Technology for Minimally Invasive Surgery” (P. Green et al.) given at the 3rd World Congress of Endoscopic Surgery in Bordeaux, Jun. 18-20, 1992.
Abstract of a presentation “Telepresence: Advanced Teleoperator Technology for Minimally Invasive Surgery”, (P. Green et al.) given at “Medicine meets virtual reality” symposium in Sna Diego, Jun. 4-7, 1992.
Abstract of a presentation “Camera Control for Laparoscopic Surgery by Speech-Recognizing Robot: Constant Attention and Better Use of Personnel” (Colin Besant et al.) given at the 3rd World Congress of Endoscopic Surgery in Bordeaux, Jun. 18-20, 1992.
“A Literature Review: Robots in Medicine” (B Preising et al.) IEEE Jun. 1991.
“Robots for the Operating Room” (Elizabeth Corcoran), The New York Times, Sunday Jul. 19, 1992, Section 3, p. 9, col. 1.
“Taming the Bull: Safety in a Precise Surgical Robot” (Russell H. Taylor et al.), IEEE 1991.
Abstract of a presentation “Design Considerations of a New Generation Endoscope Using Robotics and Computer Vision Technology” (S.M. Krishnan et al.) given at the 3rd World Congress of Endoscopic Surgery in Bordeaux, Jun. 18-20, 1992.
Abstract of a presentation “3-D Vision Technology Applied to Advanced Minimally Invasive Surgery Systems” given at the 3rd World Congress of Endoscopic Surgery in Bordeaux, Jun. 18-20, 1992.
“Analysis of the Surgeon's Grasp for Telerobotic Surgical Manipulation” (Frank Tendick and Lawrence Stark), IEEE 1989.
“Kinematic Control and Visual Display of Redundant Teleoperators” (Hardi Das et al.), IEEE 1989.
“A New System for Computer Assisted Neurosurgery” (S. Lavallee), IEEE 1989.
“An Advanced Control Micromanipulator for Surgical Applications” (Ben Gayed et al.), Systems Science vol. 13 1987.
“Force Feedback-Based Telemicromanipulation for Robot Surgery on Soft Tissues” (A.M. Sabatini et al.), IEEE 1989.
“Six-Axis Bilateral Control of an Articulated Slave Manipulator Using a Cartesian Master Manipulator” (Masao Inoue), Advanced Robotics 1990.
“On a Micro-Manipulator for Medical Application—Stability Consideration of its Bilateral Controller” (S. Majima et al.), Mechatronics 1991.
“Controlling Remote Manipulators through Kinesthetic Coupling” (A.K. Bejczy), Computers in Mechanical Engineering 1983.
“Design of a Surgeon-Machine Interface for Teleoperated Microsurgery” (Steve Charles M.D. et al.), IEEE 1989.
“A Robot in an Operating Room: A Bull in a China Shop” (J.M. Dolan et al.), 1987.
Abstract of a presentation “Concept and Experimental Application of a Surgical Robotic System the Steerable MIS Instrument SMI” given at the 3rd World Congress of Endoscopic Surgery in Bordeaux, Jun. 18-20, 1992.
Abstract of a presentation given at the 3rd World Congress of Endoscopic Surgery in Bordeaux, Jun. 18-20, 1992, entitled “Session 15/1”.
Abstract of a presentation “A Pneumatic Controlled Sewing Device for Endoscopic Application the MIS Sewing Instrument MSI” given at the 3rd World Congress of Endoscopic Surgery in Bordeaux, Jun. 18-20, 1992.
Abstract of a presentation given at the 3rd World Congress of Endoscopic Surgery in Bordeaux (Jun. 18-20, 1992), entitled “Session 15/2”.
Abstract of a presentation given at the 3rd World Congress of Endoscopic Surgery in Bordeaux (Jun. 18-20, 1992), entitled Session 15/4.
Abstract of a presentation given at the 3rd World Congress of Endoscopic Surgery in Bordeaux (Jun. 18-20, 1992), entitled “Session 15/5”.
“Properties of Master-Slave Robots” (C. Vibet), Motor-con 1987.
“A New Microsurgical Robot System for Corneal Transplantation” (Noriyuki Tejima), Precision Machinery 1988.
“Human/Robot Interaction via the Transfer of Power and Information Signals—Part I: Dynamics and Control Analysis” (H. Kazerooni), IEEE 1989.
“Human/Robot Interaction via the Transfer of Power and Information Signals—Part II: An Experimental Analysis” (H. Kazerooni), IEEE 1989.
“Power and Impedance Scaling in Bilateral Manipulation” (J. Edward Colgate), IEEE 1991.
“S.M.O.S.: Stereotaxical Microtelemanipulator for Ocular Surgery” (Aicha Guerrouad and Pierre Vidal), IEEE 1989.
“Motion Control for a Sheep Shearing Robot”(James P. Trevelyan et al.), Proceedings of the 1st International Symposium on Robotics Research, MIT, Cambridge, Massachusetts, USA, 1983.
“Robots and Telechirs” (M.E. Thring), Wiley 1983.
Industrial Robotics (Gordon M. Mair), Prentics Hall 1988 (pp. 41-32, 49-50, 54, 203-209 enclosed).
“Student Reference Manual for Electronic Instrumentation Laboratories” (Wolf et al.), Prentice Hall, New Jersey 1990, pp. 498 and 499.
“Surgery in Cyberspace” (TAUBES), Discover Magazine, Dec. 1994.
Wolf et al., “Student Reference Manual for Electronic Instrumentation Laboratories,”Prentice Hall, New Jersey, 1990, pp. 498 & 499. (No month).
Continuation in Parts (1)
Number Date Country
Parent 08/669629 Jun 1996 US
Child 08/693352 US