Patent Grant
9244523
The present invention relates to a manipulator system, and more particularly, to a master-slave type medical manipulator system.
In the past, master-slave type manipulator systems have been known as medical manipulators that support surgical operations. The medical manipulators according to the related art include a master grip (master manipulation unit) that manipulates and inputs an operation of a tool (slave motion unit) mounted on a slave manipulator and used for a surgical operation. In a medical manipulator, a movement of a master grip is transmitted to a tool when a surgeon who is an operator manipulates the master grip. Forcipes, needle holders, and the like are used as the tools to which a movement of the master grip is transmitted.
For example, as a manipulator system according to the related art, a medical robot system is disclosed in U.S. Pat. No. 7,778,733. In the medical robot system, opening and closing operations of an end effector are controlled by opening and closing an input handle.
According to a first aspect of the present invention, a manipulator system includes a master manipulation unit, a slave motion unit, an interlock control unit, and an interlock permission input unit. An operator performs a manipulation input using the master manipulation unit. The slave motion unit is configured to operate in accordance with the manipulation input. The interlock control unit analyzes the manipulation input and performs control to operate the slave motion unit, interlocking with the manipulation input. The interlock permission input unit is able to be manipulated by the operator and transmits, to the interlock control unit, an interlock permission mode signal used to enter a mode in which interlock of the slave motion unit is permitted based on the manipulation input of the mater manipulation unit when the operator manipulates the interlock permission input unit. The interlock control unit stops the interlock control when the operation of the slave motion unit is deviated from an operation corresponding to the manipulation input, and monitors the manipulation input of the master manipulation unit and an operation state of the slave motion unit. The interlock control unit interlocks the operation of the slave motion unit with the operation corresponding to the manipulation input after the interlock control unit receives the interlock permission mode signal, when detects that the manipulation input matches the operation state.
According to a second aspect of the present invention, in the manipulator system according to the first aspect of the present invention, the master manipulation unit of the manipulator system may include a manipulation member and a master angle detection unit. The manipulation member may be provided to be opened and closed in order to perform the manipulation input. The master angle detection unit may detect an opening and closing angle of the manipulation member and transmits a detection value of the opening and closing angle of the manipulation member to the interlock control unit. The slave motion unit may include an opening and closing motion unit and a slave angle detection unit. The opening and closing motion unit may be provided to be opened and closed. The slave angle detection unit may detect an opening and closing angle of the opening and closing motion unit and transmits a detection value of the opening and closing angle of the opening and closing motion unit to the interlock control unit. The interlock control unit may interlock the slave motion unit with an operation corresponding to the manipulation input after the interlock control unit receives the interlock permission mode signal, when the detection value of the opening and closing angle of the manipulation member corresponds to the detection value of the opening and closing angle of the opening and closing motion unit, as well as when the detection value of the opening and closing angle of the manipulation member is changed in a closing direction of the manipulation member.
According to a third aspect of the present invention, the manipulation system according to the first or second aspect of the present invention may include an information display unit. The information display unit may display information transmitted from the interlock control unit. The interlock control unit may display restart of interlock on the information display unit after the interlock control unit receives the interlock permission mode signal, when the interlock control unit detects that the slave motion unit may interlock with the operation corresponding to the manipulation input.
According to a fourth aspect of the present invention, in the manipulation system according to the second or third aspect, the interlock permission input unit may be configured by a position detection switch that detects that the manipulation member is moved to a maximum opening position and generates the interlock permission mode signal.
According to a fifth aspect of the present invention, in the manipulation system according to the second or third aspect, the interlock permission input unit may be configured by an input switch provided on a surface of the master manipulation unit.
According to a sixth aspect of the present invention, in the manipulation system according to the second or third aspect, the interlock permission input unit may be configured by an input switch that is provided separately from the master manipulation unit.
According to a seventh aspect of the present invention, in the manipulation system according to the sixth aspect, the input switch may be configured by a footswitch.
According to an eighth aspect of the present invention, in the manipulation system according to any one of the first to seventh aspects, the master manipulation unit may include a manipulation member and a master angle detection unit. The manipulation member may be provided to be opened and closed in order to perform the manipulation input. The master angle detection unit may detect an opening and closing angle of the manipulation member and transmit a detection value of the opening and closing angle of the manipulation member to the interlock control unit. The slave motion unit may include an opening and closing motion unit and a slave angle detection unit. The opening and closing motion unit may be provided to be opened and closed. The slave angle detection unit may detect an opening and closing angle of the opening and closing motion unit and may transmit a detection value of the opening and closing angle of the opening and closing motion unit to the interlock control unit. The interlock control unit may interlock the slave motion unit with an operation corresponding to the manipulation input after the interlock control unit receives the interlock permission mode signal, when the detection value of the opening and closing angle of the manipulation member corresponds to the detection value of the opening and closing angle of the opening and closing motion unit, as well as when the detection value of the opening and closing angle of the manipulation member is changed in an opening direction of the manipulation member.
According to a ninth aspect of the present invention, in the manipulation system according to any one of the first to seventh aspects, the master manipulation unit may include a manipulation member and a master angle detection unit. The manipulation member may be provided to be opened and closed in order to perform the manipulation input. The master angle detection unit may detect an opening and closing angle of the manipulation member and transmit a detection value of the opening and closing angle of the manipulation member to the interlock control unit. The slave motion unit may include an opening and closing motion unit and a slave angle detection unit. The opening and closing motion unit may be provided to be opened and closed. The slave angle detection unit may detect an opening and closing angle of the opening and closing motion unit and transmit a detection value of the opening and closing angle of the opening and closing motion unit to the interlock control unit. The interlock control unit may be configured to interlock the slave motion unit with an operation corresponding to the manipulation input after the interlock control unit receives the interlock permission mode signal, when the detection value of the opening and closing angle of the manipulation member corresponds to the detection value of the opening and closing angle of the opening and closing motion unit, as well as when the detection value of the opening and closing angle of the manipulation member is changed in an opening or closing direction of the manipulation member. The interlock control unit may be configured to select the interlock of the case in which the detection value is changed in the opening direction or the interlock of the case in which the detection value is changed in the closing direction.
FIG. 5A1 is a diagram illustrating the operation of the manipulator system according to the embodiment of the present invention.
FIG. 5A2 is a diagram illustrating the operation of the manipulator system according to the embodiment of the present invention.
FIG. 5B1 is a diagram illustrating the operation of the manipulator system according to the embodiment of the present invention.
FIG. 5B2 is a diagram illustrating the operation of the manipulator system according to the embodiment of the present invention.
FIG. 5C1 is a diagram illustrating the operation of the manipulator system according to the embodiment of the present invention.
FIG. 5C2 is a diagram illustrating the operation of the manipulator system according to the embodiment of the present invention.
FIG. 6A1 is a diagram illustrating the operation of the manipulator system continued from FIGS. 5A1 to 5C2 according to the embodiment of the present invention.
FIG. 6A2 is a diagram illustrating the operation of the manipulator system continued from FIGS. 5A1 to 5C2 according to the embodiment of the present invention.
FIG. 6B1 is a diagram illustrating the operation of the manipulator system continued from FIGS. 5A1 to 5C2 according to the embodiment of the present invention.
FIG. 6B2 is a diagram illustrating the operation of the manipulator system continued from FIGS. 5A1 to 5C2 according to the embodiment of the present invention.
FIG. 6C1 is a diagram illustrating the operation of the manipulator system continued from FIGS. 5A1 to 5C2 according to the embodiment of the present invention.
FIG. 6C2 is a diagram illustrating the operation of the manipulator system continued from FIGS. 5A1 to 5C2 according to the embodiment of the present invention.
Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
First, a manipulator system according to the embodiment will be described.
As shown in
The slave manipulator 300 includes a treatment tool 302, a slave arm 301, a slave control unit 303, and a holding body 304. The slave arm 301 movably holds the treatment tool 302 in periphery of a patient P. The slave control unit 303 controls operations of movable units of the treatment 302 and the slave arm 301. The holding body 304 holds the treatment tool 302 and the slave arm 301.
In
Some of the signals in the functional block diagram are not illustrated.
Various surgical instruments or treatment tools used for surgical operations may be used as the treatment tool 302. Hereinafter, for example, the treatment tool 302 including an opening and closing unit 311 (a slave motion unit or an opening and closing motion unit) and an opening and closing driving unit 313 as in
Examples of the treatment tool 302 include forcipes and needle holders.
The opening and closing unit 311 includes a pair of treatment tool pieces 311b. The pair of treatment tool pieces 311b performs opening and closing about a rotation shaft 311c in a bilaterally symmetrical manner with respect to an opening and closing central axial line O311.
In
Hereinafter, an angle θS is used as an opening and closing angle of the opening and closing unit 311. The angle θS is an angle formed by the opening and closing central axial line O311 and a gripping surface 311a of the treatment tool piece 311b. That is, the angle θS is half of the angle formed by each gripping surface 311a.
Therefore, when the treatment tool piece 311b is moved in an opening direction, the angle θS increases. When the treatment tool piece 311b is moved in a closing direction, the angle θS decreases.
However, this definition of the opening and closing angle is merely an example. For another example, an angle 2θS which is an angle formed by the gripping surfaces 311a may be used.
An operation of the opening and closing driving unit 313 is controlled by a driving signal 313a that is transmitted from the slave control unit 303 based on a driving command value 403 transmitted from a control unit 400. Therefore, the opening and closing driving unit 313 is electrically connected to the control unit 400 via the slave control unit 303 to be described below.
The opening and closing driving unit 313 can be configured appropriately using an actuator that opens and closes the opening and closing unit 311.
The opening and closing driving unit 313 includes an encoder 314 (slave angle detection unit) that detects the opening and closing angle of the opening and closing driving unit 313.
The encoder 314 is configured to generate an output signal 314a corresponding to the detected opening and closing angle and transmit the generated output signal 314a to the slave control unit 303.
The configuration of the encoder 314 is not particularly limited. For example, a rotary encoder that directly detects the amount of rotation of the opening and closing unit 311 may be used. The encoder 314 may be configured as a linear encoder that detects the amount of movement of a linear movement member, which interlocks with opening and closing operations of the opening and closing unit 311, or may be configured as a rotary encoder that detects an amount of movement by converting an amount of linear movement into an amount of rotary movement.
The encoder 314 may be an absolute type encoder or an increment type encoder.
When the increment type encoder is used, an appropriate position correction means is provided. The position correction means monitors whether the treatment tool piece 311b reaches a given correction position. In the case of the increment type encoder, the output signal 314a of the encoder 314 is preferably reset when the treatment tool piece 311b reaches the correction position. In this configuration, the output signal 314a can be corrected whenever the treatment tool piece 311b passes through the correction position. Therefore, even the increment type encoder can accurately detect the opening and closing angle of the opening and closing unit 311.
The slave arm 301 is configured as a multi joint arm that holds the treatment tool 302 at an appropriate position and an appropriate orientation. The slave arm 301 is electrically connected to the slave control unit 303, and thus an operation of the slave arm 301 is controlled by a control signal from the slave control unit 303.
As shown in
For example, the slave control unit 303 transmits the driving signal 313a used to open or close the opening and closing unit 311 to the opening and closing unit 311 of the treatment tool 302 based on the driving command value 403 and controls the opening and closing operations.
The slave control unit 303 acquires the output signal 314a from the encoder 314 and transmits the acquired output signal 314a to the manipulator control unit 402.
As shown in
The master input section 200 functions as a master that delivers an operation from the operator Op to the slave manipulator 300. The master input section 200 includes a display unit 201 (information display unit), a master arm 202, and master grips 203L and 203R (master manipulation unit).
The display unit 201 is electrically connected to a camera (not shown) and the control unit 400. The display unit 201 displays information from the camera or the control unit 400 so that the operator Op can view the information.
Examples of kinds of information displayed by the display unit 201 include a video of surgical parts and the vicinity of the surgical parts of the patient P photographed by the camera, a manipulation input screen regarding a manipulation input performed by input means (not shown) such as a footswitch, various kinds of information on the operator Op, guidance, and characters or images of warning messages.
The master arm 202 delivers, to the slave manipulator 300, manipulation performed to manipulate the position and orientation of the slave arm 301 of the slave manipulator 300 by the operator Op. The master arm 202 is connected to communicate with the control unit 400.
For example, the master arm 202 according to this embodiment includes two multi joint arms, that is, a multi joint arm 202L (see
The multi joint arms 202L and 202R are disposed on the front side of the display unit 201 so that the operator Op can perform manipulation while viewing the display unit 201.
The multi joint arms 202L and 202R correspond to manipulation inputs performed with the left and right hands of the operator Op, respectively.
Master grips 203L and 203R gripped to perform a manipulation input by the operator Op are installed in the arm distal end 202a of the multi joint arms 202L and 202R on the side of the operator Op.
The multi joint arms 202L and 202R each include an encoder that detects an amount of operation of a joint for each joint and transmit the output of each encoder as a manipulation signal of each joint to the control unit 400.
The operator Op manipulates the master grips 203L and 203R with his or her left and right hands to perform a manipulation input on the slave arm 301 corresponding to the multi joint arms 202L and 202R and the treatment tool 302 installed in the slave arm 301.
The master grips 203L and 203R can be provided in a bilaterally symmetrical shape so that the operator Op can easily grip or manipulate the master grips 203L and 203R with his or her left and right hands. Hereinafter, the master grips 203L and 203R configured as master grips 1 (see
As shown in the schematic diagram of
The grip unit 1a has a cylindrical shape gripped by one hand of the operator Op, as shown in
The distal end of the casing unit 1d is connected to the arm distal end 202a.
At the end of the grip unit 1a, a pair of manipulation handles 1b are movably held with the casing unit 1d interposed therebetween. In the grip unit 1a, the manipulation handles 1b are opened in a V shape so that the opening and closing angle can be changed.
In this embodiment, as shown in
Each manipulation handle 1b has an appropriate shape such as a bar shape or a plate shape, as long as the fingers of the operator Op can lock with the manipulation handle 1b to perform opening and closing operations. For example, a concavo-convex unit may be formed so that a gripping position for the operator Op can be identified. Although not illustrated, the manipulation handle 1b may be configured to easily follow a movement of the fingers of the operator Op. For example, protrusion units with which the fingers performing manipulation lock in the opening and closing directions or finger insertion units in which the fingers are inserted may be formed.
The spring 3 is a spring member that biases the pair of manipulation handles 1b in the opening direction. The spring 3 is mounted between the manipulation handles 1b at a position on the side of the distal end (the end opposite to the gripping unit 1a) of the manipulation handles 1b.
However, neither a kind of spring 3 nor the mounting position of the spring 3 mounted between the manipulation handles 1b is particularly limited, as long as the manipulation handles 1b are biased in the opening direction. In
The length of the spring 3 is set to a constant value determined so that the opening and closing angle of the manipulation handles 1b is smaller than the maximum opening and closing angle when manipulation is not performed.
In this configuration, when no outside force is applied to the manipulation handles 1b (hereinafter, this state is referred to as a natural state), the master grip 1 is configured to be opened in the V shape at the constant opening and closing angle by the biasing force of the spring 3, as indicated by a solid line in
When the operator Op grips the grip unit 1a with his or her hand, for example, when the operator Op grips the manipulation handles 1b with his or her thumb and forefinger and moves the manipulation handles 1b, the manipulation handles 1b are rotated about the rotation shaft 1c and the opening and closing angle is thus changed.
Hereinafter, an angle θM is used as the opening and closing angle of the manipulation handles 1b of the master grip 1. The angle θm is an angle that is formed by the opening and closing central axial line O1 and the manipulation handle 1b. That is, the angle θM is half of the angle formed by the manipulation handles 1b.
However, this definition of the opening and closing angle is merely an example. For example, an angle 2θS which is an angle formed by the manipulation surfaces 311a may be used as the opening and closing angle.
Thus, when the manipulation handles 1b are opened or closed, the reactive force from the spring 3 is generated in accordance with the expansion or contraction degree of the spring 3. Therefore, the operator Op feels a manipulation resistance. For example, when the manipulation handles 1b are gradually closed, the manipulation resistance increases with a decrease in the opening and closing angle. Therefore, when the operator Op manipulates the pair of manipulation handles 1b, the operator Op can have the sense of gripping an actual grip object.
In this embodiment, the operator Op can manipulate the manipulation handles 1b to further open the manipulation handles 1b from the natural state. Hereinafter, the angle θMA is referred to as the maximum opening and closing angle.
In the manipulation performed to further open the manipulation handles 1b from the natural state, the manipulation resistance is generated due to an elastic restoring force of the tension of the spring 3. The manipulation resistance increases, as the opening and closing angle approaches the maximum opening and closing angle.
The encoder 4 detects the opening and closing angle of the manipulation handles 1b and transmits a detection value corresponding to the opening and closing angle as an output signal 4a to the control unit 400. In this embodiment, the encoder 4 is provided inside the grip unit 1a and is electrically connected to the control unit 400.
In this embodiment, a rotary encoder that directly detects an amount of rotation of the manipulation handles 1b is used as the encoder 4. However, the encoder 4 may be configured as a linear encoder that detects the amount of movement of a linear movement member, which interlocks with opening and closing operations of the manipulation handles 1b, or may be configured as a rotary encoder that detects an amount of movement by converting an amount of linear movement into an amount of rotary movement.
The encoder 4 may be an absolute type encoder or an increment type encoder.
When the increment type encoder is used, appropriate position correction means is provided. The position correction means monitors whether the manipulation handles 1b reach given correction positions. In the case of the increment type encoder, the output signal 4a of the encoder 4 is preferably reset when the manipulation handles 1b reach the correction position. In this configuration, the output signal 4a can be corrected whenever the manipulation handles 1b pass through the correction position. Therefore, even the increment type encoder can accurately detect the opening and closing angle of the manipulation handles 1b.
The position detection switch 6 is a position detector that detects that the manipulation handles 1b are opened up to the maximum opening and closing angle by detecting the position of one of the manipulation handles 1b, generates an interlock permission mode signal 6a, and transmits the interlock permission mode signal 6a to the control unit 400. The position detection switch 6 is electrically connected to the control unit 400.
The interlock permission mode signal 6a is used to enter a mode (hereinafter referred to as an interlock permission mode) in which the control unit 400 permits the interlock of the opening and closing unit 311 based on a manipulation input of the master grip 1.
Examples of the kinds of position detection switch 6 include a contact switch detecting that an object mechanically comes into contact with the manipulation handles 1b, a position detection sensor that electrically, magnetically, or optically detects the movement positions of the manipulation handles 1b, and a speed detection sensor.
In this embodiment, the position detection switch 6 is mounted on a holding arm member 5, of which an end is fixed to the grip unit 1a, to face one of the manipulation handles 1b in the opening direction when the manipulation handles 1b are opened to the maximum angle.
The holding arm member 5 extends from the grip unit 1a so that the holding arm member 5 faces one of the manipulation handles 1b opened by the maximum angle, as indicated by a two-dot chain line in
The control unit 400 includes a master control unit 401 and the manipulator control unit 402, as shown in
The master control unit 401 receives a signal transmitted from the master input section 200 and analyzes an amount of driving of a movable unit to be controlled by the slave manipulator 300 to perform an operation based on the signal. The master control unit 401 transmits a movable unit selection signal 404 and a driving command value 403 for a movable unit selected by the movable unit selection signal 404 to the manipulator control unit 402.
Here, the movable unit selection signal 404 is independently allocated to each movable unit such as a joint of the slave arm 301 and the opening and closing unit 311 of the treatment tool 302 held by the slave arm 301.
The master control unit 401 analyzes a signal from each joint of the master arm 202 and calculates the positions and orientations of the master grips 203L and 203R. As a result, the master control unit 401 can generate the driving command value 403 of each movable unit of the slave arm 301 necessary to control the position and orientation of the distal end of the treatment tool 302 held by the slave arm 301. The driving command value 403 is transmitted to the slave control unit 303 together with the movable unit selection signal 404 corresponding to each movable unit.
The master control unit 401 can also generate the driving command value 403 to be transmitted to the opening and closing unit 311 based on the output signal 4a from the encoders 4 corresponding to the master grips 203L and 203R to the master control unit 401, and then can transmit the generated driving command value 403 to the manipulator control unit 402. The driving command value 403 is specifically referred to as an opening and closing command value 403A.
A correspondence relation between the output signal 4a and the opening and closing command value 403A is stored as, for example, a table or conversion expression data in a storage unit (not shown) of the master control unit 401. The correspondence relation can be set as necessary.
For example, the correspondence relation in which the opening and closing angle θM of the manipulation handles 1b coincides with the opening and closing angle θS of the opening and closing unit 311 may be established. The correspondence relation between the opening and closing angle θM and the opening and closing angle θS may be linear at an appropriate ratio. The correspondence relation between the opening and closing angle θM and the opening and closing angle θS may not be linear.
The master control unit 401 is configured to selectively switch between an “interlock mode” and an “interlock stop mode” by transmitting the control signal 405 to the manipulator control unit 402.
Here, the “interlock mode” is a mode in which the opening and closing command value 403A is transmitted to the slave control unit 303 by performing communication between the manipulator control unit 402 and the slave control unit 303 and an operation of the opening and closing unit 311 is interlocked with an operation based on the opening and closing command value 403A.
Further, the “interlock stop mode” is a mode in which the transmission of the opening and closing command value 403A to the slave control unit 303 is stopped by stopping the communication between the manipulator control unit 402 and the slave control unit 303, and thus the interlock operation based on the opening and closing command value 403A is stopped.
However, in the interlock stop mode, the output signal 314a continues to be transmitted from the encoder 314. The output signal 314a continues to be transmitted to the master control unit 401 via the slave control unit 303 and the manipulator control unit 402.
The interlock mode starts after the master control unit 401 receives the interlock permission mode signal 6a, and when the opening and closing angle of the manipulation handles 1b detected by the output signal 4a corresponds to the opening and closing angle of the opening and closing unit 311 detected by the output signal 314a, also when the opening and closing angle of the manipulation handles 1b detected by the output signal 4a is changed in the closing direction of the manipulation handles 1b.
Here, the “correspondence” between the opening and closing angle of the manipulation handles 1b and the opening and closing angle of the opening and closing unit 311 means that the opening and closing angle indicated by the opening and closing command value 403A generated from the output signal 4a coincides with the opening and closing angle of the opening and closing unit 311 detected by the output signal 314a based on the preset correspondence. That is, when the correspondence relation is expressed by a function f, a relation of “θS=f(θM)” is satisfied.
When such a correspondence relation is satisfied, the manipulation input of the manipulation handles 1b matches the operation state of the opening and closing unit 311 based on the correspondence relation.
In the interlock stop mode, the master control unit 401 starts transmitting the control signal 405 to the manipulator control unit 402 when an operation of the opening and closing unit 311 is deviated from the operation based on the opening and closing command value 403A by a value equal to or greater than an allowance value.
Therefore, the master control unit 401 acquires the output signal 314a transmitted from the encoder 314 via the slave control unit 303 and the manipulator control unit 402 and monitors whether the opening and closing unit 311 interlocks in accordance with the opening and closing command value 403A.
The manipulator control unit 402 communicates with each movable unit of the slave manipulator 300 selected by the movable unit selection signal 404 via the slave control unit 303 and controls an operation of each movable unit in order to execute the operation based on the driving command value 403 transmitted from the master control unit 401.
In particular, the manipulator control unit 402 transmits the opening and closing command value 403A to the slave control unit 303 until the mode is switched to the interlock stop mode by the control signal 405. Thus, the slave control unit 303 controls the opening and closing operations of the opening and closing unit 311 in accordance with the opening and closing operations corresponding to the manipulation input of the master grip 1.
When the interlock mode is switched to the interlock stop mode by the control signal 405, the transmission of the opening and closing command value 403A is stopped. Therefore, the operation of the opening and closing unit 311 is not controlled until the interlock stop mode is switched to the interlock mode by the control signal 405.
The control unit 400 has a device configuration of a computer that includes a CPU, a memory, an input and output interface, and an external storage device. A control program executing the above-described control functions is configured by the computer.
Next, an operation of the master-slave manipulator 500 according to this embodiment will be described focusing on the control operation of the opening and closing unit 311 performed by the master grip 1.
First, a normal operation of the master-slave manipulator 500 will be simply described.
In the master-slave manipulator 500, as shown in
The master control unit 401 analyzes the output signal, generates the driving command value 403 of each movable unit of the slave arm 301 used to drive the slave manipulator 300 so as to correspond to the position and orientation of each of the master grips 203L and 203R, and then transmits the driving command value 403 to the manipulator control unit 402.
The manipulator control unit 402 converts the transmitted driving command value 403 into a driving signal of the slave arm 301, and then transmits the converted driving signal to the slave control unit 303. Thus, the driving of the slave arm 301 is controlled, and the position and orientation of the distal end of the treatment tool 302 are controlled to correspond to the position and orientation of each of the master grips 203L and 203R.
On the other hand, the operator Op also manipulates the manipulation handles 1b of the master grips 203L and 203R to change the opening and closing angle in parallel, as necessary. The spring 3 is installed in each of the master grips 203L and 203R. Thus, when the manipulation handles 1b are closed, the spring 3 is deformed and the elastic restoring force is generated in proportion to the amount of deformation. Therefore, the operator Op manipulating the manipulation handles 1b feels the manipulation resistance in his or her hands.
When the manipulation handles 1b are manipulated, the output signal 4a of the encoder 4 of each of the master grips 203L and 203R is transmitted to the master control unit 401.
The master control unit 401 generates the opening and closing command value 403A corresponding to the driving signal of the opening and closing driving unit 313 which is a movable unit opening and closing the opening and closing unit 311 installed at the distal end of the treatment tool 302 based on the output signal 4a from each encoder 4 and transmits the opening and closing command value 403A to the slave control unit 303 together with the movable unit selection signal 404 corresponding to the opening and closing driving unit 313. Thus, the driving of the opening and closing driving unit 313 is controlled and the opening and closing angle of the opening and closing unit 311 of the treatment tool 302 is controlled to correspond to the opening and closing angle of the manipulation handles 1b.
Therefore, the opening and closing unit 311 is able to grip a grip object or cancel the gripping.
Thus, the operator Op performs a surgical operation by remotely manipulating the slave manipulator 300 using the master input section 200.
Next, an operation when the opening and closing operations of the opening and closing units 311 are not controlled appropriately using the master grips 203L and 203R will be described.
Since both the master grips 203L and 203R are configured by the master grip 1, a relation between the master grip 1 and the opening and closing unit 311 will be described below.
To facilitate the description, a case in which the correspondence relation is controlled such that the opening and closing angle θM of the manipulation handles 1b is the same as the opening and closing angle θS of the opening and closing unit 311 will be described.
The output signal 4a of the encoder 4 and the output signal 314a of the encoder 314 represent the values of the opening and closing angle. That is, the encoder outputs θ of the encoders 4 and 314 represent the opening and closing angles θ of the manipulation handles 1b and the opening and closing unit 311.
Various reasons why the opening and closing operations of the opening and closing units 311 do not interlock with the opening and closing operations of the master grip 1 are considered. However, when an operation deviated from the manipulation input continues, exact opening and closing operations are not performed and this operation affects a task performed using the opening and closing unit 311. For this reason, the master control unit 401 normally monitors the opening and closing operations of the opening and closing unit 311. When the opening and closing angle is deviated by a value equal to or greater than the allowance value, the master control unit 401 switches the mode to the interlock stop mode in accordance with the control signal 405.
This status frequently occurs when a grip object is gripped. For example, since the operator Op performs remote manipulation, the operator Op has no sufficient information on the size or hardness of the grip object. For example, when the grip object is sufficiently hard but the manipulation handles 1b are closed by the opening and closing angle less than an angle corresponding to the size of the grip object, the opening and closing unit 311 may not be closed by the opening and closing angle corresponding to the opening and closing command value 403A. Thus, the opening and closing angle of the manipulation handles 1b may be different from the opening and closing angle of the opening and closing unit 311. Further, when the grip object is deformed, but the resistance is large and the closing speed is too fast, the opening and closing unit 311 may not close to the opening and closing angle corresponding to the opening and closing command value 403A.
It is assumed that the manipulation handles 1b are closed from the open state in which the manipulation handles 1b and the opening and closing unit 311 are opened by an angle of θ0 (where θ0<θMA) at time t0 (hereinafter, a subscript n of time tn indicates a temporal sequence wherein a larger number subscript indicates a later time) and the opening and closing unit 311 grips a flexible grip object W (see FIG. 5A2) shown in FIG. 5A2.
As shown in
Further, the change in the encoder output indicated by the polygonal lines is merely an example. A manipulation input indicating the change in an appropriate curve shape can be performed by a manipulation method of the manipulation handles 1b.
As shown in
In this case, after time t1 when the polygonal lines 90 and 91 are branched at point a of
When the master control unit 401 detects that the opening and closing angle is deviated by a value equal to or greater than the allowance value immediately after time the master control unit 401 transmits the control signal 405 to the manipulator control unit 402 and switches the mode to the interlock stop mode. Thus, even when the operator Op opens or closes the manipulation handles 1b, the opening and closing command value 403A corresponding to the opening or closing operation is not transmitted from the manipulator control unit 402 to the slave control unit 303.
Therefore, the opening and closing driving unit 313 stops at the opening and closing angle when entering the interlock stop mode.
When the mode is switched to the interlock stop mode, the master control unit 401 displays a warning display M1 (for example, “Interlock problem has occurred”) indicating that an interlock problem has occurred and a guidance display M2 (for example, “Please fully open grip”) explaining a countermeasure method for the operator Op on a display screen 201a of the display unit 201, as in
When the operator Op views the guidance display M2 and opens the manipulation handles 1b from time t2, as in
At this time, at time t3, the encoder output of the encoder 4 becomes θ1 (see point c), and thus coincides with the encoder output of the encoder 314.
In this case, since the position detection switch 6 does not detect the manipulation handles 1b and the interlock permission mode signal 6a is not generated, the interlock permission mode is not set. Further, the master control unit 401 detects the change in the opening and closing angle of the manipulation handles 1b in the opening direction from the change in the output signal 4a.
Therefore, in this embodiment, the master control unit 401 does not switch the mode to the interlock mode. Even when the encoder output of the encoder 4 increases, the opening and closing unit 311 does not interlock and the encoder output of the encoder 314 remains “θ=θ1.” That is, the opening and closing unit 311 is not opened through the manipulation input of the manipulation handles 1b (see FIG. 5B2).
At time t4, the operator Op opens the manipulation handles 1b up to the maximum opening and closing angle (see point d of
As shown in
Since the operator Op views the display message on the display unit 201, as in
The operator Op views the guidance display M4 and gradually closes the manipulation handles 1b. Thus, the encoder output θ of the encoder 4 gradually decreases from θMA to θ1.
At this time, at time t5, the encoder output of the encoder 4 is θ1 (see point e), and thus coincides with the encoder output of the encoder 314 (see FIG. 6A1 and FIG. 6A2).
In this case, since the interlock permission mode is set, the master control unit 401 detects the change in the opening and closing angle of the manipulation handles 1b in the closing direction from the change in the output signal 4a.
Therefore, the master control unit 401 transmits the control signal 405 to the manipulator control unit 402 and switches the interlock stop mode to the interlock mode.
Further, as shown in
Thus, after the interlock with the opening and closing unit 311 restarts, the opening and closing angle of the opening and closing unit 311 is changed together with the opening and closing angle of the manipulation handles 1b.
Thus, the operator Op can continue manipulation scheduled to be performed from time t1, for example, the operator Op can continue manipulation to close the manipulation handles and further grip the grip object W (see FIG. 6B1 and FIG. 6B2 and a straight line ef in
Further, the operator Op can open the manipulation handles 1b to cancel gripping the grip object W, as necessary (see FIG. 6C1 and FIG. 6C2). In this case, since the operator Op understands that the interlock restarts and then opens the manipulation handles 1b, the operator Op can react accordingly by adjusting the opening speed without a sudden drop of the grip object W or moving the master grip 1 and manipulating the master arm 202, for example, to move the opening and closing unit 311 to a position at which the cancellation of the gripping is suitable and perform cancelling of the gripping.
Thus, since the master-slave manipulator 500 includes the position detection switch 6 as the interlock permission input unit which the operator Op can manipulate, it is possible to prevent the interlock operation from being performed at an unexpected timing. Therefore, when an operation of the opening and closing unit 311 is deviated from an operation corresponding to a manipulation input of the master grip 1, workability of the opening and closing unit 311 can be improved.
[First Modified Example]
Next, a first modified example of the embodiment will be described.
The master grip 1 according the above-described embodiment has the configuration in which the position detection switch 6 detects the positions of the manipulation handles 1b and the interlock permission mode signal 6a is generated. However, a master grip 10 (master manipulation unit) according to the first modified example in
The master grip 10 according to the first modified example can be used as the master grips 203L and 203R of the master-slave manipulator 500, as in the master grip 1 according to the above-described embodiment.
Hereinafter, differences between the first modified example and the above-described embodiment will mainly be described.
The master grip 10 according to the first modified example includes rotation shafts 10c, an actuator 13, and an encoder 14 (master angle detection unit) instead of the rotation shaft 1c, the spring 3, and the encoder 4 of the master grip 1 according to the above-described embodiment.
The rotation shaft 10c rotatably holds the end of the manipulation handle 1b instead of the rotation shaft 1c according to the above-described embodiment. The rotation shafts 10c are disposed on either side of an opening and closing central axial line O1 inside the grip unit 1a at symmetrical positions with respect to the opening and closing central axial line O1. The rotation shafts 10c hold the ends of the manipulation handles 1b at the two positions.
The actuator 13 is configured to open and close the manipulation handles 1b symmetrically with respect to the opening and closing central axial line O1 and generate manipulation resistance as the manipulation handles 1b are manipulated.
The actuator 13 includes the moving shaft 13a that linearly moves along the opening and closing central axial line O1 and a resistance generation unit 13b that movably holds a first end of the moving shaft 13a and generates a resistant force in a direction opposite to the movement direction.
A second end of the moving shaft 13a is held to be linearly moved by a slide guide 10d that is installed inside on the proximal end side (the side closer to the grip unit 1a) of a casing unit 1d.
A distal end 13c at the second end of the moving shaft 13a protrudes to be suitable to the proximal end side of the casing unit 1d from a slide guide 10d.
Links 10e that transmit rotation movement of the manipulation handles 1b about the rotation shafts 10c to the moving shaft 13a and linearly move the moving shaft 13a are connected between the middle portion of the moving shaft 13a and the manipulation handles 1b, respectively. Thus, since the opening and closing angle of the manipulation handles 1b and the amount of movement of the moving shaft 13a have a one-to-one relation, the opening and closing angle of the manipulation handles 1b can be detected from the amount of movement of the moving shaft 13a.
In the grip unit 1a, a holding plate 10a on which a position detection switch 6 is disposed is provided at a position more distant than the movement range of the distal end 13c to the front side of the distal end 13c of the moving shaft 13a.
The position detection switch 6 on the holding plate 10a is disposed at a position at which the position detection switch 6 can detect the position of the distal end 13c of the moving shaft 13a and determine whether the distal end 13c reaches the position corresponding to the maximum opening and closing angle of the manipulation handles 1b.
The resistance generation unit 13b includes an elastic member resisting the movement of the moving shaft 13a, such as an air spring or a spring member such as a spring. The resistance generation unit 13b is fixed to the internal unit on the distal end (opposite side to the grip unit 1a) of the casing unit 1d.
The encoder 14 detects the amount of movement of the moving shaft 13a of the actuator 13 and transmits an output signal 14a corresponding to the detected value to the master control unit 401. The encoder 14 is electrically connected to the master control unit 401 via a wiring (not shown).
The output signal 14a transmitted to the master control unit 401 is converted into an opening and closing angle of the manipulation handles 1b with reference to a conversion table or the like stored in advance in the master control unit 401.
In the master grip 10 according to the first modified example, when the operator Op performs manipulation to open the manipulation handles 1b at the maximum opening and closing angle, the position detection switch 6 can transmit the interlock permission mode signal 6a to the master control unit 401, as in the master grip 1 according to the above-described embodiment.
Accordingly, it is possible to prevent the interlock operation from being performed at an unexpected timing, as in the above-described embodiment. Therefore, when an operation of the opening and closing unit 311 is deviated from an operation corresponding to a manipulation input of the master grip 10, workability of the opening and closing unit 311 can be improved.
[Second Modified Example]
Next, a second modified example of the embodiment will be described.
As shown in
Hereinafter, differences between the second modified example and the above-described embodiment will mainly be described.
The master grip 20 according to the second modified example does not include the holding arm member 5 and the position detection switch 6 of the master grip 1 according to the above-described embodiment.
The input switch 26 is separated from the master grip 20. When the operator Op manipulates the input switch 26 at an appropriate timing, the input switch 26 generates an interlock permission mode signal 26a used to enter the interlock permission mode and transmits the interlock permission mode signal 26a to the master control unit 401.
Therefore, the input switch 26 is electrically connected to the master control unit 401.
The configuration of the input switch 26 is not particularly limited, as long as the input switch 26 is an input switch that the operator Op can manipulate. For example, a button switch which the operator Op can manipulate with his or her hand or a footswitch which the operator Op can manipulate with his or her foot can be used appropriately.
In the master-slave manipulator 501 according to the second modified example, the interlock permission mode signal 26a can be generated at an appropriate timing through manipulation of the operator Op. Therefore, when the master control unit 401 detects an interlock problem, the interlock mode is switched to the interlock stop mode, as in the above-described embodiment. In the master-slave manipulator 501, for example, a message “Please manipulate the input switch when you are ready to restart interlocking” is displayed to prompt the operator Op to manipulate the input switch 26, instead of the guidance display M2 in
Thus, when the operator Op views the guidance display such as the warning display M1, the operator Op can understand that an interlock problem has occurred. Therefore, the operator Op can prepare to restart the interlocking, and then manipulate the input switch 26 to enter the interlock permission mode.
When entering the interlock permission mode, the master control unit 401 displays substantially the same screen display as the screen display of
Thus, the operator Op can open the manipulation handles 1b by an angle slightly less than the encoder output θ1 in
Thus, in the second modified example, the operator Op can restore the interlocking swiftly without opening the opening and closing angle of the manipulation handles 1b up to the maximum opening and closing angle.
Since the interlocking can restart merely by slightly opening the manipulation grip from the opening and closing angle in the occurrence of an interlocking problem and closing the manipulation grip, the interlocking can restart from substantially the same manipulation state as that in the occurrence of the interlocking problem. Therefore, a task can continue smoothly using the opening and closing unit 311.
In particular, when the footswitch is used as the input switch 26, the operator Op can manipulate the input switch 26 without completely removing his or her hand from the master grip 20. Accordingly, the task can continue smoothly.
[Third Modified Example]
Next, a third modified example of the embodiment will be described.
As shown in
Hereinafter, differences between the third modified example and the above-described embodiment will mainly be described.
The master grip 30 according to the third modified example does not include the holding arm member 5 and the position detection switch 6 of the master grip 1 according to the above-described embodiment. Further, an input switch 36 (interlock permission input unit) is disposed on the surface of the casing unit 1d. That is, the master grip 30 has a configuration in which the input switch 36 is added to the master grip 20 according to the above-described second modified example.
When the operator Op manipulates the input switch 36 at an appropriate timing, the master grip enters the interlock permission mode. Therefore, the input switch 36 generates the same interlock permission mode signal 26a as that of the second modified example and transmits the interlock permission mode signal 26a to the master control unit 401 (not shown in
The input switch 36 may be disposed at any position of the surface of the casing unit 1d at which the operator Op can manipulate the input switch 36. In the third modified example, the input switch 36 is preferably disposed at a position at which the operator Op can manipulate the input switch 36 with some of his or her fingers while gripping the grip unit 1a to perform a manipulation input.
For example, as shown in
The configuration of the input switch 36 is not particularly limited, as long as the input switch 36 is an input switch that the operator OP can manipulate. For example, a button switch that the operator Op can manipulate with his or her hand can be used appropriately.
In the master-slave manipulator 502 according to the third modified example, the operator Op can restore the interlocking swiftly without opening the opening and closing angle of the manipulation handles 1b up to the maximum opening and closing angle, as in the master-slave manipulator 501 according to the second modified example. Accordingly, since the interlocking can restart from substantially the same manipulation state as the state in the occurrence of the interlocking problem, a task can continue smoothly using the opening and closing unit 311.
In particular, the input switch 36 is disposed on the surface of the casing unit 1d. Therefore, even when the operator Op grips the grip unit 1a, the operator Op can easily manipulate the input switch 36. Accordingly, the task can continue smoothly.
[Fourth Modified Example]
Next, a fourth modified example of the embodiment will be described.
As shown in
As in the master grip 1 according to the above-described embodiment, the master grip 40 according to the fourth modified example can be used as the master grips 203L and 203R of the master-slave manipulator 500.
Hereinafter, differences between the fourth modified example, and the above-described embodiment and the first modified example will mainly be described.
In the fourth modified example, the input switch 36 is disposed at a position on the side surface 1f on which the manipulation handle 1b which the operator Op manipulates with his or her forefinger is disposed when the operator Op grips the grip unit 1a and at a position on the side of the distal end of the casing unit 1d more than the distal end of the manipulation handle 1b.
Therefore, the operator Op can manipulate the input switch 36 by moving his or her forefinger to the distal end of the casing unit 1d. At this time, even in the fourth modified example, the operator Op can manipulate the other manipulation handle 1b with his or her thumb. The operator Op can hold the opening and closing angle of the manipulation handle 1b at the opening and closing angle when an interlock problem occurs, even after removing his or her forefinger.
In the master grip 40 according to the fourth modified example, the operator Op can restore the interlocking swiftly without opening the opening and closing angle of the manipulation handles 1b up to the maximum opening and closing angle, and thus start the interlocking from substantially the same manipulation state as that in the occurrence of an interlock problem. Accordingly, as in the third modified example, a task can continue smoothly using the opening and closing unit 311.
In the embodiment and the modified examples described above, the cases in which the master manipulator unit performs the opening and closing manipulations of the slave motion unit have been described. However, the manipulation input of the master manipulation unit is not limited to the opening and closing manipulation. For example, when the slave motion unit linearly moves and grips an object, a manipulation input of the linear movement may be performed.
In the embodiment and the modified examples described above, the cases in which the opening and closing are performed bilaterally symmetrically with respect to the opening and closing central axial line when the master manipulation unit performs the opening and closing manipulations of the slave motion unit have been described. However, the opening and closing may be performed asymmetrically with respect to an appropriate axial line. Further, one of a pair of manipulation members or one of a pair of treatment tool pieces may be moved to the other thereof so that the opening and closing are performed.
In the embodiment and the modified examples described above, the cases in which the interlock control unit interlocks the slave motion unit with an operation corresponding to the manipulation input when the interlock control unit receives the interlock permission mode signal, and then the detection value of the opening and closing angle of the manipulation member corresponds to the detection value of the opening and closing angle of the opening and closing motion unit and the detection value of the opening and closing angle of the manipulation member is changed in the closing direction of the manipulation member have been described.
In this configuration, when the interlocking restarts, the manipulation member is moved in the closing direction. Therefore, a grip object is not dropped erroneously.
The interlock permission mode is started by the interlock permission mode signal generated by the interlock permission input unit through the manipulation of the operator Op. Therefore, since the operator Op expects the restart timing of the interlocking, the operator Op can prepare to perform a manipulation input for the interlock restart. Accordingly, even when the opening and closing unit 311 is gradually opened after the interlock start, the probability that a grip object is erroneously dropped is considerably low compared to a case in which the interlocking is not expected and the interlock restart is not prepared for.
Accordingly, the interlock control unit is capable of interlocking the slave motion unit with an operation corresponding to the manipulation input when the interlock control unit receives the interlock permission mode signal, and then the detection value of the opening and closing angle of the manipulation member corresponds to the detection value of the opening and closing angle of the opening and closing motion unit and the detection value of the opening and closing angle of the manipulation member is changed in the opening direction of the manipulation member.
In this case, since the opening and closing unit 311 is moved in the opening direction immediately after the interlock restart, no pressure force is applied to a grip object. Accordingly, it is possible to prevent the grip object from being deformed.
Further, the interlock control unit is capable of interlocking the slave motion unit with an operation corresponding to the manipulation input after the interlock control unit receives the interlock permission mode signal, when the detection value of the opening and closing angle of the manipulation member corresponds to the detection value of the opening and closing angle of the opening and closing motion unit, as well as the detection value of the opening and closing angle of the manipulation member is changed in the opening or closing direction of the manipulation member. Furthermore, the interlock control unit is capable of selecting between the interlock of the case in which the detection value is changed in the opening direction and the interlock of the case in which the detection value is changed in the closing direction.
In this case, immediately before the operator Op starts a task, the operator Op can select an interlock start condition in the opening direction of the manipulation member or the closing direction of the manipulation member in accordance with a kind or characteristics of the grip object. Therefore, since the interlocking can be restarted in accordance with the kind or characteristics of the grip object, workability can be improved even when an interlock problem occurs.
In the embodiment and the modified examples described above, the cases in which the master control unit 401 displays a message on the display unit 201 to notify the operator Op of occurrence of an interlock problem, the switching to the interlock permission mode, the interlock restart, and the like have been described. However, the operator Op may be notified through sound or voice.
In the embodiment and the modified examples described above, the cases in which the manipulation member is not opened to the maximum opening and closing angle when the spring 3 is in the natural state, and the position detection switch 6 is pressed when the spring 3 is extended further from the natural state have been described. However, the present invention is not limited to the spring 3 installed in this way.
For example, when the spring 3 is in the natural state, the manipulation member may be opened to the maximum opening and closing angle and the position detection switch 6 may be pressed.
The configurations shown in
A master grip 1A (master manipulation unit) according to this modified example (the fifth modified example) includes a spring 3A instead of the spring 3 of the master grip 1 according to the above-described embodiment. A first end portion (the right side of the drawing) of the spring 3A is fixed to the inside of the manipulation handle 1b in a first direction (the right side of the drawing) and a second end portion (the left side of the drawing) of the spring 3A faces the manipulation handle 1b in a second direction to come into contact with and be separated from the manipulation handle 1b.
Thus, when the manipulation handles 1b are closed up to an opening and closing angle corresponding to a value equal to or less than the length of the spring 3A in the natural state, as in
In this configuration, no manipulation resistance occurs when the position detection switch 6 is pressed. Therefore, the position detection switch 6 can be pressed swiftly by a small force.
All of the constituent elements described in the embodiment and the modifications may be appropriately combined or deleted.
While preferred embodiments of the invention have been described and illustrated above, it should be understood that these are exemplary of the invention and are not to be considered as limiting. Additions, omissions, substitutions, and other modifications can be made without departing from the scope of the present invention. Accordingly, the invention is not to be considered as being limited by the foregoing description, and is only limited by the scope of the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2012-116740 | May 2012 | JP | national |
This application is a continuation application based on a PCT Patent Application No. PCT/JP2012/070417, filed on Aug. 3, 2012, whose priority is claimed on Japanese Patent Application No. 2012-116740, filed on May 22, 2012, and U.S. Provisional Patent Application No. 61/515,203, filed Aug. 4, 2011. The contents of all of the PCT Application, the Japanese Application, and the U.S. Provisional Patent Application are incorporated herein by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 3139990 | Jelatis et al. | Jul 1964 | A |
| 4830569 | Jannborg | May 1989 | A |
| 5214969 | Adkins et al. | Jun 1993 | A |
| 5603723 | Aranyi et al. | Feb 1997 | A |
| 5632432 | Schulze et al. | May 1997 | A |
| 5649956 | Jensen et al. | Jul 1997 | A |
| 5656903 | Shui et al. | Aug 1997 | A |
| 5712543 | Sjostrom | Jan 1998 | A |
| 5762458 | Wang et al. | Jun 1998 | A |
| 5836869 | Kudo et al. | Nov 1998 | A |
| 5855583 | Wang et al. | Jan 1999 | A |
| 5871493 | Sjostrom et al. | Feb 1999 | A |
| 6007550 | Wang et al. | Dec 1999 | A |
| 6063095 | Wang et al. | May 2000 | A |
| 6090122 | Sjostrom et al. | Jul 2000 | A |
| 6102850 | Wang et al. | Aug 2000 | A |
| 6132368 | Cooper | Oct 2000 | A |
| 6132441 | Grace | Oct 2000 | A |
| 6206903 | Ramans | Mar 2001 | B1 |
| 6246200 | Blumenkranz et al. | Jun 2001 | B1 |
| 6328752 | Sjostrom et al. | Dec 2001 | B1 |
| 6346072 | Cooper | Feb 2002 | B1 |
| 6430473 | Lee et al. | Aug 2002 | B1 |
| 6436107 | Wang et al. | Aug 2002 | B1 |
| 6441577 | Blumenkranz et al. | Aug 2002 | B2 |
| 6557558 | Tajima et al. | May 2003 | B1 |
| 6574355 | Green | Jun 2003 | B2 |
| 6587750 | Gerbi et al. | Jul 2003 | B2 |
| 6602185 | Uchikubo | Aug 2003 | B1 |
| 6645196 | Nixon et al. | Nov 2003 | B1 |
| 6666876 | Kawai et al. | Dec 2003 | B2 |
| 6676684 | Morley et al. | Jan 2004 | B1 |
| 6685698 | Morley et al. | Feb 2004 | B2 |
| 6699177 | Wang et al. | Mar 2004 | B1 |
| 6746443 | Morley et al. | Jun 2004 | B1 |
| 6783524 | Anderson et al. | Aug 2004 | B2 |
| 6786896 | Madhani et al. | Sep 2004 | B1 |
| 6853879 | Sunaoshi | Feb 2005 | B2 |
| 6866671 | Tierney et al. | Mar 2005 | B2 |
| 6905460 | Wang et al. | Jun 2005 | B2 |
| 6913613 | Schwarz et al. | Jul 2005 | B2 |
| 7083571 | Wang et al. | Aug 2006 | B2 |
| 7101363 | Nishizawa et al. | Sep 2006 | B2 |
| 7107124 | Green | Sep 2006 | B2 |
| 7118582 | Wang et al. | Oct 2006 | B1 |
| 7273488 | Nakamura et al. | Sep 2007 | B2 |
| 7295893 | Sunaoshi | Nov 2007 | B2 |
| 7313464 | Perreault et al. | Dec 2007 | B1 |
| 7331967 | Lee et al. | Feb 2008 | B2 |
| 7357774 | Cooper | Apr 2008 | B2 |
| 7373219 | Nowlin et al. | May 2008 | B2 |
| 7422592 | Morley et al. | Sep 2008 | B2 |
| 7476237 | Taniguchi et al. | Jan 2009 | B2 |
| 7549998 | Braun | Jun 2009 | B2 |
| 7608083 | Lee et al. | Oct 2009 | B2 |
| 7654431 | Hueil et al. | Feb 2010 | B2 |
| 7666191 | Orban, III et al. | Feb 2010 | B2 |
| 7674255 | Braun | Mar 2010 | B2 |
| 7695481 | Wang et al. | Apr 2010 | B2 |
| 7699835 | Lee et al. | Apr 2010 | B2 |
| 7699855 | Anderson et al. | Apr 2010 | B2 |
| 7778733 | Nowlin et al. | Aug 2010 | B2 |
| 7819884 | Lee et al. | Oct 2010 | B2 |
| 7819885 | Cooper | Oct 2010 | B2 |
| 7862579 | Ortiz et al. | Jan 2011 | B2 |
| 7865266 | Moll et al. | Jan 2011 | B2 |
| 7955321 | Kishi et al. | Jun 2011 | B2 |
| 8105320 | Manzo | Jan 2012 | B2 |
| 8155479 | Hoffman et al. | Apr 2012 | B2 |
| 8267958 | Braun | Sep 2012 | B2 |
| 8350806 | Nagasaka et al. | Jan 2013 | B2 |
| 8423186 | Itkowitz et al. | Apr 2013 | B2 |
| 8496647 | Blumenkranz et al. | Jul 2013 | B2 |
| 8540748 | Murphy et al. | Sep 2013 | B2 |
| 8845681 | Grace | Sep 2014 | B2 |
| 8876858 | Braun | Nov 2014 | B2 |
| 8903549 | Itkowitz et al. | Dec 2014 | B2 |
| 8906002 | Kishi et al. | Dec 2014 | B2 |
| 20010021859 | Kawai et al. | Sep 2001 | A1 |
| 20010055062 | Shioda et al. | Dec 2001 | A1 |
| 20020072736 | Tierney et al. | Jun 2002 | A1 |
| 20020091374 | Cooper | Jul 2002 | A1 |
| 20020128552 | Nowlin et al. | Sep 2002 | A1 |
| 20030033024 | Sunaoshi | Feb 2003 | A1 |
| 20030060927 | Gerbi et al. | Mar 2003 | A1 |
| 20030069471 | Nakanishi et al. | Apr 2003 | A1 |
| 20030083648 | Wang et al. | May 2003 | A1 |
| 20030100817 | Wang et al. | May 2003 | A1 |
| 20030216723 | Shinmura et al. | Nov 2003 | A1 |
| 20040092912 | Jinno et al. | May 2004 | A1 |
| 20040111113 | Nakamura et al. | Jun 2004 | A1 |
| 20040140787 | Okamoto et al. | Jul 2004 | A1 |
| 20040186345 | Yang et al. | Sep 2004 | A1 |
| 20040186624 | Oda et al. | Sep 2004 | A1 |
| 20040243147 | Lipow | Dec 2004 | A1 |
| 20050020876 | Shioda et al. | Jan 2005 | A1 |
| 20050021050 | Cooper | Jan 2005 | A1 |
| 20050033117 | Ozaki et al. | Feb 2005 | A1 |
| 20050125027 | Knodel et al. | Jun 2005 | A1 |
| 20050149003 | Tierney et al. | Jul 2005 | A1 |
| 20050228365 | Wang et al. | Oct 2005 | A1 |
| 20050273086 | Green et al. | Dec 2005 | A1 |
| 20060052664 | Julian et al. | Mar 2006 | A1 |
| 20060074408 | Jinno et al. | Apr 2006 | A1 |
| 20060079865 | Jinno et al. | Apr 2006 | A1 |
| 20060079866 | Jinno et al. | Apr 2006 | A1 |
| 20060087746 | Lipow | Apr 2006 | A1 |
| 20060116973 | Okamoto et al. | Jun 2006 | A1 |
| 20060155262 | Kishi et al. | Jul 2006 | A1 |
| 20060161138 | Orban, III et al. | Jul 2006 | A1 |
| 20060190031 | Wales et al. | Aug 2006 | A1 |
| 20060235436 | Anderson et al. | Oct 2006 | A1 |
| 20070012135 | Tierney et al. | Jan 2007 | A1 |
| 20070089557 | Solomon et al. | Apr 2007 | A1 |
| 20070119274 | Devengenzo et al. | May 2007 | A1 |
| 20070137372 | Devengenzo et al. | Jun 2007 | A1 |
| 20070138992 | Prisco et al. | Jun 2007 | A1 |
| 20070142825 | Prisco et al. | Jun 2007 | A1 |
| 20070167679 | Miyamoto et al. | Jul 2007 | A1 |
| 20070167680 | Miyamoto et al. | Jul 2007 | A1 |
| 20070173689 | Ozaki et al. | Jul 2007 | A1 |
| 20070197896 | Moll et al. | Aug 2007 | A1 |
| 20070208375 | Nishizawa et al. | Sep 2007 | A1 |
| 20070219668 | Takahashi et al. | Sep 2007 | A1 |
| 20070225550 | Gattani et al. | Sep 2007 | A1 |
| 20070249897 | Miyamoto et al. | Oct 2007 | A1 |
| 20070265638 | Lipow et al. | Nov 2007 | A1 |
| 20080015611 | Jinno et al. | Jan 2008 | A1 |
| 20080033240 | Hoffman et al. | Feb 2008 | A1 |
| 20080046122 | Manzo et al. | Feb 2008 | A1 |
| 20080051631 | Dejima et al. | Feb 2008 | A1 |
| 20080059131 | Tokita et al. | Mar 2008 | A1 |
| 20080103524 | Grace | May 2008 | A1 |
| 20080140088 | Orban, III | Jun 2008 | A1 |
| 20080147091 | Cooper | Jun 2008 | A1 |
| 20080177285 | Brock et al. | Jul 2008 | A1 |
| 20080204425 | Nagasaka et al. | Aug 2008 | A1 |
| 20080215065 | Wang et al. | Sep 2008 | A1 |
| 20080228196 | Wang et al. | Sep 2008 | A1 |
| 20080234866 | Kishi et al. | Sep 2008 | A1 |
| 20080243142 | Gildenberg | Oct 2008 | A1 |
| 20080262654 | Omori et al. | Oct 2008 | A1 |
| 20080287735 | Takemoto et al. | Nov 2008 | A1 |
| 20080312668 | Grace | Dec 2008 | A1 |
| 20090018700 | Okamoto et al. | Jan 2009 | A1 |
| 20090022262 | Ohishi | Jan 2009 | A1 |
| 20090030273 | Murakami | Jan 2009 | A1 |
| 20090034820 | Sugiyama | Feb 2009 | A1 |
| 20090036736 | Dejima et al. | Feb 2009 | A1 |
| 20090036902 | DiMaio et al. | Feb 2009 | A1 |
| 20090046146 | Hoyt | Feb 2009 | A1 |
| 20090057369 | Smith et al. | Mar 2009 | A1 |
| 20090088634 | Zhao et al. | Apr 2009 | A1 |
| 20090088773 | Zhao et al. | Apr 2009 | A1 |
| 20090088897 | Zhao et al. | Apr 2009 | A1 |
| 20090163948 | Sunaoshi et al. | Jun 2009 | A1 |
| 20090171147 | Lee et al. | Jul 2009 | A1 |
| 20090182193 | Whitman et al. | Jul 2009 | A1 |
| 20090193299 | Sekiguchi et al. | Jul 2009 | A1 |
| 20090204911 | Sekiguchi et al. | Aug 2009 | A1 |
| 20090247877 | Tanaka et al. | Oct 2009 | A1 |
| 20090326318 | Tognaccini et al. | Dec 2009 | A1 |
| 20100010673 | Wang et al. | Jan 2010 | A1 |
| 20100013812 | Gu et al. | Jan 2010 | A1 |
| 20100087835 | Blumenkranz et al. | Apr 2010 | A1 |
| 20100160728 | Yoshie | Jun 2010 | A1 |
| 20100163057 | Anderson et al. | Jul 2010 | A1 |
| 20100174293 | Orban, III et al. | Jul 2010 | A1 |
| 20100217284 | Grace | Aug 2010 | A1 |
| 20100217528 | Sato et al. | Aug 2010 | A1 |
| 20100228264 | Robinson et al. | Sep 2010 | A1 |
| 20100228265 | Prisco | Sep 2010 | A1 |
| 20100234857 | Itkowitz et al. | Sep 2010 | A1 |
| 20100274087 | Diolaiti et al. | Oct 2010 | A1 |
| 20100291520 | Kurenov et al. | Nov 2010 | A1 |
| 20100317965 | Itkowitz et al. | Dec 2010 | A1 |
| 20100318099 | Itkowitz et al. | Dec 2010 | A1 |
| 20100318101 | Choi | Dec 2010 | A1 |
| 20100332031 | Itkowitz et al. | Dec 2010 | A1 |
| 20110015650 | Choi et al. | Jan 2011 | A1 |
| 20110050852 | Lamprecht et al. | Mar 2011 | A1 |
| 20110118707 | Burbank | May 2011 | A1 |
| 20110118748 | Itkowitz | May 2011 | A1 |
| 20110118753 | Itkowitz et al. | May 2011 | A1 |
| 20110137337 | Van den Dool et al. | Jun 2011 | A1 |
| 20110230894 | Simaan et al. | Sep 2011 | A1 |
| 20110238079 | Hannaford et al. | Sep 2011 | A1 |
| 20110282493 | Ortmaier | Nov 2011 | A1 |
| 20110288579 | Hyodo | Nov 2011 | A1 |
| 20120071752 | Sewell et al. | Mar 2012 | A1 |
| 20120165828 | Duque et al. | Jun 2012 | A1 |
| 20120191245 | Fudaba et al. | Jul 2012 | A1 |
| Number | Date | Country |
|---|---|---|
| 101027010 | Aug 2007 | CN |
| 101167658 | Apr 2008 | CN |
| 101426412 | May 2009 | CN |
| 10 2008 041 867 | Mar 2010 | DE |
| 0 677 278 | Oct 1995 | EP |
| 1 728 475 | Dec 2006 | EP |
| 2 092 875 | Aug 2009 | EP |
| 2 298 220 | Mar 2011 | EP |
| 2 332 484 | Jun 2011 | EP |
| 63-029810 | Feb 1988 | JP |
| 64-034688 | Feb 1989 | JP |
| 01-271185 | Oct 1989 | JP |
| 02-071980 | Mar 1990 | JP |
| 02-292193 | Dec 1990 | JP |
| 03-161289 | Jul 1991 | JP |
| 05-096477 | Apr 1993 | JP |
| 5-329784 | Dec 1993 | JP |
| 07-001366 | Jan 1995 | JP |
| 07-194609 | Aug 1995 | JP |
| 07-241300 | Sep 1995 | JP |
| 07-246578 | Sep 1995 | JP |
| 07-096182 | Oct 1995 | JP |
| 8-66883 | Mar 1996 | JP |
| 08-215204 | Aug 1996 | JP |
| 08-243080 | Sep 1996 | JP |
| 10-128538 | May 1998 | JP |
| 11-300662 | Nov 1999 | JP |
| 2000-312684 | Nov 2000 | JP |
| 2001-087281 | Apr 2001 | JP |
| 2001-113481 | Apr 2001 | JP |
| 2001-277157 | Oct 2001 | JP |
| 2001-309920 | Nov 2001 | JP |
| 2002-014287 | Jan 2002 | JP |
| 2002-059380 | Feb 2002 | JP |
| 2002-102248 | Apr 2002 | JP |
| 2002-272758 | Sep 2002 | JP |
| 2002-537884 | Nov 2002 | JP |
| 2003-024336 | Jan 2003 | JP |
| 2003-053685 | Feb 2003 | JP |
| 2003-250812 | Sep 2003 | JP |
| 2003-265500 | Sep 2003 | JP |
| 2003-340752 | Dec 2003 | JP |
| 2004-105451 | Apr 2004 | JP |
| 2005-511185 | Apr 2005 | JP |
| 2005-192743 | Jul 2005 | JP |
| 3686947 | Aug 2005 | JP |
| 2005-261827 | Sep 2005 | JP |
| 2005-312991 | Nov 2005 | JP |
| 2006-061272 | Mar 2006 | JP |
| 2006-167867 | Jun 2006 | JP |
| 2006-288955 | Oct 2006 | JP |
| 2006-321027 | Nov 2006 | JP |
| 2007-029274 | Feb 2007 | JP |
| 2007-038315 | Feb 2007 | JP |
| 2007-98507 | Apr 2007 | JP |
| 2007-105485 | Apr 2007 | JP |
| 3999816 | Oct 2007 | JP |
| 2008-000282 | Jan 2008 | JP |
| 2008-036793 | Feb 2008 | JP |
| 4058113 | Mar 2008 | JP |
| 2008-93270 | Apr 2008 | JP |
| 2008-173724 | Jul 2008 | JP |
| 4129313 | Aug 2008 | JP |
| 4176126 | Nov 2008 | JP |
| 2009-028157 | Feb 2009 | JP |
| 2009-056164 | Mar 2009 | JP |
| 2009-512514 | Mar 2009 | JP |
| 2009-520573 | May 2009 | JP |
| 2009-178230 | Aug 2009 | JP |
| 2009-178541 | Aug 2009 | JP |
| 2009-530037 | Aug 2009 | JP |
| 2009-195694 | Sep 2009 | JP |
| 2009-226093 | Oct 2009 | JP |
| 2009-269127 | Nov 2009 | JP |
| 2010-504127 | Feb 2010 | JP |
| 2010-076012 | Apr 2010 | JP |
| 2010-524548 | Jul 2010 | JP |
| 2011-509112 | Mar 2011 | JP |
| 2011-206213 | Oct 2011 | JP |
| 2012-091310 | May 2012 | JP |
| 9716123 | May 1997 | WO |
| 9716124 | May 1997 | WO |
| 9729690 | Aug 1997 | WO |
| 9825666 | Jun 1998 | WO |
| 0051486 | Sep 2000 | WO |
| 0060421 | Oct 2000 | WO |
| 03049596 | Jun 2003 | WO |
| 2006111966 | Oct 2006 | WO |
| 2007047782 | Apr 2007 | WO |
| 2007075864 | Jul 2007 | WO |
| 2007111955 | Oct 2007 | WO |
| 2007126443 | Nov 2007 | WO |
| 2007138674 | Dec 2007 | WO |
| 2008038184 | Apr 2008 | WO |
| 2008108289 | Sep 2008 | WO |
| 2009034477 | Mar 2009 | WO |
| 2009089614 | Jul 2009 | WO |
| 2010006057 | Jan 2010 | WO |
| 2010109932 | Sep 2010 | WO |
| 2011025786 | Mar 2011 | WO |
| 2011060139 | May 2011 | WO |
| 2011060185 | May 2011 | WO |
| 2011085815 | Jul 2011 | WO |
| 2012042949 | Apr 2012 | WO |
| Entry |
|---|
| English Abstract of JP 01-234140 dated Sep. 19, 1989. |
| International Search Report dated Oct. 23, 2012 issued in PCT/JP2012/070414. |
| International Search Report dated Sep. 4, 2012 issued in PCT/JP2012/070408. |
| International Search Report dated Aug. 28, 2012 issued in PCT/JP2012/069927. |
| International Search Report dated Sep. 4, 2012 issued in PCT/JP2012/070415. |
| International Search Report dated Oct. 16, 2012 issued in PCT/JP2012/070581. |
| International Search Report dated Nov. 13, 2012 issued in PCT/JP2012/070576. |
| International Search Report dated Sep. 18, 2012 issued in PCT/JP2012/070417. |
| International Search Report dated Oct. 30, 2012 issued in PCT/JP2012/070418. |
| International Search Report dated Sep. 11, 2012 issued in PCT/JP2012/070416. |
| International Search Report dated Sep. 18, 2012 issued in PCT/JP2012/070407. |
| International Search Report dated Sep. 18, 2012 issued in PCT/JP2012/069868. |
| International Search Report dated Nov. 6, 2012 issued in PCT/JP2012/069919. |
| International Search Report dated Sep. 11, 2012 issued in PCT/JP2012/069696. |
| U.S. Office Action dated Apr. 9, 2015 received in related U.S. Patent Application, namely U.S. Appl. No. 14/169,675. |
| U.S. Office Action dated May 8, 2015 received in related U.S. Patent Application, namely U.S. Appl. No. 14/157,920. |
| Notice of Allowance dated Jan. 20, 2015 from related U.S. Appl. No. 13/566,023. |
| Notice of Allowance dated Jan. 29, 2015 from related U.S. Appl. No. 14/168,551. |
| Extended Supplementary European Search Report dated Feb. 12, 2015 from related European Application No. 12 81 9447.9. |
| Extended Supplementary European Search Report dated Feb. 13, 2015 from related European Application No. 12 82 0679.4. |
| Supplementary European Search Report dated Feb. 18, 2015 from related European Application No. 12 82 0758.6. |
| Extended Supplementary European Search Report dated Feb. 23, 2015 from related European Application No. 12 81 9877.7. |
| Extended Supplementary European Search Report dated Feb. 23, 2015 from related European Application No. 12 82 0239.7. |
| Partial Supplementary European Search Report dated Feb. 26, 2015 from related European Application No. 12 82 0666.4. |
| Partial Supplementary European Search Report dated Feb. 27, 2015 from related European Application No. 12 81 9672.2. |
| Extended Supplementary European Search Report dated Mar. 2, 2015 from related European Application No. 12 82 0017.7. |
| Extended Supplementary European Search Report dated Mar. 16, 2015 from related European Application No. 12 82 0479.9. |
| Extended Supplementary European Search Report dated Mar. 16, 2015 from related European Application No. 12 81 9504.7. |
| Extended Supplementary European Search Report dated Mar. 16, 2015 from related European Application No. 12 81 9398.4. |
| Extended Supplementary European Search Report dated Mar. 27, 2015 from related European Application No. 12 82 0056.5. |
| Chinese Office Action dated Jun. 3, 2015 from related Chinese Application No. 201280035926.3, together with an English language translation. |
| Chinese Office Action dated Jul. 1, 2015 from related Chinese Application No. 201280037244.6, together with an English language translation. |
| Extended Supplementary European Search Report dated Jul. 1, 2015 from related European Application No. 12 82 0066.4. |
| Extended Supplementary European Search Report dated Jul. 2, 2015 from related European Application No. 12 81 9672.2. |
| Extended Supplementary European Search Report dated Jul. 23, 2015 from related European Application No. 12 81 9455.2. |
| Office Action dated Sep. 16, 2015 received in related U.S. Appl. No. 13/566,012. |
| Office Action dated Nov. 19, 2015 received in related U.S. Appl. No. 14/157,920. |
| Number | Date | Country | |
|---|---|---|---|
| 20140148950 A1 | May 2014 | US |
| Number | Date | Country | |
|---|---|---|---|
| 61515203 | Aug 2011 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/JP2012/070417 | Aug 2012 | US |
| Child | 14169321 | US |
