Patent Grant
11478306
The present invention relates to a shape acquiring method and a controlling method for a medical manipulator.
There is a known medical manipulator system with which an affected part of the body is treated by inserting a medical manipulator into the body of a patient via a forceps channel or the like in an endoscope that is inserted into a body cavity of the patient (for example, see U.S. Pat. No. 7,720,322, Specification).
With the medical manipulator system of Patent Literature 1, kinematic shape information of the manipulator, that is, information concerning joint angles of the manipulator, is estimated on the basis of information concerning bending detected by an optical fiber sensor and information concerning a kinematic model.
An aspect of the present invention is a medical manipulator system including: an elongated manipulator that has a flexible portion and that has one or more joints at a distal end; a manipulator channel that passes through the manipulator; a route that is provided in the manipulator channel along a longitudinal direction; a shape sensor that is provided so as to be capable of moving in an interior of the route, and that has one or more detection points that detect shape information of the manipulator channel; a shape-sensor driving portion that causes the shape sensor to be driven forward and backward along the longitudinal direction of the route; a manipulator driving portion that drives the manipulator; and a controller that controls the manipulator and the shape sensor, wherein the controller is provided with a positional-information calculating portion that calculates longitudinal-direction positional information of the shape sensor on the basis of a driven amount of the shape-sensor driving portion, a shape estimating portion that estimates a bent shape of the manipulator on the basis of the detected shape information of the manipulator channel and the calculated longitudinal-direction positional information of the shape sensor, a control-parameter calculating portion that calculates a control parameter of the manipulator from the estimated bent-shape information of the manipulator, and a manipulator controller that controls the manipulator on the basis of the calculated control parameter.
In the above-described aspect, the shape estimating portion may compare the shape information of the manipulator channel detected by the shape sensor and the shape information of the same manipulator channel detected (N+1) cycles (N≥0) earlier, and may update the shape information of the manipulator in the case in which the difference therebetween is equal to or greater than a first threshold.
In the above-described aspect, the shape-sensor driving portion may be provided with: a motor that is disposed in the vicinity of a base end of the manipulator and that generates a motive power for driving, by means of rotational driving thereof, the shape sensor forward and backward; and a guiding member that is disposed in the vicinity of a distal end of the manipulator and that guides the shape sensor by winding a portion thereof about the guiding member, wherein the shape sensor may be moved forward and backward by pulling and feeding out the shape sensor in association with the rotational driving of the motor.
In the above-described aspect, a pulling wire having a diameter that is smaller than that of the shape sensor may be connected to a distal end of the shape sensor, and the shape-sensor driving portion may be provided with: a motor that is disposed in the vicinity of a base end of the manipulator and that generates a motive power for driving the shape sensor forward and backward via the pulling wire by means of the rotational driving thereof, and a guiding member that is disposed in the vicinity of a distal end of the manipulator and that guides the pulling wire by winding a portion thereof about the guiding member, wherein the shape sensor may be moved forward and backward by pulling and feeding out the shape sensor in association with the rotational driving of the motor.
The above-described aspect may be provided with an auxiliary shape sensor that is disposed parallel to the shape sensor and that is connected to an end portion of the pulling wire on the opposite side from the side at which the shape sensor is connected.
The above-described aspect may be provided with, between the shape sensor and the guiding member, a stopper that prevents the shape sensor from intruding into the guiding member.
The above-described aspect may be provided with a pressure receiving member that is provided at a distal end of the shape sensor and that is capable of expanding to substantially the same diameter as the inner diameter of the route, wherein the shape-sensor driving portion may be provided with a pressuring member for driving the shape sensor forward and backward by applying pressure to the pressure receiving member in the longitudinal direction.
In the above-described aspect, the shape estimating portion may determine that there is an abnormality in the case in which the shape information of the manipulator channel detected by the shape sensor is equal to or greater than a second threshold; and may cause the shape sensor to detect the shape information of the manipulator channel again.
In the above-described aspect, the manipulator controller may compare the control parameter of the manipulator calculated by the control-parameter calculating portion and the control parameter of the manipulator calculated one cycle earlier; and, in the case in which the difference therebetween is equal to or greater than a third threshold, may cause the manipulator driving portion to output a corrected control parameter that is corrected by a high-frequency cut-off filter stored in the manipulator controller.
In the above-described aspect, the manipulator controller may compare the controller of the manipulator calculated by the control-parameter calculating portion and the control parameter of the manipulator calculated one cycle earlier; and, in the case in which the difference therebetween is greater than a fourth threshold, may determine that there is an abnormality, and may cause the shape sensor to detect the shape information of the manipulator channel again.
The above-described aspect may be provided with a warning portion that issues a warning to an operator indicating the occurrence of an abnormal state in the case in which the number of times the determination that there is an abnormality is detected reaches or exceeds a predetermined number of times.
In the above-described aspect, the manipulator driving portion may control the joints on the basis of the shape information of the manipulator acquired by the shape sensor.
An aspect of the present invention is a bent-shape estimating method for a medical manipulator, said method including: a shape-sensor driving step of moving a shape sensor having one or more detection points forward and backward along a longitudinal direction of a manipulator channel in which an elongated manipulator that has a flexible portion having one or more joints at a distal end thereof is disposed; a positional-information calculating step of calculating longitudinal-direction positional information of the shape sensor on the basis of a driven amount of the shape sensor; and a shape estimating step of estimating the bent shape of the manipulator on the basis of the detected shape information of the shape sensor and the shape information of the manipulator channel detected by the shape sensor at the calculated longitudinal-direction positions of the shape sensor.
An aspect of the present invention is a controlling method for a medical manipulator, said method including: a control-parameter calculating step of calculating a control parameter of a manipulator from the bent shape of the manipulator estimated by means of the bent-shape estimating method for a medical manipulator according to claim 13; and a manipulator controlling step of controlling the manipulator on the basis of the calculated control parameter.
A medical manipulator system 1 and a shape acquiring method and a controlling method for a manipulator 2 according to an embodiment of the present invention will be described below with reference to the drawings.
As shown in
The control portion 100 is provided with: a positional-information calculating portion 9 that calculates information concerning the positions of the shape sensors 4 in the longitudinal direction on the basis of the driven amount (inserted amount) of the shape-sensor driving portion 8; a shape estimating portion 6 that estimates the bent shape of the manipulator 2 on the basis of the detected shape information (radii of curvature) of the manipulator channel 13 and the calculated longitudinal-direction positional information of the shape sensors 4; a control-parameter calculating portion 10 that calculates a control parameter of the manipulator 2 from the estimated bent-shape information of the manipulator 2; and a manipulator control portion (manipulator controller) 3 that controls the manipulator 2 on the basis of the calculated control parameter.
The shape-sensor driving portion 8 is provided with: a motor 18 that is disposed in the vicinity of the base end of the manipulator 2 and that drives, by means of rotational driving, the shape sensors 4 forward and backward; and a guiding member 17 that is disposed in the vicinity of the distal end of the manipulator 2 and that guides the shape sensors 4 by winding a portion of the shape sensors 4 therearound.
As shown in
The shape sensors 4 are, for example, sensors formed of long, thin elongated members that possess flexibility, such as optical fiber sensors, and detect, at one or more detection points P provided along the longitudinal direction, signals in accordance with the radii of curvature in a direction along a plane that includes the longitudinal axes of the shape sensors 4. As shown in
The positional-information calculating portion 9 calculates the longitudinal-direction movement amount (longitudinal-direction positional information) of the shape sensors 4 on the basis of the driven amount (inserted amount) of the shape sensors 4 inserted by the shape-sensor driving portion 8. It is possible to calculate the longitudinal-direction movement amount of the shape sensors 4, for example, by converting the rotation amount of the motor 18.
Alternatively, another method may be employed such as a method in which a rotating member (not shown), such as a roller, that comes into contact with outer surfaces of the shape sensors 4 and that is rotated by means of the movement of the shape sensors 4 in the longitudinal direction is provided, and the longitudinal-direction movement amount of the shape sensors 4 is calculated on the basis of the rotation amount of this rotating member.
While the shape sensors 4 are being moved in the route A that is provided parallel to the direction along the longitudinal direction of the manipulator channel 13 in which the manipulator 2 is disposed, the shape estimating portion 6 estimates the bent shape of the route A on the basis of the inserted amount of the shape sensors 4 calculated by the positional-information calculating portion 9 and the signals in accordance with the radii of curvatures detected by the shape sensors 4. Because the route A into which the shape sensors 4 are inserted is provided parallel to the longitudinal direction of the manipulator channel 13 into which the manipulator 2 is inserted, when the manipulator 2 is inserted into the manipulator channel 13, the shape of the flexible portion 7 of the manipulator 2 changes in conformity to the shape of the manipulator channel 13, and the shapes of the shape sensors 4 inserted into the route A change.
Therefore, the shape information of the route A and the shape information of the manipulator channel 13 are nearly identical to each other, and thus, it is possible to consider the bent shape of the route A as the bent shape of the manipulator channel 13.
The route A into which the shape sensors 4 are inserted may be, in addition to a channel that is provided in an endoscope or an overtube and into which the manipulator 2 is inserted, a channel provided in the manipulator 2 itself or an internal hole or the like of a tube disposed so as to run along the outer surface of the manipulator 2, and, in particular, in the case in which an affected part in the body is treated by inserting the manipulator 2 into the winding body cavity of a patient, the route A may be an arbitrary route that represents the bent shape of the manipulator 2 in the state of being inserted into the body cavity.
The control-parameter calculating portion 10 calculates the control parameter of the manipulator 2 from the information concerning the bent shape of the manipulator 2 estimated by the shape estimating portion 6. The manipulator control portion 3 controls the manipulator 2 on the basis of the control parameter of the manipulator 2 calculated by the control-parameter calculating portion 10.
The operation of the medical manipulator system 1 according to this embodiment, thus configured, will be described below.
In order to treat an affected part in a body cavity of a patient by using the medical manipulator system 1 according to this embodiment, first, the overtube 5 is inserted along the winding body cavity of the patient until reaching the vicinity of the affected part. Because the overtube 5 possesses flexibility, the overtube 5 bends in conformity to the shape of the body cavity of the patient. Then, the manipulator 2, which has been selected in accordance with the treatment, is inserted into the manipulator channel 13 provided in the overtube 5.
Next, the shape sensors 4 are inserted into the route A provided in the overtube 5. Then, while driving, by means of the motor 18, the shape sensors forward and backward in the longitudinal direction between the motor 18 and the guiding member 17, measurements of the radii of curvature at the individual positions of one or more detection points P and movement of the shape sensors 4 in the longitudinal direction are repeated, and the bent shape of the manipulator channel 13 is estimated by the shape estimating portion 6 on the basis of data in which the obtained information concerning the multiple radii of curvature and information concerning the longitudinal direction positions are associated with each other. By doing so, it is possible to estimate the bent shape of the manipulator channel 13 by tracing the bent shape by means of the shape sensors 4.
Because the bent shape of the manipulator channel 13 is estimated in this way, it is possible to enhance the operability of the manipulator 2 even in the state in which the manipulator 2 is inserted into the manipulator channel 13, because the manipulator 2 is controlled by the manipulator control portion 3 on the basis of the bent shape estimated by the manipulator channel 13.
In the case in which the overtube 5 is moved in order to treat a different affected part from a state in which one affected part is being treated, the posture of the patient is changed, a movement occurs in an organ, or the like, the shape of the body cavity of the patient changes in some cases, and the overtube 5 is also bent in conformity to the changed shape of the body cavity. In such a case, the bent shape of the manipulator channel 13 is estimated again while moving the shape sensors 4 forward and backward in the longitudinal direction in the route A, and the operation to bend the manipulator 2 in accordance with the estimated bent shape of the manipulator channel 13 is repeated.
As has been described above, with the medical manipulator system 1 according to this embodiment, it is possible to control the manipulator 2 in the manipulator channel 13 with the shape sensors 4 being disposed in the route A of the overtube 5 without removing and inserting the shape sensors 4 even in the case in which the affected part is moved or the posture of the patient or the like is changed while performing a procedure.
With the medical manipulator system 1 according to this embodiment, because the bent shape of the manipulator channel 13 is estimated by detecting multiple items of the shape information at the individual positions via one or more detection points P while moving the small number of shape sensors 4 in the longitudinal direction of the route A, a large number of shape sensors 4 is not necessary, and thus, there is an advantage in that it is possible to measure the bent shape of the manipulator 2 along the longitudinal direction by using the minimum number of shape sensors 4.
Because it is possible to perform a procedure without removing the shape sensors 4 from the route A and inserting the shape sensors 4 thereinto, it is possible to estimate, in real time, the bent shape of the manipulator 2 along the longitudinal direction when disposed in the manipulator channel 13.
Because the manipulator 2 is controlled on the basis of the control parameter calculated from the information concerning the estimated shape of the manipulator 2, there is a advantage in that it is possible to achieve good control of the manipulator 2 regardless of the shape of the flexible portion 7 by compensating for the attenuation of the driving force of the manipulator 2 and interference of the joints.
In this embodiment, the shape estimating portion 6 may compare the detected shape information of the manipulator channel 13 and the shape information of the manipulator channel 13 detected in advance, and may update the shape information in the case in which the difference therebetween is equal to or greater than a predetermined threshold.
Specifically, as shown in
In the case in which the difference DR between the shape information of the manipulator channel 13 and the shape information of the manipulator channel 13 detected (N+1) cycles (N≥0) earlier is equal to or less than the first threshold Th1 (step SA2), the original shape information is transmitted to the control-parameter calculating portion 10, and the control parameter of the manipulator 2 is calculated on the basis of this shape information (step SA4). The manipulator control portion 3 controls the manipulator 2 on the basis of the control parameter calculated by the control-parameter calculating portion 10 (step SA5).
As has been described above, with the medical manipulator system 1 according to this embodiment, there is an advantage in that it is possible to precisely control the manipulator 2 by preventing the manipulator 2 from being unintentionally operated in the case of an error, shaking, or the like.
The driving of the shape sensors 4 by the shape-sensor driving portion 8, the estimation of the bent shape of the manipulator 2 by the shape estimating portion 6, and the calculation of the control parameter of the manipulator 2 by the control-parameter calculating portion 10 may be performed in real time.
As has been described above, as a result of estimating the shape of the manipulator 2 in real time and continuously calculating/updating the control parameter of the manipulator 2, it is possible to smoothly control the manipulator 2 even if the control parameter is changed.
For example, as a result of performing the driving of the shape sensors 4 by the shape-sensor driving portion 8, the estimation of the bent shape of the manipulator 2 by the shape estimating portion 6, and the calculation of the control parameter of the manipulator 2 by the control-parameter calculating portion 10 at a control period that is equal to or less than 10000 times the control period of the manipulator 2 of the manipulator control portion 3, for example, as a result of performing the shape estimation to the parameter calculation at a control period that is equal to or less than 1 s when the control period of the manipulator is 100 μs, it is possible to enhance the controllability of the manipulator 2.
The shape-sensor driving portion 8, the shape estimating portion 6, the control-parameter calculating portion 10, and the manipulator control portion 3 may be configured to be capable of individually being operated in separate, independent operating modes.
By employing such a configuration, for example, it is possible to switch between a parameter calculating mode in which the control of the manipulator 2 is not performed, and the control parameter of the manipulator 2 is calculated by detecting the shape information of the manipulator channel 13 by means of the shape sensors 4 and a manipulator controlling mode in which the detection of the shape information of the manipulator channel 13 and the control-parameter calculation are not performed, and treatment is performed by controlling the manipulator 2. Therefore, because the manipulator 2 is in a halted state in the parameter calculating mode, the manipulator 2 is not unnecessarily driven, and thus, it is possible to safely operate the manipulator 2.
In this embodiment, it may be determined that there is an abnormality in the case in which the shape information of the manipulator channel 13 detected by the shape sensors 4 is equal to or greater than a second threshold, and the shape estimating portion 6 may cause the shape sensors 4 to detect the shape information of the manipulator channel 13 again. Specifically, as shown in
In the case in which the shape information R of the manipulator channel 13 detected by the shape sensors 4 is less than the second threshold Th2, it is determined that there is no abnormality such as a position displacement, and the detected shape information R is output to the control-parameter calculating portion (step SB2). The control-parameter calculating portion 10 calculates the control parameter of the manipulator 2 on the basis of the output shape information R (step SB3), and the manipulator control portion 3 controls the manipulator 2 on the basis of this calculated control parameter (step SB4).
As has been described above, with the medical manipulator system 1 according to this embodiment, it is possible to ensure safety by preventing the manipulator 2 from being unreasonably controlled and driven on the basis of an abnormal value.
In this embodiment, the manipulator control portion 3 may compare the control parameter of the manipulator 2 calculated by the control-parameter calculating portion 10 and the control parameter of the manipulator 2 calculated one cycle earlier, and, in the case in which the difference therebetween is equal to or greater than a third threshold, a corrected control parameter that is corrected by a high-frequency cut-off filter stored in the manipulator control portion 3 may be output to the manipulator driving portion 11.
Specifically, as shown in
In the case in which the difference Dk between the calculated control parameter and the control parameter of the manipulator 2 calculated one cycle earlier is less than the third threshold Th3, the original control parameter is output to the manipulator driving portion 11 (step SC6), and the manipulator 2 is driven by the manipulator driving portion 11 on the basis of the output control parameter (step SC7).
As has been described above, with the medical manipulator system 1 according to this embodiment, because the manipulator 2 is driven on the basis of the corrected control parameter in the case in which the difference Dk between the control parameter of the manipulator 2 and the control parameter of the manipulator 2 calculated one cycle earlier is equal to or greater than the third threshold Th3, it is possible to keep the driven amount of the manipulator 2 within a certain range even if the parameter is suddenly changed, and therefore, it is possible to stably drive the manipulator 2.
In this embodiment, the manipulator control portion 3 may compare the control parameter of the manipulator 2 calculated by the control-parameter calculating portion 10 and the control parameter of the manipulator 2 calculated one cycle earlier, may determine that there is an abnormality in the case in which the difference therebetween is greater than a fourth threshold Th4, and may cause the shape sensors 4 to detect the shape information of the manipulator channel 13 again.
Specifically, as shown in
In the case in which the difference Dk is equal to or less than the fourth threshold Th4, the original control parameter is output to the manipulator driving portion 11 (step SD5), and the manipulator 2 is driven by the manipulator driving portion 11 on the basis of the output control parameter (step SD6).
As has been described above, with the medical manipulator system 1 according to this embodiment, because it is determined that there is some kind of abnormality in the case in which the difference Dk between the control parameter of the manipulator 2 and the control parameter of the manipulator 2 calculated one cycle earlier is greater than the fourth threshold Th4, it is possible to safely perform treatment by preventing the manipulator 2 from being unreasonably driven on the basis of an abnormal value.
This embodiment may be provided with a warning portion (not shown) that issues a warning to an operator indicating the occurrence of an abnormal state, by means of voice or the like, in the case in which the number of times the determination that there is an abnormality is detected reaches or exceeds a predetermined number of times.
By doing so, in the case in which there is some kind of abnormality, such as a position displacement that is inconceivable with normal use, it is possible to take measures so that the manipulator 2 is not unreasonably controlled and driven on the basis of an abnormal value.
In this embodiment, the manipulator driving portion 11 controls the joints 16 on the basis of the shape information of the manipulator 2 detected by the shape sensors 4.
Because the joints of the manipulator 2 are controlled on the basis of the shape information of the manipulator, it is possible to enhance the controllability of the angle of the distal-end portion of the manipulator 2.
Although this embodiment has been described in terms of an example in which the shape-sensor driving portion 8 is provided with the motor 18 disposed in the vicinity of the base end of the manipulator 2 and the guiding member 17 disposed in the vicinity of the distal end of the manipulator 2, and the shape sensors 4 formed in a loop shape are driven forward and backward between the motor 18 and the guiding member 17, alternatively, as a first modification, for example, as shown in
As a second modification, as shown in
As a third modification, as shown in
Although
As a fourth modification, as shown in
As a result of applying the pressure from the pressuring member to the pressure-receiving member 21, it is possible to easily drive the shape sensors 4 forward and backward in the longitudinal direction even in the case in which the shape sensors 4 are formed of a flexible material or the like. Because it is possible to reduce the inner diameter of the route A as compared with a system in which the shape-sensor driving portion 8 is formed of the guiding member 17 and the motor 18, it is possible to reduce the diameter of the medical manipulator system 1.
As a result, the following aspect is read from the above described embodiment of the present invention.
An aspect of the present invention is a medical manipulator system including: an elongated manipulator that has a flexible portion and that has one or more joints at a distal end; a manipulator channel that passes through the manipulator; a route that is provided in the manipulator channel along a longitudinal direction; a shape sensor that is provided so as to be capable of moving in an interior of the route, and that has one or more detection points that detect shape information of the manipulator channel; a shape-sensor driving portion that causes the shape sensor to be driven forward and backward along the longitudinal direction of the route; a manipulator driving portion that drives the manipulator; and a controller that controls the manipulator and the shape sensor, wherein the controller is provided with a positional-information calculating portion that calculates longitudinal-direction positional information of the shape sensor on the basis of a driven amount of the shape-sensor driving portion, a shape estimating portion that estimates a bent shape of the manipulator on the basis of the detected shape information of the manipulator channel and the calculated longitudinal-direction positional information of the shape sensor, a control-parameter calculating portion that calculates a control parameter of the manipulator from the estimated bent-shape information of the manipulator, and a manipulator controller that controls the manipulator on the basis of the calculated control parameter.
With this aspect, as a result of the shape sensor, which has one or more detection points, being inserted into the route provided along the longitudinal direction of the manipulator channel in which the elongated manipulator having the flexible portion is disposed and the shape of the manipulator channel being detected by the shape sensor while the shape sensor is driven forward and backward along the longitudinal direction of the route, it is possible to estimate the bent shape of the manipulator on the basis of the detected shape of the manipulator channel and the longitudinal-direction positional information thereof. In other words, because it is possible to detect the shape at the respective positions in the longitudinal direction by driving, in real time, a small number of shape sensors forward and backward while performing a procedure, it is possible to estimate the shape of the manipulator channel, that is, the bent shape of the manipulator in the longitudinal direction when being disposed in the manipulator channel by using a minimum number of shape sensors without having to employ a shape sensor such as a fiber bundle in which numerous optical fibers are bundled.
Because the shape sensor has one or more detection points, it is possible to detect multiple items of the route information as a result of a minimum amount of movement.
Because the manipulator is controlled on the basis of the calculated control parameter by calculating the control parameter of the manipulator with the control-parameter calculating portion from the information concerning the estimated bent shape of the manipulator, it is possible to achieve good control of the manipulator regardless of the shape of the flexible portion by compensating for the attenuation of the driving force of the manipulator and interference of the joints.
In the above-described aspect, the shape estimating portion may compare the shape information of the manipulator channel detected by the shape sensor and the shape information of the same manipulator channel detected (N+1) cycles (N≥0) earlier, and may update the shape information of the manipulator in the case in which the difference therebetween is equal to or greater than a first threshold.
By doing so, because the detected shape information of the manipulator channel and the shape information of the manipulator channel detected in advance are compared and the shape information of the manipulator is updated only in the case in which the difference therebetween is equal to or greater than the first threshold, it is possible to precisely control the manipulator by preventing the manipulator from being unintentionally operated in the case of an error, shaking, or the like.
In the above-described aspect, the shape-sensor driving portion may be provided with: a motor that is disposed in the vicinity of a base end of the manipulator and that generates a motive power for driving, by means of rotational driving thereof, the shape sensor forward and backward; and a guiding member that is disposed in the vicinity of a distal end of the manipulator and that guides the shape sensor by winding a portion thereof about the guiding member, wherein the shape sensor may be moved forward and backward by pulling and feeding out the shape sensor in association with the rotational driving of the motor.
By doing so, the shape sensor becomes capable of being driven forward and backward between the motor disposed in the vicinity of the base end of the manipulator and the guiding member disposed in the vicinity of the distal end of the manipulator in the route provided parallel to the manipulator channel. Therefore, it is possible to estimate the bent shape of the manipulator over the entire length of the manipulator (in particular, the flexible portion) disposed in the manipulator channel. Because it is possible to drive the shape sensor forward and backward in the route disposed parallel to the manipulator channel even when a procedure is being performed by using the manipulator, it is possible to estimate the bent shape of the manipulator in real time while the procedure is being performed.
In the above-described aspect, a pulling wire having a diameter that is smaller than that of the shape sensor may be connected to a distal end of the shape sensor, and the shape-sensor driving portion may be provided with: a motor that is disposed in the vicinity of a base end of the manipulator and that generates a motive power for driving the shape sensor forward and backward via the pulling wire by means of the rotational driving thereof, and a guiding member that is disposed in the vicinity of a distal end of the manipulator and that guides the pulling wire by winding a portion thereof about the guiding member, wherein the shape sensor may be moved forward and backward by pulling and feeding out the shape sensor in association with the rotational driving of the motor.
By doing so, the shape sensor becomes capable of being driven forward and backward between the motor disposed in the vicinity of the base end of the manipulator and the guiding member disposed in the vicinity of the distal end of the manipulator in the route provided parallel to the manipulator channel. At this time, the pulling wire is connected to the distal end of the shape sensor, and a portion of this pulling wire is wound about the guiding member. Therefore, because the shape sensor is not wound about the guiding member, it is possible to prevent the shape sensor from being folded and broken. Because the pulling wire has a diameter that is smaller than that of the shape sensor, it is possible to reduce the diameter of a bent portion of the guiding member. Therefore, it is possible to reduce the inner diameter of the route into which the shape sensor is inserted, and thus, it is possible to reduce the size of the medical manipulator system.
The above-described aspect may be provided with an auxiliary shape sensor that is disposed parallel to the shape sensor and that is connected to an end portion of the pulling wire on the opposite side from the side at which the shape sensor is connected.
By doing so, with the two shape sensors, namely, the shape sensor having one or more detection points and the auxiliary shape sensor, it is possible to simultaneously detect the shape information of the manipulator channel in two directions at the respective positions in the longitudinal direction of the route, and thus, it is possible to more precisely and quickly estimate the bent shape of the manipulator,
The above-described aspect may be provided with, between the shape sensor and the guiding member, a stopper that prevents the shape sensor from intruding into the guiding member.
By doing so, it is possible to prevent the shape sensor from being wound about the guiding member, and it is possible to prevent, in a simple manner, the shape sensor from being folded and broken.
The above-described aspect may be provided with a pressure receiving member that is provided at a distal end of the shape sensor and that is capable of expanding to substantially the same diameter as the inner diameter of the route, wherein the shape-sensor driving portion may be provided with a pressuring member for driving the shape sensor forward and backward by applying pressure to the pressure receiving member in the longitudinal direction.
By doing so, it is possible to easily drive the shape sensor forward and backward in the longitudinal direction as a result of applying, by means of the pressuring member, pressure in the longitudinal direction to the pressure receiving member provided at the distal end of the shape sensor even in the case in which the shape sensor is formed of a flexible material.
As compared with the structure in which the shape sensor is driven by a motor and a guiding member that guides the shape sensor by winding a portion of the shape sensor about the guiding member, it is possible to reduce the inner diameter of the route into which the shape sensor is inserted, and therefore, it is possible to reduce the size of the medical manipulator system.
In the above-described aspect, the shape estimating portion may determine that there is an abnormality in the case in which the shape information of the manipulator channel detected by the shape sensor is equal to or greater than a second threshold; and may cause the shape sensor to detect the shape information of the manipulator channel again.
By doing so, in the case in which the shape information of the manipulator channel is equal to or greater than the second threshold, it is determined that there is some kind of abnormality, such as a position displacement that is inconceivable with normal use, and the shape sensor is made to detect the shape information of the manipulator channel again. Therefore, it is possible to ensure safety by preventing the manipulator from being unreasonably controlled and driven on the basis of an abnormal value.
In the above-described aspect, the manipulator controller may compare the control parameter of the manipulator calculated by the control-parameter calculating portion and the control parameter of the manipulator calculated one cycle earlier; and, in the case in which the difference therebetween is equal to or greater than a third threshold, may cause the manipulator driving portion to output a corrected control parameter that is corrected by a high-frequency cut-off filter stored in the manipulator controller.
By doing so, because the manipulator is driven on the basis of the corrected control parameter corrected by the high-frequency cut-off filter in the case in which the difference between the control parameter of the manipulator and the control parameter of the manipulator calculated one cycle earlier is equal to or greater than the third threshold, it is possible to keep the driven amount of the manipulator within a certain range. Therefore, it is possible to stably drive the manipulator by avoiding destabilization of the manipulator operation due to a sudden change in the parameter.
In the above-described aspect, the manipulator controller may compare the controller of the manipulator calculated by the control-parameter calculating portion and the control parameter of the manipulator calculated one cycle earlier; and, in the case in which the difference therebetween is greater than a fourth threshold, may determine that there is an abnormality, and may cause the shape sensor to detect the shape information of the manipulator channel again.
By doing so, because it is determined that some kind of abnormality is occurring in the case in which the difference between the control parameter of the manipulator and the control parameter of the manipulator calculated one cycle earlier is greater than the fourth threshold, it is possible to prevent the manipulator from being unreasonably controlled on the basis of an abnormal value, and thus, it is possible to safely operate the manipulator
The above-described aspect may be provided with a warning portion that issues a warning to an operator indicating the occurrence of an abnormal state in the case in which the number of times the determination that there is an abnormality is detected reaches or exceeds a predetermined number of times.
By doing so, it is possible to reliably make an operator recognize the occurrence of an abnormality, visibly, audibly, or the like in the case in which the number of times an abnormality is detected reaches or exceeds a predetermined number of times, and thus, it is possible to increase safety.
In the above-described aspect, the manipulator driving portion may control the joints on the basis of the shape information of the manipulator acquired by the shape sensor.
By doing so, because the joints of the manipulator are controlled on the basis of the shape information of the flexible portion of the manipulator, it is possible to enhance the controllability of the angles of the distal-end portion of the manipulator.
An aspect of the present invention is a bent-shape estimating method for a medical manipulator, said method including: a shape-sensor driving step of moving a shape sensor having one or more detection points forward and backward along a longitudinal direction of a manipulator channel in which an elongated manipulator that has a flexible portion having one or more joints at a distal end thereof is disposed; a positional-information calculating step of calculating longitudinal-direction positional information of the shape sensor on the basis of a driven amount of the shape sensor; and a shape estimating step of estimating the bent shape of the manipulator on the basis of the detected shape information of the shape sensor and the shape information of the manipulator channel detected by the shape sensor at the calculated longitudinal-direction positions of the shape sensor.
An aspect of the present invention is a controlling method for a medical manipulator, said method including: a control-parameter calculating step of calculating a control parameter of a manipulator from the bent shape of the manipulator estimated by means of the bent-shape estimating method for a medical manipulator according to claim 13; and a manipulator controlling step of controlling the manipulator on the basis of the calculated control parameter.
This is a continuation of International Application PCT/JP2016/88841, with an international filing date of Dec. 27, 2016, which is hereby incorporated by reference herein in its entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4443698 | Schiffner | Apr 1984 | A |
| 5563967 | Haake | Oct 1996 | A |
| 5798521 | Froggatt | Aug 1998 | A |
| 5840024 | Taniguchi et al. | Nov 1998 | A |
| 6059718 | Taniguchi et al. | May 2000 | A |
| 6256090 | Chen | Jul 2001 | B1 |
| 6888623 | Clements | May 2005 | B2 |
| 6999852 | Green | Feb 2006 | B2 |
| 7720322 | Prisco | May 2010 | B2 |
| 8105230 | Honda et al. | Jan 2012 | B2 |
| 8918212 | Larkin | Dec 2014 | B2 |
| 10105188 | Larkin | Oct 2018 | B2 |
| 10111711 | Farritor et al. | Oct 2018 | B2 |
| 10219887 | Johnson | Mar 2019 | B2 |
| 10245115 | Froggatt | Apr 2019 | B2 |
| 10512510 | Blumenkranz | Dec 2019 | B2 |
| 10537397 | Larkin | Jan 2020 | B2 |
| 10682070 | Duindam | Jun 2020 | B2 |
| 10791908 | Au | Oct 2020 | B2 |
| 10898256 | Yates et al. | Jan 2021 | B2 |
| 10939826 | Glynn | Mar 2021 | B2 |
| 10939972 | Au | Mar 2021 | B2 |
| 11116590 | Larkin | Sep 2021 | B2 |
| 11324393 | Froggatt | May 2022 | B2 |
| 20020097960 | Greenaway | Jul 2002 | A1 |
| 20060013523 | Childlers | Jan 2006 | A1 |
| 20070116415 | Kobayashi | May 2007 | A1 |
| 20070151390 | Blumenkranz | Jul 2007 | A1 |
| 20070156019 | Larkin | Jul 2007 | A1 |
| 20070197939 | Wallace | Aug 2007 | A1 |
| 20080065110 | Duval et al. | Mar 2008 | A1 |
| 20090038413 | Seibold | Feb 2009 | A1 |
| 20090088897 | Zhao | Apr 2009 | A1 |
| 20090138025 | Stabler et al. | May 2009 | A1 |
| 20090157092 | Blumenkranz | Jun 2009 | A1 |
| 20090192524 | Itkowitz et al. | Jul 2009 | A1 |
| 20090198104 | Sugiyama | Aug 2009 | A1 |
| 20090299344 | Lee et al. | Dec 2009 | A1 |
| 20090324161 | Prisco | Dec 2009 | A1 |
| 20100030063 | Lee et al. | Feb 2010 | A1 |
| 20100042077 | Okada | Feb 2010 | A1 |
| 20100099951 | Laby et al. | Apr 2010 | A1 |
| 20100125284 | Tanner et al. | May 2010 | A1 |
| 20100202727 | Prisco | Aug 2010 | A1 |
| 20100228265 | Prisco | Sep 2010 | A1 |
| 20100236352 | Iida | Sep 2010 | A1 |
| 20100318100 | Okamoto et al. | Dec 2010 | A1 |
| 20110202069 | Prisco et al. | Aug 2011 | A1 |
| 20120132009 | Prisco | May 2012 | A1 |
| 20130204124 | Duindam et al. | Aug 2013 | A1 |
| 20130261392 | Yamamoto et al. | Oct 2013 | A1 |
| 20140330080 | Laby et al. | Nov 2014 | A1 |
| 20140343416 | Panescu et al. | Nov 2014 | A1 |
| 20150127019 | Komuro et al. | May 2015 | A1 |
| 20150223670 | Fujita et al. | Aug 2015 | A1 |
| 20160151121 | Prisco et al. | Jun 2016 | A1 |
| 20160157944 | Prisco et al. | Jun 2016 | A1 |
| 20160338784 | Hatakeyama et al. | Nov 2016 | A1 |
| 20160346054 | Hatakeyama et al. | Dec 2016 | A1 |
| 20160360951 | Hane | Dec 2016 | A1 |
| 20170014194 | Duindam et al. | Jan 2017 | A1 |
| 20170051026 | Doolan et al. | Feb 2017 | A1 |
| 20170071683 | Prisco et al. | Mar 2017 | A1 |
| 20170151026 | Panescu et al. | Jun 2017 | A1 |
| 20170319049 | Laby et al. | Nov 2017 | A1 |
| 20190021796 | Timperley et al. | Jan 2019 | A1 |
| 20190029762 | Iida et al. | Jan 2019 | A1 |
| 20190307517 | Arai | Oct 2019 | A1 |
| 20200289142 | Brisson et al. | Sep 2020 | A1 |
| 20200397457 | Kim et al. | Dec 2020 | A1 |
| 20200405418 | Grubbs et al. | Dec 2020 | A1 |
| 20210015519 | Meglan et al. | Jan 2021 | A1 |
| 20210015572 | Gomez et al. | Jan 2021 | A1 |
| Number | Date | Country |
|---|---|---|
| 101496713 | Aug 2009 | CN |
| 2 085 017 | Aug 2009 | EP |
| 2 324 789 | May 2011 | EP |
| 2 647 327 | Oct 2013 | EP |
| 2 912 987 | Sep 2015 | EP |
| 3 108 797 | Dec 2016 | EP |
| 3 111 877 | Jan 2017 | EP |
| H03-295534 | Dec 1991 | JP |
| H08-107875 | Apr 1996 | JP |
| 2001-087281 | Apr 2001 | JP |
| 2004-000551 | Jan 2004 | JP |
| 3850377 | Nov 2006 | JP |
| 2007-143600 | Jun 2007 | JP |
| 2008-289556 | Dec 2008 | JP |
| 2009-131406 | Jun 2009 | JP |
| 2010-223724 | Oct 2010 | JP |
| 2011-019551 | Feb 2011 | JP |
| 2011-62291 | Mar 2011 | JP |
| 2012-115521 | Jun 2012 | JP |
| 2013-519432 | May 2013 | JP |
| 2014-83289 | May 2014 | JP |
| 2014-117446 | Jun 2014 | JP |
| 2015-505507 | Feb 2015 | JP |
| 2015-154814 | Aug 2015 | JP |
| 2015-159926 | Sep 2015 | JP |
| 2015-181643 | Oct 2015 | JP |
| 2016-129715 | Jul 2016 | JP |
| 2016-523592 | Aug 2016 | JP |
| 2008094949 | Aug 2008 | WO |
| 2008143218 | Nov 2008 | WO |
| 2010055745 | May 2010 | WO |
| 2011100124 | Aug 2011 | WO |
| 2013116140 | Aug 2013 | WO |
| 2014186715 | Nov 2014 | WO |
| 2015119935 | Aug 2015 | WO |
| WO 2015146712 | Oct 2015 | WO |
| 2017119112 | Jul 2017 | WO |
| 2017175320 | Oct 2017 | WO |
| Entry |
|---|
| International Search Report and Written Opinion dated Mar. 29, 2016 received in PCT/JP2016/050436. |
| International Search Report dated Mar. 28, 2017 received in PCT/JP2016/088841. |
| Japanese Office Action dated Nov. 12, 2019 in Japanese Patent Application No. 2017-559999. |
| Japanese Office Action dated Mar. 10, 2020 in Japanese Patent Application No. 2018-510161. |
| D. B. Camarillo, et al., “Vision based 3-D shape sensing of flexible manipulators”, IEEE, pp. 2940-2947, DOI: https://doi.org/10.1109/ROBOT.2008.4543656. |
| Y. Domae, et al., “3D measurement of flexible objects by robust motion stereo”, IEEE, pp. 740-743, DOI: https://doi.org/10.1109/SICE.2007.4421080. |
| A. Vandini, et al., “Vision-based motion control of a flexible robot for surgical applications”, IEEE, pp. 6205-6211, DOI: 10.1109/ICRA.2014.6907774. |
| Office Action dated Aug. 15, 2016 in U.S. Appl. No. 14/594,511. |
| Office Action dated Jan. 23, 2017 in U.S. Appl. No. 14/594,511. |
| Office Action dated Feb. 1, 2021 in U.S. Appl. No. 16/148,256. |
| Chinese Office Action dated Apr. 18, 2016 received in 201380037576.9. |
| International Search Report and Written Opinion of the International Searching Authority dated Oct. 22, 2013 received in PCT/JP2013/070349. |
| Japanese Office Action dated Jun. 9, 2015 received in 2014-528119. |
| Japanese Decision to Grant a Patent dated Dec. 1, 2015 received in 2014-528119. |
| Extended Search Report dated Mar. 4, 2016 received in 13825274.7. |
| International Search Report and Written Opinion dated Jul. 5, 2016 issued in PCT/JP2016/061196. |
| Written Opinion dated Mar. 28, 2017 issued in PCT/JP2016/088841. |
| Number | Date | Country | |
|---|---|---|---|
| 20190307517 A1 | Oct 2019 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/JP2016/088841 | Dec 2016 | US |
| Child | 16424935 | US |
