The present invention relates to an endoluminal device system, a control device, and a control method.
Conventionally, there are known endoluminal devices such as manipulators or endoscopes that are inserted into a lumen from the mouth or anus to perform observation or treatment in the lumen (for example, see PTLs 1 to 3). The endoluminal device includes an elongated flexible portion, a movable portion connected to a distal end of the flexible portion, and a power transmission member such as a wire configured to drive the movable portion. In such an endoluminal device, there are problems that power transmission characteristics of the power transmission member change according to a shape of the flexible portion and thus operating characteristics of the movable portion change. In PTLs 1 to 3, a means for solving the problems is proposed.
Specifically, in PTLs 1 and 2, a sensor is used to detect a shape of the flexible portion, and the movable portion is controlled based on the detected shape. A magnetic sensor (UPD) arranged outside the endoluminal device is used in PTL 1, and a shape sensor to be inserted into the endoluminal device is used in PTL 2.
In PTL 3, a movable portion is previously operated in a plurality of operation patterns according to various shape patterns of a flexible portion, and control parameters are set in association with tension information of a power transmission member at that time. The tension information is a time integral value of tension, a rate of change, or a predetermined threshold. Then, the tension information is acquired in an intraoperative calibration operation, and control parameters based on the acquired tension information are acquired.
A first aspect of the present invention provides an endoluminal device system including: an elongate and flexible endoluminal device; a flexible first wire that is disposed in the endoluminal device along a longitudinal direction of the endoluminal device; a first sensor that detects tension of the first wire; a second sensor that detects displacement of the first wire; a driving device capable of pulling the first wire; and at least one processor, wherein the at least one processor is configured to: cause the driving device to execute a relaxing operation for relaxing the first wire, acquire the tension of the first wire during the relaxing operation detected by the first sensor, acquire the displacement of the first wire during the relaxing operation detected by the second sensor, and adjust a control parameter of the endoluminal device based on a rate of change in the tension with respect to the displacement during the relaxing operation.
A second aspect of the present invention provides a control device for an endoluminal device system, the endoluminal device system including: an elongated and flexible endoluminal device; a flexible first wire that is disposed in the endoluminal device along a longitudinal direction of the endoluminal device; a first sensor that detects tension of the first wire; a second sensor that detects displacement of the first wire; and a driving device capable of pulling the first wire, wherein the control device comprises at least one processor, and wherein the at least one processor is configured to: cause the driving device to execute a relaxing operation for relaxing the first wire, acquire the tension of the first wire during the relaxing operation detected by the first sensor, acquire the displacement of the first wire during the relaxing operation detected by the second sensor, and adjust a control parameter of the endoluminal device based on a rate of change in the tension with respect to the displacement during the relaxing operation.
A third aspect of the present invention provides a control method for an endoluminal device, the endoluminal device having a flexible first wire disposed therein along a longitudinal direction of the endoluminal device, wherein the control method includes: executing a relaxing operation for relaxing the first wire; acquiring tension of the first wire during the relaxing operation; acquiring displacement of the first wire during the relaxing operation; and adjusting a control parameter of the endoluminal device based on a rate of change in the tension with respect to the displacement during the relaxing operation.
An endoluminal device system, a control device, and a control method according to a first embodiment of the present invention will be described with reference to the drawings.
The endoluminal device 1 is an elongated and flexible device, for example, an endoscope or a manipulator, which is inserted into a body cavity through an opening such as a mouth or anus for observation or treatment within the body cavity.
The driving device 2 incorporating a motor and the like is placed aside an operating table 9, as an example. Therefore, a flexible portion 13 of the electrically driven endoluminal device 1 includes, as well as an elongated intracorporeal portion 13a that is inserted into a body, an elongated extracorporeal portion 13b that is placed outside the body and connects a proximal end of the intracorporeal portion 13a to the driving device 2. Such a flexible portion 13 having flexibility is bendable in various shapes. In particular, since the shape of the extracorporeal portion 13b is determined by an arrangement of the driving device 2 and the operating table 9, the shape varies largely. Power transmission characteristics of a wire 12 in the endoluminal device 1 change depending on the shape of the flexible portion 13, and thus responsiveness of the movable portion 11 to the manipulation input to the manipulation device 6 can also change. As will be described below, the endoluminal device system 100 has a function of controlling the endoluminal device 1 such that the responsiveness of the movable portion 11 is constant by controlling the driving device 2 depending on the shape of the flexible portion 13.
The endoluminal device 1 includes an elongated and flexible portion 13. A proximal end of the flexible portion 13 is connected to the driving device 2.
The movable portion 11 is connected to a distal end of the flexible portion 13. In the present embodiment, the movable portion 11 is a bending portion that is bendable in a direction intersecting a longitudinal direction of the flexible portion 13.
The wire 12 has a function of transmitting the power given from the driving device 2 from the proximal end thereof to the distal end thereof to allow the movable portion 11 to move, and a function of acquiring shape information of the flexible portion 13. Hereinafter, the wire having the function of transmitting the power given from the driving device 2 from the proximal end to the distal end to allow the movable portion 11 to move is referred to as a driving wire, and the wire having the function of acquiring shape information of the flexible portion 13 is referred to as a measuring wire. For example, four wires 12 are provided to bend the bending portion 11 upward, downward, left, and right, respectively. In the present embodiment, each of these four wires 12 has both of a function as a driving wire and a function as a measuring wire.
The wire 12 is disposed in the flexible portion 13 along the longitudinal direction of the flexible portion 13, the distal end of the wire 12 is fixed to a distal end of the bending portion 11, and the proximal end of the wire 12 is connected to the driving device 2. The flexible wire 12 extending over the entire length of the flexible portion 13 in this way bends into the same shape as the flexible portion 13 as the flexible portion 13 bends.
The driving device 2 includes one or more actuators 2a that drive the wire 12 by retracting and advancing the proximal end of the wire 12 in the longitudinal direction of the wire 12. The actuator 2a pulls the wire 12 by retracting the proximal end of the wire 12, and relaxes the wire 12 by advancing the proximal end of the wire 12. The driving device 2 actuates the actuator 2a according to a control signal (which will be described below) from the control device 5 to bend the bending portion 11.
The tension sensor 3 is provided at the proximal end portion of the wire 12 and detects tension at the proximal end portion of the wire 12.
The displacement sensor 4 detects displacement of the proximal end portion in the longitudinal direction of the wire 12. For example, the displacement sensor 4 is an angle sensor that is provided in the actuator 2a and detects a rotation angle of the motor of the actuator 2a as displacement of the wire 12. A position of the proximal end portion of the wire 12 is an origin when the tension of the wire 12 is zero, and the displacement of the proximal end portion of the wire 12 detected by the displacement sensor 4 is a position of the proximal end of the wire 12 with respect to the origin. Therefore, the displacement increases with pulling of the wire 12, and decreases with relaxing of the wire 12.
The control device 5 includes at least one processor 5a such as a central processing unit, and a storage unit 5b.
The processor 5a receives a manipulation signal based on the input manipulation from the manipulation device 6, generates a control signal based on the manipulation signal, and transmits the control signal to the driving device 2. Thereby, the processor 5a controls the driving device 2 and thus controls the bending portion 11 of the endoluminal device 1.
The storage unit 5b includes a memory such as an RAM and a nonvolatile recording medium such as a ROM or an HDD. The recording medium is a computer-readable non-transitory recording medium. The recording medium stores a control program for causing the processor 5a to execute a control method for controlling the endoluminal device 1 according to the shape of the flexible portion 13.
Next, a control method of the endoluminal device 1 to be executed by the control device 5 will be described with reference to
As shown in
An operator inputs the trigger to the control device 5 using an input device (not shown), for example. The operator can input the trigger to the control device 5 at any desired timing when the operator wants to adjust the control parameters. For example, the operator inputs the trigger immediately before performing work such as treatment that requires an accuracy operation of the bending portion 11 after inserting the flexible portion 13 into the body cavity.
The processor 5a executes steps S2 to S5 in response to receiving the input trigger (YES in step S1).
Before step S2, the wire 12 and the bending portion 11 are arranged in a predetermined initial state. The initial state is, for example, a state in which predetermined initial tension is applied to all of the wires 12 and the bending portion 11 is arranged in a straight line.
In step S2, the processor 5a causes the driving device 2 to execute a pulling operation to pull the wire 12, and then causes the driving device 2 to execute a relaxing operation to relax the wire 12 being pulled. The wire 12 to be pulled and relaxed is any one wire 12, and the wire 12 paired with such a wire 12 is driven by the same amount, for example, in an opposite direction such that tension is not applied to the bending portion 11.
In the pulling operation, the processor 5a causes, for example, the driving device 2 to pull the wire 12 by a predetermined amount such that the wire 12 is applied with predetermined target tension. The predetermined target tension is within a range that does not hinder the bending of the flexible portion 13 along the shape of the body cavity, and accordingly, the wire 12 after the pulling operation is in a relaxed state to allow the bending of the flexible portion 13 along the shape of the body cavity.
During the relaxing operation, the displacement of the proximal end of the wire 12 decreases over time and the tension at the proximal end of the wire 12 is reduced over time (for example, see
Here, as the displacement of the proximal end of the wire 12 decreases, a region where tension decreases spreads from the proximal end to the distal end of the wire 12. In other words, during the relaxing operation, a change in tension (a decrease in tension) is transferred sequentially from the proximal end to the distal end of the wire 12. The processor 5a causes the driving device 2 to execute the relaxing operation at least until the change in tension is transferred to the distal end of the wire 12.
For example, the processor 5a may sequentially acquire the current tension or displacement from the sensors 3 and 4 during the relaxing operation, determine based on the current tension or displacement that the overall relaxing of the wire 12 is completed, and end the relaxing operation when the relaxing is completed. When the current tension is equal to or less than a predetermined value or when the current displacement is equal to or less than a predetermined value, the relaxing is determined to be completed.
When the change in tension reaches the distal end of the wire 12, there may appear a change point where a rate of change in tension changes. The processor 5a may end the relaxing operation when the change point of the tension is detected.
In step S3, the processor 5a causes the storage unit 5b to store the tension and the displacement during the relaxing operation detected by the sensors 3 and 4 in time series. Thereby, the processor 5a acquires tension data and displacement data during the relaxing operation.
Next, in step S4, the processor 5a uses the tension data and the displacement data acquired in step S3 to calculate the rate of change in tension with respect to the displacement during the relaxing operation, and adjusts the control parameters based on the rate of change. The rate of change in tension is a rate of change in tension at each displacement from the maximum tension at the start of relaxing operation.
The control parameters are the amount of pulling and the amount of relaxing of the wire 12 to transmit the change in tension to the distal end of the wire 12. More specifically, the control parameter is the amount of displacement of the proximal end of the wire 12 in the periods I, II, and III shown in
For example, when the displacement of the proximal end of the wire 12 is reduced by Δx1, the change in tension is transferred to a portion P1 of the wire 12. Therefore, the change in tension at the displacement Δx1 include shape information of the portion P1. When the displacement of the proximal end of the wire 12 is further reduced by Δx2, the change in tension is transferred to a portion P2 of the wire 12. Therefore, the change in tension at the displacement Δx2 includes shape information of the portions P1 and P2.
Therefore, a shape of a portion Pi can be estimated from a rate of change Ti/Tp in tension with respect to the displacement xi in order from the proximal end of the wire 12, and the control parameter corresponding to the overall shape of the flexible portion 13 can be determined based on such a rate of change Ti/Tp.
In order to accurately estimate the shape of the flexible portion 13 from the change in tension during the relaxing operation, as shown in
For example, when the relaxing of the wire 12 is completed and pulled again before the change in tension reaches the distal end, the tension of the wire 12 does not monotonically decrease from the proximal end to the distal end, as shown in
After completing the relaxing operation, in step S5, the processor 5a causes the driving device 2 to execute an initialization operation for returning the tension of the wire 12 to the initial tension. Thus, the wire 12 and the bending portion 11 return to the initial state.
After step S5, the processor 5a generates a control signal based on the manipulation signal from the manipulation device 6 and the control parameters adjusted in step S4, and transmits the control signal to the driving device 2. Thus, regardless of the shape of the flexible portion 13, the bending portion 11 can be controlled with good responsiveness.
As described above, according to the present embodiment, the change in tension of the wire 12 during the relaxing operation differs depending on the bending shape of the flexible portion 13, and the shape of the flexible portion 13 corresponding to the change in tension of the wire 12 is unique. Therefore, it is possible to set appropriate control parameters according to the shape of the flexible portion 13 based on the change in tension of the wire 12.
Further, with a simple configuration using the wire 12 and the sensors 3 and 4, it is possible to acquire the required data and set the control parameters.
In addition, the wire 12 has a function as a driving wire and a function as a measuring wire. Thus, there is no need to mount a separate measuring wire for acquiring shape information, or to add a new component for measurement to the flexible portion 13. Therefore, it is possible to reduce a diameter of the flexible portion 13.
In addition, the tension data and the displacement data may be acquired in the operation in which the flexible portion 13 is inserted into the body cavity and the bending portion 11 being bent returns to a straight shape. In this case, no manipulation is required to acquire the data, and data necessary for adjusting the control parameters can be acquired without increasing labor of the operator.
In addition, the data is acquired and the control parameters are adjusted immediately before the work that requires an accuracy operation of the bending portion 11, whereby optimum control parameters can be reliably set according to the shape of the flexible portion 13 at that time, and the bending portion 11 can be accurately moved according to the manipulation input to the manipulation device 6.
In the present embodiment, the processor 5a may cause the driving device 2 to execute pulling and relaxing operations without movement of the bending portion 11 by selecting the wire 12 to be pulled and relaxed.
Specifically, as shown in
In step S2 of a first example of the control method in
Next, the processor 5a controls the driving device 2 to simultaneously pull and relax the two selected wires 12 in the pulling operation and the relaxing operation. The relaxing operation at this time is executed until the tension of the wire 12 being driven returns to the tension before the pulling operation. The processor 5a acquires tension data and displacement data of at least one of the two wires 12 during the relaxing operation, and adjusts the control parameters based on the acquired data.
With such a configuration, the moment applied to the bending portion 11 is balanced during the pulling operation and the relaxing operation, and thus a bending direction and a bending angle of the bending portion 11 are kept constant. Therefore, it is possible to acquire the tension data and the displacement data without causing the operation of the bending portion 11.
In a second example of the control method in
Next, the processor 5a controls the driving device 2 to pull and relax the one selected wire 12 and the wire 12 paired with the selected wire 12 in the pulling operation and the relaxing operation.
With such a configuration, it is also possible to acquire the tension data and the displacement data without causing the operation of the bending portion 11 during the pulling operation and the relaxing operation.
In the present embodiment, the movable portion 11 is the bending portion, but the movable portion 11 is not limited thereto, and may have other forms. For example, the movable portion 11 may be a joint or may be an end effector having a grasping function.
In the present embodiment, the processor 5a executes the control method in response to the trigger input by the operator, but may automatically execute the control method.
For example, the processor 5a may repeatedly execute steps S2 to S5 at predetermined time interval. In this case, the acquisition of data and the adjustment of control parameters are repeatedly and automatically executed without the input of the trigger from the operator.
For example, the shape of the flexible portion 13 continuously changes in the process of inserting the flexible portion 13 into the body cavity. In such a scene, the control parameters are sequentially updated according to the change in the shape of the flexible portion 13, and thus the responsiveness of the movable portion 11 can be kept good.
In the present embodiment, as shown in
As shown in
In an initial state of t=t0, the tension of the wire 12 decreases exponentially from the proximal end to the distal end due to the effect of friction acting on the wire 12. As described above, in the process in which the wire 12 relaxes due to the displacement (advancement) of the proximal end of the wire 12, the change in tension (decrease in tension) is transferred sequentially from the proximal end to the distal end.
At t=ti−1, the tension at the proximal end drops from the initial maximum tension Tp to tension Tr_(i−1), and the change in tension is transferred to element i−1. In other words, the tension decreases in an operation region {1:i−1}, and the elongation of elements 1, 2, . . . , i−1 within the operation region {1:i−1} changes (decreases).
Similarly, at t=ti, the tension at the proximal end drops from the initial maximum tension Tp to tension Tr_i, and the change in tension is transferred to the element i.
In step S12, as the displacement of the proximal end of the wire 12 is reduced by dxi, the tension at the proximal end decreases from Tr_(i−1) to Tr_i, and the wire 12 relaxes to the element i, that is, the operation region extends to the element i.
Next, in step S13, tension Ti of the element i is calculated.
The maximum tension Tp at the proximal end is represented by Formula (1) below using tension Ti of each element i by the Euler's belt formula. Here, p is a friction coefficient, and θi is a bending angle of the element i.
{Formula 1}
T
p
=T
i
e
μΣ
θk (1)
The tension Ti of the element i can be calculated from Formula (2) below using the tension Tr_i at the proximal end of the wire 12 detected by the tension sensor 3. The rate of change in tension is calculated as a ratio of the tension Tr_i, which is acquired by the tension sensor 3 at the time of each displacement xi, to the initial maximum tension Tp.
Next, in step S14, the bending angle θi of the element i is calculated. The bending angle θi is obtained from Formula (3) below.
Next, in step S15, the amount of change dlk in elongation of each element k within the operation region {1, i−1} is calculated. The amount of change dlk in elongation of each element k can be calculated from the Hook's rule using a difference dTk in tension of the element k at the time of pulling and relaxing of the element k, as represented by Formula (4) below. Here, EA is rigidity of the wire 12.
dlk=Lk/EA×dTk (4)
From step S15, a total of the amount of change dl1, dl2, . . . , dl(i−1) in elongation from the element 1 to the element i−1 is obtained.
Next, in step S16, the length Li and the bending radius Ri of the element i are calculated.
Driven displacement dxi of the wire 12 is the total of the amount of change dl1, dl2, . . . , dli in elongation in an operation range {1:i} where the tension is transferred. Therefore, as represented by Formula (5) below, the amount of change dli of the element i is calculated as a difference between the displacement dxi and the total of the amount of change dl1, dl2, . . . , dli−1 in elongation from the element 1 to the element i−1.
From the above, the length Li and the bending radius (curvature radius) Ri of the element i are obtained by Formulas (6) and (7) below, respectively.
In the estimation of the shape of the flexible portion 13, weighting may be applied to multiple tension data. The multiple data are acquired by execution of the pulling operation and the relaxing operation for one wire 12 in multiple times, or are acquired by execution of the pulling operation and the relaxing operation for a plurality of wires 12.
Higher weighting is applied to data with high reliability among the multiple data. The data with high reliability is, for example, data acquired using the wire 12 with high linearity of spring constant, data with large tension, or data in which a driving speed of the wire 12 is slow in the relaxing operation. The greater the tension, the greater the amount of change in tension in the relaxing operation, so reliability of the data increases. Further, the slower the driving speed, the higher the data density, so reliability of the data increases.
In this way, the shape of the flexible portion 13 is estimated using the multiple data to which the weighting is applied based on the reliability, whereby errors in estimation of the shape of the flexible portion 13 can be reduced, and the shape of the flexible portion 13 can be estimated with higher accuracy.
Next, an endoluminal device system, a control device, and a control method according to a second embodiment of the present invention will be described with reference to the drawings.
As shown in
The endoluminal device system 200 includes an endoluminal device 10 having a movable portion 11 and one or more driving wires (second wires) 17, a measuring wire (first wire) 14 provided in the endoluminal device 10, a driving device 2, tension sensors (first sensor) 3 that detect tension of wires 14 and 17, a displacement sensor (second sensor) 4 that detects displacement of the measuring wire 14, and a control device 5.
In
The flexible driving wire 17 has the same configuration as the wire 12 of the first embodiment, but has a different function. In other words, the driving wire 17 of the present embodiment is disposed in the flexible portion 13 along the longitudinal direction of the flexible portion 13, a distal end of the driving wire 17 is fixed to a distal end of the bending portion 11, and a proximal end of the driving wire 17 is connected to the driving device 2. The flexible driving wire 17 extending over the entire length of the flexible portion 13 in this way bends into the same shape as the flexible portion 13 as the flexible portion 13 bends.
Unlike the wire 12 of the first embodiment, the driving wire 17 of the present embodiment has a function of transmitting the power given from the driving device 2 from the proximal end to the distal end to operate the movable portion 11, and does not have a function of acquiring shape information of the flexible portion 13. For example, four wires 17 are provided to bend the bending portion 11 upward, downward, left, and right, respectively. In the present embodiment, each of these four wires 17 is configured to be capable of functioning as a driving wire, but does not function as a measuring wire.
The flexible measuring wire 14 is disposed in the flexible portion 13 along the longitudinal direction of the flexible portion 13, a distal end of the measuring wire 14 is not connected to the movable portion 11 but is fixed to the distal end of the flexible portion 13, and a proximal end of the measuring wire 14 is connected to the driving device 2. The measuring wire 14 has a function of acquiring the shape information of the flexible portion 13, but does not have a function of transmitting the power given from the driving device 2 from the proximal end to the distal end to operate the movable portion 11.
The driving device 2 includes actuators 2a that retract and advance the proximal end portions of the wires 14 and 17 in the longitudinal direction of the wires 14 and 17, respectively.
The tension sensor 3 is provided at the proximal end portion of each of the wires 14 and 17 and detects tension at the proximal end portion of each of the wires 14 and 17.
The displacement sensor 4 detects displacement of the proximal end portion of the measuring wire 14 in the longitudinal direction of the measuring wire 14.
A friction coefficient of a path of the measuring wire 14 is greater than a friction coefficient of a path of the driving wire 17.
For example, as shown in
Another means of making the friction coefficients of the paths of the wires 14 and 17 different from each other may include a lubricant, a stranded wire/single-strand wire, or a surface treatment.
In other words, the type of lubricant applied to the wires 14 and 17 may be selected such that the friction coefficient of the path of the measuring wire 14 is greater than the friction coefficient of the path of the driving wire 17. Alternatively, a single-strand wire may be used as the driving wire 17 and a stranded wire may be used as the measuring wire 14. Alternatively, an outer surface of the measuring wire 14 may be subjected to a surface treatment that increases the friction coefficient, for example, a surface roughening treatment that forms an uneven structure.
In the control method of the present embodiment, the processor 5a pulls and relaxes the measuring wire 14 in a pulling operation and a relaxing operation (step S2), acquires tension data and displacement data of the measuring wire 14 during the relaxing operation (step S3), and adjusts control parameters for the driving wire 17 based on the data (step S4).
As described above, according to the present embodiment, the measuring wire 14 separate from the driving wire 17 is used, and the friction acting on the measuring wire 14 is greater than the friction acting on the driving wire 17. The smaller the friction acting on the driving wire 17, the higher the transmission efficiency of power from the proximal end to the distal end of the driving wire 17. On the other hand, the greater the friction acting on the measuring wire 14, the larger the change in tension at the proximal end of the measuring wire 14 during the relaxing operation. Therefore, responsiveness of the movable portion 11 can be enhanced, sensitivity of the tension to the shape of the flexible portion 13 can be enhanced, and estimation accuracy of the shape of the flexible portion 13 and adjustment accuracy of the control parameters can be improved.
In the present embodiment, the friction coefficient of the path of the measuring wire 14 is set to be greater than the friction coefficient of the path of the driving wire 17, but alternatively or additionally, a spring constant of the measuring wire 14 may be smaller than a spring constant of the driving wire 17.
The greater the spring constant of the driving wire 17, the faster the power transmission from the proximal end to the distal end of the driving wire 17. On the other hand, the smaller the spring constant of the measuring wire 14, the larger the amount of change in displacement with respect to the change in the tension, and the larger the amount of displacement of the measuring wire 14 required in the pulling operation and the relaxing operation.
Therefore, since the spring constant of the measuring wire 14 is smaller than the spring constant of the driving wire 17, the responsiveness of the movable portion 11 can be enhanced, the sensitivity of the displacement to the shape of the flexible portion 13 can be enhanced, and the estimation accuracy of the shape of the flexible portion 13 and the adjustment accuracy of the control parameters can be improved.
In the present embodiment, the measuring wire 14 may be pulled and relaxed in a linear region of the spring characteristic of the measuring wire 14.
According to the present modified example, the linear region of the measuring wire 14 is used, and thus it is possible to simplify an arithmetic operation for the calculation of the shape of the flexible portion 13 and the adjustment of the control parameters. Further, it is possible to perform more accurately the calculation of the shape of the flexible portion 13 and the adjustment of the control parameters.
When the measuring wire 14 is formed of a single-strand wire, the measuring wire 14 has spring characteristics in which tension varies linearly over substantially the entire range of displacement. Therefore, when the single-strand wire is used as the measuring wire 14, the measuring wire 14 may be pulled and relaxed in any linear region.
Next, an endoluminal device system, a control device, and a control method according to a third embodiment of the present invention will be described with reference to the drawings.
As shown in
The endoluminal device system 300 includes an endoluminal device 20 having two movable portions 11A and 11B and two or more wires (first wires) 12A and 12B, a driving device 2 that drives movable portions 11A and 11B by pulling and relaxing the wires 12A and 12B, a tension sensor (first sensor) 3 that detects tension of each of the wires 12A and 12B, a displacement sensor (second sensor) 4 that detects displacement of each of the wires 12A and 12B, and a control device 5.
The movable portions 11A and 11B are, for example, any one of bending portions, end effectors, and joints. In the example of
Similarly to the wires 12 of the first embodiment, the wires 12A and 12B are driving wires for operating the corresponding movable portions 11A and 11B, and are also measuring wires. Distal ends of the wires 12A and 12B are fixed to the corresponding movable portions 11A and 11B, respectively, and a proximal end of each of the wires 12A and 12B is connected to the driving device 2.
The driving device 2 includes two or more actuators 2a that retract and advance the proximal end portions of the wires 12A and 12B in the longitudinal direction of the wires 12A and 12B, respectively.
The tension sensor 3 is provided at the proximal end portion of each of the wires 12A and 12B and detects tension at the proximal end portion of each of the wires 12A and 12B.
The displacement sensor 4 detects displacement of the proximal end portion of each of the wires 12A and 12B in the longitudinal direction of each of the wires 12A and 12B.
In the present embodiment, the processor 5a executes a control method to adjust control parameters of the movable portions 11A and 11B when operating either one of the movable portions 11A and 11B. For example, the processor 5a acquires tension data and displacement data of the wire 12B during the relaxing operation of the wire 12B accompanying the operation of the movable portion 11B, and adjusts control parameters for both the movable portions 11A and 11B based on the acquired data.
As described above, according to the present embodiment, when one of the movable portions 11A and 11B performs an operation necessary for work such as treatment, control parameters for the other of the movable portions 11A and 11B can also be adjusted.
In the present embodiment, the processor 5a may execute the control method in response to a trigger or may repeatedly execute the control method at predetermined time interval, as in the first embodiment. In this case, the processor 5a may select any pair of wires from a predetermined plurality of wires 12A and 12B, and may pull and relax the selected wire in the pulling operation and the relaxing operation.
In the present embodiment, the processor 5a may calculate the shape of the flexible portion 13 and adjust the control parameters based on multiple tension data. The multiple data are acquired by execution of the pulling operation and the relaxing operation for one measuring wire 12 in multiple times, or are acquired by execution of the pulling operation and the relaxing operation for a plurality of measuring wires 12. With such a configuration, it is possible to improve the accuracy in calculation of the shape of the flexible portion 13 and adjustment of the control parameter.
Also in the first and second embodiments described above, the processor 5a may calculate the shape of the flexible portion 13 and adjust the control parameters based on the multiple tension data.
In the first to third embodiments described above, the endoluminal devices 1, 10, and 20 include the movable portions 11, 11A, and 11B, respectively, but the endoluminal device 30 may not include the movable portion as shown in
Next, an endoluminal device system, a control device, and a control method according to a fourth embodiment of the present invention will be described with reference to the drawings.
An endoluminal device system according to the present embodiment differs from those of the first to third embodiments in that the control device 5 causes the driving device 2 to automatically execute a relaxing operation without movement of the movable portion 11. In the present embodiment, components different from those of the first to third embodiments will be described, and the components common to those of the first to third embodiments will be denoted by the same reference numerals, and will not be described.
A control method of the endoluminal device according to the present embodiment can be applied to both the endoluminal device system 100 of the first embodiment including the wire 12 and the endoluminal device 300 including the wires 12A and 12B. In the present embodiment, the endoluminal device system 100 of the first embodiment will be described as an example.
As described above, in the endoluminal device 1 such as the electric endoscope having the elongated flexible portion 13, since dynamic characteristics of the wire 12 change due to the bending of the flexible portion 13, it is necessary to adjust the control parameters according to the shape of the flexible portion 13 in order to realize electric control. As one means for solving the problem, a method has been proposed in which an operator selects from a plurality of pre-registered shapes of the flexible portion or a plurality of treatment sites and a processor 5a changes control parameters according to the selected shape or treatment site (for example, see US Unexamined Patent Application, Publication No. 2017/0340400). In such a method, it is necessary for the operator to perform the manipulation of selecting the shape or treatment site.
As will be described in detail below, in the control method of the present embodiment, it is not necessary for the operator to perform an operation of inputting the trigger in step S1, and the control parameters are automatically adjusted.
The processor 5a executes a control method shown in
Specifically, the processor 5a acquires the last estimated shape of the flexible portion 13 from the storage unit 5b, and calculates the dead zone from the shape of the flexible portion 13 (step S8).
Next, the processor 5a controls the driving device 2 to retract and advance the proximal end of the wire 12 within the dead zone, thereby executing the pulling and relaxing operations of the wire 12 (step S2). Preferably, the processor 5a advances the proximal end of the wire 12 to a position where the dead zone ends.
Next, the processor 5a acquires tension and displacement of the wire 12 during the relaxing operation (step S3), estimates the shape of the flexible portion 13 (step S7), and causes the storage unit 5b to store the estimated shape.
As described above, as long as the proximal end of the wire 12 moves within the dead zone, since the decrease in tension is not transmitted to the distal end, the pulling operation and the relaxing operation of the wire 12 are executed in step S2 without movement of the movable portion 11 such as the bending portion. In other words, the execution of step S2 does not affect the manipulation of the movable portion 11 by the operator. Therefore, the processor 5a can automatically execute steps S2, S3, S7, and S4 at arbitrary timings without requiring the manipulation by the operator and without being noticed by the operator.
In the control method of
According to the control method of
In the control method of
As one method of initializing the bending portion 11, there is a method of controlling the bending of the bending portion 11 based on a difference in tension between a pair of wires 12 for bending in opposite directions. When the difference in tension is equal to or greater than a threshold, the processor 5a changes the bending angle of the bending portion 11 in a direction in which the difference in tension is smaller. Therefore, one of the pair of wires 12 relaxes in the initialization operation. When the difference in tension is less than the threshold, the bending portion 11 is restored to a straight shape.
When the operator inputs an initialization command to the control device 5 (step S1″), the processor 5a controls the driving device 2 to return the movable portion 11 to the initial state according to the initialization command, and executes relaxing operation during the initialization operation (step S2′). The processor 5a acquires tension data and displacement data of the wire 12 that relaxes during the initialization operation of the movable portion 11 (step S3), and executes steps S4 and S7 using the acquired data.
According to the control method of
Next, an endoluminal device system, a control device, and a control method according to a fifth embodiment of the present invention will be described with reference to the drawings.
As shown in
The endoluminal device system 400 includes a shape detection device 18 in addition to the endoluminal device 1, the wire 12, the driving device 2, the sensors 3 and 4, and the control device 5.
The system 400 shown in
The shape detection device 18 includes a plurality of internal sensors 18a mounted on the endoluminal device 1 and an external antenna 18b arranged outside the endoluminal device 1.
The plurality of internal sensors 18a are magnetic coils that generate magnetism, and are arranged in the longitudinal direction of the flexible portion 13.
The external antenna 18b is, for example, a UPD (Endoscope Position Detecting Unit). The external antenna 18b has a reception range (detection range) that is a three-dimensional space having a predetermined size, and the internal sensor 18a from which the external antenna 18b can receive magnetism is only the internal sensor 18a within the reception range. The external antenna 18b receives the magnetism generated by each of the internal sensors 18a within the reception range, calculates a position of each of the internal sensors 18a based on the magnetism, and calculates the shape of the flexible portion 13 by connecting the positions of the plurality of internal sensors 18a with lines.
As shown in
After step S1, the processor 5a causes the shape detection device 18 to detect a shape of a distal side portion 131 of the flexible portion 13, and acquires the shape of the distal side portion 131 from the shape detection device 18 (step S9). As shown in
After steps S2 and S3, the processor 5a estimates a shape of at least a proximal side portion 132 of the flexible portion 13 of the endoluminal device 1 using the tension data and the displacement data, and estimates a whole shape of the flexible portion 13 from the shape of the distal side portion 131 and the shape of the proximal side portion 132 (step S71).
For example, as shown in
Depending on the amount of insertion of the flexible portion 13 into the body, a length of the distal side portion 131 disposed within the reception range changes, and accordingly the number of internal sensors 18a disposed within the reception range changes. The processor 5a may calculate the length of each of the distal side portion 131 and the proximal side portion 132 from the number of internal sensors 18a from which the magnetism is received by the external antenna 18b. Alternatively, the length of each of the distal side portion 131 and the proximal side portion 132 may be determined in advance based on the dimensions of the reception range.
The use of the shape detection device 18 is advantageous in that the shape of the flexible portion 13 can be detected with high accuracy, but is disadvantageous in that a spatial range capable of being measured with high accuracy is limited to the reception range of the external antenna 18b. Therefore, it is particularly difficult to detect the shape of the entire length of the electrically driven long flexible portion 13 with high accuracy.
The method of estimating the shape of the flexible portion 13 from the tension data and the displacement data of the wire 12 during the relaxing operation is advantageous in that the shape can be estimated over the entire length of the flexible portion 13 regardless of the length of the flexible portion 13, but is disadvantageous in that the estimation accuracy of the shape of the distal side of the flexible portion 13 is low. This is because the shape of the flexible portion 13 is estimated in order from the proximal end to the distal end, and thus the estimation error on the distal side of the flexible portion 13 increases. Furthermore, estimation errors due to individual differences in material properties of the wire 12 also occur.
According to the present embodiment, the shape of the distal side portion 131 is detected with high accuracy by the shape detection device 18, and the shape of the proximal side portion 132 is estimated with high accuracy using the tension data and the displacement data. By a combination of the shapes of the two portions 131 and 132 acquired by different methods, the whole shape of the flexible portion 13 can be estimated with high accuracy.
In the present embodiment, the processor 5a may compensate the material properties of the wire 12, for example, rigidity and friction coefficient, using the shape of the distal side portion 131 acquired by the shape detection device 18 (step S10). There are individual differences in the material properties of the wire 12. By compensation of the material properties, it is possible to improve the estimation accuracy of the shape of the flexible portion 13 using the tension data and the displacement data.
Specifically, in step S10, the processor 5a selects a highly accurate portion, which is a portion detected in particular with high accuracy, from the shapes of the flexible portion 13 detected by the shape detection device 18. For example, the processor 5a specifies and selects a highly accurate portion based on a distance from the external antenna 18b to each internal sensor 18a or a variation in the calculated position of each internal sensor 18a. Next, the processor 5a selects a portion corresponding to the highly accurate portion from the shapes of the flexible portion 13 estimated using the tension data and the displacement data. Therefore, in step S71, the shape of the entire length of the flexible portion 13 is estimated. The processor 5a compensates the material properties such that the shape of the corresponding portion matches the shape of the highly accurate portion.
After compensating the material properties, the processor 5a may estimate the shape of the proximal side portion 132 again from the tension data and the displacement data using the compensated material properties (step S72). Thus, it is possible to obtain the shape that is estimated with higher accuracy than the shape estimated in step S71.
Next, an endoluminal device system, a control device, and a control method according to a sixth embodiment of the present invention will be described with reference to the drawings.
An endoluminal device system according to the present embodiment is characterized by a calculation method of control parameters in step S5 executed by the control device 5. The calculation method of control parameters of the present embodiment can be implemented in combination with any of the first to fifth embodiments. In the present embodiment, components different from those of the first to fifth embodiments will be described, and the components common to those of the first to fifth embodiments will be denoted by the same reference numerals, and will not be described.
Conventionally, a method has been proposed for accurately estimating control parameters of a complicatedly bent wire. For example, in Japanese Unexamined Patent Application, Publication No. 2015-154814, a flexible portion is divided into a plurality of sections, dynamic characteristics are estimated for each section, and control parameters are calculated using the estimated dynamic characteristics. In this case, the greater the number of sections, the higher the accuracy of the control parameters, but enormous calculation is required.
The method of the present embodiment is to estimate the dynamic characteristics of the complicatedly bent wire and to calculate the control parameters with a small amount of calculation.
As shown in
The processor 5a acquires a shape of the flexible portion 13 and displacement of the wire 12 (step S41). The processor 5a may also further acquire tension of the wire 12.
Next, the processor 5a calculates parameters of power transmission characteristics of the wire 12 in each of the three states, based on the shape and the displacement (step S42). Specifically, the processor 5a calculates, from the shape of the flexible portion 13, transmission efficiency of the tension of the wire 12 in each of the three states, and calculates a spring constant of the wire 12 in each of the three states from the displacement and transmission efficiency of the wire 12.
Next, the processor 5a derives a relationship between the amount of pulling and the tension in each of the pulling and relaxing states, using the spring constant of the wire 12, and derives a relationship between the amount of pulling and the tension in the dead zone state, as a difference between the relationships in the two states of pulling and relaxing (step S43). In other words, in step S43, the processor 5a obtains an equation of motion Mu″=T in each of the three states. Here, M indicates the mass of the wire 12, u indicates the displacement of the proximal end of the wire 12, and T indicates the tension of the wire 12.
Next, the processor 5a calculates the dynamic characteristics of the wire 12 in the pulling state from the equation of motion in the pulling state, and calculates the dynamic characteristics of the wire 12 in the relaxing state from the equation of motion in the relaxing state (step S44). Further, the processor 5a calculates a range of the displacement amount of the wire 12 corresponding to the dead zone (step S44).
Next, the processor 5a calculates control parameters, for example, for operating the bending portion 11, using the dynamic characteristics in the pulling or relaxing state (step S45). The processor 5a may relax the wire 12 by the amount corresponding to the dead zone after operating the bending portion 11 by pulling the wire 12. Thus, since there is no dead zone at the time of next operation of the bending portion 11, responsiveness of the bending portion 11 can be improved.
As described above, according to the present embodiment, the state of the wire 12 is classified into the three states, and three equations of motion are used according to the states of the wire 12. Thus, the dynamic characteristics can be calculated with the entire wire 12 as one element, and the dynamic characteristics can be estimated and the control parameters can be calculated with a small amount of calculation.
Next, an endoluminal device system, a control device, and a control method according to a seventh embodiment of the present invention will be described with reference to the drawings.
An endoluminal device system of the present embodiment is characterized by a calculation method of control parameters in step S5 executed by the control device 5. The calculation method of control parameters of the present embodiment can be implemented in combination with any of the first to sixth embodiments. In the present embodiment, components different from those of the first to sixth embodiments will be described, and the components common to those of the first to sixth embodiments will be denoted by the same reference numerals, and will not be described.
Mounting a sensor on a distal end portion of an endoluminal device such as an electric endoscope has design limitations. Therefore, a spring model is used as a control model instead of the sensor to estimate a state S of the wire 12, for example, tension Td at a distal end.
As shown in
When the step time Δt is lengthened for high-speed calculation of the spring model, displacement Δx of the mass point 123 at the step time Δt becomes large. Here, since the second spring 122′ is much shorter than the first spring 121′, the second spring constant k2 is greater than the first spring constant k1. Therefore, the tension Td at the distal end changes in response to movement of the mass point 123 with very high sensitivity. For this reason, when the step time Δt is lengthened, the tension Td abruptly changes and oscillates. In other words, the general spring model is unstable with respect to the long step time Δt, and calculation accuracy of the tension Td becomes unstable as the calculation speed increases.
As a means for solving the instability of calculation, a method has been proposed in which the stability of calculation with respect to the step time Δt is determined and the step time Δt is adjusted according to the determination result. For example, in the Publication of Japanese Patent No. 5692739, calculation is executed with a step time of “long”, the stability of the calculation is determined every time, and the step time is shortened when it is determined to be unstable.
Such a method is not to stabilize the model itself. Therefore, the total calculation time can be shortened in a case of a stable model, but the total calculation time is lengthened in a case of an unstable model. For this reason, such a method is effective in that the total calculation time can be shortened in off-line simulation, but is difficult to be used in real-time simulation.
In the present embodiment, an improved spring model shown in
Specifically, the second spring constant k2_t in the improved spring model is represented by the following formula. Here, k2 indicates a true second spring constant (an actual spring constant of a part of the wire 12 disposed on the movable portion 11), and kt indicates a spring constant of the part shifted from the first spring 121 to the second spring 122.
k2_t=k2×kt/(k2+kt)
In the improved spring model, the sensitivity of the tension Td to the amount of elongation (displacement x) of the wire 12 is reduced by kt/(k2+kt) times (<1.0) compared to the general spring model.
In the improved spring model, as described above, a part of the first spring 121 is moved to the second spring 122 by movement of the mass point 123, and thus the second spring constant k2_t becomes smaller. Thereby, the improved spring model is obtained that is stable compared to the general spring model. By using such an improved spring model, oscillation of the tension Td can be prevented even when the step time Δt is lengthened, and the calculation accuracy of the tension Td in real time can be stabilized.
As a part of the first spring 121 is shifted to the second spring 122, the first spring constant k1 also needs to be adjusted to maintain the relationship between the tension Tp at the proximal end and the tension Td at the distal end. Therefore, the adjusted first spring constant k1_t is used in the improved spring model. Thus, in the improved spring model, the relationship between the tension Tp and the tension Td as in the general spring model can be maintained.
The friction acting on the wire 12 during the pulling of the wire 12 is different from that during the relaxing of the wire 12. Therefore, in the spring model, the relationship between the displacement x and the tension Td during the pulling when tension Ta is acting on the mass point 123 differs from that during the relaxing.
As shown in
As shown in a right diagram of
The tension is lost due to the friction while being transferred between both ends of the wire 12. Here, a indicates transmission efficiency (a ratio of the tension at the distal end to the tension at the proximal end) of the tension from the proximal end to the distal end of the first spring 121. The first spring constants k1(+)_t, k1(±)_t, and k1(−)_t are calculated in consideration of the transmission efficiency α.
In this way, by using the three spring constants k1(+)_t, k1(±)_t, and k1(−)_t in consideration of the transmission efficiency α, the tension Td in each state of the wire 12 can be calculated in consideration of the friction.
The embodiments of the present invention and the modified examples thereof have been described above in detail with reference to the drawings, but the detailed configuration is not limited to the above-described embodiments and includes design changes made without departing from the scope of the present invention. Further, the components of the above-described embodiments and modified examples can be combined as appropriate.
This is a continuation of International Application PCT/JP2022/007493, with an international filing date of Feb. 24, 2022, which is hereby incorporated by reference herein in its entirety.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2022/007493 | Feb 2022 | US |
Child | 18219318 | US |