This application relates generally to medical devices and in particular to an articulated device applicable to remote robotic manipulation of surgical tools and instruments, such as endoscopes.
Endoscopic surgical instruments and tools are well known and continue to gain acceptance in the medical field. An endoscopic instrument or tool generally includes a rigid or flexible tube commonly referred to as a sleeve or sheath. One or more tool channels extend along (typically inside) the sheath to allow access to end effectors located at a distal end of the sheath. Control mechanisms located at a proximal end of the sheath are configured to enable remote manipulation of the end effectors via the one or more tool channels. Accordingly, the control apparatus for the sheath plays a key role in ensuring flexible access to end effectors, while protecting delicate organs and tissues of a patient. As used herein and elsewhere in the art of endoscopic medical devices, the term “end effector” refers to the actual working part of a surgical instrument or tool.
Endoscopic surgical tools may include clamps, graspers, scissors, staplers, needle holders, and other like tools, which serve to manipulate body parts (organs or tissue) during examination or surgery. Endoscopic instruments primarily include a light delivery system which serves to illuminate a body part under inspection, and an imaging system which serves to observe the body part under inspection. In a typical endoscopic light delivery system, the light source is located outside the patient's body and the light is delivered via an optical fiber system. In an endoscopic imaging system, an objective lens located at the distal end of the sheath transmits the image, formed by collected light, via a bundle of optical fibers to a viewing device or sensor located at the proximal end of the sheath. An example of a surgical endoscopic instrument includes a laparoscope, but many more exist.
Current endoscopic technology endeavors to reduce the amount of negative side effects and increase patient comfort, by providing minimally invasive surgery (MIS). However, one of the major shortcomings in the current state of the art of endoscopic tools is the lack of dexterity and sensitivity offered to health professionals (endoscopists and surgeons) who perform endoscopic procedures.
In highly delicate surgical operations, such as neurosurgery, it is necessary to avoid the contact of endoscope or any other surgical tools with the critical brain tissues and nerves in the periphery of the lesion. To that end, it is necessary to maneuver with precisely controlled shape of the sheath and to know with a high degree of certainty how much force or tension is being applied to an end effector. It is also necessary to view in detail the lesion from various directions, often even from an opposite direction from which the endoscope is inserted. In this manner, the operation can be performed without damaging delicate structures located near the organ or tissue being operated. To that end, it is necessary to be able to easily bend the sheath to a controlled shape in all directions and in any location, without exerting excessive force.
Many conventional endoscopic instruments with rigid or flexible sheaths prevent the surgeon or endoscopist from easily maneuvering endoscopic tools and instruments due to the rigidity of the mechanical structure of the sheath.
A potential solution to overcome the above-mentioned issues is to use a robotized articulation device to drive the endoscope camera in order to attain better view of the surgical lesion with minimal invasion to the surrounding critical structure under accurate control by a control apparatus. Improved instrumentation (e.g. endoscopes and catheters) using the robotized articulation device has been an area of active interest in clinical and engineering research groups.
A first approach is a device that uses a concentric tube. The concentric-tube robot is composed of precurved elastic tubes arranged in a concentric fashion. To control this robot with multi-sections, these tubes are rotated and translated with respect to one another. Bending torques are “built-in” as precurved tubes and are transmitted by rotational and translational motion of tubes. A second approach uses a multi-backbone robot in push-pull actuation. Among multiple backbones, one primary backbone is centrally located and is attached to a base disk and an end disk. The secondary backbones attached to the end disk are equidistant from each other. To generate bending torques, the secondary backbones are pushed and pulled against a base disk. These multi-section robots have been proposed to be applied to skull-based surgeries, neuro-endoscopes for endoscopic third ventriculostomy and choroid plexus cauterization, single-port surgery and transurethral surveillance and interventions.
Another type of robotized articulation device is a tendon-driven continuum robot. This approach has passive compliance when tendons are held by appropriate tensions. This feature ensures increased safety for patients in the case of high risk of contact with anatomies. An example includes a tendon-driven steerable catheter. For independent control of multi-sections, a linear beam configuration model that transforms beam configuration to tendon displacement including both mechanical and geometrical coupling among multi-sections has been proposed.
However, the tendon-driven continuum robot needs further refinement before becoming applicable to endoscopic support. The current state of the art in control and trajectory planning of the tendon-driven robot assumes that the one bending unit, or section, has constant curvature throughout the multiple sections as the pulling force propagates constantly through sections. In reality, a friction force between tendons and their guide structures within a section reduces the propagating pulling force, thus lessening the curvature from the proximal to the distal end of the robot. Limitation in size and material selection prohibits the reduction of this friction force, making it unrealistic to ignore friction force in control and trajectory planning.
Thus, there is a need to incorporate friction in kinematic mapping and extend such control and trajectory planning to develop a flexible endoscope. This is particularly useful as a neuroendoscope for surgical clipping of intracranial aneurysms.
Furthermore, there is a need to attain the control apparatus for tendon-driven devices with a feed-forward-control system with the kinematic mapping considering salient features of friction in tendons so that the control apparatus can generate control signal with high control bandwidth accurately.
According to at least one embodiment of the invention, there is provided an apparatus comprising a tendon-driven device having a proximal end fixed mechanically and a distal end, comprising: a bendable body, and a tendon attached to and extending a length of said body. For calculation purposes, the tendon-driven device can be understood as divided into multiple divisions between said distal end and said proximal end. The apparatus further comprises an actuator connected to said tendon, configured to actuate said tendon based on a control signal; and a controller configured to send said control signal to said actuator, comprising a forward-kinematic-mapping unit that estimates an angular displacement at the distal end, wherein the kinematic-mapping unit is configured for: providing a tension value of the tendon to obtain a desired angular displacement at the distal end of said tendon-driven device, wherein the tension has a nonlinear relationship with the desired angular displacement, and wherein the relationship is based on information of friction between said tendon and said body and the tension is greater that would be calculated without including the effect of friction.
In some embodiments, the kinematic-mapping unit is configured to map tension to curvature for a first division at the proximal end of said tendon-driven device from information of friction between said tendon and said first division and angular displacement of the first division; propagate a tension ratio between adjacent divisions of said tendon-driven device from the tension of the more proximally located division and from information of friction between said tendon and said division and angular displacements of the adjacent divisions; and estimate the angular displacement in said divisions from said tension ratio.
In other embodiments, there is provided an apparatus as well as a method for inverse kinematic mapping for the multi-section tendon-driven robot. The method comprising using a vectorized tension propagation model as disclosed herein. For example, the inverse kinematic mapping is applied to a two-section tendon-driven robot with a prismatic joint to generate reference trajectories with wide range of combination of directions and locations in the robot workspace.
Further embodiments, which may be combined with other various embodiments, include updating the friction coefficient. Yet other embodiments that may be combined with other various embodiments include providing less approximation and more precise attitude estimation by additional calculations.
Additional embodiments include an endoscopic apparatus. Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
Further objects, features and advantages of the present invention will become apparent from the following detailed description when taken in conjunction with the accompanying figures showing illustrative embodiments of the present invention.
a) illustrates an exemplary control apparatus for a tendon-driven device according to a first embodiment.
a) illustrates the angular displacement v. tension for the present invention compared to a device where tension is not taken into account.
a) illustrates of an exemplary control apparatus according to a second embodiment.
a) and 10(b) show an exemplary prototype of the tendon-driven device including a proximal body and a distal body.
a) and 23(b) are block diagrams of the computing units 91 (
a) and 24(b) are charts that respectively illustrate the tensile force Ti and angle θi, for each division with the tensile force τ1k at the proximal end set to 0.4 N. In
a) and 30(b) are charts showing calculated vs measured postures for tensions between 0.10 and 0.40 N for extending postures (
a) and 31(b) are charts showing calculated vs measured postures for tensions between 0.12N and −0.24 N and 0.12 N and 0.48 N for extending postures (
a) and 32(b) are charts showing the position error of the FKM in mm for each of the 30 cells within an embodied snake robot for tensions between 0.10 N and 0.40 N. The bars signify the mean values of the position error among three trials.
a) and 33(b) are charts showing the position error of the extended FKM in mm for each of the 30 cells within an embodied snake robot for tensions between 0.10 N and 0.40 N. The bars signify the mean values of the position error among three trials.
a) and 34(b) are charts showing the result of position error of the FKM for the antagonistic tendon layout. The position errors of a set of all cells were plotted. The bars signify the mean values of the position error among three trials.
a) and 35(b) provide results of position error of the FKM for the antagonistic tendon layout. The position errors of the sets of all cells were plotted. The bars signify the mean values of the position error among three trials. (Top) arching posture, (Bottom) extending posture.
In the following description, reference is made to the accompanying drawings which are illustrations of embodiments in which the disclosed invention may be practiced. It is to be understood, however, that those skilled in the art may develop other structural and functional modifications without departing from the novelty and scope of the instant disclosure.
In referring to the description, specific details are set forth in order to provide a thorough understanding of the examples disclosed. In other instances, well-known methods, procedures, components and circuits have not been described in detail as not to unnecessarily lengthen the present disclosure.
It should be understood that if an element or part is referred herein as being “on”, “against”, “connected to”, or “coupled to” another element or part, then it can be directly on, against, connected or coupled to the other element or part, or intervening elements or parts may be present. In contrast, if an element is referred to as being “directly on”, “directly connected to”, or “directly coupled to” another element or part, then there are no intervening elements or parts present. When used, term “and/or”, includes any and all combinations of one or more of the associated listed items, if so provided.
Spatially relative terms, such as “under” “beneath”, “below”, “lower”, “above”, “upper”, “proximal”, “distal”, and the like, may be used herein for ease of description to describe one element or feature's relationship to another element(s) or feature(s) as illustrated in the various figures. It should be understood, however, that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements described as “below” or “beneath” other elements or features would then be oriented “above” the other elements or features. Thus, a relative spatial term such as “below” can encompass both an orientation of above and below. The device may be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein are to be interpreted accordingly. Similarly, the relative spatial terms “proximal” and “distal” may also be interchangeable, where applicable.
The terms first, second, third, etc. may be used herein to describe various elements, components, regions, parts and/or sections. It should be understood that these elements, components, regions, parts and/or sections should not be limited by these terms. These terms have been used only to distinguish one element, component, region, part, or section from another region, part, or section. Thus, a first element, component, region, part, or section discussed below could be termed a second element, component, region, part, or section without departing from the teachings herein.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used herein, the singular forms “a”, “an”, and “the”, are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should be further understood that the terms “includes” and/or “including”, when used in the present specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof not explicitly stated.
In describing example embodiments illustrated in the drawings, specific terminology is employed for the sake of clarity. However, the disclosure of this patent specification is not intended to be limited to the specific terminology so selected and it is to be understood that each specific element includes all technical equivalents that operate in a similar manner.
Exemplary embodiments will be described below with reference to the several drawings, wherein like reference numerals designate identical or corresponding parts throughout the several views and embodiments. Accordingly, descriptions of such parts with like reference numerals will not be repeated with respect to multiple figures.
a) illustrates an exemplary control apparatus according to a first embodiment. A control unit 8 controls an actuator 4 by a control signal 10. The actuator is connected to a tendon 2 in a tendon-driven device 31. The actuator 4 can actuate the tendon 2 based on the control signal 10. The tendon-driven device 31 includes a body 1 with a distal end 5 and a proximal end 6. The tendon 2 is attached at an end fitting 3 to the distal end 5 on the body 1. The body 1 is fixed on the proximal end 6 mechanically so that the tip of the tendon-driven device 31 on the distal end 5 can be bent to a direction of an arrow B. As the tendon 2 is being actuated, the tip of the tendon-driven device 31 on the distal end 5 can be moved.
b) is a cross-sectional view along line A-A show in
The control unit 8 includes a forward-kinematic-mapping unit 9 that computes estimations of angular displacement of the tendon-driven device 31 based on a kinematic mapping of a lamped-parameter model of the tendon-driven device in
In the lamped-parameter model illustrated in
The following assumptions have been made for this lamped-parameter model:
To map tension in the tendon 2 at a proximal side to tension in the tendon 2 at a distal side, propagation of tension in tendon 2 is modeled with friction force between adjoining divisions 29.
In
where κi denotes curvature of division i and si denotes the length of division i, and Kθ denotes a bending stiffness of restoring element 33.
By using equation (1), the angular displacement θi (i.e., κisi) in
Under assumption A4, force equilibrium is described as,
Under assumption A5, friction force is proportional to normal force with friction coefficient μ,
f
i
=μN
i (4)
Under assumption A3, Equation (3) is described by,
T
i+1
=T
i
−f
i (5)
Using equations (2), (4), and (5), and assuming sin(θi/2)≈sin(θi+1/2), a ratio of tension Ti+1,j and Ti,j is described explicitly as,
The assumption of sin(θi/2)≈sin(θi+1/2) gives an approximation of variation ratio of the angular displacement of adjoining divisions 29 in many situations, when there are enough divisions in the tendon-driven device 31. Equation (6) allows one to calculate tension Ti+1,j by using only division i parameters. By using equation (1) and (6) from the proximal end 6 to the distal end 5 alternatively, tensions and angular displacement for all divisions 29 in the tendon-driven device 31 can be calculated.
The control target Θnk is input to an initial-value-generating unit 11. The initial-value-generating unit 11 outputs an estimation of angular displacement θ1k̂ at the proximal end 6 and tension τ1k at the proximal end 6. These signals are input to the forward-kinematic-mapping unit 9. The forward-kinematic-mapping unit 9 outputs an estimation of angular displacement Θnk̂ at the proximal end 6 based on the coordinate system on the proximal end 6 and tension τ1k at the proximal end 6. The estimation of angular displacement Θnk̂ is input to an adding unit 12. The adding unit 12 calculates the difference θe1k between the estimation of angular displacement Θnk̂ and the control target Θnk. This difference θe1k is input to a checking unit 13. The checking unit 13 compares an absolute value of the difference θe1k with a convergence criterion ε1.
In the checking unit 13, if the difference θe1k is smaller than the convergence criterion ε1, the checking unit 13 outputs an activate signal to switch unit 14. Once the activate signal is input to the switch unit 14, the tension τ1k is sent to the actuator 4 as the control signal 10. Thus, the control unit 8 can control the actuator 4 for the control target Θnk. After that, the next control target Θnk+1 at k+1 is processed.
On the other hand, if the difference θe1k is larger than the convergence criterion ε1, the checking unit 13 sends the difference θe1k to the initial-value-generating unit 11. The initial-value-generating unit 11 calculates the estimation of angular displacement θ1k̂ and the tension τ1k based on both the control target Θnk and the difference θe1k iteratively.
An exemplary computing method for the estimation of angular displacement θ1k̂ the tension τ1k in the initial-value-generating unit 11 is described as follows:
b) illustrates a control block diagram of the forward-kinematic-mapping unit 9 in
The tension for division i is mapped to the estimation of angular displacement θik̂ by a block of (1/Kθ) di based on equation (1).
The tension ratio block 17 generates the tension for division i+1 from the tension for division i and the estimation of angular displacement for division i based on equation (6). Therefore, the tension ratio block 17 estimates the tension for division on the distal side by using only information for division on the proximal side.
After calculating estimations of an angular displacement for all of divisions, angular-displacement-adding unit 35 generates estimation Θnk̂ by summing them up.
a) is a control block diagram of the control unit 8 in
First, the forward-kinematic-mapping unit 9 outputs a vector of angular displacement for divisions θk̂. Components of this vector are estimations of angular displacement for each division. Therefore the vector is described as,
θk̂·=[θ1k̂,θ2k̂,θ3k̂ . . . ,θnk̂]T (7)
Second, the vector of equation (7) is input to a tendon-displacement-computing unit 16. And then the tendon-displacement-computing unit 16 outputs the tendon displacement λk.
b) illustrates a control block diagram of the forward-kinematic-mapping unit 9 in
c) illustrates a control block diagram of the tendon-displacement-computing unit 16 shown in
This tendon displacement can be determined from a difference between a length of centroid and a length of tendon routing during bending. Consequently, the algorithm in the displacement calculation block 19 for division i is described as,
λlk=diθik̂ (8)
or,
λlk=di ArcTan(θik̂) (9)
After computation of a tendon displacement for every cell, a displacement-adding unit 20 generates the tendon displacement λk by summing all of tendon displacements for each division.
In
a) illustrates a control block diagram of the control apparatus including the control unit 8 and a plant 26 including the actuator 4 and the tendon-driven device 31 shown in
The control target Θnk is input to the feedback adding unit 24 as well as the initial-value-generating unit 11. The feedback adding unit 24 computes a difference between the control target Θnk and observation signal Yθnk of the angular displacement of the body 1 in the tendon-driven device 31.
In an exemplary embodiment, the observation signal Yθnk is obtained via sensors (not shown), such as electromagnetic field sensors. One or more of these sensors may be placed on the body 1. The sensors may include strain gauges to measure mechanical strain of the body 1. In one exemplary embodiment, multiple sensors for obtaining observation signal Yθnk are attached along a longitudinal direction of the body 1. For example, a sensor may be placed on each of the body segments along a longitudinal direction of the body 1.
In the exemplary embodiment shown and described herein, the feedback control unit 23 is a proportional-integral-derivative (PID) controller. Based on this difference, the feedback control unit 23 generates a compensation signal and outputs this compensation signal to a compensation-adding unit 25.
The compensation-adding unit 25 compensates the tension τ1k from the switch unit 14 by using the output of the feedback control unit 23, and then outputs this compensated tension τ1k to the plant 26.
b) is yet another example of the control apparatus combining with feedback control. The difference from the control apparatus in
In
In another exemplary embodiment, the configuration of the control apparatus is similar to the control apparatus of
a) is a graph of an example of the tension-calculating function. The solid line is an exemplary the tension-calculating function of the present invention.
A tension validation measurement is also depicted in
In some embodiments, the tension-calculating function can be the sequential calculation using, for example, the ratio of a tension in equations (6), (17) and (18). By using one of these equations, a friction force in each division can be determined. Then, by sum up the friction force in all of divisions, a required tension to compensate the friction can be calculated.
These functions can have pre-determined parameters so that these non-linear monotonically increasing functions fit to the experimental data of a required tension for an angular displacement. In some embodiments, the non-linear monotonically increasing function is determined from fitting the data from the tension calculated in one or more of equations (6), (17) and (18).
Thus, the present invention includes determining the tension-calculating function based on these ratios or, for example, a table based on these ratios. Other embodiments include non-linear equations such as an exponential function and a polynomial function that can be used to determine the tension. Tabulated values may include tables where friction is not positively defined but yet the tabulated values have the same relationships between the tension and angular displacement is also within the scope of the present invention.
b) is another example of an embodiment where a numerical table is used to determine tension. The forward-kinematic-mapping unit 9 in
The open in
a) illustrates of an exemplary control apparatus according to a second embodiment. A control unit 8 controls actuators 4 by a control signal 10. The actuators 4 are connected to four tendons 2 in a tendon-driven device 31. The tendon-driven device 31 includes two body segments, hereinafter referred as a distal body segment 1A and a proximal body segment 1B, connected serially. The distal body segment 1A is extended from a distal end 5 to a tip of the proximal body 21. On the other hand, the proximal body segment 1B is extended from a boundary of sections 21 to a proximal end 6. In this example, each body segment has two tendons 2. By using these pairs of tendons 2, the actuators 4 can bend the tendon-driven device 31 with two bending sections.
b) is a cross-sectional view along line C-C shown in
In the same manner, the tendons with distance d3 and d4 are attached to the proximal body segment 1B. These are terminated on the boundary of sections 21. The offset distance d3 is positive value and the offset distance d4 is negative value. Although these are same magnitude as each other, the sign is different.
The control unit 8 controls two targets of the angular displacement for the distal body segment 1A as well as the proximal body segment 1B. The one is the angular displacement Θnk on the distal end 5 based on a coordinate system on the proximal end 6. The other one is the angular displacement Θhk on the boundary of sections 21 based on a coordinate system on the proximal end 6.
The control unit 8, as well as other control units as described herein (for example, in
To control the four actuators 4, the control unit 8 sends a tendon-displacement vector λk whose components are tendon displacements of four tendons 2 for corresponding actuators as the control signal 10. The tendon-displacement vector λk is described as,
λk=[λ1k,λ2k,λ3k,λ4k]T (10)
The component λjk denotes the tendon displacement of a tendon j.
The control targets Θnk, Θhk are input to an initial-value generating unit 11. The initial-value-generating unit 11 outputs an estimation of angular displacement θ1k̂ at the proximal end 6 and a tension vector τ1k at the proximal end 6. Specifically, the tension vector τ1k composes tensions in each tendon 2 at the proximal end 6. The tension vector τ1k is described as,
τ1k=[τ1,1k,τ1,2k,τ1,3k,τ1,4k]T (11)
The component τi,jk of the tension vector τik denotes a tension in the tendon j at the division i.
The estimation of angular displacement θ1k̂ and the tension vector τ1k are input to the forward-kinematic-mapping unit 9. Moreover, a vector θk−1̂ of estimations of angular displacement for divisions at previous time, i.e., time k−1 is input from a second memory unit 22. The vector θk−1̂ is defined by equation (7). The forward-kinematic-mapping unit 9 outputs estimations of angular displacement Θnk̂, Θhk̂ and the vector of estimations of angular displacement θk̂ at present time k.
The vector of estimations of angular displacement λk is input to the second memory unit 22 as well as switch unit 14. The second memory unit 22 stores the vector λk and will send this vector to the kinematic-mapping unit 9 at time k+1. On the other hand, the estimations of angular displacement Θnk̂, Θhk̂ are input to an adding unit 12. The adding unit 12 calculates differences θe1k, θe2k between the control targets and the estimations. These differences θe1k, θe2k are input to a checking unit 13. The checking unit 13 compares an absolute value of the differences θe1k, θe2k with convergence criteria ε1, ε2.
In the checking unit 13, if the differences θe1k, θe2k are smaller than the convergence criteria ε1, ε2, the checking unit 13 outputs an activate signal to switch unit 14. Once the activate signal is input to the switch unit 14, the vector of estimations of angular displacement θk̂ is sent to a tendon-displacement-computing unit 16.
The tendon-displacement-computing unit 16 outputs a tendon displacement vector) λk to the actuator 4 as control signal 10. After that, the next control targets Θnk+1̂, Θhk+̂ at k+1 are processed.
However, if the differences θe1k, θe2k are larger than the convergence criteria ε1, ε2, the checking unit 13 sends the differences θe1k, θe2k to the initial-value-generating unit 11. The initial-value-generating unit 11 calculates the estimation of angular displacement θ1k̂ and the tension τ1k based on both the control target Θnk̂, Θhk̂ and the differences θe1k, θe2k iteratively.
The initial-value-generating unit 11 is further described by the exemplary embodiment of
These differences are input to another adding unit to compute a difference between each other. This difference is the angular displacement of the tip of the distal body segment 1A based on the bottom of the distal body 1A. This angular displacement of the tip of the distal body segment 1A is input to a bending stiffness block for the distal body 1A. By multiplying bending stiffness Kθ
The bending torque for the distal body segment 1A is input to a tension-allocation unit 36. The tension-allocation unit 36 determines the tensions at division h+1 for the two tendons 2 terminated on the tip of the distal body 1A. The division h+1 denotes the most bottom division in the distal body 1A.
To determine tensions for tendons 2 at division h+1 for this example, the tension-allocation unit 36 solves the following optimization as an algorithm 16 that can be described by the equation.
In the equation (12), Tε denotes a tension for pre-tensioning to avoid slacks of tendons and dh+1 is a moment-arm vector for division h+1. This vector is described as,
d
h+1
=[d
1
,d
2
,o,o] (13)
A pre-tension Tε may be applied to the apparatus prior to use and its effects are described by the equations above. The amount of pre-tension applied may be varied based on the use of the apparatus. Preferably, any pre-tension applied to the apparatus is applied to each of the tendons equally. The equation (12) can allocate minimum tension fulfilling the pre-tensioning condition to the tendons for the distal body 1A.
To determine tensions for rest of tendons, a second tension-allocation unit 37 performs an algorithm by using a bending torque for the proximal body segment 1B from the bending stiffness block Kθ
In equation (14), d1 denotes the moment-arm vector for division 1. This vector is described as,
d
1
=[d
1
,d
2
,d
3
,d
4] (15)
By using this algorithm, the second tension-allocation unit 37 outputs the tension vector for division 1.
In further detail,
The tension vector τi for division i is mapped to the estimation of angular displacement θik̂ by a block of (1/Kθ) di based on equation (1). However, this block performs inner product between the tension vector τi and the vector (1/Kθ) di.
The tension ratio block 17 generates the tension vector τi+1, for division i+1 from the tension vector τi for division i and the estimation of angular displacement θik̂, θik̂ for division i at time k and k−1.
The tension ratio block 17 performs linear transformation from the tension vector τi to the tension vector τi+1, by multiplying the following matrix Ai for division i in case of m tendons in the device.
In equation (16), Sgn is a sign function defined as,
Sgn(x):=−1 if x<o,o if x=o,1 if x>o (17)
The sign function in equation (16) manages the direction of friction force between tendons and the body against tensions in tendons. The direction of friction force depends on the position of tendon j against the centroid 7, i.e., Sgn (dj). Furthermore, by using estimation of angular displacement θlk−1̂ at previous time k−1, matrix Ai can consider a hysteresis feature of friction force. Therefore, the direction of friction force is also dependent on a bending direction of division i at time k, i.e., Sgn (θlk̂−θlk−1̂).
After calculating estimations of an angular displacement for all of divisions, an angular-displacement-adding unit 35 and a second angular-displacement-adding unit 38 generate estimation Θnk̂, Θhk̂ by summing them up. A first memory unit 18 stores estimations of angular displacement for every division, then outputs the vector of angular displacement for divisions. Meanwhile, the second memory unit 22 stores the vector θk̂. The vector stored in the second memory unit 22 will be used at next time k+1 as input for the division-computing unit 15.
c) illustrates another exemplary control apparatus according to the second embodiment. This control apparatus is an example of a combination with feed-forward control and feedback control. In
c) illustrates a control apparatus including the control unit 8 and a plant 26 including the actuator 4 and the tendon-driven device 31 shown in
The control targets Θnk, Θhk are input to the feedback adding unit 24 as well as the initial-value-generating unit 11. The feedback adding unit 24 computes a difference between the control targets Θnk, Θhk and observation signal Yθnk, Yθhk of the angular displacement of the body segments 1A, 1B in the tendon-driven device 31.
The exemplary feedback control unit 23 shown in
The compensation-adding unit 25 compensates the tendon-displacement vector λ1k from the tendon-displacement-computing unit 16 by using the output of the feedback control unit 23, and then outputs this compensated tendon-displacement vector λ1k to the inner-loop-feedback adding unit 28.
The inner-loop-feedback adding unit 28 and an inner-loop unit 27 create an inner loop feedback system for accurate targeting of the tendon displacement. The inner-loop-feedback adding unit 28 computes a difference between the tendon displacement vector λ1k and a vector of observation signal of the tendon displacement Yλ1k. The inner-loop unit 27 is a PID controller. Therefore, the inner-loop unit 27 computes a compensation signal for the tendon displacement vector λ1k.
The inner-loop unit 27 can increase control accuracy for the tendon displacement as well as a control band width for the control unit 8.
The embodiments described in detail above describe a multi-section continuum robot. Such a robot may be used, for example, for endoscopic surgical clipping of intracranial aneurysms. The robot may have one, two, three, four, or more sections for bending actuated by tendon wires. In on embodiment, the robot has two sections for bending actuated by tendon wires. By actuating the two sections independently, the robot can generate a variety of posture combinations by these sections while maintaining the top angle. Each body section may be actuated by a single tendon wire. Alternatively, two or more tendon wires may be used to actuate each body section (see
Kinematic Mapping with Tension Propagation Model
The kinematic mapping process and methods as described herein is able to provide models that arrive at the transformation that gives the actuator parameters of the robot. These include the pull amount of tendons in the continuum robot and displacement of the prismatic joint, based on the tip frame characterized by (Xt, Zt, θt algorithm for inverse kinematic mapping) in the task space coordinate. This transformation can be split into to two steps. First, we extended forward kinematic mapping (FKM) of the continuum robot to vectorized form for multi tendons in multi-section continuum robot. Second, by using this forward kinematic mapping (extended FKM), we presented iterative alg g (IKM) from the tip frame to the pull amount of tendons and the displacement of the prismatic joint.
To extend the forward kinematic mapping model for mapping to multiple tendon situations, we assume that we have available to use m appropriately distributed tendons for multiple sections. This allows one to write the tension of tendons at cell i at time k as the following vector.
τik=[τ1k . . . τjk . . . τmk]T (18)
In the same manner, tendon moment arms in the robot can be defined by the following matrix form.
Especially, when tendons 1 to l are terminated at the tip of the robot, e.g. cell n, and tendons (l+1) to m are terminated at cell q that is the tip of the proximal section, the matrix in equation 19 is described as,
where zero components in equation (20) denotes that tendons are terminated at the previous cell. In the same fashion, tendon moment arm matrix D can express the tendon routing for any number of multi-section by placing zero components.
Equation (20) is described as inner product of the tendon moment arm vector di and the tension vector τki for cell i.
On the other hand, tension vector τki is transformed to τk{i+1} by a tension ratio matrix Ai,
τi+1k=Aiτik (22)
where the tension ratio matrix Ai is the following diagonal matrix of the tension ratio for each tendon,
Finally, the entire forward kinematic mapping is derived from k1 to θk as a block diagram as exemplified in
On the left side of the diagram, the memory 2 block gives the information on bending angles at the previous time k−1. By comparing this information with the present bending angles at time k in the block Ai associated with equation (23), we determine the appropriate direction of the friction force considering the tendon layout even when the robot has an antagonistic pair of tendons. Besides, the mapping can manage a hysteresis of bending angles reached by bending or extending.
Once the bending angle vector θk is determined, the algorithm 1 block transforms this bending angle vector θk to the tip frame Xk of the robot based on the task coordinate. This transformation is the kinematic (geometric) transformation. To attain this transformation in the algorithm b block, we utilize a homogeneous transformation matrix parameterized by the are parameters in Webster et al, 2010 and applied the matrix for the tip frame of all cells. By multiplying this transformation matrix by cells, the tip position can be determined. Moreover, this transformation gives information of the backbone configuration, which is position of all cells. This feature is advantage for planning for exploration in constrained sensitive cavities to avoid undesirable collisions to the anatomy. Thus, the apparatus as positioned using this transformation provide particularly advantageous function within a patient.
To accomplish higher degree-of-freedom observation tasks, the tip of the continuum robot with an endoscope follows the desired trajectory with the desired observation direction. Thus, there is provided an inverse kinematic mapping.
To transform these target tip frames to corresponding actuator parameters for both the continuum robot and the prismatic joint, the target tip frame may be decoupled into the tip frames of the continuum robot Xkc, Zkc, θkc and the prismatic joint o, Zkp, o as follows.
In equation (24), the displacement of the prismatic joint is decoupled from contribution to Xkt and θkt. Therefore, we can split the entire IKM into two steps, which are the inverse mapping of the continuum robot about Xkc, θkc, and the prismatic joint about Zkp.
For the continuum robot part, to determine the vector of pull amount of tendons for the target parameters Xkt and θkt we initially map the target parameters Xkt and θkt to the tension vector of tendons by using the FKM. We define this mapping as a nonlinear optimization problem with the FKM. For a cost function of this optimization problem, we define the following normalized error norm |EkX|.
∥EkX∥=√{square root over ((Xek/εχ)2+(Θek/εθ)2)}{square root over ((Xek/εχ)2+(Θek/εθ)2)} (25)
where εx and εθ are convergence criteria for Xkt and θkt and Xke and θke are residuals based on the target parameters as follow.
X
e
k
=X
c
k
−X
t
k (26)
Θek=Θck−Θtk (27)
By using this cost function, we determine the tendon vector τk1 as the values to minimize the error norm in equation (25) as the following optimization problem.
Minimize ∥EXk∥
subject to
(Xck,Θck)=FKM(τ1k)
τk≧0 (28)
This optimization problem may be solved, for example, by the Nelder-Mead Simplex Method (See Lagarias:1998aa) with fminserch function in Matlab. In this method of optimization, all targets except for the target at time 1 have the target at previous time near the target to estimate. Therefore you can find the optimized target successfully by using the tensions at previous target as the initial search values for this algorithm. Moreover, the bending angles at previous time can be set for the bending angles in the memory 2 in
Once the tension vector is determined for the target parameters Xkt, θkt the vector of pull amount of tendons is calculated by the following equation with assumption A3 and the hinged wire guide structures.
λk=[λ1k . . . λmk]=θkD (29)
Specifically, in the robot designs as disclosed herein, the moment arm of tendon j for all cell 1 to n are equal. Therefore if we represent the moment arm for each cell as the moment arm at cell 1, the equation (29) can be simplified as follows.
λk=[Θckd1,1 . . . Θckd1,l Θbkd1,l+1 . . . Θbkd1,mk] (30)
Where θkb is the bending angle of cell l+1, which is the tip of the proximal section, based on the task coordinate.
The equation (30) gives a physical interpretation for the relation between bending angle and pull amount of tendons. The pull amount of tendons is a function of only the moment arm and the bending angle at the tip where tendons are terminated. The pull amount is independent from any bending angle distribution on the way to the tip, like the uneven curvature by friction force between tendons and eyelets or the bending angle of the intermediate section when the robot has multiple sections.
Finally, the entire inverse kinematic mapping can be derived as shown in the exemplary block diagram form shown in
The target at time 1 does not have the target at previous time before time 1. Therefore, the appropriate initial tension vector for the optimization calculation is not available for time 1. This initial tension vector is provided by the block Kinit on the left side in the diagram. To generate this initial values in the block Kinit we use the conventional piece-wise-constant approximation (PCCA) for the inverse kinematics. The closed-form geometric approach for the inverse kinematics is given for single and multiple sections with known tip position of each multi-sections. However, instead of tip position of sections, we map the tip position and the direction to the bending angle of two bending sections. Assuming that the continuum robot has two bending sections with constant curvature in the task coordinate in
where s is length of the one section and κ2 is curvature of the distal bending section.
By solving equation (31) numerically, the curvatures for two bending sections are determined from the tip frame of the robot. The tension vector for these determined curvatures can be calculated by using the similar constitution equation to equation (1).
The first embodiment involves deriving an equation regarding equilibrium between force and moment, based on assumptions A1 through A5, and solving the equation to obtain the angle θi of each division. However, if the body 1 bends greatly these assumptions do not hold as well, and estimation error of the attitude increases. For example, assumption A3 assumes that the inclined angle of the tendon 2 as to the body arm 1 is small. Accordingly, equation (1) does not take into consideration bending moment around the divisions due to normal force Ni+1,j. However, if the body 1 bends greatly the inclined angle of the tendon 2 increases, and the normal force Ni+1,j increases as can be seen in equation (2). The moment due to the normal force Ni+1,j acts to increase the angle θi, so the angle θi estimated according to the method described in the first embodiment, which does not take this moment into consideration, will be smaller than the actual value.
The first embodiment also involves approximating (θi/2) which is the inclined angle of the adjacent tendon 2 as to the sin(θi+1/2) to be equal as state in paragraph [0047], so as to solve the simultaneous equations of equations (2), (4), and (5). However, in an actual robot, the closer to the tip of the body 1 is, the smaller the angle θi is due to the influence of friction, as illustrated in
Accordingly, the present embodiment derives a forward-kinematic-mapping unit 9 with less approximation and more precise attitude estimation as compared to the first embodiment.
An equilibrium equation between force and moment acting on each division is derived.
First, an equilibrium equation will be derived for a case where i≧1. From
−Fxi+1 cos(θi+1)+Fyi+1 sin(θi+1)+Fxi−fi+1=0 (32)
−Fxi+1 sin(θi+1)−Fyi+1 cos(θi+1)+FyiNi+1=0 (33)
Taking the counterclockwise direction as forward, the equilibrium equation of moment centered on Oi, which is the base side endpoint of the division i is described by equation (34) using the bending moment Mi of the division i.
−Mi+Mi+1+dfi+1+1Ni+1−2l{Fxi+1 sin(θi+1)+Fyi+1 cos(θi+1)}=0 (34)
In a case where i≧1, the moment Mi is described by equation (35) using angle θi and bending stiffness k, thus yielding equation (36) by substituting equation (35) into equation (34).
M
i
=kθ
i (35)
−kθi+kθi+1+dfi+1+1Ni+1−2l{Fxi+1 sin(θi+1)+Fyi+1 cos(θi+1)}=0 (36)
Also, from
Further, assuming Coulomb friction between the tendon 2 and division in the same way as the first embodiment yields equation (39).
f
i+1
=μN
i+1 (39)
Note however, that equations (37) through (39) are identical to equations (2) through (4) according to the first embodiment, except that the suffixes of the normal force Ni+1 and the friction force fi+1 are different.
θi, Ti, Fxi, and Fyi are known values in the equilibrium of division i described in equations (32), (33), and (36) through (39), so the number of unknowns is the six of Ni+1, fi+1, θi+1, Ti+1, Fxi+1, and Fyi+1. The number of unknowns is thus the same as the number of independent equations, so all unknowns can be found be solving the simultaneous equations of (32), (33), and (36) through (39).
First, the right side and the left side of equation (37) are each divided by the right side and the left side of equation (38), and further equation (39) is substituted into equation (38) to eliminate the friction force fi, which yields equation (40).
Further, equations (39) and (33) are substituted into equation (36) to eliminate the reactive forces Fxi+1 and Fyi+1 and fi+1, which yields equation (41).
Equation (41) is substituted into equation (40) to eliminate the normal force Ni+1, which allows equation (42), which includes only the angle θi+1 as an unknown, to be derived.
However, equation (42) contains a tangent having the unknown θi+1 as a parameter, so analytical solution is not easy. Accordingly, in the present embodiment, a numerical solution is obtained for the angle θi+1 by iterative calculation using Newton's method. If the angle θi+1 at the m'th iterative calculation is described as θi+1m, the m'th computation result is described as equation (43).
The function H(θi+1) in equation (43) is the left side of equation (42). The function H′(θi+1) is the derivative of the angle θi+1 of the function H (θi+1), and is described in equation (44).
The angle θi+1 is then updated using equations (42) through (44) until the function H(θi+1) is a sufficiently small positive number εH or smaller. Note that in the present embodiment, the initial value θi+11 for iterative calculation is set to the angle θi of division i. The reason is that the number of times of iterative calculations necessary for convergence can be reduced by using the angle θi of an adjacent division as the initial value, since the angle θi of each division gradually changes from the proximal end to the distal end.
The angle θi+1 after convergence is substituted into equation (41) to compute the normal force Ni+1, and the normal force Ni+1 is substituted into equation (39) to obtain the friction force fi+1. The angle θi+1 and normal force Ni+1 are substituted into equation (37) to obtain the tensile force Ti+1. The angle θi+1, normal force Ni+1, and tensile force Ti+1 are substituted into equations (32) and (33) to calculate the link reactive forces Fxi+1 and Fyi+1.
Next, an equilibrium equation for division o where i=o, and a method for computing a numerical solution, will be described. First, in the present embodiment, division o is assumed to be a stiff body, so the angle θo is o.
θo=0 (45)
Thus, at the proximal end of division o the tendon 2 is parallel to division o as illustrated in
Fx
0=τ1k (46)
Fy
0=0 (47)
M
0=τ1kd (48)
Substituting equations (45) through (48) into equations (32), (33), and (36) through (38), yields equilibrium equations (49) through (53) for division o.
The simultaneous equations (39) and (49) through (53) are solved using the same method as for the case where i≧1 with the tensile force τ1k as a known value, thus obtaining the unknowns θ1, T1, Fx1, and Fy1. First, equation (49) is divided by equation (50), and the friction force f1 is eliminated using equation (39), which yields equation (54).
Also, equations (39) and (52) are substituted into equation (53) to eliminate link reactive forces Fx1 and Fy1 and friction force f1, which yields equation (55).
Further, equation (55) is substituted into equation (54) to eliminate the normal force Ni, allowing equation (56), which includes only the angle θ1 as an unknown, to be derived.
However, analytical solution of equation (56) is not easy, for the same reason as equation (43). Accordingly, a numerical solution is obtained equation (56) using Newton's method. If the angle θ1 at the m'th iterative calculation is described as θ1m, the m'th computation result is described as equation (57).
The function G(θ1) is the left side of equation (56). The function G′(θ1) is the derivative of the angle θ1 of the function G(θ1), and is described in equation (58).
Note that the initial value θi1 for iterative calculation in equation (57) is the output {circumflex over (θ)}1k of the initial-value-generating unit 11, in the present embodiment.
The angle θi+1 after convergence is substituted into equations (39) and (49)-(53), whereby the unknowns T1, Fx1, and Fy1 are obtained in the same way as in the case of i≧1.
a) and (b) are block diagrams of the computing units 91 and 92. A computing unit 911 in
This section illustrates an example of calculation of numerical values using the forward-kinematic-mapping-unit 9 designed in the previous section. In the present embodiment, the length l of a division is set to 0.5 mm, the number of divisions n is 30, the moment arm d is 0.7 mm, the friction coefficient is 0.33, and stiffness k is 0.2 Nmm/rad.
a) and (b) respectively illustrate the tensile force Ti and angle θi, for each division with the tensile force τ1k at the proximal end set to 0.4 N. In
It can be seen from
a), (b), and (c) illustrate the tip position of each division with the tensile force τ1k at the base set to 0.1 N, 0.2 N, and 0.4 N. Note that in
The attitude estimation method according to the third embodiment enables the attitude to be estimated with high precision as compared to the first embodiment even when the angle θi is great. However, the angle θi is calculated by iterative calculation as shown in equations (49) and (54), so the calculation time increases if the number of divisions increases. Also, if the angle θi is small, the difference in attitude as calculated by the methods according to the first and third embodiments is small, as can be seen from
In embodiments as discussed above, friction is presumed to be constant. However, friction is not constant and may change according to various environmental conditions such as the running time of the device, abrasion, fitting, surface oxidation, environment, humidity, and temperature. Thus, in some embodiments, the equations as discussed herein are solved using a latest and/or current value for the friction coefficient. This friction coefficient can be determined by understanding the relationship between the angular direction at the tip and the length the tendon was pulled to create the angular direction.
Surprisingly, in a tendon-driven apparatus, the direction of the tip, or of the top cell within a section that is controlled by one or more tendons (e.g., in a multi-segment apparatus) is dependent on the length the tendon was pulled and is not affected by the posture of the middle section or sections of the apparatus. Thus, an apparatus with a distal tip angle θtip will have the same pulled tendon length Lx regardless of whether the apparatus contains a single curve to provide the θtip angle or is in an “S” shape where the angle at the tip is θtip.
To describe these embodiments, a parallel curves characteristic is provided and used to calculate the direction of the tip. The parallel curve characteristic describes the relationship between (i) the angular difference between an end direction and a tip direction wherein each of two parallel tendon have the same end direction and tip direction, and (ii) the difference between the first curved end position and the second curved line end position.
For example, in an apparatus having two tendons, when one tendon located in a first position in the device is pulled a length L, the second tendon located in a second position is pulled in reverse by the same length L to effect a curve in the apparatus such that the direction of the tip of the device (or the top cell within a division controlled by the tendon) is θ. Thus, the difference between the two tendons is 2L. The directions of all top cells (the location of the tendon in the first position) in all sections are determined by the each amount of pulling tendon (L). In this embodiment, each tendon is connected to each top cell. This is not affected by any posture of the middle part of the device. In this embodiment, it is assumed that the tendons run parallel to the axis of the device and that the stretch of the strings can be ignored. The process as discussed above can be applied as well for apparatus with multiple sections and/or sections with different lengths.
This can be described as discussed above in Equation (44) which gives a physical interpretation for the relation between bending angle and pull amount of tendons, where the pull amount of tendons is described as a function of only the moment arm and the bending angle at the tip where tendons are terminated.
In a first exemplary calculation, where only a single wire is present, it is assumed that, with a tension applied to the tendon of T and a friction coefficient of μ1, the direction of the tip can be calculated with equation (45)
θ1=FKM(T,μ1) (59)
where FKM is the forward kinematic mapping as described above. In this embodiment, the current friction coefficient, μ is described as:
μ=μ1+δμ (60)
The direction of the tip can then be calculated with the assumption when a tension is T, as
θ2=FKM(T,μ1+δμ) (61)
The direction of the tip with the tendon moment arm d:
θ=λ/d (62)
is calculated based on the parallel curves characteristic where the tendon pulling displacement is λ. This calculation is based on equation (30). As discussed above, this equivalence is independent of any internal directions of the apparatus. From this information the latest or current friction coefficient can be estimated using the equation:
μ=μ1+δμ*(θ−θ1)/(θ2−θ1) (63)
In some embodiments, the equation (63) is valid. In others, it may be calculated as a curve with the three or more points (θ1, θ2, θ3 . . . ), with the equation adapted as appropriate. In these embodiments, the graph shown in
The device can be bent in an environment in which no external load is applied to the device. The distance between a centroid of the device (See 7 of
In another embodiment, the calculations are provided for determining the friction coefficient when two antagonistic wires are present. The tension applied to the first tendon is T1 and the tension applied to the second tendon is T2. The friction coefficient is μ1, and the direction of the tip can be calculated with the equation
θ1=FKM(T1,T2,μ1) (64)
where FKM is the forward kinematic mapping as described above. In this embodiment, the current friction coefficient, K is described as:
μ=μ1+δμ (65)
The direction of the tip can then be calculated with the assumption when the tendon tensions are T1 and T2 as
θ2=FKM(T1,T2,μ1+δμ) (66)
The direction of the tip under the assumption of non-elongation of the tendons:
θ=λ1/d1(=λ2/d2) (67)
is calculated based on the parallel curves characteristic. Specifically, the moment arm d1 and d2 are the opposite signed value since the two tendons locates on the opposite side on the coordinate system from Z axis. Also, λ1 and λ2 have the opposite signed values. In the two antagonistic tendon embodiment, one tendon is pulled by instance |λ1| and the second tendon is pulled in reverse by |λ2|, for a total difference in length of |λ1|+λ2| From this information the latest or current friction coefficient can be estimated using the equation:
μ=μ1+δμ*(θ−θ1)/(θ2−θ1) (68)
In yet another embodiment, where a single tendon is embodied, the effect of tendon stretch is considered. In prior embodiments, the tendon was presumed to move without stretch. However, it has been found that elongation, or stretch of the tendon during operation can occurred. It is possible to adjust for the tendon stretch as shown herein below. Additionally, the method can be applied to other embodiments, for example, those with multiple tendons, each of which has a stretch.
In this embodiment, the apparatus is defined as having n cells, an applied tension of T, and the tendon has an elastic modulus of E. Thus, assuming a friction coefficient of μ1, the direction of the tip can be calculated with the equation (59) as in the prior embodiment where the current friction coefficient, μ is described by equation (60). Similarly, equation (61) is used to calculate θ2.
The wire stretch is then calculated:
where dL is defined as follows:
dL=ΣdL
i (70)
The direction of the tip
This equation is calculated based on the parallel curves characteristic where the tendon pulling displacement is calculated according to equations (69) and (70). From this information the latest or current friction coefficient can be estimated using the equation (63).
In some embodiment, it is contemplated that an angle sensor is used to detect the angle directly. This angle sensor can be located on or near the tip of the apparatus. Thus, the direction of the tip is obtained directly from the sensors instead of the equation (62) by using tendon displacement λ. The computation procedure is the same as described above except for the equation (62). Non-limiting examples of angle sensors that may be used in these embodiments are: Examples of an angle sensors are: an external magnetic field, where there is a coil at the robot tip; an external magnetic field where there is a hall effect element at the robot tip; an external magnetic field where there is a magnetic resistance element at the tip; and an angular velocity detector such as a gyro sensor.
In some embodiment, it is contemplated that a positioning sensor detecting the position directly is equipped at the tip. For these embodiments, a friction coefficient is presumed and the tip position is calculated with FKM when the tension T is applied. Instead of θ1 and θ2 as calculated above, P1 and P2 are calculated according to the following equations:
P1=FKM(T,μ1) (72)
P2=FKM(T,μ1+δμ) (73)
where P is the tip position acquired by the position sensor. Non-limiting examples of the positioning sensor are a magnetic positioning sensor, such as an Aurora positioning sensor and image analysis.
As shown in
In some embodiments, P1, P2, and P are on the same line and P can be calculated by proportion. In other embodiments, P can be calculated by finding the nearest position on the line, which is formed by P1 and P2, to the sensed position. This can be done by first creating a line through points P1 and P2. Then, point P3 is computed on this line, where P3 is the nearest point to Point P. Then, updated μ can be computed as
μ=μ1+δμ*(x3−x1)(x2−x1)(or =μ1+μ*(z3−z1)/(z2−z1)) (74)
where x1, x2 and x3 are the x position of Point P1, P2 and P3. Also z1, z2 and z3 are the z position of Point P1, P2 and P3.
Thus, some embodiments provide for the estimation of μ with sensors. Such embodiments are particularly advantageous since the system can be the robust to the internal properties, for example initial length or elasticity of tendons and the moment arm of tendons.
Some embodiments provide for the estimation of μ with tendon displacement without the integration of additional sensors on the robot. Such embodiments are particularly advantageous since the robot can be miniaturized more than a robot that requires room for such sensors and which can complicate the structure. Also, for medical application, it is preferable for sterilization to not have additional sensors, etc. Further, this feature avoids any adverse influence to the mechanical properties like stiffness or weight from the sensors.
The robots as described herein may include additional surgical tools, such as surgical tools including clamps, graspers, scissors, staplers, needle holders, and other like tools that can be used to manipulate body parts (organs or tissue) during examination or surgery. This robot may also include additional sensors or other measuring devices to, for example, aid in determining the location, posture, or other orientation of the apparatus.
In use, the multi-section continuum robot may be continuously actuated as it is moved into place inside a patient. Thus, as each division enters the patient, additional tension is added to or removed from the tendon wires to effect the desired angular displacement of the distal end of the robot as well as the angular displacement of the division(s) of the robot moving into the patient.
Therefore, the apparatus as described herein provides an apparatus that allows for improved control accuracy for determining both the angular displacement at the distal end as well as the angular displacement of each of the various divisions as the apparatus is moved through a patient. This allows for a reduction in the risk of collisions to critical anatomy and reduces the invasiveness of the surgical procedure using the apparatus as described herein.
To validate the lamped-parameter model, the prototype of the tendon-driven device depicted in
c) illustrates a correspondence relationship between physical structure of the example and the lamped-parameter model. The prototype has a physical structure comprising node rings that can be individually tilted and correspond with the divisions in lamped-parameter model. Hinged wire guides made of ABS polymer were stacked with a coil spring as restoring element in the body segments.
The two tendons were embedded in the prototype (
As can be seen in
Each cell, which are the unit of linear spring system and curvature, has a length of 2 mm and a bending stiffness of 8.0×10−3 Nm/rad measured after fabrication.
Two sets of studies were conducted to assess the capability of our robot to trace the target trajectory. The first set of experiments measured the posture of one bending section robot with tension input experimentally to validate the accuracy of the FKM to the prototype. We observed the posture reached by bending and extending to assess the direction combination of tension and friction force in the model. The second set of experiments measured the accuracy of the tip position and the direction from the planned trajectory. We developed the two-sections continuum robot with a slide stage as the prismatic joint for this validation. By using the IKF, we generated the command for the prototype to trace the straight-line trajectory. We observed the tip position and direction for each commanded point. The deviation of the observed tip positions from the planed tip positions was determined followed by this observation. To validate improvement of position control accuracy with our tension propagation model, we compared this deviation with the deviation observed by the command with conventional piecewise constant curvature approximation.
We measured the posture of one bending section with tension input to validate the tension propagation model for the prototype of the continuum robot in
We performed tension control in the tendon to operate the robot. The tendon out of the robot is terminated at the tractor through the idler pulley in
The independent variables we set for this embodiment are tension in tendon and the bending direction for the robot. The tension is set to 0.39 N for the maximum bending angle of the section and the half value (0.18 N) of this maximum tension. The bending direction is set to direction of bending and extending with the same tension value (0.18 N) to validate the direction combination of tension and friction force in the tension propagation model. The posture measurement was conducted at three times for each tension with each bending direction. The posture data were compared to the predicted values by the FKM.
To determine if there were significant differences in prediction accuracy between the FKM we proposed and conventional PCCA, we performed paired t-test for tip-to-tip error (hereafter referred to as residual distance) of these two predictions for three tip heights. We considered differences significant at P<0.01.
To validate whether the robot trace the planed trajectory keeping the target tip direction, we conducted tracking of the tip positions and direction in the commanded trajectory. This is shown in
To measure the tip position and direction of the prototype, we acquired a digital still photograph by a digital camera (EOS X6i, EF-S18-135 IS STM, Canon Inc.) from the top of the bending plane. We extracted the pixel position of the feature at the center of the wire guide for each cell from the photos. To determine the position with a physical metric scale, we converted these pixel position data to the metric ones based on pixel length of a known graph grid.
The independent variables we set are the target tip angle and the length of the straight-line trajectory. The target angle is set to 0 degree for forward observation and 75 degree for angled observation.
To determine whether extending forward kinematic mapping model improves the prediction accuracy of the posture in extending from the curved shape, tendon-driven continuum robots were moved back and forth between the initial straight posture and the posture in maximum bending while observing the robot posture at the identical input tension between the arching and the extending postures. This experiment allowed direct comparison between the arching and the extending postures and determined the improved prediction accuracy for the extending posture comparing to the arching posture. Both a single tendon robot and a multiple, or antagonistic tendon robot layouts were analyzed.
The robot posture was observed loading the tension with the experimental apparatus in
For both tendon layouts, the initial posture of the robot was set to a substantially straight shape. The straight posture provides identical initial conditions without the hysteresis since the tendons in the straight posture are not subjected to the frictional forces. In this example, the straight posture was obtained with 0.00 N in the tendon for the single tendon layout and with (0.12, 0.12) N for the antagonistic tendon layout, which were 0.12 N for the tendon embedded on the −x and +x direction from the centroid of the robot.
The posture was measured with multiple input tensions to evaluate the extended FKM over the articulation range of the robot. The input tensions were set from 0.10 N to 0.40 N at 0.10 N intervals for the single tendon, (0.12, 0.24) N and (0.12, 0.48) N for the antagonistic tendon. After setting the straight posture, the tension in tendons was increased to these values in a series. We measured the posture with these ascending tensions as the arching postures. After completion of the measurement for the arching postures, we increased the input tension to 0.55 N for the single tendon layout and (0.12, 0.65) N for the antagonistic tendon layout as the posture in maximum bending. This posture was a halfway point for the articulation experiment and was followed by the measurement of an extending posture. We decreased the input tension from 0.40 N to 0.10 N at 0.10 N intervals for the single tendon layout and (0.12 0.48) N to (0.12, 0.24) N for the antagonistic tendon layout. We measured the posture with these descending tensions as the extending posture.
In all posture measurement, we measured the position of thirty hinges of the robot as well as the tip of the robot, and determined the position of thirty cells by calculating middle points between adjoining hinges or the hinge and the tip. We performed three trials for the arching and the extending postures with each tendon layout. We recorded the one posture for every input tension in one trial.
To determine whether the prediction accuracy of the posture improved in the extended FKM from the FKM, we calculated the position errors of all sets of cells for both the extended FKM and the FKM, which is distance of all sets of cell positions between the measured and predicted values. The position errors are summarized as mean values of the three trials and were compared with the target error of 5 mm.
The friction coefficient for the computation was 0.33. This friction coefficient was determined experimentally. We measured angle of friction with the tendon wire and the wire guide of the robot. The wire guide hanging on the tendon wire was rotated by a manual rotational stage until it slipped on the tendon wire. Specifically, to get the appropriate contact between the tendon wire and the eyelets in the wire guide, we attached a weight of 1.5 grams on the wire guide during the measurement. Twenty trials were conducted for the measurement, and the friction coefficient was measured to be μ=0.33±0.07 (standard deviation).
Hysteresis of Extending Postures.
The extending postures at every input tension performed the larger bending than the arching posture at the same input tension for the single and the antagonistic tendon layout (
Position Errors of the Extended FKM.
Through the arching and the extending posture with the single and the antagonistic tendon layout, the extended FKM predicted the measured posture within the target position error of 5 mm (2.89 mm at maximum for the single tendon (
Similarly, with the FKM, the maximum position error was the error at the most distal cell, but the maximum position error was more than two times larger than the target error of 5 mm. (12.36 mm for the single tendon layout (
Particularly, in comparison between the extended FKM and the FKM, the position error of the extending posture with the extended FKM was 81% lower than with the FKM for the single tendon layout and 74% lower for the antagonistic tendon layout (2.38 mm vs. 12.36 mm for the single tendon, 3.87 mm vs. 14.67 mm for the antagonistic tendon layout). These improved position error of the extending posture contributed the consistent lower value than the target error for the arching and the extending posture with the extended FKM.
a) and 30 (b). Result of the articulation experiment with the single tendon layout. The posture with a dotted line signifies the initial posture for each measurement. [Top] arching posture: the measured posture (black circles) was performed from the straight initial posture, [Bottom] extending posture: the measured posture (white circles) was performed from the initial posture in maximum bending of the robot.
as) and 32(b). Result of the position error of the FKM for the single tendon layout. The position errors of a set of all cells were plotted. The bars signify the mean values of the position error among three trials. (Top) arching posture, (Bottom) extending posture.
as) and 33(b). Result of position error of the extended FKM for the single tendon layout. The position errors of a set of all cells were plotted. The bars signify the mean values of the position error among three trials. (Top) arching posture, (Bottom) extending posture.
s) and 34(b). Result of position error of the FKM for the antagonistic tendon layout. The position errors of a set of all cells were plotted. The bars signify the mean values of the position error among three trials. (Top) arching posture, (Bottom) extending posture.
as) and 35(b). Result of position error of the FKM for the antagonistic tendon layout. The position errors of a sets of all cells were plotted. The bars signify the mean values of the position error among three trials. (Top) arching posture, (Bottom) extending posture.
This example presented the tendon-driven continuum robot for neuroendoscopy. We also proposed the extended FKM incorporating the tension propagation model to compute the hysteresis operation of the robot. The extended FKM characterized the hysteresis operation by coupling from the robot's posture at the previous time. We experimentally evaluated the prediction accuracy of the hysteresis operation by the extended FKM and compared the position error between the measured and the prediction posture by the extended FKM and the FKM. Our result indicated that the extended FKM predicted the measured posture within the target position error of 5 mm (2.89 mm for the single tendon 3.87 mm for the antagonistic tendon layout). We also found that the extended FKM helped to increase the prediction accuracy for the extending posture over the FKM (81 and 74% decrease for the single and the antagonistic tendon layout). Since the hysteresis operation appears in any maneuvers of neuroendoscopy, our extended FKM is useful for improving control accuracy of the robot for the maneuvers of neuroendoscopes.
In the articulation experiment, the extended FKM tended to predict larger bending angles for a set of cells of the robot than the measured values at the low tension and smaller bending angles at the high tension. This tendency was consistent in the arching and the extending posture for any tendon layouts. Therefore, the discrepancy between the extended FKM-predicted and measured values results from some factors of conservative quantity instead of the hysteresis quantity. We expected that this factor was probably the nonlinearity of the spring constant of the backbone, which the extended FKM does not take into account. Since the backbone was made of Nitinol, the young's modulus might show the soft spring effect. We also expect that the mechanical design of the backbone is helpful to reduce this unpleasant nonlinearity and to develop the robot with suitable control.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims priority from Provisional Application No. 61/880,692 filed 20 Sep., 2013 and Provisional Application No. 61/935,677 filed 4 Feb. 2014, the disclosure of which are both hereby incorporated by reference herein in their entireties.
Number | Date | Country | |
---|---|---|---|
61880692 | Sep 2013 | US | |
61935677 | Feb 2014 | US |