This application is a national stage application of PCT Application No. PCT/CN2018/106512. This application claims priority from PCT Application No. PCT/CN2018/106512, filed Sep. 19, 2018, CN Application No. CN 201810909100.4, filed Aug. 10, 2018, the contents of which are incorporated herein in the entirety by reference.
Some references, which may include patents, patent applications, and various publications, are cited and discussed in the description of the present disclosure. The citation and/or discussion of such references is provided merely to clarify the description of the present disclosure and is not an admission that any such reference is “prior art” to the present disclosure described herein. All references cited and discussed in this specification are incorporated herein by reference in their entireties and to the same extent as if each reference was individually incorporated by reference.
The present invention relates to the field of orthopedic external fixation, in particular to an automatic recognition method for spatial position and pose of parallel external fixator based on three-dimensional clinical image, in the use of fracture reduction treatment.
The existing parallel external fixator usually comprises a pair of fixation rings fixedly connected to the fractured bone and six struts connected to the fixation rings. The parallel external fixator can not only stably fix the fracture segment, but also adjust the fracture segment and achieve more accurate fracture reduction by adjusting the relative position and pose of the fixation rings. In addition, the parallel external fixator can also be used for bone deformity correction after osteotomy treatment. Due to the individuality of the fracture condition and the clinical fixator installation of the patient, it is necessary to determine the position and pose of the parallel external fixator before applying it for fracture reduction or deformity correction, and then plan the adjustment schedule according to the measured position and pose. The position and pose information of the parallel external fixator includes spatial position and pose of the external fixator structure and the fractured bone segment relative to the external fixator. How to determine the spatial position and pose information of the external fixator through the clinical information is a major difficulty in the application of parallel external fixator.
U.S. Pat. No. 9,204,937 and EP2767252 provide two similar methods for determining the position and pose of the parallel external fixator, mainly including: taking X-ray anteroposterior and lateral radiographs of the fractured bone containing the complete parallel external fixator; manually measuring the position and pose parameters between the fracture segments, and the installation parameters between the fractured bone and the external fixator on the X-ray image; reading the length of the fixator struts and measuring the axial rotation angle of the limb relative to the fixator in clinic; solving the position and pose of the parallel external fixator and the fractured bone by using the above parameters. The method provided by the above patents has the following problems: requiring extensive manual measurement operations, existing subjective and objective errors, the adopted X-ray image does not contain the axial rotation between the bone segment and the external fixator; thus resulting in low efficiency of the clinical application of the parallel external fixator, and inconsistence between the bone adjustment accuracy and the mechanical accuracy of the fixator structure.
Therefore, a heretofore unaddressed need exists in the art to address the aforementioned deficiencies and inadequacies.
The purpose of the present invention is to overcome the disadvantages of the prior art, provide an automatic recognition method for spatial position and pose of parallel external fixator, which represent the spatial configuration of the external fixator and connected fractured bone segments.
The technical scheme of the present invention is as follows.
An automatic recognition method for spatial position and pose of parallel external fixator, including the following steps of:
(1) installing markers, including: defining two fixation rings of the parallel external fixator as a proximal fixation ring and a distal fixation ring; installing three markers on the proximal fixation ring and three on the distal fixation ring; wherein the six markers have the same structure and respectively comprise a marker ball and a marker pin shaft; the distance from the sphere center of each marker on the proximal fixation ring to the upper surface of the proximal fixation ring is a fixed value hM; the distance from the sphere center of each marker on the distal fixation ring to the upper surface of the distal fixation ring is the same fixed value hM; the marker balls and the marker pin shafts are made of different materials, so that the marker balls can be recognized by a common three-dimensional (hereinafter referred to as 3D) clinical imaging system, and the marker pin shafts will not be recognized;
(2) acquiring 3D images, including: 3D scanning the fracture site and the parallel external fixator with installed markers, performing threshold division and 3D reconstruction to obtain 3D images of a proximal bone segment, a distal bone segment and six marker balls; storing the data of the 3D images in the computer system by using a 3D point cloud format; the 3D point cloud format is composed of a plurality of data points to describe the surface shape of a 3D object;
(3) sphere fitting the marker balls, including:
(3a) based on the 3D point cloud data of the six marker balls and the known diameter of the marker balls, fitting the 3D point cloud of the six marker balls into six spheres by a certain sphere fitting algorithm;
(3b) by referring to 3D images of the proximal bone segment and the distal bone segment, specifying the correspondence relationship between six marker balls in the 3D images and the six markers on the parallel external fixator, and then storing it into the computer system;
(4) specifying installation information of the markers, including:
(4a) establishing a proximal coordinate system p-uvw attached to the proximal fixation ring and a distal coordinate system P-UVW attached to the distal fixation ring;
(4b) according to the actual mounting configuration among a first marker, a second marker, a third marker and the proximal fixation ring, by using the structural dimensions of the proximal fixation ring, calculating the coordinates of the first sphere center of the first marker ball M1(u1v1w1), the second sphere center of the second marker ball M2(u2v2w2), and the third sphere center of the third marker ball M3(u3v3w3) in the proximal coordinate system p-uvw, respectively; and by using the data of the distal fixation ring, calculating to obtain the coordinates of the fourth sphere center of the fourth marker ball M4 (U4V4W4), the fifth sphere center of the fifth marker ball M5(U5V5W5), and the sixth sphere center of the sixth marker ball M6 (U6V6W6) in the distal coordinate system P-UVW, respectively; the sphere center coordinates of the six marker balls constitute the markers installation information of the external fixator;
(4c) inputting the markers installation information into a computer system;
(5) recognizing spatial position and pose of the coordinate systems, including:
(5a) according to the plane formed by the first sphere center, second sphere center and third sphere center is parallel to the upper surface of the proximal fixation ring, calculating a normal vector {right arrow over (pw)} of the upper surface of the proximal fixation ring by the following formula, which corresponds to the axis w of the proximal coordinate system p-uvw:
in which, {right arrow over (M1M2)} is a vector pointing from the first sphere center to the second sphere center in the point cloud reference coordinate system O-xyz, and {right arrow over (M1M2)}=(xM2−xM1yM2−yM1zM2−zM1); {right arrow over (M2M3)} is a vector pointing from the second sphere center to the third sphere center in the point cloud reference coordinate system O-xyz, and {right arrow over (M2M3)}=(xM3−xM2yM3−yM2zM3−zM2);
(5b) assuming the coordinates of the origin p of the proximal coordinate system p-uvw be pO-xyz=(xpO ypO zpO) in the point cloud reference coordinate system O-xyz, according to the coordinates M1(u1v1w1), M2(u2v2w2) and M3(u3v3w3) obtained by the step (4b) in the proximal coordinate system p-uvw, calculating the coordinates of the origin p in the point cloud reference coordinate system O-xyz by solving the following distance equations:
(5c) in the point cloud reference coordinate system O-xyz, assuming the value of unit vector {right arrow over (pu)} of the proximal coordinate system p-uvw be {right arrow over (pu)}=(xpu ypuzpu); respectively taking the scalar products of vectors {right arrow over (pM1)}, {right arrow over (pM2)} and {right arrow over (pM3)} of the first sphere center, the second sphere center and the third sphere center with the unit vector {right arrow over (pu)}, the outcomes are equivalent to the components u1, u2 and u3 of the first sphere center, the second sphere center and the third sphere center along the axis {right arrow over (pu)}, as the following equations:
in which, the vectors {right arrow over (pM1)}, {right arrow over (pM2)} and {right arrow over (pM3)} are determined by {right arrow over (pM1)}=(xM1−xpOyM1−ypOzM1−zpO), {right arrow over (pM2)}=(xM2−xpOyM2−ypOzM2−zpO) and {right arrow over (pM3)}=(xM3−xpOyM3−ypOzM3−zpO), respectively; solving the above equation set to determine the value of unit vector {right arrow over (pu)} of the proximal coordinate system p-uvw;
(5d) calculating the unit vector {right arrow over (pv)} of the proximal coordinate system p-uvw by using the right-hand rule, taking the following equation:
{right arrow over (pv)}={right arrow over (pw)}×{right arrow over (pu)}
(5e) repeating step (5a) to step (5d), according to the coordinates of the fourth sphere center M4(U4V4W4), the fifth sphere center M5(U5V5W5) and the sixth sphere center M6(U6V6W6) in the distal coordinate system P-UVW, determining the coordinate of the origin P of the distal coordinate system P-UVW in the point cloud reference coordinate system O-xyz be PO-xyz=(xPO yPO zPO), and determining the value of unit vectors {right arrow over (PU)}, {right arrow over (PV)} and {right arrow over (PW)} of the three coordinates axes of the distal coordinate system P-UVW in the point cloud reference coordinate system O-xyz;
(5f) determining the position and pose of the proximal coordinate system p-uvw relative to the point cloud reference coordinate system O-xyz by using the origin coordinate pO-xyz and the unit vectors {right arrow over (pu)}, {right arrow over (pv)}, {right arrow over (pw)}; determining the position and pose of the distal coordinate system P-UVW relative to the point cloud reference coordinate system O-xyz by using the origin coordinate PO-xyz and the unit vectors {right arrow over (PU)}, {right arrow over (PV)}, {right arrow over (PW)}; and storing the spatial position and pose of the proximal and distal coordinate systems into the computer system;
(6) determining the spatial position and pose of the external fixator, including: (6a) calculating the relative position of the proximal fixation ring and the distal fixation ring by using the origin coordinate pO-xyz of proximal coordinate system and the origin coordinate PO-xyz of distal coordinate system, and expressing the relative position with a position vector {right arrow over (rP
{right arrow over (rP
(6b) calculating the relative pose of the proximal fixation ring and the distal fixation ring by using the unit vectors {right arrow over (pu)}, {right arrow over (pv)}, {right arrow over (pw)} of proximal coordinate system and {right arrow over (PU)}, {right arrow over (PV)}, {right arrow over (PW)} of distal coordinate system, and express the relative pose with a pose matrix RPp as the following:
(6c) determining the spatial position and pose of the external fixator according to the position vector {right arrow over (rP
(7) determining the adjustment values of the external fixator for fracture reduction, including:
displaying the 3D images of the proximal bone segment and the distal bone segment on the screen of the computer system, moving the 3D images displayed on the screen according to the desired fracture reduction movement, achieving the correct alignment of the proximal bone segment and the distal bone segment in the screen display; automatically calculating and storing, by the computer system, the translation and rotation movement values of the proximal bone segment 3D image relative to the distal bone segment 3D image in the point cloud reference coordinate system O-xyz during the reduction, wherein the translation and rotation movement values of the proximal bone segment 3D image relative to the distal bone segment 3D image are equal to the translation and rotation adjustment values of the proximal fixation ring relative to the distal fixation ring during the reduction, thus the adjustment values of the external fixator for fracture reduction is determined;
(8) according to the recognized spatial position and pose of the external fixator, the adjustment values of the external fixator for fracture reduction, and by using a certain kinematics algorithm in the field of robotics, the adjustment schedule of the external fixator struts for fracture reduction is obtained; adjusting the external fixator struts referring to the adjustment schedule, the fracture reduction is achieved.
The present invention has following advantages: the method of the present invention is simple and reliable by avoiding manual measurement operation, and the method only needs to input some known structural data; the present invention adopts a 3D clinical imaging system as the source of information, which can truly and completely provide the spatial configuration of the parallel external fixator and the fractured site; the method of the present invention can effectively improve the efficiency and precision of the parallel external fixator in clinical application.
The accompanying drawings illustrate one or more embodiments of the present invention and, together with the written description, serve to explain the principles of the invention. Wherever possible, the same reference numbers are used throughout the drawings to refer to the same or like elements of an embodiment.
The present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the present invention are shown. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure is thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Like reference numerals refer to like elements throughout.
The embodiments of the present invention will be described below in detail with reference to the drawings.
As shown in
(1) installing markers, including: defining two fixation rings of the parallel external fixator as a proximal fixation ring 210 and a distal fixation ring 211; installing three markers on the proximal fixation ring 210 and three on the distal fixation ring 211; wherein the six markers is defined as a first marker 201, a second marker 202, a third marker 203, a fourth marker 204, a fifth marker 205 and a sixth marker 206 in order (see
(2) Acquiring 3D images, including: 3D scanning the fracture site and the parallel external fixator with installed markers, performing threshold division and 3D reconstruction to obtain 3D images of a proximal bone segment 310, a distal bone segment 311 and six marker balls 301, 302, 303, 304, 305, 306 (see
(3) Sphere fitting the marker balls, including:
(3a) based on the 3D point cloud data of the six marker balls and the known diameter of the marker balls, fitting the 3D point cloud of the six marker balls into six spheres by a certain sphere fitting algorithm.
Preferably, adopting the least square method to fit the 3D point cloud of each marker ball into a sphere. Setting up a point cloud reference coordinate system O-xyz, assuming the fitted sphere center coordinates of an arbitrary kth marker ball in the reference coordinate system O-xyz as (xMkyMkzMk), and the distance Di from the ith point of the kth marker ball's point cloud to the fitted sphere center can be expressed as:
Di2(xM
in which, xi, yi and zi represent the coordinates of the ith point of the kth marker ball's point cloud in the reference coordinate system O-xyz. The sum of square residual between Di and the actual marker ball radius rM is:
S(xMk,yMk,zMk)=Σ(Di2−dMk2)2 (2)
When the sum of square residual S reaches its minimum value, the corresponding coordinates xMk, yMk and zMk is the best fitted sphere center of the kth marker ball's point cloud.
(3b) By referring to the 3D images of the proximal bone segment 310 and the distal bone segment 311, specifying the corresponding relationship between six marker balls 301, 302, 303, 304, 305, 306 in the 3D images and the six markers 201, 202, 203, 204, 205, 206 on the parallel external fixator, and then storing it into the computer system.
(4) Specifying installation information of the markers, including:
(4a) establishing a proximal coordinate system p-uvw attached to the proximal fixation ring 210 and a distal coordinate system P-UVW attached to the distal fixation ring 211.
(4b) According to the actual mounting configuration among the first marker 201, second marker 202, third marker 203 and proximal fixation ring 210, by using the structural dimensions of the proximal fixation ring 210, calculating to obtain the coordinates M1(u1v1w1), M2(u2v2w2) and M3(u3v3w3) of the first sphere center of the first marker ball 201, the second sphere center of the second marker ball 202 and the third sphere center of the third marker ball 203 in the proximal coordinate system p-uvw, respectively (see
(4c) Inputting the markers installation information into the computer system.
(5) Recognizing spatial position and pose information of the coordinate system, including:
(5a) According to the plane formed by first sphere center, second sphere center and the third sphere center is parallel to the upper surface of the proximal fixation ring 210, calculating a normal vector {right arrow over (pw)} of the upper surface of the proximal fixation ring 210 by the following formula, which corresponds to the axis w of the proximal coordinate system p-uvw:
in which, {right arrow over (M1M2)} is a vector pointing from the first sphere center to the second sphere center in the point cloud reference coordinate system O-xyz, and {right arrow over (M1M2)}=(xM2−xM1yM2−yM1zM2−zM1); {right arrow over (M2M3)} is a vector pointing from the second sphere center to the third sphere center in the point cloud reference coordinate system O-xyz, and {right arrow over (M2M3)}=(xM3−xM2yM3−yM2zM3−zM2).
(5b) Assuming the coordinates of the origin p of the proximal coordinate system p-uvw be pO-xyz=(xpO ypO zpO) in the point cloud reference coordinate system O-xyz, according to the coordinates M1(u1v1w1), M2(u2v2w2) and M3(u3v3w3) obtained by the step (4b) in the proximal coordinate system p-uvw, calculating the coordinates of the origin p in the point cloud reference coordinate system O-xyz by solving the following distance equations:
(5c) In the point cloud reference coordinate system O-xyz, assuming the value of unit vector {right arrow over (pu)} of the proximal coordinate system p-uvw be {right arrow over (pu)}=(xpu ypuzpu); respectively taking the scalar products of vectors {right arrow over (pM1)}, {right arrow over (pM2)} and {right arrow over (pM3)} of the first sphere center, the second sphere center and the third sphere center with the unit vector {right arrow over (pu)}, the outcomes are equivalent to the vector components u1, u2 and u3 of the first sphere center, the second sphere center and the third sphere center along the axis {right arrow over (pu)}, expressing as the following:
in which, the vectors {right arrow over (pM1)}, {right arrow over (pM2)} and {right arrow over (pM3)} are determined by {right arrow over (pM1)}=(xM1−xpyM1−yp zM1−zp), {right arrow over (pM2)}=(xM2−xp yM2−yp zM2−zp) and {right arrow over (pM3)}=(xM3−xp yM3−yp zM3−zp), respectively; solving the equation set (5) to obtain the value of unit vector {right arrow over (pu)} of the proximal coordinate system p-uvw.
(5d) Calculating the unit vector {right arrow over (pv)} of the proximal coordinate system p-uvw by using the right-hand rule, as the following equation:
{right arrow over (pv)}={right arrow over (pw)}×{right arrow over (pu)} (6)
(5e) Repeating step (5a) to step (5d), according to the coordinates of the fourth sphere center M4(U4V4W4), the fifth sphere center M5(U5V5W5) and the sixth sphere center M6(U6V6W6) in the distal coordinate system P-UVW, calculating the coordinate of the origin P of the distal coordinate system P-UVW in the point cloud reference coordinate system O-xyz, PO-xyz=(xPO yPO zPO), and determining the value of unit vectors {right arrow over (PU)}, {right arrow over (PV)} and {right arrow over (PW)} of the three coordinates axes of the distal coordinate system P-UVW in the point cloud reference coordinate system O-xyz.
(5f) Determining the position and pose of the proximal coordinate system p-uvw relative to the point cloud reference coordinate system O-xyz by using the origin coordinate pO-xyz and the unit vectors {right arrow over (pu)}, {right arrow over (pv)}, {right arrow over (pw)}; determining the position and pose of the distal coordinate system P-UVW relative to the point cloud reference coordinate system O-xyz by using the origin coordinate PO-xyz and the unit vectors {right arrow over (PU)}, {right arrow over (PV)}, {right arrow over (PW)}; and storing the spatial position and pose of the proximal and distal coordinate systems p-uvw, P-UVW into the computer system.
(6) Determining the spatial position and pose of the external fixator, including:
(6a) calculating the position of the proximal coordinate system p-uvw relative to the distal coordinate system P-UVW by using the origin p of proximal coordinate system and the origin P of distal coordinate system, determining the relative position vector {right arrow over (rP
{right arrow over (rP
(6b) calculating the relative pose of the proximal fixation ring and the distal fixation ring by using the unit vectors {right arrow over (pu)}, {right arrow over (pv)}, {right arrow over (pw)} of proximal coordinate system and {right arrow over (PU)}, {right arrow over (PV)}, {right arrow over (PW)} of distal coordinate system, and express the relative pose with a pose matrix RPp of the proximal fixation ring 210 and the distal fixation ring 211 as the following:
(6c) determining the spatial position and pose of the external fixator according to the relative position vector {right arrow over (rP
(7) Determining the adjustment values of the external fixator for fracture reduction, including:
displaying the 3D images of the proximal bone segment 310 and the distal bone segment 311 on the screen of the computer system, translating and rotating the 3D images on the computer according to the desired fracture reduction movement, achieving the correct alignment of the proximal bone segment 310 and the distal bone segment 311 in the screen display; automatically calculating and storing, by the computer system, the translation and rotation movement values of the 3D images of the proximal bone segment 310 relative to the 3D image of the distal bone segment in the point cloud reference coordinate system O-xyz during the reduction; wherein the translation and rotation movement values of the proximal bone segment 310 relative to the distal bone segment 311 in the screen display equal to the translation and rotation adjustment value of the proximal fixation ring 210 relative to the distal fixation ring 211 during the reduction, thus the adjustment values of the external fixator for fracture reduction is determined.
(8) According to the recognized spatial position and pose of the external fixator, the adjustment values of the external fixator for fracture reduction, and by using a certain kinematics algorithm in the field of robotics, the adjustment schedule of the external fixator struts for fracture reduction is obtained. Surgeons could reduce bone fracture deformity by adjusting the struts of the external fixator according to the adjustment schedule.
The above description of the present invention is only exemplary rather than restrictive. Therefore, the embodiments of the present invention are not limited to the specific embodiments described above. If inspired by the present invention, one skilled in the art may make other changes or variations without departing from the spirit of the present invention and the scope protected by the claims, which, however, shall all fall into the protection scope of the present invention.
The foregoing description of the exemplary embodiments of the present invention has been presented only for the purposes of illustration and description and is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible in light of the above teaching.
The embodiments were chosen and described in order to explain the principles of the invention and their practical application so as to activate others skilled in the art to utilize the invention and various embodiments and with various modifications as are suited to the particular use contemplated. Alternative embodiments will become apparent to those skilled in the art to which the present invention pertains without departing from its spirit and scope. Accordingly, the scope of the present invention is defined by the appended claims rather than the foregoing description and the exemplary embodiments described therein.
Number | Date | Country | Kind |
---|---|---|---|
201810909100.4 | Aug 2018 | CN | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/CN2018/106512 | 9/19/2018 | WO |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2020/029378 | 2/13/2020 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20110313418 | Nikonovas | Dec 2011 | A1 |
20140379038 | Dogramadzi | Dec 2014 | A1 |
20160042571 | Mikheev | Feb 2016 | A1 |
20180055569 | Wahl | Mar 2018 | A1 |
Number | Date | Country |
---|---|---|
2590538 | Dec 2003 | CN |
101002696 | Jul 2007 | CN |
203425022 | Feb 2014 | CN |
104398295 | Mar 2015 | CN |
106859750 | Jun 2017 | CN |
206534699 | Oct 2017 | CN |
2017213425 | Dec 2017 | WO |
Entry |
---|
International Search Report of PCT/CN2018/106512. |
Written Opinion of PCT/CN2018/106512. |
Number | Date | Country | |
---|---|---|---|
20210361322 A1 | Nov 2021 | US |