The present disclosure relates to the technical field of medical equipment, in particular to the field of surgical robots, and in particular to a surgical robot navigation and positioning system and a measurement viewing angle multi-objective optimization method.
A mobile surgical robot provides a brand-new choice for all kinds of surgical operations because of its advantages of accuracy and safety. After a period of development, the related technology of a surgical robot is becoming more and more mature, and its frequency of use in clinical surgery is also increasing year by year.
The surgical robot with an optical navigation system is widely used in robot-assisted surgery. With the help of image navigation technology, the robot-assisted surgery system can accurately position the surgical site and operating tools to assist doctors in carrying out minimally invasive surgery, remote surgery or robot-assisted surgery. At present, surgical navigation relies on an optical navigation device to position the surgical site or the surgical tool by observing and identifying the optical positioning tool and calculating the image and the position.
In the practical operation of the prior art, the surgical navigation device is manually adjusted by the doctor who assists the surgery according to the surgical needs. Specifically, by dragging the handle of the device, the optical navigation device is adjusted to the appropriate observation position. However, this interactive method brings a lot of inconvenience in the practical surgical process. For some special surgical position designs, it is difficult to adjust the appropriate measurement position by hand alone, and the position accuracy cannot be guaranteed.
Therefore, it has become anew trend to give motion capability to the optical navigation device. It is necessary to realize the active navigation of optical navigation, which requires the robot not only to have optical navigation sensors for positioning, but also to have sensors with other environmental sensing functions to sense the occurrence of position changes of people or devices in the operating room, thus triggering the active movement in response. Therefore, a special hardware component system is required. At the same time, how to implement the measurement viewing angle multi-objective optimization in the above system is also a problem that needs to be considered.
Considering the above factors, the present disclosure provides a surgical robot navigation and positioning system and a measurement viewing angle multi-objective optimization method, which can better solve the measurement viewing angle multi-objective optimization problem of the surgical robot navigation and positioning system.
In order to solve the above problems, the present disclosure provides a surgical robot navigation and positioning system and a measurement viewing angle multi-objective optimization method.
A surgical robot navigation and positioning system is provided, wherein the system comprises a surgical operation planning system, a control host for data processing and robot control, a serial robot having any degree of freedom, a positioning sensor and adaptive positioning tools, and an environmental perception sensor; the positioning sensor and/or the environment perception sensor are connected to the flange of the robot.
The positioning sensor is an optical positioning sensor and comprises a binocular depth camera based on visible light and/or a binocular positioning camera based on near-infrared light.
The environment perception sensor comprises a binocular depth camera based on visible light, a laser radar and an ultrasonic sensor.
The environment perception sensor and the positioning sensor are two different types of sensors arranged in combination or are implemented by the same sensor which is used for environmental perception and positioning at the same time.
There is an overlapping area between spatial areas measured by the environmental perception sensor and the positioning sensor, and the overlapping area is a measurable area of the surgical robot navigation and positioning system.
There is one or more positioning tools; each positioning tool is provided with K positioning parts which are distributed and formed according to a certain positional relationship; according to the different positions and/or numbers of K positioning parts on each positioning tool, the positioning tool is uniquely determined; the positioning part is a specific marker capable of reflecting light or emitting light, and/or a part formed by arranging a plurality of specific patterns according to a certain positional relationship.
The specific marker capable of reflecting light at least comprises: balls with high reflectivity coating on the surfaces; the specific marker capable of emitting light at least comprises: an LED lamp.
The specific pattern is a pattern specially coded and designed, and at least comprises a QR Code and a Gray Code.
A measurement viewing angle multi-objective optimization method for the surgical robot navigation and positioning system as described above is provided, wherein the method obtains the number, the serial number and the position of required positioning tools of each link in a surgical process through a surgical operation planning system, and establishes a multi-objective minimization problem based on a decision variable x:
x=[q
1
, q
2
, q
3
, . . . , q
N] (Formula 1)
where q1, q2, q3, . . . , qN are joint variables; N is the number of the joint variables; the decision variable x denotes a vector consisted of N joint variables of a robot, and the value range is the joint value range Q achievable by each joint of the robot, that is, x∈Q.
Preferably, the method comprises the following steps:
Preferably, Step 1 comprises the following steps:
Preferably, at least two objective functions f1 and f2 of minimization optimization in Step 2 are defined as follows:
f
1=maxm∥{right arrow over (NMm)}∥ (Formula 2)
f
2=minj,k∈S−Omin(j,k) (Formula 3)
where ∥{right arrow over (NMm)}∥ denotes the distance between the coordinate origin of the m-th positioning tool and the coordinate origin of the positioning sensor; f1 denotes the maximum distance between the coordinate origin of all positioning tools and the coordinate origin of the positioning sensor; Omin(j, k) denotes the smaller non-interference margin function in the camera coordinates of the positioning sensor for a given pair of positioning tools j and k; minj,k∈SOmin(j, k) denotes the minimum non-interference margin function value among the binary combinations of all the positioning tools measured in all the cameras of the positioning sensor under the pose of the robot determined by q;
Preferably, the constraint conditions in Step 3 are as follows:
where
The technical scheme of the present disclosure has the following beneficial effects.
The present disclosure provides a surgical robot navigation and positioning system and a measurement viewing angle multi-objective optimization method. First, the present disclosure optimizes the surgical robot navigation and positioning system. Second, in view of the fact that there is an overlapping area (the overlapping area is the measurable area of the system) between spatial areas measured by the environmental perception sensor and the positioning sensor in the surgical robot navigation and positioning system, the present disclosure defines the non-interference margin function between the positioning tools, and solves the optimization problem by constraining the multi-objective optimization algorithm, and thus the measurement viewing angle multi-objective optimization problem in the surgical robot navigation and positioning system is better solved.
The technical scheme in the embodiment of the present disclosure will be clearly and completely described hereinafter with reference to the attached drawings. It can be understood that the described embodiment is only a part of the embodiment of the present disclosure, rather than all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative work belong to the scope of protection of the present disclosure.
The present disclosure provides a surgical robot navigation and positioning system and a measurement viewing angle multi-objective optimization method.
The near-infrared optical positioning system here includes two infrared emitting lamps and an infrared camera for detecting reflected infrared light. The working principle is that the left and right infrared emitting lamps emit specific infrared light and project the specific infrared light on the surface of a reflective ball on the positioning tool. The reflective ball reflects infrared light, which is observed by the infrared camera. According to the received reflected infrared light, the relative position between the near-infrared optical positioning system and each ball is calculated, and the relative position of each positioning tool with respect to the near-infrared optical positioning system is calculated according to the pre-calibrated positioning relationship model.
The base coordinate system of the robot is {O}, the joint angle of the kth joint is qk, and the origin of the coordinate system of the flange is {E}. The center coordinate of the near-infrared optical positioning system is N, and the coordinates of the left and right cameras are R and L, respectively. When the robot is in position p, the measurable area space where the near-infrared optical positioning system and the environmental perception sensor overlap is A(p). The coordinate system of the binocular camera is {C}.
As shown in
Measurement viewing angle multi-objective optimization: information on and positions of all positioning tools of each link in a surgery process are obtained through the surgical operation planning system. The following multi-objective minimization problem is established:
a decision variable: x=[q1, q2, q3, . . . , q7]
The decision variable denotes a vector consisted of seven joint variables of the robot, whose value range is the joint value range Q achievable by each joint of the robot, that is, x∈Q. Here, the number of joints of the robot can be any reasonable number.
The optimization objective is as follows (at least the objective functions f1 and f2 are simultaneously minimized).
Optimization objective 1: the maximum distance between the positioning tool and the near-infrared optical positioning system is minimized;
f
1=maxm∥{right arrow over (NMm)}∥
where maxm∥{right arrow over (NMm)}∥ denotes the distance between the coordinate origin of the m-th positioning tool and the coordinate origin of the near-infrared optical positioning system.
Optimization objective 2: minj,k∈SOmin(j, k) denotes the minimum non-interference margin function value between the positioning tools. By taking the inverse number of its value, the value is transformed into a minimization optimization problem:
f
2=minj,k∈S−Omin(j,k)
where Omin(j, k) denotes the smaller non-interference margin function in the camera coordinates of the positioning sensor for a given pair of positioning tools j and k; minj,k∈SOmin(j, k) denotes the minimum non-interference margin function value among the binary combinations of all the positioning tools measured in all the cameras of the positioning sensor under the pose of the robot determined by q;
the non-interference margin function O(j, k, G) between the positioning tools j and k is defined as shown in
G is the coordinate origin of the left or right camera in the positioning sensor. Mj and Mk are the centers of any two positioning tools after the two positioning tools are abstracted into spheres, and are also the origin of the coordinate system of the positioning tools. rj and rk are the radii of the sphere into which the positioning tools are abstracted. Each positioning tool uses the intersection point between the plane where the center of the ball is located and the central axis of the central hole of the connecting rod of the positioning tool as the coordinate origin. The minimum circumscribed ball radius with the coordinate origin as the center is li. Considering the influence of errors in practical operation, the radius ri of the sphere into which the positioning tools are abstracted is obtained by expanding the margin ω times on the basis of li. (The feature of the positioning tool here is that four or more coplanar connecting rods extend from a center, and the ends of the connecting rods are provided with balls. In a set of navigation devices, the relative position between the balls of each positioning tool is unique). ω>1.
Therefore, the size of rj and rk are known. The length of the vectors ∥{right arrow over (GMj)}∥ and ∥{right arrow over (GMk)}∥ can be measured by the positioning sensors. βG,j and βG,k can be obtained by the following relationship:
αG,j,k can be calculated by the vector:
where · denotes the vector point multiplication.
Finally,
is calculated,
The constraint conditions are as follows:
where
As shown in
To sum up, the following optimization problems need to be optimized:
The decision variable: x=[q1, q2, q3, . . . , qN]
At the same time:
f
1=maxm∥{right arrow over (NMm)}∥
f
2=minj,k∈S−Omin(j,k)
is minimized.
At the same time, the following constraint conditions are considered:
The above optimization problems can be solved by constraining the multi-objective optimization algorithm. In this example, the Pareto optimal solution of the above optimization problem can be obtained by using the MOEA/D-CDP algorithm.
Although the present disclosure has been particularly shown and described in conjunction with preferred embodiments, it should be understood by those skilled in the art that various changes in form and details can be made in the present disclosure without departing from the spirit and scope of the present disclosure as defined in the appended claims, which fall within the scope of protection of the present disclosure.
Number | Date | Country | Kind |
---|---|---|---|
2021110764799.1 | Jul 2021 | CN | national |
PCT/CN2022/094673 | May 2022 | WO | international |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/CN2022/094673 | 5/24/2022 | WO |