Patent Application
20170140671
The present application relates to the field of surgery simulation, and more particularly to a surgery simulation system and method, and particularly a simulation system and method for surgery on a human organ with haptic feedback.
Piercing and incision are very common operations in a surgery. They are the basic common skills that should be mastered by almost every doctor. For surgery such as intervention of tumor, fetal diagnosis, radio frequency tumor ablation, local anesthesia, percutaneous catheterization and endoscopic surgery, exquisite technique is required because difficulty of operation is relatively high. Exquisite technique requires extensive training to achieve. For example, a surgeon may need to practice on dozens of patients in order to master the skills. However, since many of the surgeries are highly risky, therefore it is obviously not feasible to master the skills through practice on patients. There is a long history of using human body-simulated physical models in medical training. The human body-simulated physical model is an object that simulates a real organ. It can provide a situation similar to an actual operation. However, due to limitations of the model, the actual structure of the interior of a human body cannot be truly reconstructed, and misleading in basic operation may be caused.
An object of the present application is to provide a surgery simulation system and method for surgery simulation training so as to assist doctors to quickly master the skills such as incision and piercing.
According to one aspect, there is provided a surgery simulation system including:
In one embodiment of the surgery simulation system, before the surgical instrument is inserted into the physical model, feedback force is provided by the force feedback device; when the surgical instrument is pierced into the physical model, extended calculation of the position of the incision point and/or piercing point is performed via the surgical instrument connection component and the actuator, and feedback force is provided together by the surgical instrument connection component, the force feedback devices which are connected with the surgical instrument connection component, and the physical model; and when the surgical instrument is operating in the physical model, feedback force is provided together by the surgical instrument connection component, the force feedback devices which are connected with the surgical instrument connection component, and friction at an interior of the physical model.
In one embodiment of the surgery simulation system, the surgical instrument is a piercing and/or incision instrument, the surgical instrument comprising a rotatable handle and a needle, blade, stoma dilator, stoma sheath, penetration-type probe or lens provided on the handle.
In one embodiment of the surgery simulation system, the display device displays the surgical instrument, a virtual organ and/or a medical image.
In one embodiment of the surgery simulation system, the physical model is formed with a membrane having a soft surface for repeat incision and/or piercing by the surgical instrument, an interior of the physical model is filled with a soft material that generates friction when the surgical instrument is inserted therein, and restricts the surgical instrument's path after insertion.
According to another aspect, there is provided a method for simulating a surgery including:
In one embodiment of the method for simulating a surgery, before the surgical instrument is inserted into the physical model, feedback force that simulates gravity force of the surgery instrument is provided by the force feedback device; when the surgical instrument is pierced into the physical model, feedback force that simulate piercing force of the surgery instrument is provided together by the force feedback device and the physical model; and when the surgical instrument is operating in the physical model, feedback force is provided together by the force feedback device, and friction at an interior of the physical model.
In one embodiment of the method for simulating a surgery, the surgical instrument is a piercing and/or incision instrument, the surgical instrument comprising a rotatable handle and a needle, blade, stoma dilator, stoma sheath, penetration-type probe or lens provided on the handle, and after the surgery instrument is replaced, the display device accordingly displays the surgery instrument after replacement.
In one embodiment of the method for simulating a surgery, the display device displays the surgical instrument, a virtual organ and/or a medical image.
In one embodiment of the method for simulating a surgery, the physical model is formed with a membrane having a soft surface for repeat incision and/or piercing by the surgical instrument, an interior of the physical model is filled with a soft material that generates friction when the surgical instrument is inserted therein, and restricts the surgical instrument's path after insertion.
The surgery simulation system and method of the present application has the following beneficial effects. The surgery simulation system and method of the present application employ a method of combining a force feedback device and a physical model to simulate a surgery. This can more vividly simulate the scene of a real surgery so as to assist medical staff to quickly master skills.
The surgery simulation system and method of the present application will now be further described with reference to the accompanying drawings.
The FIGURE is a schematic view of a surgical simulation system of the present application, showing force feedback device 101, actuator 102, surgical instrument connection component 103, surgical instrument 201, portion of surgical instrument inserted into a physical model 202, physical model 301, simulation platform 302, piercing point 303, display device 401, displayed image 402, and three-dimensional tracker 403.
For a better understanding of the technical features, objects and effects of the surgery simulation system and method of the present application, specific embodiments will now be described in detail with reference to the accompanying drawings.
The FIGURE shows a schematic view of a surgical simulation system of the present application which can be used for simulation of basic surgical operations such as piercing and/or incision. As shown in the figure, the surgical simulation system may include a simulation platform 302, a force feedback device 101, a three-dimensional tracker 403, a display device 401, and a control module.
The simulation platform 302 can serve as a platform for performing simulated piercing and/or incision operations. The simulation platform 302 may be provided thereon with a physical model 301. The physical model 301 may be used to simulate a human organ for piercing and/or incision operation. The physical model 301 can be replaced as needed in order to provide a different surgery simulation.
The force feedback devices 101 can be used to simulate feedback force acting on an operator during surgery. The force feedback device 101 may come with one or more sets for simulating one-handed operation, such as a left-handed or right-handed one-handed operation, or simulating surgery that requires operation by both hands, such as operation that requires both hands to hold the surgical instruments. Each set of the force feedback device 101 may be connected with an actuator 102 and one or more surgical instrument connection components 103. The actuator 102 may include a stepper motor and/or a positioning actuator for simulating the feedback force (i.e. resistance) experienced by an operator during surgery, including gravity force of the surgical instrument 201, and the resistance encountered during the simulated surgery. The position of the actuator 102 may be detected and recorded by an internal or external three-dimensional sensor. The surgical instrument 201 can be detachably connected to the surgical instrument connection component 103. The surgical instrument 201 can be a piercing and/or incision instrument, or a surgical instrument for performing other surgical operations. For example, the surgical instrument 201 may include a rotatable handle and a needle, blade, stoma dilator, stoma sheath, penetration-type probe or lens provided on the handle.
The three-dimensional tracker 403 can be a sensing device such as a depth camera, an optical tracker, or an electromagnetic tracker for tracking the location and orientation of the exposed portion of the surgical instrument 201, detecting and recording the position of an incision point and/or piercing point 303 on the physical model 301 by the surgical instrument 201. The three-dimensional tracker 403 can track the movement of the surgical instrument 201 and transmit the acquired information to the control module. In the present application, the control module, via a visional analysis algorithm, may employ a template-matching method to identify the portion of the surgical instrument 201, e.g. needle or blade of the surgical instrument 201, which is pierced into the physical model 301. This can be used to accurately calculate the deformation and haptic simulation of the virtual organ and the surgical instrument, thereby enhancing the accuracy of the calculation and estimate the degree of bending of the inserted surgical instrument.
The display device 401 can be a general display device, or a display device with a touch screen for displaying the surgical instrument, a virtual organ, and/or a medical image 402.
The control module can be a computer or a server for controlling the entire surgery simulation system. The control module may have electrical signal connection with the force feedback device 101, the three-dimensional tracker 403 and the display device 401 respectively. The control module can control the force feedback device 101 according to the signals of the actuator 102 and the three-dimensional tracker 403, and display a corresponding image on the display device 401. The magnitude of the feedback force of the force feedback device 101 may be calculated by the control module based on the signal of the three-dimensional tracker 403.
Force model calculation for the piercing and/or incision operation takes into account the path-restraining force received by the simulation platform as well as force model at other various stages.
Before the surgical instrument 201 is inserted into the physical model 301, feedback force, i.e. the gravity force of the simulated surgical instrument 201 may be provided by the force feedback device 101. When the surgical instrument 201 is pierced into the physical model 301, extended calculation of the position of the incision point and/or piercing point 303 can be performed via the surgical instrument connection component 103 and the actuator 102. Feedback force can be provided together by the surgical instrument connection component 103, the force feedback device 101 which is connected with the surgical instrument connection component 103, and the physical model 301. When the surgical instrument 201 is operating in the physical model 301, feedback force can be provided together by the surgical instrument connection component 103, the force feedback device 101 which is connected with the surgical instrument connection component 103, and the friction at the interior of the physical model 301.
The surgical instrument 201 of the surgical simulation system of the present application can be a piercing instrument, an incision instrument, or other surgery instrument. The piercing instrument may include a rotatable handle and a needle provided on the handle. The incision instrument may include a rotatable handle and a blade provided on the handle.
To better simulate the human organ, the physical model 301 may be made of a membrane having a soft surface for repeat incision and/or piercing by the surgical instrument 201. An interior of the physical model 301 may be filled with a soft material that can generate friction when the surgical instrument 201 is inserted therein, and restrains the path of the surgical instrument after insertion.
The control module of the surgery simulation system of the present application may also be provided with an evaluation module to evaluate the performance of the operator. This may assist the operator in reviewing his/her performance and training.
The present application also provides a method for simulating a surgery, the method including:
In the surgery simulation method, before the surgical instrument 201 is inserted into the physical model 301, feedback force can be provided by the force feedback device 101. When the surgical instrument 201 is pierced into the physical model 301, feedback force can be provided together by the force feedback device 101 and the physical model 301. When the surgical instrument 201 is operating in the physical model 301, feedback force can be provided together by the force feedback device 101, and the friction at the interior of the physical model 301.
When performing surgery training using the surgery simulation system and method of the present application, the control module can detect a change based on the signal of the three-dimensional tracker 403 whenever the position of the surgical instrument 201 changes, and synchronize the position and posture of the virtual and real surgical instrument 201. When piercing of the surgical instrument 201 into the physical model 301 on the simulation platform 302 is tracked, the control module will compute the deformation and haptic simulation of the virtual organ and the surgical instrument. The piercing point 303 may also be used to estimate and simulate the degree of bending of the surgical instrument. Simultaneously, the simulation platform can provide additional restraining force for force feedback after piercing. This can greatly enhance the haptic experience. The visual effect of the surgery simulation can be displayed by the display device 401. The evaluation module of the control module of the surgery simulation system can provide an analysis of the accuracy and time management of the surgery simulation operation afterwards so as to help the operator to improve.
The surgery simulation method of the present application can arbitrarily select different positions of a virtual patient's body as through-holes for an ostomy path, and can repeatedly practice ostomy at different through-holes in the same body part (e.g. chest, abdomen, head/neck and limbs).
Embodiments of the surgery simulation system and method have been described above with reference to the accompanying drawings, but they are not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not limiting. It will be apparent to those skilled in the art that various changes in form and details may be made therein without departing from the scope of protection as defined by the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 201410377905.0 | Aug 2014 | CN | national |
The present application is a Continuation application of PCT application No. PCT/CN2015/084026 filed on Jul. 15, 2015, which claims the benefit of Chinese patent application No. 201410377905.0 filed on Aug. 1, 2014. All the above are hereby incorporated by reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/CN2015/084026 | Jul 2015 | US |
| Child | 15417238 | US |
