Patent Grant
11033182
This application is a national stage application of and claims priority under 35 USC § 371 to PCT International Application No. PCT/DK2015/050035, filed Feb. 20, 2015, which further claims priority to Danish Patent Application No. PA 2014 70716, filed Nov. 20, 2014 and European Patent Application No. 14156155.5, filed Feb. 21, 2014, all of which are incorporated herein by reference.
The invention relates to a set comprising a surgical instrument suitable for use in a minimal invasive surgery and/or for training the handling of such surgical instrument as well as a surgical system, a training kit, a method of training and performing minimal invasive surgery.
Minimal invasive surgery has been used increasingly in the last years due to the benefits compared to conventional open surgery as it reduces the trauma to the patient tissue, leaves smaller scars, minimizes post-surgical pain and enables a faster recovery of the patient.
For example, in laparoscopic surgery (a form of minimal invasive surgery) the surgeon accesses a body cavity, such as the abdominal or pelvic cavity, through a series of small incisions. A laparoscope is inserted through an incision, and conventionally connected to a monitor, enabling the surgeon to see the inside of the abdominal or pelvic cavity. In order to perform the surgery procedure, surgical instruments are inserted through incisions. In addition, the body cavity around the surgical site is inflated with a fluid, preferably gas e.g. carbon dioxide in order to create an ‘air’ space within the cavity for the surgeon to view the surgical site and move the laparoscopic instruments.
In conventional open surgery the surgeon can use the normal visual-motor relations, wherein the motor control is based on visual perception, such that a desired movement of a surgical instrument can be performed on basis of vision. In other words, during conventional open surgery the normal link between the visual perception and the motor system is conserved. However, when performing minimal invasive surgery the surgeon has an indirect vision of the surgical field which results in dissociation of the visual perception and the motor system of the surgeon. Consequently, the surgeon needs to acquire new skills in order to correctly connect his or hers visual perception and motor system (hand-eye coordination) during minimal invasive surgery.
Visual perception is the ability to interpret the surrounding environment by processing information obtained by use of the eyes, in the present case the surrounding environment can be the inside of a body cavity, such as the abdominal or pelvic cavity.
The motor system of a person is the complex system which, among other things, controls voluntary movements, enabling a surgeon to move body parts, such as a hand and fingers, to control the movement of a surgical instrument inside a body cavity.
Further, the remote vision of the surgical field is normally displayed on a monitor in two dimensions whereas the surgical instrument is manipulated in three dimensions; this results in a poor spatial and depth perception which makes it even harder for a surgeon to acquire the new abilities for connecting visual perception of the remote vision (in two-dimensions) and motor system moving the surgical tools (in three-dimensions).
In addition, if the surgical tools are controlled via a surgical robot the normal three dimensional motor behaviors of the surgeon are processed and changed by the robot, which makes it more difficult for the surgeon to correctly connect his or hers visual perception and motor system during minimal invasive surgery.
Training in minimal invasive surgery is normally performed after basic surgical training and is based on apprenticeship where the skills are obtained in direct clinical surgery supervised by an experienced surgeon. This training method poses considerable risk to the patient and requires a substantially amount of time from the experienced surgeon.
Therefore, the use of simulators, for example laparoscopic simulators, is preferred in order for an inexperienced surgeon to learn the basic skills before starting to do clinical surgery. Among the most important skills needed to master is; the ability to transform the information received by indirect vision into a three dimensional understanding.
Different approaches for providing an improved depth perception have been provided for example as described in EP 2630915 in which a light instrument for use in minimal invasive surgery is described. The light instrument includes an elongate tubular member and a metrology system mounted on the elongate tubular member. The metrology system includes a mask, a zoom lens assembly and a light element arranged such that the light element propagates light beams through the mask and the zoom lens assembly to project the patterns of the mask onto the surgical site of interest to provide markings as references used for measuring by the surgeon.
US 2013/0296712 describes an apparatus for determining endoscopic dimensional measurements, including a light source for projecting light patterns on a surgical sight including shapes with actual dimensional measurements and fiducials, and means for analyzing the projecting light patterns on the surgical sight by comparing the actual dimensional measurements of the projected light patterns to the surgical site.
WO 2013/163391 describes at system for generating an image which the surgeon can use for measure the size of or distance between structures in the surgical field by using an invisible light for marking a pattern to the surgical field.
The system comprises a first camera; a second camera; a light source producing light at a frequency invisible to a human eye; a dispersion unit projecting a predetermined pattern of light from the invisible light source; an instrument projecting the predetermined pattern of invisible light onto a target area; a band pass filter directing visible light to the first camera and the predetermined pattern of invisible light to the second camera; wherein the second camera images the target area and predetermined pattern of invisible light, and computes a three-dimensional image.
The object of the present invention is to provide a tool comprising a surgical instrument suitable for use in minimal invasive surgery and/or for training the handling of such surgical instrument, which tool provides the surgeon with good visual perception for handling the surgical instrument and preferably with enhanced visual perception when performing the surgery and which tool simultaneously is relatively simple to use and can be produced at adequate cost.
It is also an object to provide a method for performing minimal invasive surgery and/or training therefor which method provides the surgeon with good visual perception.
These and other objects have been solved by the invention or embodiments thereof as defined in the claims and as described herein below.
It has been found that the invention or embodiments thereof have a number of additional advantages which will be clear to the skilled person from the following description.
The tool is provided in form of a correlated set for minimal invasive surgery comprising a surgical instrument and a pattern generating member which can be assembled as described below to form a surgical instrument assembly.
In an embodiment of the present invention a surgical instrument assembly for use in minimal invasive surgery which enhances the surgeon's visual perception such that the surgeon is able to connect his or hers visual perception and motor system during minimal invasive surgery whereby an intended movement of the surgical instrument can be performed on basis of remote vision.
The correlated set for minimal invasive surgery comprises a surgical instrument and a pattern generating member. The surgical instrument has a distal end and a proximal end and comprises a handle portion at its proximal end, a surgical tool at its distal end and a body portion connecting the handle portion to the surgical tool. The pattern generating member comprises a pattern light source and a projector. The pattern light source is operatively connected to the projector for projecting a light pattern. At least the projector of the pattern generating member is configured for being at least temporarily fixed to the body portion of the surgical instrument such that a movement of the surgical tool results in a correlated movement of the projector.
Thereby, when the tool is moved, the projector will move in a correlated way which results in that the projected pattern as seen on a distally arranged surface will change accordingly. This change of the projected pattern in response to a surgeons' movement of the tool provides the surgeon with a very good visual perception of the 3D space in which the surgical tool is moved and thereby it will be simpler for the surgeon to handle the surgical tool with high accuracy. Further the surgeon needs less time to orientate in the 3D space which also makes it possibly to perform the surgical procedure relatively fast.
The terms distal and proximal should be interpreted in relation to the orientation of the surgical instrument.
The phrase “distal direction” means a direction with a vector oriented from the proximal end to the distal end of the surgical instrument.
The phrase “proximal direction” means a direction with a vector oriented from the distal end towards the proximal end of the surgical instrument.
The distal and proximal directions are determined when the body portion of the surgical instrument is in straight position.
Any planes and angles to the distal and proximal directions are all well determined when the body portion of the surgical instrument is in straight position.
The body portion of the surgical instrument has a longitudinal axis determined in straight position which longitudinal axis is parallel to the distal and proximal directions.
The phrase “distal to” means “arranged at a position in distal direction to”. The phrase “distally arranged” means arranged distal to the distal end of the surgical instrument.
The term “surgical instrument assembly” means an assembly comprising the surgical instrument and pattern generating member.
The term “substantially” should herein be taken to mean that ordinary product variances and tolerances are comprised.
The term “about” is generally used to ensure that what is within measurement uncertainties are include. The term “about” when used in ranges, should herein be taken to mean that what is within measurement uncertainties are included in the range.
It should be emphasized that the term “comprises/comprising” when used herein is to be interpreted as an open term, i.e. it should be taken to specify the presence of specifically stated feature(s), such as element(s), unit(s), integer(s), step(s) component(s) and combination(s) thereof, but does not preclude the presence or addition of one or more other stated features.
Throughout the description or claims, the singular encompasses the plural unless otherwise specified or required by the context.
In an embodiment the surgical instrument for use in minimal invasive surgery where a surgeon performs a surgical procedure within a body cavity with indirect vision of a surgical field comprises, a handle portion for manipulation of the instrument, and a body portion extending from the handle portion and comprising a surgical tool, wherein the body portion is adapted to be inserted through an incision in a body into the body cavity. The pattern generating member is fixed to the body portion and when the body part is inserted into the body cavity, it projects a light pattern on an area of the surgical field such that the contours of the surgical field and the position of the instrument can be deduced by the surgeon based on indirect vision of the light pattern.
Thus, it is possible for the surgeon to use the light pattern as a reference in order to connect the remote vision with the movement of the surgical tools. The light pattern can be interpreted as a monocular reference which enables the surgeon to determine the position of the surgical instrument and the contours of the surgical field. Consequently, the present invention enables the surgeon to overcome the difficulties in connecting his or hers visual perception and motor system during minimal invasive surgery.
In an embodiment the indirect vision of the surgical field can be obtained through an endoscope inserted through an incision in the body. The endoscope is advantageously connected to a monitor for displaying the surgical field in a two dimensions image.
The handle portion can comprise an actual handle for the surgeon to seize and thereby control the surgical instrument directly. In another embodiment, the handle portion is controlled by use of an actuator connected to a control mechanism, for example a surgical robot, such that the surgeon can control the surgical instrument indirectly.
The invention also comprises the correlated set in assembled condition i.e. the surgical instrument assembly.
The surgical instrument assembly mentioned above can both be used in training of surgeons in minimal invasive surgery and during an actual surgical procedure. When used during training it will reduce the training time before a minimal invasive surgeon is sufficiently skilled to perform live surgery.
Light pattern can for example be a grid or a plurality of light dots that generate the pattern. In an embodiment the light pattern comprises one or more cones of light that forms a geometric shape, such as a square. The surgeon can then use the curves defined by the edges of the geometric shape to determine the position of the surgical instrument and the contours of the surgical field.
When used during the actual surgical procedure it will help the surgeon, hereby minimizing the risk of mistakes and secure a smoother surgical procedure.
Advantageously the projector of the pattern generating member is configured for being at least temporarily fixed to the body portion of the surgical instrument such that at least any non-rotational movement of the surgical tool results in a correlated movement of the projector.
The phrase “rotational movement of the surgical tool” is a movement that is exclusively rotational with a rotation axis coincident with an axis of the body portion of the surgical tool when the body portion of the surgical instrument is straight. Any other movements of the surgical tool are non-rotational movements.
It has been found that some surgeons may in certain situations be distracted in case a mere rotational movement of the surgical tool results in a correlated movement of the projector and thereby the projected pattern.
In an embodiment the projector or the shape of the pattern is configured such that a mere rotational movement of the surgical tool does not result in a correlated movement of the projector and thereby the projected pattern.
In an embodiment the projector of the pattern generating member is configured for being at least temporarily fixed to the body portion of the surgical instrument such that any non-rotational movement of the surgical tool results in a correlated movement of the projector. Thereby a very improved visual perception in 3D can be obtained which ensures that the surgeon can handle the surgical instrument assembly with high precision. Advantageously the fixation of the pattern generating member is configured for being controllable by the surgeon, such that the surgeon can switch on and off movement of the generated pattern in response to rotational movement of the surgical instrument. In an embodiment at least the projector of the pattern generating member is configured for being at least temporarily fixed to the body portion of the surgical instrument using a fixing element comprising a rotation element, such as a turntable or a rotation disc allowing at least partially rotation of the projector, wherein the fixing element preferably comprising a switch for blocking rotation of the rotation element.
The projector of the pattern generating member or the whole pattern generating member is adapted for being temporarily or permanently fixed to the body portion of the surgical instrument. The phrase “temporarily fixed” is used to mean that the projector or the whole pattern generating member can be dissembled from the surgical instrument after use, e.g. for cleaning for reuse.
By having the surgical instrument and the pattern generating member with the projector as separate units e.g. for assembling by the user, the user can for example have a correlated set with several different pattern generating members to choose between, thereby allowing the surgeon to select which pattern generating member he/she wishes to use for a specific procedure.
Further it also allows a simpler production because the surgical instrument and the pattern generating member of the correlated set may be produced and sold separately.
In an embodiment the pattern generating member is detachably attached to the body portion. The surgeon can then remove the pattern generating member if needed. In addition, the pattern generating member can be attached to an existing surgical instrument in order to obtain a surgical instrument assembly.
The projector or the whole pattern generating member can be attachable to the body portion of the surgical instrument by any suitable means which provides a sufficiently safe attachment. The projector or the whole pattern generating member may for example be temporarily or permanently fixed to the surgical instrument by a click lock, a sleeve lock, a screw lock, a turn lock, a wedge lock or combinations thereof.
By providing the pattern generating member as a detachable unit, the pattern generating member or for example the projector of the pattern generating member can be replaced whenever desired. Further, it has been found that it is simpler to clean the surgical instrument for reuse without the pattern generating member or parts thereof. In an embodiment the pattern generating member is a disposable unit. In an embodiment the projector is a disposal unit.
The pattern generating member may be selected by the surgeon for the specific surgery—i.e. different pattern may be preferred in different surgeries, such as different shape of pattern, different size of pattern and/or different wavelength(s).
In an embodiment at least the projector of the pattern generating member is temporarily fixed to the body portion of the surgical instrument by a sleeve which surrounds the body portion in at least a length section thereof of the surgical instrument. The sleeve may simultaneously hold and protect the optical fiber. The sleeve may in principle be of any material. Where the surgical instrument assembly is for use in training there is no specific requirements to the sleeve material, however generally it is desired that the sleeve is of a relatively light material e.g. with a density below 1 g/cm3, such as of about 0.97 g/cm3 or less. Preferably the sleeve is of polymer material or a composite material. For application in surgery the sleeve material is preferably an olefin polymer, polyurethane or silicone. The sleeve preferably has a low-friction outer surface in order to reduce friction between the sleeve and tissue during surgery. In an embodiment the sleeve comprises a low friction coating e.g. of PTFE or a hydrophilic material e.g. a coating comprising hydrogel (e.g. based on alkyl methacrylate) and/or polyvinylpyrridine.
The sleeve is preferably arranged to fit tight around the body—i.e. the inner diameter of the sleeve is approximately as or slightly larger than the body.
The thickness of the sleeve material surrounding the body—here referred to as the sleeve wall—may be any thickness taken into account that the surgery instrument assembly should not be too bulky in particular the part of the sleeve that is adapted to be inserted through an incision and/or through a hole in the cover of a training kit. The thickness of the sleeve wall may vary along the length of the body and/or in its annular or semi-annular extension around the body. Examples of suitable sleeve wall thickness are from about 0.1 to about 10 mm, such as from about 2-5 mm.
In an embodiment the sleeve comprises two or more layers of equal or different materials.
In an embodiment the sleeve comprises a first elongate through hole for the body and a separate elongate hole for the optical fiber, such that the sleeve provide a protection cover for the optical fiber from the end of the sleeve closest to the handle when mounted and to the projector. The sleeve may comprise additional through holes and/or pockets e.g. for other elements of the pattern generation member e.g. such that further parts e.g. All parts of the pattern generating member can be fixed to the surgical instrument e.g. to the body of the surgical instrument by the sleeve. Thereby it becomes even simpler to mount the pattern generation member.
The outer diameter of the sleeve, in particular the part of the sleeve that is adapted to be inserted through an incision, is advantageously about 15 mm or less, such as about 10 mm or less. For certain applications the outer diameter may be larger.
In an embodiment the projector of the pattern generating member is temporarily fixed to the body portion of the surgical instrument by a sleeve where the sleeve comprises a fixing element arranged immediately adjacent to the handle. The fixing element advantageously comprises a rotation element such as described above.
In embodiments where only the pattern light source is not fixed or adapted to be fixed to the surgical instrument it is desired that the optical fiber guiding the light to the projector can be arranged on either side of the handle selected by the surgeon and e.g. in a fixed position in order not to bother the surgeon during surgery.
In an embodiment at least the projector and the pattern light source of the pattern generating member are temporarily fixed to the body portion of the surgical instrument by a sleeve.
In an embodiment all elements of the pattern generating member are temporarily fixed to the body portion of the surgical instrument by a sleeve. The elements of the pattern generating member comprises the projector and the pattern light source and optional power source and/or one or more controlling elements such as the pattern light source control unit described below.
In an embodiment at least the projector of the pattern generating member is permanently fixed to the surgical instrument, preferably the pattern generating member is integrated with the surgical instrument to form an integrated surgical instrument assembly.
In an embodiment the pattern generating member including the pattern light source and an optional battery is incorporated into the body of the surgical instrument.
Advantageously the correlated movement between the surgical tool and the projector is such that a given movement of the surgical tool results in a given predetermined movement of the projector.
The surgical instrument can in principle be any kind of surgical instrument for minimal invasive surgery. The term “surgical instrument” is herein used to denote an instrument which is for performing the actual invasive act contrary to instruments for illumination or acquiring images and similar not invasive instruments.
In an embodiment the surgical instrument is a laparoscopic instrument, an arthroscopic instrument and/or a thoracoscopic instrument, a gastroscopic instrument, a colonoscopic instrument, a laryngoscopic instrument, a broncoscopic instrument, a cytoscopic instrument or a combination thereof.
In an embodiment the surgical instrument has a rigid body portion and advantageously the body portion of the surgical instrument provides a rigid interconnection between the handle portion and the surgical tool. For example the body portion is rigid and the body portion preferably has length extending from the handle portion to the surgical tool. The body portion is preferably straight along its length. Such substantially rigid surgical instrument advantageously is a laparoscopic instrument, an arthroscopic instrument and/or a thoracoscopic instrument.
A laparoscopic instrument is usually applied for minimal invasive surgery in the abdomen. An arthroscopic instrument is usually applied for minimal invasive surgery at or inside of a joint. A thoracoscopic instrument is usually applied for minimal invasive surgery in the chest (heart, lungs, great vessels).
In an embodiment the surgical instrument is an endoscopic surgical instrument for use together with an endoscope where the surgical instrument is arranged in a channel in the endoscope during the surgical procedure. Such surgical instruments are in particular suitable in gastroscopy, colonoscopy, laryngoscopy, broncoscopy and cystoscopy and advantageously such surgical instrument has a flexible body portion. In an embodiment the body portion of the surgical instrument provides a flexible interconnection between the handle portion and the surgical tool.
In general the surgical instrument for minimal invasive surgery are relatively similar, however often they differs in size in relation to their purpose, i.e. whether it is a laparoscopic instrument, an arthroscopic instrument and/or a thoracoscopic instrument. Further as explained above the body portion of surgical instrument may be rigid or flexible.
The body portion of the surgical instrument can in principle have any length depending on the surgery to be performed e.g. from a few cm, such as 5 cm to about 50 cm or even up to about 200 cm. Generally, flexible surgical instrument will have longer body portions than rigid surgical instrument. The length of the body portion is determined from the handle portion to the surgical tool. In an embodiment the body portion has a length of from about 35 cm to about 40 cm.
Advantageously the surgical tool is adapted to perform a surgical intervention at a surgery target site. In an embodiment the surgical tool is selected from a grasper, a suture grasper, a stapler, forceps, a dissector, scissors, a suction instrument, a clamp instrument, an electrode, a curette, ablators, scalpels, a needle holders, a biopsy and retractor instrument or a combination thereof.
All of such surgical tools are well known to a skilled person and will not be described in further details. The surgical tool is advantageously adapted to be operating in direct contact with the tissue. Such instruments require to be controlled with a very high precision and accordingly the invention provides a very valuable contribution for improving the control and operation of the surgical instrument in proximal directions for high precision minimal invasive surgery.
The pattern light source can in principle be any kind of light source capable of providing a desired pattern. The light source may be a coherent light source or an incoherent light source.
The term “coherent light” is herein used to denote laser light whereas “incoherent light” includes any non-laser lights irrespectively of its Degree of coherence. Incoherent light with a relatively high degree of coherence (sometimes called partially coherent light) are often preferred because the incoherent light provides a sufficient bright pattern, while the incoherent light source generally can be obtained a much lower cost than coherent light.
In an embodiment the pattern light source is a coherent light source, such as a semiconductor light source, such as a laser diode and/or a VCSEL light source.
In an embodiment the pattern light source is an incoherent light source, preferably the light source is a semiconductor light source, such as a light emitting diode (LED).
Advantageously, the light pattern is generated by at least one laser and/or LED. Lasers and LED's (light emitting diodes) are advantageous as they can generate light patterns that are well defined and it is possible to choose the wavelength, and thus color, such that the pattern is enhanced in the remote vision. For example such that the light pattern is clearly visible and enhanced on the monitor.
The pattern light source advantageously has a relatively narrow band width thereby providing a bright light in the narrow bandwidth, while simultaneously emitting a relatively low light energy. This is advantageously both to avoid undesired heating of the surgical target site and simultaneously have low risk of blinding the surgeon.
In an embodiment the pattern light source has a band width (full width at half maximum—FWHM) of up to about 50 nm, such as from 1 nm to about 40 nm. Preferably the narrow band width of the pattern light source is about 25 nm or less, such as about 10 nm or less.
In an embodiment the pattern light source has a center wavelength of about 450 nm to about 600 nm, such as about 532 nm.
In an embodiment the pattern light source has a red center wavelength within the range 610 nm<λ<760 nm.
In an embodiment the pattern light source has an orange center wavelength within the range 590 nm<λ<610 nm.
In an embodiment the pattern light source has a yellow center wavelength within the range 570 nm<λ<590 nm.
In an embodiment the pattern light source has a green center wavelength within the range 500 nm<λ<570 nm.
In an embodiment the pattern light source has a blue center wavelength within the range 450 nm<λ<500 nm.
In principle the pattern light source can comprise any wavelengths such as wavelengths within visible light or within invisible light. Where the light is invisibly the light pattern is adapted to be read by a detector capable of detecting the light wavelength in question. The detector may for example be part of a computer connected to a monitor for showing the pattern and/or the detector may be part of a robot as further described below.
In an embodiment the pattern light source has a band width comprising visible light having wavelength in the range from about 400 nm to about 900 nm, preferably in the range from about 450 nm to about 700 nm, preferably in the range from about 500 nm to about 650 nm.
In an embodiment the pattern light source has a band width comprising invisible light, such as light having wavelength above about 900 nm and/or below about 450 nm.
In an embodiment pattern generating member comprises two or more pattern light sources having equal or different bandwidths, wherein the two or more pattern light sources preferably are operatively connected to the projector.
In an embodiment—the two or more pattern light sources can be connected to separate projectors.
Generally it is desired that the pattern light source (or sources) can be switched on and off and optionally be modified in wavelength and/or intensity, using a pattern light source control unit. In an embodiment the pattern light source control unit is a non-hand held unit, such as a pedal or a voice activated control unit—thereby the surgeon can in a simple manner control the light pattern. In an embodiment the pattern light source control unit is incorporated into the handle of the surgical instrument for simple handling by the surgeon.
Advantageously the pattern light source is arranged to provide a pattern output power which is sufficient to generate a visible pattern, but not too high such that an undesired amount of heat may be generated. Preferably the pattern light source is arranged to provide a pattern output power up to about 5 mW such as from about 0.1 to about 4 mW, such as from about 0.5 to about 1.5 mW. Preferably the pattern output power is adjustable. The pattern output power is determined as the output power of the projector.
The projector of the pattern generating member is adapted to project a pattern. Advantageously the projector of the pattern generating member comprises a phase optic element, a spatial light modulator, a multi-order diffractive lens, a holographic lens, a Fresnel lens and/or a computer regulated optical element.
The phase optic element may advantageously be a diffractive optic element (DOE).
In an embodiment the phase optics element is capable of producing an image having periodic intensity distribution.
Diffractive optic elements are well known in the art and may for example utilize a surface with a complex microstructure for its optical function. The micro-structured surface relief profile has two or more surface levels. The surface structures are either etched in fused silica or other glass types, or embossed in various polymer materials. Additionally, diffractive optics can realize almost the same optical functions as refractive optics such as lenses, prisms or aspheres, but they are much smaller and lighter. DOEs are not limited to laser applications; partially coherent light from LEDs or other light sources can also be modulated.
In an embodiment the DOE is as described in US 2013/0038836 e.g. as shown in FIG. 1 and/or as described in section [015] of US 2013/0038836.
In an embodiment the diffractive optic elements comprises a “multi-order diffractive” lens, such as a conventional diffractive-optic lens utilizing a single diffraction order in which the optical power of the lens is directly proportional to the wavelength of light.
The projector may comprise any type of beam manipulating element for providing the desired pattern e.g. lenses and/or mirrors and/or splitters and/or filters and/or collimator.
In an embodiment the projector comprises a spatial light modulator. The spatial light modulator configured for modulating the light pattern for example by modulating the transparency of a pattern cover e.g. by a computer modulation. In an embodiment the spatial light modulator is arranged for modulating the intensity and/or the phase of the light from the pattern light source to thereby modulate the emitted light pattern.
In order to ensure that the minimal invasive surgery can be performed with a desired small incision it is generally desired that the part of the pattern generating member to be mounted to the body portion of the surgical instrument is relatively small.
Advantageously the projector of the pattern generating member has a maximal extending area perpendicular to the proximal direction when the pattern generating member is fixed to the body portion of the surgical instrument and the body portion is in straight position, which maximal extending area is up to about 4 cm2, such as up to about 2 cm2, such as from about 0.01 to about 1 cm2, such as from about 0.1 to about 0.5 cm2.
Where the whole pattern generating member is to be fixed to the body portion of the surgical instrument it is desired that the whole pattern generating member has a maximal extending area perpendicular to the proximal direction when the pattern generating member is fixed to the body portion of the surgical instrument and the body portion is in straight position, which maximal extending area is up to about 4 cm2, such as up to about 2 cm2, such as from about 0.01 to about 1 cm2, such as from about 0.1 to about 0.5 cm2.
The pattern light source is operatively connected to the projector to transfer light to the projector. The operatively connection can in principle be any kind of wave guiding element or elements, such as an optical fiber, one or more lenses, mirrors, splitters, collimators, amplifiers or any other suitable optical element.
In an embodiment, the light source is not intended to be inserted into the body cavity and the operatively connection e.g. at least one optical waveguide is adapted to guide the light from the pattern light source through the incision in the body to the projector. Thus, the projector of the pattern generating member that is inserted in to the body cavity can be made relatively small, as the light can be generated outside the body cavity and guided via optical waveguides to the body cavity where it can be projected onto the area of the surgical field. Advantageously, the pattern light source can be detached from the at least one optical waveguide. This simplifies the sterilization process of the surgical instrument as the pattern light source does not need to be sterilized in case it does not enter the body cavity. In an example, there is one pattern light source that is either connected to one optical waveguide or a plurality of optical waveguides. In another example, there are more than one pattern light source.
In an embodiment the pattern light source is adapted for being arranged at a distance to the projector, e.g. such that it need not be inserted through the incision in use. The pattern light source is in an embodiment incorporated into a pattern light source housing arranged to be positioned at a distance to the surgical instrument and advantageously connected to the projector via connection means comprising an optical fiber. Preferably the optical fiber is protected by a polymer cover.
In an embodiment the pattern light source is (or is adapted for being) connected to or incorporated into the handle of the surgical instrument. In this embodiment the pattern light source control unit as discussed above is advantageously also (or is adapted for being) connected to or incorporated into the handle of the surgical instrument.
The pattern generating member is connected or adapted to be connected to a power source. In an embodiment the power source is a battery.
The pattern light source and/or optional battery is/are in an embodiment incorporated into or fixed to the body of the surgical instrument. Advantageously the pattern light source is fixed to or incorporated into the handle of the of the surgical instrument and the battery is incorporated into or fixed to the body of the surgical instrument, preferably near the proximal end of the surgical instrument, such as closest to the handle than to the surgical tool.
In an embodiment the pattern light source and the battery are incorporated into a pattern light source housing which is adapted to be arranged external during a surgery e.g. in the handle of the surgical instrument as described above.
In an embodiment where the pattern light source and the battery are incorporated into a pattern light source housing, the pattern light source housing is incorporated into or fixed to the body of the surgical instrument, preferably near the proximal end of the surgical instrument, such as closest to the handle than to the surgical tool.
In an embodiment the pattern light source and the battery are incorporated into a pattern light source housing together with the projector to form the pattern generating member which is adapted to be mounted to the body portion of the surgical instrument.
In an embodiment the pattern light source and optionally the the pattern light source control unit is/are adapted for being or is/are connected to or incorporated into the handle of the surgical instrument and the pattern light source is connected to an external battery arranged at a distance from the surgical instrument.
In an embodiment the pattern light source and/or a power source or a power input connector is/are fixed to the body of the surgical instrument using a sleeve as described above. In this embodiment preferably also other elements such as the projector and optional control units are fixed to the body of the surgical instrument using the sleeve.
In an embodiment the projector pattern light source, the power source in form of one or more batteries or a power input connector, the projector and a control unit as described above are fixed to the body of the surgical instrument using the sleeve. One or more, such as all of the pattern light source, the power source, the projector and the control unit is/are advantageously fixed (temporally or permanently fixed) to the sleeve prior to mounting the sleeve to the body of the surgical instrument, thereby providing a very simple assembling of the elements to provide an assembled surgical instrument ready for use. The pattern light source, the power source, the projector and/or the control unit is/are preferably fixed to the sleeve by being fully or partly integrated in the material of the sleeve, by being arranged between layers of the sleeve by being mechanically attached to the sleeve e.g. by being arranged in a pocket of the sleeve and e.g. fixed there by being attached by being connected to another element (such as another of the parts attached to the sleeve). In an embodiment one or more parts of the pattern light source, the power source, the projector and/or the control unit is/are mechanically attached to the sleeve by an adhesive, by welding, by screws, by rivets or by any other suitable means.
In an embodiment the pattern light source and the battery is incorporated into a pattern light source housing together with the projector to form the pattern generating member and the pattern generating member is fixed (temporally or permanently fixed) to the sleeve prior to mounting the sleeve to the body of the surgical instrument.
In an embodiment, the pattern generating member projects the light pattern on an area in front of the body portion covering 90 degree to the sides, preferably 60 degree. In front of the body portion, is to be understood as along the longitudinal axis of the body portion and away from the handle portion (in distal direction), preferably in front of the surgical tool.
In an embodiment the projector of the pattern generating member is configured such that when it is fixed to the body portion of the surgical instrument it is arranged for emitting a pattern comprising a plurality of projecting directions with angles relative to its longitudinal axis of from about 5 degrees to about 85 degrees (or even up to 90 degrees), such as from about 10 degrees to about 60 degrees, such as from about 15 degrees to about 50 degrees.
When the projector of the pattern generating member is fixed to the body portion of the surgical instrument it is adapted to emitting a pattern such that a movement of the surgical tool results in a correlated change of the pattern.
The pattern may have any desired shape. In case the pattern consists of one or more coaxial circles any non-rotational movements of the surgical tool advantageously results in a correlated change of the pattern.
The change of the pattern may e.g. be a change of shape, position, size and/or color.
In an embodiment the projector is fixed or adapted to be fixed to the body portion of the surgical instrument such that the pattern remain substantially stationary when the surgical instrument is subjected exclusively to circumferential movement with the longitudinal axis of the body portion of the surgical instrument as center of the circumferential movement.
In an embodiment the projector when fixed to the body portion of the surgical instrument, is configured for emitting a pattern which pattern when projected to a surface perpendicular to the distal direction is at most 10 fold rotational symmetrical, preferably the pattern is at most 8 fold rotational symmetrical.
Such pattern which is not fully rotational symmetrical but has up to 10 fold rotational symmetry gives the user an even better visual information about the position of the surgical instrument and in particular the surgical tool. For example the user can with a high precision see any twisting and angular movements of the surgical tool.
In an embodiment, the light pattern is a grid. Thus, the light pattern is a light grid which is projected on an area of the surgical field when the surgical instrument is in use. The changes in the grid lines can for example be used to deduce the contours of the body cavity such as projected surface and/or the contours of the surgical field. The changes in the angle and distance between crossing and/or parallel grid lines when the surgical instrument is moved can for example be used to determine the orientation of the surgical instrument.
The phrases “surgical field”, “surgical site” and “surgery target site” are herein used interchangeable. In certain situations, as it will be explained below, the surgical site is an artificial surgical site.
In an embodiment the light pattern comprises a plurality of light dots. When the surgical instrument is moved, the position and/or the distance between the dots will change, which enhances the surgeon's ability even further to deduce the position of the surgical instrument and the area contours of the surgical field.
In an embodiment the projector fixed to the body portion of the surgical instrument is configured for emitting a pattern which pattern, when projected to a surface perpendicular to the longitudinal axis of the body portion of the surgical instrument, comprises a plurality of angled lines. Advantageously the pattern comprises a grid of lines, such as a grid comprising one or more sets of parallel lines.
Where the pattern has angled lines pattern when projected to a surface perpendicular to the distal direction a tilting of the surgical instrument can for example be observed by a change of such angled lines e.g. by a deformation of one or more of the lines, by change of line angles and/or by change of distance between lines.
The pattern is advantageously sufficient large to ensure good visual perception of the surgical tool and movement thereof—even when the surgical tool is in contact with tissue during a surgery.
In an embodiment the projector in mounted condition (i.e. fixed to the body portion of the surgical instrument) is configured for emitting a pattern which pattern, when projected to a projecting surface immediately distal to the surgical tool and perpendicular to the longitudinal axis of the body portion of the surgical instrument, has a pattern beam size determined as the diameter of a circle inscribing the pattern of at least about 0.5 cm, such as up to about 60 cm, preferably from about 1 cm to about 25 cm. Thereby the user can be guided by the pattern and deformations of the pattern even when the surgical tool is close to or even touching the tissue.
Advantageously the pattern projected to a projecting surface becomes larger the larger the distance to the projecting surface. In an embodiment, the pattern beam size increases proportionally on a projecting surface when the surgical instrument is moved to a distance between the surgical tool and the projecting surface. Advantageously the pattern beam size increases such that at a distance of 1 cm the pattern beam size is at least about 5% larger than at zero distance. In an embodiment the pattern beam size increases such that at a distance of 1 cm the pattern beam size is at least about 10% larger, such as up to 200% larger than at zero distance.
The invention also comprises a surgical system suitable for performing minimal invasive surgery or suitable for training for performing minimal invasive surgery.
The surgical system comprises an illuminating element comprising an illuminating light source for illuminating a surgery target site, a camera element for acquiring images of the surgery target site, a monitor for displaying the acquired images and at least one surgical instrument assembly.
The surgical instrument assembly comprises a surgical instrument and a pattern generating member. The surgical instrument has a distal end and a proximal end and comprises a handle portion at its proximal end, a surgical tool at its distal end and a body portion connecting the handle portion to the surgical tool. The pattern generating member comprises a pattern light source and a projector, wherein the pattern light source is operatively connected to the projector for projecting a light pattern. At least the projector of the pattern generating member is at least temporarily fixed to the body portion of the surgical instrument such that a movement of the surgical tool results in a correlated movement of the projector.
In an embodiment at least any non-rotational movement of the surgical tool results in a correlated movement of the projector.
Advantageously the surgical instrument assembly is an assembled correlated set as described above.
The camera element can be any element capable of acquiring images of a surgery target site. In an embodiment the camera element is in form of an endoscope, such as a rigid endoscope or a flexible endoscope. Such rigid and flexible endoscopes are well known in the art and any such prior art endoscopes may form the camera element of the surgical system.
The camera element is operatively connected e.g. wireless or by wire to the monitor optionally via a computer and/or via the Internet. The camera may e.g. comprise an objective lens and a lens system transmitting the image from the objective lens to the monitor, typically a relay lens system in the case of rigid endoscopes or a bundle of fiber optics in the case of a flexible endoscope (fiberscope).
The illumination element can be a separate illumination element or it can e.g. be incorporated in the camera element e.g. in the endoscope.
In an embodiment the surgical system comprises an endoscope comprising both the illumination element and the camera element. Where the endoscope comprises both the illumination element (or the illumination instrument) and the camera element these parts are advantageously integrated into the endoscope. In an embodiment the endoscope may comprise a channel for the illumination element.
The illumination light source is normally outside the body and the illumination light is typically directed via an optical fiber system.
In an embodiment the camera element is an endoscope, comprising a channel for the surgical instrument assembly.
In an embodiment the illumination element comprises an illuminating instrument and an illuminating light source operatively connected to the illumination instrument, the illumination light source is preferably adapted to be positioned at a distance to the illumination instrument and is preferably operatively connected to the illumination instrument via an optical fiber.
The illumination instrument is not operatively connected to the surgical instrument to change position in dependence on the position of the surgical tool of the surgical instrument.
The illumination instrument is the element from where the illumination is emitted. The illumination element may be a projector for the illumination light, such as a projector comprising a phase optic element, a spatial light modulator, a multi-order diffractive lens, a holographic lens, a Fresnel lens and/or a computer regulated optical element as described above.
The illumination light can be any kind of light, e.g. the illumination light as used in prior art illumination elements. The illumination light source may be a coherent or an incoherent light source. In an embodiment illumination light source is a halogen light source, an arc light source and/or a LED light source.
In an embodiment illumination light source is an arc light source such as a. xenon source for illumination.
In an embodiment the illumination light source is selected from a VCSEL light source and a supercontinuum light source.
Outstanding illumination light sources are ones that combine high color rendering, high luminance and as little ultraviolet and infrared radiation as possible.
Generally it is desired that the illumination light source has a relatively large band width in order to provide a good illumination. Advantageously the illumination light source has a band width comprising visible light having wavelength in the range from about 400 nm to about 900 nm, preferably in the range from about 450 nm to about 700 nm, preferably in the range from about 500 nm to about 650 nm. As described below the illumination element may comprise a filter e.g. an on-off filter or a tunable filter in case the surgeon wishes to observe certain tissue illuminated with narrow band width light.
Preferably the illumination light source has a band width (full width at half maximum—FWHM) of at least about 50 nm, such as from about 60 nm to about 800 nm or larger.
Preferably the illumination light source and the pattern light source differ from each other such that the surgeon or a computer can distinguish light pattern reflected light from illumination reflected light. Preferably the pattern light source has a narrow bandwidth relative to the bandwidth of the illumination light source. In an embodiment the pattern light source has a bandwidth which is about half or less than the bandwidth of the illumination light source. In an embodiment the pattern light source has a bandwidth which is 1/10 or less than the bandwidth of the illumination light source.
In an embodiment the pattern light source comprises wavelength in its bandwidth which has a higher power than in the bandwidth of the illumination light, thereby the surgeon or the computer can distinguish light pattern reflected light from illumination reflected light.
In an embodiment the pattern light source comprises wavelength in its bandwidth which are not comprised in the bandwidth of the illumination light source. Preferably the pattern light source comprises wavelength below 550 nm, and the illumination light source does not comprises wavelengths below 550 nm.
In an embodiment the illumination light source and or the illumination instrument comprises an optical filter, such as a tunable optical filter and/or an on-off filter. Thereby a user can switch from a broad band illumination emitted to the surgery target site to a narrow band illumination e.g. to observe certain tissue in certain light to reveal defects
In an embodiment, data of the wavelength of the reflected light of the light illumination or of the light pattern may be obtained and a system may be adapted to receive the data and determine properties of tissue in the surgical site. By analyzing the reflected light, certain properties of the tissue may be determined. This can for example be the oxygen level in the tissue and changes thereof, and the type of tissue. For example the reflected light can be used to determine what kind of organ the tissue is part of, which indicates to the surgeon what organs are which and thereby assisting the surgeon to the area of interest.
In an embodiment the surgical system further comprises a marking element comprising a marking instrument and a marking light source. The marking element is applied for marking up the surgery target site e.g. with a marking light pattern e.g. a dotted pattern or a grid. Such marking pattern is independent of the position of the surgical tool and the pattern does not change in a correlated way relative to movement of the surgical instrument or the surgical tool of the surgical instrument. Preferably the marking pattern is kept substantially stationary (or simply switched on and of) during a surgery. The marking instrument is e.g. a projector for the marking light and is e.g. arranged on the endoscope.
The marking light source advantageously differs from the pattern light source and the illumination light source, preferably the marking light source has a band width (full width at half maximum—FWHM) of up to about 50 nm, such as from 1 nm to about 20 nm.
In an embodiment the marking light source is as the invisible light source described in WO 2013/163391.
In an embodiment the marking the marking light source comprises visible light.
In an embodiment the marking element is as the projector assembly of the metrology system described in US 2013/0296712.
The invention also comprises a training kit suitable for training for performing a minimal invasive surgery.
The training kit comprises a surgical system as described above, an artificial surgical site and a cover for the artificial surgical site, wherein the cover comprises one or more through holes for the surgical instrument assembly. The cover may e.g. be shaped as a screen, a plate, a curtain, a curved shield or any combinations thereof.
The camera element is configured for acquiring images of the artificial surgical site and may e.g. be as described above. In an embodiment the camera element is fixed to the cover on a side of the cover facing the artificial surgical site. In an embodiment the camera element is arranged to be inserted through the one or more through holes.
The illumination element is configured for emitting light towards the artificial surgical site and may e.g. be as described above. In an embodiment the illumination element is fixed to the cover on a side of the cover facing the artificial surgical site. In an embodiment the illumination element is arranged to be inserted through the one or more through holes.
Advantageously the illumination element and the camera element optionally in form of a combined illumination element/camera element is/are fixed to the cover. In an embodiment the illumination element and the camera element optionally in form of a combined illumination element/camera element have/has a proximal end and a distal end wherein the camera element and illumination element carries a camera lens and an illuminating emitter at their/its distal end and wherein the one or more through holes are adapted, such that the distal ends of the surgical instrument and the camera element/illumination element can be inserted through the one or more holes.
Advantageously the camera element is in data connection (wireless or by wire) with a computer programmed to monitoring the movement of the surgical tool of the surgical instrument. Preferably the computer is programmed to monitoring the shape and size of the light pattern as a function of time and based thereon determine the movements of the surgical tool. Advantageously the computer further is programmed to evaluate the performance of the user.
The term “computer” is used to mean any kind of computer or systems of computers. The computer may e.g. be a single computer or two or more computers in data connection.
Where the surgical system also comprises a marking element e.g. emitting narrow band UV or IR this generated marking pattern may e.g. provide a reference grid for the computer to determine the positions and movements of the surgical tool.
The invention also comprises a method of training for performing a minimal invasive surgery comprising training handling of a surgical instrument for minimal invasive surgery.
The training method comprises
In an embodiment, the projected light pattern is adapted to be able to change shape, position, size and/or color. The surgeon can then ensure that the light pattern has the optimal form and/or extension and/or position on the surgical area for further enhancing the surgeon's ability to coordinate movement of the surgical instrument based on the indirect vision. In an example the color of the light pattern is chosen such that specific objects in the surgical field appear clearer and/or with a larger contrast in relation to other objects in the surgical filed. This can be used to highlight an object in the surgical field, for example an organ which is the target for the surgical procedure.
In an embodiment the training method comprises the steps; provide a cavity, provide a system for indirect vision of an area of the cavity, insert the surgical tool of the surgical instrument assembly and at least a section of the body portion into the cavity, project the light pattern on a wall of the cavity visible by the system for indirect vision, move the instrument and observe, via the system for indirect vision, the correlated changes of the light pattern.
In an embodiment, data on shape, position, size and/or color and/or changes thereof of the light pattern is obtained and a computer is programmed to receive the data and determine the position of the surgical tool. The position of the tool is advantageously forwarded to the surgeon. The position of the surgical tool can for example comprise information of the distance between the surgical tool and a training surface, such as a surgical target site or an artificial surgical site. This distance can be presented on a monitor used for remote vision e.g. as a distance in mm. The distance can be given for any distance between the surgical tool and another object in the body cavity.
Thus, it is possible to train the handling of a surgical instrument assembly based on remote vision of a section of the surgical instrument inside a cavity. Using this method for training, the handling of the surgical instrument assembly, will enhance the ability to transform the information obtained by indirect vision into a spatial understanding of the position of the instrument and internal contours of the cavity. Hence, it will train the ability to correctly connect the visual perception and motor system (hand-eye coordination) when observing via remote vision.
In an embodiment, the method is adapted such that data of the position of the surgical tool and/or changes of the light pattern is obtained and forwarded to a computer, and wherein the computer is adapted to determine the abilities of an operator of the surgical instruments based on an evaluation of the data of the position and/or changes in the light pattern.
Advantageously the surgeon in training will move the surgical instrument assembly during training in order to perform the task given. If the shape, position, size and/or color and/or changes thereof of the light pattern is recorded by the computer connected to the remote vision, (e.g. via a laparoscope) the surgeon's ability to handle the surgical instrument assembly can be determined. For example, if the light pattern has repetitive changes it can indicate that the operator makes the same movements of the surgical instruments several times and thus have difficulty doing a specific task, for example aligning the instrument for grapping a specific item in the artificial surgical site. Thus, the computer can so to speak, give a mark of the performance of the surgeon in a training session based on data of the shape, position, size and/or color and/or changes thereof of the light pattern. It is to be understood that the abovementioned feature also can be used during live surgery for evaluating the surgeon's capabilities during the surgical procedure.
In an embodiment the training method comprises at least one training step of moving the surgical tool to and back and forth relative to the training surface and observing the corresponding changes of the light pattern.
In an embodiment the training method comprises at least one training step of moving the surgical tool by twisting and/or tilting relative to the training surface and observing the corresponding changes of the light pattern.
Advantageously the surgical instrument assembly is part of a surgical system as described above and/or the surgical instrument assembly is part of a training kit as described above.
In an embodiment the training method comprises inserting the distal ends of the camera element and illumination element through the one or more holes of the cover towards the artificial surgical site, illuminating the artificial surgical site by the illumination element, acquiring images of the artificial surgical site by the camera element and transmitting the acquired images to the monitor for displaying the acquired images, inserting the surgical tool of the surgical instrument through a hole of the cover and emitting a light pattern towards the artificial surgical site, moving the surgical instrument relative to the training surface, such as a surgery target site or an artificial surgical site and observing the light pattern imaged on the monitor and changes thereof corresponding to the respective movements of the surgical instrument.
In an embodiment the method further comprises evaluating the performance of the training person by monitoring the shape, position, size and/or color and/or changes thereof of the light pattern as a function of time and based thereon determine a sequence of movements of the surgical tool and evaluate the performance. The performance advantageously is evaluated by benchmarking the movements of the surgical instrument to a preset sequence of movements.
The invention also comprises a method of performing a minimal invasive surgery of a target surgical site in an internal body structure below a skin area of a patient. The surgery method comprises providing access to the surgical target site comprising providing an incision through the skin area, inserting an illumination element for illuminating a surgery target site, a camera element for acquiring images of the surgery target site, and at least one surgical instrument assembly through the incision. The camera element is operatively coupled to a monitor for displaying the acquired images. The laparoscopic instrument assembly comprises a surgical instrument with a surgical tool and a pattern generating member with a pattern light source and a projector for projecting a light pattern, which projector is correlated to the surgical tool such that movements of surgical tool results in a change of the pattern of the pattern light source, and wherein the method comprising handling the surgical instrument based at least partly on visualizing of the light pattern by the acquired images on the monitor.
Advantageously the surgical instrument assembly is part of a surgical system as described above and/or the surgical instrument assembly is part of a training kit as described above.
All features of the inventions including ranges and preferred ranges can be combined in various ways within the scope of the invention, unless there are specific reasons not to combine such features.
The invention will be explained more fully below in connection with a preferred embodiment and with reference to the drawings in which:
The figures are schematic and are not drawn to scale.
In another embodiment the surgical tool 4 can be another surgical tool e.g. scissors or as described above. The surgeon holds the handle portion 2 and can in this way control the surgical instrument assembly and by pressing or manipulating the handle portion the forceps can be controlled.
The surgical instrument assembly 1 further comprises a pattern generating member 5 comprising a pattern light source 6 and optical fibers 7 which guide the light to a projector 8 (light emitting portion) where optical fibers 7 ends and the light is projected from the projector 8 in a desired pattern. The pattern light source 6 is placed on or incorporated into the handle portion 2 of the surgical instrument and is thus not inserted into the body cavity during surgery. In an embodiment the pattern light source 6 is connected to a battery which is also placed or incorporated into the handle portion 2. In an embodiment the pattern light source 6 is connected to an external power source such as a battery which is an external battery arranged at a distance from the surgical instrument assembly.
The projector 8 has advantageously a spherically periphery geometry and is configured for emitting a light pattern comprising a plurality of angled lines and or a plurality of parallel lines. In an embodiment the projector 8 has for example a spherical geometry, and is shaped for emitting a light pattern with a spherically periphery where the light pattern forms a light pattern resembling the light pattern generated by a mirror ball. It is to be understood that the mirror ball resembling pattern is preferably only a section of normal mirror ball pattern, e.g. not a 360 degree pattern but preferably only a 90 degree section of the pattern and/or with an angle relative to the axis of the body portion 3 up to 85 degrees.
This light pattern makes it possible for the user of the surgical instrument assembly 1 to deduce the position and movements of the surgical instrument assembly 1 and thus the surgical tool 4, relative to the surface e.g. a surgical site where the light pattern is projected.
The light generated in the light source 6 may be generated by use of one or more LED's and/or lasers or a combination thereof as explained above.
A section—i.e. the distal end of the body portion 3 of the surgical instrument assembly 1 shown in
The pattern generating member 5 or parts thereof can be made as an optionally removable clip-on device and/or it can permanently attached to the body portion 3. In an embodiment the entire pattern generating element 5 is mounted to body portion 3 and is adapted for being inserted into the body cavity.
The light source may be constructed so that substantially no light is projected in the direction of the laparoscope in order to prevent light hitting it and thus disturb the view. This can for example be done by turning off or blocking the light which faces the endoscope. It can also be done by constructing the surgical instrument so that there are no lights facing the laparoscope.
The light pattern 40 (or 30 as exemplified in
The surgical instrument assembly shown in
In an alternative embodiment the pattern light source control unit 69 is mounted to or integrated with the handle 62.
The training kit shown in
The illuminating element is illuminating the artificial surgical site with a broad bandwidth light. The surgical system further comprises a not shown marking element which e.g. in integrated with the illuminating element. The marking element generates a marking pattern 79 which is stationary and used for marking up the surgical site and is e.g. used as a reference pattern. The marking pattern preferably is a narrow band width light pattern e.g. invisible to the human eye. Advantageously the marking pattern can be switched on and off by the surgeon.
The projector 68 generates a pattern 70 which changes when the surgical instrument assembly 71 as described above.
Advantageously the camera element is connected to a computer e.g. integrated with the monitor 77, which computer is programmed to monitoring the movement of the surgical tool 64 of the surgical instrument assembly 71.
The surgical system shown in
The surgical system further comprises a monitor 87 connected to the endoscope with wire 87a. Alternatively the connection between the monitor 87 and the endoscope in wireless connected. The monitor 87 is arranged for displaying the images acquired by the endoscope 88. The monitor may additionally comprise a computer for analyzing the images. The surgical system further comprises a surgical instrument assembly 81 e.g. as shown in
The surgical instrument assembly shown in
The pattern light source in the housing 90 is connected to a power source via the plug 90a. In the shown embodiment the power source is in form of battery casing 91 is connected to the pattern light source via an electrical conducting wire 97a for supplying power. The battery casing 91 comprises an on/off button 91′. The surgeon may use this on/off button 91′ during use (training or surgery) of the surgical instrument assembly, however, for safety and to protect the battery casing 91 it is preferred that the on/off button 91′ is used only at the beginning and termination of an operation, Therefore the surgical instrument assembly comprises an additional control source control unit 92 which is arranged at a distance from the surgical instrument—e.g. on the floor in form of a pedal with a control button 92′, which can be operated by the surgeon during use for switching the power and thereby the light pattern on and off. The additional control source control unit 92 can be operatively connected to control the power supply in any way e.g. by being connected to the battery casing 91 via a wire 97b as shown. The housing 90 may preferably comprise additional not shown means for adjusting the pattern light source e.g. with respect to intensity, wavelength(s) and similar.
The surgical instrument assembly shown in
| Number | Date | Country | Kind |
|---|---|---|---|
| 14156155 | Feb 2014 | EP | regional |
| PA 2014 70716 | Nov 2014 | DK | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/DK2015/050035 | 2/20/2015 | WO | 00 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2015/124159 | 8/27/2015 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 3919541 | Chao | Nov 1975 | A |
| 4694434 | Von Ramm et al. | Sep 1987 | A |
| 4877016 | Kantor et al. | Oct 1989 | A |
| 4887222 | Miyake et al. | Dec 1989 | A |
| 5457439 | Kuhn | Oct 1995 | A |
| 5588949 | Taylor et al. | Dec 1996 | A |
| 5651783 | Reynard | Jul 1997 | A |
| 5710870 | Ohm et al. | Jan 1998 | A |
| 5725523 | Mueller | Mar 1998 | A |
| 5747953 | Philipp | May 1998 | A |
| 5754717 | Esch | May 1998 | A |
| 5769791 | Benaron et al. | Jun 1998 | A |
| 5836869 | Kudo et al. | Nov 1998 | A |
| 5888194 | Utsumi et al. | Mar 1999 | A |
| 5933223 | Flock et al. | Aug 1999 | A |
| 5951142 | Wang et al. | Sep 1999 | A |
| 5976077 | Wittens et al. | Nov 1999 | A |
| 5989181 | Dütting et al. | Nov 1999 | A |
| 6006127 | Van Der Brug et al. | Dec 1999 | A |
| 6017354 | Culp et al. | Jan 2000 | A |
| 6036636 | Motoki et al. | Mar 2000 | A |
| 6165184 | Verdura et al. | Dec 2000 | A |
| 6361530 | Mersch | Mar 2002 | B1 |
| 6387044 | Tachibana et al. | May 2002 | B1 |
| 6471638 | Chang et al. | Oct 2002 | B1 |
| 6494827 | Matsumoto et al. | Dec 2002 | B1 |
| 6522806 | James, IV et al. | Feb 2003 | B1 |
| 6527704 | Chang et al. | Mar 2003 | B1 |
| 6537290 | Adams et al. | Mar 2003 | B2 |
| 6549288 | Migdal et al. | Apr 2003 | B1 |
| 6631271 | Logan | Oct 2003 | B1 |
| 6659943 | Watanabe et al. | Dec 2003 | B2 |
| 6741883 | Gildenberg | May 2004 | B2 |
| 6791601 | Chang et al. | Sep 2004 | B1 |
| 6810184 | Skutnik | Oct 2004 | B2 |
| 6811546 | Callas et al. | Nov 2004 | B1 |
| 6908428 | Aizenfeld et al. | Jun 2005 | B2 |
| 6945981 | Donofrio et al. | Sep 2005 | B2 |
| 7037314 | Armstrong | May 2006 | B2 |
| 7049594 | Wu et al. | May 2006 | B2 |
| 7063695 | Nield et al. | Jun 2006 | B2 |
| 7113675 | Nield et al. | Sep 2006 | B2 |
| 7211044 | Mast et al. | May 2007 | B2 |
| 7422327 | Smith | Sep 2008 | B2 |
| 7464846 | Shelton, IV et al. | Dec 2008 | B2 |
| 7505808 | Anderson et al. | Mar 2009 | B2 |
| 7725214 | Diolaiti | May 2010 | B2 |
| 7775969 | Teichmann | Aug 2010 | B2 |
| 7784947 | Pérez et al. | Aug 2010 | B2 |
| 7843558 | Furman | Nov 2010 | B2 |
| 7845537 | Shelton, IV et al. | Dec 2010 | B2 |
| 7876942 | Gilboa | Jan 2011 | B2 |
| 7912532 | Schmidt et al. | Mar 2011 | B2 |
| 7927272 | Bayer et al. | Apr 2011 | B2 |
| 7976459 | Laser | Jul 2011 | B2 |
| 8064819 | Ingrassia et al. | Nov 2011 | B2 |
| 8086008 | Coste-Maniere et al. | Dec 2011 | B2 |
| 8162826 | Pecherer et al. | Apr 2012 | B2 |
| 8165351 | Bendall | Apr 2012 | B2 |
| 8182422 | Bayer et al. | May 2012 | B2 |
| 8211044 | Liebowitz | Jul 2012 | B2 |
| 8242390 | Prest et al. | Aug 2012 | B2 |
| 8242398 | Young et al. | Aug 2012 | B2 |
| 8340379 | Razzaque et al. | Dec 2012 | B2 |
| 8397335 | Gordin et al. | Mar 2013 | B2 |
| 8403843 | Bruto Da Costa | Mar 2013 | B2 |
| 8409076 | Pang et al. | Apr 2013 | B2 |
| 8443007 | Kindig et al. | May 2013 | B1 |
| 8480566 | Farr | Jul 2013 | B2 |
| 8512368 | Sato et al. | Aug 2013 | B2 |
| 8525059 | Berger et al. | Sep 2013 | B2 |
| 8527033 | Williams et al. | Sep 2013 | B1 |
| 8531511 | Katakura | Sep 2013 | B2 |
| 8554307 | Razzaque et al. | Oct 2013 | B2 |
| 8568304 | Vayser et al. | Oct 2013 | B2 |
| 8632535 | Shelton, IV et al. | Jan 2014 | B2 |
| 8657809 | Schoepp | Feb 2014 | B2 |
| 8670816 | Green et al. | Mar 2014 | B2 |
| 8672207 | Shelton, IV et al. | Mar 2014 | B2 |
| 8708211 | Zemlok et al. | Apr 2014 | B2 |
| 8721525 | Heckele et al. | May 2014 | B2 |
| 8750568 | Frank et al. | Jun 2014 | B2 |
| 8780362 | Sharonov et al. | Jul 2014 | B2 |
| 8880151 | Stolka et al. | Nov 2014 | B1 |
| 8892191 | Brennan et al. | Nov 2014 | B2 |
| 8922781 | Tearney et al. | Dec 2014 | B2 |
| 8968347 | McCollam | Mar 2015 | B2 |
| 8988505 | Schaerer et al. | Mar 2015 | B2 |
| 9008757 | Wu | Apr 2015 | B2 |
| 9179984 | Teichman et al. | Nov 2015 | B2 |
| 20010025174 | Daniel et al. | Sep 2001 | A1 |
| 20010027272 | Saito et al. | Oct 2001 | A1 |
| 20010040990 | Dadi | Nov 2001 | A1 |
| 20010055462 | Seibel | Dec 2001 | A1 |
| 20020028986 | Thompson | Mar 2002 | A1 |
| 20020049435 | Mersch | Apr 2002 | A1 |
| 20020049464 | Donofrio et al. | Apr 2002 | A1 |
| 20020087179 | Culp et al. | Jul 2002 | A1 |
| 20020123665 | Miller | Sep 2002 | A1 |
| 20020137987 | Watanabe et al. | Sep 2002 | A1 |
| 20030013960 | Makin et al. | Jan 2003 | A1 |
| 20030029464 | Chen et al. | Feb 2003 | A1 |
| 20030095781 | Williams | May 2003 | A1 |
| 20030118302 | James, IV et al. | Jun 2003 | A1 |
| 20040022527 | Carusillo et al. | Feb 2004 | A1 |
| 20040064019 | Chang et al. | Apr 2004 | A1 |
| 20040122292 | Dey et al. | Jun 2004 | A1 |
| 20040145746 | Kim et al. | Jul 2004 | A1 |
| 20040188616 | Wu et al. | Sep 2004 | A1 |
| 20050004592 | Criscuolo | Jan 2005 | A1 |
| 20050005024 | Weber et al. | Jan 2005 | A1 |
| 20050054894 | Aizenfeld et al. | Mar 2005 | A1 |
| 20050085718 | Shahidi | Apr 2005 | A1 |
| 20050131426 | Moctezuma de la Barrera et al. | Jun 2005 | A1 |
| 20050135749 | Nield et al. | Jun 2005 | A1 |
| 20060004406 | Wehrstein et al. | Jan 2006 | A1 |
| 20060036162 | Shahidi et al. | Feb 2006 | A1 |
| 20060069314 | Farr | Mar 2006 | A1 |
| 20060114473 | Tearney et al. | Jun 2006 | A1 |
| 20060171693 | Todd et al. | Aug 2006 | A1 |
| 20060235270 | Teichmann | Oct 2006 | A1 |
| 20060235279 | Hawkes et al. | Oct 2006 | A1 |
| 20060241347 | Whitehead | Oct 2006 | A1 |
| 20060258938 | Hoffman et al. | Nov 2006 | A1 |
| 20070060098 | McCoy | Mar 2007 | A1 |
| 20070112336 | Aizenfeld et al. | May 2007 | A1 |
| 20070112337 | Salman et al. | May 2007 | A1 |
| 20070147707 | Coste-Maniere et al. | Jun 2007 | A1 |
| 20070151390 | Blumenkranz et al. | Jul 2007 | A1 |
| 20070167679 | Miyamoto et al. | Jul 2007 | A1 |
| 20070175964 | Shelton, IV et al. | Aug 2007 | A1 |
| 20070179488 | Trusty et al. | Aug 2007 | A1 |
| 20070206275 | Hemmer et al. | Sep 2007 | A1 |
| 20070225550 | Gattani et al. | Sep 2007 | A1 |
| 20070250006 | Court et al. | Oct 2007 | A1 |
| 20070255101 | Bar-Or | Nov 2007 | A1 |
| 20070260121 | Bakos et al. | Nov 2007 | A1 |
| 20080009677 | Shoroji et al. | Jan 2008 | A1 |
| 20080058989 | Oleynikov et al. | Mar 2008 | A1 |
| 20080071140 | Gattani et al. | Mar 2008 | A1 |
| 20080159653 | Dunki-Jacobs et al. | Jul 2008 | A1 |
| 20080167522 | Giordano et al. | Jul 2008 | A1 |
| 20080167671 | Giordano et al. | Jul 2008 | A1 |
| 20080188716 | Heckele et al. | Aug 2008 | A1 |
| 20080208006 | Farr | Aug 2008 | A1 |
| 20080208041 | Gilboa | Aug 2008 | A1 |
| 20080319311 | Hamadeh | Dec 2008 | A1 |
| 20090017430 | Muller-Daniels et al. | Jan 2009 | A1 |
| 20090054767 | Telischak et al. | Feb 2009 | A1 |
| 20090192519 | Omori | Jul 2009 | A1 |
| 20090203991 | Papaioannou et al. | Aug 2009 | A1 |
| 20090209998 | Widmann | Aug 2009 | A1 |
| 20090218527 | French et al. | Sep 2009 | A1 |
| 20090225320 | Bendall et al. | Sep 2009 | A1 |
| 20090240111 | Kessler et al. | Sep 2009 | A1 |
| 20090244260 | Takahashi et al. | Oct 2009 | A1 |
| 20090248041 | Williams et al. | Oct 2009 | A1 |
| 20090270682 | Visser | Oct 2009 | A1 |
| 20090318756 | Fisher et al. | Dec 2009 | A1 |
| 20090318758 | Farr et al. | Dec 2009 | A1 |
| 20090318763 | Koerner et al. | Dec 2009 | A1 |
| 20090323053 | Furman | Dec 2009 | A1 |
| 20100036393 | Unsworth | Feb 2010 | A1 |
| 20100065605 | Shelton, VI et al. | Mar 2010 | A1 |
| 20100065609 | Schwemberger | Mar 2010 | A1 |
| 20100069920 | Naylor et al. | Mar 2010 | A1 |
| 20100096435 | Fuchs et al. | Apr 2010 | A1 |
| 20100106015 | Norris | Apr 2010 | A1 |
| 20100200636 | Zemlok et al. | Aug 2010 | A1 |
| 20100228092 | Ortiz et al. | Sep 2010 | A1 |
| 20100268067 | Razzaque et al. | Oct 2010 | A1 |
| 20110069159 | Soler et al. | Mar 2011 | A1 |
| 20110110114 | Papac et al. | May 2011 | A1 |
| 20110112377 | Papac et al. | May 2011 | A1 |
| 20110161054 | Woolf et al. | Jun 2011 | A1 |
| 20110165535 | Berger et al. | Jul 2011 | A1 |
| 20110208004 | Feingold et al. | Aug 2011 | A1 |
| 20110237915 | Yamaguchi | Sep 2011 | A1 |
| 20110275901 | Shelton, IV | Nov 2011 | A1 |
| 20110282160 | Bhadri et al. | Nov 2011 | A1 |
| 20120024934 | Shelton, IV et al. | Feb 2012 | A1 |
| 20120062724 | Yokota | Mar 2012 | A1 |
| 20120071711 | Shelton, IV et al. | Mar 2012 | A1 |
| 20120071757 | Salcudean et al. | Mar 2012 | A1 |
| 20120082970 | Pravong et al. | Apr 2012 | A1 |
| 20120101497 | Jayaraj | Apr 2012 | A1 |
| 20120108901 | Sargeant et al. | May 2012 | A1 |
| 20120116369 | Viola | May 2012 | A1 |
| 20120130162 | Dolt et al. | May 2012 | A1 |
| 20120143049 | Neubauer et al. | Jun 2012 | A1 |
| 20120184951 | Viola | Jul 2012 | A1 |
| 20120209123 | King | Aug 2012 | A1 |
| 20120238808 | Teichtmann | Sep 2012 | A1 |
| 20120265009 | Yang | Oct 2012 | A1 |
| 20120265010 | Uram | Oct 2012 | A1 |
| 20120265071 | Berke | Oct 2012 | A1 |
| 20120296163 | Stopek | Nov 2012 | A1 |
| 20120302828 | Toledo-Crow et al. | Nov 2012 | A1 |
| 20130038836 | Smith | Feb 2013 | A1 |
| 20130053782 | Shelton, IV | Feb 2013 | A1 |
| 20130053835 | Bacher et al. | Feb 2013 | A1 |
| 20130060084 | Fouts et al. | Mar 2013 | A1 |
| 20130070070 | Katakura | Mar 2013 | A1 |
| 20130103023 | Monson et al. | Apr 2013 | A1 |
| 20130110005 | Sharonov | May 2013 | A1 |
| 20130110006 | Sharonov et al. | May 2013 | A1 |
| 20130110129 | Reid et al. | May 2013 | A1 |
| 20130123800 | Leroy et al. | May 2013 | A1 |
| 20130144267 | Chan et al. | Jun 2013 | A1 |
| 20130190759 | Waaler et al. | Jul 2013 | A1 |
| 20130197317 | Daniel | Aug 2013 | A1 |
| 20130218024 | Boctor et al. | Aug 2013 | A1 |
| 20130226037 | Pinto et al. | Aug 2013 | A1 |
| 20130226156 | Sharonov | Aug 2013 | A1 |
| 20130267787 | Warnock | Oct 2013 | A1 |
| 20130267975 | Timm et al. | Oct 2013 | A1 |
| 20130281845 | Luiken | Oct 2013 | A1 |
| 20130296712 | Durvasula | Nov 2013 | A1 |
| 20130317351 | Case et al. | Nov 2013 | A1 |
| 20130317352 | Case et al. | Nov 2013 | A1 |
| 20130317353 | Frank et al. | Nov 2013 | A1 |
| 20130324999 | Price et al. | Dec 2013 | A1 |
| 20130345513 | Tsuruta | Dec 2013 | A1 |
| 20140005484 | Charles | Jan 2014 | A1 |
| 20140005682 | Worrell et al. | Jan 2014 | A1 |
| 20140012078 | Coussa | Jan 2014 | A1 |
| 20140012286 | Lee et al. | Jan 2014 | A1 |
| 20140025067 | Kerr et al. | Jan 2014 | A1 |
| 20140030669 | Hey et al. | Jan 2014 | A1 |
| 20140031665 | Pinto et al. | Jan 2014 | A1 |
| 20140051994 | Graumann et al. | Feb 2014 | A1 |
| 20140052005 | Yokota | Feb 2014 | A1 |
| 20140066784 | Yokota | Mar 2014 | A1 |
| 20140071239 | Yokota | Mar 2014 | A1 |
| 20140071257 | Yokota | Mar 2014 | A1 |
| 20140074116 | Collins | Mar 2014 | A1 |
| 20140088410 | Wu | Mar 2014 | A1 |
| 20140106626 | Frushour et al. | Apr 2014 | A1 |
| 20140107417 | McKinley et al. | Apr 2014 | A1 |
| 20140107471 | Haider et al. | Apr 2014 | A1 |
| 20140107685 | O'Neill et al. | Apr 2014 | A1 |
| 20140114327 | Boudreaux et al. | Apr 2014 | A1 |
| 20140121507 | Nau, Jr. | May 2014 | A1 |
| 20140121508 | Latimer et al. | May 2014 | A1 |
| 20140148799 | Mueller | May 2014 | A1 |
| 20140163359 | Sholev et al. | Jun 2014 | A1 |
| 20140171962 | Kang | Jun 2014 | A1 |
| 20140180001 | von Grünberg et al. | Jun 2014 | A1 |
| 20140194896 | Frimer et al. | Jul 2014 | A1 |
| 20140200406 | Bennett et al. | Jul 2014 | A1 |
| 20140200561 | Ingmanson et al. | Jul 2014 | A1 |
| 20140204702 | Ratering | Jul 2014 | A1 |
| 20140207002 | Seow | Jul 2014 | A1 |
| 20140235946 | Smith | Aug 2014 | A1 |
| 20140236177 | Verner | Aug 2014 | A1 |
| 20140243658 | Breisacher et al. | Aug 2014 | A1 |
| 20140275764 | Shen et al. | Sep 2014 | A1 |
| 20140275771 | Henley et al. | Sep 2014 | A1 |
| 20140276097 | Sharonov | Sep 2014 | A1 |
| 20140296636 | Hatano | Oct 2014 | A1 |
| 20140303491 | Shekhar et al. | Oct 2014 | A1 |
| 20140357945 | Duckworth | Dec 2014 | A1 |
| 20140367444 | Williams | Dec 2014 | A1 |
| 20140367591 | Mahou et al. | Dec 2014 | A1 |
| 20150005748 | Sniffin et al. | Jan 2015 | A1 |
| 20150018622 | Tesar et al. | Jan 2015 | A1 |
| 20150049907 | Hong et al. | Feb 2015 | A1 |
| 20150065875 | Friebe | Mar 2015 | A1 |
| 20150069108 | Williams | Mar 2015 | A1 |
| 20150073398 | Toledo-Crow et al. | Mar 2015 | A1 |
| 20150076211 | Irka et al. | Mar 2015 | A1 |
| 20150080660 | Gomez et al. | Mar 2015 | A1 |
| 20150080764 | Poe | Mar 2015 | A1 |
| 20150086162 | Miyahara et al. | Mar 2015 | A1 |
| 20150088115 | Smith | Mar 2015 | A1 |
| 20150109427 | Wood et al. | Apr 2015 | A1 |
| 20150119637 | Alvarez et al. | Apr 2015 | A1 |
| 20150133960 | Lohmeier et al. | May 2015 | A1 |
| 20150173591 | Zheng et al. | Jun 2015 | A1 |
| 20150230866 | Tung | Aug 2015 | A1 |
| 20150238276 | Atarot et al. | Aug 2015 | A1 |
| 20150265792 | Goudra et al. | Sep 2015 | A1 |
| 20150359418 | Feussner et al. | Dec 2015 | A1 |
| 20160081712 | Heniford et al. | Mar 2016 | A1 |
| 20160166345 | Kumar et al. | Jun 2016 | A1 |
| 20160278611 | Power | Sep 2016 | A1 |
| 20160360954 | Rohling et al. | Dec 2016 | A1 |
| 20170095269 | Reid et al. | Apr 2017 | A1 |
| 20170105802 | Taraschi et al. | Apr 2017 | A1 |
| 20170172382 | Nir et al. | Jun 2017 | A1 |
| 20170238962 | Hansen et al. | Aug 2017 | A1 |
| 20170251900 | Hansen et al. | Sep 2017 | A1 |
| 20180014851 | Hansen et al. | Jan 2018 | A1 |
| 20180042686 | Peine | Feb 2018 | A1 |
| 20180325604 | Atarot et al. | Nov 2018 | A1 |
| Number | Date | Country |
|---|---|---|
| 2603353 | Sep 2007 | CA |
| 2533818 | Feb 2003 | CN |
| 2691487 | Apr 2005 | CN |
| 1729938 | Feb 2006 | CN |
| 101305901 | Nov 2008 | CN |
| 201316257 | Sep 2009 | CN |
| 201393995 | Feb 2010 | CN |
| 201393999 | Feb 2010 | CN |
| 201602746 | Oct 2010 | CN |
| 101991399 | Mar 2011 | CN |
| 201861616 | Jun 2011 | CN |
| 102401646 | Apr 2012 | CN |
| 102626301 | Aug 2012 | CN |
| 103299355 | Sep 2013 | CN |
| 203379100 | Jan 2014 | CN |
| 203852327 | Oct 2014 | CN |
| 200 02 770 | Nov 2000 | DE |
| 10 2004 008 488 | Sep 2004 | DE |
| 10 2005 045 706 | Apr 2007 | DE |
| 10 2007 007 742 | Aug 2008 | DE |
| 10 2008 056 830 | May 2010 | DE |
| 20 2011 103 007 | Jan 2012 | DE |
| 10 2012 209 448 | Dec 2013 | DE |
| 10 2012 209 450 | Dec 2013 | DE |
| 2412290 | Feb 2012 | EP |
| 1 961 372 | Mar 2012 | EP |
| 2554103 | Feb 2013 | EP |
| 2 630 915 | Aug 2013 | EP |
| 2 551 698 | Sep 2014 | EP |
| 3056934 | Aug 2016 | EP |
| 2000-131623 | May 2000 | JP |
| 2001-025469 | Jan 2001 | JP |
| 2003-061970 | Mar 2003 | JP |
| 2006-271600 | Oct 2006 | JP |
| 2015-073663 | Apr 2015 | JP |
| WO 9510218 | Apr 1995 | WO |
| 0042906 | Jul 2000 | WO |
| WO 0152720 | Jul 2001 | WO |
| 02080773 | Oct 2002 | WO |
| WO 2005122940 | Dec 2005 | WO |
| WO 2009116969 | Sep 2009 | WO |
| WO 2009134634 | Nov 2009 | WO |
| WO 2012072112 | Jun 2012 | WO |
| WO 2012083247 | Jun 2012 | WO |
| WO 2013002050 | Jan 2013 | WO |
| WO 2013096896 | Jun 2013 | WO |
| WO 2013163391 | Oct 2013 | WO |
| 2014140813 | Sep 2014 | WO |
| WO 2014174726 | Oct 2014 | WO |
| WO 2014198675 | Dec 2014 | WO |
| 2015133958 | Sep 2015 | WO |
| 2015135055 | Sep 2015 | WO |
| 2015149041 | Oct 2015 | WO |
| 2016018815 | Feb 2016 | WO |
| WO 2016019424 | Feb 2016 | WO |
| 2016057989 | Apr 2016 | WO |
| Entry |
|---|
| Albitar, C. et al. (2007) “Robust Structured Light Coding for 3D Reconstruction” Proceedings of the 2007 IEEE 11th International Conference on Computer Vision (ICCV 2007), Oct. 14-21, 2007, Rio de Janeiro, Brazil; pp. 1-6, DOI: 10.1109/ICCV.2007.4408982. |
| Krupa, A. et al. (2002) “Autonomous retrieval and positioning of surgical instruments in robotized laparoscopic surgery using visual servoing and laser pointers” Proceedings of the 2002 IEEE International Conference on Robotics and Automation, May 11-15, 2002, Washington, DC; vol. 4, pp. 3769-3774. |
| Reiter, A. et al. (2014) “Surgical Structured Light for 3D Minimally Invasive Surgical Imaging” Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014); pp. 1282-1287. |
| Zhang, K. et al. (Sep. 2009) “A Surface Topology and Motion Compensation System for Microsurgery Guidance and Intervention based on Common-Path Optical Coherence Tomography” IEEE Trans Biomed Eng, 56(9):2318-2321. NIH Public Access Author Manuscript; available in PMC Sep. 1, 2010 (12 pages). |
| European Patent Application No. 16781653.7, by 3DIntegrated ApS: Supplementary European Search Report, dated May 22, 2017 (4 pages). |
| Ackerman, J.D. et al. (2002) “Surface reconstruction of abdominal organs using laparoscopic structured light for augmented reality” Proceedings of SPIE, 4661:39-46. |
| Bauer, S. et al. (2013) “Real-Time Range Imaging in Health Care: A Survey” in Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications. Dagstuhl Seminar 2012 and GCPR Workshop on Imaging New Modalities. M. Grzegorzek et al. (Eds.) Springer Berlin Heidelberg. Lecture Notes in Computer Science, vol. 8200; pp. 188-212. |
| Clancy, N.T. et al. (2011) “Spectrally encoded fiber-based structured lighting probe for intraoperative 3D imaging” Biomedical Optics Express, 2(11):3119-3128. |
| Edgcumbe, P. et al. (2014) “Pico Lantern: A Pick-up Projector for Augmented Reality in Laparoscopic Surgery” Medical Image Computing and Computer-Assisted Intervention (MICCAI) 17th International Conference, Boston, MA, USA, Sep. 14-18, 2014, Proceedings. P. Golland et al. (Eds.): MICCAI 2014, Part 1, LNCS 8673, pp. 432-439. |
| Geng, J. (2011) “Structured-light 3D surface imaging: a tutorial” Advances in Optics and Photonics, 3:128-160. |
| Maier-Hein, L. et al. (2013) “Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery” [online]. Author deposited preprint: Retrieved from Sheffield Hallam University Research Archive (SHURA) at: http://shura.shu.ac.uk/7180/; deposited on Aug. 2, 2013, 58 pages including cover. Final publication in: Medical Image Analysis, 17(8):974-996. |
| Maier-Hein, L. et al. (2014) “Comparative Validation of Single-shot Optical Techniques for Laparoscopic 3D Surface Reconstruction” Accepted article, IEEE Transactions on Medical Imaging, doi: 10.1109/TMI.2014.2325607, 18 pages. Final publication in vol. 33, Issue 10, pp. 1913-1930, Oct. 2014. |
| Maurice, X. et al. (2013) “Real-time structured light coding for adaptive patterns” J. Real-Time Image Proc, 8:169-178. |
| Schmalz, C. et al. (2012) “An endoscopic 3D scanner based on structured light” Medical Image Analysis, 16:1063-1072. |
| European Patent Application No. 17169285.8 by 3dintegrated ApS: Extended European Search Report and European Search Opinion, dated Aug. 31, 2017 (7 pages). |
| Office Action dated Feb. 2, 2019, from the China National Intellectual Property Administration in corresponding Chinese Patent Application No. 201580009012.3. |
| “Supplementary European Search Report issued in European Patent Application No. 16853132.5”, dated Oct. 27, 2017, 4 pages. |
| Choi et al. (May 5, 2015) “An effective visualization technique for depth perception in augmented reality-based surgical navigation”, International Journal of Medical Robotics and Computer Assisted Surgery, 12(1): 11 pages. |
| Hao (Dec. 2011) “Wide Baseline Stereo Image Rectification and Matching”, Dissertation. The University of Tennessee, 174 pages. |
| Kang (May 2002) “Robotic Assisted Suturing in Minimally Invasive Surgery”, Thesis. Rensselaer Polytechnic Institute, 183 pages. |
| Karjee et al. (Jul. 3-4, 2014) “Spatial Data Estimation in Three Dimensional Distributed Wireless Sensor Networks”, International Conference on Embedded Systems, 139-144. |
| Louw et al. (2005) “An approximate EM Homographical Iterative Closest Point algorithm”, PRASA2005, Langebaan, 89-92. |
| Nicolau et al. (Sep. 2011) “Augmented reality in laparoscopic surgical oncology”, Surgical Oncology, 20(3):189-201. |
| “International Search Report and Written Opinion received for PCT/DK2016/050180”, dated Apr. 11, 2016 (18 pages). |
| Pellicano et al. (Dec. 4-8, 2016) “Robust Wide Baseline Pose Estimation from Video (Supplementary Material)”, Proceedings of the International Conference on Pattern Recognition (ICPR) (2 pages). |
| Pritchett et al. (Jan. 4-7, 1998) “Wide Baseline Stereo Matching”, Proceedings of the Sixth International Conference on Computer Vision, 754-760. |
| Salvi et al. (Apr. 2004) “Pattern codification strategies in structure light systems”, Pattern Recognition, 37(4):827-849. |
| Extended European Search Report received for European Patent Application No. 17884041.9, dated Aug. 12, 2020, 11 pages. |
| Pennington et al. (Jul. 2001) “Miniaturized 3-D Surface Profilometer using a Fiber Optic Coupler”, Optics & Laser Technology, 33(5):313-320. |
| Schick et al. (May 26, 2011) “3D Measuring in the Field of Endoscopy”, Proceedings of SPIE, 8082:808216-1-808216-12. |
| Su et al. (Aug. 26, 2015) “Three-dimensional Shape Measurements using Endoscopes”, Proceedings of SPIE, 9586:95861H-1-95861H-6. |
| U.S. Appl. No. 15/589,476, filed May 8, 2017, Cannula Assembly Kit. |
| U.S. Appl. No. 15/717,088, filed Sep. 27, 2017, Minimally Invasive Surgery System. |
| U.S. Appl. No. 15/601,276, filed May 22, 2017, Depiction System. |
| Number | Date | Country | |
|---|---|---|---|
| 20170055819 A1 | Mar 2017 | US |
