This invention pertains in general to the field of orthopedics, such as hip, knee, spine, shoulder, trauma or extremity orthopedic procedures. More particularly, the invention relates to a computer implemented method and apparatus for planning an orthopedic procedure. The method comprises retrieving medical imaging data that comprises a portion of a first bone and a portion of a second bone. In the retrieved medical imaging data, the portion of the first bone and the portion of the second bone are unsegmented, i.a. the portion of the first bone and the portion of the second bone are not labeled in the medical imaging data such that the may be identified separately. The portion of the first bone and the portion of the second bone are segmented such that the portion of the first bone is moveable relative the portion of the second bone portion. A plurality of landmarks including at least a first landmark at the portion of the first bone and at least a second landmark at the portion of the second bone may be identified. This may be done before or after the segmentation, or even without performing the segmentation. At least one of a first implant component and a second implant component may be selected from among a plurality of implant components in a database based on information obtained from the first landmark and the second landmark. The first implant component and/or the second implant component may be fitted in a space at least partially defined by the first landmark and the second landmark.
Orthopedic procedures, such as such as hip, knee, spine, shoulder, trauma or extremity orthopedic procedures are may be digitally planned using digital medical imaging data. For example, the type, size, and position of implant components relative to medical imaging data can be planned pre-operatively, i.e. before the patient enters the operating room, or intra-operatively, i.e. when the patient has entered the operating room. Planning the type, size, and position of implant components relative to medical imaging data is also referred to as templating. Traditionally, this was performed using 2D imaging data, but more modern approaches uses 3D imaging data for planning of orthopedic procedures.
The medical imaging data may come from various sources, such as X-ray, fluoroscopy, CT (Computer Tomography), CBCT (Cone Beam Computer Tomography), Ultrasound, and MRI (Magnetic Resonance Imaging).
A challenge with planning of orthopedic implant procedures is that the relative position of various bones of the patient when scanning the patient to generate the medical imaging data may not correspond to the relative positions the bones will have during the operation or the relative positions the bones will have after the operation when the implants have been placed. For example, a hip surgery, such as THA (Total Hip Arthoplasty), involving restoration of the patient's biomechanics may include lengthening/shortening of the leg, adjusting various offsets, etc. For example, it may be desired to move the femur relative to the pelvis of the patient in order to obtain better biomechanics. This can be done by selecting implant components with appropriate types and sizes to achieve the desired biomechanics. However, selecting the correct implant components to achieve the desired outcome of the procedure is difficult since the femur and the pelvis have a fixed positional relationship in the medical imaging data when unsegmented and does not represent the desired relative position to obtain the desired biomechanics. This is even more difficult when multiple components are selected, that will not have the same interrelationship on screen when planning is performed as after surgery in view of the unsegmented character of the imaging data. Similar challenges apply e.g. for a TKA (Total Knee Arthroplasty) or PKA (Partial Knee Arthroplasty) procedures, shoulder procedures, etc., where relative bone positions are modified as a part of the orthopedic procedure.
In some types of procedures, the position of the patient in the medical imaging scanner, where the medical imaging data is captured, may not correspond to the position of the patient on the operating table. This is e.g. the case for spine surgery, where the medical imaging data is captured in a CT or MRI scanner pre-operatively with the patient in supine position, whereas during surgery the patient is in lateral or prone position. The vertebras of the spine inevitably have different interrelationships in the various positions. For example, for pedicle screw fixation the relative position of the vertebras at which they should be fixed is obtained when the patient is lying on the operating table. A 2D or 3D C-arm may be used during surgery, e.g. to identify the entry level of the spine, and/or to match the pre-operative image data to the intra-operative image data to use pre-operatively planning data for navigation or robotic surgery. However, since the vertebras have different interrelationships in the two sets of data, such matching may be challenging or impossible. This may have the consequence that it is not possible to plan pre-operatively, or the sub-optimal implants or implant positions are planned.
In summary, the interrelationships of bones in the medical imaging data may not be optimal for performing the planning and/or surgery and may introduce inaccuracies in the planning or surgery or even lead to selecting sub-optimal implants. In worst case, implants are placed in sub-optimal positions, which may even be unsafe for the patient.
Hence, an improved method for planning an orthopedic procedure would be advantageous and in particular improved precision, increased flexibility, cost-effectiveness, and/or patient safety would be advantageous.
Accordingly, embodiments of the present invention preferably seek to mitigate, alleviate or eliminate one or more deficiencies, disadvantages or issues in the art, such as the above-identified, singly or in any combination by providing a method, an apparatus, and computer program product for planning an orthopedic procedure. Embodiments of the invention are defined by the following detailed description and the appended patent claims.
Some embodiments comprise a computer implemented method for planning an orthopedic procedure. The method comprises retrieving medical imaging data comprising a portion of a first bone and a portion of a second bone, wherein the portion of the first bone and the portion of the second bone are unsegmented. A plurality of landmarks including at least a first landmark at the portion of the first bone and at least a second landmark at the portion of the second bone are identified.
The portion of the first bone and the portion of the second bone may be segmented, such that the portion of the first bone is moveable relative the portion of the second bone.
A first implant component and a second implant component may be selected from among a plurality of implant components in a database based on information obtained from the first landmark and/or the second landmark.
At least one of the first implant component and the second implant component may be fitted in a space at least partially defined by the first landmark and the second landmark.
In some embodiments, the method comprises moving the portion of the first bone relative to the portion of the second bone based on at least one landmark of the plurality of landmarks after segmenting the portion of the first bone and the portion of the second bone. Alternatively or additionally, the method comprises comprising moving the portion of the first bone relative to the portion of the second bone based on a contour of the segmented portion of the first bone and/or a contour of the segmented portion of the second bone.
In some embodiments, the portion of the first bone is moved relative to the portion of the second bone to obtain a desired position of the first landmark relative to a position of the second landmark before selecting a first implant component and/or a second implant component.
The information obtained from the first landmark and/or the second landmark may be obtained after segmenting the portion of the first bone and the portion of the second bone and after the portion of the first bone is moved relative to the portion of the second bone.
The first landmark and the second landmark may be landmarks of the portion of the first bone or the portion of the second bone. Alternatively, the first landmark is a landmark of the portion of the first bone and the second landmark is a landmark of the portion of the second bone.
Embodiments of the method may comprise identifying a third landmark of at least one of the portion of the first bone and the portion of the second bone, and obtaining the information based of the first landmark, the second landmark, and the third landmark.
Obtaining the information from the first landmark and the second landmark may comprise obtaining at least one dimension, which includes at least one of diameter, length, width, and angle.
Embodiments may comprise storing each implant component in the database together with implant information, which optionally may include at least one of diameter, length, width, and angle.
Selecting at least one of the first implant component and the second implant component may comprise selecting an implant component having implant information with a best fit to the information obtained from the first landmark and the second landmark.
Embodiments comprise a computer readable storage medium, which has program instructions stored therein, wherein the program instructions, when executed by a processor, perform the method of the embodiments described herein.
Embodiments comprise an apparatus for planning an orthopedic procedure. The apparatus is configured to access a memory to retrieve medical imaging data comprising a portion of a first bone and a portion of a second bone, wherein the portion of the first bone and the portion of the second bone are unsegmented, using a processing unit to identify a plurality of landmarks including at least a first landmark at the portion of the first bone and at least a second landmark at the portion of the second bone, using the processing unit to segment the portion of the first bone and the portion of the second bone, such that the the portion of the first bone is moveable relative the portion of the second bone portion, using the processing unit to select at least one of a first implant component and a second implant component from among a plurality of implant components in a database based on information obtained from the first landmark and the second landmark, and using the processing unit to fit at least one of the first implant component and the second implant component in a space at least partially defined by the first landmark and the second landmark.
The processing unit may be configured to move the portion of the first bone relative to the portion of the second bone based on at least one landmark of the plurality of landmarks after segmenting the portion of the first bone and the portion of the second bone, and/or based on a contour of the segmented portion of the first bone and/or a contour of the portion of the second bone.
The processing unit may be configured to move the portion of the first bone relative to the portion of the second bone to obtain a desired position of the first landmark relative to a position of the second landmark before selecting a first implant component and/or a second implant component.
The processing unit may be configured to obtain the information from the first landmark and the second landmark after segmenting the portion of the first bone and the portion of the second bone and after the portion of the first bone is moved relative to the portion of the second bone.
Further embodiments of the invention are defined in the dependent claims.
Some embodiments of the invention provide for efficient and accurate planning of an orthopedic procedure. Since portions of bones are segmented, it makes it possible to move bone portions relative to each other, such that the actual position of the bone portions may be moved to a desired relative to positions to simulate a desired outcome of a treatment. After this has been done, implant components may be selected. This optimizes selection of implant components to fit a desired outcome of a surgery, even before the surgery commences. Furthermore, segmented bone portions may be rendered in different colors, which may also facilitate planning the procedure. Also, landmarks on the bone portions may be identified. The landmarks may be used to select implant components. Furthermore, the landmarks may be used to move portions of bone relative to each other in order to plan the treatment. For example, the landmarks can be used to plan for biomechanical symmetry or biomechanical restoration by moving bone portions. This is possible due to combination with segmentation of the bone portions. Hence, identification of landmarks also contributes to efficient and accurate planning of an orthopedic procedure.
It should be emphasized that the term “comprises/comprising” when used in this specification is taken to specify the presence of stated features, integers, steps or components but does not preclude the presence or addition of one or more other features, integers, steps, components or groups thereof.
These and other aspects, features and advantages of which embodiments of the invention are capable of will be apparent and elucidated from the following description of embodiments of the present invention, reference being made to the accompanying drawings, in which
Specific embodiments of the invention will now be described with reference to the accompanying drawings. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. The terminology used in the detailed description of the embodiments illustrated in the accompanying drawings is not intended to be limiting of the invention. In the drawings, like numbers refer to like elements.
The following description focuses on embodiments of the present invention applicable for planning an orthopedic procedure exemplified by a planning of a THA (Total Hip Arthroplasty). However, it will be appreciated that the invention is not limited to this application but may be applied to many other procedures, such as including knee, spine, shoulder, extremities, and trauma orthopedic procedures, particularly wherein orthopedic implants are used.
According to the method illustrated in
Identifying 2 landmarks 100-121 may be performed manually by a user providing input to a computer by selecting portions or areas on the medical imaging data when presented on a screen. Alternatively or additionally, the landmarks 100-121 may be identified by an analytical model, which may be computer implemented. Such analytical model may be set up using a machine learning model that has been trained via an iterative learning process. For example, the analytical model may be set up using a neural network that can cluster and recognize patterns in the imaging data. In a learning process, the landmarks 100-121 are defined, and then a user defines, via user interaction, where the landmarks are located within the imaging data. Gradually, the analytical model may continuously learn and improve in order to more precisely identify the landmarks 100-121 in the medical imaging data. Once fully trained, the analytical model may recognize the landmarks 100-121 at great precision without human interaction. Yet, human confirmation or enhancement of accuracy may be desired as will be further discussed below.
The imaging data may comprise at least one of X-ray, fluoroscopy, CT (Computer Tomography), CBCT (Cone Beam Computer Tomography), Ultrasound, and MRI (Magnetic Resonance Imaging) and be generated by a medical imaging device. When generated, the medical imaging data is unclassified or unlabeled, such that one bone of the patient cannot be distinguished from another bone of the patient. Therefore, one bone of the patient cannot be moved relative to the other without further processing. The process of distinguishing one bone from the other is generally referred to as segmentation.
The method may comprise segmenting 3 the medical imaging data. Segmenting 3 the imaging data may be performed before or after identifying 2 the landmarks 100-121. In some embodiments, segmentation may even be performed independently from the identification of landmarks 100-121. According to embodiments, segmenting 3 the medical imaging data may comprise dividing that medical imaging data into at least two data sets. This may be used for moving a portion of the first bone relative to relative said portion of the second bone portion, as will be further illustrated in embodiments described below. Segmentation may be performed manually by a user. Alternatively or additionally an analytical model, e.g. using machine learning similar to the model for identifying landmarks may be implemented. A combination approach may also be used, where the analytical model first prepares a suggested segmentation, which may be corrected by the user by tagging certain medical imaging data as belonging to a particular portion of bone. At the most detailed level, each voxel in a set of medical imaging data can be tagged as belonging to a particular bone.
According to embodiments, the method may also comprise selecting 4 at least one implant component 201, 202 (
After an appropriate implant component or implant components 201, 202 have been selected 4, the implant component(s), such as the first implant component 201 and the second implant component 202, may be fitted 5 in a space at least partially defined by the landmark(s), as will be further exemplified with regard to embodiments described below. Hence, at least one landmark that was used for selecting 4 may also be used for fitting 5 the implant component 201, 202 in the space defined by the landmark(s).
Computer software in which the present invention is implemented when run by the CPU 11 may comprise a CAD system, wherein the medical imaging data can be rendered, such as a 3D model of the surgical object or the 3D volume of scan data, and/or multiple 2D views of scan data, such as MRI or CT data, generated from a 3D volume of medical imaging data. A 2D/3D model of the implant component(s) and 2D views of medical imaging data may also be rendered at the same time and be partially overlaid in order to increase the information.
As discussed above, embodiments of the present invention may comprise identifying 2 a plurality of landmarks 100-121, such as anatomical landmarks of a bone portion of the medical imaging data.
The landmarks 100-121 may be indicated in the medical imaging data in the view on a screen using an indicator, which may have a pre-defined shape. The shape may e.g. be a circle, a cross, a line, etc. The indicator may have a fixed size, such as a cross or a point, e.g. in order to indicate a landmark defined by a specific point on the portion of bone. Such a point may e.g. be a center of rotation or a specific point at a surface of the portion of bone. Landmarks 107-121 are such indicators having a fixed size. When the user click on one of the indicators in the shape of a circle, a cross appears in the center of the circle in order to facilitate positioning the indicator with great accuracy. Hence, the indicators may have multiple shapes. Alternatively, the size of the indicator may be adjustable, such as exemplified by the indicators identifying landmarks 101-106. For example, the indicators identifying the femur heads 101-102 may comprise a circle that is adjustable in diameter. The contour of the circle can be used to identify the contour of the femur head. At the same time, a cross at the center of the circle can identify the center of rotation of the femur head. Hence, one indicator may identify multiple landmarks of a single portion of bone. Other examples of indicators that can have adjustable sizes are the indicators for the femoral shafts 103-106. These landmarks may comprise a dimension as well as a position. In the illustrated examples, the proximal femur shaft is a landmark at the lesser trochanter and at which a diameter of the femur shaft can be indicated. The center of the indicator identifies the position within the femur shaft, whereas the diameter of the indicator identifies the diameter of the femur shaft at the particular positon. Similarly, the distal femur shaft 105, 106 can be indicated, wherein the position is defined at a predefined position from the proximal femur shaft landmark 103, 104. The dimeter of the circles can be set based on a particular value of the medical imaging data. Such a value of the medical imaging data may comprise a grey value, e.g. identifying cortical bone or the border between harder and softer bone. Hence, a landmark may be identified based on a particular shape condition of the portion of the bone. Additionally or alternatively, the landmark may be identified based on a condition, status or quality of the bone, such as relatively softer and relatively denser bone.
Adjusting the positon of the indicator for the landmark may be performed by user interaction/input. The analytical model may be used to propose a position of the landmark 100-121. A user may provide input to adjust the positon of an indicator of the landmark, e.g. by using an input device such as a mouse or a keyboard to move the indicator relative to the portion of bone on the screen. This is e.g. illustrated in
As discussed above, bone portions may be segmented and sub-volumes generated. Each sub-volume may comprise one or several portions of bone. After segmentation, the bone portions may be stored as separate entities or separate sub-volumes. Sub-volumes may be manipulated separately. For example, on sub-volume may be moved individually relative to another sub-volume. Furthermore, one sub-volume may be rendered in a different color compared to another sub-volume. This makes it easier to distinguish between bone portions and verify the accuracy of the segmentation. On situation where it may be difficult to verify accuracy is for total hip arthroplasty due to arthritis. In such situations it is common that the kaput (femur head) lies directly against the acetabulum. This makes it difficult for the user to determine if the segmentation has been successful. Rendering the bone portions (the femur and the pelvis in this example), after segmentation, in different colors makes this determination easier.
Moving one or several portions of bone relative one or several other portions of bone may be useful for planning restoration of biomechanics, i.e. the desired outcome of the procedure, before implant components 201, 202 are selected and the positon of the components planned. Hence, the desired positions of the anatomy after surgery can be planned before the surgery actually commences. This follows more closely what happens in surgery, where bone portions are first positioned at a desired location, and then implant components 201, 202 are inserted to match that desired location. In
Alternatively or additionally, rather than moving a portion of the first bone relative to a portion of the second bone (or multiple portions) based on the landmarks, the bone portions may be moved using a contour of the segmented portion of the first bone and/or a contour of the segmented portion of the second bone. For example, this may be useful for 3D-2D matching procedures, wherein a first set of medical imaging data of the patient is generated with a first medical imaging device, such as a CT or MR scanner, and one or several sets of medical imaging data of the patient is/are generated with a second medical imaging device, such as a fluoroscopy or x-ray scanner. The first set of medical imaging data, preferably in 3D, can be generated before surgery, and the second set(s) of medical imaging data, in 3D or 2D, can be generated during surgery. In some situations, the position of the patient in a medical imaging device for generating 3D medical imaging data before surgery is not the same as the position of the patient on the operating table. One such example is for spine surgery. 3D medical imaging data can be generated before surgery in a 3D medical imaging device, such as a CT or MR scanner, with the patient lying in supine position. However, in surgery, the patient may be lying in prone or lateral position. The positions of the vertebras relative to each other when the patient is lying in the supine position are not the same as when the patient is lying in prone or lateral position. Hence, the position of the bone portions in the 3D medical imaging data generated before surgery do not fully match the positions of the bone portions in the 2D/3D medical imaging data generated during surgery.
According to the present invention, it is still possible to plan the surgery before surgery. Alternatively or additionally, the surgery can be planned intra-operatively. If planed before surgery, the position of the implant component(s) is/are planned relative the 3D medical imaging data generated before surgery. The position of the bone portions in the 3D medical imaging data can be matched to positon of the bone portions in the 2D/3D medical imaging data generated intra-operatively. Hence, the bone portions in 3D medical imaging data generated before surgery can be moved. This may be based on the contour of the bone portions, which appears in the 3D medical imaging data generated pre-operatively as well as the 2D/3D medical imaging data generated intra-operatively. If necessary, the positions of the implant component(s) 201, 202, planned relative to the 3D medical imaging data generated pre-operatively can follow the movement and/or can be adjusted if necessary. For example, for a spine surgery pedicle screws can be planed relative to multiple portions of bone (vertebras). If a screw is only placed in a single vertebra, the screw can follow the movement. However, rods to be placed between the pedicle screws for fixating the vertebras relative to each other can be planned intra-operatively. Alternatively or additionally, the rods can be pre-operatively, and then be adjusted intra-operatively based on any movement of the bone portions.
Other embodiments when bone portions are moved are e.g. for knee surgery, wherein the tibia is moved relative to the femur before appropriate implant components and their relative positions in the tibia and/or femur are determined. Landmarks for knee implant surgery correspond to a large extent to landmarks for a hip implant surgery. Additional landmarks may e.g. comprise the canal of the tibia canal. For lumbar spine surgery, the entry point of the pedicle screw may be defined as the confluence of any of the four lines: pars interarticularis, the mamillary process, the lateral border of the superior articular facet, and/or the mid transverse process. Landmarks can be identified to define these lines. For thoracic spine surgery, the entry point of the pedicle screw for the distal thoracic segments may be defined after determining the intersection of the mid portion of the facet joint and the superior edge of the transverse process. The specific entry point can be just lateral and caudal to this intersection. The entry point tends to be more cephalad at more proximal thoracic levels. Landmarks may include the lateral border of the superior facet, the lateral border of the inferior facet, and/or the ridge of the pars interarticularis and the transverse process. These and other landmarks landmarks can be used to select an optimal implant component, such as pedicle screw with optimal length diameter, thread type, and/or thread pitch.
Hence, according to embodiments the portion of the first bone can be moved relative to the portion of the second bone. This can be done in order to obtain a desired position of a first landmark, or a first set of landmarks, relative to a position of a second landmark, or a second set of landmarks. Furthermore, segmentation of the portion of the first bone and the portion of the second bone may be done before selecting at least one of a first implant component from among a plurality of implant components. This facilitates selecting an implant component that is most optimal to achieve the desired outcome of the surgery as defined by moving the portions of bone to desired relative positions.
In some embodiments, such as in the embodiments described above, the information obtained from the first landmark and said second landmark may be obtained after segmenting the portion of the first bone and the portion of the second bone and after the portion of the first bone is moved relative to the portion of the second bone. For example, the information obtained from the first landmark and the second landmark may comprise obtaining at least one dimension, which includes at least one of diameter, length, width, and angle. As one exemplary embodiment and as illustrated in
As is elucidated with the embodiments described above, at least one implant component 201, 202 can be selected from among a plurality of implant components in a database based on information obtained from a first landmark and a second landmark 100-121. Also, further implant components 201, 202, such as a second implant component, can be selected based on the information obtained from the first landmark and the second landmark. The landmarks used for said selecting can be landmarks of the portion of first bone or the portion of second bone. Additionally or alternatively, the first landmark is a landmark of the portion of first bone and the second landmark is a landmark of the portion of second bone. Furthermore, a third landmark of at least one of the portion of the portion of the first bone and the portion of the second bone and be identified, and information based of said first landmark, said second landmark, and said third landmark can be obtained, as has been described in the embodiments illustrated in
In some embodiments, each implant component that is available for planning can be stored in the database 16 together with implant information. Implant information may comprise at least one of size, diameter, length, width, angle, type of material, surface treatment, etc.
According to embodiments, such as in the embodiments described above, selecting at least one of the first implant component and the second implant component may comprises selecting an implant component having implant information with a best fit to the information obtained from the first landmark and said second landmark. Thus, diameter, length, width etc. can be obtained from the landmarks 100-121, and these dimensions can be used to retrieve an implant component that has dimensions that most closely matches the dimensions determined based on the landmarks. This means that the person performing the planning does not have to try which implant component fits best, rather can focus of obtaining the desired outcome of the surgery by moving portions of bone relative to each other. Optimal components are then determined based on dimensions obtained from the landmarks after the portions of bone have been moved. The user input may be acceptance of a desired location of bone portions after surgery. This may determine positons of landmarks. These locations of landmarks can be used to determine dimensions, which in turn can be used to select optimal implant components.
Some embodiments comprises a computer readable storage medium 12, which has program instructions stored therein, wherein the program instructions, when executed by the processor 11, perform the method as described above.
As will be apparent, the features and attributes of the specific embodiments disclosed above may be combined in different ways to form additional embodiments, all of which fall within the scope of the present disclosure.
Conditional language used herein, such as, among others, “can,” “could,” “might,” “may,” “e.g.,” and the like, unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments include, while other embodiments do not include, certain features, elements and/or states. Thus, such conditional language is not generally intended to imply that features, elements and/or states are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without author input or prompting, whether these features, elements and/or states are included or are to be performed in any particular embodiment.
Any process descriptions, elements, or blocks in the flow diagrams described herein and/or depicted in the attached figures should be understood as potentially representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps in the process. Alternate implementations are included within the scope of the embodiments described herein in which elements or functions may be deleted, executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those skilled in the art.
It should be emphasized that many variations and modifications may be made to the above-described embodiments, the elements of which are to be understood as being among other acceptable examples. All such modifications and variations are intended to be included herein within the scope of this disclosure and protected by the following claims.
The present invention has been described above with reference to specific embodiments. However, other embodiments than the above described are equally possible within the scope of the invention. Different method steps than those described above may be provided within the scope of the invention. The different features and steps of the invention may be combined in other combinations than those described. The scope of the invention is only limited by the appended patent claims.
Number | Date | Country | Kind |
---|---|---|---|
1951237-5 | Oct 2019 | SE | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/SE2020/051143 | 11/29/2020 | WO |