The following description relates to a procedure method and apparatus. More particularly, the following description relates to a method and apparatus to evaluate an intravascular proceeding route of a guidewire used for a catheter procedure.
A remote control robot system has been developed to insert a catheter more precisely and accurately and to remove a radiation exposure risk in case of taking an X-ray during a procedure to identify a position of an inserted procedure equipment during an interventional procedure using a catheter to treat a cardiovascular or a peripheral vascular disease.
It is tremendously difficult to transfer a guidewire to a target point along numerous blood vessels of a human body. In addition, a blood vessel route may be temporarily identified by injecting contrast media. However, a duration of showing is approximately 3 seconds and except for that, a practitioner may insert a guidewire to a target point while viewing a shape of the guidewire only. Thus, there is a desire for a development of a system to identify a current intravascular position using a shape of a guidewire or navigate a route.
According to an aspect, there is provided an image processing system for a catheter procedure, the system including a storage unit to at least temporarily store a plurality of candidate routes on which a guidewire is to proceed from a first point as a route is changed by vascular bifurcation points, using a blood vessel image; and a processor configured to select at least one route corresponding to a current shape of the guidewire based on a comparison of similarities between the current shape of the guidewire and each of the plurality of candidate routes, from an image input during the procedure.
The processor may be configured to evaluate and provide a probability of a match between the current guidewire and each of the plurality of candidate routes.
The probability of the match may be generated by calculating and comparing correlation information between the guidewire and each of the plurality of candidate routes.
The processor may be configured to exclude at least one route with low similarity from the plurality of candidate routes.
In addition, the processor may be configured to correct the similarity referring to a blood vessel image captured while the system is in operation.
The plurality of candidate routes may include at least one of a blood vessel connecting an entry point of the guidewire to a target point or a blood vessel adjacent to the connecting blood vessel.
The processor may be configured to determine the similarity considering a deformable shape of the guidewire within the width of a blood vessel of each of the plurality of candidate routes.
According to another aspect, there is provided an image processing method for a catheter procedure including storing a plurality of candidate routes on which a guidewire proceeds from a first point using a blood vessel image wherein a route is changed by a vascular bifurcation point; comparing similarities between a current shape of the guidewire and the plurality of candidate routes from an image input during the procedure; and selecting at least one route corresponding to the current shape of the guidewire based on the comparing.
Hereinafter, the example embodiments will be described in detail with reference to the accompanying drawings. The scope of the right, however, should not be construed as limited to the example embodiments set forth herein. In the drawings, like reference numerals are used for like elements.
The terms used herein are selected from terms generally understood by those skilled in the related art, but may have different meanings according to technical developments and/or changes, practices, and preferences of an engineer. Accordingly, the terms used herein should not be construed as limiting the technical spirit, and should be construed as illustrative terms to describe example embodiments.
In addition, in a specific case, most appropriate terms are arbitrarily selected by the applicant. In this instance, the meanings of the arbitrarily used terms will be clearly explained in the corresponding description. Hence, the terms should be understood not by the simple names of the terms but by the meanings of the terms and the following overall description of this specification.
A practitioner who inserts the guidewire 110 may transfer the guidewire 110 to a target point while watching an X-ray image as shown in
During the process, an aspect of the blood vessel may be temporarily identified by injecting contrast media near the guidewire. Referring to
However, even if the contrast media are injected, an image as shown in
That is, the blood vessel route 220 may be instantaneously identified. However, since a duration of showing the blood vessel route 220 may be approximately three seconds, except for the duration, the practitioner may have to insert the guidewire 110 to a target point depending on a shape of the guidewire 110 along the blood vessel route 220 based on a memory of the practitioner. In addition, in a real procedure, it may be more difficult to identify a location of a blood vessel since the guidewire 110 and the heart 100, 200 are moving due to cardiac impulse and so forth.
In case of using a lot of contrast media during a process of inserting the guidewire, since a side effect may occur to a recipient (a patient), an injection of contrast media may need to be minimized. Thus, there is a demand for an image processing system which allows a practitioner or a mechanical apparatus to insert a guidewire smoothly to a target point while minimizing an injection of contrast media.
According to an example embodiment, there is provided an image processing system for a catheter procedure, the system including a storage unit to at least temporarily store a plurality of candidate routes on which a guidewire is to proceed from a first point as a route is changed by vascular bifurcation points, using a blood vessel image; and a processor configured to select at least one route corresponding to a current shape of the guidewire based on a comparison in a similarity between the current shape of the guidewire and each of the plurality of candidate routes, from an image input during the procedure.
Referring to
The plurality of candidate routes may refer to at least one of a blood vessel connecting an entry point of the guidewire to a target point or a blood vessel adjacent to the connecting blood vessel.
The candidate routes may be extracted from an image of a blood vessel captured before a procedure by using contrast media in advance, and stored. That is, in case of a procedure which requires an insertion of a guidewire, an image of a blood vessel is obtained in advance and then, with a predetermined point as the first point 310, a plurality of candidate routes ({circle around (1)} through {circle around (11)}) which may be proceedable from the first point may be found and stored.
As described in
Using a travel distance of the guidewire from the first point 310 and the shape of the guidewire, a position where the guidewire is currently located in a blood vessel may be determined.
In addition, a blood vessel which is most similar to the shape of the guidewire may be determined as the blood vessel in which the guidewire is currently located.
For example, when a guidewire has to proceed along a blood vessel {circle around (6)} among the blood vessel candidate routes, if the guidewire is located in the blood vessel {circle around (6)}, it may be determined that the guidewire is properly proceeding. If the guidewire strays out of the blood vessel {circle around (6)} and proceeds toward a blood vessel {circle around (3)}, it may be determined that the guidewire is proceeding in a wrong way.
According to another embodiment, the image processing system for a catheter procedure may evaluate and provide a probability of a match of a current guidewire to each of a plurality of candidate routes.
For example, but not limited to, a probability of a match of a current shape of a guidewire to each of the eleven candidate routes may be evaluated as 10% for a route {circle around (1)}, 15% for a route {circle around (2)}, and 95% for a route {circle around (6)}. The probability of the match may be generated by calculating and comparing correlation information between the guidewire and each of the plurality of candidate routes.
According to another embodiment, the image processing system may exclude at least one route with a low similarity from the plurality of candidate routes.
For example, if a guidewire is currently passing by a branch point of the routes {circle around (2)} and {circle around (6)}, a similarity to a route {circle around (1)}, which may be entered from the previous branch point, may be considered as substantially low. Thus, the route {circle around (1)} may be excluded from the candidate routes.
Alternatively, if the guidewire reached a branch point of routes {circle around (5)} and {circle around (6)}, all previous routes except for the two routes, may be excluded from the candidate routes.
The image processing system may correct the similarity referring to a blood vessel image captured while the system is in operation. The processor, for determining a similarity between a shape of a guidewire and the candidate routes by a previously obtained image of a blood vessel, may correct the similarity by additionally using an image of a blood vessel captured during a procedure.
Specifically, since an image of a blood vessel captured during a procedure and candidate routes before the procedure at a point in time of being stored in the storage unit may have a difference in time, a similarity may be corrected using a recent image of the blood vessel captured during the procedure.
In addition, the image processing system may correct a similarity using a displacement between an image of a blood vessel obtained previously and an image of the blood vessel captured during a procedure. For example, the image processing system may calculate a displacement between positions of a catheter tip in the two images of a blood vessel and correct the similarity using the calculated displacement. The displacement of the catheter tip in the image of the blood vessel may be caused by respiration of a patient. This may be because an organ such as a heart may be moved by a diaphragm during respiration, and the catheter may also be moved in the image.
According to another example embodiment, the image processing system may also determine a similarity to a shape of a guidewire considering a width of a blood vessel.
A width or a thickness of a blood vessel may refer to an inside diameter of the blood vessel in three-dimensions, and in case of displayed in a two-dimensional drawing, may refer to a perpendicular distance to a length direction of the blood vessel.
To describe in detail, in
On the other hand, referring to
Thus, the processor may determine the similarity considering a deformable shape of a guidewire corresponding to the width of the blood vessel within the width of the blood vessel. If a width of a blood vessel is narrow, when a shape of a guidewire is substantially similar to a candidate route, a similarity may be determined as high. Conversely, if a width of a blood vessel is wide, even though a shape of a guidewire is slightly different from a candidate route but is still deformable within the width of the blood vessel, a similarity may be determined as high.
Consequently, a similarity may be corrected corresponding to a width of a blood vessel when determining similarities with respect to a plurality of candidate routes.
The evaluation method for a proceeding route of a guidewire may include operation 510 of storing blood vessel candidate routes, operation 520 to compare similarities to the guidewire and operation 530 to select a corresponding route.
Operation 510 of storing blood vessel candidate routes may be an operation of at least temporarily storing a plurality of candidate routes on which a guidewire is to proceed from a first point as a route is changed by vascular bifurcation points, using a blood vessel image.
Here, the plurality of candidate routes may include at least one of a blood vessel connecting an entry point of the guidewire to a target point or a blood vessel adjacent to the connecting blood vessel. For example, if a guidewire enters from a thigh and moves to a brain, a blood vessel connecting a blood vessel of the thigh from which the guidewire enters and a brain vessel, and a blood vessel adjacent to the corresponding vessel may be stored as candidate routes.
The plurality of candidate routes may be at least temporarily stored, and both of permanently stored or temporarily stored method may be possible.
Operation 520 of comparing similarities to a guidewire may be an operation of comparing similarities between a current shape of the guidewire and the plurality of candidate routes from an image input during the procedure.
Specifically, similarities may be compared using a shape (form) and a depth of an insertion of a guidewire. As long as a guidewire does not perforate a blood vessel, the guidewire may move only inside of the blood vessel. Thus, considering a depth of an insertion of the guidewire, a reachable point for the guidewire within a blood vessel may exist. In addition, a shape of the guidewire may be compared to each of the plurality of candidate routes.
In addition, in operation of comparing similarities, a probability of a match between a current guidewire and each of the plurality of candidate routes may be calculated. The probability of the match may be calculated by calculating and comparing correlation information between the current guidewire and each of the plurality of candidate routes.
Operation 530 of selecting a corresponding route may be an operation of selecting at least one route corresponding to a current shape of the guidewire based on the comparison of similarities performed in operation 520.
The probability of the match and/or the similarity to each of the candidate routes may be calculated, and based on the similarities, the most similar candidate route to the current shape of the guidewire may be selected as a corresponding route to the current guidewire.
According to another embodiment, since the probability of the match and/or the similarities to each of the candidate routes may be determined, a route with a similarity that exceeds a predetermined level to each of the candidate routes may be selected as a corresponding route to the current guidewire. That is, in accordance with levels of similarities, a plurality of routes may be selected as routes corresponding to the current guidewire.
Consequently, the image processing system for a catheter procedure may find the most corresponding route to the current guidewire. Accordingly, it may be determined whether the guidewire is properly inserted.
In addition, using the image processing system may allow a practitioner to select whether to proceed or change a route by immediately determining a proceeding route during a procedure and delivering the determined proceeding route to the practitioner, and reduce control time or a number of control commands when using a machine system.
In addition, although
The units described herein may be implemented using a hardware component, a software component and/or a combination thereof. A processing device may be implemented using one or more general-purpose or special purpose computers, such as, for example, a processor, a controller and an arithmetic logic unit (ALU), a DSP, a microcomputer, an FPGA, a programmable logic unit (PLU), a microprocessor or any other device capable of responding to and executing instructions in a defined manner. The processing device may run an operating system (OS) and one or more software applications that run on the OS. The processing device also may access, store, manipulate, process, and create data in response to execution of the software. For purpose of simplicity, the description of a processing device is used as singular; however, one skilled in the art will appreciate that a processing device may include multiple processing elements and multiple types of processing elements. For example, a processing device may include multiple processors or a processor and a controller. In addition, different processing configurations are possible, such as parallel processors.
The software may include a computer program, a piece of code, an instruction, or some combination thereof, to independently or uniformly instruct or configure the processing device to operate as desired. Software and data may be embodied permanently or temporarily in any type of machine, component, physical or pseudo equipment, computer storage media or device, or in a propagated signal wave capable of providing instructions or data to or being interpreted by the processing device. The software also may be distributed over network-coupled computer systems so that the software is stored and executed in a distributed fashion. The software and data may be stored by one or more non-transitory computer-readable recording medias.
The methods according to the above-described example embodiments may be recorded in non-transitory computer-readable media including program instructions to implement various operations of the above-described example embodiments. The media may also include, alone or in combination with the program instructions, data files, data structures, and the like. The program instructions recorded on the media may be those specially designed and constructed for the purposes of example embodiments, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of non-transitory computer-readable media include magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROM discs, DVDs, and/or Blue-ray discs; magneto-optical media such as optical discs; and hardware devices that are specially configured to store and perform program instructions, such as read-only memory (ROM), random access memory (RAM), flash memory (e.g., USB flash drives, memory cards, memory sticks, etc.), and the like. Examples of program instructions include both machine code, such as produced by a compiler, and files containing higher-level code that may be executed by the computer using an interpreter. The above-described devices may be configured to act as one or more software modules in order to perform the operations of the above-described example embodiments, or vice versa.
A number of example embodiments have been described above. Nevertheless, it should be understood that various modifications may be made to these example embodiments. For example, suitable results may be achieved if the described techniques are performed in a different order and/or if components in a described system, architecture, device, or circuit are combined in a different manner and/or replaced or supplemented by other components or their equivalents.
Accordingly, other implementations are within the scope of the following claims.
Number | Date | Country | Kind |
---|---|---|---|
10-2019-0050785 | Apr 2019 | KR | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/KR2020/004495 | 4/2/2020 | WO |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2020/222429 | 11/5/2020 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
7203534 | Mollus et al. | Apr 2007 | B2 |
8374689 | Gopinathan et al. | Feb 2013 | B2 |
8494794 | Dutta et al. | Jul 2013 | B2 |
8798712 | Gopinathan et al. | Aug 2014 | B2 |
8825151 | Gopinathan et al. | Sep 2014 | B2 |
9675276 | Gopinathan et al. | Jun 2017 | B2 |
10548669 | Goyal | Feb 2020 | B2 |
10932815 | Lenker | Mar 2021 | B1 |
20100106149 | Habib | Apr 2010 | A1 |
20100312100 | Zarkh | Dec 2010 | A1 |
20110264075 | Leung | Oct 2011 | A1 |
20120101369 | Patil et al. | Apr 2012 | A1 |
20130123694 | Subramaniyan et al. | May 2013 | A1 |
20140032142 | Dutta et al. | Jan 2014 | A1 |
20140142398 | Patil et al. | May 2014 | A1 |
20170332945 | Gopinathan et al. | Nov 2017 | A1 |
20200129740 | Kottenstette | Apr 2020 | A1 |
20200305970 | Ben-Haim | Oct 2020 | A1 |
20230145569 | McWeeney | May 2023 | A1 |
Number | Date | Country |
---|---|---|
2003-245273 | Sep 2003 | JP |
6433745 | Dec 2018 | JP |
2019-10533 | Jan 2019 | JP |
2019-510547 | Apr 2019 | JP |
10-0466409 | Jan 2005 | KR |
10-2015-0025461 | Mar 2015 | KR |
10-1512110 | Apr 2015 | KR |
10-1549528 | Sep 2015 | KR |
10-2018-0016687 | Feb 2018 | KR |
Entry |
---|
International Search Report issued on Jul. 8, 2020 in PCT/KR2020/004495 filed Apr. 2, 2020, 3 pages. |
Coronary Angiography, Nucleus Medical Media, 2012, https:/www.youtube.com/watch?v=GhNT2GifkJg, 1 total page. |
Number | Date | Country | |
---|---|---|---|
20220193369 A1 | Jun 2022 | US |