Patent Grant
11278214
The present invention relates to systems and methods to detect and identify medical devices within a biological subject.
Medical devices such as catheters and balloons are inserted into patients and guided around the body along major blood vessels to a destination location where treatment or investigation is to take place. Various imaging techniques can be used to guide and verify the location of the medical device (or part of the medical device). For example, x-ray guidance is commonly used. The treatment of the patient may involve a medical device being left behind at the treatment site, for example, a stent.
Frequently, it is difficult to know what equipment has been used in each case, especially if the patient was treated somewhere else previously or their medical notes are out of date or incorrect. Manual documentation is used to track what medical devices have previously been used. That documentation is not always available and may not necessarily be correct.
In other scenarios, devices are implanted such as pacemakers or hip replacements and it is difficult to know what device, model or size is used afterwards if the manual documentation is not available or correct.
Product recalls on medical devices such as artificial hip joints or silicone breast implants can occur. The medical device needs to be identified to determine whether it is in the class of products being recalled. Having to undertake an invasive procedure to identify the medical device and thus determine whether it needs to be replaced or not, presents a significant risk to the patient. Any invasive procedure, merely to reliably identify a medical device within a patient, is difficult to justify.
Software solutions are available in combination with ultrasound techniques to distinguish and recognize specific arteries, for example, the common carotid artery, and then determine physical properties of the artery such as lumen diameter and wall thickness. Software solutions are also available to help recognize medical devices such as hip replacements from their geometric shapes and dimensions.
One aspect of the invention provides a system to detect a medical device within a biological subject and identify the medical device, the system comprising:
Another aspect of the invention provides a system to detect a medical device within a biological subject, the system comprising:
Another aspect of the invention provides a system to match a signature from a detected medical device within a biological subject with signature information held in a databank for a plurality of medical devices, the databank also holding specification information corresponding to the plurality of medical devices, the system being operable to match a signature relating to a detected medical device with signature information held in the databank and to provide some or all of the specification information for the matched signature to identify the nature of the medical device.
Another aspect of the invention provides a marker for attachment to, embedding in or comprising a medical device to identify the medical device from imaging data of the marker, the marker having information encoded in the opacity of the marker to an imaging system.
Another aspect of the invention provides a method of detecting a medical device in a biological subject, the method comprising:
Another aspect of the invention provides a method of matching a signature from a detected medical device within a biological subject with signature information held in a databank for a plurality of medical devices, the databank also holding specification information corresponding to the plurality of medical devices, the method comprising:
Another aspect of the invention provides a method of augmenting image data of a biological subject and a medical device within the biological subject comprising:
One aspect of the present invention provides a system to detect a medical device within a biological subject, the system comprising: an imaging system operable to generate image data derived from the biological subject and image data derived from the medical device; and a processor operable to detect the medical device and evaluate the image data derived from the medical device to identify the nature of the medical device.
Another aspect of the present invention provides a marker and the image data derived from the medical device is image data of the marker, the system being operable to generate a signature from the marker image data, the signature being related to the detected medical device.
A further aspect of the present invention provides the material of the marker, the marker surface texture, marker surface contour or other property of the marker is modulated to encode information in the marker and the modulation is apparent to an imaging system operable to generate the image data derived from the biological subject and/or the modulation is apparent to an imaging system operable to generate the image data derived from the medical device.
In another aspect of the present invention, the medical device has characteristics and the image data derived from the medical device is image data of the medical device characteristics, the system being operable to generate a signature from the characteristics, the signature being related to the detected medical device.
Another aspect of the present invention provides a databank holding signature information for a plurality of medical devices and corresponding specification information and/or characteristics for the plurality of medical devices, the system being operable to match a signature relating to a detected medical device with signature information held in the databank and to provide some or all of the specification information for the matched signature.
A further aspect of the present invention augments the image data with some or all of the specification information for the matched signature, the augmenting information being in respect of and/or associated with the detected medical device.
A further aspect of the present invention provides a module operable to recognise a site in the subject or a body part of the subject.
In another aspect of the present invention, the module is further operable to determine the location of the detected medical device with respect to the recognised site in the subject or body part of the subject.
In a further aspect of the present invention, the system is operable to further augment the augmented image data with: the site in the subject or a body part of the subject; and/or the location of the detected medical device with respect to the recognised site in the subject or body part of the subject.
Another aspect of the present invention provides a system to detect a medical device within a biological subject, the system comprising: a processor operable to: receive image data derived from the biological subject and image data derived from the medical device; detect the medical device and evaluate the image data derived from the medical device to identify the nature of the medical device.
A further aspect of the present invention provides a system to match a signature from a detected medical device within a biological subject with signature information held in a databank for a plurality of medical devices, the databank also holding specification information corresponding to the plurality of medical devices, the system being operable to match a signature relating to a detected medical device with signature information held in the databank and to provide some or all of the specification information for the matched signature to identify the nature of the medical device.
Another aspect of the present invention provides a method of detecting a medical device in a biological subject, the method comprising: imaging the biological subject; generating image data derived from the biological subject, generating image data derived from the medical device; processing the image data to detect the medical device; and determining the nature of the medical device.
A further aspect of the present invention provides a method of matching a signature from a detected medical device within a biological subject with signature information held in a databank for a plurality of medical devices, the databank also holding specification information corresponding to the plurality of medical devices, the method comprising: matching a signature relating to a detected medical device with signature information held in the databank; providing some or all of the specification information for the matched signature to identify the nature of the medical device.
Another aspect of the present invention provides a system to match a method of augmenting image data of a biological subject and a medical device within the biological subject comprising: deriving a signature from the medical device; interrogating a databank holding specification information corresponding to a plurality of medical devices; matching the signature from the medical device with signature information held in the databank; and providing some or all of the specification information for the matched signature to augment the image data.
So that the present invention may be more readily understood, embodiments of the present invention will now be described, by way of example, with reference to the accompanying drawings, in which:
A medical practitioner reviewing a patient or performing a procedure on a patient needs to have accurate and up to the minute information about the patient's status and this includes the medical devices present already in the patient and those being introduced to the patient in an ongoing procedure. More than one medical device may be in the field of view of the image of the procedure or review. It is also useful for the practitioner to be aware of the proximity of other medical devices in case there is any possibility of migration, collision or interference between devices. It is also useful for a practitioner to be able to evaluate whether other medical devices shown in image data of a procedure are relevant or not to an ongoing procedure. For example, if an image showed a stent present in one artery and the practitioner is introducing a stent in a distinct artery, then even though the two stents may be shown in the image as in proximity to one another their proximity can be disregarded since the arteries are at different levels or layers in the image. Embodiments of the invention allow such disambiguity considerations to be evaluated by the practitioner in real time.
When retrieving or replacing a medical device implanted in a patient, for example because of a product recall or routine replacement, it is good practice to retrieve and replace the correct medical device. Embodiments of the invention allow the correct device to be identified, recognised and importantly, verified by virtue of the practitioner being provided with real time augmenting information, for example, overlaying and pointing to and labelling up the medical devices being imaged.
System: Referring to
Augmenting information:
The image in
Overlaying the augmenting information on the original image as in
Medical devices: Medical devices 2 can be implanted in the biological subject or be present temporarily as, for example, part of a delivery mechanism. The medical devices may not have a medical function but are termed medical devices for the purpose of this discussion since they are implanted within the human body. An example of a medical device without a medical function is a surgically implanted RFID tag serving to identify the subject, for example a canine RFID chip.
Imaging systems: Imaging of the human body and medical devices within the body is accomplished by a number of different imaging system 3 mechanisms such as x-ray imaging, CT scans, magnetic resonance imaging (MRI), ultrasound techniques, functional medical imaging, fluoroscopy techniques, IVUS (intravascular ultrasound), OCT (optical coherence tomography) and various other tomography techniques. Some imaging techniques are more suited than others for imaging particular targets. The available imaging techniques can be combined with one another to provide composite images and/or data from one imaging technique is used to inform the data from another imaging technique. These techniques can be used to provide image data and/or images to image processing systems. The imaging system may comprise multiple different forms of imaging. Preferably, if there are multiple imaging systems 3 employed in the system 1, then the areas which they image coincide or overlap so that an overlapping portion provides a composite image in which the two or more images are aligned. Some imaging systems 3 image in a plane 20. The imaging systems generate image data generate image data derived from the biological subject and image data derived from the medical device located within the subject—the so-called original image data.
Recognition and identification (non-marker imaging recognition—pattern recognition techniques): Medical devices are not usually fabricated from human tissue and therefore they present themselves, when imaged, as being distinct from human tissue. Medical devices located within the human body have characteristics that are distinct from the human tissue surrounding them. For example, medical devices like replacement hip joints are manufactured from material which is more dense and more homogenous than human tissue and are therefore readily visible when imaged.
Imaging of the characteristics of a medical device enable an imaged device to be recognized by the system embodying the present invention. The image recognition functionality is provided by the processor 6. For example, characteristic features like the density or shape of an object can be used to recognize the device as a catheter 17, a bronchoscope 2′″, a balloon 18, a stent 2′, a replacement joint 2″ or other device. The device 2 can be permanently implanted in an invasive procedure or can be present temporarily in the course of a procedure. Recognition techniques can use machine learning techniques such as pattern recognition, pattern matching, shape matching which may use fuzzy logic, neural networks and heuristics. These characteristics of medical devices 2 are used to generate signatures of respective medical devices so that medical devices having matching signatures can be detected and also possibly identified.
The signature is checked against a register containing records of signatures and the register is held in a databank 8.
In the case of a stent, recognition can be achieved by analyzing the number of cells or struts or by a combination of both.
In the case of a pacemaker or replacement joint, by studying the shape and/or outline of the pacemaker or prosthetic joint replacement.
Recognition and identification (non-marker imaging recognition): Instead of (or in addition to) conducting detection of medical devices by shape recognition, as above, detection can also be achieved in embodiments of the invention using a marker 100 to aid or infer recognition. Medical devices 2 may be provided with a marker 100 to assist recognition and/or to provide an identifier. The marker 100 can be in the form of a bar code label or insert 101, or similar other identifier designed to label or encode a medical device 2 using an imaging modality such as X-Ray (fluoroscopy, computer tomography, CT scan or MRI), ultrasound or other such modality. The identifier may offer a unique identifier for each medical device 2 or may be an indicator of the class of medical device or can be both a class indicator and an individual identifier (or unique serial number). The marker 100 can be implemented as an x-ray or ultrasound-readable barcode. The marker is preferably machine readable. The marker is suitable for attachment to a medical device, for embedding in a medical device or the marker actually comprises the medical device. Imaging data from the marker identifies the medical device. The marker is preferably radiopaque or has one or more parts of respective radiopacity so that information can be encoded in the relative opacity of the marker to the imaging system.
Many coding schemes using portions of the marker material (or medical device material) which are opaque to the respective imaging system and contrasting portions which are non-opaque or partially-opaque to the respective imaging system are available to those skilled in applying codes to materials. For example, in the case of x-ray derived imaging an x-ray-readable barcode or other such marker is made up from alternating bars of varying thickness of radio-opaque and non-radio-opaque portions. In another example, the marker is a string of radio-opaque bits and non-radio-opaque bits. The radio-opaque bits are 1's or 0's and conversely non-radio-opaque bits are 0's or 1's thereby delivering binary code information. Effectively, the material of the medical device, its surface texture or some other property of the material is modulated to embody the code and that modulation is “visible” or apparent to the imaging system being used to provide the image data.
The opacity of the material of the marker, the opacity of the marker surface texture, the opacity of the marker surface contour or other property of the marker is modulated to encode information in the marker and this modulation is apparent to the imaging system being used to generate the image data derived from the biological subject and/or the modulation is apparent to the imaging system being used to generate the image data derived from the medical device—the respective imaging systems may be the same imaging system or different imaging systems.
In one embodiment, the marker is a barcode applied to (or part of) the shaft of the balloon delivery system or even on the balloon or stent itself. In another embodiment, information is encoded as a digital watermark image on or in the medical device—the marker is a digital watermark image. A digital watermark image is not a code per se. In one example, a digital watermark presents a known image in a slightly different manner and the information in the watermark is conveyed by deriving the difference features from the known image. The differences in radiopacity in areas of the marker may be slight, imperceptible to the naked eye, for example, but perceptible to high resolution medical imaging equipment. The marker may be a code of a series of bits—each bit in
When the marker is configured as a more complex code, the more complex codes can include orientation information which may be valuable when attempting to interrogate a code which is not being presented square on to the image capture device and/or can provide information about the orientation of the marked medical device within the body.
In the case of ultrasound, a similar barcode or other such marker composed of textured markers, or markers with different acoustic or reflective properties differentially scatters ultrasound waves. This ultrasound-readable pattern is detected and presented to a databank.
There may be more than one medical device within a patient so the system is able to process either serially or in parallel each of the medical devices. Of course, if the volume of the patient which is imaged is limited (and not a full body scan), then only those medical devices within the imaging footprint will be detected.
When a body is scanned or imaged by the system embodying the present invention, one or markers may be detected if they are present in the body. In some embodiments, detection comprises the successful reading of information from a marker 100. Preferably, the marker is machine readable. Preferably, the machine reading the marker is one of the imaging systems 3. The information conveyed by the marker 100 is, or results in the generation of, a signature comprising the whole or part of the information conveyed by the marker 100. The signature is an output of the image processor 6. The signature can be a hash of the marker identifier. The signature may identify the class of product of the medical device. The signature may be a unique identifier of the detected medical device.
The signature is checked against a register containing records of signatures and the register is held in a databank 8.
Processor: The processor 6 in the
Databank: The databank 8 is held locally on the system embodying the present invention as in the
The databank 8 contains a record of marker signatures or shape/pattern signatures that are compared to either: the images or image data derived from the imaged device; and/or the marker information derived from the medical device. The databank can operate as a lookup table so that when a match between the information derived from the medical device and the signatures in the databank is discovered, the databank 8 holds key information identifying the matched device and is operable to provide specification information for that medical device such as its manufacturer, date of manufacture, location of manufacture, batch number, size and a listing of the sub-assembly parts and the materials of manufacture. This list is not intended to be exclusive and other properties or characteristics of the medical device can be held on the databank. In some embodiments, the specification information includes a link or URL pointing the databank enquiry to a third party online resource 9, maintained, for example, by a manufacturer or health authority. An example of specification information for a number of hypothetical medical devices 2 denoted by their respective signatures is shown in Table 1:
The databank 8 returns the identity of the marker 100 and/or all or part of the specification information for that medical device 2 to the system so that the system can convey that information to the system operator or perhaps also to a third party 9 such as the manufacturer or a medical panel/watchdog/health authority.
The system embodying the present invention then has specification information about the medical device(s) detected in the patient. This specification information (or a selection of this information) can then be:
Preferably, the image data is displayed and is augmented by the medical device specification information, very valuable information for the operator and/or medical practitioner. The augmentation may comprise rendering a schematic representation of the recognised medical device 2 and/or “labelling-up” the original image data with a descriptor giving some or all of the recognised medical device's specification information.
Advantageously, alternatively, or in addition, to augmenting the original image data, the augmenting information can be provided for recordal or logging in a data storage medium which may or may not be the databank 8. The augmenting information in combination with some or all of the image data from which the matched signature was derived may itself be used to further populate a record associated with a patient or a record associated with a medical device. The record may also be populated with the image data, as augmented or as the original image data. This provides a linked intelligent data gathering system.
Recognising the site in the human body of the medical device: Examples of the invention include module solutions which operate in concert with the imaging technologies used by the imaging system embodying the present invention to distinguish between and recognise body parts or sites in the body. Specific blood vessels, for example, the common carotid artery, can be distinguished from one another and recognized by existing software modules. Such modules can then determine the physical properties of the artery such as lumen diameter and wall thickness. The software solutions allow for the recognition of parts of the human body such as specific organs and, because the system embodying the present invention is also able to identify and image the detected medical devices, a useful disambiguity function is enabled Embodiments of the invention use information derived from the image processor and/or the specification information returned from the databank 8 for detected medical devices to recognise (or help recognise or infer recognition of) a part of the human body subject or a site in the body and can then also determine the location of the detected medical device with respect to the recognised part of the human body subject or the recognised site in the body.
The part of the human body or site in the human body does not need to be recognised, as such, as recognition can be inferred from the nature of the medical device, by the class of the medical device, by the identity of the medical device and by the size, shape and/or construction of the medical device either as recognised directly from the imaging system and/or from the specification information returned from the databank 8. For example, a bronchoscope is more likely to be in the trachea than a stent so if a medical device is detected in the stent class, then it can be inferred that the stent is in a blood vessel and not the trachea.
Thus, the identification of the medical device 2 by its marker 100 and/or by the returned specification information from the databank 8 aids recognition of the body part or site in the human body itself. For example, from a computational perspective, this further information would be extremely helpful in recognising a coronary artery from a carotid. Of course in many cases the device may not be left in situ, as the marker might be on the delivery balloon shaft rather than on the stent, but that data could still be captured.
For example, stents will most frequently be located in blood vessels and not, for example, in the trachea, so if the imaging system “sees” a stent, then the system therefore “knows” because it has identified the medical device as a stent that the part of the body in which the stent is located must be a blood vessel and not the trachea. Furthermore, because the system is able to distinguish between blood vessels and identify specific blood vessels, a rendering (possibly “labelled-up”) of the medical devices with their positioning at a specified site in the human body or with respect to a site in the human body is possible. Another mechanism for removing ambiguities as to the location of medical devices is the size and/or shape of the particular device. For example, stents of different sizes, shape and/or construction will be utilised in different blood vessels. Such information infers or aids recognition of sites in the subject and is information which can be used to further augment image data (as above) or the logged record (as above).
In examples, the databank 8 may interface directly with third party systems 9 to display, record or document the data without requiring interaction with the local system 1,6. In examples, the specification information derived from the barcode/marker 100 is integrated with the patient's case details and entered directly onto the x-ray images or recorded into the patient's medical notes—in this manner the data derived about the detected medical devices 100 is linked to the images themselves so that the operator, third party and/or physician is provided with medical device specification information derived from the medical device 100 and the image data, linking the two.
Additional recognition and identification (non-imaging recognition): If the medical device 2 has a marker 100, then the medical device can be both detected and recognized from information 101 carried in the marker 100. The marker may not be readable by the imaging system 3 alone and could be implemented, for example, as an RFID tag applied to or part of the medical device. Systems embodying the present invention can have a machine reader in addition to the imaging system so that the human body and the medical device are imaged by the imaging system and the medical device is at least detected and possibly also identified by the machine reader (which is not necessarily the imaging system). Other forms of radio frequency communication enabling machine reading of the marker are possible such as wireless communication, near-field communication and contactless communication.
Embodiments of the invention allow the medical devices used in a patient to be detected and identified readily. Embodiments of the invention can interrogate an image to identify an implanted medical device retrospectively without any invasive procedures.
System enhancements: some scenarios and improvements which can be applied in whole or in part to embodiments of the present invention.
The Automated response/Artificial Intelligence:
The imaging system of the claimed invention recognises a code by detecting and evaluating image data of the medical device and more particularly image data of a marker 100 on the medical device 2. A code carried by the marker or a code unlocked by a key carried on the marker is checked against a central database which is operable to return information to a user, another database or an authorised third party.
Having the ability to query a database for product identification about the identified medical device 2 allows the computer 6 to check for additional information. This could include, if the device is stolen, out of date, or if a product recall exists on a device. This information can then be relayed immediately back to the hospital systems, and potentially to the medical device manufacturer that there is a potential device issue.
Once the medical device has been identified in the database, it is possible to run a series of automated checks to determine whether the device is appropriate for the situation it is being used in. This again could be an out of date device, but with image recognition which can give us details about a vessel size/location it could prompt the user that a device is now too small, or now too large, or simply that the device/consumable is being used in the wrong part of the body. This could reduce patient risk, and improve quality of health care. Moving forward and thinking about a time when surgical procedures are more automated, having the computer check the ID of the device/consumable will be an essential part of a procedure verification process to ensure the correct device has been loaded, and that it is appropriate for the procedure.
Additionally, a computer monitoring a case procedure could warn the operator about potential future problems. For example, once the device/consumable is known it could automatically recognise other devices already deployed in the body for compatibility with new devices. An example of this may be a pacemaker lead which would be incompatible with a particular pacemaker. Another example would be if an operator was trying to get 2 balloons down a catheter in which the diameter would be too small. Another example could be if a prosthetic hip replacement was used, and the computer determined immediately that the size was inappropriate for the size of the joint from additional imaging. So an automated, intelligent imaging system enhanced with image data according to the present invention could warn the operator of potential future incompatibility and, going further, propose solutions to rectify the problem or suspend the procedure until human clinical intervention is possible. The solution could be changing to a different pacemaker lead in the first example, or changing to a different catheter in the second, or a different size prosthesis in the third. In this way the computer can foresee potential problems ahead of when they occur. It would also allow operators to simulate cases beforehand, by doing a virtual run-through.
In general these intelligent systems could not only cross reference compatibility from a central database, but also learn the specific preferences of individual clinicians, by recording and reviewing what they prefer to use, and reference what has been successful in the past. They could also suggest potential new alternatives to try.
By evaluating the equipment being used the computer can also assess the risk of the cases, and pre-empt potential emergency systems, and activate emergency protocols should adverse events occur.
Whilst the medical device has its identity established from the image data, the ID code can also be entered manually from the device itself or from device packaging which expresses the barcode on the medical device in printed alphanumerics on the packaging, for example. Alternatively, the barcode on the device is replicated on the packaging and can be read by machine readable means, not necessarily the same machine readable mechanism as the imaging system. Machine reading can be scanned either by a light source or x-ray to check for compatibility, for example.
Once recognised, the system can also recognise the status of a medical device. For example, if a stent is used, the system can detect the ID of the stent from the marker. Once detected the system continues to watch the position of the stent. When the system images and identifies that the stent balloon has inflated, observing a marker on the balloon or balloon shaft, then the system status can be updated to “balloon deployed”. In addition to check for balloon inflation the computer could look to identify the stent within the vessel on the x-ray. In this way it could confirm, and automatically document the stent deployment. Using co-registration, the system can identify in which artery the stent has been deployed. Additionally, the system can advise on the need for further expansion based on the size of the stent (known from the ID), size of the vessel (known from the imaging QCA), and the size of the balloon expansion (known from the live imaging). Detecting and identifying medical devices within a human body can also be useful in the security environment so as to verify the nature of foreign bodies detected within the human body. If the specification information held in the databank 8 includes a patient identifier, then combining this with an identified medical device offers security the ability to verify (or provide an additional cross-check) of the personal identity of a person being scanned at a security checkpoint. Linking a patient identifier to a record of a particular implanted medical device 2 provides quasi-biometric data about that individual which is useful to help determine the identity of a person. This link ties the identified medical device 2 to a particular individual. Patient information is preferably encrypted in the specification information and patient information is not shared with, for example, security/border guards who can receive a simple red, green or amber flag whether the scanned individual matches the patient identifier information held in the databank 8 or not, thus maintaining patient confidentiality.
Embodiments of the present invention preferably utilize machine-readable marking to provide the information 101 carried in, on or as the marker 100. The marker is preferably in the form of a tag which is encoded with the information 101. The encoding mechanism has been developed to offer a large number of permutations/combinations within a self-defining coding structure. The code has to follow the physical limitations of the imaging systems. Whereas most medical devices are relatively large (order of multiple cms), it is important that the code is capable of being used along small dimensions (order of 1 or 2 mms) of devices which are either used as consumable medical devices or implanted medical devices.
In addition to the code being developed to aid identification by the imaging system, coding patterns follow specific algorithmic boundary conditions to provide a high level or likelihood of detection, in that the code is robust and can be read unambiguously, even in the most challenging imaging conditions. The coding patterns use image ensembling, and the detection algorithms have built in check-sum capacity for local error correction prior to querying on the central database.
Preferably, the coding uses up to 4 shades of greyscale on a radiopaque marker 100 or tag. The greyscales are predefined in a primer code and then have a number of bits in which the information is encoded, “length encoded”. Referring now to
The tables below show the number of combinations for a given number of greyscales, primer lengths, and encoded length.
The code on the tag is preferably an elongate strip of bits/blocks 105 with each block having a 1 mm width along the length of the strip and a minimum height of 1 mm across the strip. The block may not be a block of material but a space the size of a block meaning that the space the size of a block has 100% relative opacity. Opacity will be discussed later. The strip height is constrained by the size of the device/disposable upon which the code is being marked. For example in a pacemaker, the height could be large because the dimensions are in the order of cms, whereas, in a coronary catheter the height would be smaller because the dimensions are in the order of mms.
The choice of dimensions of the marker depends on the size of the device/disposable 2. The example marker 100 of
The primer may be short, two or three bits. The example of
The primer registration tells the computer what to expect in terms of length from the encoded section and also tells the computer the number of greyscale channels to expect, and also how to interpret the different imaged densities.
As x-rays pass through tissue differently in every person, a particular shade of grey on one person will differ from a shade of grey on another person. This means that that if we were using absolute colours it would be impossible to know what greyscale colour was being encoded. The primer overcomes this by defining the greyscale shades/intensities/densities such that the computer knows where each shade sits in terms of intensity/density or level. For example, in the first position of the primer there is a solid black block 105, in the second a white block and in the third a block with a shade of grey. These are each produced by altering the density of the material of each band, and in doing so letting more/less of the x-ray pass through. The same densities are used on the primer section as are used on the encoded section, such that when the computer recognises black in the primer region it knows the intensity of black in the encoded section. Similarly, for white blocks and any of the greyscale intensities. The computer can thus on each individual frame have the key (the primer) to unlocking the code (encoded section). This approach drastically increases the density of combinations which can run to over a trillion unique combinations from a relatively simple sequence.
Marker placement and orientation is also an important consideration. When a device 2 is imaged, there can be no guarantee that a marker 100 on the device 2 will be correctly oriented with respect to the imaging device so as to allow the complete code to be imaged, processed and determined unambiguously.
The precise manner in which the marker strips 100 are mounted on medical devices varies depending on the nature of the medical device 2 to which they are being attached (or embedded). Some mounting scenarios:
Accordingly, multiple markers 100 should preferably be provided on a single device 2 with different orientations and placements so that the chances of at least one marker “facing” an imaging system for unambiguous identification are increased. The differently placed markers may each have a unique code 101 indicating where each marker 100 is located on the device 2 (e.g. proximal end, distal end, mid-point of device). This provides good location resolution of the different parts of the device which can be important for a long device such as a catheter. Alternatively, the differently placed markers may each have the same code, for example on adjacent flat sides of a pacemaker (but not overlapping).
Marker placement on a medical device is effected to avoid or minimize x-ray shadowing which can be caused if a part of a marker overlaps another marker in the imaged field. Shadowing can lead to ambiguities in the code being read. Labelling or marking of medical devices 2 can be done on the outside of the device 2, or preferably within the device 2. If a device has already had approval from a medical authority for use within the human body, then printing a marker onto an internal surface of a device may not need further approval from the regulatory authority. Printing a marker on an external surface may require further approval from the regulatory authority. The code is preferably machine read by, for example, an x-ray imaging system, and so the code can be read equally well within the device as on an external surface of the device 2.
Where possible an array of markers is positioned at multiple positions in an orthogonal array, such that x-ray beams incident at differing angles should always be able to acquire an on-axis view. In the case of a catheter there would be an array of markers positioned close to the tip, and a series along the shaft of the catheter. In the case of a pacemaker this could be a marker array fixed on the inside of the pacemaker on two orthogonal surfaces (side wall and adjacent main flat surface for example).
For elongate medical devices such as catheters, sutures, and bronchial tubes, circumferential placement of markers should be avoided. Markers should be placed along the length of the device, normal to the circumference, to minimize the risk of shadowing—see
In combination with marker placement, the dimensions of the marker 100 are deliberately curtailed so that they do not extend over more than a quarter of the circumference of the substantially cylindrical medical device 2. If the marker 100 extended around the circumference, then there is a much greater risk of shadowing. Referring to
In preferred embodiments the code is configured as a bar code (the series of blocks 105) which can be directly printed onto the medical device 2. The bar code is composed of the blocks/bits described above (105,106,107,108) and may be painted, sprayed or printed onto the medical device as a thin film. A number of techniques can be used to deposit a thin film, foil or coating, preferably metallic in nature, onto the medical device. The absence of a film, one layer of film or multiple layers of film determine the relative opacity of the resultant block 105.
The term “printed” will now be used to describe the mechanism for laying down a thin film of material (to make up a block 105 of the marker 100) onto a substrate of the medical device 2.
Preferably, each block of the code is made up from none, one or multiple layers of material printed onto the medical device. Each layer of material has a predetermined thickness and is tailored to contribute to a predetermined percentage of relative opacity (a measure of how opaque to the particular imaging system each layer of printed material is) when imaged by a designated imaging system. Different opacities provide different greyscales. Labelling with a marker 100 takes the form of a series of bars or blocks 105 detectable by the imaging system. These blocks are made up of varying densities, such that differing amounts of x-ray can pass through each block. The x-ray image shows and the system can decipher a series of differing greyscale shades from each block. At the extreme would be white (low density, 100% opacity), to black (high density, 0% opacity), and then in the middle different shades of grey depending on the density of the block.
For example, when using an x-ray imaging system with a code having four greyscales, see
In another example, when using an x-ray imaging system with a code having three greyscales, see
As well as printing onto a substrate of the medical device 2, there are techniques for printing onto a metal, for example, embedded in the medical device substrate—a strip of foil, for example. Ultrasonic additive manufacturing is a 3D printing technology that uses ultrasound to modulate layers of metal within the foil strip. The modulation changes the imaged density of portions of the strip with respect to other portions of the strip so that they present different images or density of shading when imaged. The process works with a variety of metals such as aluminium, copper and titanium. Similarly, the material of the medical device 2 itself can be modulated by etching (selective removal of material) to alter/modulate its imaged properties. Altering the imaged properties of blocks of material within or on a substrate allows a code or information to be encoded in or on the medical device material to form a marker 100.
In some cases it may be desirable for the marker 100 to carry a smaller encoded section or primer section, perhaps due to space limitations on a medical device 2 on which the marker 100 is located. In such cases, the code (primer or encoded section) 101 can act as a key to access or unlock another, possibly more complex, code embedded in an RFID tag associated with the same medical device 2, i.e. the same medical device carries an imaging marker and an RFID marker. The code from the RFID tag can be used to interrogate the central database in place of the code from the imaging marker. Thus the code on the imaging marker does not interrogate the database for the medical device directly but the imaging marker code works alongside the RFID code. In this way, the imaging marker code is not acting to identify the medical consumable/device but acts as a password/key to unlock the identity of the medical device on the database. This two-stage verification process can be useful to prevent fraud and ensure data integrity.
In the present specification “comprise” means “includes or consists of” and “comprising” means “including or consisting of”.
The features disclosed in the foregoing description, or the following claims, or the accompanying drawings, expressed in their specific forms or in terms of a means for performing the disclosed function, or a method or process for attaining the disclosed result, as appropriate, may, separately, or in any combination of such features, be utilised for realising the invention in diverse forms thereof.
| Number | Date | Country | Kind |
|---|---|---|---|
| 1508400 | May 2015 | GB | national |
| 1516990 | Sep 2015 | GB | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/GB2016/051382 | 5/13/2016 | WO | 00 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2016/185180 | 11/24/2016 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20060212096 | Stevenson | Sep 2006 | A1 |
| 20070016244 | Behl | Jan 2007 | A1 |
| 20090171196 | Olson | Jul 2009 | A1 |
| 20100131023 | Costello et al. | May 2010 | A1 |
| 20130184571 | Wilkening et al. | Jul 2013 | A1 |
| 20140135619 | Casanova | May 2014 | A1 |
| 20140263674 | Cerveny | Sep 2014 | A1 |
| 20150088091 | Beasley | Mar 2015 | A1 |
| 20150254542 | Deffeyes | Sep 2015 | A1 |
| 20160042261 | Kieser | Feb 2016 | A1 |
| Number | Date | Country |
|---|---|---|
| 101 065 299 | Sep 2011 | KR |
| WO-2006101993 | Sep 2006 | WO |
| WO-2012090148 | Jul 2012 | WO |
| Entry |
|---|
| International Search Report and Written Opinion for Application No. PCT/GB2016/051382, dated Jul. 12, 2016. |
| Number | Date | Country | |
|---|---|---|---|
| 20190008412 A1 | Jan 2019 | US |
