The subject matter disclosed herein relates to methods and apparatus for improving resolution of acquired radiographic images using x-rays.
Structures that are significantly smaller than a digital radiographic detector's interpixel distance might require improved resolution when using standard x-ray imaging techniques. Technology continues improving to reduce the spatial resolution of imaging pixels, however, as pixel size is reduced the amount of incident photons reaching each of the detector's pixels is reduced. In addition, the natural loss of spatial resolution due to digitization may introduce noise, blur, and aliasing.
Multiple radiographic exposures of a patient in clinical practice are less desirable since ionized radiation from an x-ray source is used. In other applications, such as non-destructive testing (NDT), multiple acquisitions are not common practice, as additional time is required. However, there are multiple situations where repeated exposures may not be a significant factor or are employed as part of the usual process/protocol.
The discussion above is merely provided for general background information and is not intended to be used as an aid in determining the scope of the claimed subject matter.
A method for generating a high-resolution radiographic image of an object is disclosed, including capturing a first radiographic image of the object using an x-ray source and a digital radiographic detector, then moving at least one of the x-ray source, the object, and the detector at a relative displacement less than an interpixel distance of the detector. A second radiographic image of the object is captured, using the displaced x-ray source, object, or digital radiographic detector, and the two captured images of the object are combined.
The ability of utilizing the super-resolution technique disclosed herein relies on acquiring two or more images. Different embodiments described herein illustrate methods and apparatus in which a pair of images, or more, may be acquired, thus enabling a super resolution technique to be applied.
In one embodiment, a method for generating a high-resolution radiographic image of an object is disclosed. Capturing a first radiographic image of the object using an x-ray source and a digital radiographic detector is followed by moving at least one of the x-ray source, object, and the detector at a relative displacement less than an interpixel distance of the detector. A second radiographic image of the object is captured using the at least one displaced x-ray source, object, and digital radiographic detector, then the first captured radiographic image of the object is combined with the second captured radiographic image of the object.
Super resolution techniques have been applied successfully to obtain higher resolutions and sharper images from multiple low-resolution images. Multiple images may be acquired by displacing an image plane by subpixel motion. These images are then combined to reconstruct a higher quality image having increased resolution.
The summary descriptions above are not meant to describe individual separate embodiments whose elements are not interchangeable. In fact, many of the elements described as related to a particular embodiment can be used together with, and possibly interchanged with, elements of other described embodiments. Many changes and modifications may be made within the scope of the present invention.
This brief description of the invention is intended only to provide a brief overview of subject matter disclosed herein according to one or more illustrative embodiments, and does not serve as a guide to interpreting the claims or to define or limit the scope of the invention, which is defined only by the appended claims. This brief description is provided to introduce an illustrative selection of concepts in a simplified form that are further described below in the detailed description. This brief description is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter. The claimed subject matter is not limited to implementations that solve any or all disadvantages noted in the background.
So that the manner in which the features of the invention can be understood, a detailed description of the invention may be had by reference to certain embodiments, some of which are illustrated in the accompanying drawings. It is to be noted, however, that the drawings illustrate only certain embodiments of this invention and are therefore not to be considered limiting of its scope, for the scope of the invention encompasses other equally effective embodiments. The drawings below are intended to be drawn neither to any precise scale with respect to relative size, angular relationship, relative position, or timing relationship, nor to any combinational relationship with respect to interchangeability, substitution, or representation of a required implementation, emphasis generally being placed upon illustrating the features of certain embodiments of the invention. In the drawings, like numerals are used to indicate like parts throughout the various views. Thus, for further understanding of the invention, reference can be made to the following detailed description, read in connection with the drawings in which:
This application claims priority to U.S. Patent Application Ser. No. 63/277,623, filed Nov. 10, 2021, in the name of Bogoni et al., and entitled SUPER RESOLUTION IN DIGITAL X-RAY IMAGING, which is hereby incorporated by reference herein in its entirety.
In the context of NDT, in one embodiment, a platform supporting an object 18 to be imaged is configured to be moved in the x-y plane 52 on a subpixel scale, i.e., capable of a controlled micro-motion of the platform. The object may be radiographically imaged multiple times, using the imaging system of
In one embodiment, the digital detector 40 may be placed in a movable frame, as described herein, capable of displacing the detector 40 in the x-y plane 53 by a subpixel distance. In this embodiment, the imaging procedure may be used to characterize, quantify and/or assess the presence of a defect 55 in the object 18, wherein a size of the defect 55 may be smaller than the interpixel distance of the detector 40. As shown in the enlarged image 57 of the defect 55, the defect 55 may have a dimension of about 50 sm. As noted, two or more DR images may be acquired in specific circumstances and, while the ability to provide higher resolution images is of high value, the NDT domain enables using multiple exposures without a significant concern of damage to the imaged object 18 that may be caused by radiographic exposure. Super-resolution techniques in digital x-ray imaging can be provided by introducing means for generating image sequences that use subpixel displacements suitable to reconstruct images at increased spatial resolutions.
While
In one embodiment, a detector assembly is configured to apply subpixel movements controllably, systematically and deliberately to a digital detector, or image receptor, 40 so as to enable the acquisition of a plurality of subpixel shifted images and the formation of an enhanced image or a stream of enhanced images.
In one embodiment, an assembly for achieving the subpixel displacements described herein may include a plurality of piezo electronic devices, or micro-electromechanical systems (MEMS) 405, 407, or similar technologies, or a combination thereof, to effect electronically controlled displacement. The MEMS 405, 407, may be attached to the housing 401 and configured to contact two or four sides of the movable frame 403. On each side one or more MEMS 405, 407, may be configured to contact and displace the movable frame 403 portion of the detector assembly 400 as described herein. Upon receiving control instructions, the MEMS 405, 407, may, in response, push the movable frame 403 on a side with which the MEMS 405.407, is in contact in order to displace the frame 403 in the x-y plane 53 for a selected subpixel distance as indicated by the control instructions. Upon completing a shift in response to control instructions, the detector assembly 400 may be configured to transmit a completion signal indicating the digital detector 40 is in position for a subsequent radiographic image capture procedure. The processing control system, whether on-board the digital detector 40 or external, such as in a connected control system as described herein, may be used to trigger a plurality of exposures resulting in individual radiographic image captures differentiated by subpixel displacements of the detector 40. A program, executed either onboard the digital detector 40 or external to the detector 40, may receive the plurality of acquired radiographic images and generate a combined composite enhanced image.
In the context of NDT, certain radiographically imaged structures may be linear in nature and aligned with specific spatial orientations, e.g., parallel lines. In such a situation, a super-resolution strategy may be optimized to capture specific spatial frequencies along a particular direction, such as either in the x or y dimension of the x-y plane, as described herein with respect to
It should be understood that the super resolution method described herein may be performed by acquiring a sequence of images where motion, or displacement, may be applied to any of three separate radiographic imaging system components. In one embodiment, wherein the object, or patient, 18 is moved in the x-y plane 52, in the context of healthcare, the imaged patient 18 may move naturally such as when acquiring images in a breathing cycle or cardiac cycle. In the context of NDT, the imaged object 18 may be placed on a platform or attached to a device whereby, between image acquisitions, a small, controlled subpixel displacement may be applied in the x-y plane 52 (
In the case of x-ray source displacement, the amount of the projective displacement depends on the distance between the source and the detector as well as the position and distance of the object from these components. While it is possible to calibrate the source motion so as to control its displacement relative to pixels in the detector, very small depth and angular misalignments could result in magnified displacement in the imaging plane of the detector. Furthermore, as the imaged object is three-dimensional, possibly with complex internal architecture (e.g., a patient thorax), parallax effects will be induced causing complex effects to be accounted for.
When a super-resolution method such as described herein leverages natural occurring patient body motion, the method may need to account for alignment of anatomical structures. The quality of the intra acquisitions registration will depend on the amount and direction of motion. Super-resolution processes that either use explicit motion models or implicit ones, such as Expectation Minimization or convolutional neural networks, can be used to both align images and integrate the information to achieve a higher spatial resolution, such as shown on the right in
In one embodiment, a clinician may be interested in monitoring/imaging a patient's chest during a breathing cycle or visualizing contrast in blood flow as used in serial radiography (fluoroscopy) or C-arm applications. The methods and apparatus disclosed herein may be used to shift a digital detector 40 after each image capture during serial radiography. For example, during a serial radiography imaging procedure that captures and displays images at a rate of eight (8) frames per second, the detector assembly described herein may be used to shift, back and forth, the digital detector 40 eight times per second, once after each image capture during the serial radiography procedure. Each running pair of successively captured images may be combined to enhance the images being displayed during the serial radiographic procedure.
In one exemplary embodiment, the rows of photosensitive cells 22 may be scanned one or more at a time by electronic scanning circuit 28 so that the exposure data from the array 12 may be transmitted to electronic read-out circuit 30. Each photosensitive cell 22 may independently store a charge proportional to an intensity, or energy level, of the attenuated radiographic radiation, or x-rays, received and absorbed in the cell. Thus, each photosensitive cell, when read-out, provides information defining a pixel of a radiographic image 24, e.g. a brightness level or an amount of energy absorbed by the pixel, that may be digitally decoded by image processing electronics 34 and transmitted to be displayed by the digital monitor 26 for viewing by a user. An electronic bias circuit 32 is electrically connected to the two-dimensional detector array 12 to provide a bias voltage to each of the photosensitive cells 22.
Each of the bias circuit 32, the scanning circuit 28, and the read-out circuit 30, may communicate with an acquisition control and image processing unit 34 over a connected cable 33 (wired), or the DR detector 40 and the acquisition control and image processing unit 34 may each be equipped with a wireless transmitter/receiver to transmit radiographic image data wirelessly 35 to the acquisition control and image processing unit 34. The acquisition control and image processing unit 34 may include a processor and electronic memory (not shown) to control operations of the DR detector 40, and the imaging system 10 overall, as described herein, including control of circuits 28, 30, and 32, for example, by use of programmed instructions transmitted to the detector 40, and to store and process image data. The acquisition control and image processing unit 34 may also be used to control activation of the x-ray source 14 during a radiographic exposure, controlling an x-ray tube electric current magnitude, and thus the fluence of x-rays in x-ray beam 16, and/or the x-ray tube voltage, and thus the energy level of the x-rays in x-ray beam 16. A portion, or all, of the acquisition control and image processing unit 34 functions may reside in the detector 40 in an on-board processing system 36 which may include a processor and electronic memory to control operations of the DR detector 40 as described herein, including control of circuits 28, 30, and 32, and transmitter/receiver 35 by use of programmed instructions, and to store and process image data similar to the functions of standalone acquisition control and image processing system 34. The on-board processing system 36 may receive instructions transmitted from control and image processing system 34 in order to control operations of the MEMS devices 405, 407, as described herein. The processing system 36 may perform image acquisition and image disposition functions as described herein. The processing system 36 may control image transmission and image processing and image correction on board the detector 40 based on instructions or other commands transmitted from the acquisition control and image processing unit 34, and transmit corrected digital image data therefrom, and may transmit status information related to completed subpixel displacements of the frame 403 so that subsequent image capture procedures may be initiated.
The processing system 36 may convey control signals to the MEMS devices 405, 407, to controllably displace the frame 403 and the digital detector 40 therein according to instructions received from image processing unit 34. The processing system 36 may store predetermined instructions to automatically shift the frame 403 and the digital detector 40 therein according to a preselected shift distance. Such preselected shift distances may be stored in processing system 36 as absolute values, e.g., 50 μm or another absolute distance value, or they may be stored as f=0.25 or f=0.5 values, which may be programmably applied by processing system 36 corresponding to the pixel resolution of the detector 40. The processing system 36 may also cooperate with an image processing unit 34 which may be a part of a serial radiography (fluoroscopy) system. The processing system 36 may signal the serial radiography system each time that the frame 403 is shifted (back and forth) to synchronize each serial image capture with the programmed back and forth shift of the digital detector 40.
With regard to a direct detection embodiment of DR detector 40, the photosensitive cells 22 may each include a sensing element sensitive to x-rays. i.e. it absorbs x-rays and generates an amount of charge carriers in proportion to a magnitude of the absorbed x-ray energy. A switching element may be configured to be selectively activated to read out the charge level of a corresponding x-ray sensing element. With regard to an indirect detection embodiment of DR detector 40, photosensitive cells 22 may each include a sensing element sensitive to light rays in the visible spectrum. i.e. it absorbs light rays and generates an amount of charge carriers in proportion to a magnitude of the absorbed light energy, and a switching element that is selectively activated to read the charge level of the corresponding sensing element. A scintillator, or wavelength converter, (not shown) may be disposed over the light sensitive sensing elements to convert incident x-ray radiographic energy to visible light energy. Thus, in the embodiments disclosed herein, it should be noted that the DR detector 40 may include an indirect or direct type of DR detector.
Examples of sensing elements used in sensing array 12 include various types of photoelectric conversion devices (e.g., photosensors) such as photodiodes (P-N or PIN diodes), photo-capacitors (MIS), photo-transistors or photoconductors. Examples of switching elements used for signal read-out include a-Si TFTs, oxide TFTs, MOS transistors, bipolar transistors and other p-n junction components.
Incident x-rays, or x-ray photons, 16 are converted to optical photons, or light rays, by a scintillator, which light rays are subsequently converted to electron-hole pairs, or charges, upon impacting the a-Si:H n-i-p photodiodes 270. In one embodiment, an exemplary detector cell 222, which may be equivalently referred to herein as a pixel, may include a photodiode 270 having its anode electrically connected to a bias line 285 and its cathode electrically connected to the drain (D) of TFT 271. The bias reference voltage line 232 can control a bias voltage of the photodiodes 270 at each of the detector cells 222. The charge capacity of each of the photodiodes 270 is a function of its bias voltage and its capacitance. In general, a reverse bias voltage, e.g. a negative voltage, may be applied to the bias lines 285 to create an electric field (and hence a depletion region) across the pn junction of each of the photodiodes 270 to enhance its collection efficiency for the charges generated by incident light rays. The image signal represented by the array of photosensor cells 212 may be integrated by the photodiodes while their associated TFTs 271 are held in a non-conducting (off) state, for example, by maintaining the gate lines 283 at a negative voltage via the gate driver circuits 228. The photosensor cell array 212 may be read out by sequentially switching rows of the TFTs 271 to a conducting (on) state by means of the gate driver circuits 228. When a row of the pixels 22 is switched to a conducting state, for example by applying a positive voltage to the corresponding gate line 283, collected charge from the photodiode in those pixels may be transferred along data lines 284 and integrated by the external charge amplifier circuits 286. The row may then be switched back to a non-conducting state, and the process is repeated for each row until the entire array of photosensor cells 212 has been read out. The integrated signal outputs are transferred from the external charge amplifiers 286 to an analog-to-digital converter (ADC) 288 using a parallel-to-serial converter, such as multiplexer 287, which together comprise read-out circuit 230.
This digital image information may be subsequently stored immediately as controlled by an on-board processing system 36, or it may be image processed on-board, or it may be processed by image processing system 34 to yield a digital image which may then be digitally stored and immediately displayed on monitor 26, or it may be displayed at a later time by accessing a digital electronic memory containing the stored image. The flat panel DR detector 40 having an imaging array as described with reference to
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method, or computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.), or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “service,” “circuit,” “circuitry,” “module.” and/or “system.” Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.
Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code and/or executable instructions embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The program code may execute entirely on the user's computer (device), partly on the user's computer, as a stand-alone software package, partly on the users computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
This written description uses examples to disclose the invention, including the best mode, and also to enable any person skilled in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the invention is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal language of the claims.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2022/049351 | 11/9/2022 | WO |
Number | Date | Country | |
---|---|---|---|
63277623 | Nov 2021 | US |