The present invention relates generally to methods, systems, and apparatuses for optimizing imaging protocols using the consensus of an imaging community. The disclosed methods, systems, and apparatuses may be applied to, for example, imaging modalities such as Magnetic Resonance Imaging (MRI).
Magnetic Resonance Imaging (MRI) is a non-invasive medical imaging technique that utilizes magnetization to visualize soft tissue. The contrast of MRI is extraordinarily flexible; several physical tissue properties can be used as contrast parameters to extract anatomical, morphological and even functional information. Tissue properties may include but are not limited to relaxation parameters, diffusion perfusion, flow, etc. The achieved image contrast strongly depends on the used Magnetic Resonance (MR) protocols—a specific set of imaging parameters that describe data acquisition and image reconstruction. Such imaging protocols are the core element of a clinical MRI study. The optimal selection of an imaging protocol and associated imaging parameters strongly impacts the image quality and diagnostic performance of the MRI study and requires careful optimization to clinical scenarios, diseases, body parts and patient habitus. Unfortunately, even small deviations from optimized MRI protocols may render an MR image as non-diagnostic, resulting in repeated scans or even call backs of the patients.
Although vendors of MRI scanners provide a wealth of MRI protocols for different clinical and patient scenarios, the further optimization and development of MRI protocols is an ongoing and dynamic process that often happens on local level and strongly depends on level of experience and expertise of the MRI technologists/radiologists/cardiologists and last, but not least, local preferences. Even if clinical relevant protocols are being optimized on a local level, the clinical community typically does not benefit from those developments as locally optimized protocols are typically not available to the public. Even if they are, the implementation of those modifications remains limited, or even disappears if there is no clear consensus of the community.
MRI protocols provided by the vendors typically cover the majority of clinical and patient scenarios. Often, these MRI protocols represent the state of the art based on the protocol development of a rather small group of application specialists or consultants. As a result, these protocols are adopted by users to reflect changes in standard of care or local preferences. However, if those changes are not executed with appropriate care, protocol modifications may impact image quality and overall diagnostic output in a detrimental fashion. Although professional societies such as Society of Cardiac Magnetic Resonance (SCMR) define minimum requirements for MRI protocols to obtain sufficient diagnostic MRI image quality, often, practical implementation of those protocols varies widely from one site to another. Therefore, image quality and diagnostic performance may be very different from site to site, potentially burdening the patient with repeated scans or studies and the healthcare system with additional costs. Moreover, adaptation of MRI protocols to reflect the state of the art, new clinical applications or emerging methods is typically rather slow and often depends on the release of new protocols by the vendors of MR scanners.
Accordingly, it is desired to make clinically relevant MRI protocols available that represent that state of the art and result in pristine image quality; a dynamic, community oriented, collaborative approach to modify the protocols will increase the stability and consistency.
Embodiments of the present invention address and overcome one or more of the above shortcomings and drawbacks, by providing methods, systems, and apparatuses that allow an imaging community to jointly optimize and further develop clinical imaging protocols. Consensus of an imaging community is used as a metric to measure the quality of images generated using optimized protocols. This technology is particularly well-suited for, but by no means limited to, imaging modalities such as Magnetic Resonance Imaging (MRI).
According to some embodiments of the present invention, a method for optimizing imaging protocols usage based on community voting includes a computer storing standard imaging protocol data associated with an imaging device type in a protocol database. The computer receives a request to modify the standard imaging protocol data. The request comprises an original image generated on a device of the imaging device type using the standard imaging protocol data, a new image generated on the device of the imaging device type using modified imaging protocol data, and a textual explanation of one or more modifications of the standard imaging protocol data used to create the modified imaging protocol data. Next, the computer presents the original image, the new image, and the textual explanation of one or more modifications on a website accessible by a plurality of community members. A plurality of vote values may be received from the plurality of community members via the website, each respective vote value selected from a range of values with a minimum value indicating rejection of the modified imaging protocol data and a maximum value indicating acceptance of the modified imaging protocol data. Then the computer determines whether a consensus decision exists among the plurality of vote values. If the consensus decision exists, the computer determines whether to accept or reject the request to modify the standard imaging protocol data based on the consensus decision. In some embodiments, if the consensus decision does not exist, the request to modify the standard imaging protocol data may be rejected.
In some embodiments of the aforementioned method, the computer also determines a distribution of the plurality of vote values between the minimum value and the maximum value. Then, the consensus decision may be determined based on the distribution. The distribution may also be used to determine whether the consensus decision exists among the plurality of vote values. For example, two portions of the distribution may be identified: a rejection portion comprising the minimum value and an endorsement portion comprising the maximum value. Then, a consensus decision may exist, for example, if the distribution includes a single peak in the rejection portion of the distribution or the endorsement portion of the distribution. In some embodiments, the method further includes the identification of a middle portion of the distribution between the rejection portion and the endorsement portion. Then, it may be determined that a consensus does not exist if, for example, the distribution does not include a single peak value, the distribution has a neutral peak value located in the middle portion, or the distribution is uniform.
The form of the website utilized in the aforementioned method may vary. For example, in one embodiment a graphical input element is presented on the website to allow selection of an input value between the minimum value and the maximum value. Then, the vote values may be received via the graphical input element. In one embodiment, a plurality of download links is presented on a second website accessible to the plurality of community members. These download links are operable to facilitate downloading of the standard imaging protocol data in a distinct imaging device format.
In some embodiments, the votes are weighted. For example, in one embodiment, a weighting process is performed for each respective vote value in the plurality of vote values. This process includes determining a weight value associated with a community member submitting the respective vote value and applying the weight value to the respective vote value prior to determining the consensus decision. These weighting values may be updated based on the results of the consensus decision. For example, if a respective vote value agrees with the consensus decision, the weight value associated with the community member submitting the respective vote value may be increased. Conversely, if the respective vote value disagrees with the consensus decision, the weight value associated with the community member submitting the respective vote value may be decreased. Various restrictions may be placed on the increase or decrease in weight value. For example, in one embodiment, the weight value associated with the community member submitting the respective vote value is restricted to a range of weight values between a predetermined minimum threshold and a predetermined maximum threshold. In one embodiment, the weight increase and/or decrease is inversely proportional to the existing weight value. Inactivity of a community member may also be used as a factor in decreasing weight value. For example, in one embodiment, a weight decrease rate due to inactivity of a community member is determined based on the time that the community member was inactive. This weight decrease rate may then be applied to the weighting value associated with the community member. In one embodiment, the weight decrease rate due to inactivity is linear if the inactivity time is greater than a predetermined threshold value.
According to other embodiments of the present invention, one or more of the features of aforementioned method may be used in various apparatuses and systems. For example, in one embodiment, an article of manufacture for optimizing imaging protocols usage based on community voting comprises a non-transitory, tangible computer-readable medium holding computer-executable instructions for performing the aforementioned method. According to other embodiments of the present invention, a system for optimizing imaging protocols usage based on community voting includes a database and a server computer. The database is configured to store standard imaging protocol data associated with an imaging device type in a protocol database. The server computer includes at least one processor and is configured to perform one or more of the features discussed above with respect to the aforementioned method.
Additional features and advantages of the invention will be made apparent from the following detailed description of illustrative embodiments that proceeds with reference to the accompanying drawings.
The foregoing and other aspects of the present invention are best understood from the following detailed description when read in connection with the accompanying drawings. For the purpose of illustrating the invention, there is shown in the drawings embodiments that are presently preferred, it being understood, however, that the invention is not limited to the specific instrumentalities disclosed. Included in the drawings are the following Figures:
The present invention relates generally to methods, systems, and apparatuses for optimizing imaging protocols using the consensus of an imaging community The various embodiments described herein offer several benefits to the imaging community. Imaging protocols may be stored in a centralized repository and made available online, thus allowing community members to view, add, delete, and modify imaging protocols available to the community. Additionally, community members may approve or reject modifications based on a consensus rating system. A centralized repository of imaging protocols will help to improve reproducibility and consistency of images across sites and department. In turn, this may help in reducing certain costs associated with performing imaging. The disclosed methods, systems, and apparatuses may be applied to, for example, imaging modalities such as Magnetic Resonance Imaging (MRI).
Using computers 105B, 110B, and 115B, the community members 105C, 110C, and 115C communicate over a network 120 with an Imaging Protocol Server 125. The Imaging Protocol Server 125 includes a Protocol Database 130 storing one or more imaging protocols. The imaging protocols stored in the Protocol Database 130 may include standard imaging protocols (e.g., Society for Cardiovascular Magnetic Resonance protocols) as well as modifications to the standard imaging protocols generated by one or more of the community members (e.g., community members 105C, 110C, and/or 115C). The Protocol Database 130 also stores a representative image for each imaging protocol, depicting results previously generated using a respective imaging protocol. In one embodiment, these representative images are stored using the Digital Imaging and Communications in Medicine (DICOM) format.
Through interaction with the Imaging Protocol Server 125, the community members 105C, 110C, and 115C are able to view, download, use, and submit modifications to the imaging protocols stored in the Protocol Database 130. For example, a community member may propose a new protocol or set of protocols, a modification to an existing protocol or set of protocols, or removal of an individual imaging protocol from a clinical study. In one embodiment, Imaging Protocol Server 125 is configured to present a wiki-type webpage to provide online tools for viewing and editing the imaging protocols. Any change to a standard protocol may be suggested via interaction with the Imaging Protocol Server 125. In some embodiments, the community member submitting the proposed modification is also required to provide a description of the modifications applied to the original protocol.
Once a modification to an imaging protocol is submitted and received by the Imaging Protocol Server 125, the modification is made available to users of the system (e.g. community members 105C, 110C, and 115C), for example via a webpage hosted by the Imaging Protocol Server 125. In some embodiments, the Imaging Protocol Server 125 stores and maintains all standard protocols, along with any proposed modifications, in a version control system. In such a system, each modified protocol may be presented as a “version” of an original, standard protocol. In one embodiment, the version control system further includes branching functionality, such that different modifications to the original protocol may be made in parallel. For example, one branch of modifications may focus on changes to one set of parameters included in the original protocol, while another branch focuses on changes to a different set of parameters included in the original protocol. These two branches can eventually be “merged” to create a new protocol that combines the changes made on both branches. Using the version control system, users may compare the original protocol with the suggested modifications, and see the differences. Users may also download the modified protocol and test it locally using their respective imaging systems. Each user can “vote” on a proposed modification, according to a process that is described in more detail below with respect to
Next, at 215, the Imaging Protocol Server 125 community members (i.e., users of the system) vote for the proposed modification via the webpage on the imaging community site. In some embodiments, community members are sent requests, for example by email, inviting them to vote for the proposed modification to the imaging protocol via the website. In one embodiment, the webpage includes a graphical input which allows community members to select one of a range of values between endorsement and acceptance of the modification as a vote. The website may also allow user to submit additional comments with their votes, for example suggesting additional modifications to the protocol that may then be posted on the website.
Continuing with reference to
Next, at 225, the Imaging Protocol Server 125 determines whether a consensus decision exists among the votes submitted by the community members. A consensus measurement may be determining using all the submitted votes or a subset of the submitted votes. The approach described herein may not impose any thresholds to initiate a consensus measurement since the decision is not solely made by the majority of the votes. Making decisions based on the majority of the votes may polarize the community rather than reaching the consensus. The use of consensus, as described herein, may be contrasted with open source approaches like Linux, or GNU is Not UNIX (GNU) that often do not implement strict measures for quality of modifications, or implement approval processes using steering committees. Steering committees impose theirs decisions on users' communities, rather than seeking consensus of a user's community. Therefore, the open source approach is not well suited for medical imaging community that includes multiple groups with similar aims to reach, often with conflicting methods in optimization strategies that may even lead to polarization rather than consensus of a community. Additionally, those steering committees may disband due to internal conflicts, thereby inflicting damage to the community. On the other hand, using the consensus as a quality metric can help guarantee the coalescence of the entire medical imaging community over a protocol modification. In some embodiments, any addition of a new imaging protocol or removal of an existing imaging protocol (or set of protocol) must undergo a consensus evaluation process as well.
In some embodiments, to determine whether consensus exists at 225, a distribution of the votes submitted by the community members is calculated. This process, along with some illustrative examples, is described in greater detail below with reference to
Returning to
Continuing with reference to
As shown in
The processors 1220 may include one or more central processing units (CPUs), graphical processing units (GPUs), or any other processor known in the art. More generally, a processor as used herein is a device for executing machine-readable instructions stored on a computer readable medium, for performing tasks and may comprise any one or combination of, hardware and firmware. A processor may also comprise memory storing machine-readable instructions executable for performing tasks. A processor acts upon information by manipulating, analyzing, modifying, converting or transmitting information for use by an executable procedure or an information device, and/or by routing the information to an output device. A processor may use or comprise the capabilities of a computer, controller or microprocessor, for example, and be conditioned using executable instructions to perform special purpose functions not performed by a general purpose computer. A processor may be coupled (electrically and/or as comprising executable components) with any other processor enabling interaction and/or communication there-between. A user interface processor or generator is a known element comprising electronic circuitry or software or a combination of both for generating display images or portions thereof. A user interface comprises one or more display images enabling user interaction with a processor or other device.
Continuing with reference to
The computer system 1210 also includes a disk controller 1240 coupled to the system bus 1221 to control one or more storage devices for storing information and instructions, such as a magnetic hard disk 1241 and a removable media drive 1242 (e.g., floppy disk drive, compact disc drive, tape drive, and/or solid state drive). The storage devices may be added to the computer system 1210 using an appropriate device interface (e.g., a small computer system interface (SCSI), integrated device electronics (IDE), Universal Serial Bus (USB), or FireWire).
The computer system 1210 may also include a display controller 1265 coupled to the system bus 1221 to control a display 1266, such as a cathode ray tube (CRT) or liquid crystal display (LCD), for displaying information to a computer user. The computer system includes an input interface 1260 and one or more input devices, such as a keyboard 1262 and a pointing device 1261, for interacting with a computer user and providing information to the one or more processors 1220. The pointing device 1261, for example, may be a mouse, a light pen, a trackball, or a pointing stick for communicating direction information and command selections to the one or more processors 1220 and for controlling cursor movement on the display 1266. The display 1266 may provide a touch screen interface which allows input to supplement or replace the communication of direction information and command selections by the pointing device 1261.
The computer system 1210 may perform a portion or all of the processing steps of embodiments of the invention in response to the one or more processors 1220 executing one or more sequences of one or more instructions contained in a memory, such as the system memory 1230. Such instructions may be read into the system memory 1230 from another computer readable medium, such as a magnetic hard disk 1241 or a removable media drive 1242. The hard disk 1241 may contain one or more datastores and data files used by embodiments of the present invention. Datastore contents and data files may be encrypted to improve security. The processors 1220 may also be employed in a multi-processing arrangement to execute the one or more sequences of instructions contained in system memory 1230. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions. Thus, embodiments are not limited to any specific combination of hardware circuitry and software.
As stated above, the computer system 1210 may include at least one computer readable medium or memory for holding instructions programmed according to embodiments of the invention and for containing data structures, tables, records, or other data described herein. The term “computer readable medium” as used herein refers to any medium that participates in providing instructions to the one or more processors 1220 for execution. A computer readable medium may take many forms including, but not limited to, non-transitory, non-volatile media, volatile media, and transmission media. Non-limiting examples of non-volatile media include optical disks, solid state drives, magnetic disks, and magneto-optical disks, such as hard disk 1241 or removable media drive 1242. Non-limiting examples of volatile media include dynamic memory, such as system memory 1230. Non-limiting examples of transmission media include coaxial cables, copper wire, and fiber optics, including the wires that make up the system bus 1221. Transmission media may also take the form of acoustic or light waves, such as those generated during radio wave and infrared data communications.
The computing environment 1200 may further include the computer system 1210 operating in a networked environment using logical connections to one or more remote computers, such as remote computer 1280. Remote computer 1280 may be a personal computer (laptop or desktop), a mobile device, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to computer system 1210. When used in a networking environment, computer system 1210 may include modem 1272 for establishing communications over a network 1271, such as the Internet. Modem 1272 may be connected to system bus 1221 via user network interface 1270, or via another appropriate mechanism.
Network 1271 may be any network or system generally known in the art, including the Internet, an intranet, a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), a direct connection or series of connections, a cellular telephone network, or any other network or medium capable of facilitating communication between computer system 1210 and other computers (e.g., remote computing 1280). The network 1271 may be wired, wireless or a combination thereof. Wired connections may be implemented using Ethernet, Universal Serial Bus (USB), RJ-6, or any other wired connection generally known in the art. Wireless connections may be implemented using Wi-Fi, WiMAX, and Bluetooth, infrared, cellular networks, satellite or any other wireless connection methodology generally known in the art. Additionally, several networks may work alone or in communication with each other to facilitate communication in the network 1271.
An executable application, as used herein, comprises code or machine readable instructions for conditioning the processor to implement predetermined functions, such as those of an operating system, a context data acquisition system or other information processing system, for example, in response to user command or input. An executable procedure is a segment of code or machine readable instruction, sub-routine, or other distinct section of code or portion of an executable application for performing one or more particular processes. These processes may include receiving input data and/or parameters, performing operations on received input data and/or performing functions in response to received input parameters, and providing resulting output data and/or parameters.
A graphical user interface (GUI), as used herein, comprises one or more display images, generated by a display processor and enabling user interaction with a processor or other device and associated data acquisition and processing functions. The GUI also includes an executable procedure or executable application. The executable procedure or executable application conditions the display processor to generate signals representing the GUI display images. These signals are supplied to a display device which displays the image for viewing by the user. The processor, under control of an executable procedure or executable application, manipulates the GUI display images in response to signals received from the input devices. In this way, the user may interact with the display image using the input devices, enabling user interaction with the processor or other device.
The functions and process steps herein may be performed automatically, wholly or partially in response to user command. An activity (including a step) performed automatically is performed in response to one or more executable instructions or device operation without user direct initiation of the activity.
The system and processes of the figures are not exclusive. Other systems, processes and menus may be derived in accordance with the principles of the invention to accomplish the same objectives. Although this invention has been described with reference to particular embodiments, it is to be understood that the embodiments and variations shown and described herein are for illustration purposes only. Modifications to the current design may be implemented by those skilled in the art, without departing from the scope of the invention. As described herein, the various systems, subsystems, agents, managers and processes can be implemented using hardware components, software components, and/or combinations thereof. No claim element herein is to be construed under the provisions of 35 U.S.C. 112, sixth paragraph, unless the element is expressly recited using the phrase “means for.”