Patent Application
20080144897
The present invention relates generally to the field of medical image processing. More particularly, the invention relates to techniques for accessing, pre-processing, and finally processing medical images, such as through reads by radiologists and other medical professionals.
In a field of medical diagnostic imaging, many processes are known for generating images and for managing their distribution and use. For example, a number of imaging modalities are currently available, such as magnetic resonance imaging (MRI), computed tomography (CT), positron emission tomography (PET), ultrasound, X-ray, X-ray tomosynthesis, and so forth. In general, patients undergo such examinations to identify anatomical structures and to enable medical professionals to evaluate the anatomical features and functions for health and possible disease states, as well as response to treatment, and so forth.
In a common scenario, digital information is gathered from one of the imaging modalities mentioned above and raw image data is processed to create data that can be reconstructed into useful images. For digital systems, which now dominate the medical diagnostic medical field, the resulting image sets, typically end in the form of series of images taking during an imaging or an examination session, are stored in a large capacity memory device, such as a picture archiving and communications system (PACS). The images can be retrieved from the PACS system for pre-processing, for reading by a radiologist, and so forth. In general, some processing may be done on the image data at the imaging system itself. However, more sophisticated pre-processing is often handled by clinicians or technicians who access the data at a workstation to make the most efficient use of the time of the physician or radiologist. The images are then re-accessed by the radiologist who can more carefully examine the pre-processed images for normal and diseased tissues, progress or response to treatments, and so forth. Radiologists also typically annotate images either with text, markers on the images themselves, or a combination of inputs that memorialize the analysis made during the read.
Radiology department workflow in a typical hospital or other imaging center, however, requires that many complex analyses be performed on a multitude of different analysis workstations. The process of performing advanced analysis by a radiologist, such as to offer conclusions and treatment recommendations to referring physicians, is typically done locally at a dedicated advanced application workstation. However, as noted above, the process is usually facilitated by pre-processing of data by a technician, only after which the radiologist typically performs further analysis and storing of the results in the form of annotated screen captures, DICOM (Digital Imaging and Communications in Medicine) reports, dedicated reports, or a combination of these. The output is archived on a long term storage device, such as a PACS system, and can be made available to referring physicians.
Such workflow is, however, in need of improvement. A first issue in this typical workflow is the inconvenience cost to radiologists and technicians who essentially access and analyze the image data sequentially, at one or more advanced application workstations. There is, at present, no convenient mechanism for enabling the radiologist and technician to simply communicate when pre-processing has been completed. Even once the radiologist is informed that pre-processing is complete and that the image data is ready for analysis, the radiologist must typically log into the hospital system and manually locate an appropriate file to reload the images before analysis can be performed. This process can be time consuming and could lend itself to errors in appropriately locating the pre-processed file.
Moreover, the present workflow does not facilitate distributing reports, recommendations or other results of the analysis by radiologists to referring physicians. While the radiologists may dictate reports, save static screen captures, movie loops of key pathologies, and so forth on web servers, a referring physician, if able to access the data at all, must carefully navigate to the processed data files. In general, the referring physician cannot interact with the image data and the radiologist must directly answer any questions regarding conclusions or recommendations in person or via telephone conference.
There is, therefore, significant need for improvement in the processing and workflow of medical image data that can address such issues.
The present invention provides a technique for processing medical image data designed to respond to these needs. In general, the technique may be used in a number of settings, including individual institutions, departments within institutions, and particularly between institutions, where technicians, radiologists, referring physicians and patients are not conveniently located or do not have sufficient time for direct interaction. The invention may be used with any type of medical image data acquired from any modality, and stored in a common memory location, such as a PACS system or any other suitable location.
In accordance with one exemplary embodiment medical image data is stored for retrieval, and processing. The medical image data is then accessed from a shared memory device and the image data is processed. Save-state information is generated and stored s based upon the processing. An electronic message is generated and sent an following processing the image data, the message indicating that processing of the image data has been performed, and including a link to the save-state information. The state of the processing is then restored by accessing the save-state information via the link from the message.
In accordance with another exemplary embodiment, medical image data is accessed from a shared memory device. The data is then processed, and save-state information is generated based upon the processing, the save-state information including at least information needed to restore an application used to process the image data to the state prior to saving the state. The save-state information is then stored in the shared memory device, and an electronic message is generated and sent following processing the image data, the message indicating that processing of the image data has been performed, and including either embedded save-state information or a link to the save-state information. The save-state information is then accessed via selection of the embedded information or the link from the message, and the image is further processed beginning with the state defined by the save-state information, and the image data and state may again be stored.
In yet another embodiment, medical image data is accessed from a shared memory device, and processed. Save-state information is generated based upon the processing, the save-state information including at least information needed to restore an application used to process the image data to the state prior to saving the state. The save-state information is stored in the shared memory device. A DICOM note is updated indicating the state of the save-state information, the DICOM note including a link to the save-state information. From the DICOM note, then, a user may determine that the processed image data is ready for further processing. The save-state information may be accessed via the link, and further processing the image data may be performed beginning at a processing state based upon the save-state information. Finally, the further processed image data may be stored in the shared memory device.
Software and systems for carrying out functionalities of the type summarized above are also provided.
These and other features, aspects, and advantages of the present invention will become better understood when the following detailed description is read with reference to the accompanying drawings in which like characters represent like parts throughout the drawings, wherein:
Turning now to the drawings, and referring first to
Image data files resulting from imaging sequences at imaging system 12, designated generally by reference numeral 18, will be stored by the operator interacting with workstation 16 at a shared memory device. Such memory devices may include any suitable type of memory, but most medical institutions will prefer shared memory systems for storage of large files for extended durations. In the present context, a convenience storage device is a picture archiving and communications system (PACS) 20 which can be located at a medical institution, such as in a radiology department, or at a remote location. Indeed, a number of imaging systems 12 may be interfaced with such storage devices, and many associated storage devices may be used for the invention. The PACS system 20, itself, may include a number of individual storage devices which are networked to one another for management of the image data files 18.
The system 10 also includes a number of digital tools used to store, pre-process the image data files, as well as to facilitate their management and the workflow described below. In the illustrated embodiment, the PACS system 20 will store image files 22 which may be at various stages of processing, as described below. In general, these files may be stored in accordance with convenient formats, typically conforming to standards known in the field as DICOM standards. As will be appreciated by those skilled in the art, such standards have greatly facilitated the formatting, distribution, and viewing of medical images, and provide some degree of standardization for such images, in addition to certain information relating to acquisition dates, processing dates, modality, and so forth. The image files 22 will typically be stored and associated with one another such that images saved from an examination of a patient in a particular session will be associated with one another for pre-processing, processing, and reading by radiologists. The images may also be associated in such a way to permit two-dimensional, three-dimensional, or four-dimensional (including a temporal dimension) reconstruction, processing and viewing.
The shared memory device 20 also includes save-state files or information 24. As will be appreciated by those skilled in the art, save-state technology enables certain states of an application or a system running an application to be stored for later placing the same or a different computer in the same or a similar state for further processing via the application. In general, save-state information 24 may include such information as the address and contents of registers and internal states of a central processing unit or other processor, information regarding operation of particular circuits in a computer, such as sound cards, video cards, and so forth, contents of some or all random access memory, including video, palette data and so forth, timing information, states of any peripheral devices, such as programmable read only memory, controllers, and so forth, currently selected states of memory banks for random access and read only memory, and states of any driver-specific devices. In a presently contemplated embodiment, for example, the save-state information 24 may include any information needed to restore an application, particularly the image processing application, to the state prior to performing the save-state action. Examples of such information might include the layout of the images displayed to the user, the display settings, and any segmentation or analysis done on the data.
In one particular embodiment contemplated for the invention, the same storage system 20, or another storage system may include a shared software suite 26. The software suite 26 may include application files that can be run from a shared server and that enable the pre-processing and processing described below. The use of shared server-run applications may facilitate restoring a previous state to an application in order to greatly facilitate further pre-processing or processing of image data files based upon a save-state information.
Further, the system 20 may include DICOM notes 28 for some or all of the image data files 22. As will be appreciated by those skilled in the art, such notes may be included in various types of text or reports that may be created and formatted in accordance with DICOM standards. By way of example, the notes may be a part of a structured report (SR), of which there are basic types, including basic text SR and enhanced SR files. In a particular implementation presently contemplated, the DICOM notes may include key image notes formed in accordance with DICOM standards. As will be appreciated by those skilled in the art, such key image notes are typically stored in the image archive along with the image files or image date itself, such as on PACS system 20. As described more fully below, the DICOM notes enable queries to be performed, and may summarize the state of pre-processing or processing of particular image data, or sets of files or data to facilitate workflow in accordance with the present invention. Such notes, configured in accordance with the structured reporting capabilities of DICOM, may enable messages to be conveyed between those professionals able to access the notes and image data as discussed below. Moreover, in accordance with the invention, save-state information 24 may either be embedded within or links to such save-state information may be provided within the DICOM notes for easy and ready access by subsequent service provider in the workflow chain.
In general, the images which can be reconstructed from the image data files 18 will consist of images that are sufficiently complex to require pre-processing, or sequential steps in processing. Presently contemplated image data, for example, may include multi-dimensional image data, such as three-dimensional, or image data that can be rendered in three-dimensions. Other, two-dimensional files, and four-dimensional data may, of course, be accommodated by the present techniques.
The workflow improvements offered by the invention essentially allow for technicians, clinicians, radiologists and referring physicians to interact with one another by means of the save-state information created and stored in a common or accessible memory space. The invention may make use of a database that contains user information for such service providers, such as electronic mail address, a suite of advanced processing applications that are capable of saving a state of any processing done to images being analyzed, a mechanism to remotely access the advanced applications and data, as well as an application to send electronic notifications related to the state of processing done on the image data set.
As illustrated in
Following pre-processing at workstation 30, the pre-processed image files or data 34 are again stored on the PACS system 20, as part of the exam files 22. Moreover, in accordance with aspects of the present technique, a DICOM note 28 may be created or added, indicating that such pre-processing has been complete, and the pre-processed image data are available for review by the radiologist. Additional description of this aspect of the invention are provided below with reference to
Following review by the clinician 32, an electronic message may be generated and conveyed to that radiologist as indicated generally by reference numeral 36. Such messages may be formatted and configured in accordance with standard electronic messaging protocols, such as STMP. Moreover, it should be recognized that the clinician 32 may direct such messages to the radiologist individually, or as it should be understood in the present context, to the radiologist by means of the practice, staff, institution or other extended entity associated with the radiologist. When reference is made in the present discussion or claims to messages directed to or from individuals, it should be understood that such messages can be compiled by, sent by and directed to those particular individuals or to their related staff or organizations.
In addition to storing pre-processed image data 34, the pre-processing workstation 30 generates a save-state information 24 and stores the file in a common memory device, such as PACS system 20. The ability to save the state may be provided by application itself, or by other software running on or commanded by the pre-processing workstation 30. Moreover, the save-state information 24 may be intimately associated with the pre-processed image data 34. Alternatively, the save-state information may simply save states of the advanced application used to pre-process and later to process the image data.
The electronic message 36, when conveyed from the pre-processing workstation to the radiologist as described above, may include a message file 38 which itself includes a save-state information 24 or, as in a presently contemplated embodiment, a link 40 to the save-state information. This link will typically include a URL address back to the storage device 20 and will cause an instance of the application used to process the image data to be opened and to return to the saved state in accordance with the save-state information. Moreover, as described more fully below, a similar link may be provided in a DICOM note 28, enabling the radiologist or any other medical professional enabled (e.g., permitted) to pre-process or process the image data files or to view the processed states of the files to access the files, and the saved states of the application by simply clicking on or otherwise executing the link.
A radiologist workstation 42 may be generally similar to the pre-processing workstation 30, and will enable a radiologist 42 to access the pre-processed image data and to further analyze the images, finally processing the images, such as by the addition of annotations, highlights, textual and auditory analyses, and so forth. In a presently contemplated embodiment, and summarized more fully below, two techniques are contemplated for facilitating this workflow. In a first, the radiologist 44 simply opens the save-state information 24 with any linked exam files in the form or pre-processed image data 34. This may be done via the electronic message 38 which either includes those files embedded therein or a link 40 to the files stored on the shared memory device. In a second approach, the radiologist may access DICOM key image notes 28 which, themselves, may include links to the pre-processed image data and the state of the application used to perform the analyses. Following further analysis and processing of the image data, then, the radiologist 44 may restore the processed image files or data 46 to the shared memory device 20. Moreover, a message 48 may be generated by the same technique described above, and sent to further professionals in the workflow chain, particularly to a referring physician.
In the same manner as described above, a referring physician workstation 52 may be provided, at which a referring physician 54 may access images, annotations, suggested treatments, and any other information provided by the radiologist 44. This may be performed both by accessing image data and related data directly from electronic message 48, such as via links 50 or embedded files in the message, or by access to DICOM key image notes 28 as described above. Where appropriate, limited access files 56 may be provided to the referring physician, wherein some but not all of the pre-processing or processing capabilities are enabled via the advanced application. Moreover, where the referring physician has no need to perform further analysis or manipulation of the images, access to the application and even the save-state files or information may not be required, and images may be conveyed in accordance with conventional telemedicine or teleradiology techniques.
As also noted above, then, the pre-processing steps 62 include access of the image data file from the shared memory device as indicated at step 70. An application is then initiated for pre-processing the image data file. As indicated at step 72 in
The processing steps 64 may then be initiated at the convenience of the radiologist, without requiring the radiologist to search for and manually access either the pre-processed files themselves or to set the application back into a state or condition in which it was last found when the pre-processing was completed by the clinician. In particular, the state may be restored by the radiologist accessing the electronic messages indicated at step 80, followed by accessing the saved state of the application via the embedded file or link, as summarized at step 82. Once the file or link has been selected (e.g., clicked on) by the radiologist, then, the application for processing the pre-processed image data is initiated as indicated at step 84. As noted above, the application is restored to the state in which it was found following pre-processing, as summarized by the save-state information. As also noted above, the application which is restored to such state may operate (i.e., run) either on the local workstation or on the server. The radiologist then completes the annotation and processing of the image data file in a manner similar to that used in the prior art as indicated at step 86. However, following such processing, the radiologist may once again save the state of the application, as indicated at step 88. This saving of the state may be similar or identical to that performed at step 76, and will capture not only the image data then being processed, but certain aspects of the state of the application upon completion of the processing. Finally, as indicated at step 90 in
The pre-processing steps summarized in
The processing steps 96, then, may begin with the radiologist or a radiologist assistant simply opening a browser on the processing workstation to be used by the radiologist, as indicated at step 100. At step 102, then, the key image notes may be sorted so as to group pre-processed image files or data (typically grouped by exam sequences for particular exam sessions and patients). This sorting will effectively produce a work list for the radiologist who may then access both the pre-processed images and the saved state of the application by simply selecting a link provided in the DICOM note as indicated at step 104. Once the radiologist has accessed the pre-processed images and the saved state of the application, then, the application may be run either on the processing workstation or from the server, followed by the processing as indicated at steps 84, 86 and 88, which may be essentially identical to those described above with reference to
While only certain features of the invention have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.
