This invention concerns a medical image data processing and image viewing system for automatically presenting individual frames of a reduced resolution video clip at full-resolution, for example, in response to user navigation commands.
Diagnosing physicians frequently view video clips created by medical imaging devices (e.g., an ultrasound machine, X-Ray Angiography unit, MR device, CT scan device). These clips are large and are typically unable to be quickly transferred at full resolution to a physician over limited-bandwidth networks (e.g. Cable/DSL modems commonly used to access the World-Wide Web). Compressing the medical video clips enables them to be transferred relatively quickly, but risks losing valuable image diagnostic information. Further, a compressed video clip does not provide a physician with any indication of what information might have been lost and the physician has no way to evaluate diagnostic impact of the video compression.
Brightness and contrast adjustment of a compressed video clip is also difficult because brightness and contrast adjustment is used to enhance the information that tends to get lost in compression. Known diagnostic imaging systems rely on expensive ultra-high speed networks to transfer video clips at full resolution and require expensive high-speed (e.g. fiber-optic) networks, or are slow to load and play the video clips. The use of video compression and low-bandwidth networks by known systems also results in loss of image fidelity. A system according to invention principles addresses these deficiencies and related problems.
A system enables a diagnosing physician to view diagnostic video clips over limited-bandwidth networks as well as individual frames of a clip at full-resolution and to assess an effect of video clip data compression on diagnosis and perform video image brightness and contrast adjustment at full image resolution. A medical image data processing and image viewing system includes an acquisition processor for acquiring image data representing a sequence of reduced resolution medical images and corresponding full resolution medical images. An image navigation processor detects, a pause in user navigation through the sequence of reduced resolution medical images and continued presentation of a particular reduced resolution medical image of the sequence on a display. An acquisition control processor automatically initiates acquisition by the acquisition processor of data representing a full resolution medical image corresponding to the particular reduced resolution medical image for presentation on the display in response to a detected pause. A display processor initiates generation of data representing a composite display image including at least one of the particular reduced resolution medical image and the corresponding full resolution medical image.
A system enables a diagnosing physician to view diagnostic video clips over limited-bandwidth networks as well as to view individual frames of the clip at full-resolution and to assess the effect of video clip data compression on the diagnosis. The system also enables a physician to perform video image brightness and contrast adjustment at full image resolution.
System 10 supports sharing of DICOM compatible or non-DICOM compatible medical images, video clips and related data by different computer systems. Client devices 5 (e.g., workstations or portable devices such as notebooks, Personal Digital Assistants, phones) individually include, display 12, acquisition processor 15, image navigation processor 20. acquisition control processor 23, display processor 25, contrast processor 30, communication processor 33 and internal memory (not shown to preserve drawing clarity). Server 7 includes data processor 47, repository 17 and communication interface 45. Display processor 25 provides data representing display images comprising a Graphical User Interface (GUI) for presentation on display 12. At least one repository 17 stores DICOM compatible and/or non-DICOM compatible data and medical image studies and full and reduced resolution (compressed) video clips for multiple patients. A medical image study individually includes multiple image series of a patient anatomical portion which in turn individually include multiple images and may include DICOM structured reports.
Acquisition processor 15 acquires image data representing a sequence of reduced resolution (compressed) medical images (a video clip) and corresponding full resolution medical images. Image navigation processor 20 detects, a pause in user navigation through the sequence of reduced resolution medical images and continued presentation of a particular reduced resolution medical image of the sequence on display 12. Acquisition control processor 23 automatically initiates acquisition by acquisition processor 15 of data representing a full resolution medical image corresponding to the particular reduced resolution medical image for presentation on display 12 in response to a detected pause. Display processor 25 initiates generation of data representing a composite display image including at least one of the particular reduced resolution medical image and the corresponding full resolution medical image. Contrast processor 30 acquires data indicative of user adjusted contrast of the corresponding full resolution medical image in response to user data entry via at least one displayed image. Communication processor 33 initiates communication of the acquired data indicative of user adjusted contrast to a processing device (e.g., server 7) via network 21.
In response to pausing the video clip, navigation buttons 409 and 413 become active to allow the user to scroll to nearby frames. Client device 5 displays the paused compressed reduced resolution image frame of
Device 5 in step 212 automatically begins downloading the paused frame from server 7 at full-resolution as well as full-resolution versions of frames nearby the paused frame in step 218 in response to a message request for full-resolution versions of the nearby frames communicated from device 5 to server 7 in step 215 using communication processor 33. Device 5 automatically updates display 12 to replace the paused compressed reduced resolution image frame with an acquired corresponding uncompressed full-resolution image frame.
A user adjusts the contrast of the paused image frame of
In step 227 device 5 communicates a message to server 7 indicating nearby images of a paused frame are no longer needed and server 7 terminates communication of nearby frames. In step 230 device 5. In response to the user pausing the re-started compressed reduced resolution video clip with enhanced contrast levels at another image of interest, device 5 in step 230 automatically initiates downloading the paused frame from server 7 at full-resolution with the enhanced contrast levels as well as full-resolution versions of frames nearby the paused frame. Device 7 identifies and extracts the paused frame and nearby frames with full resolution and enhanced contrast levels from a full resolution clip having the adjusted enhanced contrast levels in response to a message request automatically communicated from device 5 to server 7 in step 230 using communication processor 33. Data processor 47 of device 7 identifies and extracts the paused frame and nearby frames with full resolution and enhanced contrast levels from a full resolution clip having the adjusted enhanced contrast levels in response to the message request automatically communicated from device 5 to server 7 in step 230 using communication processor 33. Device 5 automatically updates display 12 to replace the paused enhanced contrast compressed reduced resolution image frame with an acquired corresponding enhanced contrast uncompressed full-resolution image frame. A user is able to advantageously toggle between full and corresponding reduced resolution images to see if there is any diagnostically significant difference between the images using change resolution button 420 of
System 10 enables networks of limited-bandwidth to view medical images and clips and enables individual image frames to be viewed at full-resolution. Spare bandwidth is used to pre-fetch frames before and after a paused frame. When full resolution images of nearby frames become available, additional buttons are enabled that allow the user to step to nearby frames. The system reduces time to transfer compressed video clips to a diagnosing user and the user may play the clip, or pause it and view individual frames at full-resolution. System 10 also enables brightness and contrast adjustment to be performed on a full-resolution image and applied to an entire video clip. The user is able to also perform brightness and contrast adjustment on a single-frame full-resolution image, and play the compressed clip at the new window-level settings. Further, a physician by toggling between full and reduced resolution images, is able to assess the effect of video clip data compression and its impact on diagnosis. The system advantageously enables a diagnosing user to review diagnostic video clips acquired over inexpensive and widely available networks and view pertinent frames at full-resolution, and assess whether a diagnosis is being compromised by the image compression. User interface buttons enable a user to examine nearby frames at high-resolution. The system advantageously displays a few full-resolution frames from a video consisting of a large collection of compressed frames. The system also advantageously combines compressed video clips with individual uncompressed frames. In operation, a user at home receives a phone call from a referring user requesting review of an ultrasound or other imaging modality video clip. The user connects to a hospital PACS server using a home PC via a cable or DSL modem and reviews the diagnostic images and makes a diagnosis over the phone.
In step 817 communication processor 33 automatically communicates command data to a processing device (server 7) via a communication link (e.g., network 21) to initiate communication to device 5 from server 7 of data representing the full resolution medical image corresponding to the particular reduced resolution medical image in response to the detected pause. In step 819 acquisition control processor 23 automatically initiates acquisition by acquisition processor 15 of data representing a full resolution medical image corresponding to the particular reduced resolution medical image for presentation on display 12 in response to a detected pause as a pre-fetch operation for storage in local memory. Acquisition control processor 23 also automatically initiates acquisition by acquisition processor 15 of data representing a full resolution medical image corresponding to at least one nearby image of the particular reduced resolution medical image for presentation on display 12 in response to a detected pause. Further, image navigation processor 20 enables a user to scroll to the full resolution medical image corresponding to at least one nearby image. Display processor 25 in step 821 automatically initiates generation of data representing a composite display image including at least one of the particular reduced resolution medical image and the corresponding full resolution medical image. The composite display image includes a user selectable image element enabling user toggling between display of the particular reduced resolution medical image and the corresponding full resolution medical image. The composite display image includes a user selectable image element enabling a user to compare the particular reduced resolution medical image with the corresponding full resolution medical image and includes a user selectable image element enabling a user to initiate communication of the particular reduced resolution medical image to a remotely located medical worker.
Contrast processor 30 in step 825 acquires data indicative of user adjusted contrast of the corresponding full resolution medical image in response to user data entry via at least one displayed image. In step 829 communication processor 33 automatically communicates the acquired data indicative of user adjusted contrast to server 7 via network 21. Acquisition processor 15 acquires image data representing a reduced resolution medical image processed in response to the acquired data indicative of user adjusted contrast and automatically communicated by server 7 to acquisition processor 15. The process of
Data processor 47 provides the image data representing the sequence of reduced resolution medical images by compressing data representing a sequence of full resolution medical images corresponding to the sequence of reduced resolution medical images. Data processor 47 automatically communicates to client device 5, data representing at least one full resolution medical image corresponding to at least one nearby image of the particular reduced resolution medical image. Also communication interface 45 acquires data indicative of user adjusted contrast of the corresponding full resolution medical image. Data processor 47 processes data representing a sequence of full resolution medical images corresponding to the sequence of reduced resolution medical images as well as data representing the sequence of reduced resolution medical images in response to the acquired data indicative of user adjusted contrast. Data processor 47 provides contrast adjusted image data representing the sequence of reduced resolution medical images by compressing the processed data representing the sequence of full resolution medical images. The process of
A processor as used herein is a device for executing machine-readable instructions stored on a computer readable medium, for performing tasks and may comprise any one or combination of, hardware and firmware. A processor may also comprise memory storing machine-readable instructions executable for performing tasks. A processor acts upon information by manipulating, analyzing, modifying, converting or transmitting information for use by an executable procedure or an information device, and/or by routing the information to an output device. A processor may use or comprise the capabilities of a controller or microprocessor, for example, and is conditioned using executable instructions to perform special purpose functions not performed by a general purpose computer. A processor may be coupled (electrically and/or as comprising executable components) with any other processor enabling interaction and/or communication there-between. A user interface processor or generator is a known element comprising electronic circuitry or software or a combination of both for generating display images or portions thereof. A user interface comprises one or more display images enabling user interaction with a processor or other device.
An executable application, as used herein, comprises code or machine readable instructions for conditioning the processor to implement predetermined functions, such as those of an operating system, a context data acquisition system or other information processing system, for example, in response to user command or input. An executable procedure is a segment of code or machine readable instruction, sub-routine, or other distinct section of code or portion of an executable application for performing one or more particular processes. These processes may include receiving input data and/or parameters, performing operations on received input data and/or performing functions in response to received input parameters, and providing resulting output data and/or parameters. A user interface (UI), as used herein, comprises one or more display images, generated by a user interface processor and enabling user interaction with a processor or other device and associated data acquisition and processing functions.
The UI also includes an executable procedure or executable application. The executable procedure or executable application conditions the user interface processor to generate signals representing the UI display images. These signals are supplied to a display device which displays the image for viewing by the user. The executable procedure or executable application further receives signals from user input devices, such as a keyboard, mouse, light pen, touch screen or any other means allowing a user to provide data to a processor. The processor, under control of an executable procedure or executable application, manipulates the UI display images in response to signals received from the input devices. In this way, the user interacts with the display image using the input devices, enabling user interaction with the processor or other device. The functions and process steps herein may be performed automatically or wholly or partially in response to user command. An activity (including a step) performed automatically is performed in response to executable instruction or device operation without user direct initiation of the activity.
The system and processes of
This is a non-provisional application of provisional application Ser. No. 61/104,318 filed Oct. 10, 2008, by D. Ei et al.
Number | Date | Country | |
---|---|---|---|
61104318 | Oct 2008 | US |