Patent Application
20110176711
Embodiments of the present invention relate generally to a mechanism of more efficiently rendering multi-planar reconstructions (MPRs) and, more particularly, relate to a method, apparatus and computer program product for efficiently transferring medical images of a dataset to a device for diagnosis of one or more of the images prior to receipt of the entire dataset of images.
Advances in processor, networking and other related technologies have led to increased networked computing and abundant availability of content on private and public networks. Users may access the available content from computing devices remote from the content storage and interact with the content using their local computing device. A particularly relevant example is medical imaging, in which radiologists and other physicians may access and manipulate medical images as part of diagnostic interpretation. These medical images may be part of a volume of data images (e.g., radiographic images) to be reformatted in various planes or may be part of volumetric data or representations of structures such as for example parts of a human body. In this regard, the medical images may be images of the body generated from radiography, ultrasound, magnetic resonance imaging or any other medical imaging technique. The medical images may be received by devices such as for example workstations of the radiologists or other physicians from a remote computing device such as a server. These workstations may render multi-planar reconstructions by displaying one or more two-dimensional images of the volumetric data (e.g., images).
At present, rendering of multi-planar reconstructions on a device such as a workstation typically requires the transfer of large datasets (e.g., images), potentially consisting of thousands of images. It should be pointed out that the time required for a server to transfer these images to the workstation may be significant (e.g., tens of seconds) and may vary depending on the size of the dataset and conditions of a network. However, waiting for the entire dataset to be transferred to the workstation before displaying the multi-planar reconstruction may be undesirable since radiologists and other physicians may desire to examine the images associated with the multi-planar reconstruction as soon as possible. For instance, the radiologists and other physicians may desire to display the multi-planar reconstruction as soon as possible so that they can begin diagnosing the associated images.
Existing solutions for transferring medical images to devices of physicians and for rendering the MPRs on these devices in a timely manner suffer from drawbacks. For instance, typically a server is utilized to render the MPRs and to transfer the rendered image to a device of a physician in order to achieve a short-display time. However, this approach is typically unsuitable for networks that have a high latency and low bandwidth (e.g., low bandwidth capacity) since the network latency (e.g., delay) and/or low network bandwidth may slow the effective transfer speed of the rendered images and hence the displaying of the MPRs on devices of the physicians. Additionally, the number of physician devices that may utilize the server simultaneously for displaying the MPRs are typically limited by the server's capacity. This limitation in the server's capacity may also cause delay in the transfer of the MPRs and the rendering of the MPRs on the devices of the physicians.
In view of the foregoing drawbacks, it may be desirable to provide a mechanism that more efficiently transfers medical images to devices so that the devices may more efficiently render multi-planar reconstructions in a timely manner.
A method, apparatus and computer program product are therefore provided that enable provision of an efficient manner in which to transfer a set of images (e.g., medical images such as for e.g., Digital Imaging and Communications in Medicine (DICOM) images) to a device.
The exemplary embodiments may facilitate transfer of a sparse set (Ss) of images of a dataset of images in response to receipt of a selection for one or more images. The sparse set of images may be a subset of the images of an entire dataset of images defined by a three-dimensional volume. The images of the sparse set may be received by a device in a reduced-quality (e.g., preview quality) prior to the receipt of all the images of the dataset. In this regard, the exemplary embodiments may render a multi-planar reconstruction(s) of the images of the sparse set so that the images may be viewed by a user. In this manner, the exemplary embodiments may minimize the overhead of transferring all the images of a dataset to a device before a user (e.g., physician) may be able to view desired images. It should be pointed out that the exemplary embodiments may, but need not, facilitate display of the reduced-quality (e.g., preview quality) images within two seconds of a user's request or selection for one or more images. The immediate access to view one or more reduced-quality images (e.g., preview-quality images) may allow a user to navigate or manipulate (e.g., changing orientation, rendering parameters and a point(s)-of-interest) the images associated with a multi-planar reconstruction(s) prior to the entire dataset of images being transferred.
After a device receives the sparse set of images, the exemplary embodiments may facilitate transfer of all the images in the dataset. The transfer of all of the images in the dataset may be transferred in a high quality that is sufficient for a user to diagnose these images. It should be pointed out that the transfer of the images in the dataset may be based on a transfer order generated by the exemplary embodiments which may specify the sequence in which the images are to be transferred to a device. In this regard, the exemplary embodiments may generate the transfer order of the images based in part on a proximity to a user-defined or selected point(s)-of-interest. As such, the exemplary embodiments may facilitate transfer of images closer to the point-of-interest with a high quality (e.g., diagnostic display quality) before transfer of images that are peripheral to the proximity of the point-of-interest.
In this regard, the transfer of images proximal to a user-indicated region or point-of-interest may be prioritized so that diagnostic-quality rendering may be quickly achieved at the indicated point-of-interest. As such, diagnosis of one or more images as well as diagnosis of a corresponding person (e.g., patient) associated with the images may commence before the entire dataset of images has been transferred to a device.
Upon receipt of high quality images of the dataset of images, the exemplary embodiments may replace the reduced-quality images with corresponding high quality images. Additionally, the exemplary embodiments may provide a mechanism for tracking or monitoring a point(s)-of-interest (which may be displayed) and may dynamically adjust the transfer order of the images on the basis of the tracked point(s)-of-interest. For instance, when the exemplary embodiments determine that a new point-of-interest is selected by a user or that a point-of-interest has changed, the exemplary embodiments may monitor and detect this new or changed point-of-interest and may dynamically generate a new transfer order.
In one exemplary embodiment, a method for efficiently receiving a set of medical images from a device is provided. The method may include receiving a selection for one or more medical images of a set of medical images and sending a request to a device for transfer of the medical images of the set. The request may include information instructing the device to transfer a subset of the medical images of the set first. The method may further include receiving the subset of medical images in a reduced-quality based on information in the request and displaying the subset of medical images in the reduced-quality. Additionally, the method may include subsequently receiving each of the medical images of the set in a high quality based on an order specifying a sequence in which the medical images of the set are to be transferred and displaying the medical images of the set in the high quality.
In another exemplary embodiment, an apparatus for efficiently receiving a set of medical images from a device is provided. The apparatus includes a processor configured to receive a selection for one or more medical images of a set of medical images and send a request to a device for transfer of the medical images of the set. The request may include information instructing the device to transfer a subset of the medical images of the set first. The processor may also receive the subset of medical images in a reduced-quality based on information in the request and display the subset of medical images in the reduced-quality. Additionally, the processor may subsequently receive each of the medical images of the set in a high quality based on an order specifying a sequence in which the medical images of the set are to be transferred and display the medical images of the set in the high quality.
In yet another exemplary embodiment, a computer program product for efficiently receiving a set of medical images from a device is provided. The computer program product may include at least one computer-readable storage medium having computer-executable program code instructions stored therein. The computer-executable program code instructions may include program code instructions for receiving a selection for one or more medical images of a set of medical images and sending a request to a device for transfer of the medical images of the set. The request may include information instructing the device to transfer a subset of the medical images of the set first. The program code instructions may receive the subset of medical images in a reduced-quality based on information in the request and display the subset of medical images in the reduced-quality. Additionally, the program code instructions may subsequently receive each of the medical images of the set in a high quality based on an order specifying a sequence in which the medical images of the set are to be transferred and display the medical images of the set in the high quality.
Embodiments of the invention may provide a method, apparatus and computer program product for facilitating receipt of high quality images of a dataset of images prior to receipt of the entire dataset of images. As a result, device users may enjoy improvements in diagnosing the images since the user may not be required to wait on the receipt of entire set of images in order to begin diagnosis.
Having thus described the invention in general terms, reference will now be made to the accompanying drawings, which are not necessarily drawn to scale, and wherein:
Some embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which some, but not all embodiments of the invention are shown. Indeed, various embodiments of the invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Like reference numerals refer to like elements throughout. As used herein, the terms “data,” “content,” “information” and similar terms may be used interchangeably to refer to data capable of being transmitted, received and/or stored in accordance with embodiments of the invention. Moreover, the term “exemplary”, as used herein, is not provided to convey any qualitative assessment, but instead merely to convey an illustration of an example. Thus, use of any such terms should not be taken to limit the spirit and scope of embodiments of the invention.
In general, according to various embodiments of the invention, methods, apparatuses, systems and computer program products are provided for varying the quality of one or more images in a dataset of images (e.g., DICOM images). In this regard, the exemplary embodiments may generate one or more reduced-quality images which may be displayed. Upon receipt of improved quality images the reduced-quality images may be replaced with the improved-quality images. The best-available-quality of the images may replace corresponding improved-quality images. The best-available-quality of the images may be displayed and may be used for diagnostic purposes.
Additionally, the exemplary embodiments may receive a subset of medical images of a dataset from a device in which the subset of images may include reduced-quality images. The reduced-quality images may be displayed upon receipt. The remainder of the images of the dataset may be subsequently received and displayed in a progressive manner.
The exemplary embodiments may also continuously monitor a user-indicated point(s)-of-interest and in this regard the exemplary embodiments may replace reduced-quality images in the proximity of the point(s)-of-interest with higher quality images that may be used for diagnostic purposes. In this manner, the density of the images in the proximity of the point(s)-of-interest may be increased at a greater rate than the density of the images in peripheral areas.
Reference is now made to
In an exemplary embodiment, the communication device 145 may send one or more medical images such as for example Digital Imaging and Communications in Medicine (DICOM) images to any of the computing devices 100. The medical images may relate to images of one or more parts (e.g., lungs) of a human body. The medical images as referred to herein may, but need not, be generated by computed tomography (CT), magnetic resonance (MR), radiography, ultrasound, or any other suitable modality. It should be pointed out that the medical images referred to herein may represent anatomic slices and be part of a volume of data which, for example, may be reformatted by multi-planar reconstruction in various planes or rendered as volumetric two-dimensional representations of structures such as one or more parts of a human body, as described more fully below. The slices may, but need not, have different depths with different thicknesses. In this regard, the computing devices 100 may render the multi-planar reconstructions so that the medical images may be shown on a display of the computing devices. In an exemplary embodiment, the medical images of the MPR may be displayed in two-dimensions by the computing devices 100.
For example, the memory may store content transmitted from, and/or received by, the computing device. In an exemplary embodiment, the memory 86 may store one or more medical images (e.g., DICOM medical images). The medical images may be generated by computed tomography (CT), magnetic resonance (MR), radiography, ultrasound, or any other suitable modality and may relate to one or more parts of a human body, as described above.
Also for example, the memory 86 typically stores client applications, instructions or the like for execution by the processor 70 to perform steps associated with operation of the computing device in accordance with embodiments of the invention. As explained below, for example, the memory 86 may store one or more client application(s) such as for example software (e.g., computer code).
The processor 70 may be embodied in a variety of ways. For instance, the processor 70 may be embodied as a controller, coprocessor, microprocessor of other processing devices including integrated circuits such as for example an application specific integrated circuit (ASIC), a field programmable gate array (FPGA). In an exemplary embodiment, the processor may execute instructions stored in the memory 86 or otherwise accessible to the processor 70.
The computing device 100 may include one or more logic elements for performing various functions of one or more client application(s). In an exemplary embodiment, the computing device 100 may execute the client application(s). The logic elements performing the functions of one or more client applications can be embodied in an integrated circuit assembly including one or more integrated circuits (e.g., an ASIC, FPGA or the like) integral or otherwise in communication with a respective network entity (e.g., computing system, client, server, etc.) or more particularly, for example, a processor 70 of the respective network entity.
In addition to the memory 86, the processor 70 may also be connected to at least one interface or other means for displaying, transmitting and/or receiving data, content or the like. The interface(s) can include at least one communication interface 88 or other means for transmitting and/or receiving data, content or the like. In this regard, the communication interface 88 may include, for example, an antenna and supporting hardware and/or software for enabling communications with a wireless communication network. For example, the communication interface(s) may include a first communication interface for connecting to a first network, and a second communication interface for connecting to a second network. In this regard, the computing device is capable of communicating with other electronic devices (e.g., other communication devices 100 and communication device 145) over one or more networks (e.g., network 140) such as a Local Area Network (LAN), wireless LAN (WLAN), Wide Area Network (WAN), Wireless Wide Area Network (WWAN), the Internet, or the like. Alternatively, the communication interface can support a wired connection with the respective network. In an exemplary embodiment, the computing device 100 may receive one or more medical images (e.g., a set of medical images) from a device(s) (e.g., communication device 145) via the communication interface 88.
In addition to the communication interface(s), the interface(s) may also include at least one user interface that may include one or more earphones and/or speakers, a display 80, and/or a user input interface 82. The user input interface, in turn, may comprise any of a number of devices allowing the computing device to receive data from a user, such as a microphone, a keypad, keyboard, a touch display, a joystick, image capture device, pointing device (e.g., mouse), stylus or other input device. In an exemplary embodiment, one or more medical images may be shown on the display 80 and a user (e.g., a physician) may utilize the user input interface 82 to select one or more points-of-interest (POIs) on the medical images. For instance, the user may utilize a pointing device (e.g., mouse) or the like to select POIs of an image. Additionally, the user may select a POI(s) by using a stylus, pen, finger or the like to contact an area of one or more images on a touch display of the user input interface 82. It should also be pointed out that selection of a point(s)-of-interest may be performed by an eye-tracking mechanism such as, for example, tracking a user's point of gaze. The points-of interest may, but need not, be areas of the images that the user would like to evaluate or examine. For instance, the user may select a point(s)-of-interest on one or more medical images for diagnostic purposes.
In an exemplary embodiment, the processor 70 may in communication with and may otherwise control a multi-planar reconstruction (MPR) renderer 78. The MPR renderer 78 may be any means such as a device or circuitry operating in accordance with software or otherwise embodied in hardware or a combination of hardware and software thereby configuring the device or circuitry (e.g. a processor or controller) to perform the corresponding functions of the MPR renderer 78 as described below. In examples in which software is employed, a device or circuitry (e.g., processor 70 in one example) executing the software forms the structure associated with such means. As such, for example the MPR renderer 78 may be configured to provide among other things, for the rendering of multi-planar reconstructions associated with the medical images so that medical images may be displayed. Additionally, the MPR renderer 78 may reconstruct an area(s) or point(s)-of-interest of an image(s) in multiple planes so that the point(s)-of-interest may be displayed.
The MPR renderer 78 may also vary the quality of one or more medical images (e.g., DICOM images) in a dataset to generate respective reduced-quality medical images. It should be pointed out that these medical images may be received from a device such as, for example, communication device 145. In an exemplary embodiment, once the medical images are received from a device (e.g., communication device 145) the processor 70 of the computing device may feed the medical images to the MPR renderer 78. The MPR renderer 78 may also instruct the display 80 to show the reduced-quality medical image(s). In an exemplary embodiment, the reduced-quality medical image(s) may be an image(s) of a sufficient quality for a preview of the image(s) on a display (e.g., display 80). The preview of the reduced-quality images may be used for navigation purposes or manipulation of the images such as for example changing orientation of the images, zooming in or out of a view of the images, navigating back and forth between images and selecting points-of-interests on the images.
In response to receiving additional medical images of a dataset from the communication device 145, the MPR renderer 78 may replace the reduced-quality image(s) with an improved-quality image(s). The MPR renderer 78 may also instruct the display 80 to show the improved-quality image. As additional images of a dataset are received from the communication device 145, the MPR renderer 78 may replace the improved-quality image(s) with a diagnostic-quality image(s) which may be used for diagnostic purposes. It should be pointed out that the MPR renderer 78 may instruct the display 80 to show the best-available quality image. In this regard, a user (e.g., physician) of computing device 100 may utilize the diagnostic-quality image(s) to diagnose a medical condition of a person (e.g., patient).
In order to facilitate display of the medical images of a multi-planar reconstruction, the MPR renderer 78 may utilize a sparse representation of a dataset of images. As referred to herein a sparse representation may be a subset of images of a dataset. In this regard, the MPR renderer 78 may render the subset of images and may subsequently render the remainder of the images of the dataset in a progressive manner. It should be pointed out that the MPR renderer 78 may render the remainder of the images of the dataset in a progressive manner as the images are received by the computing device 100 from the communication device 145. By rendering a subset of the images of the dataset, via the MPR renderer 78, a user may select a point(s)-of-interest prior to receipt of the entire dataset of images. As such, diagnosis of the image(s) associated with the point(s)-of-interest may commence before receipt of the entire dataset of images. This may be beneficial to a user(s) (e.g., a physician(s)) that does not wish to wait on receipt of all of the images of the dataset in order to examine areas of interest. Additionally, the MPR renderer 78 may minimize the overhead associated with transferring the entire dataset of images to the computing device 100. Minimizing the overhead associated with transferring an entire dataset of images may be beneficial in networks experiencing high latency and low bandwidth since it may reduce the load on the resources of the network.
It should also be pointed out that the MPR renderer 78 may continuously monitor or track a user indicated point-of-interest. In this regard, when a user changes a point-of-interest, the MPR renderer 78 may detect this change and may dynamically adjust the MPR rendering of the medical images. The MPR renderer 78 may dynamically adjust the MPR rendering by replacing the reduced-quality images in the proximity of the point(s)-of-interest with diagnostic-quality images. In this manner, the density of the images in the proximity of the point-of-interest may be increased at a greater rate than the density of images in other peripheral areas.
Additionally or alternatively, when a point(s)-of-interest is changed, the MPR renderer 78 may send a request to the communication device 145 to transfer images of the dataset in areas in the proximity of the point(s)-of-interest before transferring images in peripheral areas of the images. In this regard, images closer to the point(s)-of-interest may be rendered by the MPR renderer 78 before images that are farther away from the point(s)-of-interest. As such, the MPR renderer 78 may allow a user to examine images and provide a diagnosis before the entire dataset of images is received by the computing device 100. In this manner, the MPR renderer 78 may efficiently render a dataset of medical images and may reduce the load on the resources (e.g., a processor such as for e.g., processor 70) of a device.
Referring now to
The communication device 145 may also include a processor 34 that may be connected to at least one communication interface 38 or other means for displaying, transmitting and/or receiving data, content, information or the like. In this regard, the communication interface 38 may be capable of connecting to one or more networks. In an exemplary embodiment, the communication device 145 may send one or more medical images to any of the computing devices 100 so that the computing devices 100 may render MPRs and display corresponding medical images. In an exemplary embodiment, the communication device 145 may receive instructions (e.g., a transfer order) from the computing devices regarding the manner in which to send the medical images, as described more fully below.
The communication device 145 may also include at least one user input interface 32 that may include one or more speakers, a display 30, and/or any other suitable devices. For instance, the user input interface 32 may include any of a number of devices allowing the communication device to receive data from a user, such as a keyboard, a keypad, mouse, a microphone, a touch screen display, or any other input device.
Reference will now be made to
a. Definition of a Three-Dimension Volume of Images
Referring now to
It should be pointed out that the volume 3 may have an acquisition plane (not shown). As referred to herein, the acquisition plane may be any one of the infinity of planes (not shown) parallel to the plane containing an image such as for example image I1 (See e.g.,
Additionally, as referred to herein, an MPR rendering may be a two-dimensional isometric projection of a VMPR slice 12 bounded by cross sections 9 and 11 on a plane parallel with plane 5 (e.g., plane P1) and plane 7 (e.g., plane P2). The MPR rendering may be generated by MPR renderer 78. It should be pointed out that given two non-intersecting surfaces S1 and S2 (not shown) intersecting volume 3 and forming cross sections Cc1 and Cc2 (not shown), a curved MPR rendering may be a two-dimensional projection of a VCMPR slice (not shown) bounded by Cc1 and Cc2. In this regard, a mechanism of projection may vary depending on a clinical purpose of an MPR rendering. In an exemplary embodiment, the MPR rendering referred to herein may, but need not, require data from more than one original image(s) (e.g., original DICOM image(s)) of the set S of images. It should be pointed out that the MPR renderer 78 may generate the volume 3 and the components of volume 3 shown in
As described more fully below, the progressive display of images associated with multi-planar reconstructions may be achieved by providing the MPR renderer 78 with datasets of images of increasing quality or fidelity.
b. Graphical Representation of Images Associated with MPR(s)
Referring now to
In this example, the MPR renderer 78 may render the VMPR slice 12 so that the received images I1 to In of set S may be shown on a display (e.g., display 80) of a computing device 100. In this manner, the MPR renderer 78 may instruct the display 80 to show the images I1 to In in two-dimensions. Although not shown in
While the example of
c. Facilitating Receipt of a Subset of Images in Set S
Referring now to
Given a parameter n as the number of images in set S, the sparse representation Ss of volume 3 may be defined as Ss={I1+k*p|k=maximum (d+1, n/m), dεN, pεN, k*p<n} (equation 1) where:
S={I
x|1<=x<=n},
d denotes the minimum distance, in terms of skipped images, between two successive elements of Ss,
m is the maximum number of images to be included in Ss,
N represents a set of nonnegative integers (e.g., 0, 1, 2, 3, etc.), in which dεN denotes that parameter d belongs to N, and
p denotes a set of nonnegative integers, in which pεN denotes that parameter p belongs to N.
As an example of the manner in which the MPR renderer 78 may utilize equation 1 to generate a spares set Ss, consider a scenario in which a user may utilize a user input interface 82 to select one or more images of a dataset such as for example set S. (In an alternative exemplary embodiment, a user may also utilize the user input interface 82 to specify that a reduced-quality version of the selected images is acceptable.) For purposes of illustration and not of limitation also consider that n=8, d=2 and m=10 in this example. In this regard, the MPR renderer 78 may determine that k equals the maximum of (d+1, n/m) and as such k equals 3 in this example since the maximum of (2+1, 8/10) is taken as the value of k. As described above, parameter p equals a set of nonnegative integers (e.g., 0, 1, 2, 3, etc.) belonging to N. As such, Ss=I1+3*0 which equals I1 when p=0. Moreover, when p=1, Ss=I1+3*1 which equals I4 and when p=2, Ss=I1+3*2 which equals I7. It should be pointed out that the MPR renderer 78 may determine that no more images of the set S may be included in the sparse set Ss in this example when p=4 since k*p<n, and in this example 2*4 equals 8 which is not less than n (e.g., 8).
In this regard, the MPR renderer 78 may determine that the sparse set of images Ss={I1, I4, I7}. As such, the MPR renderer 78 may send a request to a device such as communication device 145 to send the subset of images I1, I4, and I7 of the dataset such as set S for rendering and display on a computing device 100. The images I1, I4, and I7 may be reduced-quality images for manipulation and navigation purposes. The MPR renderer 78 may subsequently receive the remainder of the images of the set S from a communication device 145 in a sequential or progressive manner and may render and facilitate display of the remainder of images via display 80, as described more fully below.
It should also be pointed out that when corresponding improved-quality images are received by a computing device 100 from the communication device 145, the MPR renderer 78 may replace the reduced-quality images with corresponding improved-quality images. The improved-quality images may include all of the original data associated with the images and may not be compressed. Additionally, the MPR renderer 78 may select the best-available-quality images to replace the improved-quality images for diagnostic purposes.
In the exemplary embodiment of
d. Order of Transferring Images of a Set S
Referring now to
However, it should be pointed out that the MPR renderer 78 may facilitate the transfer of the images (e.g., medical images such as, for e.g., DICOM images) of set S, from communication device 145, in a certain order based in part on a point(s)-of-interest chosen or selected by a user. For instance, given XεP1 (equation 2) in which a user defined or selected point-of-interest X belongs to a plane P1 (e.g., plane 5), Di is the distance between point(s)-of-interest X and the intersection between P1 and an image Ii as shown in
It should be pointed out that when Di=Dq, the MPR renderer 78 may request that a device such as, for example, communication device 145 transfer images Ii and Iq at the same time. However, in an alternative exemplary embodiment, when Di=Dq, the MPR renderer 78 may determine that while images Ii and Iq may be transferred at the same time, the MPR renderer 78 may randomly select either image Ii or image Iq to be transferred first since the distances (e.g., Di and Dq) between the intersection P1 (e.g., plane 5) and the images Ii and Iq may be the same in this example. In this regard, the MPR renderer 78 may determine that the randomly selected image (e.g., image Ii) is to be transferred first followed by the transfer of the non-selected image (e.g., image Iq).
As such, images that are closest (e.g., image Ii) to a user defined or selected point(s)-of-interest X may be transferred by the communication device 145 to a computing device 100 before images (e.g., image Iq) that are farther away from point(s)-of-interest X. In this regard, the images that are in a proximity of a point(s)-of-interest (e.g., point(s)-of-interest X) may be prioritized by the MPR renderer 78 and the images in the proximity may be transferred from a communication device 145 and received by a respective computing device in a high quality or best-available-quality such as a diagnostic quality which may include all of the original data associated with the respective images. In this regard, the MPR renderer 78 may send a request to communication device 145 to transfer or send images to the computing device 100 that are closer to the point(s)-of-interest X before images situated farther from point(s)-of-interest X. As such, the MPR renderer 78 may increase the density of the images in the proximity of the point(s)-of-interest at a greater rate than the density of peripheral areas of the images. In this regard, a user of a respective computing device 100 may begin diagnosing images before the entire dataset of high quality images are received.
Referring now to
In the example of
Subsequently, the MPR renderer 78 may utilize equations 2 and 3 to determine that the images I3 and I6 are the next closest images to point(s)-of-interest X and that images I3 and I6 are an equal distance (e.g., distance D3=distance D6) away from point(s)-of-interest X. In this regard, the MPR renderer 78 may generate a request that may be sent to communication device 145 requesting the communication device 145 to transfer or send images I3 and I6 to a respective computing device 100 at the same time. Alternatively, the MPR renderer 78 may randomly select either one of the images I3 and I6 to be transferred first (e.g., image I3) followed by the transfer of the non-selected image (e.g., image I6) since the distances D3 and D6 may be the same. In this regard, the MPR renderer 78 may include information in the request that may be sent to the communication device 145 requesting transfer of the selected image (e.g., image I3) followed by transfer of the non-selected image (e.g., image I6) to the respective computing device 100.
Thereafter, the MPR renderer 78 may utilize equations 2 and 3 to determine that the images I2 and I7 are the next closest images to point(s)-of-interest X and that images I2 and I7 are an equal distance (e.g., distance D2=distance D7) away from point(s)-of-interest X. In this regard, the MPR renderer 78 may generate a request that may be sent to communication device 145 requesting the communication device 145 to transfer or send images I2 and I7 to a respective computing device 100 at the same time. Alternatively, the MPR renderer 78 may randomly select either one of the images I2 and I7 to be transferred first (e.g., image I2) followed by the transfer of the non-selected image (e.g., image I7) since the distances D2 and D7 may be the same. As such, the MPR renderer 78 may include information in the request that may be sent to the communication device 145 requesting transfer of the selected image (e.g., image I2) followed by transfer of the non-selected image (e.g., image I7) to the respective computing device 100.
Subsequently, the MPR renderer 78 may utilize equations 2 and 3 to determine that the images I1 and I8 are the next closest images to point(s)-of-interest X and that images Ii and I8 are an equal distance (e.g., distance D1=distance D8) away from point(s)-of-interest X. It should be pointed out that in the this example, the MPR renderer 78 may determine that the images I1 and I8 are the farthest images away from point(s)-of-interest X and as such the images I1 and I8 may be the last images transferred. In this regard, the MPR renderer 78 may generate a request that may be sent to communication device 145 requesting the communication device 145 to transfer or send images I1 and I8 to a respective computing device 100 at the same time. Alternatively, the MPR renderer 78 may randomly select either one of the images I1 and I8 to be transferred first (e.g., image I1) followed by the transfer of the non-selected image (e.g., image I8) since the distances D1 and D8 may be the same. As such, the MPR renderer 78 may include information in the request that may be sent to the communication device 145 requesting transfer of the selected image (e.g., image I1) followed by transfer of the non-selected image (e.g., image I8) to the respective computing device 100.
By requesting transfer, by the MPR renderer 78, of the images closest to a user defined or point(s)-of-interest selected by a user (e.g., physician), the user may begin diagnosing areas of interest with respect to the images prior to the entire transfer of a dataset of images (e.g., set S). In this regard, the exemplary embodiments facilitate an efficient and reliable manner in which to transfer images of a dataset to a device for usage by a user (e.g., a physician).
Additionally, it should be pointed out that the MPR renderer 78 may track a position of a point(s)-of-interest during the transfer of the images of a dataset (e.g., set S) by the communication device 145 to a respective computing device 100. In this regard, when the MPR renderer 78 determines that the position of a point(s)-of-interest is changed, the MPR renderer 78 may dynamically change or adjust the order in which the images are to be sent to the respective computing device 100 from the communication device 145. It should be pointed out that the MPR renderer 78 may detect that a point(s)-of-interest is changed based on an input or selection for a different or new point(s)-of-interest chosen by a user utilizing the user input interface 82 of a respective computing device 100.
The changed or adjusted order may be sent to the communication device 145 in a request that includes information specifying the order in which the images are to be transferred to the respective computing device 100 based on the changed point(s)-of-interest. The adjusted or changed order may be generated by the MPR renderer 78 based on the images that are closest to the changed point(s)-of-interest (that may be tracked or detected by the MPR renderer 78) in a manner analogous to that described above with respect to
e. Mechanism of Receiving Images of a Dataset & Rendering Images for Display
Referring now to
At operation 910, a processor (e.g., processor 34) of a device, such as for example communication device 145 may lower the quality of the subset of images to obtain reduced-quality images. In an exemplary embodiment, the reduced-quality images may be images having a preview quality in which at least a portion of the original data of the subset of images may be compressed (e.g., via lossy compression). The reduced-quality images may be used for manipulation of the images and navigation purposes, in the manner described above. At operation 915, a processor (e.g., processor 34) of a device such as, for example, communication device 145 may transfer the subset of images (e.g., images of sparse set Ss) in the reduced-quality to a respective computing device 100. Upon receipt of the subset of images by the respective computing device 100, the MPR renderer 78 may render a multi-planar reconstruction associated with the subset of images and instruct a display (e.g., display 80) to show the subset of images in a reduced-quality (e.g., preview-quality). In an exemplary embodiment, the subset of images may, but need not, be shown in two-dimensions.
At operation 920, the MPR renderer 78 may generate an order in which all of the images of the dataset (e.g., set S) may be transferred by a device such as, for example, communication device 145, to a respective computing device 100. The MPR renderer 78 may send the generated order in a request to a device such as, for example, communication device 145 instructing the communication device 145 to send the images of the dataset to a respective computing device 100 in a sequence as specified by the order. The request generated by the MPR renderer 78 may also include information specifying that the images are to be transferred or sent to the respective computing device 100 in a high quality (e.g., diagnostic quality). It should be pointed out that the order generated by the MPR renderer 78 may be based in part on a point(s)-of-interest (e.g., point(s)-of-interest X, see e.g.,
In this regard, the MPR renderer 78 may increase the density of the images in the proximity of the point(s)-of-interest at a greater rate than the density of peripheral areas of the images. As such, a user of a respective computing device 100 may begin diagnosing images before the entire dataset of high quality images are received.
At operation 925, the respective computing device 100 may subsequently receive the images of the dataset (e.g., all of the images of the set S) from a device such as, for example, communication device 145. The images of the dataset may be received by the respective computing device 100 in a high quality (e.g., diagnostic quality). It should also be pointed out that the images of the dataset may be received in a progressive manner and may be rendered by the MPR renderer 78 which may instruct a display (e.g., display 80) to show the images. In an exemplary embodiment, the images of the dataset may, but need not, be displayed in two-dimensions.
Optionally, at operation 930, the MPR renderer 78 may replace the reduced-quality images (e.g., the reduced quality images of sparse set Ss) that were rendered and displayed during operation 915 with corresponding high quality images of the dataset as the corresponding high quality images are being received from a device such as, for example, communication device 145, in the sequence specified by the order. In this regard, the MPR renderer 78 may render the high quality images that may replace the reduced-quality images in a progressive manner and may instruct a display (e.g., display 80) to show the high quality images. As an example, the MPR renderer 78 may replace the reduced-quality images I1, I4, I7 of sparse set Ss described above with corresponding high quality images of I1, I4, I7 of set S. The high quality images that may replace the reduced-quality images may, but need not, be displayed in two-dimensions.
Optionally, at operation 935, the MPR renderer 78 may continuously track or monitor a point(s)-of-interest during the transfer of the high quality images and may dynamically change the order in which the high quality images are to be transferred by a device such as, for example, communication device 145 and received by a respective computing device 100 based in part on a change in the point(s)-of-interest, in the manner described above.
It should be pointed out that
Accordingly, blocks or steps of the flowchart support combinations of means for performing the specified functions and combinations of steps for performing the specified functions. It will also be understood that one or more blocks or steps of the flowchart, and combinations of blocks or steps in the flowchart, can be implemented by special purpose hardware-based computer systems which perform the specified functions or steps, or combinations of special purpose hardware and computer instructions.
In an exemplary embodiment, an apparatus for performing the method of
Many modifications and other embodiments of the inventions set forth herein will come to mind to one skilled in the art to which these inventions pertain having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that the inventions are not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of the appended claims. Moreover, although the foregoing descriptions and the associated drawings describe exemplary embodiments in the context of certain exemplary combinations of elements and/or functions, it should be appreciated that different combinations of elements and/or functions may be provided by alternative embodiments without departing from the scope of the appended claims. In this regard, for example, different combinations of elements and/or functions than those explicitly described above are also contemplated as may be set forth in some of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.
