Methods for enabling an application within another independent system/application in medical imaging

Abstract

A method and system is provided for data/process sharing. A trigger response unit is provided to reside on a first system where a first application system is present. The trigger response unit monitors, on the first system, when trigger data from a second application system is presented in the first application system. When the trigger data is presented in the first application system, the trigger response unit decodes the trigger data to obtain a trigger corresponding to a second application system. The obtained trigger is used to launch the second application system on the first system.

Description

BACKGROUND

1. Technical Field

The present teaching relates generally to methods and system for process sharing between different system platforms. Specifically, the present teaching relates to methods and system for process sharing and communication between different medical imaging system platforms.

2. Discussion of Related Art

With the large number of applications available on computing devices, there is a need to allow these applications to share with each other data created in different applications. One conventional solution is through a set of interfaces such as Object Linking and Embedding (OLE) developed by Microsoft. Such interfaces can be used to facilitate creating a compound document, in which objects or data from different applications reside in a single document and such object or data may be manipulated in an environment similar to its native environment in which the objects or data are initially generated. This is possible because an application may be embedded within an object or data it creates and imported as an integrated object into a document operated by a different application so that the former application may be invoked to manipulate its object within the document when needed. For example, within a Microsoft Word document, one may incorporate a Microsoft Excel sheet embedded with the Microsoft Excel application. When the Word document is opened, one may invoke Microsoft Excel editing tool within the Word (for embedding) to process the incorporated Microsoft Excel spreadsheet.

In medical imaging, there is a similar need. A patient data processed in one application system such as a dedicated clinical application system (or a server based thereupon) may be imported into a different data processing environment and further being viewed and/or interactively manipulated using tools of the first application within the environment of the system to which the patient data is exported. As a specific example, a Computer-Aided Detection (CAD) system may process patient data to identify locations of suspicious regions for, e.g., tumors, and such identified locations may be exported, with possibly other associated data such as patient information and the original imaging data, to another medical imaging analysis application such as a Picture Archiving and Communication System (PACS) environment, which is physicians' routine reading environment. Within the PACS environment, the physicians may need to invoke the CAD application on the same patient data and to use the CAD system's interactive tools to further analyze the data.

Existing systems in medical imaging utilize certain commonly conformed standard in medical imaging such as Digital Imaging and Communication in Medicine (DICOM). To share images of different modalities, DICOM specifies how images should be stored and transferred. However, DICOM does not allow data to be embedded with application(s) that creates the data, making it difficult, if not impossible, to manipulate data created in one medical imaging system to be manipulated in its native environment in a different application system.

With the current technical limitations in medical imaging, to share the result data generated by an application among different medical imaging systems, there are two existing solutions. One is simply sending the result data created in a first application to a second application in a recognizable format such as DICOM for display in the second application and for manipulation using tools of the second application. With this solution, manipulation using data tools of the first application system in the environment of the second application system is not possible. The second solution is to integrate the first application system such as CAD system with the second application system such as PACS through some mutually defined APIs. In this case, implementing the API-based integration requires code-level engineering effort, which can be not only time consuming but also cost prohibitive. For example, considering the complexity of CAD systems and PACS systems on today's market, the effort to achieve such API-based integration can be very costly. This kind of integration is especially difficult if one considers integration with systems already installed in a clinical environment. Other dedicated clinical applications, such as 3D visualization, have similar restrictions in their accessibility within another independent system.

BRIEF DESCRIPTION OF THE DRAWINGS

The inventions claimed and/or described herein are further described in terms of exemplary embodiments. These exemplary embodiments are described in detail with reference to the drawings. These embodiments are non-limiting exemplary embodiments, in which like reference numerals represent similar structures throughout the several views of the drawings, and wherein:

FIG. 1 a and 1b depict an exemplary construct of a system diagram for process sharing between two independent systems/applications, according to an embodiment of the present teaching;

FIG. 1 c shows an symbolic representation of DPAA trigger and patient data ID, according to an embodiment of the present teaching;

FIG. 1 d shows an graphic representation of DPAA trigger and patient data ID as a barcode, according to an embodiment of the present teaching;

FIG. 2 shows a flowchart of process communication and process sharing between multiple systems/applications, according to an embodiment of the present teaching;

FIG. 3 a is an exemplary flow of encapsulating a symbolic and/or graphic representation for DPAA trigger and patient data ID with the patient data;

FIG. 3 b illustrates how a graphic and/or symbolic representation of DPAA trigger and patient data ID can be appended to a patient image.

FIG. 3 c illustrates how a graphic and/or symbolic representation of DPAA trigger and patient data ID can be appended into one or more corners of a patient image.

FIG. 3 d shows an exemplary embodiment of generating a graphic and/or symbolic trigger data by putting a graphic and/or symbolic representation of DPAA trigger and patient data ID into an additional trigger image;

FIG. 4 is an exemplary embodiment of a trigger response unit for extracting a DPAA trigger and associated patient data ID from displayed graphic and symbolic trigger.

DETAILED DESCRIPTION

The present teaching is for providing process sharing and communication by encoding a graphic or symbolic representation of an application trigger as an image without the need for API or code-level integration between two systems.

FIG. 1 a and FIG. 1b show an exemplary system diagram 100 facilitating process communication and data/process sharing, according to an embodiment of the present teaching. The system 100 comprises two different applications or systems, one is on the left of the communication platform 116 corresponding to the first system and the other is on the right of the communication platform 116 corresponding to the second system. The two applications may or may not reside in separate computing devices. The system 100 comprises components of the first system including a Data Processing and Analysis Application (DPAA) unit 102, a DPAA representation unit 105, a graphic and symbolic trigger generation unit 110, a communication unit 114, a communication platform 116, and additionally all the parts residing on the second system, including a Data Archiving Communication and Manipulation System (DACMS) 118, a trigger response unit 124, a DPAA requesting mechanism 128, a DPAA launching unit 139, which creates an instance of DPAA 130.

The DPAA 102 may process patient data from a data storage Database A 104. The Database A 104 may store both original patient data and processed result data. It may store data of different types, including, but not limited to, patient record, patient report, digital images, such as X-ray, CT, MRI, and results of data processing. The DPAA may be represented, through the DPAA representation unit 105, as a DPAA trigger 106. The DPAA trigger 106 may be in the form of a symbolic or numeric representation of the DPAA such as an abstraction in the form of an identification number to be used by the first system to identify DPAA or a physical location representing where the DPAA is stored. An example of such a symbolic representation of DPAA trigger is ABC. When there are a plurality of application systems to be shared within, e.g., DACMS, each identification number may be defined to uniquely identify a specific application system.

The graphic and/or symbolic trigger generation unit 110 may generate a trigger image 112 corresponding to the trigger containing a symbolic and/or graphic representation of the DPAA trigger 106 with associated patient data ID (identity). A symbolic representation is developed using symbols such as characters and numerals to compose a 2-dimensional image of such symbols. An example of a symbolic representation of DPAA trigger with associated patient data ID is shown in FIG. 1c, where the area 150 is the pixel data of the symbolic representation of the DPAA trigger, whereas characters ABC represents a DPAA trigger and numerals 131345667791 represents the associated patient data ID. In some embodiments, a graphic representation of DPAA trigger with associated patient data ID is a bar code. FIG. 1d illustrates a barcode representation of a DPAA trigger and the patient data ID. The area 160 is the pixel data representing barcode. The trigger image 112 generated by the trigger generation unit 110 may be either in the form of a patient data encapsulated with the graphic and/or symbolic representation for the DPAA trigger, or in the form of a separate DPAA trigger image containing the graphic and/or symbolic representation. When the trigger image 112 is exported via the communication unit 114 to the DACMS unit 118 via a communication platform 116, standardized protocols such as DICOM may be used to facilitate the transportation.

The DACMS 118 may be any system or application that may perform certain functions, including, but not limited to, data storage, data communication, data processing, and data visualization. An example of such a system is a Picture Archiving and Communicating System (PACS). The DACMS 118 may store the DPAA trigger data into a data storage Database B, 119. If DPAA 102 and DACMS 118 are located in different computers, the communication platform 116 may be either a local area network (LAN), or a wide area network (WAN) or other types of communication media. If the DPAA 102 and DACMS 118 are both located on the same computer, the communication platform 116 may include, but not limited to, specific hard drive locations or a specific network port number.

The trigger response unit 124 may be designed to correspond to a functional block of the first system such as the illustrated DPAA application system. The trigger response unit 124 is deployed within a foreign environment such as the second application system, e.g., the DACMS system, as shown in FIG. 1b. Once being deployed on the second system, the trigger response unit 124 monitors when a trigger image is displayed on a screen, e.g., monitor 120, in the foreign environment (e.g., DACMS). When the trigger image is displayed, e.g., upon a physicians' selection, on a monitor 120, the trigger response unit 124 detects the presence of the graphic and/or symbolic representation of DPAA trigger with associated patient data ID from the screen, and extracts or decodes both the DPAA trigger 127 and the patient data or data ID 132 from the displayed graphic and/or symbolic representation 121.

The trigger response unit 124 may need to be pre-loaded in the second system or the environment, prior to the second application system such as DACMS starts to import the trigger data from the first application system such as DPAA. The deployment of the trigger response unit 124 may be through a direct installation, download, or deployment from DPAA 102. Based upon the extracted DPAA trigger 127, the DPAA requesting mechanism 128 may send a DPAA resource request 136 to the communication platform 116. The DPAA source request may incorporate the decoded DPAA trigger which, upon being received by the first system, can be used by the first system to instantiate an instance of the DPAA and the DPAA launcher 139 may then launch such created instance of DPAA 130 in the DACMS environment.

The DPAA launcher 139 may be an independent program running in the backend in the DACMS environment. When an instance of DPAA 130 is launched, the activated DPAA instance may then be used to manipulate the patient data imported from the first application system or DPAA. If additional analysis results are subsequently generated by the original first DPAA, the launched DPAA in the foreign environment may send a request for the results to be sent to the launched DPAA 130. The communications between the original DPAA and the launched DPAA in the foreign environment may be based on the patient data ID 132.

On the other hand, if some information needed by the launched DPAA is not present in the trigger image, the launched DPAA may request such information from either the original DPAA 102 residing on the first system or from DACMS 118 through some standard interfaces, such as DICOM. In this way, both DACMS and DPAA can operate on the same patient data. The processed results 142 from the launched DPAA on the second system may also be sent to DACMS 118 and remote DPAA 102 via the communication platform 116.

FIG. 2 illustrates an exemplary workflow of the system 100, according to one embodiment of the present teaching. At step 201, the trigger response unit 124 may be deployed in the DACMS environment, either remotely from the DPAA environment or through local installation. Upon being deployed in the DACMS environment, the trigger response unit may then start to monitor when a trigger image created by a DPAA system is displayed in the DACMS environment. It may check for the existence of a graphic and/or symbolic pattern on a display screen. Such checking may be performed within a memory, in which the DACMS program may reside and operate. The check may also be performed in a buffer that stores data to be displayed. The memory may include video memory.

After being deployed in a foreign environment, the trigger response unit 124 facilitates process/data sharing between the first and the second system. At step 204, the trigger generation unit may generate a trigger image containing a graphic and/or symbolic representation of the DPAA trigger 106. At step 206, the trigger image may be sent to the DACMS 118 by the communication unit 114. At step 208, physicians open the trigger image and displays it on the screen in DACMS. When the trigger image is displayed in the DACMS environment, the trigger response unit 124 detects the presence of the graphic and/or symbolic pattern and extracts the DPAA trigger and patient data ID at step 210, e.g., by a process running on the backend in DACMS environment. At step 213, a request for DPAA resources is generated based on the extracted DPAA trigger and sent to the original DPAA. Upon receiving the DPAA resource request, the original DPAA 102 responds to the request by sending the requested DPAA resources at step 220.

At step 216, the patient data may be retrieved from the remote DPAA 102, based on the extracted data ID. When DPAA components and the patient data are available, a DPAA instance may be instantiated and launched at step 217. At step 218, the processed results from the launched DPAA may be sent to DACMS or to the original DPAA.

FIG. 3 a is an exemplary flowchart of graphic and/or symbolic trigger generation according to an embodiment of the present teaching. At step 320, the patient data ID may be extracted from the patient data. An embodiment is to extract the SOP (Service Object Pair) instance UID (Unique Identifier) from the DICOM header of the patient data. The SOP instance UID is designed by the DICOM standard to uniquely identify a patient image. At step 332, the DPAA trigger and patient data ID may be encoded as a graphic and/or symbolic graphic pattern. An embodiment of such a graphic pattern is a barcode, as illustrated in FIG. 1d. The barcode may be either in 1-dimensional or 2-dimentional. In some embodiments a symbolic representation of a DPAA trigger with associated patient data ID can be encapsulated in corresponding patient data by superimposing the symbolic representation (e.g., characters of numerals) on image areas, as illustrated in FIG. 1c. At step 334, the graphical and/or symbolic representation of the DPAA trigger and patient data ID may be incorporated into the pixel data field of the patient data. In some embodiments, the symbolic representation of the trigger with associated ID may be appended to the pixel data of the patient image. FIG. 3b illustrates an example, where area 337 represents the pixel data of the patient image, area 338 represents the graphic and/or symbolic representation of a DPAA trigger. For example, area 338 can be appended to the end of 337. When there is a discrepancy in size between 338 and 337 (e.g., 337 is wider than 338), appropriate padding may be added (e.g., the area 338 has to be widened through padding in area 339 using some agreed padding value) to make the size of the appended area for the graphic representation compatible with the size of the patient image to which the addition is made. After the appending and possible padding, the overall size of the appended patient image may be changed. In this case, the corresponding DICOM header providing image dimension and size may be accordingly modified to reflect the new image dimensiona. Another embodiment is to incorporate the graphic and/or symbolic representation into the pixel data of the patient image, such as into the corner or boundary pixels of the patient image. FIG. 3c shows an example, where a graphic and/or symbolic representation of DPAA and patient data ID is split into 4 part and put into the 4 corners of the pixel data area 337 of the patient image. The original pixel data at the 4 corners may be overwritten or combined with encoded trigger in some predetermined manner. The output is a trigger image 336 that contains both the original image data and the graphic and/or symbolic trigger representation of DPAA and patient data ID.

FIG. 3 d is another exemplary flowchart of the graphic and/or symbolic trigger generation unit according to an embodiment of the present teaching. At step 320, the patient data ID may be extracted from the patient data, similarly to the one described in FIG. 3a. At step 332, the DPAA trigger and patient data ID may be encoded as a graphic or symbolic representation, similarly to the one described in FIG. 3a. At step 340, an independent trigger image may be created, with the DICOM header containing the same patient information as that of the original patient data. At step 342, the symbolic and/or graphical representation of the DPAA trigger with associated patient data ID may be put into the pixel data field of that trigger image. The output is a separate trigger image 346 that contains the graphic and/or symbolic representation of the DPAA and patient data ID.

Since the trigger image data contains the same patient information as the original image, it may be organized under the same patient into the data storage unit 120 by the DACMS 118, according to the DICOM protocol.

FIG. 4 shows an exemplary flow of the trigger response unit 124. At step 402, a user selects to display trigger image in the environment of DACMS 118. The trigger image may either be a patient image encapsulated with the trigger, or an image containing only the symbolic representation of a DPAA trigger with associated patient data ID. Depending on the implementation of DACMS, the selection may be performed either by double-clicking a thumbnail of the trigger image, or by clicking an entry in the image list of the patient data.

The previously deployed trigger response unit, running in the backend of the DACMS environment, may make screen captures of the display monitor, at step 404. The capture may be performed at sampled screen locations. At step 405, the captured regions may then be analyzed to identify whether the graphic and/or symbolic pattern is present on the screen. If it is determined, at step 406, that no symbolic pattern is present, the trigger response unit may pause for a certain time interval at step 410 and subsequently capture another screen capture to search for the symbolic and/or graphic pattern. If the expected symbolic pattern is captured and identified it may then be analyzed so that the DPAA trigger and patient data ID can be decoded and extracted, at step 412. Depending on how the trigger is generated, barcode decoding techniques or optical character recognition (OCR) techniques known in the art may be used for extracting the DPAA trigger and the patient data ID.

While the inventions have been described with reference to the certain illustrated embodiments, the words that have been used herein are words of description, rather than words of limitation. Changes may be made, within the purview of the appended claims, without departing from the scope and spirit of the invention in its aspects. Although the inventions have been described herein with reference to particular structures, acts, and materials, the invention is not to be limited to the particulars disclosed, but rather can be embodied in a wide variety of forms, some of which may be quite different from those of the disclosed embodiments, and extends to all equivalent structures, acts, and, materials, such as are within the scope of the appended claims.

Claims

1. A method for data/process sharing, comprising: providing a trigger response unit residing on a first system where a first application system resides; monitoring, by the trigger response unit, when a representation corresponding to trigger data from a second application system is presented in the first application system; decoding the presented representation corresponding to the trigger data to obtain a trigger, wherein the representation comprises the trigger corresponding to the second application system encoded with associated data; and launching the second application system on the first system based on the trigger.

2. The method according to claim 1, wherein the trigger response unit is installed on the first system.

3. The method according to claim 1, wherein the trigger response unit is downloaded from the second system to the first system.

4. The method according to claim 1, wherein the trigger response unit is provided by a third system.

5. The method according to claim 1, wherein the trigger represents one of a full version of the second application system, a partial version of the second application system, an identifier corresponding to the second application system that is recognizable on the second system, and an location indicator corresponding to where the second application system resides on the second system.

6. The method according to claim 1, wherein the launching the second application system, when trigger contains a full version of the second application system, comprises: instantiating an instance of the second application system on the first system; and launching the instance of the second application system on the first system.

7. The method according to claim 1, wherein the launching the second application system, when the trigger represents a partial version of the second application system, comprises sending a resource request to the second system for a full version of the second application system based on the trigger; receiving a request to receive the requested full version of the second application system; instantiating an instance of the second application system on the first system; and launching the instance of the second application system on the first system.

8. The method according to claim 1, wherein the representation corresponding to a trigger is a graphical pattern.

9. The method according to claim 8, wherein the graphical pattern is a bar code coding the trigger with associated data.

10. The method according to claim 8, wherein the graphical pattern is an image for one or more numerical symbols corresponding to the trigger with associated data.

11. The method according to claim 10, wherein the graphical pattern is coded with a data set corresponding to the associated data generated by the second application system.

12. The method according to claim 11, wherein the graphical pattern is superimposed in the data set.

13. The method according to claim 11, wherein the graphical pattern is appended to the data set.

14. The method according to claim 1, wherein the representation corresponding to the trigger data is presented on a display screen.

15. The method according to claim 1, wherein the representation corresponding to a trigger is stored in a storage storing information to be displayed on a display screen.

16. The method according to claim 1, further comprising encoding, on the second system, data from the second application system and the trigger to generate the trigger data.

17. The method according to claim 12, wherein the graphical pattern is superimposed at a pre-defined location of the data set.

18. The method according to claim 17, wherein the decoding comprises: identifying the pre-defined location of the data set; extracting the trigger from the pre-defined location of the data set.

19. The method according to claim 17, wherein the decoding comprises: searching for a location in the data set where the graphical pattern is present; analyzing information from the location in the data set; and retrieving the trigger based on the analysis result.

20. The method according to claim 1, wherein the first system and the second system correspond to a same computing system.

21. A system for data/process sharing, comprising: a first application system residing on a first system; a second application system residing on a second system; a trigger response unit residing on the first system configured to monitor when trigger data from the second application system is present in the first application system and decode the trigger data to obtain a trigger corresponding to the second application system; an symbolic trigger generation unit residing on the second application system configured to encode data from the second application system with the trigger; and a launcher residing on the first system configured to launch the first application system on the first system based on the trigger.

22. The system according to claim 21, wherein the trigger response unit is installed on the first system.

23. The system according to claim 21, wherein the trigger response unit is downloaded or deployed from the second system to the first system.

24. The system according to claim 21, wherein the trigger response unit is provided by a third system.

25. The system according to claim 21, wherein the symbolic trigger generation unit embeds a graphical pattern representing the trigger into a pre-defined location of the data.

26. The system according to claim 21, wherein the symbolic trigger generation unit appends a graphical pattern representing the trigger to the data.

27. The system according to claim 21, wherein the trigger represents one of a full version of the second application system, a partial version of the second application system, an identifier corresponding to the second application system that is recognizable on the second system, and an location indicator corresponding to where the second application system resides on the second system.

28. The system according to claim 21, further comprising a requesting mechanism residing on the first system, wherein the requesting mechanism sends a request to the second system to obtain resources relating to the second application system when the trigger does not include a full version of the second application system.

29. The system according to claim 28, wherein the requesting mechanism sends a request to the second system to obtain information that is not present in the data.