The present disclosure relates to a pathology interface system for mass spectrometry (PIMS), and more specifically, a PIMS system that provides control, management, and dissemination of data associated with biomarking and/or annotating regions of interest in images associated with tissue sections and registering the annotated images.
The application of imaging mass spectrometry (“IMS”) to clinical specimens such as animal or human tissue is an advancing frontier in diagnostic medicine. The molecular specificity of modern mass spectrometry provides unique insights into the biological mechanism for disease. For example, recent studies have demonstrated that histology-directed analyses of tissue sections using IMS can differentiate Spitz Nevi from Spitzoid melanoma based on molecular measurement.
Accordingly, IMS and histology-directed analysis of tissue sections can play a central role in the clinical studies relating to disease detection, diagnostics, control, and treatment. One type of IMS is a matrix-assisted laser desorption ionization mass spectrometry (“MALDI MS”). Further discussion of MALDI MS techniques and analysis is found in U.S. Patent Publication No. U.S. 2005/0029444 that published on Feb. 10, 2005 under application Ser. No. 10/880,750 entitled METHODS AND APPARATUSES FOR ANALYZING BIOLOGICAL SAMPLES BY MASS SPECTROMETRY and is assigned to the assignee of the present disclosure. The 2005/0029444 patent publication is incorporated herein by reference.
One aspect of the disclosure comprises a diagnostic system and method that includes a non-transitory computer readable medium storing machine executable instructions executable by the processor for altering tissue images, the instructions that further includes an input interface configured to receive a plurality of tissue images, the input interface generating enhanced resolution images from the plurality of tissue images for viewing, an annotation interface for positioning coordinates of interest on the enhanced resolution images, and a matrix model configured to evaluate the coordinates of interest on the enhanced resolutions to generate discrete coordinates, the matrix model using the discrete coordinates in performing mass spectrometer analysis to form at least one viewing image. The system also includes a user interface configures to provide at least one viewing image to a user at a display.
Another aspect of the disclosure comprises a system for controlling the acquisition of data from at least one tissue sample. The system comprises a pathology interface for receiving at least one tissue sample and provides the at least one tissue sample image to a user. The pathology interface is configured to position at least one coordinate of interest for the acquisition of data on the at least one tissue sample. The pathology interface is also configured to perform a controlled operation relating to at least one coordinate of interest to provide an enhanced image about the coordinate of interest.
Yet another aspect of the disclosure comprises a method of tissue imaging, the method comprising the steps of configuring an input interface to receive a plurality of tissue images, the interface generating enhanced resolution images from the plurality of tissue images for viewing. The method further comprises the step of positioning coordinates of interest with an annotation interface on the enhanced resolution images, the step of evaluating the coordinates of interest on the enhanced resolution images with a matrix model configured to generate discrete coordinates, and the matrix model using the discrete coordinates to perform mass spectrometry analysis to form at least one viewing image or provide molecular data to enhance the micrograph/photography. And, the step of displaying the viewing image to a user.
While another aspect of the disclosure comprises a diagnostic system comprising a processor, a display, and a non-transitory computer readable medium storing machine executable instructions executable by the processor for altering tissue images. The instructions comprise: an input interface configured to receive a plurality of tissue images, the input interface generating enhanced resolution images from the plurality of tissue images for viewing; an annotation interface for positioning coordinates of interest on the enhanced resolution images; a matrix model configured to evaluate the coordinates of interest on the enhanced resolution images to generate discrete coordinates, the matrix model using the discrete coordinates in performing mass spectrometer analysis to form at least one viewing image; and a user interface configured to provide at least one viewing image to a user at the display.
The foregoing and other features and advantages of the present disclosure will become apparent to one skilled in the art to which the present disclosure relates upon consideration of the following description of the disclosure with reference to the accompanying drawings, wherein like reference numerals, unless otherwise described refer to like parts throughout the drawings and in which:
Skilled artisans will appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help to improve understanding of embodiments of the present disclosure.
The apparatus and method components have been represented where appropriate by conventional symbols in the drawings, showing only those specific details that are pertinent to understanding the embodiments of the present disclosure so as not to obscure the disclosure with details that will be readily apparent to those of ordinary skill in the art having the benefit of the description herein.
Referring now to the figures generally wherein like numbered features shown therein refer to like elements having similar characteristics and operational properties throughout unless otherwise noted. The present disclosure relates to a pathology interface system for mass spectrometer (PIMS), and more specifically, a PIMS system that provides control, management, and dissemination of data associated with biomarking and/or annotating regions of interest in images associated with tissue sections and registering the annotated images.
In particular,
In particular, the work-flow diagram comprising the pathology interface system 10 is initiated with the tissue sectioning to obtain images of tissue samples 12. The tissue samples 12 can include, but are not limited to, human tissue, animal tissue, and/or tumor bearing tissue. The tissue samples 12 may also include individual cells or a cluster of cells, and further include, but are not limited to, brain cell tissue, prostate cell tissue, or colon cell tissue. It should be appreciated that the tissue samples 12 can further be stored or preserved in any number of ways. For example, in one example embodiment, the tissue samples 12 are frozen-fresh tissue. While in yet another example embodiment, the tissue samples 12 are formalin-fixed tissue, paraffin-embedded tissues, and/or the like.
If the specimen or tissue 12 is a tumor-bearing tissue, the techniques described herein may be used in intra-operative assessment of the surgical margins of tumors. In one embodiment, the specimen or tissue samples 12 may include cancerous tissue. Some examples of cancer tissues that may be analyzed include, but are not limited to, testicular, prostate, lung, breast, colon, skin, and brain cancer. In other embodiments, the tissue may be normal. Tissue specimens 12 may be obtained by any means known in the art, including surgical means. If a tissue 12 is obtained surgically, it is advantageous that the tissue be intact and the location of the tissue be known prior to removal. The tissue sample 12 may be obtained from tissue grown in any medium, and the tissue obtained may be stored for later analysis for an indefinite period according to methods known in the art. With the benefit of this disclosure, those having skill in the art will recognize that other types of specimens and tissue may be analyzed using the very techniques described herein, without insubstantial modifications.
Electronic images of the tissue samples 12 as described above are sent to, or accessible by the pathology interface 14. In one example embodiment, the pathology interface 14 is a computer readable medium 114 as used herein refers to a medium or media that participates in providing instructions to the computer 100 (see
In yet another example embodiment, the computer readable medium 114 can be internal 114A or external 114B to the computer 100, or a network of computers and computing devices, local and wide area networks, remote storage clouds, and remote server web-linked computers such as the Internet, all collectively acting as a computer system 110, as illustrated in the example embodiment of
It should be appreciated by those of ordinary skill in the art that the electronic images of the tissue samples 12 are in the form of digital files of micrographs or low resolution photographs. In addition, such electronic images could be standard brightfield micrographs, or requires a specific stain, filter, or other specialized method of visualization. Some electronic images of the tissue samples 12 are provided to the pathology interface 14 in such a manner that no magnification or staining is required, but the images include areas of interest that can be seen by the naked eye by simple photography, such as nodules formed on the tissue.
Referring again to the example embodiment of
Referring now to
In the example embodiment of
Referring now to
Illustrated in
A specimen 126 for providing tissue samples 12 becomes accessible to the computer system 110 via the operating computer 100. Stated another way, a user such as medical personnel can use the computer system 110 to view micrographed tissue samples 12 and further control the acquisition of data executed by the MS 18 through the pathology interface 14. In particular, the user of the computer system 110 in the example embodiment of
The users and medical personnel access, as described in
The pathology interface's 14 positioning of the chemistry 128, such as reagents and biomarkers on the electronic images of the micrographed or photographed tissue samples 12 can further include annotations to form a coordinate matrix 132 for the robotic matrix instrument 130 and for controlling the MS 18 in the production of the enhanced images 20. Illustrated in
The enhanced image 20 generated by the pathology interface 14 includes a smaller window view 134 of the tissue sample 12 and a magnified window view 136 of a user selectable area 138 near a tumor 140. The pathology interface 14 further provides the user or medical personnel with annotations 142 that may describe locations or conditions of the locations of the matrix and biomarkers 128.
In one example embodiment, the annotations 142 can be in any shape or dimension and positioned at any location on the electronic image of the tissue sample 12. The user or medical personnel can create custom annotations that become meta data 162 that can be captured by the system 10 and recognized by the interface 14. In addition, users or medical personnel can define any number of classes and subclasses 164 on the electronic images 166. The classes and subclasses 164 can be uniquely color coded and drive the comparison of these unique areas of interest by the molecular data derived from the experiment or MS scan.
In another example embodiment, the annotations 142 are linked to medical records and/or are used in electronically delivered pathology reports. While in another example embodiment, the annotations 142 and classes and subclasses 164 provide meta data, which all three modes of information can be used in a classification system 464, 564, respectively in
Referring now to
Illustrated in
In the illustrated example embodiment, the project management program 300 through the pathology interface 14 provides four different user operation views 310, 312, 314, and 316. The first view 310 includes a secure login for the user or medical personnel to insure access to only authorized users of the project management program 300, which is controlled by the system administrator. Access at the first view 310 is limited to those users or collaborators involved with a project and only gain access to projects authorized by the system administrator.
The second view 312 includes a database 212 that is organized by projects 318. Each project 318 may relate to an individual or set of patients, test, tumor, sample, and the like, with basic information shown on the second view 312 about the project, such as identification data. Users, collaborators, and medical personnel can only view projects in the database 212 which they have been assigned.
The third view 314 is a project view that allows samples to connect to each project 318. It is in this third view 314 that users, collaborators, or medical personnel can input sample information for the study. In the third view 314, micrograph samples 12 are automatically assigned to samples 12 based on the filename and import by the pathology interface 14. In addition, samples 12 can be assigned to more than one project 318.
The fourth view 316 includes a sample view that all information relating to a particular sample 12 is displayed via the pathology interface 14, including thumbnail images 322 of the associated micrographs. Also within this fourth view, all projects 318 for which the sample has been assigned is shown in a dropdown window 320. Selection of the thumbnail image 322 opens the image annotation window 320.
Illustrated in
Shown in
During operation, the system 60 can receive tissue images 12 from the input interface 72, which then applies chemistry 128 (such as biomarkers and/or reagents) to the tissue images with the biomarker interface 68 and annotation interface 70 to apply a matrix 132 using a spotter or sprayer directed at the tissues using the system's matrix interface 66. A MS 18 is then controlled based on the matrix 132 coordinates on the tissues to form the enhanced images 20. In the illustrated example embodiment, the MS 18 is in communication with the system 60.
In the illustrated example embodiment, the process 400 is controlled by the pathology interface 14 at 440. The pathology interface 14 receives and/or stores the first set images 432. At which time, medical personnel can access or is notified that the first set of images 432 are available for viewing at 442. Upon viewing the first set of images 432, the medical personnel (either locally or remotely) can control the acquisition of data from a mass spectrometer by applying chemistry 128, such as matrix or other reagents, annotations, and matrix coordinates to the images at 444 under the instructions and operation provided by the pathology interface 14. The annotations are used to apply matrix or reagents to specific regions of the tissue, directed by the pathology interface 14.
Once the application of annotations on the first set of images is complete at 444, the pathology interface 14 communicates using a robotic interface 446 for positioning of a matrix in the region of interest (identified by the medical personnel) on the tissue samples 12 at 448. The coordinates of the matrix 132 are then used at 450 to operate a MS 18 to generate one or more scans of the sample 12 at 452. The scanning by the MS 18 then generates a second set of images 455 at 454.
Using the second set of images 455 at 454, the pathology interface 14 provides access to local and/or remote collaborators 456, 458, 460, and 462, including the medical personnel, which will use the second set of images for example, diagnostic or treatment purposes. The second set of images 455 in the illustrated example embodiment are further utilized in a remote classification system 464, which compares the second set of images 455 with images in a database of the classification system for diagnostic and treatment analysis.
In another alternative work-flow example embodiment of the interface process 400 avoids the staining operation of the tissue samples at 420, and uses unstained or pretreated tissues at 415 to create the first electronic images at 430. Thus, the paths 412 and 445 are avoided.
In yet another alternative work-flow example embodiment of the interface process 400, the electronic tissue are used to guide the analysis of tissue placed onto matrix precoated targets 12. Thus, the step 445 is avoided along with the placement of the matrix on the tissue sample images at 448. A robotic interface 446 facilitates along step 447 the coordinates the matrix of the precoated tissue images to the MS operation to form a second set of electronic images 455.
In the illustrated example embodiment, the process 500 is controlled by the pathology interface 14 at 540. The pathology interface 14 receives and/or stores the first set images 532. At which time, medical personnel can access or is notified that the first set of images 532 are available for viewing at 542. Upon viewing the first set of images 532, the medical personnel (either locally or remotely) can control the acquisition of data from a mass spectrometer by applying annotations, and matrix coordinates to the images at 544 under the instructions and operation provided by the pathology interface 14.
Once the application of annotations on the first set of images 532 is complete at 544, the pathology interface 14 communicates using a robotic interface 546 for positioning of a matrix in the region of interest (identified by the medical personnel) on the unstained Group B tissue samples 12 at 548. The coordinates of the matrix 132 are then used at 550 to operate a MS 18 to generate one or more scans of the unstained Group A samples 12 at 552. The scanning by the MS 18 then generates a second set of images 555 at 554.
Using the second set of images at 555, the pathology interface 14 provides access to local and/or remote collaborators 556, 558, 560, and 562, including the medical personnel, which will use the second set of images for example, diagnostic or treatment purposes. The second set of images 555 in the illustrated example embodiment are further utilized in a remote classification system 564, which compares the images 555 with images in a database of the classification system for diagnostic and treatment analysis.
In an alternative work-flow example embodiment of the interface process 500, the placement of the matrix on Group B is not necessary. Thus, the step 545, robotic interface 546, and placement of the matrix on Group B at 548 is avoided. Accordingly, samples from Group B then flow from 514 along 547 to the positioning by the pathology interface 14 of coordinates upon the areas of interest to the pathologist to drive the MS at 550.
In the foregoing specification, specific embodiments have been described. However, one of ordinary skill in the art appreciates that various modifications and changes can be made without departing from the scope of the disclosure as set forth in the claims below. Accordingly, the specification and figures are to be regarded in an illustrative rather than a restrictive sense, and all such modifications are intended to be included within the scope of present teachings.
The benefits, advantages, solutions to problems, and any element(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential features or elements of any or all the claims. The disclosure is defined solely by the appended claims including any amendments made during the pendency of this application and all equivalents of those claims as issued.
Moreover in this document, relational terms such as first and second, top and bottom, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms “comprises,” “comprising,” “has”, “having,” “includes”, “including,” “contains”, “containing” or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises, has, includes, contains a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by “comprises . . . a”, “has . . . a”, “includes . . . a”, “contains . . . a” does not, without more constraints, preclude the existence of additional identical elements in the process, method, article, or apparatus that comprises, has, includes, contains the element. The terms “a” and “an” are defined as one or more unless explicitly stated otherwise herein. The terms “substantially”, “essentially”, “approximately”, “about” or any other version thereof, are defined as being close to as understood by one of ordinary skill in the art, and in one non-limiting embodiment the term is defined to be within 10%, in another embodiment within 5%, in another embodiment within 1% and in another embodiment within 0.5%. The term “coupled” as used herein is defined as connected, although not necessarily directly and not necessarily mechanically. A device or structure that is “configured” in a certain way is configured in at least that way, but may also be configured in ways that are not listed.
The Abstract of the Disclosure is provided to allow the reader to quickly ascertain the nature of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, it can be seen that various features are grouped together in various embodiments for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment. Thus, the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separately claimed subject matter.
The present application claims priority under 35 U.S.C. §371 to currently pending International Patent Application Serial No. PCT/US 14/XXX,XXX filed Jun. 9, 2014, which claims priority under 35 U.S.C. §119(e) to U.S. Provisional Patent Application Ser. No. 61/832,379 filed Jun. 7, 2013, both entitled PATHOLOGY INTERFACE FOR MASS SPECTROMETRY. The above-identified applications are incorporated herein by reference in their entirety for all purposes.
This invention was made with government support under Grant Nos. National Center for Research Resources (5P41RR031461) and National Institute of General Medical Sciences (8P41GM103391) awarded by The National Institutes of Health. The United States government has certain rights to the invention.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2014/041530 | 6/9/2014 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
61832379 | Jun 2013 | US |