This invention is related to bioinformatics and biological data analysis. Specifically, this invention provides methods, computer software products and systems for the analysis of biological data.
Many biological functions are carried out by regulating the expression levels of various genes, either through changes in the copy number of the genetic DNA, through changes in levels of transcription (e.g. through control of initiation, provision of RNA precursors, RNA processing, etc.) of particular genes, or through changes in protein synthesis. For example, control of the cell cycle and cell differentiation, as well as diseases, are characterized by the variations in the transcription levels of a group of genes.
Recently, massive parallel gene expression monitoring methods have been developed to monitor the expression of a large number of genes using nucleic acid array technology which was described in detail in, for example, U.S. Pat. No. 5,871,928; de Saizieu, et al., 1998, Bacteria Transcript Imagine by Hybridization of total RNA to Oligonucleotide Arrays, N
Massive parallel gene expression monitoring experiments generate unprecedented amounts of information. For example, a commercially available GeneChip® array set is capable of monitoring the expression levels of approximately 6,500 murine genes and expressed sequence tags (ESTs) (Affymetrix, Inc, Santa Clara, Calif., USA). Array sets for approximately 60,000 human genes and EST clusters, 24,000 rat transcripts and EST clusters and arrays for other organisms are also available from Affymetrix. Effective analysis of the large amount of data may lead to the development of new drugs and new diagnostic tools. Therefore, there is a great demand in the art for methods for organizing, accessing and analyzing the vast amount of information collected using massive parallel gene expression monitoring methods.
The current invention provides methods, systems and computer software products suitable for analyzing data from gene expression monitoring experiments that employ multiple probes against a single target.
In one aspect of the invention, non-parametric statistical analysis is employed to analyze results of multiple probe gene expression experiments with control probes such as mismatch probes. In some embodiments, each target sub-region of a transcript is detected using two probes. One of probes is a perfect match (PM) probe that is designed to be completely complementary to a reference or target transcript. A mismatch (MM) probe is a probe that is designed to be complementary to a reference sequence except for some mismatches that may significantly affect the hybridization between the probe and its target sequence. In preferred embodiments, MM probes are designed to be complementary to a reference sequence except for a homomeric base mismatch at the central (e.g., 13th in a 25 base probe) position. Mismatch probes are normally used as controls for cross-hybridization. A probe pair is usually composed of a PM and its corresponding MM probe. The difference between PM and MM provides an intensity difference in a probe pair.
In one aspect of the invention, computer implemented methods are used for determining whether a transcript is present in a biological sample. The methods include step of providing a plurality of perfect match intensity values (PMi) and mismatch intensity values (MMi) for the transcript, where each of the PMi is paired with one of the MMi; calculating a p-value using one sided Wilcoxon's signed rank test, where the p-value is for a null hypothesis that θ=a threshold value and an alternative hypothesis that said θ>the threshold value, wherein said θ is a test statistic for intensity difference between the perfect match intensity values and mismatch intensity values; and indicating whether the transcript is present based upon the p-value.
In some embodiments, the testing statistic is median(PMi−MMi). The threshold value may be zero. In some preferred embodiments, the threshold value is calculated using τ1=c1{square root}{square root over (median(PMi))} wherein said c1 is a constant. Alternatively, the threshold value is calculated using: τ1=c1{square root}{square root over (mean(PMi))} wherein c1 is a constant.
The presence, marginal present or absence (detected, marginally detected or undetected) of a transcript may be called based upon the p-value and significance levels. Significance levels, α1 and α2 may be set such that: 0<α1<α2<0.5. Note that for the one-sided test, if null hypothesis is true, the most likely observed p-value is 0.5, which is equivalent to 1 for the two-sided test. Let p be the p-value of one sided signed rank test. In preferred embodiments, if p<α1, a “detected” call can be made (i.e., the expression of the target gene is detected in the sample). If α1≦p<α2, a marginally detected call may be made. If p≧α2, “undetected call” may be made. The proper choice of significance levels and the thresholds can reduce false calls. In some preferred embodiments, 0<α1<α2<0.06. In some particularly preferred embodiments, α1 is around 0.04 and α2 is around 0.06.
In some particularly preferred embodiments, the testing statistic is median((PMi−MMi)/(PMi=MMi)). In these embodiments, the threshold value is a constant. Typically, the threshold value is around 0.001 to 0.05. Most preferably, the threshold value is around 0.015.
In another aspect of the invention, computer implemented methods are provided for analyzing gene expression experiments where a transcript is detected with multiple probes. The method include steps of providing a plurality of perfect match intensity values (PMi) and background intensity values (Bi) for the transcript, where each of the PMi is paired with its corresponding Bi; calculating a p value using one sided Wilcoxon's signed rank test, wherein the p value is for a null hypothesis that θ=a threshold value and an alternative hypothesis that the θ>the threshold value, where the θ is a test statistic for intensity difference between the perfect match intensity values and background intensity values; and indicating whether the transcript is present based upon the p-value. In preferred embodiments, the testing statistic is median(PMi−Bi).
The threshold value can be zero. However, in preferred embodiments, the threshold value is calculated using τ3=c3{square root}{square root over (median(PMi))} where the c1 is a constant. Alternatively, the threshold value is calculated using: Σ3=c3{square root}{square root over (mean(PMi))} where the c3 is a constant.
The presence, marginal present or absence (detected, marginally detected or undetected) of a transcript may be called based upon the p-value and significance levels. Significance levels, α1 and α2 may be set such that: 0<α1<α2<0.5. Note that for the one-sided test, if null hypothesis is true, the most likely observed p-value is 0.5, which is equivalent to 1 for the two-sided test. Let p be the p-value of one-sided signed rank test. In preferred embodiments, if p<α1, a “detected” call can be made (i.e., the expression of the target gene is detected in the sample). If α1≦p<α2, a marginally detected call may be made. If p≧α2, “undetected call” may be made. The proper choice of significance levels and the thresholds can reduce false calls. In some preferred embodiments, 0<α1<α2<0.06. In some particularly preferred embodiments, α1 is around 0.04 and α2 is around 0.06.
In another aspect, computer software products are provided. The computer software products include computer program code for inputting a plurality of perfect match intensity values (PMi) and mismatch intensity values (MMi) for a transcript, wherein each of the PMi is paired with one of the MMi; computer program code for calculating a p value using one-sided Wilcoxon's signed rank test, wherein the p value is for a null hypothesis that θ=a threshold value and an alternative hypothesis that the θ>the threshold value, wherein the θ is a test statistic for intensity difference between the perfect match intensity values and mismatch intensity values; computer program code for indicating whether the transcript is present based upon the p value; and a computer readable media for storing the computer program codes. In some preferred embodiments of the computer software products, the testing statistic is median(PMi−MMi). The threshold value may be zero in some embodiments. In preferred embodiments, however, the threshold value is calculated using τ1=c1{square root}{square root over (median(PMi))} where the c1 is a constant or using τ1=c1{square root}{square root over (mean(PMi))} where the c1 is a constant.
In some particularly preferred embodiments of the computer software products of the invention, the testing statistic is median((PMi−MMi)/(PMi−MMi)) and threshold value is a constant. The computer program product may contain code for accepting user's selection or input of the threshold value. A default value may be used as well. Typically, the threshold value is around 0.001 to 0.05. In a particularly preferred embodiment, the threshold value is around 0.015.
The presence, marginal present or absence (detected, marginally detected or undetected) of a transcript may be called based upon the p-value and significance levels. Significance levels, α1 and α2 may be set such that: 0<α1<α2<0.5. In preferred embodiments, if p<α1, a “detected” call can be made (i.e., the expression of the target gene is detected in the sample). If α1≦p<α2, a marginally detected call may be made. If p≧α2, “undetected call” may be made. The proper choice of significance levels and the thresholds can reduce false calls. In some preferred embodiments, 0<α1<α2<0.06. In some particularly preferred embodiments, α1 is around 0.04 and α2 is around 0.06.
The computer software product may include computer program code for indicating that the transcript is present, absent or marginally absent. The computer program code, when executed, may indicate the result by causing the display of the result on a display device such as a screen. Alternatively, the result may be outputted into a file. In addition, the result may be temporary stored in a computer memory device so that other computer program module may access this result. In some preferred embodiments, the computer software products may include code to accept user's selection of various significance levels.
In addition, the present invention includes computer software products for analyzing the presence of a transcript without using mismatch intensities. The computer software product includes computer program code for providing a plurality of perfect match intensity values (PMi) and background intensity values (Bi) for a transcript, wherein each of the PMi is paired with one of the Bi; computer program code for calculating a p-value using one-sided Wilcoxon's signed rank test, wherein said p-value is for a null hypothesis that θ=a threshold value and an alternative hypothesis that the θ>the threshold value, where the θ is a test statistic for intensity difference between the perfect match intensity values and background intensity values; and computer program code for indicating whether the transcript is present based upon the p-value; and a computer readable media for storing the codes. The testing statistic may be median(PMi−Bi). The threshold value can be zero. In preferred embodiments, the threshold value is calculated using: τ3=c3{square root}{square root over (median(PMi))} where the c3 is a constant and alternatively, the threshold value is calculated using: τ3=c3{square root}{square root over (mean(PMi))} where the c3 is a constant.
The computer software product may include computer program code for indicating that the transcript is present, absent or marginally absent. The computer program code, when executed, may indicate the result by causing the display of the result on a display device such as a screen. Alternatively, the result may be outputted into a file. In addition, the result may be temporary stored in a computer memory device so that other computer program module may access this result. In some preferred embodiments, the computer software products may include code to accept user's selection of various significance levels.
In addition, systems for determining whether a transcript is present in a biological sample are also provided. The systems include a processor; and a memory being coupled to the processor, the memory storing a plurality machine instructions that cause the processor to perform a plurality of logical steps when implemented by the processor; the logical steps include the method steps of the invention.
The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention:
Reference will now be made in detail to the preferred embodiments of the invention. While the invention will be described in conjunction with the preferred embodiments, it will be understood that they are not intended to limit the invention to these embodiments. On the contrary, the invention is intended to cover alternatives, modifications and equivalents, which may be included within the spirit and scope of the invention. All cited references, including patent and non-patent literature, are incorporated herein by reference in their entireties for all purposes.
I. Gene Expression Monitoring With High Density Oligonucleotide Probe Arrays
High density nucleic acid probe arrays, also referred to as “DNA Microarrays,” have become a method of choice for monitoring the expression of a large number of genes. As used herein, “Nucleic acids” may include any polymer or oligomer of nucleosides or nucleotides (polynucleotides or oligonucleotidies), which include pyrimidine and purine bases, preferably cytosine, thymine, and uracil, and adenine and guanine, respectively. See Albert L. Lehninger, PRINCIPLES OF BIOCHEMISTRY, at 793-800 (Worth Pub. 1982) and L. Stryer BIOCHEMISTRY, 4th Ed., (March 1995), both incorporated by reference. “Nucleic acids” may include any deoxyribonucleotide, ribonucleotide or peptide nucleic acid component, and any chemical variants thereof, such as methylated, hydroxymethylated or glucosylated forms of these bases, and the like. The polymers or oligomers may be heterogeneous or homogeneous in composition, and may be isolated from naturally-occurring sources or may be artificially or synthetically produced. In addition, the nucleic acids may be DNA or RNA, or a mixture thereof, and may exist permanently or transitionally in single-stranded or double-stranded form, including homoduplex, heteroduplex, and hybrid states.
“A target molecule” refers to a biological molecule of interest. The biological molecule of interest can be a ligand, receptor, peptide, nucleic acid (oligonucleotide or polynucleotide of RNA or DNA), or any other of the biological molecules listed in U.S. Pat. No. 5,445,934 at col. 5, line 66 to col. 7, line 51. For example, if transcripts of genes are the interest of an experiment, the target molecules would be the transcripts. Other examples include protein fragments, small molecules, etc. “Target nucleic acid” refers to a nucleic acid (often derived from a biological sample) of interest. Frequently, a target molecule is detected using one or more probes. As used herein, a “probe” is a molecule for detecting a target molecule. It can be any of the molecules in the same classes as the target referred to above. A probe may refer to a nucleic acid, such as an oligonucleotide, capable of binding to a target nucleic acid of complementary sequence through one or more types of chemical bonds, usually through complementary base pairing, usually through hydrogen bond formation. As used herein, a probe may include natural (i.e. A, G, U, C, or T) or modified bases (7-deazaguanosine, inosine, etc.). In addition, the bases in probes may be joined by a linkage other than a phosphodiester bond, so long as the bond does not interfere with hybridization. Thus, probes may be peptide nucleic acids in which the constituent bases are joined by peptide bonds rather than phosphodiester linkages. Other examples of probes include antibodies used to detect peptides or other molecules, any ligands for detecting its binding partners. When referring to targets or probes as nucleic acids, it should be understood that there are illustrative embodiments that are not to limit the invention in any way.
In preferred embodiments, probes may be immobilized on substrates to create an array. An “array” may comprise a solid support with peptide or nucleic acid or other molecular probes attached to the support. Arrays typically comprise a plurality of different nucleic acids or peptide probes that are coupled to a surface of a substrate in different, known locations. These arrays, also described as “microarrays” or colloquially “chips” have been generally described in the art, for example, in Fodor et al., Science, 251:767-777 (1991), which is incorporated by reference for all purposes. Methods of forming high density arrays of oligonucleotides, peptides and other polymer sequences with a minimal number of synthetic steps are disclosed in, for example, U.S. Pat. Nos. 5,143,854, 5,252,743,5,384,261, 5,405,783, 5,424,186, 5,429,807, 5,445,943, 5,510,270, 5,677,195, 5,571,639, 6,040,138, all incorporated herein by reference for all purposes. The oligonucleotide analogue array can be synthesized on a solid substrate by a variety of methods, including, but not limited to, light-directed chemical coupling, and mechanically directed coupling. See Pirrung et al., U.S. Pat. No. 5,143,854 (see also PCT Application No. WO 90/15070) and Fodor et al., PCT Publication Nos. WO 92/10092 and WO 93/09668, U.S. Pat. Nos. 5,677,195, 5,800,992 and 6,156,501 which disclose methods of forming vast arrays of peptides, oligonucleotides and other molecules using, for example, light-directed synthesis techniques. See also, Fodor et al., Science, 251, 767-77 (1991). These procedures for synthesis of polymer arrays are now referred to as VLSIPS™ procedures. Using the VLSIPS™ approach, one heterogeneous array of polymers is converted, through simultaneous coupling at a number of reaction sites, into a different heterogeneous array. See, U.S. Pat. Nos. 5,384,261 and 5,677,195.
Methods for making and using molecular probe arrays, particularly nucleic acid probe arrays are also disclosed in, for example, U.S. Pat. Nos. 5,143,854, 5,242,974, 5,252,743, 5,324,633, 5,384,261, 5,405,783, 5,409,810, 5,412,087, 5,424,186, 5,429,807, 5,445,934, 5,451,683, 5,482,867, 5,489,678, 5,491,074, 5,510,270, 5,527,681, 5,527,681, 5,541,061, 5,550,215, 5,554,501, 5,556,752, 5,556,961, 5,571,639, 5,583,211, 5,593,839, 5,599,695, 5,607,832, 5,624,711, 5,677,195, 5,744,101, 5,744,305, 5,753,788, 5,770,456, 5,770,722, 5,831,070, 5,856,101, 5,885,837, 5,889,165, 5,919,523, 5,922,591, 5,925,517, 5,658,734, 6,022,963, 6,150,147, 6,147,205, 6,153,743, 6,140,044 and D430024, all of which are incorporated by reference in their entireties for all purposes. Typically, a nucleic acid sample is a labeled with a signal moiety, such as a fluorescent label. The sample is hybridized with the array under appropriate conditions. The arrays are washed or otherwise processed to remove non-hybridized sample nucleic acids. The hybridization is then evaluated by detecting the distribution of the label on the chip. The distribution of label may be detected by scanning the arrays to determine florescence intensities distribution. Typically, the hybridization of each probe is reflected by several pixel intensities. The raw intensity data may be stored in a gray scale pixel intensity file. The GATC™ Consortium has specified several file formats for storing array intensity data. The final software specification is available at www.gatcconsortium.org and is incorporated herein by reference in its entirety. The pixel intensity files are usually large. For example, a GATC™ compatible image file may be approximately 50 Mb if there are about 5000 pixels on each of the horizontal and vertical axes and if a two byte integer is used for every pixel intensity. The pixels may be grouped into cells (see, GATC™ software specification). The probes in a cell are designed to have the same sequence (i.e., each cell is a probe area). A CEL file contains the statistics of a cell, e.g., the 75 percentile and standard deviation of intensities of pixels in a cell. The 75 percentile of pixel intensity of a cell is often used as the intensity of the cell. Methods for signal detection and processing of intensity data are additionally disclosed in, for example, U.S. Pat. Nos. 5,547,839, 5,578,832, 5,631,734, 5,800,992, 5,856,092, 5,936,324, 5,981,956, 6,025,601, 6,090,555, 6,141,096, 6,141,096, and 5,902,723. Methods for array based assays, computer software for data analysis and applications are additionally disclosed in, e.g., U.S. Pat. Nos. 5,527,670, 5,527,676, 5,545,531, 5,622,829, 5,631,128, 5,639,423, 5,646,039, 5,650,268, 5,654,155, 5,674,742, 5,710,000, 5,733,729, 5,795,716, 5,814,450, 5,821,328, 5,824,477, 5,834,252, 5,834,758, 5,837,832, 5,843,655, 5,856,086, 5,856,104, 5,856,174, 5,858,659, 5,861,242, 5,869,244, 5,871,928, 5,874,219, 5,902,723, 5,925,525, 5,928,905, 5,935,793, 5,945,334, 5,959,098, 5,968,730, 5,968,740, 5,974,164, 5,981,174, 5,981,185,5,985,651, 6,013,440, 6,013,449, 6,020,135, 6,027,880, 6,027,894, 6,033,850, 6,033,860, 6,037,124, 6,040,138, 6,040,193, 6,043,080, 6,045,996, 6,050,719, 6,066,454, 6,083,697, 6,114,116, 6,114,122, 6,121,048, 6,124,102, 6,130,046, 6,132,580, 6,132,996 and 6,136,269, all of which are incorporated by reference in their entireties for all purposes.
Nucleic acid probe array technology, use of such arrays, analysis array based experiments, associated computer software, composition for making the array and practical applications of the nucleic acid arrays are also disclosed, for example, in the following U.S. patent application Ser. Nos. 07/838,607, 07/883,327, 07/978,940, 08/030,138, 08/082,937, 08/143,312, 08/327,522, 08/376,963, 08/440,742, 08/533,582, 08/643,822, 08/772,376, 09/013,596, 09/016,564, 09/019,882, 09/020,743, 09/030,028, 09/045,547, 09/060,922, 09/063,311,09/076,575, 09/079,324,09/086,285, 09/093,947,09/097,675, 09/102,167, 09/102,986, 09/122,167, 09/122,169, 09/122,216, 09/122,304, 09/122,434, 09/126,645, 09/127,115, 09/132,368, 09/134,758, 09/138,958, 09/146,969, 09/148,210, 09/148,813, 09/170,847, 09/172,190, 09/174,364, 09/199,655, 09/203,677, 09/256,301, 09/285,658, 09/294,293, 09/318,775, 09/326,137, 09/326,374, 09/341,302, 09/354,935, 09/358,664, 09/373,984, 09/377,907, 09/383,986, 09/394,230, 09/396,196, 09/418,044, 09/418,946, 09/420,805, 09/428,350, 09/431,964, 09/445,734, 09/464,350, 09/475,209, 09/502,048, 09/510,643, 09/513,300, 09/516,388, 09/528,414, 09/535,142, 09/544,627, 09/620,780, 09/640,962, 09/641,081, 09/670,510, 09/685,011, and 09/693,204 and in the following Patent Cooperative Treaty (PCT) applications/publications: PCT/NL90/00081, PCT/GB91/00066, PCT/US91/08693, PCT/US91/09226, PCT/US91/09217, WO/93/10161, PCT/US92/10183, PCT/GB93/00147, PCT/US93/01152, WO/93/22680, PCT/US93/04145, PCT/US93/08015, PCT/US94/07106, PCT/US94/12305, PCT/GB95/00542, PCT/US95/07377, PCT/US95/02024, PCT/US96/05480, PCT/US96/11147, PCT/US96/14839, PCT/US96/15606, PCT/US97/01603, PCT/US97/02102, PCT/GB97/005566, PCT/US97/06535, PCT/GB97/01148, PCT/GB97/01258, PCT/US97/08319, PCT/US97/08446, PCT/US97/10365, PCT/US97/17002, PCT/US97/16738, PCT/US97/19665, PCT/US97/20313, PCT/US97/21209, PCT/US97/21782, PCT/US97/23360, PCT/US98/06414, PCT/US98/01206, PCT/GB98/00975, PCT/US98/04280, PCT/US98/04571, PCT/US98/05438, PCT/US98/05451, PCT/US98/12442, PCT/US98/12779, PCT/US98/12930, PCT/US98/13949, PCT/US98/15151, PCT/US98/15469, PCT/US98/15458, PCT/US98/15456, PCT/US98/16971, PCT/US98/16686, PCT/US99/19069, PCT/US98/18873, PCT/US98/18541, PCT/US98/19325, PCT/US98/22966, PCT/US98/26925, PCT/US98/27405 and PCT/IB99/00048, all of which are incorporated by reference in their entireties for all purposes. All the above cited patent applications and other references cited throughout this specification are incorporated herein by reference in their entireties for all purposes.
The embodiments of the invention will be described using GeneChip® high oligonucleotide density probe arrays (available from Affymetrix, Inc., Santa Clara, Calif., USA) as exemplary embodiments. One of skill the art would appreciate that the embodiments of the invention are not limited to high density oligonucleotide probe arrays. In contrast, the embodiments of the invention are useful for analyzing any parallel large scale biological analysis, such as those using nucleic acid probe array, protein arrays, etc.
Gene expression monitoring using GeneChip® high density oligonucleotide probe arrays are described in, for example, Lockhart et al., 1996, Expression Monitoring By Hybridization to High Density Oligonucleotide Arrays, Nature Biotechnology 14:1675-1680; U.S. Pat. Nos. 6,040,138 and 5,800,992, all incorporated herein by reference in their entireties for all purposes.
In the preferred embodiment, oligonucleotide probes are synthesized directly on the surface of the array using photolithography and combinatorial chemistry as disclosed in several patents previous incorporated by reference. In such embodiments, a single square-shaped feature on an array contains one type of probe. Probes are selected to be specific against desired target. Methods for selecting probe sequences are disclosed in, for example, U.S. patent application Ser. No. ______, Attorney Docket Number 3359; Ser. No. ______, filed Nov. 21, 2000, Attorney Docket Number 3367, filed Nov. 21, 2000, and Ser. No. ______, Attorney Docket Number 3373, filed Nov. 21, 2000, all incorporated herein by reference in their entireties for all purposes.
In a preferred embodiment, oligonucleotide probes in the high density array are selected to bind specifically to the nucleic acid target to which they are directed with minimal non-specific binding or cross-hybridization under the particular hybridization conditions utilized. Because the high density arrays of this invention can contain in excess of 1,000,000 different probes, it is possible to provide every probe of a characteristic length that binds to a particular nucleic acid sequence. Thus, for example, the high density array can contain every possible 20 mer sequence complementary to an IL-2 mRNA. There, however, may exist 20 mer subsequences that are not unique to the IL-2 mRNA. Probes directed to these subsequences are expected to cross hybridize with occurrences of their complementary sequence in other regions of the sample genome. Similarly, other probes simply may not hybridize effectively under the hybridization conditions (e.g., due to secondary structure, or interactions with the substrate or other probes). Thus, in a preferred embodiment, the probes that show such poor specificity or hybridization efficiency are identified and may not be included either in the high density array itself (e.g., during fabrication of the array) or in the post-hybridization data analysis.
Probes as short as 15, 20, 25 or 30 nucleotides are sufficient to hybridize to a subsequence of a gene and that, for most genes, there is a set of probes that performs well across a wide range of target nucleic acid concentrations. In a preferred embodiment, it is desirable to choose a preferred or “optimum” subset of probes for each gene before synthesizing the high density array.
In some preferred embodiments, the expression of a particular transcript may be detected by a plurality of probes, typically, up to 5, 10, 15, 20, 30 or 40 probes. Each of the probes may target different sub-regions of the transcript. However, probes may overlap over targeted regions.
In some preferred embodiments, each target sub-region is detected using two probes: a perfect match (PM) probe that is designed to be completely complementary to a reference or target sequence. In some other embodiments, a PM probe may be substantially complementary to the reference sequence. A mismatch (MM) probe is a probe that is designed to be complementary to a reference sequence except for some mismatches that may significantly affect the hybridization between the probe and its target sequence. In preferred embodiments, MM probes are designed to be complementary to a reference sequence except for a homomeric base mismatch at the central (e.g., 13th in a 25 base probe) position. Mismatch probes are normally used as controls for cross-hybridization. A probe pair is usually composed of a PM and its corresponding MM probe. The difference between PM and MM provides an intensity difference in a probe pair.
II. Data Analysis Systems
In one aspect of the invention, methods, computer software products and systems are provided for computational analysis of microarray intensity data for determining the presence or absence of genes in a given biological sample. Accordingly, the present invention may take the form of data analysis systems, methods, analysis software, etc. Software written according to the present invention is to be stored in some form of computer readable medium, such as memory, or CD-ROM, or transmitted over a network, and executed by a processor. For a description of basic computer systems and computer networks, see, e.g., Introduction to Computing Systems: From Bits and Gates to C and Beyond by Yale N. Patt, Sanjay J. Patel, 1st edition (Jan. 15, 2000) McGraw Hill Text; ISBN: 0072376902; and Introduction to Client/Server Systems: A Practical Guide for Systems Professionals by Paul E. Renaud, 2nd edition (June 1996), John Wiley & Sons; ISBN: 0471133337.
Computer software products may be written in any of various suitable programming languages, such as C, C++, C# (Microsoft®), Fortran, Perl, MatLab (MathWorks, www.mathworks.com), SAS, SPSS and Java. The computer software product may be an independent application with data input and data display modules. Alternatively, the computer software products may be classes that may be instantiated as distributed objects. The computer software products may also be component software such as Java Beans (Sun Microsystem), Enterprise Java Beans (EJB, Sun Microsystems), Microsoft® COM/DCOM (Microsoft®), etc.
III. Gene Expression Calls Using Non-Parametric Statistics
Computational analysis of probe array intensity data for determining the presence or absence of expression of genes in a given biological sample is a crucial step in extraction of useful information from experimental data. There may be a large uncertainty associated with these calls (i.e., determination of the presence or absence of the expression of genes) because of many random effects such as inevitable variations in manufacturing and experimental conditions, and the complexity of cross hybridization.
It is therefore desirable for every call to provide a p-value, the probability value for a testing statistic be equal or further extreme to its observed value under the null hypothesis.
In one aspect of the invention, methods, computer software and systems are provided to determine (or call) the presence or absence of the expression of target genes using data from gene expression experiments that employ multiple probes against a single target. The methods include steps for computing p-values of such calls using non-parametric statistics.
Nonparametric statistical methods are powerful tools for computing exact p-values when the distribution of original data is unknown (e.g., Wilcoxon, F. Individual Comparisons by Ranking Methods, Biometrics, 1:80-83 (1945) Hogg R V, Tanis E A (1997) Probability and Statistical Inference (fifth edition), Upper Saddle River, N.J.: Prentice-Hall, Inc Hollander M, Wolfe D A (1999) Nonparametric Statistical Methods (second edition), New York: John Wiley & Sons, Inc., all incorporated herein by reference for all purposes).
Many nonparametric methods use ranks or signs of data, and hence are insensitive to outliers. Their assumptions about the distributions of the original data are much weaker than those of parametric methods. Therefore, they can be applied to more general situations.
In some embodiments, Wilcoxon's signed rank test is used to analyze paired PM and MM probes. In a block of n probe pairs (also known as atoms,
Let the i-th perfectly matching cell intensity be PMi and the i-th mismatching cell intensity be MMi (i=1, . . . , n). All these data are positive numbers. As described above, in some embodiments, the hybridization of each probe may be reflected by several pixel intensities. In such embodiments, the cell intensity is derived from the pixel intensities. In preferred embodiments, around 60, 70, 75, 80, 85, or 90 percentile of of intensities of inner pixels in a cell is used to represent the cell intensity. In a particularly preferred embodiment, the 75 percentile of intensities of inner pixels in a cell is used to represent the cell intensity and is saved in a CEL file together with the number of pixels and the standard deviation of intensities at these pixels.
The traditional parametric approach to compare PMi and MMi is to test whether the mean of PMi is equal to the mean of MMi, or equivalently, whether the mean of differences
D=PMi−MMi (1)
is zero. To calculate the p-value, normal distribution is assumed.
The nonparametric approach, by contrast, is to test whether the median of PMi is the same as the median of MMi, or equivalently, whether the median of differences Di=PMi−MMi is zero. In practice, it is better to include a positive threshold τ, and to test whether the median of Di is larger than τ.
In practice, when using differences Di, we require Di be larger than a certain threshold τ to make a detected call. Using a threshold τ can avoid a detected call if most PMi's are only slightly larger than MMi's, which is possible sometimes when the gene is really absent. In one embodiment, τ may be calculated as follows:
Other statistics such as the discrimination score (also referred to as Ryder's discrimination score):
can also be used. In spite of these different flavors of implementation, the principles of computing p-values are the same. The methods of the invention involve the testing the null hypothesis
If all values if Di's are zeros, then we accept the null hypothesis and let the p-value be 0.5 for the one-sided test. If there are some but not all values of Di's are zeros, then we remove these zero values and adjust the block size n to be the number of nonzero Di's that are used for computing p-values.
Where there are no zero values of Di's, all |Di|'s are sorted in the ascending order. If there are no ties among |Di|'s, they can be ranked and assigned positive integers 1, 2, . . . , n. Then, the signs of the original data are given to the ranks.
If there are ties of |Di|'s the average of the consecutive integer ranks are assigned to entries in a tied group. For example, consider six probe pairs with D1=150.2, D2=−300.1, D3=1700.1, D4=−150.2, D5=−50.3, D6=−50.3. There are two tied groups: |D1|=|D4| and |D5|=|D6|. The signed ranks are r1=3.5, r2=−5, r3=6, r4=3.5, r5=−1.5, and r6=−1.5.
Let signed rank of Di be ri. The sum of all positive signed ranks may be calculated as follows:
where the characteristic coefficient
Under the null hypothesis, all 2n possible patterns of signed ranks are uniformly distributed. Using this fact, the exact p-value for an observed W1+ statistic can be calculated.
The computation of exact p-value becomes expensive when n is large. For large samples, under the null hypothesis, normal approximation for W1+ may be used, whose mean and variance are respectively
where g is the number of tied groups, and tk is the number of tied entries in tied group k. Then the statistic
should approximately have the standard normal distribution N(0,1).
Statistics other than Di=PMi−MMi can also be used for nonparametric methods. For example, Ryder's discrimination score
is a monotonically increasing function of the ratio PMi/MMi. It changes the range (0,∞) of PMi/MMi to the range (−1,1) of Ri. In another embodiment, the following discrimination score may be used:
To compare the results of two experiments on the same chip, it is important to determine a normalization factor. Let PMi(b) and MMi(b) be the intensity data of a baseline experiment, and PMi(e) and MMi(e) be the intensity data of the other experiment.
Wilcoxon's signed rank test can be applied to compare PMi(b) with N·PMi(e). Ri(b) may also be directly compared with Ri(e), Ryder's discrimination score of the baseline experiment with that of the other experiment.
Other nonparametric methods can also be used to analyze microarray intensity data. The CEL files give cell intensity which is the 75 percentile of pixel itensities in a cell. When we want to reduce the number of probe sets in a block, using the DAT file to take all pixel intensities into consideration may give more dependable analysis and more reasonable p-values.
In some particularly preferred embodiments, the following three statistics of cell intensities can be used to make calls based on one sided Wilcoxon's signed rank test. The null hypothesis is denoted H0 and alternative hypothesis H1.
Here, the threshold τ1, τ2, and τ3 are non-negative, and Bi in the third method is a space dependent background. Significance levels, α1 and α2 may be set such that: 0<α1<α2<0.5. Note that for the one-sided test, if null hypothesis is true, the most likely observed p value is 0.5, which is equivalent to 1 for the two-sided test. Let p be the p-value of one sided signed rank test. In preferred embodiments, if p<α1, a “detected” call can be made (i.e., the expression of the target gene is detected in the sample). If α1≦p<α2, a marginally detected call may be made. If p≧α2, “undetected call” may be made. The proper choice of significance levels and the thresholds can reduce false calls.
The threshold τ1 may be set to be proportional to the square root of the sample median or mean of perfect match intensity, i.e.,
τ1=c1{square root}{square root over (median(PMi))} (13)
The Ryde discrimination score in the second test is a relative measure of the difference between PMi and MMi. As discussed above, it is a monotonic function of ratio: ri=PMi/MMi, of perfect match and mismatch intensities:
Ri=(ri−1)/(ri+1) (14)
Using the Ryder statistic is particularly preferred if both perfect match and mismatch intensities are available. One benefit is that a constant τ2 may be used to get good results. Another justification of using a positive τ2 is that the median of Ri is a small positive number in several sets of Latin square experiments (Example 1, infra) with over 100 transcripts in each experiment with concentrations 0, 0.25, 0.5, 1, 2, 4, 8, 16, 32, 64, 128, 256, 512, 1024 pM. Table 1 lists the median, 25 percentile, 75 percentile, minimum and maximum of Ri in every concentration group. Table 2 is similar to Table 1, but with human genome complex background. Both data are on chips with lot number 9912072.
When median (Ri) is below 0.7, corresponding approximately to the concentration range below 30-60 pM or so, Ri increases when the concentration of the transcript increases. Beyond this range, Ri may decrease as transcript concentration increases, but remains higher than 0.7. Therefore, Ri is not always related to transcript concentration, especially when median (Ri) is above 0.7, but for the purpose of absolute calls, i.e., to detect the existence of a gene above a small concentration, e.g., 1 or 2 pM, Ri is a very good statistic to use.
τ2 may be set according user preference. In preferred embodiment, τ2 may be set at 0.005-0.05, preferably around 0.015, more preferably at 0.015. The third test, H0: median (PMi−Bi)=τ3; H1: median (PMi−Bi)>τ3;
If mismatch intensities are not available, Bi can be considered as a background, e.g., the average of the lowest 2 or the result of smoothing these averages. Bi so calculated is usually lower than the mismatch intensities, but this can be made up by adjusting τ3. In some cases, τ3 may be set to be proportional to the square root of the sample median or mean of perfect match intensity, i.e.,
τ3=c3{square root}{square root over (median(PMi))} (15)
When a gene has splicing variants, a subset of atoms in a block can show significant positive differences Di, but within the whole block the differences may not be so significantly different from 0. Nonparametric algorithms can detect this situation by calculating the relevant statistics for subsets of a block of atoms.
The nonparametric algorithms suggested here need sorting. The results of sorting subsets can be used for sorting the whole set with the merge sort algorithm. It can save the total computing time for the detection of splicing variants with nonparametric algorithms.
IV. Methods, Computer Software and Systems for Making Gene Expression Calls
In one aspect of the invention, computer implemented methods are provided for analyzing gene expression experiments.
In some embodiments (
The presence, marginal present or absence (detected, marginally detected or undetected) of a transcript may be called based upon the p-value and significance levels (54-58). Significance levels, α1 and α2 may be set such that: 0<α1<α2<0.5. Note that for the one-sided test, if null hypothesis is true, the most likely observed p-value is 0.5, which is equivalent to 1 for the two-sided test. Let p be the p-value of one sided signed rank test. In preferred embodiments, if p<α1, a “detected” call can be made (i.e., the expression of the target gene is detected in the sample). If α1≦p<α2, a marginally detected call may be made. If p≧α2, “undetected call” may be made. The proper choice of significance levels and the thresholds can reduce false calls. In some preferred embodiments, 0<α1<α2<0.06. In some particularly preferred embodiments, α1 is around 0.04 and α2 is around 0.06.
In some particularly preferred embodiments (
In another aspect of the invention, computer implemented methods are provided for analyzing gene expression experiments where a transcript is detected with multiple probes (
The threshold value can be zero. However, in preferred embodiments, the threshold value is calculated using: τ1=c1{square root}{square root over (median(PMi))} where the c1 is a constant. Alternatively, the threshold value is calculated using: τ3=c3{square root}{square root over (mean(PMi))} where the c3 is a constant.
The presence, marginal present or absence (detected, marginally detected or undetected) of a transcript may be called based upon the p-value and significance levels. Significance levels, α1 and α2 may be set such that: 0<α1<α2<0.5. Note that for the one-sided test, if null hypothesis is true, the most likely observed p value is 0.5, which is equivalent to 1 for the two-sided test. Let p be the p-value of one sided signed rank test. In preferred embodiments, if p<α1, a “detected” call can be made (i.e., the expression of the target gene is detected in the sample). If α1≦p<α2, a marginally detected call may be made. If p≧α2, “undetected call” may be made. The proper choice of significance levels and the thresholds can reduce false calls. In some preferred embodiments, 0<α1<α2<0.06. In some particularly preferred embodiments, α1 is around 0.04 and α2 is around 0.06.
The methods of the invention are particularly suitable for analyzing a large number of transcripts, preferably more than 50, 100, 500, 750, 1000, 2000, 3000, 5000, 10,000 or more.
In another aspect, computer software products are provided. The computer software products include computer program code for inputting a plurality of perfect match intensity values (PMi) and mismatch intensity values (MMi) for a transcript, wherein each of the PMi is paired with one of the MMi; computer program code for calculating a p-value using one-sided Wilcoxon's signed rank test, wherein the p-value is for a null hypothesis that θ=a threshold value and an alternative hypothesis that the θ>the threshold value, wherein the θ is a test statistic for intensity difference between the perfect match intensity values and mismatch intensity values; computer program code for indicating whether the transcript is present based upon the p-value; and a computer readable media for storing the computer program codes. In some preferred embodiments of the computer software products, the testing statistic is median(PMi−MMi). The threshold value may be zero in some embodiments. In preferred embodiments, however, the threshold value is calculated using: τ1=c1{square root}{square root over (median(PMi))} where the c1 is a constant or using: τ1=c1{square root}{square root over (mean(PMi))} where the c1 is a constant.
In some particularly preferred embodiments of the computer software products of the invention, the testing statistic is median((PMi−MMi)/(PMi−MMi)) and threshold value is a constant. The computer program product may contain code for accepting user's selection or input of the threshold value. A default value may be used as well. Typically, the threshold value is around 0.001 to 0.05. In a particularly preferred embodiment, the threshold value is around 0.015.
The presence, marginal present or absence (detected, marginally detected or undetected) of a transcript may be called based upon the p-value and significance levels. Significance levels, α1 and α2 may be set such that: 0<α1<α2<0.5. In preferred embodiments, if p<α1, a “detected” call can be made (i.e., the expression of the target gene is detected in the sample). If α1≦p<α2, a marginally detected call may be made. If p≧α2, “undetected call” may be made. The proper choice of significance levels and the thresholds can reduce false calls. In some preferred embodiments, 0<α1<α2<0.06. In some particularly preferred embodiments, α1 is around 0.04 and α2 is around 0.06.
The computer software product may include computer program code for indicating that the transcript is present, absent or marginally absent. The computer program code, when executed, may indicate the result by causing the display of the result on a display device such as a screen. Alternatively, the result may be outputted into a file. In addition, the result may be temporary stored in a computer memory device so that other computer program module may access this result. In some preferred embodiments, the computer software products may include code to accept user's selection of various significance levels.
In addition, computer software products for analyzing the presence of a transcript without using mismatch intensities. The computer software product includes computer program code for providing a plurality of perfect match intensity values (PMi) and background intensity values (Bi) for a transcript, wherein each of the PMi is paired with one of the Bi; computer program code for calculating a p value using one sided Wilcoxon's signed rank test, wherein said p value is for a null hypothesis that θ=a threshold value and an alternative hypothesis that the θ>the threshold value, where the θ is a test statistic for intensity difference between the perfect match intensity values and background intensity values; and computer program code for indicating whether the transcript is present based upon the p value; and a computer readable media for storing the codes. The testing statistic may be median(PMi−Bi). The threshold value can be zero.
In preferred embodiments, the threshold value is calculated using: τ3=c3{square root}{square root over (median(PMi))} where the c3 is a constant and alternatively, the threshold value is calculated using: τ3=c3{square root}{square root over (mean(PMi))} where the c3 is a constant.
The computer software product may include computer program code for indicating that the transcript is present, absent or marginally absent. The computer program code, when executed, may indicate the result by causing the display of the result on a display device such as a screen. Alternatively, the result may be outputted into a file. In addition, the result may be temporary stored in a computer memory device so that other computer program module may access this result. In some preferred embodiments, the computer software products may include code to accept user's selection of various significance levels.
Appropriate computer code, computer systems and products are adapted to carry out the present invention.
In addition, systems for determining whether a transcript is present in a biological sample are also provided. The systems include a processor; and a memory being coupled to the processor, the memory storing a plurality machine instructions that cause the processor to perform a plurality of logical steps when implemented by the processor; the logical steps include the method steps of the invention.
Table 1 and 2 list Ryder discrimination score in several sets of Latin squre experiments with over 100 genes in each experiment with concentrations 0, 0.25, 0.5, 1, 2, 4, 8, 16, 32, 64, 128, 256, 512, 1024 pM.
When Ryder's discrimination score median (Ri) is below 0.7, corresponding approximately to the concentration range below 16-64 pM or so, Ri increases when the concentration of the gene increases. Beyond this range, Ri may decrease as gene concentration increases, but remains higher than 0.7. Therefore, Ri is not always an increasing function of gene concentration, especially when median(Ri) is above 0.7, but for the purpose of absolute calls, i.e., to detect the existence of a gene above a small concentration, e.g., 1 or 2 pM, Ryder's discrimination score Ri is a very good statistic to use.
Saturation is the situation when the brightness of the pixels exceeds the brightness range of the scanner. When there is saturation PMi and MMi can be both large and close to each other, thus Ryder's discrimination score becomes small. To prevent this situation from interfering our analysis, a first check may be necessary to determine whether there are any saturated cells, and exclude them from further analysis. If all probe pairs are saturated, the gene may be indicated as detected, i.e., set the p-value to be 0.
In a semi-blind test, 11 yeast target genes were used in a hybridization solution and the yeast genome chip YG_S98 was used. The concentration of every yeast gene was 5 pM. This was a semi-blind because the algorithm developer only knew the number of target yeast genes, but neither their names nor the number and names of bacterial spiked genes. Table 3 lists the 25 sorted p-values of absolute calls for p<α1=0.05 with one-sided signed rank test (1). The parameter τ1 was obtained with Equation (3c) where c″1=1.2. The first 23 units gave the correct answer of 13 units of 11 yeast genes (YAL038W, YDL235C, YEL003W, YEL018W, YEL024W, YER161C, YFL018C, & KL193C, YLR083C, YNL259C, YPR129W) and 9 units of four bacterial spiked genes (BioB, BioC, BioDn and CreX) with a false positive. The p-value, 0.001602, of the unit YEL003W_at with target in hybridization the solution has a relatively large difference with the p-value, 0.003906, of the 24th unit NNL069W_i_at whose target is not in the hybridization solution. Therefore, if the significance level is chosen somewhere between these two numbers, a clear cutoff can be obtained.
In Table 3, the column labeled Probe Pairs lists the number of probe pairs in the unit. The column labeled P/A denotes whether the corresponding target is present (P) or absent (A) in the hybridization solution.
With Ryder's discrimination score and τ2=0.02, sorting the p-values in the ascending order, similar results were obtained and shown in Table 4 and p-values 0.009985 for YEL003W_at in the hybridization solution and 0.023438 of gMR07—3_at not in the hybridization solution have a big gap.
In a Latin square experiment design, 14 groups of yeast gene transcripts (8 genes per group) with different concentrations were used in 14 experiments (Table 5). In some of the data sets, human genome background was also added in the hybridization solution. These hybridization solutions were used on yeast genome chips yg_s95 and yeast test chips test_hyb.
Eight genes were excluded from the analysis because of poor quality. The remaining genes were used for analysis. Yeast genes not in the Latin square were considered as with concentration 0. Tables 6 and 7 give the error rates by concentrations of our rank-based algorithm using Ryder's discrimination score with τ2=0.012, α1=0.04, and α2=0.06 for two Latin square data sets, one without human genome background, and the other with human genome background. If lower false positive rate is wanted, one can lower τ2, or raise α1 and/or α2
The column labeled by “Marginal as undetected” shows the error rates when the marginal calls are counted as undetected calls, i.e., α1 is used as the cutoff. The column labeled by “Marginal as detected” shows the error rates when the marginal calls are counted as detected calls, i.e., α2 is used as the cutoff.
The present inventions provide methods and computer software products for analyzing gene expression profiles. It is to be understood that the above description is intended to be illustrative and not restrictive. Many variations of the invention will be apparent to those of skill in the art upon reviewing the above description. By way of example, the invention has been described primarily with reference to the use of a high density oligonucleotide array, but it will be readily recognized by those of skill in the art that other nucleic acid arrays, other methods of measuring transcript levels and gene expression monitoring at the protein level could be used. The scope of the invention should, therefore, be determined not with reference to the above description, but should instead be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.
All cited references, including patent and non-patent literature, are incorporated herein by reference in their entireties for all purposes.
This application claims the priority of U.S. Provisional Application No. 60/189,558, filed on Mar. 15, 2000. The '558 application is incorporated herein by reference in its entirety for all purposes.
Number | Date | Country | |
---|---|---|---|
60189558 | Mar 2000 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 09735743 | Dec 2000 | US |
Child | 11166497 | Jun 2005 | US |