This application claims priority from Korean Patent Application Nos. 10-2012-0000729, 10-2012-0000730, 10-2012-0000745 and 10-2012-0129390, respectively filed on Jan. 3, 2012, Jan. 3, 2012, Jan. 3, 2012 and Nov. 15, 2012, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference in its entirety.
1. Field of the Invention
The present invention relates to an apparatus for screening cancer, and more particularly, to an apparatus for screening cancer which is capable of diagnosing cancer by confirming mass spectra of low-mass ions for cancer diagnosis based on biostatistical analysis on low-mass ions extracted from biological materials and utilizing the low-mass ion mass spectra.
2. Description of the Related Art
Cancer is a disease that involves indefinite proliferation of cells, and examples thereof notably include lung cancer, gastric cancer (GC), breast cancer (BRC) or colorectal cancer (CRC). However, cancer can practically develop into any place of the body. In the early stage of cancer diagnosis, focus was on the external change of biological tissue that occurred in accordance with the growth of cancer cells. Recently, attempts are made to develop a diagnosis and detection of cancer by utilizing trace amounts of biological molecules present in the biological tissue or cells, blood, glycol chain, DNA, etc. However, the most widely used way of diagnosing cancer is based on tissue sample taken by biopsy and imaging.
The biopsy has shortcomings including tremendous pain, expensive cost and lengthy time until the diagnosis. If a patient suspected of cancer indeed has cancer, there is a possibility that the cancer spreads during biopsy. Further, for specific sites of a body where biopsy is limited, diagnosing is often not available until suspicious tissues are extracted by surgical operation.
The imaging-based diagnosis basically determines the cancer based on the X-ray image, the nuclear magnetic resonance (NMR) images, or the like, using contrast agent to which disease-targeting substance is attached. The shortcomings of the imaging-based diagnosis include possibility of misdiagnosis depending on expertise of clinician or personnel who reads the data, and high dependency on the precision of the image-acquisition devices. Furthermore, even the device with the upmost precision is not able to detect a tumor under several mm in size, which means that early detection is unlikely. Further, in the process of image acquisition, as a patient is exposed to high energy electromagnetic wave which itself can induce mutation of genes, there is possibility that another disease may be induced and the number of diagnosis by imaging is limited.
Presence and absence of disease in gastric system is generally determined by observation by naked eyes with the use of endoscope. The process is painful and even when abnormality is observed during this examination, biopsy is still required to accurately determine whether the cancer is malignant/benign tumor, polypus, etc.
Colorectal cancer (CRC) is the third most commonly diagnosed cancer in the world and the cure thereof hugely depends on the stages of cancer development. That is, CRC is highly curable when detected at an early stage by screening. While early detection is very important, symptoms of this cancer are not palpable until the patient perceives the possibility from changed color of excretion due to presence of blood therein. Generally, a patient or a person suspected of CRC first goes thorough endoscopic examination of large intestines and then necessarily takes biopsy to accurately determine specific disease. That is, for CRC, early detection is critical, but since endoscopic examination of large intestines and biopsy take tremendous time and cost and also are inconvenient and painful, a diagnosis method is necessary, which can considerably reduce the number of subjects of the endoscopic examination and biopsy which can be unnecessary.
Accordingly, by providing CRC screening at an early stage based on new molecular approach, patients will be benefited. The genomics, proteomics and molecular pathology have provided various biomarker candidates with clinical potentials. It will be possible to improve treatment effect by actively utilizing the biomarker candidates in the customized treatment of cancers according to stages and patients, and therefore, many researches are necessary to apply the above in the actual clinical treatment.
The recent CRC screening test includes determination of gross abnormality by endoscopic examination of large intestines, or fecal occult blood test (FOBT) which detects blood in feces. The endoscopic examination of large intestines has been utilized as a standard way of examination in the CRC screening, but due to invasiveness thereof, patients who can receive the examination are limited. Accordingly, many attempts have been focused on the examination of feces, for advantages such as noninvasiveness, no need for colonic irrigation, and transferability of the sample. The fecal marker may include feces oozing, excreted or exfoliated from the tumor. For example, hemoglobin in traditional FOBT was perceived as the oozing type of the marker in the large scale screening program. However, the markers known so far, including the above, have not met the satisfaction.
Meanwhile, it is possible to extract spectra of mass ions within blood using the matrix-assisted laser desorption/ionization-time of flight (MALDI-TOF) mass spectrometer. The mass spectrometry, generally used in the researches on proteins, mainly categorizes 800 to 2500 m/s mass range as the target of analysis, because the specific range corresponds to the mass value region of peptide when the protein is dissociated by trypsin. It is also possible to extract the mass spectra of los-mass ions by using MALDI-TOF mass spectrometer. However, for the low-mass region below approximately 800 m/z where the matrix mass ions coexist, research has not been active on this particular region.
The extracted low-mass ion mass spectra can be analyzed by the conventional software, MarkerView™ (version 1.2). The inventors of the present invention analyzed mass spectra of the low-mass ions extracted from the serums of CRC patient group and normal group (control, CONT) using MarkerView™ in a manner that will be explained in detail below with reference to
The low-mass ion mass spectra in T2D file format was imported with MarkerView™ from the set (A1) of samples of serums collected from 133 CRC patients of Table 101 and 153 normal controls of Table 102 (A11).
The conditions of Table 103 were used for import.
The imported peak intensities were then normalized (A12). MarkerView™ has a plurality of normalization methods, and among these, “Normalization Using Total Area Sums” was employed for the normalization. According to the method, partial sums of the intensities of the respective samples were obtained and averaged, and then each peak intensity was multiplied by a scaling factor so that the sums of the respective samples were in agreement with the averages. As a result, the partial sums of the intensities of the respective samples became identical after the normalization.
Next, the normalized peak intensities were Pareto-scaled (A13). That is, the peak intensities were Pareto-scaled by subtracting the averages of the respective mass ions from the respective normalized peak intensities, and dividing the same by the square root of the standard deviation.
Next, with respect to the Pareto-scaled peak intensities, discriminant scores (DS) were computed by performing the principal component analysis-based linear discriminant analysis (PCA-DA) (A14). The PCA-DA was performed by two stages, to obtain factor loading, which are the weighting factors of the respective mass ions, and the Pareto-scaled intensities were multiplied by the factor loading. The resultant values were summed, to compute the discriminant scores of the respective samples. The import condition of Table 103 includes maximum 10,000 peaks with sufficient samples imported, so that there were 10,000 factor loading computed, and one DS was computed by summing 10,000 terms.
Next, it was determined whether the computed DS was positive number or not (A15), and if so, determined positive (A16), and if not, determined negative (A17). In other words, when implemented on CRC, the positive number was interpreted as CRC patient group, while negative number was interpreted as normal control group.
Referring to
However, the robustness of the formula must be verified for clinical use. That is, even the mass spectra that were additionally measured by a number of times with respect to the dataset that was measured once and constituted discriminant formula, are required to maintain good discrimination results, and the discrimination result based on the same discriminant also has to be sound with respect to new CRC patient groups and non-cancer subjects that were not taken into consideration in the designing of the discriminant. The process of repeatedly measuring mass spectra may include the process of freezing and thawing serums and mixing the serum newly with methanol/chloroform to obtain extract. These processes are considered the disturbances in the statistic analysis with respect to the mass spectra, and clinical implementation is only possible when the discriminant is least influenced by the disturbances.
The conventional PCA-DA explained above with reference to
The incidence rate and prevalence rate of breast cancer (BRC) rapidly grew, following the thyroid cancer. Compared to the high incidence rate, BRC also has high cure rate following the thyroid cancer, for reasons mainly include development of effective drugs and change in public's awareness and also advancement of mammograpy which enables early detection of BRC. Like other carcinomas, BRC survival rate can be increased if detected and treated at an early stage. The survival rate is reported as high as 90% in the case of small-size BRC with no lymph node metastasis. However, the survival rate drops to 10% when BRC is detected after metastasis into another area. In order to discover BRC as early as possible, doctor's diagnosis and radiologic breast checkup as well as self test are prerequisite. However, sensitivity of mammography stays at a low level of 60-70%, and the diagnosis rate considerably decreases in the case of dense breasts which are more commonly found in young women. These women are generally advised to take breast ultrasonic test, but this test has a shortcoming of high dependency on the skill of the sonographer. Additionally, breast magnetic resonance imaging (MRI) is used in the diagnosis of BRC, but high cost thereof makes MRI unsuitable option for the BRC diagnosis and further, the false positive rate is high.
Accordingly, the patients will be benefited if it is possible to apply new molecular approach to screen BRC at an early stage. The genomics, proteomics and molecular pathology have provided many biomarkers with potential clinical value. The treatment effect would be improved by actively utilize these markers via customization with stages of the cancer and the patients. However, researchers have a long way to go until they would finally be able to implement these for clinical treatment.
Meanwhile, it is possible to extract spectra of mass ions within blood using the matrix-assisted laser desorption/ionization-time of flight (MALDI-TOF) mass spectrometer. The mass spectrometry, generally used in the researches on proteins, mainly categorizes 800 to 2500 m/s mass range as the target of analysis, because the specific range corresponds to the mass value region of peptide when the protein is dissociated by trypsin. It is also possible to extract the mass spectra of los-mass ions by using MALDI-TOF mass spectrometer. However, for the low-mass region below approximately 800 m/z where the matrix mass ions coexist, research has not been active on this particular region.
The extracted low-mass ion mass spectra can be analyzed by the conventional software, MarkerView™ (version 1.2). The inventors of the present invention analyzed mass spectra of the low-mass ions extracted from the serums of BRC patient group and normal group (control, CONT) using MarkerView™ in a manner that will be explained in detail below with reference to
The low-mass ion mass spectrum in T2D file format was imported with MarkerView™ from the set (C1) of samples of serums collected from 54 BRC patients of Table 201 and 202 normal controls of Table 202 (B11).
<10%
>66%
>66%
100%
The conditions of Table 203 were used for import.
The imported peak intensities were then normalized (A12). MarkerView™ has a plurality of normalization methods, and among these, “Normalization Using Total Area Sums” was employed for the normalization. According to the method, partial sums of the intensities of the respective samples were obtained and averaged, and then each peak intensity was multiplied by a scaling factor so that the partial sums of the respective samples were in agreement with the averages. As a result, the partial sums of the intensities of the respective samples became identical after the normalization.
Next, the normalized peak intensities were Pareto-scaled (B13). That is, the peak intensities were Pareto-scaled by subtracting the averages of the respective mass ions from the respective normalized peak intensities, and dividing the same by the square root of the standard deviation.
Next, with respect to the Pareto-scaled peak intensities, discriminant scores (DS) were computed by performing the principal component analysis-based linear discriminant analysis (PCA-DA) (B14). The PCA-DA was performed by two stages, to obtain factor loading, which are the weighting factors of the respective mass ions, and the Pareto-scaled intensities were multiplied by the factor loading. The resultant values were summed, to compute the discriminant scores of the respective samples. The import condition of Table 103 includes maximum 10,000 peaks with sufficient samples imported, so that there were 10,000 factor loading computed, and one DS was computed by summing 10,000 terms.
Next, it was determined whether the computed DS was positive number or not (B15), and if so, determined positive (B16), and if not, determined negative (B17). In other words, when implemented on BRC, the positive number was interpreted as BRC patient group, while negative number was interpreted as normal control group.
Referring to
However, the robustness of the formula must be verified for clinical use. That is, even the mass spectra that were additionally measured by a number of times with respect to the dataset that was measured once and constituted discriminant formula, are required to maintain good discrimination results, and the discrimination result based on the same discriminant also has to be sound with respect to new BRC patient groups and non-cancer subjects that were not taken into consideration in the designing of the discriminant. The process of repeatedly measuring mass spectra may include the process of freezing and thawing serums and mixing the serum newly with methanol/chloroform to obtain extract. These processes are considered the disturbances in the statistic analysis with respect to the mass spectra, and clinical implementation is only possible when the discriminant is least influenced by the disturbances.
The conventional PCA-DA explained above with reference to
Meanwhile, gastric cancer (GC) is the most-commonly diagnosed cancer in South Korea (18.3%), with the incidence frequency recording highest among men, and third-highest among women following BRC and thyroid cancer (Major carcinoma incidence rates, 2003-2005, National Statistical Office). Although the rate of early detection is increasing thanks to endoscopic examination on general public and change in the public awareness, the death rate of this particular cancer still records highest frequency (22%) following lung cancer and liver cancer (2006. Statistical Year Book of Cause of Death. National Statistical Office).
Surgical treatment is the basic measure for complete recovery and the frequency of early GC is approximately 50% recently with the complete recovery rate exceeding 90%. However, unlike the early GC, metastatic or recurrent GC shows quite undesirable prognosis, in which the median survival time is as short as 1 year or shorter. The five year survival rate is also very low around 5% or below.
The palliative chemotherapy is accepted as a standard treatment of metastatic or recurrent GC, based on the researches that confirmed effect of prolonged survival period in 3 phrase study compared with the best supportive care and also the effect of improved life quality.
Since 1990, treatment with 5-fluorouracil (5-FU) and platinum have been most widely used as the treatment for metastatic GC, and irinotecan, oxaliplatin, paclitaxel, docetaxel, capecitabine have been used in various combinations for clinical study to develop new drugs with improved efficacy and minimized side effects. No particular research has been reported so far, which confirmed markedly increased performance than 5-FU based chemotherapy. While ECF (epirubicin, cisplatin and 5-fluorouracil) provides good effect, this is accompanied with side effect of high toxicity.
Various studies are conducted to overcome the limitations mentioned above, and among these, efforts to discover biomarker are at the center. The biomarkers can be used in the early diagnosis of cancer, and also used as a target for the treatment of metastatic carcinoma. Combined use of marker with the existent anticancer agents exhibit efficacy in the CRC, lung cancer, BRC and pancreatic cancer, and many efforts are necessary to develop and research use in GC.
Accordingly, by providing GC screening at an early stage based on new molecular approach, patients will be benefited. The genomics, proteomics and molecular pathology have provided various biomarker candidates with clinical potentials. It will be possible to improve treatment effect by actively utilizing the biomarker candidates in the customized treatment of cancers according to stages and patients, and therefore, many researches are necessary to apply the above in the actual clinical treatment.
The recent GC screening test includes determination of gross abnormality by endoscopic examination of large intestines, or fecal occult blood test (FOBT) which detects blood in feces. The endoscopic examination of large intestines has been utilized as a standard way of examination in the GC screening, but due to invasiveness thereof, patients who can receive the examination are limited. Accordingly, many attempts have been focused on the examination of feces, for advantages such as noninvasiveness, no need for colonic irrigation, and transferability of the sample. The fecal marker may include feces oozing, excreted or exfoliated from the tumor. For example, hemoglobin in traditional FOBT was perceived as the oozing type of the marker in the large scale screening program. However, the markers known so far, including the above, have not met the satisfaction.
Meanwhile, it is possible to extract spectra of mass ions within blood using the matrix-assisted laser desorption/ionization-time of flight (MALDI-TOF) mass spectrometer. The mass spectrometry, generally used in the researches on proteins, mainly categorizes 800 to 2500 m/s mass range as the target of analysis, because the specific range corresponds to the mass value region of peptide when the protein is dissociated by trypsin. It is also possible to extract the mass spectra of los-mass ions by using MALDI-TOF mass spectrometer. However, for the low-mass region below approximately 800 m/z where the matrix mass ions coexist, research has not been active on this particular region.
The extracted low-mass ion mass spectra can be analyzed by the conventional software, MarkerView™ (version 1.2). The inventors of the present invention analyzed mass spectra of the low-mass ions extracted from the serums of GC patient group and normal group (control, CONT) using MarkerView™ in a manner that will be explained in detail below with reference to
The low-mass ion mass spectra in T2D file format was imported with MarkerView™ from the set (A1) of samples of serums collected from 49 GC patients of Table 301 and 84 normal controls of Table 302 (C11).
—a
—a
The conditions of Table 203 were used for import.
The imported peak intensities were then normalized (C12). MarkerView™ has a plurality of normalization methods, and among these, “Normalization Using Total Area Sums” was employed for the normalization. According to the method, partial sums of the intensities of the respective samples were obtained and averaged, and then each peak intensity was multiplied by a scaling factor so that the partial sums of the respective samples were in agreement with the averages. As a result, the partial sums of the intensities of the respective samples became identical after the normalization.
Next, the normalized peak intensities were Pareto-scaled (C13). That is, the peak intensities were Pareto-scaled by subtracting the averages of the respective mass ions from the respective normalized peak intensities, and dividing the same by the square root of the standard deviation.
Next, with respect to the Pareto-scaled peak intensities, discriminant scores (DS) were computed by performing the principal component analysis-based linear discriminant analysis (PCA-DA) (C14). The PCA-DA was performed by two stages, to obtain factor loading, which are the weighting factors of the respective mass ions, and the Pareto-scaled intensities were multiplied by the factor loading. The resultant values were summed, to compute the discriminant scores of the respective samples. The import condition of Table 103 includes maximum 10,000 peaks with sufficient samples imported, so that there were 10,000 factor loading computed, and one DS was computed by summing 10,000 terms.
Next, it was determined whether the computed DS was positive number or not (C15), and if so, determined positive (C16), and if not, determined negative (C17). In other words, when implemented on GC, the positive number was interpreted as GC patient group, while negative number was interpreted as normal control group.
Referring to
However, the robustness of the formula must be verified for clinical use. That is, even the mass spectra that were additionally measured by a number of times with respect to the dataset that was measured once and constituted discriminant formula, are required to maintain good discrimination results, and the discrimination result based on the same discriminant also has to be sound with respect to new GC patient groups and non-cancer subjects that were not taken into consideration in the designing of the discriminant. The process of repeatedly measuring mass spectra may include the process of freezing and thawing serums and mixing the serum newly with methanol/chloroform to obtain extract. These processes are considered the disturbances in the statistic analysis with respect to the mass spectra, and clinical implementation is only possible when the discriminant is least influenced by the disturbances.
The conventional PCA-DA explained above with reference to
The present invention provides an apparatus for screening cancer, which reads low-mass ion mass spectrum for diagnosing cancer based on biostatistical analysis with respect to low-mass ions extracted from biological materials, and diagnoses cancer using the low-mass ion spectrum.
The present invention provides a discriminant which provides robust discrimination result with respect to CRC patent samples and non-cancer subject samples, by providing a discriminant that results in all the sensitivity, specificity, positive predictability and negative predictability exceeding 85% with respect to the mass spectrum additionally and repeatedly measured on new CRC patient samples and normal patent samples as well as the mass spectrum additionally and repeatedly measured on the CRC patient samples and normal patent samples from which the discriminant is obtained, and an apparatus for screening cancer which diagnoses CRC by analyzing the constituent low-mass ions.
The present invention provides a discriminant which provides robust discrimination result with respect to BRC patent samples and non-cancer subject samples, by providing a discriminant that results in all the sensitivity, specificity, positive predictability and negative predictability exceeding 85% with respect to the mass spectrum additionally and repeatedly measured on new BRC patient samples and normal patent samples as well as the mass spectrum additionally and repeatedly measured on the BRC patient samples and normal patent samples from which the discriminant is obtained, and an apparatus for screening cancer which diagnoses BRC by analyzing the constituent low-mass ions.
The present invention provides a discriminant which provides robust discrimination result with respect to GC patent samples and non-cancer subject samples, by providing a discriminant that results in all the sensitivity, specificity, positive predictability and negative predictability exceeding approximately 80-90% with respect to the mass spectrum additionally and repeatedly measured on new GC patient samples and normal patent samples as well as the mass spectrum additionally and repeatedly measured on the GC patient samples and normal patent samples from which the discriminant is obtained, and an apparatus for screening cancer which diagnoses GC by analyzing the constituent low-mass ions.
The apparatus for screening cancer according to the present invention provides advantages including economic analysis cost in the case of CRC diagnosis, short analysis time and large-scale analysis. To describe the procedure briefly, mass spectrum of the low-mass ion in blood is measured, peak intensities corresponding to the masses of the low-mass ions for CRC diagnosis are extracted, and through simple calculation, CRC positive/negative information can be provided.
Further, sound and robust discrimination performance is provided, so that with CRC as a target, it is confirmed that all the sensitivity, specificity, positive predictability and negative predictability exceed 85% with respect to not only training set, but also validation set. Further, by changing the CRC patient and non-cancer subject sets to patients with other diseases and non-cancer subjects, it is possible to advantageously implement the present invention for other various diseases.
Further, in terms of CRC target, compared to the comparison of FOBT with the feces as the analyte, the present invention can use blood as analyte, and thus can be co-conducted with the other analysis. Accordingly, the present invention provides more convenient and efficient CRC information. Compared to the conventional FOBT discrimination performance, the present invention using low-mass ions for the diagnosis of CRC exhibits comparable specificity and markedly increased sensitivity.
The apparatus for screening cancer according to the present invention provides advantages including economic analysis cost in the case of BRC diagnosis, short analysis time and large-scale analysis. To describe the procedure briefly, mass spectrum of the low-mass ion in blood is measured, peak intensities corresponding to the masses of the low-mass ions for BRC diagnosis are extracted, and through simple calculation, BRC positive/negative information can be provided.
Further, sound and robust discrimination performance is provided, so that with BRC as a target, it is confirmed that all the sensitivity, specificity, positive predictability and negative predictability exceed 85% with respect to not only training set, but also validation set. Further, by changing the BRC patient and non-cancer subject sets to patients with other diseases and non-cancer subjects, it is possible to advantageously implement the present invention for other various diseases.
The apparatus for screening cancer according to the present invention provides advantages including economic analysis cost in the case of GC diagnosis, short analysis time and large-scale analysis. To describe the procedure briefly, mass spectrum of the low-mass ion in blood is measured, peak intensities corresponding to the masses of the low-mass ions for GC diagnosis are extracted, and through simple calculation, BRC positive/negative information can be provided.
Further, sound and robust discrimination performance is provided, so that with GC as a target, it is confirmed that all the sensitivity, specificity, positive predictability and negative predictability exceed approximately 80-90% with respect to not only training set, but also validation set. Further, by changing the GC patient and non-cancer subject sets to patients with other diseases and non-cancer subjects, it is possible to advantageously implement the present invention for other various diseases.
a is a graph presenting a characterization result of 1465.6184 m/z from among the first type CRC-diagnosing low-mass ion masses as confirmed, according to an embodiment;
b is a graph presenting a characterization result of 2450.9701 m/z from among the first type CRC-diagnosing low-mass ion masses as confirmed, according to an embodiment;
As used herein, the expression “biological material” encompasses whole blood, serum, plasma, urine, feces, sputum, saliva, tissue, cells, cell extract, or in vitro cell culture, but not limited thereto. In the Examples provided below, the biological materials of serums from patients or non-cancer subjects are used.
As used herein, the expression “peak intensity” refers to values obtained by the MALDI-TOF mass spectrometer, and have correlativity with the amount of mass ions corresponding to the peaks.
As used herein, the expression “normalization” refers to the process of brining data range to agreement with each other or brining data distribution to similar state, in which the normalization may be performed using mean or median, but not limited thereto. That is, various known methods may be adequately implemented. In one embodiment, the normalization involves obtaining partial sums of the peak intensities of the respective samples and averaging the partial sums of the samples, and multiplying the respective peak intensities by the scaling factors of the respective samples so that the partial sums of the peak intensities of the respective samples are brought into agreement with the average. As a result, the partial sums of the peak intensities of the respective samples are identical after the normalization.
As used herein, the “Pareto scaling” refers to the process of subtracting averages of the respective mass ions from the normalized peak intensities and dividing by the square root of the standard deviation. The Pareto-scaling has the advantage because it is possible to avoid amplification of noise by partially maintaining the data size information instead of applying more general method such as autoscaling which completely offsets the data size information by standard deviation.
As used herein, the “weighting factor” refers to a factor which adjusts the numeric data size after multiplication by weighting factor to a proportional relationship with the importance from the statistical viewpoint. One example of the weighting factor includes a factor loading which is obtained as a result of PCA-DA in the Examples provided below.
As used herein, the term “low-mass ion” refers to ions having mass within 1500 m//z as obtained using MALDI-TOF mass spectrometer, or the like. Although some of the low-mass ions for CRC diagnosis may have mass exceeding the above limit, considering the most low-mass ions are within this limit, all the ions will be collectively called “low-mass ions”. Accordingly, the limit as 1500 m/z will be understood as approximate value rather than definite one.
The mass measured by the MALDI-TOF mass spectrometer includes an error range of “±0.05 m/z”, considering a slight error that may be generated in the mass measure depending on the environment of experiment. Y way of example, the mass of 1467.5969 m/z as indicated in the appended claims is indeed understood to be within a range between 1467.5469 m/z and 1467.6469 m/z. The error range may be “±0.1 m/z” depending on the environment of experiment.
In one embodiment, the mass measured by the MALDI-TOF mass spectrometry may be acquired in positive mode of the MALDI-TOF mass spectrometry.
In one embodiment, the code of the weighting vector is determined to be positive if the discriminant score is positive number, while it is determined to be negative if the discriminant score is negative number. The factor loading vector in the PCA-DA mathematically corresponds to eigenvector, of which code may be determined arbitrarily. That is, mathematically, the values are considered equal according to the eigenvalue problem, even when the computed factor loading per mass ions are multiplied by −1 and thus change code. However, the negative value of discriminant score is considered to indicate positivity, while the positive value of the discriminant score is considered to indicate negativity. Although the positive discriminant score indicates negativity and the negative discriminant score indicates positivity, the scope of the invention is not limited to the specific example.
Further, as used herein, the term “discriminant score” refers to a value computed by a biostatistical analysis with respect to mass spectrum extracted from a biological material, based on which cancer positivity or negativity may be determined. Simple method of determining whether the computed discriminant score exceeds a specific reference value or not may be implemented, and a function may be used, according to which the computed discriminant score is input and a result of interpretation is output.
Although the specific term “discriminant score” is used in the embodiments of the present invention, the term is not limiting. Accordingly, various other forms of terms such as discriminant level, discriminant value or the like may be adequately used. Accordingly, the term “discriminant score” is not limited to the definition in the dictionary, but rather understood as a term that encompasses various terms such as discriminant level, value or any other similar terms that can indicate the discriminant score as defined by the invention.
Further, as used herein, the term “discrimination performance” refers to numeric representation of the index including, for example, sensitivity, specificity, positive predictability, negative predictability or accuracy. The term “discrimination performance” may also refer to a value computed by the functions of the indexes. For example, sensitivity, specificity, positive predictability, negative predictability and accuracy may each be used as the discrimination performance, or alternatively, the sum of two or more indexes, e.g., the sum of sensitivity and specificity, the sum of sensitivity and positive predictability, or the sum of negative predictability and accuracy, may be used as the discrimination performance.
The invention will be explained in greater detail below with reference to Examples. However, the Examples are given only for illustrative purpose, and accordingly, the scope of the present invention should not be construed as limited by any of specific Examples.
First,
The low-mass ion detecting unit 1000 may extract the mass spectrum of the low-mass ions by detecting peak intensity of the low-mass ions from the biological material. Further, the low-mass ion detecting unit 1000 may include a mass spectrometer.
The display 3000 may convert the cancer diagnosis information as determined into various forms including text, numbers, or figures and displays the resultant converted information on a device such as monitor screen, or LCD of mobile terminal, or the like.
The factor loading computnig means 2300 may perform biostatistical analysis with respect to the aligned mass spectra and may include a first training set selecting means 2310 which selects a first raining set based on the training cases that meet condition of training based on the biostatistical analysis among the cancer and non-cancer cases. The factor loading computnig means 2300 may compute a factor loading based on the first training set.
The first training set selecting means 2310 may set the cancer and non-cancer cases to be the first training set, if the sensitivity according to the result of biostatistical analysis exceeds a threshold N1, and the specificity exceeds a threshold N2. The thresholds N1 and N2 may preferably be 1.
The cancer determining means 2700 may determine the subject of interest to be cancer positive or negative depending on the discriminant score, and may determine the subject of interest to be positive if the DS exceeds a reference value S, or negative if the DSC does not exceed the reference value S. The reference value S may preferably be 0.
The cancer determining means 2700 may determine the cancer information of the subjects of interest based on the ge of a plurality of DS which are computed with respect to a plurality of low-mass ion mass spectra detected by repetitive measure of a biological materials for cancer screening.
The scaling module 2200 may perform Pareto-scaling. The DS calculating module 2230 may perform the biostatistical analysis using PCA-DA. The DS calculating module 2230 may compute the DS using the factor loading acquired as a result of PCA-DA and the scaled peak intensities.
The scaling module 2620 may perform Pareto-scaling. The DS calculating module 2630 may compute the DS based on the scaled peak intensities of the low-mass ions for cancer diagnosis and the factor loading.
The criterion for evaluating the discrimination performance implementable at the final ion set selecting means 2420 may include a first criterion according to which ions, from among the candidate low-mass ions, that have sums of sensitivity and specificity greater than a reference are selected, or a combination of ions, from among the combinations of the candidate low-mass ions, that has a sum of sensitivity and specificity greater than the counterpart combinations is selected.
The criterion for evaluating the discrimination performance at the final ion set selecting means 2420 may additionally include a second criterion according to which a combination of the ions, from among the combinations of the candidate low-mass ions, that has the least number of the candidate low-mass ions among the counterpart combinations.
The criterion for evaluating the discrimination performance implementable at the final ion set selecting means 2420 may additionally include a third criterion according to which a combination of the candidate low-mass ions, from among the combinations of the candidate low-mass ions, that has the greatest difference between the maximum DS of the true positive case and the maximum DS of the true negative case, in which the DS may be computed based on the scaled peak intensities and the factor loading of the candidate low-mass ions, and indicate cancer positive or negative.
The final ion set selecting means 2420 may perform the operation of selecting low-mass ions with respect to a training set consisting of the first training set added with a second training set, independent from the first training set.
The candidate ion set selecting means 2410 may include a candidate ion set preselecting module 2412 which selects the candidate ion set with the second low-mass ions which are present commonly in the training cases of the first low-mass ions that exceed the threshold percentage T2. The threshold percentage T2 may preferably be 50%.
The candidate ion set selecting means 2410 may include a sensitivity/specificity calculating module 2413 which computes DS representing cancer positive or negative with respect to each training case using the second low-mass ions, and computes sensitivity and specificity based on the DS, and a candidate ion set final selecting module 2414 which changes at least one of T1 and T2 and selects the candidate ion set by repeating the above operations, if the sensitivity is less than the threshold N3 or if the specificity is less than threshold N4. The thresholds N3 and N4 may preferably be 0.9.
The final ion set selecting means 2420 may include a biomarker group additional selecting module 2425 which repeats the selecting operation of the three biomarker groups with respect to remaining candidate ion set of the candidate ion set except for the low-mass ions in the combinations selected as the biomarker group at the biomarker group final selecting module 2424 to thereby additionally select a biomarker group, and continues additionally selecting the biomarker group as far as there are more than L mass ions left in the high sensitivity set or the high specificity set; and a cancer-diagnosing low-mass ion final selecting module 2426 which selects the low-mass ions in the combination of top K biomarker groups as the low-mass ions for cancer diagnosis in terms of accuracy in determining true positivity or true negativity. The value L may be 2, and M may be 1, and K may be 1, 2 or 3.
The plurality of cancer patent cases may include any of CRC, BRC or GC patient cases.
Referring to
To the above-mentioned purpose, the low-mass ion detecting unit 1000 extracts mass spectrum of the low-mass ion by detecting peak intensity of the low-mass ions using mass spectrometer with respect to biological materials of a plurality of CRC patient and non-CRC cases.
The detailed components of the cancer diagnosing unit to diagnose the CRC are identical to those of the apparatus for screening cancer explained above with reference to
Referring to
(2-1) Sample Preparation—Collecting Serums
Serums were collected from 133 CRC patients (Table 101), 153 normal controls (Table 102), 111 BRC patients (Table 105), 36 non-Hodgkin lymphoma (NHL) patients (Table 106) and 29 GC patients (Table 107), respectively.
<10%
>66%
<10%
<10%
>66%
<10%
>66%
>66%
<10%
>66%
>66%
<10%
>66%
<10%
<10%
>66%
>66%
<10%
<10%
<10%
<10%
<10%
<10%
>66%
>66%
>66%
>66%
<10%
<10%
<10%
With respect to set A1 consisting of 462 cases, subset A0 was constructed into the first training set. The weightings (factor loadings) per mass ions were computed by the biostatistical analysis, and the preliminary discriminant was acquired. Further, the training set was enlarged to include the second training set A2 consisting of the 144 CRC patients of Table 108, 50 normal controls of Table 109, 25 BRC patients of Table 110, 15 NHL patients of Table 111 and 57 GC patients of Table 112. That is, to analyze CRC-diagnosing low-mass ions according to the method explained below with respect to the preliminary candidate groups of the low-mass ions constructing the preliminary discriminant, the set A, i.e., union of set A1 and set A2, which are independent from each other, was used as the training set.
Further, validation set was constructed with set A and set B consisting of 143 CRC patients of Table 113, 50 normal controls of Table 114, 25 BRC patients of Table 115, 15 NHL patients of Table 116, 55 GC patents of Table 117, 25 ovarian cancer (OVC) patients of Table 118, 19 Tis or Advanced Adenoma (TA) patients of Table 119. The OVC patients and TA patients were not reflected at all when obtaining weighting per mass ions or investigating CRC-diagnosing low-mass ions, and included to see how these particular patient groups are discriminated with the discriminant constructed according to the present invention.
(2-2) Sample Preparation—Preparing Serum and Measuring Mass Spectrum
4× volume of methanol/chloroform (2:1, v/v) was mixed with 25 μl serum violently and incubated at room temperature for 10 min. The mixture was centrifuged at 4° C., 10 min, 6000×g. The supernatant was completely dried for 1 h in the concentrator, and dissolved in the vortexer in 30 μl of 50% acetonitrile/0.1% trifluoroacetic acid (TFA).
Methanol/chloroform extract was mixed with a-cyano-4-hydroxycinnamic acid solution in 50% acetonitrile/0.1% TFA (1:12, v/v), and 1 μl mixture was placed on MALDI-target plate. The mass spectra of the serum extracts from the CRC patients and normal subjects were measured using the Proteomics Analyzer (Applied Biosystems, Foster City, Calif., USA).
The mass spectrum data for one sample is extracted based on the average of spectrum which was repeatedly measured 20 times. The mass region of the entire individual samples was adjusted so that the maximum mass was set at approximately 2500 m/z. To minimize experimental error, various factors including focus mass, laser intensity, target plate, data acquisition time were taken into consideration.
The focus mass and the laser intensity were fixed at preferable levels, i.e., 500 m/z and 5000, respectively. In addition to the fixed focus mass and the laser intensity, the entire samples were repeatedly measured at least five times under viewpoint of other extraction and other data collection. The set A1, from which weightings per mass ions were computed, was measured one more time.
Accordingly, the low-mass ion detecting means 4000 extracted the low-mass ion mass spectrum from the serum sample via the processes explained above, using the MALDI-TOF.
(2-3) Discrimination Strategy
In order for the constructed discriminant to be CRC specific, the discriminant is required to discriminate the CRC patient group from not only the normal control, but also the patient groups with other cancer types. In one embodiment, the patient groups with other cancer types include BRC patients, NHL patients and GC patients. Table 120 provides the result of implementing the conventional PCA-DA to investigate whether one discriminant can discriminate the CRC patient group from the non-CRC group (normal controls, BRC patient group, NHL patient group and GC patient group). To be specific, the specificity of the normal controls is as low as 69.28%. This reveals the fact that one discriminant cannot discriminate the CRC patient group from all the non-CRC groups.
Referring to
Accordingly, discriminating the CRC patient group from the non-CRC patient groups may include implementing a first type discriminant to discriminate CRC patient group from normal controls and a second discriminant to discriminate CRC patient group from the patient groups with other cancer types, in which the CRC patient is determined if both the discriminants indicate CRC, while the non-CRC patient is determined if any of the two discriminants indicates non-CRC patient.
(2-4) Selecting First Training Set A0 and Computing Weightings Per Mass Ions
Although the result of discrimination of Tables 104 and 121 are good, the sensitivity and the specificity are not always 100%. In one embodiment of the present invention, the first training set A0 with predetermined sensitivity and specificity is selected, and weightings per mass ions of the first training set A0 were computed, in which the predetermined sensitivity and specificity were both 100%.
A method for selecting the first training set A0 with the predetermined sensitivity and specificity will be explained below with reference to
The first DS computing means 4200 aligned and imported the low-mass ion mass spectra of the CRC patient group and the normal control group of set A1 (D111), normalized the imported peak intensities (D112), Pareto-scaled the normalized peak intensities (D113), and computed DS by performing biostatistical analysis with respect to the Pareto-scaled peak intensities (D114).
Among a variety of biostatistical analyzing methods that can be implemented to compute DS, in one embodiment, the PCA-DA was performed. Sensitivity and specificity were computed based on the DS (D115) and the result is shown in
Next, sensitivity threshold CN1 and specificity threshold CN2 were set (D116), and false positive or false negative cases were excluded when the sensitivity or the specificity was less than the corresponding threshold (D117).
In one embodiment, both the sensitivity threshold CN1 and the specificity threshold CN2 were set to 1, to thus find the first training set A0 with both the sensitivity and the specificity being 100%. That is, steps D111 to D115 were performed again with respect to the set from which two false positive cases and two false negative cases in Table 104 were excluded. The sensitivity and the specificity did not directly reach 100% when the steps D111 to D115 were repeated with respect to the set excluding the false positive and false negative cases. That is, the first training set A0 with both the sensitivity and the specificity being 100% was found after the steps D111 to D117 were repeated predetermined number of times (D118).
The first type discriminant to discriminate CRC patient group from the normal controls reached discrimination result with 100% sensitivity and specificity when 8 false negative and 9 false positive cases were excluded, and the second type discriminant reached discrimination result with 100% sensitivity and specificity when 5 false negative and 10 false positive cases (1 BRC, 8 NHL, and 1 GC) were excluded. Through this process, it is possible to derive factor loadings per mass ions which provide discrimination result with both 100% sensitivity and specificity (D119).
The series of the processes explained above may be performed at the factor loading computing means 4300.
(2-5) Implementing a Discriminant
The process of implementing the constructed discriminant on the sample of interest will be explained below.
First, MarkerView™ supports the function that can be used for the similar purpose. That is, it is possible to apply the PCA-DA on only the part of the imported sample data, and discriminate the rest samples using the discriminant constructed as a result. According to this function, it is possible to select only the first training set after the import of the first training set and the other samples for analysis so that only the first training set undergoes the PCA-DA to show how the samples for analysis are interpreted.
Meanwhile, the peak alignment function to align the peaks is performed in the import process of MarkerView™. Because there is no function to align the peaks of the samples of interest based on the first training set, the peak table (matrix of m/z rows and rows of peak intensities per samples) obtained when only the first training set is imported, does not match the first training set of the peak table which is generated when the first training set is imported together with the samples of interest. The peak intensity matrices are difference, and the m/z values corresponding to the same peak intensity column also do not always appear the same. Accordingly, in order to compute DS by implementing the discriminant constructed from the first training set on the samples of interest, a realignment operation to realign the peak table, generated when the first training set is imported together with the samples of interest, to the peak table generated when only the first training set is imported.
The misalignment becomes more serious, if several samples of interests are imported together with the first training set. Accordingly, in one embodiment, with respect to the entire samples of interest, one sample of interest is added to the first training set to be imported, realigned, normalized and Pareto-scaled.
The embodiment will be explained in greater detail below with reference to
First, the low-mass ion mass spectra of the samples of interest were aligned with the first training set and imported (D211).
Meanwhile, since MarkerView™ in one embodiment does not support the function of aligning and importing the sample of interest to the first training set, as explained above, a program may be designed to realign the peak table generated after importing the low-mass ion mass spectrum of the sample of interest together with the first training set to the peak table which is generated after importing the first training set only, so that the low-mass ion mess spectrum of the sample of interest aligned with the first training set is extracted. However, it is more preferable that the sample of interest is directly aligned and imported to the first training set without having realigning process and this is implementable by designing a program.
Next, the imported peak intensities were normalized (D212), and the normalized peak intensities were Pareto-scaled (D213).
Next, discriminant score was computed using the Pareto-scaled peak intensities of the low-mass ions and the factor loadings per mass ions acquired by the PCA-DA (D214).
It is determined whether or not the computed DS exceeds a reference CS (D215), and if so, it is interpreted positive (D216), while it is interpreted negative if the computed DS is less than the reference CS (D217). In one embodiment, the reference DS may preferably be 0.
The series of processes explained above may be performed at the second aligning means 4500, the second DS computing means 4600 and a CRC determining means 4700.
The DS was computed by applying factor loadings per mass ions computed at Clause (2-4) with respect to the 8 CRC patient samples and 9 normal control samples which were excluded when constructing the first training set A01 from the set A1 to construct the first type discriminant, and the 5 CRC patient samples, 1 BRC patient sample, 8 NHL patient samples and 1 GC patient sample which were excluded when constructing the first training set A02 from the set A1 to construct the second type discriminant Considering that the cases were excluded when constructing the first training sets A01 and A02, it was expected that the cases would be discriminated to be false positive or false negative, and they were discriminated to be false positive or false negative as expected when the computation was done. The result of discrimination of the set A1 by applying the factor loadings per mass ions computed at Clause (2-4) is presented in
(2-6) Constructing Preliminary Discriminant
Conventionally, DS is computed using the entire mass ions that are taken into consideration in the PCA-DA and the CRC patient was determined according to the computed DS. In one embodiment of the present invention, a preliminary discriminant is constructed, which uses only the mass ions that contribute considerably to the DS, in order to derive a discriminant with robust discrimination performance. As used herein, the term “preliminary discriminant” refers to an intermediate form of a discriminant which is obtained before the final discriminant is obtained, and the low-mass ions constructing the discriminant are the “preliminary candidate group” of the CRC-diagnosing low-mass ions to construct the final discriminant.
Through the process of
As explained above with reference to Table 103, because the maximum number of the peaks under the import condition is set to 10,000 and sufficient samples are imported, the discriminant constructed by the PCA-DA of MarkerView™ consists of 10,000 terms. However, not all the 10,000 terms have the equal importance particularly in distinguishing CRC patients and non-CRC patients. Accordingly, the mass ions that give considerable influence on the DS were selected from among the 10,000 mass ions by two steps according to the process of
The mass ions were preliminarily selected under corresponding case categories, if the absolute product obtained by multiplying the peak intensities by the factor loadings per mass ions exceeds the threshold CT1 (D121). In one embodiment, the threshold CT1 may preferably be 0.1.
Next, the mass ions were again selected from among the preliminarily-selected mass ions under each case category, if the mass ions appear commonly in the cases exceeding the threshold percentage CT2 (D122). In one embodiment, the threshold percentage CT2 may preferably be 50. That is, take the first type discriminant for example, only the mass ions that appear commonly in at least 135 cases from among the 269 cases of the first training set were used to construct the preliminary discriminant.
The DS was again computed exclusively with the mass ions that were selected as explained above, and the sensitivity and the specificity were computed accordingly (D123). Again, the sensitivity threshold CN3 and the specificity threshold CN4 were set (D124), so that if the sensitivity or the specificity is less than the corresponding threshold, the threshold CT1 used at step D121 and/or the threshold CT2 used at step D122 was changed (D125) and the steps from D121 to D124 were repeated. In one embodiment, the sensitivity threshold CN3 and the specificity threshold CN4 may preferably be 0.9, respectively.
The preliminary candidate group of the CRC-diagnosing low-mass ions was constructed with the mass ions that were selected as explained above (D126), and in one embodiment, 278 mass ions were selected by the first type discriminant or 383 mass ions were selected by the second type discriminant from among the 10,000 mass ions. Tables 122 and 123 provides the results of discriminating the first training sets A01 and A02 with the first and second type preliminary discriminants, according to which the discrimination performance including the sensitivity and the specificity was slightly degraded from 100%, but still the result of computing with less than 3˜4% of the total mass ions was certainly as good as the result obtained by using the entire mass ions.
Further,
The series of processes explained above may be performed at the CRC-diagnosing ion selecting means 4400 which includes the candidate ion set selecting means.
(2-7) Constructing a Final Discriminant The mass ions were extracted from among the 10,000 mass ions imported in the process of constructing the preliminary discriminant, as those that contribute considerably to the numerical aspect of the DS. Considering that the selected mass ions include the mass ions that do not generate a problem in the first training set A0, but can potentially deteriorate the discrimination performance in the discrimination with the mass spectrum that was re-measured with respect to the same CRC patient samples and non-CRC samples or in the discrimination of new CRC patient group and non-CRC patient group, additional step is necessary, which can actively remove the presence of such mass ions. The process of constructing a final discriminant includes such step before finally determining CRC-diagnosing low-mass ions.
To validate robustness of a discriminant, repeated measure experiment was conducted with respect to the set A1 5 times, and the repeated measure experiment was also performed 5 times with respect to the sets A2 and B which were independent from the set A1 and also independent from each other. It is hardly possible to confirm that the repeated measure of the mass spectrum is always conducted under the exactly same conditions in the processes like vaporization using laser beam, desorption, ionization, or the like, in addition to the process of freezing and thawing the serums and mixing the serums with methanol/chloroform to obtain extract, and it is also hard to rule out introduction of disturbances due to various causes. In other words, the DS with respect to the repeatedly-measured individual mass spectrum may have a predetermined deviation, and considering this, interpretation in one embodiment was made by computing an average DS with respect to the sample which was repeatedly measured 5 times. Table 124 provides the result of discriminating the sets A and B with the discriminant of 10,000 terms as a result of the conventional technology, i.e., PCA-DA by MarkerView™, and Table 125 shows the result of discriminating the sets A and B with the first type preliminary discriminant with 278 terms and the second type preliminary discriminant with 383 terms. Referring to the table, CRC LOME 1 (colorectal cancer low mass ion discriminant equation) refers to the first type discriminant, and CRC LOME 2 refers to the second type discriminant, and the following numbers indicate the number of low-mass ions included in the discriminant Further, Table 126 shows the discrimination performance with respect to the validation set only, i.e., to the set B, in which the numbers in parenthesis refers to the discrimination performance when TA patient group is included in the CRC patient group. Considering that TA patients have high risk of developing CRC, discriminating the TA patient group is considered to be rather advantageous result for the purpose of early detection of the diagnosis.
The discriminant consisting of 10,000 mass ions exhibits perfect discrimination performance with respect to the first training set A0, but with reference to Table 126, the sensitivity is particularly low with respect to set B. Both the first and second preliminary discriminants exhibited very good discrimination performance (Tables 122, 123) with respect to the first training set A0, but the discrimination result with respect to set B is far from satisfaction.
Accordingly, in one embodiment of the present invention, steps illustrated in
First, the mass ions of the preliminary candidate group were divided into high sensitivity set and high specificity set (D131). As used herein, the mass ions of the high sensitivity set have higher sensitivity per mass ions than specificity, while the mass ions of the high specificity set have higher specificity per mass ions than sensitivity.
Next, the mass ions of the high sensitivity set and the mass ions of the high specificity set were sorted in a descending order {Sns1, Sns2, Sns3 . . . SnsI} {Spc1, Spc2, Spc3 . . . SpcJ} in terms of the sum of the sensitivity and specificity per mass ions, and two top mass ions of the respective sets were taken {Sns1, Sns2, Spc1, Spc2}, and a biomarker group was selected with a combination of the best performance from among 11 combinations that are possibly made with the two or more mass ions of the four mass ions (D132).
The criteria to determine whether a combination has the best performance or not may be selected objectively and universally from among the following criteria which are listed in the order of importance:
Criterion 1) The combination with greater sum of sensitivity and specificity has better performance;
Criterion 2) The combination with less mass ions has better performance; and
Criterion 3) The combination with a greater difference between minimum DS of the true positive case and the maximum DS of true negative case has better performance.
Next, one more mass ion, i.e., the second top mass ion {Sns3, Spc3} was additionally taken from each of the high sensitivity set and the high specificity, so that a set with the best performance was re-selected as a biomarker group from among the four sets {biomarker group}, {biomarker group, Sns3}, {biomarker group, Spc3}, {biomarker group, Sns3, Spc3} which are the combinations of the additionally-taken mass ions {Sns3, Spc3} (D133).
The process repeated until the high sensitivity set and the high specificity set had no further mass ion to add (D134).
In other words, the process (D133) repeats as long as both the high sensitivity set and the high specificity set have mass ions to add, and when any of the high sensitivity set and the high specificity set has no further mass ion left to add, the next top mass ion {Snsi or Spcj} in the set having mass ions is additionally taken, so that a biomarker group is selected with a set of the best performance among the two sets {biomarker group}, {biomarker group, Snsi or Spcj} which are combinations of the additionally-taken mass ion {Snsi or Spcj}.
The process repeats as long as the high sensitivity set or the high specificity set is out of the mass ion, and the biomarker group that is selected when there is no mass ion left in the high sensitivity set and high specificity set becomes the biomarker group 1 (CG) (D135).
The biomarker group 1 (CG) was removed from the preliminary candidate group (D136), the high sensitivity set and the high specificity set were constructed with the remaining mass ions, and the above-explained process repeats. The process repeats until any of the high sensitivity set and the high specificity has less than two mass ions therein (D137).
CK number of biomarker groups were combined with the biomarker groups 1, 2, . . . which were obtained by the repeated process explained above, in the order of accuracy, to form a final biomarker group. As used herein, the “accuracy” refers to a proportion of true positive and true negative cases in the entire cases. In one embodiment, CK may preferably be 1, 2, or 3 (D138).
Accordingly, the mass ions of the final biomarker group were determined to be the CRC-diagnosing low-mass ions (D139).
The preliminary candidate group of the mass ions was selected from the set A1, and more specifically, from the subset A0, and to avoid overfitting problem, the set A2 which was independent from the set A1 was added to enlarge the training set when the final biomarker group was determined from the preliminary candidate group.
As a result of performing the process explained above with respect to the samples to distinguish CRC patient group from the normal controls, 104 mass ions were selected as the first type CRC-diagnosing low-mass ions. Further, as a result of performing the process explained above with respect to the samples to distinguish CRC patient group from the patient group with other cancer types, 23 mass ions were selected as the second type CRC-diagnosing low-mass ions. The masses of the first and second type CRC-diagnosing low-mass ions are listed in Tables 127 and 128. The low-mass ions explained above are referred to as the “first type CRC-diagnosing low-mass ions” and the “second type CRC-diagnosing low-mass ions”, and the discriminant according to the present invention which is finally obtained using the same are referred to as the “first type CRC-diagnosing final discriminant” and the “second type CRC-diagnosing final discriminant”, respectively.
Referring to Table 127, 1465.6184, 1466.6096, 1467.5969, 2450.9701, 2451.9662, 2452.9546 m/z were characterized into fibrinogen alpha chain and transthyretin.
The series of the processes explained above may be performed at the CRC-diagnosing ion selecting means 4400 which includes the final ion set selecting means.
(2-8) Implementation of the Final Discriminant & Analysis
The interpretation is available when the first and second type CRC-diagnosing final discriminants using the first and second type CRC-diagnosing low-mass ions are implemented on the set B according to the method of
The result of interpretation obtained by the final discriminant is shown in
The validation set (set B) exhibits all the sensitivity, specificity, positive predictability and negative predictability exceeding 85%. Further, if TA patient group is added into CRC patient group, the discrimination performance exceeds 90% which is quite satisfactory.
Table 130 shows the discrimination performance of the conventional FOBT conducted with respect to the analyte, in comparison with the discrimination performance according to the present invention. Among the validation sets, the FOBT result exhibits 100% of specificity, but low sensitivity at 50% with respect to the 96 CRC patient samples and 49 normal control samples.
The sensitivity is less than 60˜85% which is generally accepted sensitivity of the FOBT. That is, in comparison with the discrimination performance of the general conventional FOBT, the present invention provides comparable performance in terms of the specificity, and provides distinguishing result in terms of the sensitivity. Therefore, the present invention provides superior discrimination performance. The similar result is displayed in the training set. Table 131 lists the results of discrimination by FOBT and the present invention with respect to both the training set and the validation set.
To investigate the reproductibility of the discrimination result according to the present invention, the same process was repeated with respect to some of the validation sets, i.e., 13 normal controls, 35 CRC patients, 7 BRC patients, 14 GC patients, 7 OVC patients, and 5 TA patients and the result is shown in Table 132. TA patient group has most reversal of the interpretation. The clinical category of Tis of TA is sometimes confusing between cancer and non-cancer, and the discrimination result according to the present invention reflect such confusion. Except for the TA patent group, reproducibility exceeds 90% which is indicative of good discrimination performance of the present invention.
a and 25b present the result of characterizing 1465.6184 m/z and 2450.9701 m/z among the first type CRC-diagnosing low-mass ions. The two low-mass ions both exhibit the same material mass peak group which has a mass difference of approximately 1 m/z depending on the number of constituent isotopes. This is typical mass peaks of protein or peptide appearing in the mass spectrometer.
The left-upper sides of
Corresponding to the qualitative result that indicates higher peak intensity of the low-mass ion 1465.6184 m/z corresponding to the fibrinogen alpha chain in the CRC patient group, the quantitative measure indicates that the level of fibrinogen in blood of the CRC patient is higher than the normal counter part, and higher according to the progress of the stage (Table 133).
On the contrary, corresponding to the qualitative result that indicates lower peak intensity of the low-mass ion 2450.9701 m/z corresponding to transthyretin in the CRC patient group, the quantitative measure indicates that the level of transthyretin in blood of the CRC patient is lower than that of the normal counterpart (Table 134). To summarize in the form of average±standard deviation, the CRC patient group has 160.39±62.41 ng/mL, and the normal control indicates 171.19±30.86 ng/mL.
According to the present invention, it is possible to interpret the low-mass ion mass spectrum of the serum as CRC patient and non-CRC patent with high level of discrimination performance.
Referring to
To the above-mentioned purpose, the low-mass ion detecting unit 1000 extracts mass spectrum of the low-mass ion by detecting peak intensity of the low-mass ions using mass spectrometer with respect to biological samples of a plurality of BRC patient and non-BRC cases.
The detailed components of the cancer diagnosing unit to diagnose the BRC are identical to those of the apparatus for screening cancer explained above with reference to
Referring to
(3-1) Sample Preparation—Collecting Serums
Serums were collected from 54 BRC patients (Table 201), 49 normal controls (Table 202), 34 CRC patients (Table 205), 16 GC patients (Table 206), and 12 non-Hodgkin lymphoma (NHL) patients (Table 207) and, respectively.
With respect to set C1 consisting of 165 cases, subset C0 was constructed into the first training set. The weightings (factor loadings) per mass ions were computed by the biostatistical analysis, and the preliminary discriminant was acquired. Further, the training set was enlarged to include the second training set C2 consisting of the 54 BRC patients of Table 208, 46 normal controls of Table 209, 29 CRC patients of Table 210, 15 GC patients of Table 211 and 7 NHL patients of Table 212. That is, to analyze BRC-diagnosing low-mass ions according to the method explained below with respect to the preliminary candidate groups of the low-mass ions constructing the preliminary discriminant, the set C, i.e., union of set C1 and set C2, which are independent from each other, was used as the training set.
>66%
>66%
<10%
>66%
<10%
<10%
>66%
>66%
<10%
<10%
<10%
>95%
<10%
>95%
Further, validation set was constructed with set A and set B consisting of 53 BRC patients of Table 213, 46 normal controls of Table 214, 88 CRC patients of Table 215, 11 GC patients of Table 216, 5 NHL patents of Table 217, and 25 ovarian cancer (OVC) patients of Table 218. The OVC patients were not reflected at all when obtaining weighting per mass ions or investigating BRC-diagnosing low-mass ions, and included to see how these particular patient group IS discriminated with the discriminant constructed according to the present invention.
<10%
<10%
<10%
>66%
>66%
>66%
>66%
<10%
<10%
<10%
>95%
2~3%
>95%
>95%
(3-2) Sample Preparation—Preparing Serum and Measuring Mass Spectrum 4× volume of methanol/chloroform (2:1, v/v) was mixed with 25 μl serum violently and incubated at room temperature for 10 min. The mixture was centrifuged at 4° C., 10 min, 6000×g. The supernatant was completely dried for 1 h in the concentrator, and dissolved in the vortexer in 30 μl of 50% acetonitrile/0.1% trifluoroacetic acid (TFA).
Methanol/chloroform extract was mixed with a-cyano-4-hydroxycinnamic acid solution in 50% acetonitrile/0.1% TFA (1:12, v/v), and 1 μl mixture was placed on MALDI-target plate. The mass spectra of the serum extracts from the BRC patients and normal subjects were measured using the Proteomics Analyzer (Applied Biosystems, Foster City, Calif., USA).
The mass spectrum data for one sample is extracted based on the average of spectrum which was repeatedly measured 20 times. The mass region of the entire individual samples was adjusted so that the maximum mass was set at approximately 2500 m/z. To minimize experimental error, various factors including focus mass, laser intensity, target plate, data acquisition time were taken into consideration.
The focus mass and the laser intensity were fixed at preferable levels, i.e., 500 m/z and 5000, respectively. In addition to the fixed focus mass and the laser intensity, the entire samples were repeatedly measured at least five times under viewpoint of other extraction and other data collection. The set C1, from which weightings per mass ions were computed, was measured one more time.
Accordingly, the low-mass ion detecting means 5000 extracted the low-mass ion mass spectrum from the serum sample via the processes explained above, using the MALDI-TOF.
(3-3) Discrimination Strategy
In order for the constructed discriminant to be BRC specific, the discriminant is required to discriminate the BRC patient group from not only the normal control, but also the patient groups with other cancer types. In one embodiment, the patient groups with other cancer types include CRC patients, GC patients and NHL patients. Table 219 provides the result of implementing the conventional PCA-DA to investigate whether one discriminant can discriminate the BRC patient group from the non-BRC group (normal controls, CRC patient group, GC patient group and NHL patient group). Although the result of discrimination was not as perfect as that of Table 204, the discrimination performance was generally as high as 80% or above. This reveals the fact that one discriminant can discriminate the BRC patient group from all the non-BRC groups.
Referring to
Accordingly, discriminating the BRC patient group from the non-BRC patient groups may implement one discriminant or two discriminants as explained detail in the Examples provided below. A first type discriminant may be used to discriminate BRC patient group from non-patient group. A second discriminant may be used to discriminate the BRC patient group from the normal controls, with a third discriminant which may be used to discriminate the BRC patient group from non-BRC patient groups with other types of cancers, in which the BRC patient is determined if both discriminants indicate BRC, while the non-BRC patient is determined if any of the two discriminants indicates non-BRC patient.
(3-4) Selecting First Training Set C0 and Computing Weightings Per Mass Ions
Although the result of discrimination of Tables 219 and 220 are good, the sensitivity and the specificity are not always 100%. In one embodiment of the present invention, the first training set C0 with predetermined sensitivity and specificity is selected, and weightings per mass ions of the first training set C0 were computed, in which the predetermined sensitivity and specificity were both 100%.
A method for selecting the first training set C0 with the predetermined sensitivity and specificity will be explained below with reference to
The first DS computing means 5200 aligned and imported the low-mass ion mass spectra of the BRC patient group and the normal control group of set C1 (E111), normalized the imported peak intensities (E112), Pareto-scaled the normalized peak intensities (E113), and computed DS by performing biostatistical analysis with respect to the Pareto-scaled peak intensities (E114).
Among a variety of biostatistical analyzing methods that can be implemented to compute DS, in one embodiment, the PCA-DA was performed. Sensitivity and specificity were computed based on the DS (E115) and the result is shown in Table 219.
Next, sensitivity threshold BN1 and specificity threshold BN2 were set (E116), and false positive or false negative cases were excluded when the sensitivity or the specificity was less than the corresponding threshold (E117).
In one embodiment, both the sensitivity threshold BN1 and the specificity threshold BN2 were set to 1, to thus find the first training set C01 with both the sensitivity and the specificity being 100%. That is, steps E111 to E115 were performed again with respect to the set from which 12 false positive cases and 12 false negative cases in Table 219 were excluded. The sensitivity and the specificity did not directly reach 100% when the steps E111 to E115 were repeated with respect to the set excluding the false positive and false negative cases. That is, the first training set C01 with both the sensitivity and the specificity being 100% was found after the steps E111 to E117 were repeated predetermined number of times (E118).
The first type discriminant to discriminate BRC patient group from the normal controls reached the first training set C01 when 15 false positive cases (7 CONT, 3 CRC, 2 GC, 3 NHL) were excluded, and the third type discriminant to discriminate BRC patient group from the patient groups with other types of cancer reached the first training set C03 when 1 false positive case (1 GC) was excluded, with both the sensitivity and specificity reaching 100%.
The training set C02 was used as is, i.e., without excluding cases, because the second type discriminant to distinguish BRC patient group from the normal controls already provides 100% sensitivity and specificity. Through this process, it is possible to derive factor loadings per mass ions which provide discrimination result with both 100% sensitivity and specificity (E119).
The series of the processes explained above may be performed at the factor loading computing means 5300.
(3-5) Implementing a Discriminant
The process of implementing the constructed discriminant on the sample of interest will be explained below.
First, MarkerView™ supports the function that can be used for the similar purpose. That is, it is possible to apply the PCA-DA on only the part of the imported sample data, and discriminate the rest samples using the discriminant constructed as a result. According to this function, it is possible to select only the first training set after the import of the first training set and the other samples for analysis so that only the first training set undergoes the PCA-DA to show how the samples for analysis are interpreted.
Meanwhile, the peak alignment function to align the peaks is performed in the import process of MarkerView™. Because there is no function to align the peaks of the samples of interest based on the first training set, the peak table (matrix of m/z rows and rows of peak intensities per samples) obtained when only the first training set is imported, does not match the first training set of the peak table which is generated when the first training set is imported together with the samples of interest. The peak intensity matrices are difference, and the m/z values corresponding to the same peak intensity column also do not always appear the same. Accordingly, in order to compute DS by implementing the discriminant constructed from the first training set on the samples of interest, a realignment operation to realign the peak table, generated when the first training set is imported together with the samples of interest, to the peak table generated when only the first training set is imported.
The misalignment becomes more serious, if several samples of interests are imported together with the first training set. Accordingly, in one embodiment, with respect to the entire samples of interest, one sample of interest is added to the first training set to be imported, realigned, normalized and Pareto-scaled.
The embodiment will be explained in greater detail below with reference to
First, the low-mass ion mass spectra of the samples of interest were aligned with the first training set and imported (E211).
Meanwhile, since MarkerView™ in one embodiment does not support the function of aligning and importing the sample of interest to the first training set, as explained above, a program may be designed to realign the peak table generated after importing the low-mass ion mass spectrum of the sample of interest together with the first training set to the peak table which is generated after importing the first training set only, so that the low-mass ion mess spectrum of the sample of interest aligned with the first training set is extracted. However, it is more preferable that the sample of interest is directly aligned and imported to the first training set without having realigning process and this is implementable by designing a program.
Next, the imported peak intensities were normalized (E212), and the normalized peak intensities were Pareto-scaled (E213).
Next, discriminant score was computed using the Pareto-scaled peak intensities of the low-mass ions and the factor loadings per mass ions acquired by the PCA-DA (E214).
It is determined whether or not the computed DS exceeds a reference BS (E215), and if so, it is interpreted positive (E216), while it is interpreted negative if the computed DS is less than the reference BS (E217). In one embodiment, the reference BS may preferably be 0.
The series of processes explained above may be performed at the second aligning means 5500, the second DS computing means 5600 and a BRC determining means 5700.
The DS was computed by applying factor loadings per mass ions computed at Clause (3-4) with respect to the 15 non-BRC patient samples which were excluded when constructing the first training set C01 from the set C1 to construct the first type discriminant, and the 1 GC patient sample which was excluded when constructing the first training set C03 from the set C1 to construct the third type discriminant Considering that the cases were excluded when constructing the first training sets C01 and C03, it was expected that the cases would be discriminated to be false positive or false negative, and they were determined to be the false positive or false negative cases as expected when the computation was done, except for one case of the normal control group related to the first type discriminant which was determined to be true negative. The result of discrimination of the set C1 by applying the factor loadings per mass ions computed at Clause (3-4) is presented in
(3-6) Constructing Preliminary Discriminant
Conventionally, DS is computed using the entire mass ions that are taken into consideration in the PCA-DA and the BRC patient was determined according to the computed DS. In one embodiment of the present invention, a preliminary discriminant is constructed, which uses only the mass ions that contribute considerably to the DS, in order to derive a discriminant with robust discrimination performance. As used herein, the term “preliminary discriminant” refers to an intermediate form of a discriminant which is obtained before the final discriminant is obtained, and the low-mass ions constructing the discriminant are the “preliminary candidate group” of the CRC-diagnosing low-mass ions to construct the final discriminant.
Through the process of
As explained above with reference to Table 203, because the maximum number of the peaks under the import condition is set to 10,000 and sufficient samples are imported, the discriminant constructed by the PCA-DA of MarkerView™ consists of 10,000 terms. However, not all the 10,000 terms have the equal importance particularly in distinguishing BRC patients and non-BRC patients. Accordingly, the mass ions that give considerable influence on the DS were selected from among the 10,000 mass ions by two steps according to the process of
The mass ions were preliminarily selected under corresponding case categories, if the absolute product obtained by multiplying the peak intensities by the factor loadings per mass ions exceeds the threshold BT1 (E121). In one embodiment, the threshold BT1 may preferably be 0.1.
Next, the mass ions were secondarily selected from among the preliminarily-selected mass ions under each case category, if the mass ions appear commonly in the cases exceeding the threshold percentage BT2 (E122). In one embodiment, the threshold percentage BT2 may preferably be 50. That is, take the second type discriminant for example, only the mass ions that appear commonly in at least 52 cases from among the 103 cases of the first training set were used to construct the preliminary discriminant.
The DS was again computed exclusively with the mass ions that were selected as explained above, and the sensitivity and the specificity were computed accordingly (E123). Again, the sensitivity threshold BN3 and the specificity threshold BN4 were set (E124), so that if the sensitivity or the specificity is less than the corresponding threshold, the threshold BT1 used at step E121 and/or the threshold BT2 used at step E122 was changed (E125) and the steps from E121 to E124 were repeated. In one embodiment, the sensitivity threshold BN3 and the specificity threshold BN4 may preferably be 0.9, respectively.
The preliminary candidate group of the BRC-diagnosing low-mass ions was constructed with the mass ions that were selected as explained above (E126), and in one embodiment, only 376 mass ions were selected by the first type discriminant from among the 10,000 mass ions, 353 mass ions were selected by the second type discriminant, or 345 mass ions were selected by the third type discriminant. Tables 221, 222, 223 provide the results of discriminating the first training sets C01, C02, C03 with the first, second and third type preliminary discriminants, according to which the discrimination performance including the sensitivity and the specificity was slightly degraded from 100%, but still the result of computing with less than 4% of the total mass ions was certainly as good as the result obtained by using the entire mass ions.
Further,
The series of processes explained above may be performed at the BRC-diagnosing ion selecting means 5400 which includes the candidate ion set selecting means.
(3-7) Constructing a Final Discriminant The mass ions were extracted from among the 10,000 mass ions imported in the process of constructing the preliminary discriminant, as those that contribute considerably to the numerical aspect of the DS. Considering that the selected mass ions include the mass ions that do not generate a problem in the first training set C0, but can potentially deteriorate the discrimination performance in the discrimination with the mass spectrum that was re-measured with respect to the same BRC patient samples and non-BRC samples or in the discrimination of new BRC patient group and non-BRC patient group, additional step is necessary, which can actively remove the presence of such mass ions. The process of constructing a final discriminant includes such step before finally determining BRC-diagnosing low-mass ions.
To validate robustness of a discriminant, repeated measure experiment was conducted with respect to the set C1 5 times, and the repeated measure experiment was also performed 5 times with respect to the sets C2 and D which were independent from the set C1 and also independent from each other. It is hardly possible to confirm that the repeated measure of the mass spectrum is always conducted under the exactly same conditions in the processes like vaporization using laser beam, desorption, ionization, or the like, in addition to the process of freezing and thawing the serums and mixing the serums with methanol/chloroform to obtain extract, and it is also hard to rule out introduction of disturbances due to various causes. In other words, the DS with respect to the repeatedly-measured individual mass spectrum may have a predetermined deviation, and considering this, interpretation in one embodiment was made by computing an average DS with respect to the sample which was repeatedly measured 5 times.
Table 224 provides the result of discriminating the sets C and D with the discriminant of 10,000 terms as a result of the conventional technology, i.e., PCA-DA by MarkerView™, and Table 225 shows the result of discriminating the sets C and D with the first type preliminary discriminant with 376 terms, the second type preliminary discriminant with 353 terms, and the third type preliminary discriminant with 345 terms. Referring to the table, BRC LOME 1 (breast cancer low mass ion discriminant equation) refers to the first type discriminant, BRC LOME 2 refers to the second type discriminant, and BRC LOME 3 refers to the third type discriminant, and the following numbers indicate the number of low-mass ions included in the discriminant. Further, Table 226 shows the discrimination performance with respect to the validation set only, i.e., to the set D, in which the numbers in parenthesis refers to the discrimination performance when OVA patient group is excluded.
The discriminant consisting of 10,000 mass ions exhibits perfect discrimination performance with respect to the first training set C0, but with reference to Table 226, the positive predictability was particularly low with respect to set D. All the first, second and third preliminary discriminants exhibited very good discrimination performance (Tables 122, 123) with respect to the first training set C0, but the discrimination result with respect to set D was far from satisfaction.
Accordingly, in one embodiment of the present invention, steps illustrated in
First, the mass ions of the preliminary candidate group were divided into high sensitivity set and high specificity set (E131). As used herein, the mass ions of the high sensitivity set have higher sensitivity per mass ions than specificity, while the mass ions of the high specificity set have higher specificity per mass ions than sensitivity.
Next, the mass ions of the high sensitivity set and the mass ions of the high specificity set were sorted in a descending order {Sns1, Sns2, Sns3 . . . SnsI} {Spc1, Spc2, Spc3 . . . SpcJ} in terms of the sum of the sensitivity and specificity per mass ions, and two top mass ions of the respective sets were taken {Sns1, Sns2, Spc1, Spc2}, and a biomarker group was selected with a combination of the best performance from among 11 combinations that are possibly made with the two or more mass ions of the four mass ions (E132).
The criteria to determine whether a combination has the best performance or not may be selected objectively and universally from among the following criteria which are listed in the order of importance:
Criterion 1) The combination with greater sum of sensitivity and specificity has better performance;
Criterion 2) The combination with less mass ions has better performance; and
Criterion 3) The combination with a greater difference between minimum DS of the true positive case and the maximum DS of true negative case has better performance.
Next, one more mass ion, i.e., the second top mass ion {Sns3, Spc3} was additionally taken from each of the high sensitivity set and the high specificity, so that a set with the best performance was re-selected as a biomarker group from among the four sets {biomarker group}, {biomarker group, Sns3}, {biomarker group, Spc3}, {biomarker group, Sns3, Spc3} which are the combinations of the additionally-taken mass ions {Sns3, Spc3} (E133).
The process repeated until the high sensitivity set and the high specificity set had no further mass ion to add (E134).
In other words, the process (E133) repeats as long as both the high sensitivity set and the high specificity set have mass ions to add, and when any of the high sensitivity set and the high specificity set has no further mass ion left to add, the next top mass ion {Snsi or Spcj} in the set having mass ions is additionally taken, so that a biomarker group is selected with a set of the best performance among the two sets {biomarker group}, {biomarker group, Snsi or Spcj} which are combinations of the additionally-taken mass ion {Snsi or Spcj}.
The process repeats as long as the high sensitivity set or the high specificity set is out of the mass ion, and the biomarker group that is selected when there is no mass ion left in the high sensitivity set and high specificity set becomes the biomarker group 1 (BG) (E135).
The biomarker group 1 (BG) was removed from the preliminary candidate group (E136), the high sensitivity set and the high specificity set were constructed with the remaining mass ions, and the above-explained process repeats. The process repeats until any of the high sensitivity set and the high specificity has less than two mass ions therein (E137).
BK number of biomarker groups were combined with the biomarker groups 1, 2, . . . which were obtained by the repeated process explained above, in the order of accuracy, to form a final biomarker group. As used herein, the “accuracy” refers to a proportion of true positive and true negative cases in the entire cases. In one embodiment, BK may preferably be 1, 2, or 3 (E138)
Accordingly, the mass ions of the final biomarker group were determined to be the BRC-diagnosing low-mass ions (E139).
The preliminary candidate group of the mass ions was selected from the set C1, and more specifically, from the subset C0, and to avoid overfitting problem, the set C2 which was independent from the set C1 was added to enlarge the training set when the final biomarker group was determined from the preliminary candidate group.
As a result of performing the process explained above with respect to the samples to distinguish BRC patient group from the non-BRC patient group, 29 mass ions were selected as the first type BRC-diagnosing low-mass ions. Further, as a result of performing the process explained above with respect to the samples to distinguish BRC patient group from the normal controls, 42 mass ions were selected as the second type BRC-diagnosing low-mass ions. Further, as a result of performing the process explained above with respect to the samples to distinguish BRC patient group from the patient groups with other types of cancers, 75 mass ions were selected as the third type BRC-diagnosing low-mass ions. The masses of the first, second and third type BRC-diagnosing low-mass ions are listed in Tables 227, 228 and 229. The low-mass ions explained above are referred to as the “first type BRC-diagnosing low-mass ions”, the “second type CRC-diagnosing low-mass ions”, and the “third type BRC-diagnosing low-mass ions”, and the discriminant according to the present invention which is finally obtained using the same are referred to as the “first type BRC-diagnosing final discriminant”, the “second type CRC-diagnosing final discriminant”, and the “second type CRC-diagnosing final discriminant”, respectively.
The series of the processes explained above may be performed at the BRC-diagnosing ion selecting means 5400 which includes the final ion set selecting means.
(3-8) Implementation of the Final Discriminant & Analysis
The interpretation is available when the first, second and third type BRC-diagnosing final discriminants using the first, second and third type BRC-diagnosing low-mass ions are implemented on the set D according to the method of
The result of interpretation obtained by the final discriminant is shown in
Based on the discrimination performance of the validation set (D), compared to the result by the first type BRC-diagnosing final discriminant, the results by the second and third type BRC-diagnosing final discriminants were more accurate. When the second and third type BRC-diagnosing final discriminants were used, even with the OVC patient group included, which was excluded from the training set, all the sensitivity, specificity, positive predictability and negative predictability of set D exceeded 85%.
When the first type BRC-diagnosing final discriminant was used, the set D had 85% or above sensitivity, specificity, positive predictability and negative predictability only with respect to the set excluding OVC patient group. On the whole, the first type BRC-diagnosing final discriminant is considered to exhibit good discrimination result.
Accordingly, it is possible to discriminate the BRC patients from the non-BRC patients by analyzing the low-mass ion mass spectrum of the serum.
Referring to
To the above-mentioned purpose, the low-mass ion detecting unit 1000 extracts mass spectrum of the low-mass ion by detecting peak intensity of the low-mass ions using mass spectrometer with respect to biological samples of a plurality of GC patient and non-GC cases.
The detailed components of the cancer diagnosing unit to diagnose the GC are identical to those of the apparatus for screening cancer explained above with reference to
Referring to
(4-1) Sample Preparation—Collecting Serums
Serums were collected from 49 BRC patients (Table 301), 84 normal controls (Table 302), 77 CRC patients (Table 305), 54 BRC patients (Table 306), and 24 non-Hodgkin lymphoma (NHL) patients (Table 307) and, respectively.
<10%
>66%
>66%
100%
With respect to set E1 consisting of 288 cases, subset E0 was constructed into the first training set. The weightings (factor loadings) per mass ions were computed by the biostatistical analysis, and the preliminary discriminant was acquired. Further, the training set was enlarged to include the second training set E2 consisting of the 48 GC patients of Table 308, 83 normal controls of Table 309, 175 CRC patients of Table 310, 54 BRC patients of Table 311 and 22 NHL patients of Table 312. That is, to analyze GC-diagnosing low-mass ions according to the method explained below with respect to the preliminary candidate groups of the low-mass ions constructing the preliminary discriminant, the set E, i.e., union of set E1 and set E2, which are independent from each other, was used as the training set.
>66%
>66%
<10%
>66%
<10%
<10%
>66%
>66%
<10%
<10%
<10%
>95%
<10%
>95%
Further, validation set was constructed with set E and set F consisting of 44 GC patients of Table 313, 81 normal controls of Table 314, 168 CRC patients of Table 315, 53 BRC patients of Table 316, 20 NHL patents of Table 317, and 25 ovarian cancer (OVC) patients of Table 318. The OVC patients were not reflected at all when obtaining weighting per mass ions or investigating GC-diagnosing low-mass ions, and included to see how these particular patient group IS discriminated with the discriminant constructed according to the present invention.
<10%
<10%
<10%
>66%
>66%
>66%
>66%
<10%
<10%
<10%
>95%
2~3%
>95%
>95%
(4-2) Sample Preparation—Preparing Serum and Measuring Mass Spectrum
4× volume of methanol/chloroform (2:1, v/v) was mixed with 25 μl serum violently and incubated at room temperature for 10 min. The mixture was centrifuged at 4° C., 10 min, 6000×g. The supernatant was completely dried for 1 h in the concentrator, and dissolved in the vortexer in 30 μl of 50% acetonitrile/0.1% trifluoroacetic acid (TFA).
Methanol/chloroform extract was mixed with a-cyano-4-hydroxycinnamic acid solution in 50% acetonitrile/0.1% TFA (1:12, v/v), and 1 μl mixture was placed on MALDI-target plate. The mass spectra of the serum extracts from the BRC patients and normal subjects were measured using the Proteomics Analyzer (Applied Biosystems, Foster City, Calif., USA).
The mass spectrum data for one sample is extracted based on the average of spectrum which was repeatedly measured 20 times. The mass region of the entire individual samples was adjusted so that the maximum mass was set at approximately 2500 m/z. To minimize experimental error, various factors including focus mass, laser intensity, target plate, data acquisition time were taken into consideration.
The focus mass and the laser intensity were fixed at preferable levels, i.e., 500 m/z and 5000, respectively. In addition to the fixed focus mass and the laser intensity, the entire samples were repeatedly measured at least five times under viewpoint of other extraction and other data collection. The set C1, from which weightings per mass ions were computed, was measured one more time.
Accordingly, the low-mass ion detecting means 6000 extracted the low-mass ion mass spectrum from the serum sample via the processes explained above, using the MALDI-TOF.
(4-3) Discrimination Strategy
In order for the constructed discriminant to be GC specific, the discriminant is required to discriminate the GC patient group from not only the normal control, but also the patient groups with other cancer types. In one embodiment, the patient groups with other cancer types include CRC patients, BRC patients and NHL patients. Table 319 provides the result of implementing the conventional PCA-DA to investigate whether one discriminant can discriminate the GC patient group from the non-GC group (normal controls, CRC patient group, BRC patient group and NHL patient group). The specificity of the NHL patient group was as low as 25.00%, and this reveals the fact that one discriminant cannot discriminate the GC patient group from the non-GC groups.
Referring to
Accordingly, discriminating the GC patient group from the non-GC patient groups may implement four discriminants consisting of a first type discriminant to discriminate GC patient group from normal controls, a second type discriminant to discriminate the GC patient group from the CRC patient group, a third type discriminant to discriminate the GC patient group from BRC patient group, and a fourth type discriminant to discriminate the GC patient group from the NHL patient group, in which the GC patient is determined if all of the four discriminant indicate GC, while the non-GC patient is determined if any of the four discriminants indicates non-GC patient.
Considering the requirement that GC be determined based on all the discriminants will inevitably compromise the sensitivity as the number of discriminants increases, the number of discriminants may be reduced. Table 323 shows GC patient group and the normal controls distinguished from the patient groups with other types of cancers, which generally exhibits good discrimination result. Accordingly, to distinguish the GC patient group from the non-GC patient group, it is possible to combine this discriminant with the first type discriminant to distinguish the GC patient group and the normal controls from the patient groups with other types of cancers, and then distinguish the GC patient group from the normal controls. The discriminant to distinguish the GC patient group and the normal control from the patient groups with the other types of cancers will be referred to as a fifth type discriminant. It is possible to implement four discriminants or alternatively, to implement two discriminants, and these examples will be explained below.
(4-4) Selecting First Training Set E0 and Computing Weightings Per Mass Ions
Although the result of discrimination of Tables 304, 320, 321, 323 are good, the sensitivity and the specificity are not always 100%. In one embodiment of the present invention, the first training set E0 with predetermined sensitivity and specificity is selected, and weightings per mass ions of the first training set E0 were computed, in which the predetermined sensitivity and specificity were both 100%.
A method for selecting the first training set E0 with the predetermined sensitivity and specificity will be explained below with reference to
The first DS computing means 6200 aligned and imported the low-mass ion mass spectra of the GC patient group and the normal control group of set E1 (F111), normalized the imported peak intensities (E112), Pareto-scaled the normalized peak intensities (F113), and computed DS by performing biostatistical analysis with respect to the Pareto-scaled peak intensities (F114).
Among a variety of biostatistical analyzing methods that can be implemented to compute DS, in one embodiment, the PCA-DA was performed. Sensitivity and specificity were computed based on the DS (F115) and the result is shown in Table 304.
Next, sensitivity threshold GN1 and specificity threshold GN2 were set (F116), and false positive or false negative cases were excluded when the sensitivity or the specificity was less than the corresponding threshold (F117).
In one embodiment, both the sensitivity threshold GN1 and the specificity threshold GN2 were set to 1, to thus find the first training set E01 with both the sensitivity and the specificity being 100%. That is, steps F111 to F115 were performed again with respect to the set from which one false negative case in Table 304 were excluded. It was thus confirmed that the first type discriminant directly achieved 100% of sensitivity and specificity, but considering that the sensitivity and the specificity did not directly reach 100% when the steps F111 to F115 were repeated with respect to the set excluding the false negative case, the first training set E01 with both the sensitivity and the specificity being 100% was found after the steps F111 to F117 were repeated predetermined number of times (F118).
The first type discriminant to discriminate GC patient group from the normal controls reached the first training set E01 when 1 false negative case was excluded, the second type discriminant to discriminate GC patient group from the CRC patient group reached the first training set E01 when 4 false negative cases and 2 false positive cases were excluded, the third type discriminant to discriminate GC patient group from the BRC patient groups reached the first training set E03 when 4 false negative cases and 1 false positive case were excluded, and the fifth type discriminant to discriminate the GC patient group and the normal control from the patient groups with the other types of cancers reached the first training set E05 when 11 false negative cases (5 GC and 6 CONT) and 21 false positive cases (20 CRC, 1 BRC) were excluded, with both the sensitivity and specificity of each first training set reaching 100%.
Since the fourth type discriminant to discriminate the GC patient group from the NHL patient group already has 100% sensitivity and specificity as indicated in Table 322, the corresponding cases were used as they area for the first training set E04. Through this process, it is possible to derive factor loadings per mass ions which provide discrimination result with both 100% sensitivity and specificity (F119).
The series of the processes explained above may be performed at the factor loading computing means 6300.
(4-5) Implementing a Discriminant
The process of implementing the constructed discriminant on the sample of interest will be explained below.
First, MarkerView™ supports the function that can be used for the similar purpose. That is, it is possible to apply the PCA-DA on only the part of the imported sample data, and discriminate the rest samples using the discriminant constructed as a result. According to this function, it is possible to select only the first training set after the import of the first training set and the other samples for analysis so that only the first training set undergoes the PCA-DA to show how the samples for analysis are interpreted.
Meanwhile, the peak alignment function to align the peaks is performed in the import process of MarkerView™. Because there is no function to align the peaks of the samples of interest based on the first training set, the peak table (matrix of m/z rows and rows of peak intensities per samples) obtained when only the first training set is imported, does not match the first training set of the peak table which is generated when the first training set is imported together with the samples of interest. The peak intensity matrices are difference, and the m/z values corresponding to the same peak intensity column also do not always appear the same. Accordingly, in order to compute DS by implementing the discriminant constructed from the first training set on the samples of interest, a realignment operation to realign the peak table, generated when the first training set is imported together with the samples of interest, to the peak table generated when only the first training set is imported.
The misalignment becomes more serious, if several samples of interests are imported together with the first training set. Accordingly, in one embodiment, with respect to the entire samples of interest, one sample of interest is added to the first training set to be imported, realigned, normalized and Pareto-scaled.
The embodiment will be explained in greater detail below with reference to
First, the low-mass ion mass spectra of the samples of interest were aligned with the first training set and imported (F211).
Meanwhile, since MarkerView™ in one embodiment does not support the function of aligning and importing the sample of interest to the first training set, as explained above, a program may be designed to realign the peak table generated after importing the low-mass ion mass spectrum of the sample of interest together with the first training set to the peak table which is generated after importing the first training set only, so that the low-mass ion mess spectrum of the sample of interest aligned with the first training set is extracted. However, it is more preferable that the sample of interest is directly aligned and imported to the first training set without having realigning process and this is implementable by designing a program.
Next, the imported peak intensities were normalized (F212), and the normalized peak intensities were Pareto-scaled (F213).
Next, discriminant score was computed using the Pareto-scaled peak intensities of the low-mass ions and the factor loadings per mass ions acquired by the PCA-DA (F214).
It is determined whether or not the computed DS exceeds a reference GS (F215), and if so, it is interpreted positive (F216), while it is interpreted negative if the computed DS is less than the reference GS (F217). In one embodiment, the reference GS may preferably be 0.
The series of processes explained above may be performed at the second aligning means 6500, the second DS computing means 6600 and a GC determining means 6700.
The DS was computed by applying factor loadings per mass ions computed at Clause (4-4) with respect to the 1 GC patient sample which was excluded when constructing the first training set E01 from the set E1 to construct the first type discriminant, 4 GC patient samples and 2 CRC patient samples which were excluded when constructing the first training set E02 from the set E1 to construct the second type discriminant, 4 GC patient samples and 1 BRC patient sample which were excluded when constructing the first training set E03 from the set E1 to construct the third type discriminant, and 5 GC patient samples, 6 normal control samples, 20 CRC patient samples, and 1 BRC patient sample which were excluded when constructing the first training set E05 from the set E1 to construct the fifth type discriminant Considering that the cases were excluded when constructing the first training sets E01, E02, E03 and E05, it was expected that the cases would be discriminated to be false positive or false negative, they were determined to be the false positive or false negative cases as expected when the computation was done, except for two cases from the GC patient group and one case from the normal control group related to the fifth type discriminant which were determined to be true positive. The result of discrimination of the set E1 by applying the factor loadings per mass ions computed at Clause (4-4) is presented in
(4-6) Constructing Preliminary Discriminant
Conventionally, DS is computed using the entire mass ions that are taken into consideration in the PCA-DA and the GC patient was determined according to the computed DS. In one embodiment of the present invention, a preliminary discriminant is constructed, which uses only the mass ions that contribute considerably to the DS, in order to derive a discriminant with robust discrimination performance. As used herein, the term “preliminary discriminant” refers to an intermediate form of a discriminant which is obtained before the final discriminant is obtained, and the low-mass ions constructing the discriminant are the “preliminary candidate group” of the GC-diagnosing low-mass ions to construct the final discriminant.
Through the process of
As explained above with reference to Table 303, because the maximum number of the peaks under the import condition is set to 10,000 and sufficient samples are imported, the discriminant constructed by the PCA-DA of MarkerView™ consists of 10,000 terms. However, not all the 10,000 terms have the equal importance particularly in distinguishing GC patients and non-GC patients. Accordingly, the mass ions that give considerable influence on the DS were selected from among the 10,000 mass ions by two steps according to the process of
The mass ions were preliminarily selected under corresponding case categories, if the absolute product obtained by multiplying the peak intensities by the factor loadings per mass ions exceeds the threshold GT1 (F121). In one embodiment, the threshold GT1 may preferably be 0.1.
Next, the mass ions were secondarily selected from among the preliminarily-selected mass ions under each case category, if the mass ions appear commonly in the cases exceeding the threshold percentage GT2 (F122). In one embodiment, the threshold percentage GT2 may preferably be 50. That is, take the fourth type discriminant for example, only the mass ions that appear commonly in at least 37 cases from among the 73 cases of the first training set were used to construct the preliminary discriminant.
The DS was again computed exclusively with the mass ions that were selected as explained above, and the sensitivity and the specificity were computed accordingly (F123). Again, the sensitivity threshold GN3 and the specificity threshold GN4 were set (F124), so that if the sensitivity or the specificity is less than the corresponding threshold, the threshold GT1 used at step F121 and/or the threshold GT2 used at step F122 was changed (F125) and the steps from F121 to F124 were repeated. In one embodiment, the sensitivity threshold GN3 and the specificity threshold GN4 may preferably be 0.9, respectively.
The preliminary candidate group of the GC-diagnosing low-mass ions was constructed with the mass ions that were selected as explained above (F126), and in one embodiment, only 299 mass ions were selected by the first type discriminant from among the 10,000 mass ions, 351 mass ions were selected by the second type discriminant, 384 mass ions were selected by the third type discriminant, 348 mass ions were selected by the fourth type discriminant, and 383 mass ions were selected by the fifth type discriminant, Tables 324 to 328 provide the results of discriminating the first training sets E01 to E05 with the first, second, third, fourth and fifth type preliminary discriminants, according to which the discrimination performance including the sensitivity and the specificity was slightly degraded from 100%, but still the result of computing with less than 4% of the total mass ions was certainly as good as the result obtained by using the entire mass ions.
Further,
The series of processes explained above may be performed at the GC-diagnosing ion selecting means 6400 which includes the candidate ion set selecting means.
(4-7) Constructing a Final Discriminant
The mass ions were extracted from among the 10,000 mass ions imported in the process of constructing the preliminary discriminant, as those that contribute considerably to the numerical aspect of the DS. Considering that the selected mass ions include the mass ions that do not generate a problem in the first training set E0, but can potentially deteriorate the discrimination performance in the discrimination with the mass spectrum that was re-measured with respect to the same GC patient samples and non-GC samples or in the discrimination of new GC patient group and non-GC patient group, additional step is necessary, which can actively remove the presence of such mass ions. The process of constructing a final discriminant includes such step before finally determining GC-diagnosing low-mass ions.
To validate robustness of a discriminant, repeated measure experiment was conducted with respect to the set E1 5 times, and the repeated measure experiment was also performed 5 times with respect to the sets E2 and F which were independent from the set E1 and also independent from each other. It is hardly possible to confirm that the repeated measure of the mass spectrum is always conducted under the exactly same conditions in the processes like vaporization using laser beam, desorption, ionization, or the like, in addition to the process of freezing and thawing the serums and mixing the serums with methanol/chloroform to obtain extract, and it is also hard to rule out introduction of disturbances due to various causes. In other words, the DS with respect to the repeatedly-measured individual mass spectrum may have a predetermined deviation, and considering this, interpretation in one embodiment was made by computing an average DS with respect to the sample which was repeatedly measured 5 times.
Table 329 provides the result of discriminating the sets E and F with the discriminant of 10,000 terms as a result of the conventional technology, i.e., PCA-DA by MarkerView™, and Table 330 shows the result of discriminating the sets E and F with the first type preliminary discriminant with 299 terms, the second type preliminary discriminant with 351 terms, the third type preliminary discriminant with 384 terms, the fourth type preliminary discriminant with 348 terms, and the fifth type preliminary discriminant with 383 terms.
Referring to the table, GC LOME 1 to 5 (gastric cancer low mass ion discriminant equation) refers to the first to fifth type discriminants, and the following numbers indicate the number of low-mass ions included in the discriminant. Further, Table 331 shows the discrimination performance with respect to the validation set only, i.e., to the set F.
The discriminant consisting of 10,000 mass ions exhibits perfect discrimination performance with respect to the first training set E0, but with reference to Table 331, the positive predictability was particularly low with respect to set F. All the first, second, third, fourth and fifth preliminary discriminants exhibited generally good discrimination performance (Tables 324 to 328) with respect to the first training set E0, but the discrimination result with respect to set F was far from satisfaction.
Accordingly, in one embodiment of the present invention, steps illustrated in
First, the mass ions of the preliminary candidate group were divided into high sensitivity set and high specificity set (F131). As used herein, the mass ions of the high sensitivity set have higher sensitivity per mass ions than specificity, while the mass ions of the high specificity set have higher specificity per mass ions than sensitivity.
Next, the mass ions of the high sensitivity set and the mass ions of the high specificity set were sorted in a descending order {Sns1, Sns2, Sns3 . . . SnsI} {Spc1, Spc2, Spc3 . . . SpcJ} in terms of the sum of the sensitivity and specificity per mass ions, and two top mass ions of the respective sets were taken {Sns1, Sns2, Spc1, Spc2}, and a biomarker group was selected with a combination of the best performance from among 11 combinations that are possibly made with the two or more mass ions of the four mass ions (F132).
The criteria to determine whether a combination has the best performance or not may be selected objectively and universally from among the following criteria which are listed in the order of importance:
Criterion 1) The combination with greater sum of sensitivity and specificity has better performance;
Criterion 2) The combination with less mass ions has better performance; and
Criterion 3) The combination with a greater difference between minimum DS of the true positive case and the maximum DS of true negative case has better performance.
Next, one more mass ion, i.e., the second top mass ion {Sns3, Spc3} was additionally taken from each of the high sensitivity set and the high specificity, so that a set with the best performance was re-selected as a biomarker group from among the four sets {biomarker group}, {biomarker group, Sns3}, {biomarker group, Spc3}, {biomarker group, Sns3, Spc3} which are the combinations of the additionally-taken mass ions {Sns3, Spc3} (F133).
The process repeated until the high sensitivity set and the high specificity set had no further mass ion to add (F134).
In other words, the process (F133) repeats as long as both the high sensitivity set and the high specificity set have mass ions to add, and when any of the high sensitivity set and the high specificity set has no further mass ion left to add, the next top mass ion {Snsi or Spcj} in the set having mass ions is additionally taken, so that a biomarker group is selected with a set of the best performance among the two sets {biomarker group}, {biomarker group, Snsi or Spcj} which are combinations of the additionally-taken mass ion {Snsi or Spcj}.
The process repeats as long as the high sensitivity set or the high specificity set is out of the mass ion, and the biomarker group that is selected when there is no mass ion left in the high sensitivity set and high specificity set becomes the biomarker group 1 (GG) (F135).
The biomarker group 1 (GG) was removed from the preliminary candidate group (F136), the high sensitivity set and the high specificity set were constructed with the remaining mass ions, and the above-explained process repeats. The process repeats until any of the high sensitivity set and the high specificity has less than two mass ions therein (F137).
GK number of biomarker groups were combined with the biomarker groups 1, 2, . . . which were obtained by the repeated process explained above, in the order of accuracy, to form a final biomarker group. As used herein, the “accuracy” refers to a proportion of true positive and true negative cases in the entire cases. In one embodiment, GK may preferably be 1, 2, or 3 (F138)
Accordingly, the mass ions of the final biomarker group were determined to be the BRC-diagnosing low-mass ions (F139).
The preliminary candidate group of the mass ions was selected from the set E1, and more specifically, from the subset E0, and to avoid overfitting problem, the set E2 which was independent from the set E1 was added to enlarge the training set when the final biomarker group was determined from the preliminary candidate group.
As a result of performing the process explained above with respect to the samples to distinguish GC patient group from the normal control group, 14 mass ions were selected as the first type GC-diagnosing low-mass ions. Further, as a result of performing the process explained above with respect to the samples to distinguish GC patient group from the CRC patient group, 36 mass ions were selected as the second type GC-diagnosing low-mass ions. Further, as a result of performing the process explained above with respect to the samples to distinguish GC patient group from the BRC patient group, 50 mass ions were selected as the third type GC-diagnosing low-mass ions. Further, as a result of performing the process explained above with respect to the samples to distinguish GC patient group from the NHL patient group, 46 mass ions were selected as the fourth type GC-diagnosing low-mass ions. Further, as a result of performing the process explained above with respect to the samples to distinguish GC patient group from the cancer patient group with other types of cancers, 55 mass ions were selected as the fifth type GC-diagnosing low-mass ions.
The masses of the first to fifth type GC-diagnosing low-mass ions are listed in Tables 332 to 336. The low-mass ions explained above are referred to as the “first type GC-diagnosing low-mass ions”, “second type GC-diagnosing low-mass ions”, “third type GC-diagnosing low-mass ions”, “fourth type GC-diagnosing low-mass ions”, and “fifth type GC-diagnosing low-mass ions”, and the discriminants according to the present invention which is finally obtained using the same are referred to as the “first type GC-diagnosing final discriminant”, “second type GC-diagnosing final discriminant”, “third type GC-diagnosing final discriminant”, “fourth type GC-diagnosing final discriminant”, and “fifth type GC-diagnosing final discriminant”, respectively.
The series of processes explained above may be performed at the GC-diagnosing ion selecting means 6400 which includes the candidate ion set selecting means.
(4-8) Implementation of the Final Discriminant & Analysis
The interpretation is available when the first to fourth type, or first and fifth type GC-diagnosing final discriminants using the first to fifth type, or first and fifth type GC-diagnosing low-mass ions are implemented on the set F according to the method of
The result of interpretation obtained by the final discriminant is shown in
Based on the discrimination performance of the validation set (F), compared to the result by the first and fifth type GC-diagnosing final discriminants, the results by the first to fifth type GC-diagnosing final discriminants were more accurate. While the increased number of discriminants is generally accompanied with the reduction in the sensitivity, considering that the third and fourth discriminants show 100% sensitivity as explained in the example, from a viewpoint of the degradation of sensitivity, it is almost like when there are indeed two discriminants. In other words, the sensitivity is not severely influenced according to the number of discriminants.
When the second and third type BRC-diagnosing final discriminants were used, even with the OVC patient group included, which was excluded from the training set, all the sensitivity, specificity, positive predictability and negative predictability of set D exceeded 85%.
When the first to fifth type GC-diagnosing final discriminant were used, the set F had 90% or above sensitivity, specificity, positive predictability and negative predictability. When the first and fifth type GC-diagnosing final discriminant were used, the set F had approximately 80% or above sensitivity, specificity, positive predictability and negative predictability. On the whole, the first and fifth type GC-diagnosing final discriminants are also considered to exhibit good discrimination result.
Accordingly, it is possible to discriminate the GC patients from the non-GC patients by analyzing the low-mass ion mass spectrum of the serum.
The embodiment of the present invention is easily expanded to construct a discriminant to distinguish a specific cancer patient group other than CRC, BRC or GC patient groups from the normal control groups by the similar processes explained above. Further, those skilled in the art would be easily able to appreciate that it is possible to expand the embodiment of the present invention to screening of not only cancers, but also other disease types.
Number | Date | Country | Kind |
---|---|---|---|
1020120000729 | Jan 2012 | KR | national |
1020120000730 | Jan 2012 | KR | national |
1020120000745 | Jan 2012 | KR | national |
1020120129390 | Nov 2012 | KR | national |