The present disclosure relates to a learning method, a mixing ratio prediction method, and a learning device.
In the development of, for example, immunotherapy, it is important to understand changes in immune state due to a disease. Under these circumstances, in recent years, a method for predicting a mixing ratio of each cell type (type of cell) in tissue has been studied using data indicating an expression level (gene expression level) of each gene in an immune cell. In such a study, a cell group containing a plurality of types of cells (hereinafter, referred to as a “bulk cell”) is used for prediction of a mixing ratio of each cell type contained in the bulk cell, for example.
In order to achieve the above-described object, an embodiment of the present invention includes causing a machine learning model to learn to output, in response to input of cell group expression level data indicating an expression level of each gene in a cell group to be predicted, a mixing ratio of a cell contained in the cell group. In the causing a machine learning model to learn, a virtual mixing ratio that differs among a plurality of pieces of learning data is set as desired, and a learning dataset is used, the learning dataset including data generated, for each piece of the learning data, by obtaining a virtual expression level that is a virtual gene expression level corresponding to the virtual mixing ratio based on original data indicating a gene expression level in each cell type.
An embodiment of the present invention will be described in detail below with reference to the drawings. According to the embodiment of the present invention, a mixing ratio prediction device 10 capable of predicting a mixing ratio of each cell type contained in a bulk cell with high accuracy will be described. First, a concept of how the mixing ratio is predicted will be described with reference to
Note that, as an example according to the embodiment of the present invention, a sample cell containing a plurality of types of immune cells is used as the bulk cell. Note that the bulk cell may contain various types of cells (for example, cancer cells, muscle cells, nerve cells, etc.) other than such immune cells.
As shown in
As shown in
In the example shown in
First, the mixing ratio prediction device 10 sets a virtual mixing ratio of each cell. In the example shown in
Subsequently, the mixing ratio prediction device 10 mixes “cell 1” at 80%, “cell 2” at 10%, and “cell 3” at 10% in accordance with the virtual mixing ratio (1) to generate “virtual bulk cell 1”. Then, the mixing ratio prediction device 10 uses the respective proportions A1 to C1 of the genes A to C making up the cells 1 to 3 to determine virtual expression levels A4 to C4 representing the respective virtual expression levels of the genes A to C making up “virtual bulk cell 1”.
Similarly, the mixing ratio prediction device 10 generates “virtual bulk cell 2” at the virtual mixing ratio (2) and determines respective virtual expression levels A5 to C5 of the genes A to C. Further, the mixing ratio prediction device 10 generates “virtual bulk cell 3” at the virtual mixing ratio (3) and determines respective virtual expression levels A6 to C6 of the genes A to C.
This allows the mixing ratio prediction device 10 according to the present invention to use the virtual mixing ratio and the virtual expression level as the learning data even when a sufficient volume of bulk cell information cannot be obtained as the learning data and to predict the cell mixing ratio from the gene expression levels in the bulk cell. That is, the mixing ratio prediction device 10 can make the prediction with the learning data that is virtual information obtained through the generation process, instead of data obtained through measurement or the like. In other words, the mixing ratio prediction device 10 uses a new method in which learning is made based on virtual data, instead of learning processes in the related art.
A description will be given below of “learning dataset creation process” of creating a dataset (learning dataset) for use in learning a predictor, “learning process” of causing the predictor to learn using the learning dataset, and “prediction process” of predicting, by the predictor, the mixing ratio of each cell type contained in the bulk cell.
Note that, as an example according to the embodiment of the present invention, a case where the predictor is implemented by a learned neural network will be described. Note that the predictor may be implemented by not only such a learned neural network, but also various machine learning models such as a decision tree and a support vector machine.
Next, a description will be given of a function configuration of the mixing ratio prediction device 10 according to the embodiment of the present invention with reference to
As shown in
The dataset creation module 101 executes the learning dataset creation process. That is, the dataset creation module 101 uses, as input, the gene expression level data 211 of each cell type to create a learning dataset 215. Herein, the dataset creation module 101 includes a mixing ratio generator 111, a bulk cell creator 112, and a learning data creator 113.
The mixing ratio generator 111 generates the virtual mixing ratio data 212 indicating the virtual mixing ratio of each cell type contained in the bulk cell. At this time, the mixing ratio generator 111 generates a plurality of pieces of virtual mixing ratio data 212.
The bulk cell creator 112 creates, for each piece of virtual mixing ratio data 212, the virtual bulk cell expression level data 213 indicating the gene expression levels in the virtual bulk cell from the gene expression level data 211 of each cell type and the virtual mixing ratio data 212.
The learning data creator 113 creates, for each piece of virtual mixing ratio data 212, a set of the virtual bulk cell expression level data 213 and the virtual mixing ratio data 212 as the learning data 214. As a result, the learning dataset 215 made up of a plurality of pieces of learning data 214 is created. Note that, in the example shown in
The learning module 102 executes the learning process. That is, the learning module 102 updates parameters of the neural network based on each piece of learning data 214 included in the learning dataset 215. This causes the neural network to learn to implement the predictor.
The prediction module 103 is a predictor implemented by the learned neural network and executes the prediction process. That is, the prediction module 103 outputs, upon receipt of bulk cell expression level data indicating the gene expression levels in the bulk cell as input, mixing ratio prediction data indicating a predicted value of the mixing ratio of each cell type contained in the bulk cell.
Note that, in the example shown in
Next, a description will be given of a hardware configuration of the mixing ratio prediction device 10 according to the embodiment of the present invention with reference to
As shown in
The input device 201 is, for example, a keyboard, a mouse, or a touch screen and is used by a user to input various operations. The display device 202 is, for example, a display and displays various process results from the mixing ratio prediction device 10. Note that the mixing ratio prediction device 10 need not include at least either the input device 201 or the display device 202.
The external I/F 203 is an interface with an external device. Examples of the external device include a recording medium 203a and the like. The mixing ratio prediction device 10 is capable of reading from or writing to the recording medium 203a and the like via the external I/F 203. The recording medium 203a may record at least one program and the like by which each function module (that is, the dataset creation module 101, the learning module 102, and the prediction module 103) of the mixing ratio prediction device 10 is implemented.
Examples of the recording medium 203a include a flexible disk, a compact disc (CD), a digital versatile disk (DVD), a secure digital (SD) memory card, and a universal serial bus (USB) memory card.
The communication I/F 204 is an interface for connecting the mixing ratio prediction device 10 to a communication network. At least one program by which each function module of the mixing ratio prediction device 10 is implemented may be acquired (downloaded) from a predetermined server device or the like via the communication I/F 204.
The RAM 205 is a volatile semiconductor memory that temporarily retains the program and data. The ROM 206 is a non-volatile semiconductor memory capable of retaining the program and data even when power is removed. The ROM 206 stores, for example, settings on an operating system (OS) and settings on the communication network.
The processor 207 is a processor such as a central processing unit (CPU) or a graphics processing unit (GPU) that loads a program and data from the ROM 206, the secondary storage device 208, or the like onto the RAM 205 and executes a corresponding process. Each function module of the mixing ratio prediction device 10 is implemented, for example, by the processor 207 executing at least one program stored in the secondary storage device 208. The mixing ratio prediction device 10 may include both the CPU and the GPU as the processor 207, or alternatively, may include only either the CPU or the GPU.
The secondary storage device 208 is a non-volatile storage device such as a hard disk drive (HDD) or a solid state drive (SSD) that stores the program and data. In the secondary storage device 208, for example, the OS, various application software, at least one program by which each function module of the mixing ratio prediction device 10 is implemented, and the like are stored.
The mixing ratio prediction device 10 according to the embodiment of the present invention that has the hardware configuration shown in
Next, a description will be given of the learning dataset creation process with reference to
First, the dataset creation module 101 acquires the gene expression level data of each cell type (step S101). Herein, when the total number of gene types is denoted by M, and the total number of cell types is denoted by N, gene expression level data xn of a cell type n (1≤n≤N) is represented by an M-dimensional vector. That is, with the expression level of a gene M (1≤m≤M) in the cell type n denoted by xmn, the gene expression level data xn is represented as xn=(x1n, . . . , xMn)t. Note that t denotes transpose.
As such gene expression level data of each cell type, for example, LM22 dataset may be used. The LM22 dataset is a set of data that results from measuring the expression levels of 547 types of genes in each of 22 types of homogeneous immune cells. For details of the LM22 dataset, refer to, for example, “Robust enumeration of cell subsets from tissue expression profiles”, Aaron M. Newman et al., Nature Methods 2015 May; 12(5): 453-457. In addition to the LM22 dataset, the gene expression level data of each cell type can also be obtained through, for example, single-cell RNA-Seq analysis.
The following description will be given on the assumption that gene expression level data x1, . . . , xN in which expression levels of M types of genes in N cell types are represented by an M-dimensional vector has been input.
The mixing ratio generator 111 of the dataset creation module 101 generates a plurality of pieces of virtual mixing ratio data (step S102). Herein, when the number of pieces of generated virtual mixing ratio data is denoted by P, the p(1≤p≤P)-th virtual mixing ratio data ap is represented by an N-dimensional vector (that is, a vector having dimensions as many as the total number of cell types). That is, with a mixing ratio of the cell type n (1≤n≤N) contained in the bulk cell denoted by anp, the virtual mixing ratio data ap is represented as ap=(a1p, . . . , aNp)t. Therefore, the mixing ratio generator 111 generates, for each p, random numbers a1p, . . . , aNp that satisfy a1p+ . . . +aNp=1 and that each fall within a range of 0 to 1 to generate P pieces of virtual mixing ratio data a1, . . . , ap. Note that P may be any natural number determined by the user.
Next, the bulk cell creator 112 of the dataset creation module 101 creates, for each piece of virtual mixing ratio data, virtual bulk cell expression level data from the gene expression level data of each cell type and the virtual mixing ratio data (step S103). Herein, the bulk cell creator 112 performs, with the gene expression level data x1, . . . , xN of each cell type represented as a matrix X=(x1, . . . , xN) that is a column vector, for example, a matrix product with the matrix X and the virtual mixing ratio data ap to create the virtual bulk cell expression level data yp. That is, the bulk cell creator 112 calculates yp=Xap for p=1, . . . , P. As a result, M-dimensional vectors y1, . . . , yp are obtained. Each yp represents the expression levels of M types of genes in the virtual bulk cell p.
Note that the bulk cell creator 112 may calculate yp=Xbp using virtual mixing ratio data bp that results from normalizing values obtained by multiplying the virtual mixing ratio data ap by predetermined noise to create the virtual bulk cell expression level data yp. The virtual mixing ratio data bp is created by, for example, multiplying each element anp (1≤n≤N) of ap by the predetermined noise (for example, salt pepper noise, lognormal noise, etc.) and then performing normalization such that the sum of the elements anp (1≤n≤N) multiplied by the noise is equal to 1.
Note that when the virtual bulk cell expression level data yp=Xbp based on the virtual mixing ratio data bp described above is created, the learning data creator 113 sets, for p=1, . . . , P, a set (yp, ap) of the virtual bulk cell expression level data yp=Xbp and the virtual mixing ratio data ap before being multiplied by the noise as learning data.
As described above, in the mixing ratio prediction device 10 according to the embodiment of the present invention, a learning dataset D={(yp, ap)|p=1, . . . , P} is created from the gene expression level data (for example, LM22 dataset, etc.) of each cell type obtained through actual measurement. Herein, as described above, yp denotes data indicating the gene expression levels in the virtual bulk cell, and ap denotes data indicating the mixing ratio of each cell type contained in the virtual bulk cell (that is, target variable data). As will be described later, this learning dataset D is used to cause the neural network to learn to implement the predictor.
Note that, in step S101 described above, a plurality of pieces of gene expression level data of the same cell type may be input. For example, gene expression level data x1 and x1′ of a cell type i may be input. In this case, it may be required that the above-described steps S103 and S104 be executed on gene expression level data x1, . . . , xi, . . . , xN and gene expression level data x1, . . . , xi′, . . . , xN. As a result, learning datasets D={(yp, ap)|p=1, . . . , P} and D′={(yp′, ap)|p=1, . . . , P} are created. Therefore, in this case, these learning datasets D and D′ may be used to cause the neural network to learn to implement the predictor. The same applies to a case where three or more pieces of gene expression level data of the same cell type are input.
Next, a description will be given of a learning process with reference to
First, the learning module 102 inputs the learning dataset D={(yp, ap)|p=1, . . . , P} (step S201).
Next, the learning module 102 calculates an error using a predetermined error function by using each piece of learning data (yp, ap) contained in the learning dataset D (step S202). That is, the learning module 102 inputs the virtual bulk cell expression level data yp into the prediction module 103 (that is, an unlearned neural network) and obtains output data ap{circumflex over ( )} indicating the mixing ratio of each cell type contained in the virtual bulk cell p. Then, the learning module 102 calculates an error between the output data ap{circumflex over ( )} and the target variable data ap using the predetermined error function. Herein, as the error function, for example, softmax cross entropy, mean squared error, or the like is used.
Next, the learning module 102 updates the parameters of the neural network based on the error calculated in step S202 described above (step S203). That is, the learning module 102 updates the parameters by using, for example, backpropagation or the like to minimize the error. This causes the neural network to learn to implement the predictor.
As described above, the mixing ratio prediction device 10 according to the embodiment of the present invention is capable of acquiring the learned neural network by which the predictor is implemented.
Next, a description will be given of a prediction process with reference to
The prediction module 103 inputs bulk cell expression level data y (step S301). Note that the bulk cell expression level data y can be obtained, for example, through measurement of gene expression levels in the bulk cell by a known method (for example, analysis using DNA microarray, RNA-Seq analysis, etc.).
Next, the prediction module 103 causes the predictor to predict a mixing ratio of each cell type contained in the bulk cell corresponding to the bulk cell expression level data y and outputs mixing ratio prediction data a indicating the predicted mixing ratios (step S302). As a result, the mixing ratio prediction data a in which the mixing ratios of N cell types are represented by an N-dimensional vector is obtained.
As described above, the mixing ratio prediction device 10 according to the embodiment of the present invention can obtain the mixing ratio prediction data a from the bulk cell expression level data y. As described above, unlike the experiment using cell counter in the related art, the mixing ratio prediction device 10 according to the embodiment of the present invention can directly predict the mixing ratio of each cell type contained in the bulk cell from the gene expression levels in the bulk cell.
A description will be given below of a comparison example of prediction accuracy between a method in the related art and the method according to the embodiment of the present invention with reference to
In the example shown in
This shows that the mixing ratio prediction device 10 according to the embodiment of the present invention can predict the mixing ratio with high accuracy compared to the method in the related art such as CIBERSORT.
As described above, the mixing ratio prediction device 10 according to the embodiment of the present invention is capable of predicting, with the predictor implemented by the learned neural network, the mixing ratio of each cell type contained in the bulk cell from data indicating the gene expression levels in the bulk cell. In order to cause this predictor to learn, the mixing ratio prediction device 10 according to the embodiment of the present invention generates, from data indicating the gene expression levels of each cell type, the learning data which is a set of data indicating the gene expression levels in the virtual bulk cell and data indicating the mixing ratio of each cell type contained in the virtual bulk cell.
Therefore, the mixing ratio prediction device 10 according to the embodiment of the present invention is capable of easily creating the learning dataset even when it is difficult to measure the gene expression levels in the bulk cell and the mixing ratio of each cell type contained in the bulk cell by experiment or the like.
Further, the mixing ratio prediction device 10 according to the embodiment of the present invention is capable of predicting the mixing ratio with high accuracy by using the predictor learned as described above even when, for example, the gene expression level cannot be estimated to have linearity. Herein, a case where the gene expression level can be estimated to have linearity corresponds to a case where the gene expression level in the bulk cell can be expressed by the sum of the products of the gene expression level in each cell type and the mixing ratio of the cell type (further including a case where the gene expression level in the bulk cell can be expressed by the sum of the above-described sum and the term representing noise).
Note that, according to the embodiment of the present invention, the case of predicting the mixing ratio of each cell type contained in the bulk cell has been described, but the present invention is applicable to not only such a case, but also a case of, for example, predicting the mixing ratio of each component contained in an unknown chemical substance. Further, the embodiment of the present invention is applicable to any task of estimating the mixing ratio of each unknown signal in an issue setting where a signal representing a pure object (or element) can be obtained.
Further, according to the above-described embodiment, the dataset creation module 101 is provided in the mixing ratio prediction device 10, but the present invention is not limited to such a configuration. That is, the dataset creation module 101, the learning module 102, and the prediction module 103 may be provided separately as a dataset creation device, a learning device, and a prediction device, respectively.
The present invention is not limited to the embodiment disclosed in detail above, and various modifications or changes can be made without departing from the scope of the claims.
10 mixing ratio prediction device
101 dataset creation module
102 learning module
103 prediction module
111 mixing ratio generator
112 bulk cell creator
113 learning data creator
Number | Date | Country | Kind |
---|---|---|---|
2018-124385 | Jun 2018 | JP | national |
This application is a continuation of International Application No. PCT/JP2019/025676, with an international filing date of Jun. 27, 2019, which claims priority to Japanese Patent Application No. 2018-124385 filed on Jun. 29, 2018, each of which is incorporated herein by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2019/025676 | Jun 2019 | US |
Child | 17134802 | US |