This invention relates generally to protein structure alignment. More particularly, the present invention relates to identification, classification and prediction of protein structures.
Proteins fold into a three-dimensional structure. The folding of a protein is determined by the sequence of amino acids and the protein's environment. Aligning proteins is a subject of utmost relevance. It enables the study of functional relationship between proteins. It also is very important for homology and threading methods in structure prediction. Furthermore, by grouping protein structures into fold families and subsequent tree reconsideration, ancestry and evolutionary issues may get unrevealed. An example of the importance of identifying protein structures can be illustrated by the comparison of DNA binding homeodomains from two organisms separated by more than 1 billion years of evolution. The yeast α2 protein and the Drosophilla engrailed protein, for example, are both regulatory proteins in the homeodomain family. Because they are identical in only 17 of their 60 amino acid residues, their relationship became certain only when their three-dimensional structures were compared.
Structure alignment amounts to matching two three-dimensional structures such that potential common substrates, e.g. α-helices, have priority. The latter is accomplished by allowing for gaps in either of the chains. Also the possibility of permuting sites within a chain may be beneficial. At first sight, the problem may appear very similar to sequence alignment, as manifested in some of the vocabulary (gap costs, etc.). However, from an algorithmic standpoint there is a major difference since the minimization problem is not trivial due to rigid body constraints. Whereas sequence alignment can be solved within polynomial time using dynamical programming methods (e.g. Needleman S. B. & Wunsch C. D. (1971) Identification of homologous core structures. Proteins 35:70-79), this is not the case for structure alignment algorithms since rigid bodies are to be matched according to these constraints. Hence, for all structure alignment algorithms the scope is limited to high quality approximate solutions.
Existing methods for structure alignment fall into two broad categories, depending upon whether one (1) directly minimizes the inter-atomic distances between the structures, or (2) minimizes the distance between substructures that are either pre-selected or supplied by an algorithm involving intra-atomic distances.
One approach is an iterative dynamical programming method (e.g. Laurants D.V. et al. (1993) Structural similarity of DNA-binding domains of bacteriophage repressors and the globin core. J. Mol. Biol. 3:141-148; and Gerstein M. & Levitt M. (1996) Using iterative dynamic programming to obtain accurate pairwise and multiple alignments of protein structures. In: Proceedings of the 4th International Conference on Intelligent Systems in Molecular Biology, Menlo Park, Calif.: AAAI Press). In this approach one first computes a distance matrix between all pairs of atoms (e.g. Cα) forming a similarity matrix, which by dynamical programming methods gives rise to an assignment matrix mimicking the sequence alignment procedure. One of the chains is then moved towards the other by minimizing the distance between assigned pairs. This method does not allow for permutations, since the internal ordering is fixed by construction. In another inter-atomic approach the area rather than the distances between two structures is minimized (e.g. U.S. Pat. No. 5,878,373). In yet another approach, one compares distance matrices within each other of the two structures to be aligned, which provide information about similar structures (e.g. Holm L. & Sander C. (1993) Protein structure comparison by alignment of distance matrices. J. Mol. Biol. 233:123-138; and Lu G. (2000) A new method for protein structure and similarity searches. J. Appl. Cryst. 33:176-183). The similar structures are subsequently matched. In these methods, for instance by Holm & Sander as well as by Lu, permutations can in principle be dealt with.
However, there are implementation issues shared by both types of methodologies mentioned above. One is structure encoding (Cα and/or Cβ of the chains). For many methodologies Cα appears to be sufficient, whereas in some cases Cβ is needed. Also, the choice of distance metric is a subject of concern in order to avoid the influence of outliers.
The present methods are useful in certain types of problems of protein structure alignment and less useful in others. Some methods only partially explore the space of possible alignments or lack the ability to handle permutations efficiently. In addition, as mentioned above, the minimization problem for protein structure alignment is non-trivial due to the rigid body constraint. Accordingly there is a need to develop a general method that not only provides an acceptable solution for the minimization problem, but also has a high assurance of protein structure alignment and prediction and thereby applicable to a variety of problems.
This invention relates generally to protein structure alignment. More particularly, the present invention relates to identification, classification and prediction of protein structures. The present invention involves two key ingredients. First, an energy or cost function formulation of the problem simultaneously in terms of binary (Potts) assignment variables and real-valued atomic coordinates. Second, a minimization of the energy or cost function by an iterative method, where in each iteration (1) a mean field method is employed for the assignment variables and (2) exact rotation and/or translation of atomic coordinates is performed, weighted with the corresponding assignment variables.
In accordance with exemplary embodiments of the present invention, a method is provided with a plurality of steps with the purpose of aligning two three-dimensional protein structures. In that respect the method receives a first protein with N1 atoms and a second protein with N2 atoms. An initial alignment of the atoms of the first protein to the atoms of the second protein is made. Once the initial alignment is made, all atomic distances between the coordinates of the atoms of the first protein and the atomic coordinates of the atoms of the second protein can be calculated. These distances could be represented in any type of distance matrix using the real-valued atomic coordinates. Subsequently, the present invention provides for a mechanism to define a matrix with a plurality of binary assignment variables wherein each binary assignment variable corresponds to either a match or to a gap (i.e. not a match). Upon defining the binary assignment variables, the present invention defines one or more mean field equations wherein the plurality of binary assignment variables are now replaced by a plurality of continuous mean field variables, whereby each mean field variable has assigned a value between 0 and 1. The mean field equations also include a plurality of forces that are proportional to the atomic distances squared. The present invention provides for the formulism of an energy function wherein four different costs are included. First, the energy function includes a cost for each atomic distance wherein the distance is based on a weighted body transformation using the continuous mean field variables of the first protein while keeping the second protein fixed. Second, the energy function includes a cost λ for each gap that is created by either the first protein or the second protein. Third, the energy function includes a cost 67 for a position-independent consecutive gap that is created. Finally, fourth, the energy function includes a cost for enforcing a constraint to satisfy that each atom of the first protein either aligns with the atom of the second protein or to a gap. In addition, an optional fifth cost could be included in the energy function to discourage any crossed matches. The energy function is minimized by an iterative process wherein the continuous mean field variables are updated using the mean field equations for a decreasing set of temperatures T until convergence to a predefined convergence value is reached. Once the iterative process has been completed, i.e. after convergence, the continuous mean field variables are rounded of to either 0 or 1.
In view of that which is stated above, it is the objective of the present invention to provide for an extensive search of all possible alignments, including those involving arbitrary permutations. It is another objective of the present invention to allow for arbitrary weighting of a selected atom site assignment. It is yet another objective of the present invention to demand a match between selected amino acids in desirable geometric arrangements for certain biological functionality. It is still another objective of the present invention to provide for methods so that by adjusting the gap cost parameters for each site, the method can find matches of selected segments of the protein chains. It is still another objective of the present invention to provide for the inclusion of user prescribed constraints. It is another objective of the present invention to allow for a probabilistic interpretation of the results. The advantage of the present invention over the prior art is that it provides a generic and flexible method which is able to handle protein permutations efficiently.
The objectives and advantages of the present invention will be understood by reading the following detailed description in conjunction with the drawings, in which:
Although the following detailed description contains many specifics for the purposes of illustration, anyone of ordinary skill in the art will readily appreciate that many variations and alterations to the following exemplary details are within the scope of the invention. Accordingly, the following preferred embodiment of the invention is set forth without any loss of generality to, and without imposing limitations upon, the claimed invention.
Algorithm 1
The present invention can be understood according to the following exemplary embodiments in which there are two proteins, protein 1 and protein 2 with respectively N1 and N2 atoms, that are to be structurally aligned. In the general sense of the present invention, the structural alignment is accomplished by a series of weighted rigid body transformations of the first chain, keeping the second chain fixed. The atom coordinates of the first and the second chain of protein 1 and 2, respectively, is denoted by xi (i=1, . . . , N1) and yj (j=1, . . . , N2). The word “atom” will be used throughout this description in a generic sense—it could represent individual atoms but also groups of atoms. In the present exemplary embodiment, it could mean Cα atoms along the backbone. It could also mean e.g. center-of-mass of side-chain atoms. A square distance metric between the chain atoms is used according to EQ. 1, for instance
dij2=|xi−yj|2 (1)
but the formalism is not confined to this choice. In general, any distance metric could be used as long as it provides a measure for all distances between the atom coordinates of the first and second chain of protein 1 and 2. In the description of the present invention that follows, first the encoding method and energy (or cost) function is discussed using Algorithm 1, including a discussion of the method for minimizing this energy function. In addition, the description will distinguish a gapless case wherein all atoms of the first and second chain are matched with each other versus a gapped case wherein it is allowed to have a gap in either of the chains meaning that an atom in for instance the first chain is not connected to the second chain. Finally, an alternative way for calculating the energy function is provided in Algorithm 2 which is more efficient for alignments where no permutations are expected.
Gapless Case
To better illustrate the present invention, the discussion will start off with the gapless case with N1=N2. First binary assignment variables sij are defined, such that sij=1 if atom i in one chain matches j in the other chain and sij=0 otherwise. Since every atom in one chain must match one atom in the other, the following conditions must be fulfilled:
A suitable energy function to minimize subject to the above constraints (EQS. 2 and 3) is
where the spatial degrees of freedom, xi, are contained in the distance matrix d2ij. Thus whenever sij=1 one adds a penalty d2ij to Echain. Note that EQ. 4 is to be minimized both with respect to the binary variables sij and the real-valued coordinates xi.
Gapped Case
Allowing for gaps in either of the chains is implemented by extending sij to include 0-components in a compact way; si0=1 and s0j=1 if an atom (i˜or˜j) in one chain is matched with a gap in the other and vice versa. Hence, gap positions are not represented by individual elements in sij; rather the gap-elements correspond to common sinks. The matrix S, with elements sij, containing gap-elements is shown in EQ. 5.
Some caution is needed when generalizing EQS. 2 and 3 to host gaps, since the elements of the first row and column (gap-mappings containing the index 0) in EQ. 5 differ from the others in that they need not sum up to 1. Hence EQS. 2 and 3 become
where the first condition can be written as
An illustrative example of the encoding (sij) of matches and gaps is shown in
For instance, s01 as indicated by 230 is 0 which means that the particular atom (i.e. j=1) in chain J has a match, whereas s50 as indicated by 240 is 1 which means that the particular atom (i.e. i=5) in chain I is matched with a gap. This latter example is also shown in
In
Assuming a constant penalty per inserted gap one has the error function
where λi(1) is the cost for matching atom i in the first chain with a gap in the second chain, and similarly for λj(2). The position dependence of the gap costs, λi(1) and λj(2), originates from the fact that it is desirable not to break α-helix and β-strand structures.
In EQ. 8 the gap penalties are proportional to gap lengths. In sequence alignment it is conjectured that gap penalties consist of two parts; (1) a penalty for opening a gap and then (2) a penalty proportional to the gap length. The present invention includes a similar gap cost philosophy as presented by Gerstein & Levitt (Gerstein M. & Levitt M. (1996) Using iterative dynamic programming to obtain accurate pairwise and multiple alignments of protein structures. In: Proceedings of the 4th International Conference on Intelligent Systems in Molecular Biology, Menlo Park, Calif.: AAAI Press), i.e. λi(1) and λj(2) for opening a gap and a position-independent λ per consecutive gap. Hence, EQ. 8 generalizes to
where products like si−1,0 si0 are 1 if two adjacent atoms are matched to gaps.
In addition, it may also be desirable to discourage “crossed” matches. Cross matches are matches in which i is matched to j, and (i+1) is matched to k, where k<j, or matches in which (i−1) is matched to k, where k>i. This could be accomplished by adding the term according to
where ω is defined as the strength of this penalty term.
Minimization
The next aspect that is needed is an efficient procedure for minimizing E with respect to both sij and xi subject to the constraints in EQS. 6 and 7. As mentioned above, this minimization problem is non-trivial due to the rigid body constraint. Earlier in 1992, Ohlson et al. probed that a mean field approximation could be used for fitting structures with relevance factors in case of track finding problems with a template approach (Ohlson M., Peterson C. & Yuille A. L. (1992) Track finding with deformable templates—the elastic arms approach. Comp. Phys. Comm. 71:77-98).
In the present invention, a mean field approximation approach is integrated, however this mean field method is different from any previously mentioned mean field approaches (see e.g. Blankenbecler R. (1994) Deformable templates—revisited and extended—with an OOP implementation. Comp. Phys. Comm. 81:318-344, 1994). In the paper by Blankenbecler (1994), the assignment matrix, S(ij), although as they are also denoted by v(ij) and V(ij), assigns a “hit” (spark) in a particle detector to track a mathematical curve representing the path of the high energy particle. In the present invention, the mean field approach is employed for a protein matching case in which it assigns for instance a carbon alpha (atom) in one chain to a carbon alpha (atom) in another chain. During the iteration/calculation, while the v's are not exactly zero or one, they can be interpreted as the “probability” that atom i in one chain is assigned to atom j in the other chain. For an introduction on the mean field approach one could refer to the paper by Peterson C. & Soderberg B. (1989) A new method for mapping optimization problems onto neural networks, Int. J. Neural. Syst. 1:3-22.
In the formulation of the present invention, the inherent optimization difficulty resides in the binary part (sij) of the problem. Hence, minimizing EQ. 9 using a simple updating rule for sij will very likely yield poor solutions due to local minima. Well known stochastic procedures such as simulated annealing (e.g. Kirkpatrick S., Gelatt C. D. & Vecchi M. P. (1983) Optimization by simulated annealing. Science 220:671-680) for avoiding these local minima are too costly from a computational standpoint. In the mean field approach of the present invention, the philosophy behind simulated annealing is retained, but the tedious simulations are replaced by an efficient deterministic process. The binary variables sij are then replaced by continuous mean field variables υij, whereby υij is a value between 0 and 1, with a dynamics given by iteratively solving the mean field equations for a decreasing set of temperatures T down to T0, where most of the υij approach either 1 or 0. These continuous mean field variables can evolve in a space not accessible to the original intermediate variables. The intermediate configurations at non-zero T have a natural probabilistic interpretation.
For sij satisfying EQ. 6, the mean field equations for the corresponding υij read
where the force uij is given by
and is computed by substituting sij with vij in E (EQ. 9). Note that the desired normalization condition, EQ. 6
is fulfilled automatically in EQ. 11. The other condition (EQ. 7) is enforced by adding a penalty term
where γ is a parameter and the last equality follows from the fact that υ2ij=υij for T=0.
So far the description only described the assignment part when minimizing the error function. When updating the mean field variables υij, using the mean field equations, the distance measure d2ij is a fixed quantity. This corresponds to having the chains at fixed positions. However, the present invention also includes the step to minimize the distance between the two chains. Based on the probabilistic nature of the mean field variables, the chain positions are updated using the (probabilistic) assignment matrix V, with elements υij. This is done simultaneously with the updating of υij. Explicitly, one of the chains will be moved in order to minimize the chain error function Echain (EQ. 4).
The distance measure d2ij depends on the translation vector a and the rotation matrix R making a total of six independent variables. Let x′i be the coordinates of the translated and rotated protein, i.e. x′i=a+R xi,then
This minimization problem can be solved exactly with closed-form expressions for R and a that minimizes Echain as was pointed out by Neuman (1937) in a paper entitled “Some matrix-inequalities and metrization of matric-space” in Tomsk. Univ. Rev. vol. 1, pp. 286-300. It should be noted that this solution is rotationally invariant (independent of R) for the special case when the atoms in the two chains matches each other with the same weight, i.e. when vij=constant for all i and j, which is the case for high T.
In summary, for a decreasing set of temperatures T, one iterates until convergence:
It is stressed that in the present invention, step 2, i.e. the translation and rotation of the chain, is done with the probabilistic mean field assignment variables υij and not with the binary variables, sij. After convergence, υij are rounded off to 0 or 1 and rms (root-mean-square-distance) is computed for the matching pairs. An exemplary detail of the algorithmic details can be found in the next subsection.
The forces uij entering EQ. 11 are proportional to d2ij (EQS. 4 and 12). It is the ratio d2ij/T that counts. Hence, for large temperatures T, υij is fairly insensitive to dij and many potential matching pairs (i,j) contribute fairly evenly. As the temperature is decreased, a few pairs (the ones with small dij are singled out and finally at the lowest T only one winner remains. One can view the situation as that around each atom i one has a Gaussian domain of attraction, which initially (large T) has a large width, but gradually shrinks to a small finite value.
The probabilistic of the approach is shown in
An illustrative example of the alignment is shown in
Algorithm 2
In this section an alternative formulation of the energy function will be described. This alternative algorithm, called Algorithm 2, is more efficient for alignments where no permutations are expected than Algorithm 1. Algorithm 2 can be described as a shortest path algorithm with a varying distance matrix. In that case, the energy function that is to be minimized is now
E=Σi,j Di,j (16)
The Di,j elements are referred to as the optimal alignment energy cost elements from point (ij) to the “end” of the protein chain. These elements are computed by the following scheme
Di,j=Vi,j1(Di,(j+1)+λj2+Vi,(j+1)1(δ−λj2))+Vi,j2(Di+1),(j+1)+di,j2)+Vi,j3(D(i+1),j+λj1+V(i+1),j3(δ−λj1)) (17)
In these EQS. 16 and 17, the various quantities are basically extensions of the parameters introduced and discussed in Algorithm 1 above. The various quantities as in EQ. 17 are defined as
Using the alternative formulation, the mean field variables are now updated by updating equations
ui,j1=(Di,(j+1)+λj2+Vi,(j+1)1(δ−λj2))
uij2=(D(i+1),(j+1)+di,j2)
ui,j3=(D(i+1),j+λj1+V(i+1),j3(δ−λj1)) (18)
As will also become clear in the subsequent section where both algorithm 1 and 2 are listed and compared, the Potts mean variables are now updated similar as in Algorithm 1, namely
and finally, the matching or assignment matrix is given by
Matching Matrix=Si,j=Pi,jVi,j2 (20)
In other words, this means that the probability for matching (ij) is equal to the product of the probability of ending up at position (ij) and the probability of matching that particular pair.
Implementation
The method presented in the present invention can be applied to, but is not limited to, different types of proteins each with its own type of difficulty in terms of structure alignment. For instance, Dihydrofolate Reductases which contain (α- and β-proteins that have mainly parallel beta sheets, Globins that are all-α, Plastocyanin/azurin and Immunoglobulins which are both are proteins that all-β, and Permutated (winged helix fold) proteins. The latter example is a protein group that is considered difficult and where iterative dynamical programming will fail. In the next sections examples are provided for implementation of the algorithm and the parameters involved. This section contains three parts, i.e. parameters, initialization, and iteration steps.
Parameters
In general, two kind of parameters are used; the ones related to the encoding of the problem (γ) and iteration dynamics (ε), where ε governs the annealing schedule as shown in the Table 1 below, and the ones specifying gap costs (λ, δ). The same set of parameters can be used for most of the pairs as shown in the Table 1 below. The first protein family shown in Table 1 involves 27 pairs, whereas the others one each. The algorithm is remarkably stable. The value of λ for each carbon alpha site is chosen to reflect the importance of the surrounding substrate structure, such as an (α-helix, β-sheet, and others. Sheet and helix refer to secondary structure assignment for each Cα atom.
Initialization
An initialization of the chains is made prior to the mean field alignment. First both chains are moved to their common center of mass. For a random initialization, this move is then followed by a random rotation of one of the chains. Most of the times, however, a sequential initialization is used that consists of minimizing EQ. 4 using a band-diagonal assignment matrix S. This corresponds to a situation where, on the average, atom i in one of the chains is matched to atom i in the other.
Iteration Steps
The following describes a preferred way of defining the algorithm steps as shown in FIGS. 4. However, the algorithm steps could be altered in various ways as long as step 6 through 8 in algorithm 1 and 2 are followed in the order shown in
As shown in
Updating Steps for Algorithm 1
11. Repeat items 5-10 until all υij are close to 1 or 0 (defined e.g. by 1/N1Σijυij2≧0.99), indicated by 4110 in
As also shown in
Updating Steps for Algorithm 2
11. Repeat items 5-10 until all υij are close to 1 or 0 (defined e.g. by 1/N1Σijυij2≧0.99), indicated by 4110 in
12. Finally, the mean field solution is given by the integer limit of υij i.e. for each row i, i=1, . . . , N1 select the column j* such that υij * is the largest element for this row. Let sij*=1 and all other sij=0 for this row. As indicated by 4120 in FIG. 4.
It is important to note that while the present invention has been described in the context of a fully functional data processing system and method, those skilled in the art will appreciate that the mechanism of the present invention is capable of being distributed in the form of a computer readable medium of instructions in a variety of forms, and that the present invention applies equally regardless of the particular type of signal bearing medium used to actually carry out the distribution. In other words, the present invention is also a program storage device accessible by a computer, tangible embodying a program of instructions or means executable by the computer to perform method steps for protein structure alignments. Examples of computer readable medium include: recordable type media such as floppy disks and CD-ROMS and transmission type media such as digital and analog communication links. In addition, the present invention could be implemented and coded in different programming languages such as, but not limited to, for example C and C++ programming languages, JAVA or Java script, or DHTML
The present invention has now been described in accordance with several exemplary embodiments, which are intended to be illustrative in all aspects, rather than restrictive. Thus, the present invention is capable of many variations in detailed implementation, which may be derived from the description contained herein by a person of ordinary skill in the art. All such variations are considered to be within the scope and spirit of the present invention as defined by the following claims and their legal equivalents
This application is cross-referenced to and claims priority from provisional U.S. application 60/194,203 filed Apr. 3, 2000 which is incorporated herein by reference.
This invention was supported in part by grant number DE-AC03-76SF00515 from the U.S. Department of Energy. The U.S. Government has certain rights in the invention.
Number | Name | Date | Kind |
---|---|---|---|
5642292 | Itai et al. | Jun 1997 | A |
5866343 | Blom et al. | Feb 1999 | A |
Number | Date | Country | |
---|---|---|---|
20020111781 A1 | Aug 2002 | US |
Number | Date | Country | |
---|---|---|---|
60194203 | Apr 2000 | US |