The present invention relates generally to methods and apparatuses for producing performance attribution for investment portfolios. In particular, the invention concerns a machine for displaying factor-based performance attribution (PA) results for a set of historical investment portfolios using a framework that computes the attribution using a set of factor mimicking portfolios (FMPs). By considering different constraints, universes, and rebalance frequencies for the FMPs, different PA results may be advantageously obtained. One aspect of the machine of the present invention enables portfolio managers to obtain actionable information concerning the sources of his or her investment returns. Another aspect of the machine of the present invention enables the identification of advantageous FMPs for automating PA. Another aspect of the machine of the present invention associates advantageous FMPs to different portfolio managers in order to characterize each manager's investment performance and investment style in terms of FMP characteristics.
Factor-based performance attribution results are often misleading due to correlation between the factor and specific contributions. Ideally, the correlation between the factor and specific correlations should be low. The present invention provides an improved FMP framework to perform PA in which the correlation of factor and specific contributions is reduced in magnitude.
An improved graphical user interface permits a portfolio manager or a manager of portfolio managers to readily create, display and select a preferred PA using FMPs that provides the most intuitive and actionable information concerning the sources of the portfolio's return.
Factor-based performance attribution (PA) has been used in the investment management community for decades to demonstrate the added value of active portfolio management. The methodology typically relies on factor and specific return models to decompose and explain the return of the portfolio in terms of distinct contributions. Often, the factor and specific return models are associated with a factor risk model. The portion of the portfolio return that can be explained by the factors is called the factor contribution. The remainder of the return is called the asset-specific contribution, the specific contribution, or the residual contribution.
By decomposing the historical returns of a portfolio into intuitive factors, one seeks to identify the particular bets or biases in a portfolio that helped or hurt overall performance.
If a fundamental or quantitative portfolio manager constructs a portfolio based on a criterion that is not well explained by the factors employed, then factor-based performance attribution may attribute a significant portion of the return to the specific or residual contribution.
Recent trends in investment management have only increased the importance of factor-based PA. The advent of low cost, “smart” beta exchange traded funds (ETFs) and other factor products allow institutional and individual investors to obtain and maintain desired exposure(s) in their portfolios to intuitive factors simply by buying the appropriate ETF or combination of ETFs. As a result, active portfolio managers have been forced to demonstrate strong evidence that the source of their performance cannot be replicated simply by buying a set of low cost ETFs. Investors are demanding such evidence and scrutinizing it in detail before making their investment decisions. Asset managers have a variety of tools at their disposal, and factor based PA is a key component for making that case.
In traditional factor based PA, one seeks to explain the active return of a portfolio through the lens of a collection of factors that make up a returns model. Specifically, the returns model takes the form
r=Xf+ε, (1)
where r represents the excess returns of the assets, f represents the returns of the factors in the model, X represents the exposures (also called sensitivities) of assets to these factors, and ε is the residual or specific return of the assets; in other words, ε is the return that cannot be explained by the asset's exposures to the factors.
When the returns model, (1), is formulated, one of the central guiding principles is the idea that the specific return ε should be at least approximately uncorrelated with each component of the factor return vector. When the factor returns are estimated by a cross-sectional regression with appropriate weights, the properties of linear regression ensure that ε is exactly uncorrelated with the factor returns at the point in time at which the model is estimated.
Given a portfolio represented by investment weights, w, the portfolio's return can be decomposed into a factor contribution and a specific contribution as follows:
w
T
r=w
T
Xf+w
Tε (2)
The first term on the right-hand side of equation (2), wTXf, is the factor contribution. The second term on the right-hand side of equation (2), wTε, is the specific or residual contribution. Note that the factor contribution can be further decomposed into contribution attributable to individual factors or groups of factors. Another way to interpret the factor contribution, wTXf, is that that each element of the factor return vector f represents the return for a portfolio with a unit of exposure to that factor.
In general, active portfolio managers split into two groups depending on which contribution—factor or specific—is expected to dominate equation (2). Active portfolio managers who develop investment signals based on well-known factors such as value, growth, or momentum would expect most of their performance to be explained by those factors. As a result, for these portfolios mangers, the factor contribution of PA would likely be larger (positive or negative) than the specific contribution. Alternatively, portfolio managers whose expertise is picking individual stocks but have no views on factors would expect the specific contribution to dominate the PA results. By monitoring the relative contributions of the factor and specific components, portfolio managers can quantitatively demonstrate the value of their investment processes. They can also incrementally improve it by making appropriate adjustments.
However, factor-based PA is difficult to interpret when both contributions—factor and specific—are substantial, and especially hard to interpret if they are both substantial but of opposite signs. When this latter circumstance occurs, it is difficult to develop effective strategies for improving the investment process since changes to improve, say, the factor exposures and thereby modify the factor contribution are likely to adversely affect the specific return. It is also hard to demonstrate to a potential investor that a particular investment decision has improved the investment performance. Unfortunately, such results—substantial factor and specific contributions of opposite sign—are commonly encountered using traditional factor-based PA.
Factor-based PA based on models like equation (1) are easy to compute and readily available in many analytic systems. However, one drawback of these systems is that they rely on off-the-shelf, standard return model estimates provided by commercial vendors such as Axioma Inc. (Axioma). These standard return models may not always capture all the factors a portfolio manager uses in his or her investment process. Important but missing factors would likely cause the specific component of PA to be larger than desired. In addition, the universe of investments in the standard models may not be the same as the universe employed by the portfolio manager, and the frequency at which returns are estimated may be different. Also, the portfolio manager may be under several mandated investment constraints (such as being long-only or having a limited amount of turnover) that are not well captured by the standard linear return model.
One solution to these problems has been the introduction of systems that allow portfolio managers to construct customized linear return models and factor risk models. These tools ensure that all the relevant factors are in the linear return model, that the estimation universe matches the universe of the portfolio manager, and that the rebalance frequencies are commensurate. Although custom risk models can significantly improve factor-based PA, they do not always lead to intuitive results. One disadvantage of using a custom risk model is that it requires constructing a complete factor risk model. Such construction can be a labor-intensive and costly process. Furthermore, even with custom risk models, PA results may still prove difficult to interpret.
The present invention takes advantage of three separate but interconnected areas of investment portfolio management: (a) factor risk models; (b) quantitative methods for portfolio construction (e.g., optimization); and (c) performance attribution. Illustrative prior art of each of these areas is addressed briefly below.
First, the prior art concerning factor risk models is addressed. In the present invention, commercial and custom factor risk models may be employed to calculate traditional factor-based PA. They may also serve as a source for a family of relevant factors over which to compute an FMP. They may also be used to estimate the risk or active risk of an investment portfolio.
For over three decades, commercial risk model vendors have sold factor risk models to estimate the risk of a portfolio where risk is the standard deviation of the portfolio returns. Alternatively, these same models may be used to estimate the variance of a portfolio, since variance is the square of the standard deviation. Factor risk models provide an estimate of the asset-asset covariance matrix, Q, which estimates the future covariance of each pair of asset returns using historical return data.
To obtain reliable variance or covariance estimates based on historical return data, the number of historical time periods used for estimation should be of the same order of magnitude as the number of assets, N. Often, there may be insufficient historical time periods. For example, new companies and bankrupt companies have abbreviated historical price data and companies that undergo mergers or acquisitions have non-unique historical price data. As a result, the covariances estimated from historical data can lead to matrices that are numerically ill-conditioned. Such covariance estimates are of limited value.
Factor risk models were developed, in part, to overcome these short comings. Factor risk models represent the expected variances and covariances of security returns using a set of M factors, where M is much smaller than N, that are derived using statistical, fundamental, or macro-economic information or a combination of any of such types of information. For each factor, every asset covered by the factor risk model is given a score. The N by M matrix of factors scores is called the factor exposures or factor loadings. In addition, a factor return is estimated for each factor at each time that the model is re-estimated. Given exposures of the securities to the factors and the covariances of factor returns, the covariances of security returns can be expressed as a function of the factor exposures, the covariances of factor returns, and a remainder, called the specific risk of each security. Factor risk models typically have between 20 and 200 factors. Even with, say, 80 factors and 1000 securities, the total number of values that must be estimated is just over 85,000, as opposed to over 500,000.
A substantial advantage of factor risk models is that since, by construction, M is much smaller than N, factor risk models do not need as many historical time periods to estimate the covariances of factor returns and thus are less susceptible to the ill-conditioning problems that arise when estimating the elements of Q individually.
The commercial importance and expertise required to build high quality factor risk models, as well as, high quality portfolios and trade lists has led to many patented innovations related to factor risk models. These include U.S. Pat. Nos. 7,698,202, 8,315,936, 8,533,089, 8,533,107, and 8,700,516, all of which are assigned to the assignee of the present invention and are incorporated by reference herein in their entirety.
A classic factor mimicking portfolio can be constructed from a matrix of factor exposures taken from a factor risk model. See for example, R. Litterman, Modern Investment Management: An Equilibrium Approach, John Wiley and Sons, Inc., Hoboken, N.J., 2003 (Litterman), which gives detailed descriptions of factor mimicking portfolios and which is incorporated by reference herein in its entirety. Factor mimicking portfolios are designed so that they have exposure to one and only one factor. The exposure to all other factors in the risk model or matrix of factor exposures is zero by construction.
Although traditional FMPs based on the exposure matrix of a factor risk model have been studied for many years, these traditional FMPs suffer disadvantages. For example, most FMPs invest in far too many names—typically, as many names as are available in the universe considered. Hence, for a broad equity benchmark like the Russell 3000 index, each FMP would hold 3000 names. Portfolios with so many names are generally considered uninvestable, as most portfolios limit the number of names held to less than, say, 400 names. Furthermore, many of the positions are short positions, regardless of whether or not the equity is available to short. In general, the fact that most traditional FMPs are uninvestable portfolios in practice is a major drawback. It would be advantageous to create alternative FMPs with investable characteristics.
Next, the prior art for quantitative methods for portfolio construction is addressed, concentrating on optimization approaches for portfolio construction. These approaches are used in the present invention to construct novel FMPs as addressed further herein.
Prior methods for constructing a portfolio of investments with advantageous risk and return characteristics are known. See, for example, Markowitz, in Portfolio Selection: Efficient Diversification of Instruments, Wiley, 1959 (Markowitz) which is incorporated by reference herein in its entirety, developed mean variance optimization (MVO), which is a portfolio construction approach and methodology that is widely used in equity portfolio management.
In MVO, a portfolio is constructed that minimizes the risk of the portfolio while achieving a minimum acceptable level of return. Alternatively, the level of return is maximized subject to a maximum allowable portfolio risk. In traditional mean variance portfolio construction, risk is measured using the standard deviation or variance of possible returns. The family of portfolio solutions solving these optimization problems for different values of either minimum acceptable return or maximum allowable risk is said to form an efficient frontier, which is often depicted graphically on a plot of risk versus return.
There are numerous, well known, variations of MVO that are used for portfolio construction. These variations include methods based on utility functions and the Sharpe ratio.
Portfolio construction procedures often make use of different estimates of portfolio risk, and some make use of an estimate of portfolio return. A crucial issue for these optimization procedures is how sensitive the constructed portfolios are to changes in the estimates of risk and return. Small changes in the estimates of risk and return occur when these quantities are re-estimated at different time periods. They also occur when the raw data underlying the estimates is corrected or when the estimation method itself is modified. Traditional MVO portfolios are known to be sensitive to small changes in the estimated asset return, variances, and covariances. See, for example, J. D. Jobson, and B. Korkei, “Putting Markowitz Theory to Work”, Journal of Portfolio Management, Vol. 7, pp. 70-74, 1981 and R. O. Michaud, “The Markowitz Optimization Enigma: Is Optimized Optimal?”, Financial Analyst Journal, 1989, Vol. 45, pp. 31-42, 1989 and Efficient Asset Management: A Practical Guide to Stock Portfolio Optimization and Asset Allocation, Harvard Business School Press, 1998, (the two Michaud publications are hence referred to collectively as “Michaud”); all of the above cited publications are incorporated by reference herein in their entirety.
Over the many years that MVO and its variants have been commercially employed, a number of practices for constructing portfolios and trade lists using optimization have become standard. As one example, Axioma sells software for constructing portfolios and trade lists that allows portfolio managers to construct portfolios and trade lists that specify general rules and requirements for both the portfolio and the trades. The portfolio can be long only, or it may be long-short. For long-short portfolios, the ratio or leverage between the market value of the short side can be controlled independently or as a function of the market value of the long side. The local universe comprising potential investment assets that may be used to construct the portfolio or trade list can be specified. General grandfathering options are commonly employed to allow the portfolio to hold or keep existing asset investments if they are not in the local universe or do not satisfy constraints that are violated by the initial holdings. In addition, the trade list may or may not allow cross-over (long positions becoming short positions or vice versa), and may or may not use round lotting to restrict the trade or holding sizes to multiples of a fixed numbers of shares. The strategy may also include compliance rules that are specified for subsets of portfolios.
The objective function, which may be minimized or maximized to obtain the optimal portfolio, may include linear terms such as the expected return or alpha. In MVO, the letter M refers to the mean and is the linear tilt of the expected return, sometimes called alpha, which is maximized for the optimal portfolio. The objective function may include tilts or linear terms for the long and short holdings separately. The objective function may include risk terms, which refer to the standard deviation of possible returns, or variance terms, which refer to the square of the standard deviations of possible returns. These risk terms may be computed using the total holdings, or they may be computed using only the active holdings relative to a benchmark of investment holdings. In this case, the risk and variance terms are termed active risk or active variance. In MVO, the letter V refers to variance, either total or active, and is minimized. In many, if not most, cases, a commercial factor risk model is used to estimate the risk or variance of the portfolio. The objective function terms may also include the costs of trading the portfolio. Such costs may include both the costs charged directly as well as indirect market impact costs, such as changes in market prices caused by the trade itself. The objective function may also include terms designed to benefit the portfolio when taxes are considered. Taxable losses may be maximized while taxable gains—both short and long term and for various rates—may be minimized. In modern portfolio and trade list construction software, there is great flexibility to consider different, weighted combinations of these terms in the objective function to compute a desired, optimal portfolio.
The portfolio construction strategy will usually include a set of constraints that must be satisfied by the optimal portfolio or trade list. These constraints may include maximum and/or minimum bounds on the holdings or exposures of the holdings. For instance, the maximum and minimum asset weights in the portfolio may be specified. Or the maximum or minimum net exposure of assets to an industry, sector, or country may be specified. The maximum and minimum net exposure of the portfolio or subsets of the portfolio to general attributes such as market capitalization or average daily traded volume may also be specified as constraints on the portfolio or trade list. Instead of including risk or variance in the objective function, the maximum allowable risk, active risk, variance, or active variance may be specified as a constraint. In addition, the marginal contribution to risk or active risk, which is the derivative of the risk with respect to an asset's weight in the portfolio, may also be given a maximum value. The constraints may impose limits on the kinds and size of trades employed. That is, some assets may not be allowed to trade, while other asset positions may be entirely liquidated. The total transaction cost of trades may be constrained to be less than a maximum allowable amount. The total number of names held or traded may also be constrained. The taxable gains and liabilities for the investment holdings may be constrained.
Of course, with more sophisticated software, the number and variety of possible objective terms and constraints increases.
Third, the prior art concerning factor-based PA is addressed. Litterman provides an entire chapter (Chapter 19) to performance attribution, and summarizes the existing methodologies and practices. According to Litterman, PA is the “process in which sources of a portfolio's return are identified and measured.” In practice, portfolio managers rely on either in-house or commercial systems to perform and report PA results.
In traditional PA, asset returns, either domestic or international, are decomposed against a set of factors. This approach breaks down the overall portfolio return into return contributions driven by those factors, any currency contributions based on currency returns (for international portfolios) and return components or contributions driven by whatever is unexplained by those factors. This unexplained return is called by various names including specific return, idiosyncratic return, stock selection, and residual return or contribution. Apart from the selection of the factors and how they are represented, the decomposition of a portfolio's return at any point in time is normally unambiguous. However, when returns are compounded over time, the additive properties of a point in time are lost unless a linking algorithm is employed. There are several known linking algorithms including the Frank Russell methodology (Litterman) and techniques employing log returns.
Factor contributions are computed as the product of factor returns with the portfolio's weighted exposure to the factor. The specific contribution is computed as the total portfolio contribution (e.g., weighted return) minus all the factor contributions. Contributions have properties similar to returns, in that they can describe a contribution at a point in time, or they can be accumulated into a cumulative contribution over time. Indeed, the two terms, contributions and returns, are often used interchangeably not because they are identical but because they share similar properties.
Ideally, over time, the factor contributions of each factor as well as the combined sum of factor contributions should be uncorrelated with the residual contribution.
The difficulties interpreting traditional PA results have been previously identified, and various solutions have been proposed. One solution is described in R. A. Stubbs and V. Jeet, “Adjusted Factor-Based Performance Attribution”, The Journal of Portfolio Management, Special Issue 2016, and U.S. patent application Ser. No. 14/336,123 filed Jul. 21, 2014, which are incorporated by reference herein in their entirety. In this solution, an iterative regression algorithm is used to re-estimate factor returns for a PA such that the magnitude of the beta of the adjusted factor returns to the adjusted specific return is minimized. This process generally reduces the magnitude of the specific contribution, allowing a clearer interpretation of which factors most affected the overall performance. In this approach, a particular adjustment is made to the factor return model based on the particular portfolio being analyzed. This procedure does not make use of FMPs or attempt to create a generalized adjustment of the returns model that would be useful for more than one set of historical portfolio. Furthermore, this method gives no insight into the characteristics of adjustment made. This limits a portfolio manager's ability to derive unifying characteristics about what kind of PA adjustments work best for his or her investment process.
A different approach to portfolio-based and FMP-based PA is described by R. Grinold, “Attribution,” The Journal of Portfolio Management, Vol. 32 No. 2, pp. 9-22, Winter 2006 and R. Grinold, “The Description of Portfolios,” The Journal of Portfolio Management, Vol. 37 No. 2, pp. 15-30, Winter 2011 (the two Grinold publications are hence referred to collectively as “Grinold”); both of the above cited publications are incorporated by reference herein in their entirety. As with the present invention, a set of portfolios such as FMPs are used to decompose a portfolio's performance (e.g., return) and risk in terms of the performance and risk of a set of portfolios, possibly FMPs, and a residual. In Grinold, the analysis devotes significant effort to various correlation coefficients, which could be the cross-sectional, point-in-time correlation coefficients of different portfolios or their variances. While Grinold decomposes performance into the performance of a set of portfolios and a residual, the similarities end at there. In Grinold, there is no systematic attempt to incorporate various restrictions in the construction of the FMPs including the restriction of the universe of assets used to construct the FMP, the rebalancing frequency for the FMPs, as well as various constraints such as long-only or long/short, risk limits, or turnover limits. As is shown with the extensive examples described herein, these additional restrictions are crucial for obtaining FMP-based PAs with actionable insights. Furthermore, although Grinold presents many correlation coefficients, none of them are correlation coefficients based on a time-series of data. Instead, they are all correlation coefficients based on a point-in-time, cross-sectional distribution the portfolios. Grinold provides no data or discussion about how his results would evolve over time.
Among its several aspects, the present invention recognizes that existing approaches for factor based performance attribution of historical portfolios suffer from important limitations as addressed in detail above and further below. To the end of addressing such limitations, the present invention provides an entirely new framework for performing PA using FMPs.
One general problem considered by the present invention is the fact that standard PA using off-the-shelf risk models may not include all the relevant factors or the appropriate estimation universe and rebalance frequency used by a portfolio manager.
A further problem considered by the present invention is the fact that often portfolio managers must obey mandated constraints on their portfolio such as being long-only or having a maximum allowable turnover that are not well represented by the FMPs implicit in a linear return model.
A further problem considered by the present invention is that in traditional PA, the magnitude of the factor and residual contributions are often of approximately the same size, and often of different sign; for example, one of them is positive while the other is negative. In theory, the residual contribution is intended to be uncorrelated with the factor contribution. However, in practice, the traditional PA residual contribution is often highly correlated with factor contribution. This unwanted correlation makes it difficult to identify actionable trends in the portfolio investment process. Even if factor and residual contributions are uncorrelated, we may still find factor and residual contributions that are significant but of opposite sign. For instance, this can occur if constraints like long-only requirements significantly impact the mean return one can earn by betting on a particular factor.
One goal of the present invention, then, is to provide a machine capable of producing alternative PA using FMPs as taught further herein.
Another goal of the present invention is to provide portfolio managers the opportunity to add and remove factors from a factor based PA to better match the factors used by a portfolio manager and see the results of such changes. In addition, the present invention aims to allow the PA to use the same estimation universe and rebalance frequency used by the portfolio manager.
Another goal of the present invention is to provide a system in which the factors used in PA can be aligned with the constraints imposed on the portfolio manager.
Another goal of the present invention is to provide a metric that can be used to assess the quality or usefulness of a PA. This metric can be used to guide portfolio managers as they seek more intuitive PA results.
Another goal is to provide improved tools for displaying and comparing PA analysis as addressed further herein. In particular, an improved, interactive tool in a graphical user interface is described in detail that can be advantageously employed by a portfolio manager to create useful PA results.
Another goal is to provide an automated machine for searching for, identifying, and presenting the most intuitive PA results for a particular set of historical portfolios.
Another goal is to allow the construction of a database associating FMP characteristics with particular portfolios or portfolio managers. Such a database would be used for identifying managers with a repeatable ability to successfully invest in a particular set of factors. As one example, a large fund such as a university endowment may be broken into a smaller allocation which will be outsourced for management. The university would look for external money managers with (1) a history of good performance, for example, repeatability of portfolio return, and (2) verifiability of the investing premise or theme, for example, if the portfolio is said to be a growth or value portfolio are the returns produced by that type of investment. If not, the desired diversification of the outsourced investment within the overall university investments may not be achieved. The present invention provides a useful tool for making such evaluations.
A more complete understanding of the present invention, as well as further features and advantages of the invention, will be apparent from the following Detailed Description and the accompanying drawings.
As shown in
The mouse 16 and keyboard 14 can be used to select displays to be displayed on and make selections to be acted upon utilizing the graphical user interface display 22 and monitored by the computer or mobile device 12 as addressed further below. As one example, user selector 35 may be utilized by the user to select from among choices such as, long only versus long and short, a maximum FMP risk limit, a maximum FMP turnover limit, a rebalance frequency, an FMP universe of potential investments, and the like. User selector 36 may be utilized by the user to select a particular portfolio or portfolios from the set of historical investment protfolios for further analysis. For mobile devices and other suitable devices, the user selections may be input using a touch-screen display. In addition, the server, database, or electronic trading system 28 or LAN 26 or electronic trading system or portfolio database may also monitor the interaction with the graphical user interface 22, respond to user indications from the mouse 16 or keyboard 14, touchscreen, and so on.
The computer or mobile device 12 may also have a USB connector 21 which allows external hard drives, flash drives and other devices to be connected to the computer or mobile device 12 and used when utilizing the invention. It will be appreciated, in light of the present description of the invention, that the present invention may be practiced in any of a number of different computing environments without departing from the spirit of the invention so long as the transformative aspects of the present invention are employed therein. For example, the system 100 may be implemented in a network configuration with individual workstations connected to a server. Also, other input and output devices may be used, as desired. For example, a remote user could access the server with a desktop computer, a laptop utilizing the Internet or with a wireless handheld device such as cell phones, tablets and e-readers such as an IPad™, IPhone™, IPod™, Blackberry™, Treo™, or the like.
One embodiment of the invention has been designed for use on a stand-alone personal computer running Windows 10. Another embodiment of the invention has been designed to run on a Linux-based server system. The present invention may be coded in a suitable programming language or programming environment such as Java, C++, Excel, R, Matlab, Python, etc.
According to one aspect of the invention, it is contemplated that the computer or mobile device 12 will be operated by a user in an office, business, trading floor, classroom, or home setting.
As illustrated in
As further illustrated in
The output information may appear on the graphical user interface display screen of the monitor 22 or may also be printed out at the printer 24. The output information may also be electronically sent to an electronic trading platform or a database of PA results. The output information may also be electronically sent to an intermediary for interpretation. Other devices and techniques may be used to provide outputs, as desired.
Customized hardware and software to improve the interaction between a portfolio manager, a portfolio optimization and management system, and a portfolio manager management system is one aspect of the present invention. As further illustrated in one embodiment of the present invention shown in
A portfolio manager user system 270 is utilized to evaluate a number of different historical investment portfolios. These results can be electronically stored in a database of manager's results 272. Strategies for employing quantitative metrics that describe the advantages of each portfolio may be generated as discussed further herein. These quantitative metrics may change as updated or further historical investment portfolios are obtained. When more than one historical portfolio is considered, a ranking of the portfolios may be advantageously made and displayed as addressed further herein. Alternatively, the metrics and rankings may be transmitted to a ranking database 274 for storage. This database 274 associates FMP characteristics with particular portfolios or portfolios managers as addressed further herein.
As one example of how a portfolio manager may suitably evaluate a historical portfolio, the user system 270 is used to communicate through the communication network 240 with a portfolio optimization and management system 250. System 250 comprises plural high speed servers 2521, 2522, . . . , 252n, a pricing database 254, a dataset database 256, a factor risk model module 258, an optimizer module 260, software 262 to construct and save traditional PA results and software 264 to construct and save FMP-based PA results. While various modules and engines discussed above may be implemented in software operating on a processor or server, it will be recognized that they may be implemented as a combination of software and hardware or principally as hardware, such as an array of field programmable arrays (FPGAs) or application specific integrated circuits (ASICs) to implement an FMP-based performance attribution framework of the present invention for use in analyzing and improving portfolios.
As shown, the portfolio manager management system 280 will be utilized to aggregate and manage the investment budget allocation to each PM. The system comprises a database of portfolio managers 281, and a database of PMs historical portfolios 282, a database of PMs current portfolios 283, and a database of FMP characteristics chosen by the PMs. As part of the allocation of the investment budget across more than one PM, the portfolio manager management system 280 also has a database of FMP characteristics chosen by the mangers of the PMs 285. These characteristics apply across different PMs so that their aggregate contributions could be effectively evaluated. This type of allocation is important in instances where the aggregate positions of more than one PM are best explained with a set of FMP characteristics that are different than the FMP characteristics that worked best for individual PMs.
The portfolio manager management system 280 also has a PM budget allocation engine 286 for determining how to allocation available investment resources between the PMs, as well as a database 287 of the final, current, aggregate portfolio allocations which combines all the PMs individual portfolios into a composite portfolio. In some cases, the only trades submitted to an electronic trading platform would be these final allocations.
Commonly, models like the model of equation (1) above are estimated using a fundamental approach, where the modeler specifies the exposure matrix X, and then estimates the factor returns f via cross-sectional regression. In this case, the factor returns can be thought of as the returns of portfolios called factor mimicking portfolios (FMPs).
Specifically, if the cross-sectional regression is weighted by a matrix W, then
f=(XTWX)−1XTWr (3)
In other words, the factor returns are the returns of the portfolios captured by the columns of the matrix WX(XTWX)−1.
Now consider a portfolio of the form w=WX(XTWX)−1δ, in other words a linear combination of FMPs. That is, δ is a row vector giving the weights for each FMP in the portfolio w. If factor returns are estimated using cross-sectional regression with weights W, then a PA of the form of equation (2) has the following properties:
w
T(r−Xf)=δT(XTWX)−1XTWr−δT(XTWX)−1XTWXf=0 (4)
In other words, attribution on a linear combination of FMPs leaves no residual.
Now, consider an alternative perspective on factor PA where it is sought to maximally explain the (active) portfolio as a linear combination of FMPs. In this case, rather than use the FMPs that reproduce the factor returns obtained by linear regression, an alternative set of FMPs is produced by solving a problem of the form
min uTQ u (5)
w=WXλ+u (6)
In other words, the actual portfolio, w, is described as a linear combination of WX plus a residual, u, where the residual minimizes the scalar quantity uTQu.
The optimal solution to (5) and (6) is given by
λ=(XTWQWX)−1XTWQW (7)
If the inverse of the regression weights equals the variance, in other words if Q=W−1, then it is found that λ=(XTWX)−1XTw. This implies that
r
T
w=r
T
WXλ+r
T
u
=rTWX(XTWX)−1XTw+rTu
=fTXw+rTu
=wTXF+wTε (8)
In other words, for an appropriately chosen Q, this approach is equivalent to the usual factor based PA given in equation (2).
However, by viewing PA from this perspective, additional flexibility is introduced as it is now possible to explain the portfolio in terms of portfolios other than the FMPs implied by the cross-sectional regression of the fundamental model. Furthermore, a full risk model can be chosen to represent Q, rather than the proxies obtained by the inverse of the regression weights.
More generally, solving
min uTQu (9)
w=Hλ+u (10)
and, given a solution to this optimization, the portfolio return can be decomposed as
w
T
r=r
T
Hλ+r
T
u (11)
With this decomposition, the first term on the right-hand side of equation (11), rTHλ, is the factor component, and the second term on the right-hand side of equation (2), rTu, is the specific component.
In traditional factor based PA, H is the matrix of FMPs and Q=W−1. However, the FMPs in H can be replaced with factor portfolios that more closely reflect the limitations imposed on the strategy that produced w.
Next, the approach of the present invention establishes that unconstrained optimal mean-variance portfolios, herein termed MVO portfolios, can be perfectly explained by the factor based attribution of an appropriately constructed returns model. This insight is motivated by that fact that each FMP is itself an optimal solution to a very specific mean-variance optimization (MVO) problem. More precisely, the FMP for the i-th factor is an optimal solution to:
min hTW−1h (12)
XTh=ei (13)
where ei is a vector with a one in the i-th position and zeros elsewhere. In other words, the FMP is a minimum risk portfolio that has unit exposure to the factor in question, and no exposure to any other factors in the model.
Now a generic, unconstrained mean-variance optimization (MVO) is examined:
max αTh (14)
(h−b)TQ(h−b)≤r2 (15)
where b is a benchmark. In other words, alpha, α, is maximized with a constraint on active risk. The solution, h, of (14) and (15) is the unconstrained, long-short, MVO portfolio that tilts on α. The optimal active portfolio is a multiple of Q−1α. Now suppose that Q=XΩXT+Δ and α=Xθ, i.e. the alpha is a linear combination of factors in the risk model. In this case, it can be shown that
Q−1 α
=(Δ−1−Δ−1X(XTΔ−1X+Ω−1)−1XTΔ−1)α
=Δ−1α−Δ−1Xλ
=Δ−1Xθ−Δ−1Xλ
=Δ−1X(θ−λ) (16)
In other words, if W=θΔ−1, then the optimal active portfolio is a linear combination of FMPs of a regression weighted by the inverse of specific variances in the risk model. Alternatively put, if H=Δ−1X in (9) and (10), then the portfolio return can be explained exactly, and u=0 yielding an attribution with no residual.
Adding constraints to the optimization causes this simple relationship to break down, but it motivates the replacement of usual FMPs, produced by (12) and (13), with factor portfolios that also reflect the additional constraints.
For instance, if the portfolio construction is bound by long-only constraints, then it stands to reason that this restriction should be accounted for in the definition of a factor portfolio as well. Hence, (12) and (13) can be replaced with
min hTΔh (17)
XTh=ei (18)
h≥−b (19)
The constraint h≥−b follows from the fact that if the portfolio must be long-only, then the active portfolio cannot underweight any asset more than its weight in the benchmark. Unfortunately, this problem may not always have a feasible solution, so instead exposure to the required factor subject to a risk constraint is maximized:
max XiTh (20)
hTQh≤r2 (21)
XjTh=0∀j≠i (22)
h≥−b (23)
By replacing some of the usual FMPs in the matrix H in equations (9) and (10) with FMPs resulting from equations (20)-(23), an attribution can be computed constrained to these long-only FMPs and the effect of having these constraints on the portfolio construction strategy can be advantageously addressed.
As one example, the following sequence of steps is employed. First, equations (20)-(23) are solved to determine a set of h's which are FMPs. Second, these h's or FMPs are combined to form the matrix H in equations (9) and (10), which are solved to determine the decomposition, which includes the specific return u. Finally, the portfolio's return is decomposed as shown in equation (11). This sequence of steps is performed at every time period in the attribution to produce a factor/specific decomposition over time. The contributions over time are then linked to create PA results. This approach provides an advantageous alternative FMP-based performance attribution.
As seen in the following quantitative examples, by thinking about factor-based PA as a framework that explains a portfolio's return using a set of FMPs derived by a generalized, but readily solved optimization problem instead of as a linear combination of fixed factor returns and exposures, flexibility is gained to clearly identify which elements of a particular investment strategy added value, such as increasing the return to the investment process.
Charts 330 and 338 in
These standard decomposition results, represented by curves 334 and 336, are approximately the same magnitude and sign, and together they add up to the full active return, 332. However, since the PA factors do not fully represent the signal used to construct the portfolio, it is reasonable to ask if the specific return, which is significant, truly represents specific return or, alternatively, is simply the result of misrepresenting the signal.
In chart 338, an alternative PA is performed in accordance with the present invention using a return model that has factors that fully represent the profitability signal used to construct the portfolio. The dark line is indicated by two numbers, 340 and 342, because, in fact, two lines are drawn on top of each other. That is, line 340, which is the cumulative active return of the portfolio and line 342, which is the factor component, lie on top of each other and are indistinguishable in the chart. Of course, when the factor component represents the active return exactly, the specific component, 344, is identically zero.
These results indicate that the standard PA with missing factors does not fully attribute performance to the factors, leaving a significant specific, residual, unexplained return. It is generally preferable to use an alternative PA that includes the full set of factors relevant to the portfolio construction. In this case, it is possible to make the residual, specific, unexplained return identically zero. Selecting the PAs and displaying the charts for those selected PAs as addressed above in connection with
There are many possible metrics that may be used to quantify the quality of PAs. These include
Note that these results do not imply that the standard PA results are wrong. Those results are correct. The point being made here is that they are not a helpful decomposition of the portfolio's performance, either for convincing investors of the value of active management or in identifying constructing change to an investment process that can be used to improve the investment process.
In chart 368, an alternative PA in accordance with the present invention is performed using a return model that has factors that fully represent the earnings yield signal used to construct the portfolio. The dark line is indicated by two numbers, 370 and 372, because, in fact, two curves are drawn on top of each other. That is curve 370, which is the cumulative active contribution of the portfolio and curve 372, which is the factor component, are indistinguishable. Of course, when the factor component represents the active contribution exactly, the specific component 374 is identically zero.
As with the results in
Unlike in
Here it is seen that for some portfolios, the standard PA can produce results in which the specific component is relatively small in comparison with the factor contribution. Again, the displayed information for the selected PAs for evaluation by a user is intuitively useful to the user. This is true for the selections and displays of the figures which follow as well. Charts 410 and 418 in
The decomposition results using AXUS3-MH, illustrated by curves 414 and 416, are intuitive, in that the factor contribution 414 dominates the attribution, and the specific contribution 416 is relatively small. If a PA quality metric were employed to evaluate this result, the metric would produce a relatively small number indicating a useful PA.
In chart 418, the PA using AXUS4-MH shows large factor and specific contributions of different signs. The active return is shown by the dark line 420. The factor contribution is shown by the dotted line 422. The specific return is shown by the light grey line 424.
Here it is seen that the introduction of a long only constraint into the portfolio can change the PA results dramatically. Here, the model that only approximates the factor tilt does a better job attributing the return to factors than the model that contains the factor explicitly. In other words, a PA quality metric evaluating the PA in 410 would be of smaller magnitude than the PA quality metric evaluation, the PA in 418. This result is an example of two wrongs (e.g., discrepancies) making a right (counter-acting each other). Clearly, with such a wide range of results, it can be hard to come to reliable conclusions of what to expect with any given PA. Indeed, a flexible interactive PA that automatically enables portfolio managers to seek a defensible and intuitive PA is clearly required. This is a tool that has been desired but missing from the arsenal of portfolio managers' tools. The present invention provides a framework for creating a tool to fill this gap. One aspect of the present invention is the automation of FMP-based PA to obtain PAs with advantageous PA quality metrics. The new analysis tools provided by the present invention are particularly helpful for complex signals, portfolios, and PA results such as those illustrated in
Once portfolio managers have a PA of their performance, the standard investment advice is to identify those factors that have performed well and, going forward, increase the portfolio exposures to those factors that worked well. In addition, the PA is used to identify those factors that have not performed well and, going forward, the portfolio manager will try to reduce his or her exposure to those factors. Changes to an investment strategy depend crucially on whether or not a PA indicates a factor is over or under-performing. It is therefore also crucial to have a PA in which the performance of the factors indicated is unambiguous—that is, in which the PA quality metric is low, indicating a high quality PA. When the PA quality metric is high, then there is ambiguity about whether the performance is driven by factor contributions or specific contributions. This uncertainty leads to ambiguity about potential changes to an investment strategy based on the PA. A tool that reliably produces a high quality PA is therefore advantageous to portfolio managers wishing to improve their performance.
Chart 430 in
Chart 460 in
Charts 470 and 478 in
In chart 478, curve 480 is the same active return shown by curve 472 in chart 470. In this case, however, PA was performed using FMPs constructed over the Russell 1000 universe, the same universe used to construct the long-short mean-variance, unconstrained, profitability portfolios. In this case, the factor contribution 482 is identical to the active return 480, and the specific contribution 484 is identically zero. This kind of result is easier to interpret than the PA performed in chart 470. A PA quality metric would indicate a high quality PA.
Chart 490 in
Charts 500 and 508 in
In chart 508, curve 510 is the same active return shown by curve 502 in chart 500. In this case, however, PA was performed using FMPs constructed over the Russell 1000 universe, the same universe used to construct the mean-variance, unconstrained, medium-term momentum portfolios. In this case, the factor contribution, 512, is identical to the active return 510, and the specific contribution, 514, is identically zero. A PA quality metric would indicate high quality.
Table 518 in
In the analysis shown in
Table 520 in
It is concluded from this data, as well as the data in table 518, that differences in FMP annualized returns and correlations between universes correspond to important differences in PA analyses.
In chart 538, the same portfolio is analyzed, but now the FMPs used for PA are derived with a long-only constraint. In this case, when the active return 540 is decomposed into factor and specific contributions, only the factor contribution 542 is significant. The specific contribution 544 is small throughout the time period analyzed. This PA would have a good PA quality metric. Hence, having the FMPs used for PA use similar constraints satisfied by the investment portfolio improves the interpretability of the PA results illustrated here.
Chart 550 in
Chart 560 in
Table 570 in
Table 572 in
In chart 588, the same portfolio is analyzed, but now the FMPs used for PA are derived with a long-only constraint and a fixed risk limit of 3% annual volatility. In this case, when the active return 590 is decomposed into factor and specific contributions, only the factor contribution 592 is significant. The specific contribution 594 is small throughout the time period analyzed.
In chart 612, the corresponding specific returns are shown. Curve 614 is for the traditional FMP; curve 616 is 3% risk; curve 618 is 4% risk; and curve 620 is 5% risk. The 4% risk curve 618 and the 5% risk curve 620 both have very small specific returns throughout the time period.
In chart 642, the corresponding specific returns are shown. Curve 644 is for the traditional FMP; curve 646 is 1% risk; curve 648 is 2% risk; and curve 650 is 3% risk. The 2% risk curve 648 and the 3% risk curve 650 both have small specific returns throughout the time period.
The approach outlined above works well in most cases, but it does have some nuances in terms of how it works in practice. As shown above, when PA is performed on the returns of an unconstrained, long-short mean variance portfolio, portfolios can be found that explain the portfolio performance perfectly, for example, they have no specific contribution. However, when a simple long-only constraint is added to the construction of the portfolio, portfolios are no longer found that perfectly explain the portfolio performance. Portfolios can be found with relatively small specific contributions, indicating a higher quality PA, but in general it is not possible to make the specific contribution identically zero.
To understand why this happens, it is helpful to consider in more detail why we are able to perfectly explain an optimal mean variance portfolio as long as no constraints such as long-only are present.
As equation (16) showed, even a simple mean variance bet on a single signal results in exposure to many factors. Specifically, we see that the optimal portfolio can be written as
h=ΣθjΔ−1Xj (24)
Each term Δ−1Xj can be thought of as the optimal solution to
max XjTh−hTΔ−1h/2 (25)
and that a weighted sum of the optimal solutions to each of these optimization problems is equal to the optimal solution of
max(ΣθjXj)Th−hTΔ−1h/2 (26)
In other words, in this unconstrained scenario, mixing portfolios coming from equation (25) is equivalent to mixing signals first and constructing a portfolio from the mixed signal. It is this principle that allows an explanation of optimal unconstrained mean variance portfolios perfectly through portfolios.
However, once long-only constraints are added, this result no longer holds. For example, it can no longer be guaranteed that the optimal solution to
max(ΣθjXj)Th−hTΔ−1h/2 (27)
h≥−b (28)
has the same properties, e.g., is identical to the weighted sum of optimal solutions for each factor. Understanding the difference between long-only constrained portfolios obtained by mixing individual portfolios versus those obtained by first mixing the signals can be instructive in understanding why it is not possible to rely on perfect attributions of long-only constrained portfolios.
Specifically, it is desired to understand the difference between constructing portfolios in two different ways:
This result is further illustrated as follows. Consider constructing FMPs for the Russell 3000 universe on the two factors profitability and value.
An illustration comparing mixing portfolios and mixing signals is shown by chart 670 in
The purpose of these comparisons is to illustrate why PA results for long-only constrained mean variance portfolios can usually not be perfectly explained by long-only constrained FMPs, since combining these FMPs (portfolios that bet on individual signals) is not equivalent to mixing the signals and constructing the portfolio based on the mixed signal.
The point illustrated by this data is that there can be substantial differences in the assets weights for long-only FMPs when more than one signal is combined. These differences extend to different approaches such as mixing portfolios and mixing signals.
Another important practical nuance relates to the frequency at which factor returns and FMPs are rebalanced. For many commercial factor risk model providers, the factor returns and risk models are updated on a daily basis. However, in practice very few portfolios are rebalanced or updated at that frequency. Often portfolios may be rebalanced once a month or once a quarter in an effort to minimize the trading and transaction costs for the portfolio. As a result, these portfolios do not react to daily changes in factor scores or exposures as the commercially available, daily factor returns do.
The flexibility of the FMP approach of the present invention allows PA to be performed with a rebalance frequency that matches the portfolio rebalance schedule. This approach improves the PA by minimizing the misalignment between the FMPs and the portfolio.
In chart 688, PA is performed using FMPs that are rebalanced daily. In this case, the active return 690 is the same, but now the factor return 692 is similar to but not identical to the active return. The specific return 694 is now small but negative. The PA in chart 688 is still intuitive, but not as ideal as the PA shown in 680.
In chart 708, PA is performed using FMPs that are rebalanced daily. In this case, the active return 710 is the same, but now the factor return 712 is similar to but not identical to the active return. The specific return 714 is now small but positive. The PA in 708 is still intuitive, but not as ideal as the PA shown in 700.
Another aspect of the present invention is the ability to use the FMP characteristics in a high quality FMP-based PA as descriptors of the historical portfolios or the portfolio manager in charge of those portfolios. In a large investment bank with dozens or hundreds of portfolio managers and PAs, a database that identified those FMP characteristics that were most associated both with high quality PA and with out-performance, that is portfolio returns that were positive or greater than a benchmark return, could be used to screen portfolio managers and guide the allocation of investment funds. The database would be advantageous for identifying those portfolio managers who consistently out-perform the market and choose advantageous factors.
In a second window 1006, a summary of the most recent PA results is presented. This summary includes a decomposition of the returns and risk across the factors and specific components. In addition, a metric defining the quality of the PA may also be presented. The summary may also include graphical representations of the cumulative factor and specific returns.
There are also two user indications in the graphical user interface. There is an “Update PA” indicator or button 1008 that may be pressed by the user to start the new PA analysis. There is also an “Export PA” indicator or button 1010 that will take the most recent PA results and export them to a database or file or trading system. The exported PA results could also be exported to a portfolio construction and management system that would attempt to capitalize on the PA results by altering investment portfolios to increase those factor exposures that have worked historically and reduce those factor exposures that have not worked historically.
In step 3002, the set of historical investment portfolios is electronically received by a programmed computer. For example, where a portfolio manager wishes to compare the results of a group of potential fund investors, historical investment portfolios may be obtained from that group of potential fund investors and stored in digital storage, such as database 272 of
In step 3004, a first set of user choices for constricting a set of FMPs are displayed on the graphical user interface. For example, user choices may be displayed on display 22 of system 100 or touchscreen 275 of computer 271 of the user system 270. One exemplary set of user choices comprises long only, maximum risk value for each FMP, a maximum turnover value for each FMP, a rebalance frequency, and an FMP universe of potential investments. Such choices may be selected by clicking on an item listed in a selectable menu, typing a selection into a selection box, touching a button or other user selector on a touchscreen or the like.
In step 3006, a user selector in the graphical user interface is automatically monitored by the programmed computer and upon determining a user selection to perform PA, constructing a first set of FMPs utilizing the first set of user choices. By way of example, a user selector is displayed on the graphical user interface or the display 22 or touchscreen of 275 of system 100 or user system 270, respectively. The user selector may suitably comprise a selector button labeled “Perform PA” or the like.
In step 3008, a first PA is performed on the first set of historical investment portfolios using the first set of FMPs, the first PA including a determination of a first residual performance contribution not explained by the first set of FMPs.
In step 3010, a graph of the first residual performance contribution over time is displayed on the graphical user interface. For example, a graph like any of graphs 336, 344, 366, 374, 396, 404, 416, 424, 476, 484, 506, 514, 536, 544, 586, 594, 614, 616, 618, 620, 644, 646, 648, 650, 686, 694, 706, and 714 shown in
In step 3012, user entered changes to the first set of user choices are automatically monitored by the programmed computer to create a second set of user choices for constructing a second set of FMPs. As one example, where a user first selected long only, that choice might be replaced with a frequency of rebalancing of once a month.
In step 3014, automatically continuing to monitor by the programmed computer the user selection in the graphical user interface for a second user selection to perform a second PA, and upon detection of this second user selection to perform the second PA, constructing the second set of FMPs utilizing the of user selection.
In step 3016, the second PA is performed on this set of historical investment portfolios using the second set of FMPs including a determination of a second residual performance contribution not explained by the second set of FMPs.
In step 3018, a revised graph including both the first and the second residual performance contributions over time is displayed on the graphical user interface.
Although the present invention has been described in terms of FMPs derived using an optimization framework, the present invention is not limited to optimized FMPs. The customized FMP-based PA framework is more broadly applicable. It may be that other kinds of customized FMPs perform differently and advantageously than the particular cases described here. For example, turnover-constrained FMPs, FMPs with a limited number of names held, tax-aware FMPs, rules-based FMPs such as top minus bottom quintiles or Fama-French portfolios, and the like may be utilized within the framework of the present invention. In addition, the FMPs may be constructed using multiple descriptors or variables for each factor.
While the present invention has been disclosed in the context of various aspects of presently preferred embodiments, it will be recognized that the invention may be suitably applied to other environments consistent with the claims which follow.
The present application claims the benefit of U.S. Provisional Application Ser. No. 62/414,106 filed Oct. 28, 2016, the disclosure of which is incorporated herein by reference in its entirety. The present invention may advantageously be used in conjunction with one or more of the following applications and patents: U.S. patent application Ser. No. 11/668,294 filed Jan. 29, 2007 which issued as U.S. Pat. No. 7,698,202; U.S. patent application Ser. No. 12/958,778 filed Dec. 2, 2010 which issued as U.S. Pat. No. 8,533,089; U.S. patent application Ser. No. 12/711,554 filed Feb. 24, 2010 which issued as U.S. Pat. No. 8,315,936; U.S. patent application Ser. No. 12/827,358 filed Jun. 30, 2010 which was published as U.S. Publication No. 2011/0289017; U.S. patent application Ser. No. 13/503,696 filed Apr. 24, 2012 which issued as U.S. Pat. No. 8,533,107; U.S. patent application Ser. No. 13/503,698 filed Apr. 24, 2012 which issued as U.S. Pat. No. 8,700,516; U.S. patent application Ser. No. 13/892,644 filed May 13, 2013 which was published as U.S. Publication No. 2013/0304671; U.S. patent application Ser. No. 14/025,127 filed Sep. 12, 2013 which was published as U.S. Publication No. 2014/0081889; U.S. patent application Ser. No. 14/051,711 filed Oct. 11, 2013 which was published as U.S. Publication No. 2014/0108295; U.S. patent application Ser. No. 13/654,797 filed Oct. 18, 2012 which was published as U.S. Publication No. 2013/0041848; U.S. patent application Ser. No. 13/965,621 filed Aug. 13, 2013 which was published as U.S. Publication No. 2013/0332391; U.S. patent application Ser. No. 14/336,123 filed Jul. 21, 2014 which was published as U.S. Publication No. 2015/0081592; U.S. patent application Ser. No. 14/203,807 filed Mar. 11, 2014 which was published as U.S. Publication No. 2014/0201107; U.S. patent application Ser. No. 14/482,685 filed Sep. 10, 2014 which was published as U.S. Publication No. 2016/0071213; U.S. patent application Ser. No. 14/495,470 filed Sep. 24, 2014 which was published as U.S. Publication No. 2016/0086278; U.S. patent application Ser. No. 14/505,258 filed Oct. 2, 2014 which was published as U.S. Publication No. 2016/0098796; U.S. patent application Ser. No. 14/519,991 filed Oct. 21, 2014 which was published as U.S. Publication No. 2016/0110811; and U.S. patent application Ser. No. 15/280,144 filed Sep. 29, 2016, all of which are assigned to the assignee of the present application and incorporated by reference herein in their respective entireties.
Number | Date | Country | |
---|---|---|---|
62414106 | Oct 2016 | US |