We have discussed the composition and aggregate performance of the Compact Model Portfolio in other articles in this blog. Briefly, it is composed using a ranking that results from the application of time series analysis methodologies to the total value traded rather than the stock price.

In the above chart we exhibit a simple conditional analysis of the average return over the prior decade of portfolio members versus their ranking number. In these series, when the stock rank changes we follow the rank and not the stock. Thus the performance of the stock ranked “1” is the performance of the first ranked stock through time and not the performance of the stock currently ranked “1” (which is currently AAPL). In the chart we do see an out-performance for the higher ranked stocks, but its statistical significance is only notable when the general trend is estimated. If each rank were considered separately, we would not accept the hypothesis that the stock has significantly outperformed the benchmark.

Following on from the prior article, we will now study the effect of leverage on the severity of drawdowns. This is done for a series with a positive mean daily return over the last decade — so it should produce profitable investments in expectation. We will investigate the effect of leverage on the maximum drawdown in the series by using the bootstrap to elucidate the mean relationship rather than looking at one specific realization.

Our approach is as before, with the exception that we pick the leverage for each trial at randome between zero and four. Four is the maximum leverage permitted to a Pattern Day Trader, and so that seems a sensible limit for our analysis.

The above chart shows the observed relationship between the leverage used and the maximum drawdown within the nine years of trading represented by each simulation. The curve fitted is to the expression below (and is done by non-linear least squares).

(Here M is the maximum drawdown and L is the leverage; I don't assert that this relationship is anything other than a convenient representation of the data.) We see that with a standard margin account (2× leverage permitted), we expect a maximum drawdown of around 75% of capital and the probability of a drawdown exceeding 50% of capital is of order unity. Near the higher levels of leverage, complete drawdown (maxmimum drawdown exceeding 99% of capital) is increasingly certain. We shall present an empirical model for these probabilities in the next post.

The Bootstrap is a technique for simulating the sampling distribution of a statistic invented by Bradley Efron. It is a technique that attempts to solve the following problem: the empirical p.d.f. of a dataset clearly rejects common parametrical representations or the statistic we are computing has a population distribution that is analytically difficult or impossible to compute; however, the statistic is useful and we need to estimate it's sampling distribution to place confidence limits on the observed value.

The method is discussed in many places, such as Efron's excellent little book The Jackknife, the Bootstrap, and Other Resampling Plans, but I will summarize it briefly: we simulate data drawn from the empirical distribution function of the data by resampling with replacement of the actual data. This is clearly not as good as sampling from the population distribution function, but there are strong theorems governing the convgence of the e.d.f. to the p.d.f. and it does allow us to produce monte-carlo simulations of data with all of the measured properties of the sample (although the procedure is a little more complicated in the presence of serially correlated data). It is important to note that the replacement is an important step — it means that the properties of the simulations we create do not exactly match the actual sample and that allows us to estimate quantities such as the bias of an estimator.

The above charts show our use of The Bootstrap to analyze the series of daily returns of the Compact Model Portfolio. The upper chart shows five simulated total return time series (black) and the actual total return time series (red). The returns are accumulated and the dispersion of the final states due to a fortunate run of returns is very evident. The histograms show the distributions of the maximum drawdown and Sharpe Ratio for each simulated series. This are both popular metrics for quant. traders and are examples of statistics with awkward sampling distributions that a traditional analysis only gives use one opportunity to compute from historical data. The maximum drawdown histogram is fitted to the Gamma Distribution, and the Sharpe Ratio histogram to the Student's t Distribution. We learn from these charts that the standard deviation of the Sharpe Ratio is approximately equal to it's sample value and that the probability of a maximum drawdown exceeding 25% of capital is close to unity. It would not be possible to obtain this information via other methods.

Finally, I would like to acknowledge Greg Laughlin for stimulating my interest in using the Bootstrap method.

I recently changed several things regarding the Compact Model Portfolio (in particular the hedging strategy). This change went live, at a new brokerage, on the 9th. of April. To check that things are ok, we need to verify whether the returns series from the traded portfolio are not significantly distinguishable from the index — i.e. we need to investigate whether the traded portfolio is accurately tracking the desired index performance.

We have a small data set, so far, of only 12 days, so we need to be careful about our inferences. However, we have three tools to use:

• we can look at the time series of the total returns of both series and see if they appear similar (an eyeball or ballpark test);
• we can perform a linear regression of the traded portfolio daily returns onto the index portfolio daily returns, and apply statistical tests to investigate the null hypothesis (α,β) = (0,1) i.e. perfect tracking
• we can use the two-sided Kolmogorov-Smirnov test to investigate whether the empirical distributions of the respective daily return series are consistent with eachother.

Before presenting our results, let's discuss our expectations for the alternate hypothesis (that the traded portfolio does not track the index portfolio). The traded portfolio has frictions — brokerage fees, financing fees etc. — that are not represented in the ideal portfolio. In addition, the treatment of dividends is different. The ideal portfolio receives the dividend on the ex-dividend date, which is done to prevent spurious returns due to the expected ex-dividend drop; whereas, the traded portfolio will experience the ex-dividend drop and then receive the dividend income on the settlement date. The former effect should lead to a linear-regression α of less than zero. The latter effect should be a depression of the β below unity.

For the brief data sample we have, we cannot reject the null hypothesis. However, we have now established the toolset needed to investigate this issue, and will return to it after more time has elapsed.

The following chart updates the actual daily performance of the Compact Model Portfolio. This is a nominal scale portfolio, but it is an actually traded portfolio. The gap in early April occurred as I made some modifications to the system. Since then we're taking more risk, and so far the performance has picked up noticably. I'll explain these changes in a later post.

The Compact Model Portolio, which has been quiescent for a long time, has traded again. This time substituting FAS, which is the triple leveraged financials ETF for SDS, which is the double short S&P 500 tracking ETF. (The history of the composition of this index, and it's daily return relative to the benchmark, have are available on the blog side panel.) This trade actually occured on 20/10/2009, but I've been very busy on other projects and have been unable to update the blog for a while.