Using the Jackknife to Understand the Variance of the Measured Skill

by Graham Giller April 07, 2010 00:57

In the prior post we presented evidence that the forecasting skill of our AR(1) model of the returns due to the dynamic trading risk factor was +18% relative to the null hypothesis forecast based on the sample mean return. However, we did not give a statement of the significance of this excess skill based on the sample data recorded.

The principal reason for this omission was that I don't know the sampling distribution of the skill statistic, and so cannot easily assess it's sample variance. In this post we will use the Jackknife, which is a statistical resampling technique, to estimate the bias and variance of the skill statistic.

For N data points, the basic technique is to compute the statistic we are interested in over the N subsets of the data that may be selected by leaving one of the data points out in each group. Unlike bootstrapping, we do not select subsets at random — we consider every possible subset that may be formed with just one datum left out. We may then use the sample distribution of these leave-one-out estimators of the skill to estimate the bias and variance of our whole sample statistic. 

Our data has a null forecast of 0.46% per month and a relative skill of 18%. From the data below, we compute a Jackknife bias of −2% in skill, leading to a Jackknife estimator of 20% skill with a Jackknife variance estimator of 0.0207 (std.err. of 14% in skill). 

Month Forecast Return Jackknifed Skill
2009:01 0.54000 1.91969 0.18129
2009:02 0.93000 -0.99514 0.20240
2009:03 -0.00250 2.00606 0.20355
2009:04 1.00000 5.45154 0.16943
2009:05 2.17000 4.56036 0.06672
2009:06 2.17414 0.86447 0.19742
2009:07 0.65150 3.60079 0.18709
2009:08 1.67528 1.96684 0.15889
2009:09 1.11241 3.37740 0.15628
2009:10 1.92452 -0.48630 0.23750
2009:11 1.18858 1.46865 0.17088
2009:12 0.97735 2.34761 0.16717
2010:01 1.25547 -0.12375 0.19797
2010:02 0.15856 0.88933 0.18387
2010:03 0.68968 4.10525 0.18953

 

 

Comments are closed

Powered by BlogEngine.NET 1.4.5.0
Theme by Mads Kristensen | Modified by Mooglegiant



RecentComments

Comment RSS

About the Author

Graham Giller - Headshot GRAHAM GILLER
Dr. Giller holds a doctorate from Oxford University in experimental elementary particle physics. His field of research was statistical astronomy using high energy cosmic rays. After leaving Oxford, he worked in the Process Driven Trading Group at Morgan Stanley, as a strategy researcher and portfolio manager. He then ran a CTA/CPO firm which concentrated on trading eurodollar futures using statistical models. From 2004, he has managed a private family investment office. In 2009, he joined a California based hedge fund startup, concentrating on high frequency alpha and volatility forecasting. My updated resume is on LinkedIn.

Pages


Disclaimer

Nothing on this site should be construed as a reccommendation to buy or sell any specific security nor as a solicitation of an order to buy or sell any specific security. Before making any trade for any reason you should consult your own financial advisor. The author may hold long or short positions in any of the securities discussed either before or after publication of an article mentioning such a security.

Copyright Notice

All post on this blog are © Copyright property of Giller Investments (New Jersey), LLC. All comments are the property of their respective authors and neither the author or this blog nor any entity associated with him are responsible for or accept any responsibility for their content. Offensive comments and spam may be removed at the authors discretion.

Data provided on this blog or through links to this blog are either property of Giller Investments (New Jersey), LLC or publicly available or derived from data that is publically available. Any data that is proprietary to Giller Investments (New Jersey), LLC is published here for the public interest and may be reproduced for private research or in public forums provided that suitable attribution and acknowledgement of ownership is made.

Privacy Policy

We use third-party advertising companies to serve ads when you visit our website. These companies may use information (not including your name, address, email address, or telephone number) about your visits to this and other websites in order to provide advertisements about goods and services of interest to you. If you would like more information about this practice and to know your choices about not having this information used by these companies, click here.