Tuesday, July 16, 2013

Momentum Crash and Recovery

In my book I devoted considerable attention to the phenomenon of "Momentum Crashes" that professor Kent Daniel discovered. This refers to the fact that momentum strategies generally work very poorly in the immediate aftermath of a financial crisis. This phenomenon apparently spans many asset classes, and has been around since the Great Depression.  Sometimes it lasted multiple decades, and at other times these strategies recovered during the lifetime of a momentum trader. So how have momentum strategies fared after the 2008 financial crisis, and have they recovered?

First, let's look at the Diversified Trends Indicator (formerly the S&P DTI index), which is a fairly generic trend-following strategy applied to futures.  Here are the index values since inception (click to enlarge):



and here are the values for 2013:




After suffering relentless decline since 2009, it has finally shown positive returns YTD!

Now look at a momentum strategy on the soybean futures (ZS) that I have been working on. Here are the cumulative returns from 2009 to 2011 June:


and here the cumulative returns since then:


The difference is stark!

Despite evidences that indeed momentum strategies have enjoyed a general recovery, we must play the part of skeptical financial scientists and look for alternative theories. If any reader can tell us an alternative, plausible explanation why ZS should start to display trending behavior since July 2011, but not before, please post that in the comment area. The prize for the best explanation: I will disclose in private more details about this strategy to that reader. (To claim the prize, please include the last 4 digit of your phone number in the post for identification purpose.)

===
Upcoming events:
  1. I will be teaching an online workshop on Momentum Strategies from July 30 - August 1. Registration info can be found here.
  2. My friend Dr. Haksun Li is offering a Certificate in Quantitative Investment series of courses.










82 comments:

kj said...

Rolling 252 day stdev falls off a cliff after 09. It stabilizes in 2011 and has been in the same range ever since (around 2%, from 5% in 09).

8049

Jozef Rudy said...

explanation is not important. when u trade trends, trade them on all assets - like CTA's. It's impossible to predict when trends work on which asset.

Jozef (number 009)

Unknown said...

9455

I read a research paper (I think it was by Fabozzi but I'm not sure) that explained, during recessions there is a fundamental reason for the market to become more volatile. Companies are usually highly leveraged at the peak of a bull market; just like how LTCM went from a leverage ratio of 40 to 100 in a couple of days, companies too will suddenly have exponentially larger leverage ratios since their intrinsic capital will have diminished. This increased amounts of leverage results in increased fluctuations in prices.

Essentially, recessions causes market volatility, which in turn causes momentum strategies to whiplash.

For the commodities, I would guess that the same actions apply to the traders rather than the companies. Traders leverage themselves too much, a crisis causes their leverage to shoot up and increase market volatility during the de-leveraging cycle.

Unknown said...

Hello Ernie

If it is true that all momentum / trend following strategies breakdown during periods of high volatility which generally coincide with Economic recessions then one must predict economic recessions. In my experience economic recessions are typically a result of exogenous price shocks. Either the price of energy or the price of capital (i.e. interest rates). For example the 2007-2008 financial crisis was proceeded by rising short term interest rates and very high Oil prices. Similarly, the 2000 recession was proceeded by rising short term interest rates (inverted yield curve). Recessions in the 1970's (two of them) were a result of Oil embargos and huge spike in Oil prices. 1982 - Volker. etc.. So. One might be able to model and predict possible recession periods with Oil price series and short term treasury yield price series. Interest rates are a little more complicated as one might have to take into account inflation to get the "real" vs. "nominal" interest rates. Yield curve. I could even see Libor spreads being used in this part of the model (spreads were widening into the 2007-2008) crisis.

As always. Looking for an opportunity to work with you Ernie.

Neil Jetty 4000
Professional Programmer

Ernie Chan said...

kj:yes, it is interesting that volatility of ZS fell off dramatically after 2011. But so did volatility in many other assets. It may be related to the revival of trend following strategies, but just as another manifestation of the "bull market".

Jozef: I used to follow your paradigm of trading a trend following strategy on all futures, but with little success. After I studied some successful managers' strategies, I now don't believe that we should apply the same strategy to all futures. In particular, equity index futures behave extremely differently from many commodities futures. Also, as my book detailed, the main reason for trending behavior in futures is roll returns, and they are very different for different futures.

Ernie

Ernie Chan said...

Hi William,
As in my response to kj above, it is hard to discern whether the decline of volatility is a cause for the revival of trends, or whether it is just a contemporaneous feature of a bull market.
Ernie

Ernie Chan said...

Hi Neil,
Actually, one does not need to predict recessions to benefit from this phenomenon. We just need to know that after a recession has already started, we shouldn't be trading trend strategies for a while, maybe a long while.
Best,
Ernie

Dekalog said...

In July 2011 I bought a soy milk maker and since that time I have been eating soy milk everyday on my breakfast cereals. Since I'm a greedy pig, my mass purchases of raw soybeans and subsequent increase in market demand have obviously pushed prices up!

9449

jose antonio said...

Hi Ernie

As you said in your book, roll return are very important in futures of commodities and this quantity depends on some factor like: interest rate, inflation, expectations.... It could be that this quantity have been less for 5 years because we don't have inflation and 0 interest rate and that could mean more noise and less trend in futures markets. What do you think?

Jose Antonio

Mdbllbr said...

The ZS market regime changed from an exogenous regime (factors outside agriculture commodities market leading prices) to an endogeneous regime (mainly weather related factors afecting prices). Among weather factors affecting prices we can cite midwest drought and forecast of a mild el ninõ conditions during the period.

Jozef Rudy said...

Hi Ernie,

what does with little success mean? Out of the long-term sucessful investors/traders, I only know CTA's (turtles) and value buyers (warren buffet).

Everything else stops working sooner or later. Please check http://www.amazon.com/Following-Trend-Diversified-Managed-ebook/dp/B009WWQD08/ref=sr_1_2?ie=UTF8&qid=1374094381&sr=8-2&keywords=trend+following

Gives a good overview of simple trend following strategy.

I think if you manage to have ann ret/max dd ~ 1 for > 10 years, you're a success. Everything better will not last.

Theo said...

First of all, we should differentiate btw trend following and momentum. The paper you mentioned is about cross-sectional momentum on equities, which in academia is referred simply as momentum. The reason it doesn't work after crises is b/c of trend reversal (stocks that used to underperform start to overperform). For example small cap value stocks which were falling the most during the bear mkt, are the first to participate in the bull market. Trend following or absolute momentum (academia), tends also to underperform after crises b/c markets become range bound creating more false signals. I think of the mkts as springs. After volatility expansion (crisis) the spring will start to hover around (noisy range bound markets) until it reaches an equilibrium where momentum will start to work again. After crises (regime breaks) mkts are noisy, creating more false signals for trends (signal/noise falls precipitously). The fact that they are noisy does not mean ostensibly that there aren't trends, but the new trends are more noisy and maybe you need different approach (maybe longer lookback) to identify them.

1364

Dan Goldman 6261 said...

Hi Ernie,
One thought is that this momentum was initially set off by the USDA Acreage and Grain Stocks Report that comes out in late June. In 2011, there was a big surprise (at least in corn, which is highly correlated) that deflated a long upward crawl in prices. Same situation in June this year. Last year was the drought. In that case, which I'm guessing is more common in commodities markets, there was a gradual diffusion of news regarding the severity of the drought. Weather forecasting, acreage reporting and the like are messy businesses that probably lend themselves to trending - periodic, imprecise, regional, often anecdotal. So, I'd sum up by guessing that big summer shocks initiated action and widened trading ranges with momentum propagated by the nature of news flow in commodities. Perhaps the memory of recent years also makes a retracing more likely?

Chris the Contractor said...

I've noticed similar trending averages over the past year. As a contractor, I gauge my workload to determine the direction of the construction industry. When things pick up, I invest and when things slow down, I sell.

I'm not sure we are heading in that direction but the last thing we need is another bubble that only leads us to problems.

Anonymous said...

Hi Ernie

Why would I like to know more about your strategy as it is highly unstable over time? Not very good sharpes in either time period.



Ernie Chan said...

Hi Jose,
Your point about roll returns is an interesting one.

ZS did go into a prolonged backwardation since around 201109or so. But it was also in backwardation in early 2009, yet the returns of the strategy was not particularly strong then.

In terms of the magnitude of the roll return, it was also higher than average since 201109 or so. But again, it peaked previously around early 2009, without much effect on returns.

So while I cannot dismiss backwardation and high roll return from being some of the factors, I don't think they are the complete picture.

Ernie

Ernie Chan said...

Mdbllbr,
Your explanation sounds interesting and plausible. Is there any other reader who agree/disagree with this fundamental observation?

Also, please tell me the last 4 digit of your phone no. if you want to contend for the "prize".

Ernie

Ernie Chan said...

Hi Jozef,
Renaissance Technologies' Medallion Fund, which trades futures, scored average annual returns of about 35%, after fees, since its inception in 1988, with only one money-losing quarter since 1995, a slight 0.5% drop in the first quarter of 1999.

I think their long term return/drawdown is much better than the 1:1 that you suggested is possible.

The trick is ultra-short holding period.

Ernie

Ernie Chan said...

Hi Theo,
Yes, I also discussed cross-sectional vs. time-series momentum strategies in the book.

I like your explanation about why time-series momentum suffers after financial crises. However, it is really a generic explanation of momentum crashes, not quite the alternative, fundamental explanation specific to ZS that I was hoping for.

Ernie

Ernie Chan said...

Hi Dan,
Thanks for telling us about the USDA Acreage and Grain Stocks Report.

Are you saying that there were no such reports prior to 2011?

Or are you suggesting that prior to 2011, the reports simply didn't generate much volatility or interest because of lack of surprises?

Ernie

Ernie Chan said...

Hi Chris the Contractor
Maybe you can start selling your private workload data as signals to traders!
Ernie

Ernie Chan said...

Hi Anon,
Firstly, the Sharpe ratio since 2011/7 is just over 1, which is pretty good for a momentum strategy on a single future. The annualized return / max drawdown is 1.5, which is again quite decent. (Reader Jozef Rudy above would agree with me!)

Secondly, I would argue that most strategies die sooner or later. You might think that you have found, in backtest, a strategy that worked since the 1900's, but that is likely due to survivorship bias: once you start trading it, it is quite likely to fail in the not-too-distant future. Given this general observation, we should not be afraid to trade strategies that didn't used to work, but suddenly started to do so due to some identifiable market regime change, and *vice versa*.

(Note the keyword "identifiable". What I am trying to ascertain is whether there is a fundamental basis for the regime change, and if so, whether the fundamental condition persists.)

Ernie

Mdbllbr said...

Hi Ernie,

My last 4 last numbers are 3458

Dan Goldman said...

Hi Ernie,
These reports have been around for a long time; I just think that the 2011 and 2013 reports were unusually surprising/impactful...and they sandwiched a severe drought in 2012, all lending credence to Mdbllbr's post.

Jozef Rudy said...

Hi Ernie,

I am not sure you are aiming at the proper league. Medallion fund employs tens of PhDs. You are a single fighter and there is no way you can re-estimate and come with new models in a same pace. Being in CTA league does not require you to do the same, you can use the same models for decades without a significant change.

From my perspective, aiming at CTA performance is more proper.

Also, Renaissance Technologies has another fund, which is not exclusive for employees to invest in, and it has much worse performance.

Jozef

Ernie Chan said...

Hi Dan,
Thanks for the clarification!
Ernie

Paul said...

Hi Ernie

This is first time I post reply here. First of all thank you for writing such a great blog. It really helps a lot.

I have a question about your earlier reply about "all strategies dying sooner or later".

When a strategy not making money any more, does it mean that we need to rerun the full backtest and parameter estimations to ensure it is "dead" before abandon it too early?

Thanks


When we find a

Ernie Chan said...

Hi Paul,
When a strategy is dying, I think it is most important to find out the fundamental reason why. I gave the example of GLD-GDX in the book. Once you understood the fundamental reason, you can make a better decision whether or not to abandon it forever.
Ernie

Dave newbie said...

Corn. I agree with Mdbllbr of the nature of the change. I think one of those factors is highly related to corn. Corn and soy beans compete for production land. The constant rise in corn demand because of substantial processing facilities built in the last two decades. Farming communities have been amazed by the rise in corn prices and as a result are producing less soy beans. China demand for soy beans continues to rise significantly. Oddly the ethanol tax credit expired in 2011. Corn and soy bean prices are now less influenced by congress and more by market forces. 2630

Anonymous said...

Slightly off topic. Could you provide the code where kalman filter can be used for single asset price as a mean reversion and momentum signal. You have touched on this concept in your book regarding single asset but I am struggling to code it. Please provide it in the usual protected page with other codes. Thanks John

Ernie Chan said...

Hi all,
I will pick a "winner" for the best explanation on August 16 ... so more comments are welcome!
Ernie

Ernie Chan said...

Dave newbie,
Thanks for your explanation ... makes sense to me.
Ernie

Ernie Chan said...

Hi Anon,
I haven't actually implemented the single asset Kalman filter model in Matlab. Please elaborate on your specific difficulty doing so.
Ernie

Anonymous said...

Hi Ernie, regarding the single asset class kalman filter. I was wondering how to interpret the result if I put single asset prices through the code you have given. I am beginning to sound confused because I have never come across this concept before and learning. Does the code stay same. I wanted to see some visible examples of kalman used with financial data to understand it better. Thanks, John

Anonymous said...

Hi Ernie

I have a promising strategy which is thoroughly backtested and ready to be implemented with real cash.

How do I get initial seed capital?

Thanks

Anonymous said...

What is a typical P&L split for a hedge fund portfolio manager? For example, for a fund charging a 10% performance fee, I've heard a typical PM gets about half of that.

Say I manage $50m. I generate 10% return=$5m. The management company takes out 10% performance fee on that=$500k. The PM gets half=$250k.

Is this low,high, reasonable?

Ernie Chan said...

Hi Anon,
You can sign up with a prop trading firm - they will provide you with seed capital to trade. At some firms, they will ask you to put up some of your own capital as well.

Ernie

Ernie Chan said...

Hi Anon,
Typical hedge fund charges 20% performance fee. An employee of the fund may or may not get a fixed percentage. But yes, 50% split is possible.
Ernie

Anonymous said...

Thanks for your reply. Having a good strategy, what would say is the difference between working for a hedge fund or prop-trading firm?

How would you choose between the two?

Are compensations typically the same?

Ernie Chan said...

Hi Anon,
When you said "prop trading firm", I assume you mean those where the partners put up all capital, and you are employed as a trader, getting a salary and bonus? If so, there is little difference from working at a hedge fund.

(That is different from certain prop trading firms that require you to put up some of your own risk capital in return for a significant portion of the profits. You get no salary from those firms.)

Ernie

Frank said...

1) US government subsidize biodiesel production till ~2011
2) One of soybean's main uses was to produce biodiesel
3) Other raw materials can substitute soybean in biodiesel production
4) Biodiesel is a substitute for crude oil products

2866

HK said...

Hi Ernie,

I am reading your book everyday and it is very well written:) To be an institutional or personal algorithmic trading professional in institution, do you think any higher education helps? Let's say someone like me having a degree, is there any master that would help me to gain the suitable knowledge? I looked at financial engineering kind of masters in Hong Kong but the courses are mainly (or I should say "all about") about the calculations of derivative products but not trading.

From my understanding, algorithmic trading is mainly about math+stats+programming. My degree and job are about programming so basically I keep trying to improve my math and stats knowledge for trading purpose. Does this direction make sense to you?

-HK

HK said...

I mean "To be an institutional or personal algorithmic trading professional" without the "in institution" part.

-HK

Ernie Chan said...

Frank,
Your explanation is very insightful. If anyone disagrees with that, please let us know!
Ernie

Ernie Chan said...

Hi HK,
More formal education may help you find a job in institutional algo trading, but not necessarily improve the profitability of your models. Self-learning is the most efficient, mainly by reading a large number of books and papers. For basic knowledge, you can consider MOOC.
Ernie

Anonymous said...

Hi Ernie,

I am still struggling to implement the Kalman Filter for a single asset price series. I was mumbling when I was trying to explain what I was looking for. But then I found this post and the picture in this post is exactly what I am looking for. COuld you please provide the R code for the same in the usual place where other codes of your book2 are. for Example I want to feed S&P 500 daily prices.

Link: http://intelligenttradingtech.blogspot.in/2010/05/kalman-filter-for-financial-time-series.html

Thanks
John

Ernie Chan said...

Hi John,
I am afraid that I don't program in R. Furthermore, I don't presume to understand exactly how a different author implement their own Kalman Filter strategy. However, I would refer you to this R financial expert for help: http://quanttrader.info/public/
Ernie

HK said...

Hi Ernie,

I never try mean reversion model in real life trade. Base on my understanding from your new book, mean reversion model with good backtest suppose to keep working well and stop lose may be never needed. It is hard to apply stop lose for mean reversion model and even if I apply one, it would be far away from the reasonable "mean reversion moving range". So is that if somehow the mean reversion model doesn't work, then the lose of a trade would be so big? So the risk of a single mean reversion model trade can be huge especially for someone like me who is not expert to calculate the mean reversion relationship well enough? Thanks.

-HK

Ernie Chan said...

Hi HK,
Yes, mean reversion is supposed to work most of the time, but does incur tail risk. However, if the frequency of the trades is high enough, the cumulative profit will be larger than the tail risk, which can be controlled by a stop loss.
Ernie

HK said...

Hi Ernie,

For intraday trading, is that hard for individual to daily gain profit from mean reversion models with retail internet speed and broker like IB? So that if I want to do intraday trading everyday, I should better focus on momentum models?

-HK

Ernie Chan said...

Hi HK,
Individual retail traders can certainly profit from daily mean reversal trades.

What may be difficult to profit from is high frequency (millisecond) mean reversion trades if you use IB. But then, there are other brokers such as Lightspeed or Mirus futures that you can use as retail trader that offers better speed.

Ernie

HK said...

Hi Ernie,

I think I haven't saw an example of daily base intraday mean reversal example but there is a chapter of intraday momentum in your new book...so I thought it should be difficult...

-HK

Ernie Chan said...

Hi HK,
See example 4.1
Ernie

iamatrader said...

The 3 most compelling alternative hypothesis during these time frames are:

1) (Weather) - Severe 2011-2012 droughts in US and Brazil caused endogenous dislocations in soy and crop prices and the resulting ZS regime change (full credit to Mdblbr)
Link: http://www.ers.usda.gov/topics/in-the-news/us-drought-2012-farm-and-food-impacts.aspx#.UgrxW2Sbjs8

2) (Consumption) - Significant whipsaw in US biodiesel production (50% decrease between 2008-2010, but 300% increase between 2010-2012) caused exogenous ZS regime changes (credit, I believe, to Dan)
Link: http://www.soystats.com/2012/page_24.htm and http://www.biodieselmagazine.com/articles/7658/u-s-census-releases-2010-biodiesel-production-estimates

3) (Regulatory/Structural) - As a reaction to soaring farmland prices, Brazilian regulatory reinterpretation of agricultural laws in August 2010 limiting foreign ownership and investments caused infrastructural issues in Brazil, just as it was becoming the largest global soy producer
Link: http://www.aljazeera.com/indepth/features/2012/09/2012913112137744956.html and http://www.bloomberg.com/news/2013-03-26/brazil-soy-boom-bottlenecked-as-china-left-waiting-commodities.html

Of the three, the first hypothesis is the most likely, but interestingly the second seems most correlated to your ZS strategy return data (but as you teach correlation <> cointegration or causation!)

I submit in the third hypothesis because as a market structure trader, I love seeing governments interference causing unintended consequences (like 15 miles of unloaded soybean trucks - and profitable trading opportunities). Also it gave me a last minute entry opportunity to be in the running for the prize. :)

Then again, if anyone else does win the primary prize for the best theory, I would love if you would also consider an 'alternate' prize to the runner-up…!

0211

iamatrader said...

My apologies, I believe Frank and Dave were the first proposing theory #2.

Then again It was late at night and my mind was going through its own regime change.

Ernie Chan said...

Hi iamtrader,
Thanks for your additional insight concerning the Brazilian regulatory change!

To all: 2 more days left for additional answers to my question before I announce the winner!

Ernie

HK said...

Hi Ernie,

I have finished reading this research paper regarding support and resistance that was referenced in your new book:

http://www.ny.frb.org/research/epr/00v06n2/0007osle.pdf

I am wondering why would federal reserve banks, universities allow/ask researchers/scholars to release this kind of reports/articles to the public? Why don't they save these for themselves?

I find out Carol Osler has released some interesting articles regarding technical analysis and she has some authority in financial gov/universities.

Do you use ideas.repec.org to search for papers?

-HK

Ernie Chan said...

Hi HK,
I seldom look for papers randomly - I rely on knowledgeable readers or other articles to tell me about useful papers.

Researchers publish papers because that's what they are hired to do by their employers.

ERnie

HK said...

Hi Ernie,

Is there any objective way to define support and resistance level in trading system?

-HK

HK said...

Hi Ernie,

I just remember your new book mentioned the possible ways to define the rules with the orders kind level of data/order flow. If I only know the price and volume with basic live price feed, is there way to define support and resistance? How about interdays?

-HK

Mdbllbr said...

Hi,

I would like to comment the third hyphotesis proposed by iamatrader.

1 - The limitation of foreign ownership of farmland has not limited the supply of agricultural commodities from Brazil. The government statistics shows the total land used to grow soy has been increasing since 2009.

2 - The infrastructure bottlenecks doesn't reduce the supply either. The logistic issue just increase the transportation cost and they have this issue for a long time. Every year during the export season the press report about it.


Mdbllbr

Mdbllbr said...

One more comment about the Ernie's question.

I answered why ZS should start to display trending behavior since july 2011 but I haven't answered why not before.

The answer is the end of the european sovereign debt crisis and decreased euro break up risk since ECB started to buy sovereign bonds.

Before that the global demand could colapse and all assets was influenced by that single risk factor.

After that other risk factors started to influence the asset prices and most of the momentun strategies started to work again.

I have one strategy for trading equity index futures that show this behavior.

Mdbllbr

Ernie Chan said...

Hi HK,
Different technical analysts have different ways to define support and resistance, and I don't use any of them.

Research indicates that a lot of traders simply use the nearest integer price as support and resistance.

Ernie

Anonymous said...

I think the interesting question here is why trend following in general stopped working 2010-about mid 2011. Since these strategies typically trade at least 50 different futures, there must be a general explanation rather than a different explanation for each contract.

The answers provided concerning soybean futures fall nicely under the "narrative fallacy" that Taleb talks a lot about. There seems like there are several blog readers that could become academics :)

I could come up with a different explanation for every contract. However, this is purely a narrative and likely not very useful. Therefore, the true answer lies in nailing down why trend following in general stopped working.

Looking back to 1920, trend following has experienced several periods of sideways or negative P&L, but it has always kicked in again after about 2-3 years.

HK said...

Hi Ernie,

Thanks for your explanation but I am confused. In your new book, you talked about there is paper shows that support and resistance have some predictive power and you showed a high frequency model involving order flow data with support and resistance. So is that you consider 1. support and resistance are subjective and cannot be well defined in your trading system? or 2. support and resistance are not reliable factors to be include in trading system?

-HK

Ernie Chan said...

Hi HK,
Yes, I quoted Osler's paper about a stop hunting strategy using support and resistance levels. And I wrote that those levels are either reported by banks or brokerages daily, or just round numbers. I never wrote that I traded any such strategy myself, nor did I write that I have a system for calculating such levels. Finally, this strategy is completely different from the order flow strategy that I discussed.

Ernie

Ernie Chan said...

Hi Anon,

Actually, I already pointed out one generic reason why momentum strategies stopped working after 2008. And when momentum strategies stopped working, they do eventually recover historically. So their recovery in 2011 may not require any special explanations.

However, I am looking for alternative economic hypotheses. I disagree with you that these hypotheses have "narrative fallacy". Some of these narratives actually have testable consequences. My favorite example is why GLD-GDX fell out of cointegration in mid-2008. The explanation was high oil price. And lo and behold, if you add oil price as an extra price series, the triplet cointegrates quite well during that period.

To look for testable consequence of the explanations offered here, we may see if similar cause and effect occur for another commodity.

In general, commodities (just like most other assets) are affected by general factors as well as specific factors. We should not ignore explanations due to specific factors since, as Mdbllbr said, they may dominate that commodity over some period.

Ernie

Ernie Chan said...

Ladies and Gentlemen: Thank you all for your very thoughtful arguments and suggestions. The contest is over! And the winner is ... you might have guessed it ... Mdbllbr!

But first look at some other good suggestions:

1) Dan suggested that USDA reports for 2011 and 2012 were big surprises, thus inducting momentum.

I agree that surprising news do generate momentum, but usually just in the immediate aftermath of the report. Why should they create trends for the entire year?

2) Dave newbie suggested that demand for soybean is increasing while supply is dropping.

That might seem to suggest unidirectional increase in prices since 2011, which is not the case.

3) Frank suggested also that supply is dropping due to the end of biodiesel subsidy.

Again, this would have just explained a long-term increase in prices that didn't happen.

4) iamatrader suggested a drop in Brazilian soybean production may do this.

This has the same problem with explanations 2 and 3.

5) Finally, Mdbllbr said that prior to 2011, the Euro crisis forced a single risk factor across many assets, while after 2011 the market turned its focus to endogenous (specific) factors unique to the soybean market. In particular, weather forecasts is one. Since weather forecasts count as surprises, and unlike the USDA report, weather forecasts come out regularly, they can and do produce short term trend in prices.

Is this hypothesis testable? Sure it is! You would just need to correlate the reports of "surprising" weather forecasts (much like earnings surprises in equities markets) with any subsequent trend in prices over the last 2 years.

Congratulations, Mdbllr, please email me for your prize. For readers 1-4, please also email me if you wish to know a bit more about my strategy. In your emails, please include your complete phone no. so that I can verify your identity by calling.

Have a good weekend!
Ernie

hk said...

Hi Ernie,

Is it possible to objectively backtest support amd resistance? If I setup a backtest to record recent low volatility range then see if it has any impact in trend following strategy in years of data, would this a reasonable way to backtest support and resistance?

-hk

Ernie Chan said...

Hi HK,
Surely it is possible to backtest support and resistance. You would just need to buy a book on technical analysis and see the various definitions of support and resistance.

Your definition of S and R isn't too clear to me, however.
Ernie

HK said...

Hi Ernie,

Other than Sharpe Ratio and Maximum Drawdown, what else should we look at in backtest report?

-HK

jose antonio said...

Hello Ernie

Where can we find a database of historical weather forecast?

Thanks

Ernie Chan said...

Hi HK,
You should look at the ratio between APR and Maximum Drawdown. This ratio should be better than 1.
Ernie

Ernie Chan said...

Hi Jose,
I haven't looked into such a weather forecast database yet, but I suspect many data suppliers for commodities traders would have this for sale. Perhaps other readers here know about this?
Ernie

Eric said...

To determine if reversion to the mean or trending will work best ask one question; Does the perceived value of an asset nearly match its current price? If yes; reversion to the mean will work best. If no; trending will work best as the market moves towards a new perceived value.

Reversion to the mean works when price discovery is two forces going back and forth on the pros and cons of an asset which results in a bouncing around a mean. Trends happen when something fundamentally has changed. Think of it as a light bulb slowly going off in every investors head as they each realize; prices are wrong at this level.

In 2008 the market trended down to a low value. After the market overshot and snapped back the market began the process of price discovery. As the economy recovered; it did so in a choppy manner because the economy and by extension the market was fragile. We had two forces going back and forth on the pros and cons of all assets. Are good times here again or are we going to crash again? Everyone was searching for the correct price of an asset and the wide opinions = volatility. This is perfect for reversion to the mean strategies and horrible for trend strategies.

What happened in 2011? The market started trending because the economy fundamentally improved. As this light bulb goes off in the minds of investors the market will continue to trend. Eventually it will overshoot and snap back and begin the process of price discovery again. (5849)

Ernie Chan said...

Hi Eric,
Thank you for your comment ... it does make sense as a general explanation of regimes change between mean reversion and momentum, but I was looking for a reason that is more specific to ZS.

In any case, in my comment on Aug 16, we have announced the winner of the contest. Please check that out!

Ernie

Anonymous said...

Hi Ernie

Might the launch of the pureplay Teucrium Soybeans ETF in September 2011 be a factor.I note on your chart that the returns on your strategy chart begin to climb at a time coincident with this point.
regards conor

Ernie Chan said...

Hi Anon,
Interesting thought! Thanks!
(I wonder what the ETF NAV was at the initial launch though.)
Ernie

Ernie Chan said...

Hi all,

Please see my tweet (@chanep) for an interesting follow-up to my article.

Ernie

Unknown said...

Hi Ernie,

I really appreciate your work !

I back-tested a momentum strategy on the US equity market that successfully recorded sustainable returns during different market regimes. I am long on average 10 stocks and I rebalance my portfolio on a monthly basis. I back-tested this strategy from 2002 to 2014 on high volume stocks only. Since 2015 the members of my portfolio are available at the beginning of each month. Please look at my website and let me know what you think.
www.thehedgefundproject.com/

regards

Unknown said...

Hi Ernie,

I really appreciate your work !

I back-tested a momentum strategy on the US equity market that successfully recorded sustainable returns during different market regimes. I am long on average 10 stocks and I rebalance my portfolio on a monthly basis. I back-tested this strategy from 2002 to 2014 on high volume stocks only. Since 2015 the members of my portfolio are available at the beginning of each month. Please look at my website and let me know what you think.
www.thehedgefundproject.com/

Ernie Chan said...

Looks good! Do you have plans to trade this strategy live?

Ernie