tag:blogger.com,1999:blog-35364652.post1169831461797558092..comments2022-05-25T08:54:23.376-04:00Comments on Quantitative Trading: A factor model that I can believe inErnie Chanhttp://www.blogger.com/profile/02747099358519893177noreply@blogger.comBlogger15125tag:blogger.com,1999:blog-35364652.post-64420262164850035372010-08-23T21:14:33.281-04:002010-08-23T21:14:33.281-04:00Olivier,
You can scrape off such info from, e.g., ...Olivier,<br />You can scrape off such info from, e.g., finance.yahoo.com. An automated program can probably speed this up quite a bit.<br />ErnieErnie Chanhttps://www.blogger.com/profile/02747099358519893177noreply@blogger.comtag:blogger.com,1999:blog-35364652.post-34061399930527151392010-08-22T15:21:57.976-04:002010-08-22T15:21:57.976-04:00Hi Ernie,
While dated I think this is a great thre...Hi Ernie,<br />While dated I think this is a great thread. I would like to replicate such factor models but then comes the key question: How do I get the required dataset of fundamental data for backtesting and optimization (Ideally free or affordable for a non professional enthusiast)?Olivier Van Paryshttps://www.blogger.com/profile/08587068562837322765noreply@blogger.comtag:blogger.com,1999:blog-35364652.post-9202213665583179612010-08-22T15:19:48.919-04:002010-08-22T15:19:48.919-04:00Hi Ernie,
While dated I think this is a great thre...Hi Ernie,<br />While dated I think this is a great thread. I would like to replicate such factor models but then comes the key question: How do I get the reuired dataset of fundamental data required for backtesting and optimization (Ideally free or affordable for a non professional enthusiast)Dr Van Parysnoreply@blogger.comtag:blogger.com,1999:blog-35364652.post-69217290866952061452007-06-21T12:15:00.000-04:002007-06-21T12:15:00.000-04:00Dear Quantonymous,Thank you for the links to the i...Dear Quantonymous,<BR/><BR/>Thank you for the links to the interviews.<BR/><BR/>The question that Simon asks "when is eventually?" is a good question. Certainly statistical arbitrage is not like convertible arbitrage where there is a definite time in the future where the two sides must converge. This is also the reason that Edward Thorpe doesn't like statistical arbitrage. However, there is a good, albeit statistical answer, to the question of convergence time scale. I have written about it in my blog somewhere that if you apply the Ornstein-Uhlenbeck model to a mean-reverting spread, you can estimate the convergence time.<BR/><BR/>ErnieErnie Chanhttps://www.blogger.com/profile/02747099358519893177noreply@blogger.comtag:blogger.com,1999:blog-35364652.post-8735907667131232482007-06-20T19:42:00.000-04:002007-06-20T19:42:00.000-04:00Hi again,Here are two very interesting articles:In...Hi again,<BR/><BR/>Here are two very interesting articles:<BR/><BR/>Interview of Jim Simons with Seed Magazine and Institutional Investor:<BR/><BR/>http://www.seedmagazine.com/news/2006/09/seed_interview_james_simons_2.php<BR/><BR/>http://mikeonghai.blogspot.com/2005/12/rare-interview-of-james-simons-of.html<BR/><BR/>Interview of D.E. Shaw with Wired:<BR/><BR/>http://www.wired.com/wired/archive/5.01/ffshaw.html?topic=&topic_set=<BR/><BR/>They say of Shaw in page 4:<BR/><BR/>"During Shaw's education at Morgan Stanley, he decided pairs trading was not going to be the way he would make his fortune."<BR/><BR/>In the case of Simons in the Institutional Investor interview:<BR/><BR/>"We look for things that can be replicated thousands of times. A trouble with convergence trading is that you don't have a time scale. You say that eventually things will come together. Well, when is eventually?"<BR/><BR/>Sorry for all the questions but this is a fascinating subject and unfortunately, there is no Quant department at my university.<BR/><BR/>Sincerely,<BR/><BR/>QuantonymousAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-35364652.post-10663475984806597442007-06-20T14:30:00.000-04:002007-06-20T14:30:00.000-04:00Dear Quantonymous,I don't know exactly what the ho...Dear Quantonymous,<BR/><BR/>I don't know exactly what the holding period for that factor model is, but it is likely to be measured in weeks, if not months.<BR/><BR/>I don't believe you need "a team" to develop a successful HF trading system, nor do you need any unusually powerful computer beyond a good PC. You need good quality HF data, a good strategy, and a good programmer to build an efficient automated execution system (<B><I>Commercial break</I></B>: such as those programmers who work for my consulting company!) It won't take more than a few months to research and build a system -- whether it is going to be profitable or not, however, is another question.<BR/><BR/>I don't think anyone know what percentage of hedge funds use HF systems, but I would bet that a majority of funds with assets greater than $1B have such systems in place. With regard to competition leading to diminishing returns, that's true for any strategy. However, as I explained before, there is no advantage in being a big hedge fund in this situation.<BR/><BR/>My own HF strategy is still in R&D phase. I don't know whether Shaw and Simon "quickly abandoned" convergence strategies or not -- I am not privy to their funds' secrets. As for why someone would consider abandoning them in the past few years, I am going to post a new article on this topic.<BR/><BR/>ErnieErnie Chanhttps://www.blogger.com/profile/02747099358519893177noreply@blogger.comtag:blogger.com,1999:blog-35364652.post-19044118037640773812007-06-20T13:14:00.000-04:002007-06-20T13:14:00.000-04:00In the case of factor models for commodities, were...In the case of factor models for commodities, were these unsuccessful on a short term basis as well as a long term basis?<BR/><BR/>For high frequency trading, how easy is it really to develop a successful system? How large a team, what kind of computational power and how much time would it take to develop a system on average?<BR/><BR/>What percentage of hedge funds, in your opinion, use such systems? With increase use of these techniques, won't they eventually become useless or is the market so large that, for very large markets, opportunities will remain? Isn't it unreasonable to believe that a small new hedge fund could possibly achieve great returns when the larger funds have much greater computational power?<BR/><BR/>Do you use high frequency trading for your own account? I see that you focus a lot on convergence arbitrage on this blog. I find it interesting though that both Shaw and Simons quickly abandonned this technique early in their careers. Why is this?<BR/><BR/>Thanks again,<BR/><BR/>QuantonymousAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-35364652.post-40541708930700984932007-06-20T08:06:00.000-04:002007-06-20T08:06:00.000-04:00Dear Quantonymous,I remember reading somewhere tha...Dear Quantonymous,<BR/><BR/>I remember reading somewhere that a very successful hedge fund also thought that factor model would work well with commodities futures. But it turned out to be a disaster. The fund became successful later by switching to technical trend- following models.<BR/><BR/>High frequency models are not hard to develop if you have the tick-by-tick historical data to backtest on. They can take long and short positions at different times, but they are not usually market-neutral. It is true that the trade size is limited for high frequency trading due to liquidity constraint. Therefore, if you, like Rentec, have >$10B to dispose of, high frequency trading in stocks won't do very much good.<BR/><BR/>Even though stocks have higher transaction costs, they are suitable for high frequency trading because of their diversity (at least 3,000 symbols vs maybe 30 symbols for futures) -- they can generate more signals and therefore statistical significance.<BR/><BR/>ErnieErnie Chanhttps://www.blogger.com/profile/02747099358519893177noreply@blogger.comtag:blogger.com,1999:blog-35364652.post-21157365884946747012007-06-19T19:35:00.000-04:002007-06-19T19:35:00.000-04:00Thanks for the quick reply.With respect to factor ...Thanks for the quick reply.<BR/><BR/>With respect to factor models, it would appear to me that commodities would make for more accurate models given that prices are largely decided by supply and demand.<BR/><BR/>I remember you mentionning that the hedge funds that you worked with that had the highest Sharpe ratios used high-frequency trading systems. How complicated are such systems to develop and are they mainly based on multivariate time series? Do they tend to be long only and low leverage?<BR/><BR/>I find it intriguing that high frequency funds like Rentec, SAC and D.E. Shaw trade stocks as well as derivatives. Why would a high frequency system trade stocks given the higher transaction costs?<BR/><BR/>I also find it interesting that the new Institutional Equity fund from Rentec is a low frequency trading fund with definate elements of fundamental analysis, since the p/e ratio of the long equities is significantly lower than the short. Does this imply that high frequency systems are too difficult to impliment for large funds? <BR/><BR/>Thanks,<BR/><BR/>QuantonymousAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-35364652.post-11764594435759082102007-06-18T20:13:00.000-04:002007-06-18T20:13:00.000-04:00Dear Quantonymous,I don't know much about Niederho...Dear Quantonymous,<BR/><BR/>I don't know much about Niederhoffer, except that the risks he takes on are too much for my taste. (I didn't learn much from a finance seminar he gave at NYU a couple of years ago, except that he enjoyed theatrics.)<BR/><BR/>I do agree that time series analysis is more useful for short-term trading, simply because for short time scale, fundamental factors are not going to mean very much -- except when they change dramatically during that short time (such as earnings announcements).<BR/><BR/>Certainly, creating a portfolio of futures or stocks and rebalancing them using Universal Portfolio algorithm is a good strategy.<BR/><BR/>On a short time scale (e.g. daily), universal portfolio is just a constant rebalanced portfolio. So if you include cash as a security, it will maintain a constant proportion of cash vs. stocks, i.e. constant leverage. This is the same as Kelly criterion. But how do you determine the exact value of the leverage factor? In Universal portfolio, the factor is determined by evaluating long-run profits of each different allocation, whereas in Kelly's criterion it is determined by the returns vs risk of the strategy. In both cases, better returns or profits yield higher leverage. They are therefore consistent, and although I don't have a mathematical proof, I bet that the leverage factor will be exactly the same based on either method. (Kelly's criterion is silent on how you allocate capital among different stocks.) <BR/><BR/>Thanks for your excellent questions!<BR/><BR/>ErnieErnie Chanhttps://www.blogger.com/profile/02747099358519893177noreply@blogger.comtag:blogger.com,1999:blog-35364652.post-89386199632890765572007-06-18T18:49:00.000-04:002007-06-18T18:49:00.000-04:00Hi,What are your thoughts of Niederhoffer? After "...Hi,<BR/><BR/>What are your thoughts of Niederhoffer? After "blowing up" a couple years back, it seems that he now achieving amazing returns of about 50% for the last couple of years. His website, www.dailyspeculations. com, states that "The firm employs proprietary programs that predict short-term moves based on the interactions between multivariate time series." Could you expand on that? Are time series only useful for detecting short term fluctuation for high-frequency systems and not long term trends?<BR/><BR/>Also, I still find the idea of Universal Portfolios very interesting and some studies I've looked though seamed to have attained interesting results. I know that the big difficulty is computational as well as associated to transaction costs. However, what if one was to create a "Universal Portfoilio" of 10 or so futures selected on the basis of fundamental analysis and let the portfolio be rebalanced with this concept? Also, I don't understand how Universal Portfolios satisfy the Kelly criterion. With Universal Portfolios, aren't you selling gains to put then into losers? Doesn't Kelly say to increase leverage of winners and decrease that of losers?<BR/><BR/>Thanks,<BR/><BR/>QuantonymousAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-35364652.post-12869454525481324482007-06-18T09:26:00.000-04:002007-06-18T09:26:00.000-04:00Dear Anonymous, When you say that all publicly ava...Dear Anonymous, <BR/>When you say that all publicly available information should already be reflected in the stock price, you are stating the "efficient market hypothesis". Most equity financial research is based on the notion that this hypothesis is wrong at least some of the time. The reason the market cannot discount all information correctly is that there are many irrational players (small investors? traders with bad pricing models?) and furthermore, every pricing model is just an approximation to the ultimate "true" price, if there is such a thing. Therefore, there are always pricing models that are better, and thus more profitable, than others.<BR/>ErnieErnie Chanhttps://www.blogger.com/profile/02747099358519893177noreply@blogger.comtag:blogger.com,1999:blog-35364652.post-74307176564909601022007-06-17T22:29:00.000-04:002007-06-17T22:29:00.000-04:00This sounds to me like simple data mining of last ...This sounds to me like simple data mining of last quarter's publicly available information. Shouldn't this already be reflected in the stock price? Seems to me the market, being a discounting mechanism that reflects the aggregate wisdom of all participants, is the ultimate factor model. What's the rational for beating it at its own game (discounting information)? <BR/><BR/>Rentec does use fundamental inputs, at least in their equity program.<BR/><BR/>This is an interesting blog.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-35364652.post-4164939980647054572007-06-15T08:16:00.000-04:002007-06-15T08:16:00.000-04:00Dear Anonymous,Fundamental analysis is often part ...Dear Anonymous,<BR/><BR/>Fundamental analysis is often part of a fully automated trading system: fundamental factors such as advertising expenses and so forth are simply numerical variables that are input to the program.<BR/><BR/>When people say D.E. Shaw uses fundamental analysis in a hybrid system, they mean more than entering some fundamental factors into a model: they probably mean in-depth analysis of companies that may take into account the quality of the management and other such intangible factors which cannot be quantified easily. <BR/><BR/>Quants who work for hedge funds work in both stat arb and risk management. However, only large hedge funds can afford quants that work on risk mgmt alone -- most smaller and medium size hedge funds employ quants to develop strategies, not just risk mgmt.<BR/><BR/>To develop a successful arbitrage strategy requires only one good brain: it doesn't require a team.<BR/><BR/>ErnieErnie Chanhttps://www.blogger.com/profile/02747099358519893177noreply@blogger.comtag:blogger.com,1999:blog-35364652.post-35865102560860152042007-06-14T21:37:00.000-04:002007-06-14T21:37:00.000-04:00Once again great post!I was wondering what your ap...Once again great post!<BR/><BR/>I was wondering what your approach to investing is. Is your goal to develop a fully automated trading system or to develop a "hybrid" system in which both fundamental and quantitative analysis compliment eachother? I was intrigued by the fact that the D.E. Shaw Group seems to use a hybrid approach as opposed to Rentec.<BR/><BR/>Do most quants working for hedge funds work in risk management or in the statistical arbitrage? With the emergence of so many quant funds, would it not be more logical to use quantitative analysis more for risk management than arbitrage? Unless a fund has a large team of quants like at Rentec, would it not be futile to focus too much on arbitrage?<BR/><BR/>ThanksAnonymousnoreply@blogger.com