In my last post I referenced a paper with David Rothschild that we posted earlier this month. The main goal of that work was to try to examine the manner in which new information is transmitted to asset prices, and to distinguish empirically between two influential theories of trading. To accomplish this we examined in close detail every transaction on Intrade over the two week period immediately preceding the 2012 presidential election. We looked at about 84,000 transactions involving 3.5 million contracts and over 3,200 unique accounts, and in the process of doing so quickly realized that a single trader was responsible for about a third of all bets on Romney to win, and had wagered and lost close to 4 million dollars in just this one fortnight.
While this discovery was (and remains) incidental to the main message of the paper, it has attracted a great deal of media attention over the past couple of days. (About a dozen articles are linked here, and there have been a couple more published since.) Most of these reports state the basic facts and make some conjectures about motivation. The purpose of this post is to describe and interpret what we found in a bit more detail. Much of what is said here can also be found in Section 5 of the paper.
To begin with, the discovery of a large trader with significant exposure to a Romney loss was not a surprise. There was discussion of a possible "Romney Whale" in the Intrade chat rooms and elsewhere leading up to the election, as well as open recognition of the possibility of arbitrage with Betfair. On the afternoon of election day I noticed that the order book for Romney contracts was unusually asymmetric, with the number of bids far exceeding the number of offers, and posted this:
This was circulated quite widely thanks to the following response:
In a post on the following day I explained why I thought that is was an attempt at manipulation:
The strategic manner in which these orders were placed, with large bids at steadily declining intervals, suggested to me that this was an experienced trader making efficient use of the available funds to order to have the maximum price impact. The orders lower down on the bid side of the book served as deterrents, revealing to counterparties that a sale at the best bid would not result in a price collapse. This is why I described the trader as sophisticated in my conversations with reporters at the WSJ and Politico. Characterizing his behavior as stupid presumes that this was a series of bets made with in the conviction that Romney would prevail, which I doubt.
But if this was an attempt to manipulate prices, what was it's purpose? We consider a couple of different possibilities in the paper. The one that has been most widely reported is that it was at attempt to boost campaign contributions, morale, and turnout. But there's another very different possibility that's worth considering.
On the afternoon of the 2004 presidential election exit polls were leaked that suggested a surprise victory by John Kerry, and the result was a sharp rise in the price of his Tradesports contract. (Tradesports was a precursor to Intrade.) This was sustained for several hours until election returns began to come in that were not consistent with the reported polls. In an interesting study published in 2007, Snowberg, Wolfers and Zitzewitz used this event to examine the effects on the S&P futures market of beliefs about the electoral outcome. They found that perceptions of a Kerry victory resulted in a decline in the price of the index, an effect they interpreted as causal. The following chart from their paper makes the point quite vividly:
Motivated in part by this finding, we wondered whether the manipulation of beliefs about the electoral outcome could have been motivated by financial gain. If Intrade could be used to manipulate beliefs in a manner that affected the value a stock price index, or specific securities such as health or oil and gas stocks, then a four million dollar loss could be easily compensated by a much larger gain elsewhere. Could this have provided motivation for the behavior of our large trader?
We decided that this was extremely unlikely, for two reasons. First, the 2004 analysis showed only that changes in beliefs affected the index, not that the Intrade price caused the change in beliefs. In fact, it was the leaked exit polls that affected both the Intrade price and the S&P 500 futures market. This does not mean that a change in the Intrade price, absent confirming evidence from elsewhere, could not have a causal impact on other asset prices. It's possible that it could, but not plausible in our estimation.
Furthermore, the partisan effects identified by Snowberg et al. were completely absent in 2012. In fact, if anything, the effects were reversed. S&P 500 futures reacted negatively to an increase in perceptions of a Romney victory during the first debate, and positively to the announcement of the result on election day. One possible reason is that monetary policy was expected to be tighter under a Romney administration. Here is the chart for the first debate:
The index falls as Romney's prospects appear to be rising, but the effect is clearly minor. The main point is that any attempt to use 2004 correlations to influence the S&P via changes in Intrade prices, even if they were successful in altering beliefs about the election, would have been futile or counterproductive from the perspective of financial gain.
This is why we ultimately decided that this trader's activity was simply a form of support to the campaign. While four million dollars is a fortune for most of us, it is less than the cost of making and airing a primetime commercial in a major media market. In the age of multi-billion dollar political campaigns, it really is a drop in the bucket. Even if the impact on perceptions was small, it's not clear to me that there was an alternative use of this money at this late stage that would have had a greater impact. Certainly television commercials had been largely tuned out by this point.
It's important to keep in mind that attempts at manipulation notwithstanding, real money peer-to-peer prediction markets have been very effective in forecasting outcomes over the two decades in which they have been in use. Furthermore, as I hope my paper with David demonstrates, the simplicity of the binary option contract makes the data from such markets valuable for academic research. It is true that participation in these markets is a form of gambling, but that is also the case for many short-horizon traders in markets for more traditional assets, especially options, futures and swaps. The volume of speculation in such markets exceeds the demands for hedging by an order of magnitude. From a regulatory standpoint, there is really no rational basis for treating prediction markets differently.
While this discovery was (and remains) incidental to the main message of the paper, it has attracted a great deal of media attention over the past couple of days. (About a dozen articles are linked here, and there have been a couple more published since.) Most of these reports state the basic facts and make some conjectures about motivation. The purpose of this post is to describe and interpret what we found in a bit more detail. Much of what is said here can also be found in Section 5 of the paper.
To begin with, the discovery of a large trader with significant exposure to a Romney loss was not a surprise. There was discussion of a possible "Romney Whale" in the Intrade chat rooms and elsewhere leading up to the election, as well as open recognition of the possibility of arbitrage with Betfair. On the afternoon of election day I noticed that the order book for Romney contracts was unusually asymmetric, with the number of bids far exceeding the number of offers, and posted this:
This was circulated quite widely thanks to the following response:
In a post on the following day I explained why I thought that is was an attempt at manipulation:
Could this not have been just a big bet, placed by someone optimistic about Romney's chances? I don't think so, for two reasons. First, if one wanted to bet on Romney rather than Obama, much better odds were available elsewhere, for instance on Betfair. More importantly, one would not want to leave such large orders standing at a time when new information was emerging rapidly; the risk of having the orders met by someone with superior information would be too great. Yet these orders stood for hours, and effectively placed a floor on the Romney price and a ceiling on the price for Obama.Ron Bernstein at Intrade has explained why the disparity with Betfair is not surprising given the severe constraints faced by US residents in opening and operating accounts at the latter exchange, and the differential fee structure. Nevertheless, I still find the second explanation compelling.
The strategic manner in which these orders were placed, with large bids at steadily declining intervals, suggested to me that this was an experienced trader making efficient use of the available funds to order to have the maximum price impact. The orders lower down on the bid side of the book served as deterrents, revealing to counterparties that a sale at the best bid would not result in a price collapse. This is why I described the trader as sophisticated in my conversations with reporters at the WSJ and Politico. Characterizing his behavior as stupid presumes that this was a series of bets made with in the conviction that Romney would prevail, which I doubt.
But if this was an attempt to manipulate prices, what was it's purpose? We consider a couple of different possibilities in the paper. The one that has been most widely reported is that it was at attempt to boost campaign contributions, morale, and turnout. But there's another very different possibility that's worth considering.
On the afternoon of the 2004 presidential election exit polls were leaked that suggested a surprise victory by John Kerry, and the result was a sharp rise in the price of his Tradesports contract. (Tradesports was a precursor to Intrade.) This was sustained for several hours until election returns began to come in that were not consistent with the reported polls. In an interesting study published in 2007, Snowberg, Wolfers and Zitzewitz used this event to examine the effects on the S&P futures market of beliefs about the electoral outcome. They found that perceptions of a Kerry victory resulted in a decline in the price of the index, an effect they interpreted as causal. The following chart from their paper makes the point quite vividly:
Motivated in part by this finding, we wondered whether the manipulation of beliefs about the electoral outcome could have been motivated by financial gain. If Intrade could be used to manipulate beliefs in a manner that affected the value a stock price index, or specific securities such as health or oil and gas stocks, then a four million dollar loss could be easily compensated by a much larger gain elsewhere. Could this have provided motivation for the behavior of our large trader?
We decided that this was extremely unlikely, for two reasons. First, the 2004 analysis showed only that changes in beliefs affected the index, not that the Intrade price caused the change in beliefs. In fact, it was the leaked exit polls that affected both the Intrade price and the S&P 500 futures market. This does not mean that a change in the Intrade price, absent confirming evidence from elsewhere, could not have a causal impact on other asset prices. It's possible that it could, but not plausible in our estimation.
Furthermore, the partisan effects identified by Snowberg et al. were completely absent in 2012. In fact, if anything, the effects were reversed. S&P 500 futures reacted negatively to an increase in perceptions of a Romney victory during the first debate, and positively to the announcement of the result on election day. One possible reason is that monetary policy was expected to be tighter under a Romney administration. Here is the chart for the first debate:
The index falls as Romney's prospects appear to be rising, but the effect is clearly minor. The main point is that any attempt to use 2004 correlations to influence the S&P via changes in Intrade prices, even if they were successful in altering beliefs about the election, would have been futile or counterproductive from the perspective of financial gain.
This is why we ultimately decided that this trader's activity was simply a form of support to the campaign. While four million dollars is a fortune for most of us, it is less than the cost of making and airing a primetime commercial in a major media market. In the age of multi-billion dollar political campaigns, it really is a drop in the bucket. Even if the impact on perceptions was small, it's not clear to me that there was an alternative use of this money at this late stage that would have had a greater impact. Certainly television commercials had been largely tuned out by this point.
It's important to keep in mind that attempts at manipulation notwithstanding, real money peer-to-peer prediction markets have been very effective in forecasting outcomes over the two decades in which they have been in use. Furthermore, as I hope my paper with David demonstrates, the simplicity of the binary option contract makes the data from such markets valuable for academic research. It is true that participation in these markets is a form of gambling, but that is also the case for many short-horizon traders in markets for more traditional assets, especially options, futures and swaps. The volume of speculation in such markets exceeds the demands for hedging by an order of magnitude. From a regulatory standpoint, there is really no rational basis for treating prediction markets differently.
Rajiv,
ReplyDeleteI agree with much of your post but am not sure about the following section: "The main point is that any attempt to use 2004 correlations to influence the S&P via changes in Intrade prices, even if they were successful in altering beliefs about the election, would have been futile or counterproductive from the perspective of financial gain."
I also do not think it is likely that the trader was using Intrade to try to influence other asset prices (e.g. the S&P). However, if that was his goal, whether the correlation between Romney's odds and the S&P is positive or negative is immaterial. If it's positive, go long the S&P. If it's negative, short it.
- Sam
Sam, I agree. The problem is that there was no way to know ahead of time what (if any) correlation there was. The first debate was just a single data point and it contradicted the 2004 findings. So it would have been a very risky thing to try. I should have been clearer in the post.
ReplyDeleteGreat work Rajiv! Thanks for your contribution to more honest politics, among other things.
ReplyDeleteA few points, if I may:
1) I hope the media, and others, are a lot more careful and on top of attempts to manipulate this market for political reasons. I hope they take these markets odds with more of a grain of salt. Sure, they have some correlation with the results, but as much as, and as good as, the polls, as the models of Nate Silver and Sam Wang? I'd be surprised.
2) Here's a point I thought of earlier with regard to market reflected odds, and event markets:
The prices in the market, or of the bookie, might not reflect what people think the odds are very well because of risk aversion.
Suppose a person thinks an asset has a 50% probability of a $200,000 payoff and a 50% probability of a negative $100,000 payoff. Even though he thinks the odds are 50-50, he might only be willing to pay $1,000 for the asset, or even a negative amount if a $100,000 loss would be really catastrophic for him. So, you can't infer his believed odds from a straightforward look at his bid price. You'd also have to know his risk aversion.
I thought about this before when it came to betting on very unlikely events. Suppose an event has a probability of 500:1. In the market place it might be hard to find people to take the side of the bet for it not happening, for many dollars.
A lot of people may be fine with putting $100 on it happening. If they lose they just lose $100, not that risky. And if they win, they get $50,000.
But not a lot of people are going to want to bet $50,000 on it not happening, and if they win they make $100, but they risk $50,000 if they lose. Risk aversion makes the two sides of this bet very unequal, even though both parties have the same belief about the odds.
With the lotto you can make it work with massive risk pooling, but I don't think you can, for real world events and assets, find hundreds or thousands of independent super high odds bets you can pool your money over, and with reasonable transactions and evaluation costs. And it can also be too hard transactions costs, time costs, trouble costs, and information costs to break these big best up into lots of tiny pieces to sell to a huge number of people. So these very unlikely event markets may far from imply the beliefs of the market participants about the odds.
3) The point above is based on idiosyncratic risk. Carola Binder recently quoted John Cochrane from his book Asset Pricing:
ReplyDelete"You might think that as asset with a volatile payoff is `risky' and thus should have a large risk correction. However, if the payoff is uncorrelated with the discount factor m, the asset receives no risk correction to its price, and pays an expected return equal to the risk-free rate!"
At: http://noahpinionblog.blogspot.com/2013/09/financing-federal-government-with.html#comment-form
But this is just true in models where it is easy and costless to completely diversify away idiosyncratic risk. Often, in the real world, there's just no way, to really pool away an idiosyncratic risk at zero, or even very low, cost and effort.
And this is a case in point. The Romney whale comes in and forces Romney's odds artificially much higher. What do you do as an investor to take advantage of this? The key thing is, unlike in traditional models, there's not an arbitrage created (100% riskless money machine); there's just an above average risk-adjusted return, a good deal (see: http://richardhserlin.blogspot.com/2013/09/the-intuition-for-wallace-neutrality.html ).
But, it's a good risk-adjusted return only when added in the proper proportion to a well-diversified portfolio (using CAPM theory, and please see the above link). You add too much, and it becomes sub-optimal. The more you add, the lower the marginal value of an additional unit becomes to you because you further unbalance your portfolio.
Of course, if the whole market does this, and everyone adds a little, you'll quickly neutralize a Romney Whale, but few people know this market, and the transactions, time, and trouble costs are far from insubstantial, so the impact can stay a while, and buy Romney some time to turn things around before a narrative hardens.
Richard, thanks for your comments here and on the previous post - I've been a bit swamped and slow to reply.
ReplyDeleteMarket forecasts do extremely well compared to even the best pollsters and naive poll aggregates. This despite that fact that the trading population is risk-averse and unrepresentative, and incentives for manipulation exist.
The question is why? I tried to deal with this in the last post. It's not just about information aggregation, the distribution of perspectives need to be balanced in some way to result in a wisdom of crowds. If you follow the link to the Berg et al paper in in the last paragraph you'll see some evidence.
Regarding risk aversion and prediction market prices, I have a detailed post on this:
On the Interpretation of prediction Market Prices>
Wonderful illustrated information. I thank you about that. No doubt it will be very useful for my future projects. Would like to see some other posts on the same subject!
ReplyDeleteSP500 Futures