Why are we so bad at predicting Olympic medal success?

There have been a lot of questions following Australia’s below-expectation performance at the London Olympics. But the question I keep asking myself is, how did so many “experts” get their medal tally predictions so wrong? Prior to the Olympics, the Australian Olympic Committee (AOC) boldly predicted…

8gck25pw-1344920047
Team GB’s medal haul helped derail Australia’s chances of achieving a predicted 15 gold. EPA/Robert Ghement

There have been a lot of questions following Australia’s below-expectation performance at the London Olympics. But the question I keep asking myself is, how did so many “experts” get their medal tally predictions so wrong?

Prior to the Olympics, the Australian Olympic Committee (AOC) boldly predicted Australia would win 15 gold medals and finish 5th on the medal table. They were right about one thing – 15 gold medals would have placed Australia 5th on the gold-medal table.

But history will show that in contrast to these lofty predictions, Australia scraped into 10th place with less than half that number: seven gold medals (and 35 medals in total).

The AOC were not alone in getting it wrong. Economists at Goldman Sachs used a raft of economic, political, productivity and growth information to also predict Australia would finish with 15 gold medals.

Similarly, economics researchers at the Ruhr University Bochum, Germany used economic, demographic, and cultural factors to predict Australia would win 43 medals (they did not predict the number of gold medals). Australia finished the Games with 35 medals.

So, how did so many experts get it so wrong? I can think of at least three reasons.

First, most of these predictions take current trends (such as past Olympic results) and project them into the future. In fact, despite what seems like the use of sophisticated modelling, for most countries the difference between the predictions of Goldman Sachs and the actual results from the 2008 Olympics was less than one gold medal.

The only exceptions were China and Great Britain where they factored in a home-games effect.

Australia’s Mitchell Watt finished with silver in the men’s long jump after Briton Greg Rutherford took gold in front of his home crowd. EPA/Robert Ghement

Relying on current trends to continue is generally a pretty safe bet, but not always. Trends end, surprises happen, and predicting the future by projecting the past is like driving with your eyes shut – a good chance of success on the Gunbarrel Highway, but try it on the London M5 motorway and you’re headed for trouble.

The second reason is that none of the predictions took into account the effect a resurgent Great Britain would have on Australia’s medal chances.

Research by Goldman Sachs has shown that hosting the Olympic Games can increase the host nation’s medal tally by more than 50% with respect to what they would have otherwise attained. Given the shared sporting traditions of Great Britain and Australia, it seems logical that more medals to Great Britain is precisely the subtle curve in the road that can disrupt past trends and reduce Australia’s medal haul.

In fact, on five occasions British athletes relegated Australians to the silver medal (women’s pair, women’s double sculls, and men’s four in rowing; men’s team cycling pursuit and the men’s long jump).

A third, and much-discussed possibility, is that Australia underperformed. I won’t enter into this debate here but, of all the countries at the 2012 Olympics, Australia had the largest difference between their actual and predicted number of gold medals (except for the USA who won nine more than predicted). Underperformance is obviously something that is very difficult to include into a model.

A final question worth asking is what purpose do these (inaccurate) predictions serve? A famous rebuttal to Nobel laureate Kenneth Arrow, when he was a young statistician during the Second World War, was:

“The Commanding General is well aware the forecasts are no good. However, he needs them for planning purposes.”

So, apart from a little harmless fun, can we actually use these predictions to plan for future Olympics?

Refreshingly, sport remains unpredictable, and it is this not-knowing who will perform at their best in four years’ time that makes the Olympics so compelling. Undoubtedly there are some trends – the host nation normally improves their medal haul, and the previous host nation typically has a slight decrease in their number of medals.

Apart from that, in the words of retired English soccer star Paul Gascoigne: “I never make predictions and I never will”.

Articles also by This Author

Sign in to Favourite

Want to follow The Conversation?

Sign up to our free newsletter to get the day's top stories in your inbox each morning, with a special wrap on Saturday.

Donate and become a friend of The Conversation

Join the conversation

3 Comments sorted by

  1. Kerri lawrence

    Subpostmaster

    The M5 is not in London, nor anywhere near it. Apart from that very well written and makes some interesting points.

    report
  2. charles sutcliffe

    retired

    The Guardian averaged 5 predictions and came up with:

    USA 104
    China 87
    Russia 75
    U.K. 65
    Germany 47
    South Korea 31
    Canada 19
    France 41
    Australia 46 etc.

    Some were exact, most very close. The order is very predictable! Do not forget that one of the predictions they averaged was an Australian prediction. Next time, the prediction will likely get close to the total for Australia. The New York Times did 10 models for the winter olympics and was very close.(Google: 538 winter medal prediction). Find as many models as you can, average them and you can get so close it is eerie. If you add the sports books from several countries as well it gets frighteningly close to reality. Asking Australians to judge Australians is dumb methodology. In predictions- everyone is individually wrong but collectively brilliant (usually).

    report
    1. David Bishop

      Research Leader, Sport, Institute of Sport, Exercise and Active Living at Victoria University

      In reply to charles sutcliffe

      Good point about the greater predictive power of averaging many predictions. Nonetheless, while some prediction were very close (eg, USA and UK), even the averaged predictions were 20 - 30% wrong for Australia and France; this doesn't seem very close to me. Also, given that some of the predictions were for close to 200 countries, by chance alone one would expect some to be very close. Rather than focussing on the few accurate predictions, I think that it is more interesting and informative to see how many were wrong.

      report