- ISIL creates all-female brigade to terrorize women into following Sharia law
- ISTOOK: Obama wants to be impeached
- Obama to Latin leaders: Help with border
- Military bans troops from Baptist church event honoring ‘God’s Rescue Squad’
- ‘Pocket drones’: U.S. Army developing tiny surveillance tools for the next big war
- Belgian cafe posts sign: Dogs allowed, but Jews stay out
- Gen. Dempsey: Pentagon studying Russian readiness plans not viewed ‘for 20 years’
- John McCain: Botched, two-hour execution of murderer is ‘torture’
- House GOP ready to move border bill
- Bomb squad called after live WWII artillery washes on Cape Cod beach
Experts’ predictions of the future have a history of being wrong
Question of the Day
“You find serious overconfidence by hedgehogs,” Mr. Tetlock said. “With a rigid, self-justifying style of thinking, combined with a lot of content knowledge, combined with trying to see far in the future — well, you are more likely to go off a cliff.
“On the other hand, a key factor underlying superior fox performance was that they were more modest about what they could predict. The longer you try to see into the future, the more advantageous it is to be modest. I think they also derive some befits by being more self-critical and aware of alternative possibilities.”
The most common problem with forecasts like the Global Trends report, Mr. Horowitz said, is that they fall into a hedgehog-style trap of treating current conventional wisdom as a blueprint for the long-term future. For example, extrapolating from the late 1990s economic boom, the 2001 Global Trends report predicted that the global economy of 2015 would “return to the high levels of growth reached in the 1960s and early 1970s.”
“The most natural thing to do intellectually is look at the present,” Mr. Horowitz said. “What is going on now is going on for a reason, and therefore it is most likely to continue. There’s nothing wrong with that. To do better is difficult. It requires both being more aware of your own biases and being forced out of your intellectual comfort zone.”
The future of forecasting?
Mr. Horowitz and Mr. Tetlock are involved in an ongoing, multi-year project funded by the Intelligence Advanced Research Projects Activities Agency (IARPA) that is attempting to create better metrics for evaluating analyst accuracy.
Encompassing studies at a half-dozen universities and involving thousands of forecasters making predictions on hundreds of questions — Who will win the upcoming election in Ghana? Will Iran test a nuclear weapon by the end of the year? — the research aims to help participants recognize biases, avoid common errors and make better predictions in the future, lessons that can then be applied to American intelligence gathering.
One of the most important lessons, Mr. Tetlock said, is learning to avoid something he calls “accountability ping-pong” — that is, overreacting to errant prediction by abstaining from predictions going forward.
“We’re making progress in that direction,” he said. “Our forecasters are gradually becoming better calibrated. How far can they can go? Nobody knows for sure.”
Spoken like a fox.
© Copyright 2014 The Washington Times, LLC. Click here for reprint permission.
About the Author
Patrick Hruby is an award-winning journalist who holds degrees from Georgetown and Northwestern. He also contributes to ESPN.com and The Atlantic Online, and his work has been featured in The Best American Sports Writing. Follow him on Twitter (@patrick_hruby) and contact him at PatrickHruby.net.
- Taking to Twitter: Everybody's Oscar night in 140 characters
- Glenn Beck, Michelle Malkin cry foul at WWE Tea Party stereotypes
- Oscar Pistorius and the 'roid rage' defense: It's no Get-Out-Of-Jail-Free card
- Spatial media: Astronaut Chris Hadfield live chats from 220 miles above earth
- Hero-worship for a cold-blooded killer: The cult of Christopher Dorner
TWT Video Picks
Second- and third-stringers eye 2016 if front-runner stumbles
- NAPOLITANO: What if our democracy is a fraud?
- ISTOOK: Obama wants to be impeached
- 'Pocket drones': U.S. Army developing tiny spies for the next big war
- 'We're coming for you, Barack Obama': Top U.S. official discloses threat from ISIL terrorists
- Michelle Obama says money in politics is bad, asks donors for 'big, fat check'
- Ted Nugent loses second casino gig for 'racist remarks'
- Russia shipping sophisticated weapons systems to Ukraine separatists
- EDITORIAL: Detroit's water 'spigot bigots'
- Obama orders Pentagon advisers to Ukraine
- Let it roll: D.C. Council hits Las Vegas on taxpayer's dime, leaves $14,000 tab
Obama's biggest White House 'fails'
Celebrities turned politicians
Athletes turned actors
20 gadgets that changed the world
Fighting in Iraq