- Associated Press - Monday, June 13, 2011

The analysis of Sarah Palin’s emails over the past few days may end up teaching us more about the future of journalism than about the former Alaska governor’s past.

Drawing on methods used by both Wikileaks and social networks, traditional news organizations such as The New York Times and The Washington Post used the Palin email dump as an experiment in new media techniques. They sought collaboration from readers and posted massive volumes of documents online before reporters even had a chance to read most of the papers.

That sort of public coordination _ often called “crowdsourcing” _ has drawn increasing interest from many journalists. David Lauter, chief of Tribune Co.’s Washington bureau, said he and his colleagues have wondered whether it would be a more productive way of analyzing data.

“It’s a concept that we’d been looking at,” Lauter said. “This seemed like a great opportunity to test to see how it might work.”


Tribune dispatched two journalists equipped with portable scanners to Juneau to pick up the thousands of Palin emails and begin digitizing them for online readers. Lauter said the first batch was posted on the Los Angeles Times website about 30 minutes after the documents were released Friday.

The New York Times, using a similar strategy, assigned a team to put all the documents online as soon as possible. It took 14 hours to post all of them.

Technologically, the project seemed to succeed. Several outlets organized the files chronologically and made the documents searchable. The Associated Press made electronic scans available to members around the country.

Neither the crowdsourcing nor the traditional analysis by reporters produced any bombshells, but enlisting the public did help engage readers. The New York Times received more than 2,000 emails, about half of which were substantive responses. Most of the annotations attached to Palin’s emails came from readers, not reporters.

Jim Roberts, an assistant managing editor at the paper, said the paper still considers crowdsourcing experimental, but the public responses were clearly useful.

“The readers are augmenting the work of our journalists, not taking their place,” Roberts said in an email. “We’re not doing anything that we wouldn’t otherwise do. The readers are just an extra, and valuable, resource.”

Steve Doig, a journalism professor at Arizona State University who specializes in computer-assisted reporting, said the crowdsourcing approach was clever _ and one he hopes to see more of in the future.

“You don’t have to be a professional reporter to be able to recognize statements that might be newsworthy,” Doig said. “So, having lots and lots of eyeballs looking through it _ whether it’s professional reporter or just somebody who’s looking for their own interest or amusement _ you can more quickly find something newsworthy.”

With an increased focus to share documents online, media outlets have been seeking out new ways to compile and analyze information. A few months ago, the AP internally assessed thousands of emails sent to Wisconsin Gov. Scott Walker and raised questions about his claim that most people who contacted him wanted to eliminate nearly all union rights for state workers.

In 2009, The New York Times publicly posted hundreds of pages from the calendar of Timothy Geithner _ now President Barack Obama’s treasury secretary _ from his time at the New York Federal Reserve Bank.

Journalists and observers said the conditions were ripe for using crowdsourcing with the Palin emails because the documents were so voluminous. And they were released to many media outlets at the same time, meaning there was no reason to horde them in hopes of identifying an exclusive.

Story Continues →