Sunday, September 24th, 2006
EuroOSCON: Adrian Holovaty - Journalism via computer programming
Journalism right now is broken. Several ways - celebrity focus, political bias, circulation declining consistently, stock prices dropping, craisglist taking away classifieds market.
But that’s not the issue. The issues is that newspapers throw away data.
So if there was a burglary, you have the address, the person, the stuff nicked, roughly the time. has key value pairs. But all the journalist does is write an article and throw away most of the data.
News orgs have huge infrastructure, with reporters on the street, specialised. Infrastructure to collect and edit information, verify it. Not every media organisation does that, that they’re not taking advantage of. Have infrastructure to get info out to people, i.e. a printing press originally. Also have the attention of people.
But can’t take advantage of data because they are just creating big blobs - stories.
So contrast to
Google Base, (which is just infrastructure with no data).
Wikipedia
Craigslist
All great frameworks desperate for data. Journalists have great data desperate for a framework.
Why is structured data important - because if it’s structured a computer can do cool stuff with it.
Journalism via computer programming.
News people write an article, or create a video. A programmer makes a web app that makes it easy to look at the data.
WaPo, Iraq war, huge issue. Most recent deaths page, total fatalities, in Operation Iraqi Freedom, or Operation Enduring Freedom. Collect data on everyone who’s died, but can’t do a story on everyone, but can make that data available.
Faces of the Fallen - get own page, bio, map of home town. Depressing but important. Breakdown of age of deaths, most are 21, look by age, photos, breakdown of state, see all the people from the state and their town. Googlemaps. RSS Feed for every state. Sounds depressing and gory, but people are interested and they are then making their own sites, using for political activism.
Another example:
ChicagoCrime.org
Type of crime, street, by block, brows by day, by hour, and latest crime RSS feed
Votes Database, representatives in congress, their votes, breakdowns of late night votes, votes missed, get RSS out there. So people can get more interested in government: did you know your representative voted this way today?
Telling a story via an application not words. Being smart about data, dealing with raw data. Badger journalists to get the raw data so we can do cool stuff. End game is not creating an article, but getting data in one place to do cool stuff.
Cultural similarities to this and open source code.
Open source:
- making code available.
- understanding through transparency: can download stuff and look at it.
- encourages derivative work, although depends on licence.
Journalism via code:
- make the data available.
- encourages understanding through transparency: better to look at the data than someone’s opinion.
- encourages derivative work, can take the data from the RSS feed and do stuff with it yourself.
Call to action
Done talks at journalism conferences, and people grumble that this ‘isn’t journalism’, but that’s kinda depressing that the industry thinks that way. It’s not full of passionate people who want to do cool things with technology but full more of people more interested in the ends than the means. So if people are interested, then go out there and do it.







September 24th, 2006 at 9:22 pm
“It’s not full of passionate people who want to do cool things with technology”
I have to agree- that doesn’t sound like journalism.
September 27th, 2006 at 12:14 pm
Simon,
I’ll cede that it doesn’t sound like traditional journalism, but it’s not an either/or proposition. So many times when I suggest new skills for a subset of journalists, I get a lot of pushback from traditional journalists thinking that I’m suggesting that all journalists need to have these skills and be involved in this work. But some do.
I’m not sure that journalism isn’t ‘full of passionate people wanting to do cool things with technology’. And maybe to tease out Adrian’s point, it’s not doing things with technology for the sake of the new. It’s about improving journalism by using new technology to best effect, and that’s not just about new methodss of distribution and presentation but also new methods of newsgathering.
February 2nd, 2007 at 11:15 am
I agree with Kevin, I think there are journalists out there who are fired up by technology. I think reason for so much pushback is, as Adrian says, that the indusrty is “full more of people more interested in the ends than the means”
People don’t see a distinction between what they do as journalists and the medium they do it in. So if you use the web or technology in any way you are an ‘online journalist’. Use shorthand and you are a ‘print journalist’.
To paraphrase Dan Gilmour, does using a telephone make you a telephone journalist. No.
You can do pretty much anything journalistcally - including use a database - if you are a journalist first and medium second.