Journalism in the Age of Data

Sourced from Datajournalism, Stanford University

'Journalists are coping with the rising information flood by borrowing data visualization techniques from computer scientists, researchers and artists. Some newsrooms are already beginning to retool their staffs and systems to prepare for a future in which data becomes a medium. But how do we communicate with data, how can traditional narratives be fused with sophisticated, interactive information displays?'

Journalism in the Age of Data from Geoff McGhee on Vimeo.

The Ecologist Guide to Data Activism

Reposted in full from The Ecologist, 4 March 2011

'You don't have to be a web geek to join the growing ranks of activists who have told powerful stories using data visualisation. Christine Ottery outlines how you can use data as a powerful tool to press for change

Isabell Long was 16 years old and with little previous computer programming experience when she created GovSpark, an application that influenced government departments to reduce their energy consumption.

At the time, the government's real time energy data had just been released, allowing ordinary citizens, like Isabell Long, to hold the government accountable to meet its target to slash energy use by 10 per cent.

Emma Mulqueeny, digital media expert and director of hack day events organizers Rewired State, tells me that GovSpark was part of a ‘really effective strategy' to reduce the government's energy use because it showed at a glance how departments were competing. 'We were calling up the press officers from different departments and saying you could do something about what is causing the spikes in energy,' she says.

According to Mulqueeny, 'The government energy and carbon emissions data is still very much an underused resource.' This is because data can differ in file format or even units of measurement from one department to the next, creating a hefty amount of work before it can be compared meaningfully.

Could another reason be technical knowledge barriers? If you want to work at the coalface of data activism the best thing to do it roll your sleeves up and learn a programming language.

Otherwise, there are free programmes that can carry out at least parts of the process - but you might have to rely on developers as well. One example of open source software you can use is the data visualization tool Many Eyes, which can display your data attractively in bubbles, graphs or maps.

Here are some tips that will help you get started, whether you decide to learn to code or not:

Identify sources

Data can be numbers or text. The first thing to do is identify the data sources that you want to analyse or cross-reference. In the UK, public data is released on Data.gov.uk, which is licensed by the National Archives and paid for by UK taxpayers. Other sources could include international governments, quangos or the UN.

It is worth considering making a Freedom of Information (FOI) request if the information you want to use is not already publicly available. You can use WhatDoTheyKnow.com to help you generate emails to the relevant government department's FOI office.

Be careful, however, with commercial data. 'You have to abide by their licensing laws otherwise that's just nicking,' says Mulqueeny. Needless to say, data theft is illegal.

Sometimes you can get permissions to use private data, however. For example, Premasagar Rose, founder of web apps company Dharmafly, created a game called Carbon Copies to raise awareness of carbon footprints with data from Mike Berners-Lee's book ‘How bad are bananas?'. This was as part of a climate hack day run by Rewired State.

Digging for data

When web developers run programming language code to pull data with specific criteria from websites, it is called data scraping, data mining, or data hacking.

ScraperWiki is one platform for scraping data. Developers can write code into ScraperWiki browsers to get started. Those who can't code can use the data from the database, or request new data scrapes. Aine McGuire, director of Scraperwiki, describes ScraperWiki as 'a social network for data prospectors' - there are 1,700 developers in the community and numbers are increasing by 20 per cent each month.

However, be cautious when you are drilling down into cross-referenced geolocation data because you risk identifying individuals, which can have legal ramifications. Mulqueeny recommends consulting a statistician to be on the safe side - contact the Royal Statistical Society to find an expert.

Tell the story

Data visualization can be powerful. David McCandless' graphics and animations, for example, are renowned for their ability to put a perspective on large numbers in comparative datasets.

One of the simplest ways to visualize data is if you have geolocation information. For example, 38 Degrees used a Google map to pinpoint forests endangered under the government's recently proposed (and retracted) sell-off. You can do something similar with Mapalist. Other visualization tools include: Google Charts, Many Eyes, Wordle, Tableau Public and Open Heat Map.

Interactivity is a hot new field, led by Hans Rosling's Gapminder Foundation, which animates global statistics. "Trying to find a way to engage a human with hard data is the challenge," says Rose.

James Darling, a developer at designers Berg London, says, 'Telling stories with the data is the crucial part, and the bit that's often missing is a really good narrative.' He recommends reading Ben Griffiths' history hack blogpost to check out masterful storytelling with statistics.

Also, ‘Journalism in the Age of Data' is a brilliant video on the challenges of telling stories with data.

Learn to code

By now, you might want to learn how to code so you can scrape data and build your own applications and visualisations. But how hard is it to pick up?

'If you have good skills in Excel then it is relatively easy to pick up a computing language like Ruby. You would then be able to take the data out of your spreadsheet and turn that into a mobile application or web application that you can visualize,' says Mulqueeny.

It is time to choose a programming language. Ruby is considered the easiest. Darling says he prefers Ruby because it is more readable as a kind of 'semi-English', which can help you to learn it. Rose, however, calls JavaScript 'liberating' because every browser, mobile phone and increasingly servers are running Javascript.

Mulqueeny says that the best way to learn coding is get a developer to talk you through it. She days: 'There are lots of informal developer's communities who meet in pubs across the UK who welcome newbies, for example Ruby in the Pub. You can find them on Twitter.' Alternatively, Rose recommends starting your own group of nascent data hackers to learn together and collaborate together.

To learn off your own steam, you can try O'Reilly books. Darling suggests: 'Hackety hack is written for children and will teach you the basics in a fun way.''

China Bans Reincarnation Without Government Permission

This story is a few years old, but is as funny as a fit!!! I just want to know how they are going to enforce it? It is completely daft.

Reposted in full from the Huffington Post, 22 August 2007

'In one of history's more absurd acts of totalitarianism, China has banned Buddhist monks in Tibet from reincarnating without government permission. According to a statement issued by the State Administration for Religious Affairs, the law, which goes into effect next month and strictly stipulates the procedures by which one is to reincarnate, is "an important move to institutionalize management of reincarnation." But beyond the irony lies China's true motive: to cut off the influence of the Dalai Lama, Tibet's exiled spiritual and political leader, and to quell the region's Buddhist religious establishment more than 50 years after China invaded the small Himalayan country. By barring any Buddhist monk living outside China from seeking reincarnation, the law effectively gives Chinese authorities the power to choose the next Dalai Lama, whose soul, by tradition, is reborn as a new human to continue the work of relieving suffering.

At 72, the Dalai Lama, who has lived in India since 1959, is beginning to plan his succession, saying that he refuses to be reborn in Tibet so long as it's under Chinese control. Assuming he's able to master the feat of controlling his rebirth, as Dalai Lamas supposedly have for the last 600 years, the situation is shaping up in which there could be two Dalai Lamas: one picked by the Chinese government, the other by Buddhist monks. "It will be a very hot issue," says Paul Harrison, a Buddhism scholar at Stanford. "The Dalai Lama has been the prime symbol of unity and national identity in Tibet, and so it's quite likely the battle for his incarnation will be a lot more important than the others."'

America is NOT Broke

An emotional Michael Moore speaks in Madison, Wisconsin, 5 March 2011

'Contrary to what those in power would like you to believe so that you'll give up your pension, cut your wages, and settle for the life your great-grandparents had, America is not broke. Not by a long shot. The country is awash in wealth and cash. It's just that it's not in your hands. It has been transferred, in the greatest heist in history, from the workers and consumers to the banks and the portfolios of the uber-rich.'