<strong></strong>Accessing information to support reporting is easier than ever. Governments and corporations publish countless bytes of data online. But very little information comes in a structured form that lends itself to easy analysis. Reporters often are faced with lists or tables — usually in HTML format — that aren’t so easily manipulated. That’s where web scraping comes in handy.

Web scraping for journalists involves a few key steps:
<ul>
	<li>Getting information from      somewhere</li>
	<li>Storing it somewhere that      can be accessed later</li>
	<li>And in a form that makes      it easy (or easier) to analyze and interrogate</li>
</ul>
For instance, a web scraper could be used to gather information from a local police department website, and store it in a spreadsheet that can be used to sort through, average, total up, filter and so on.

But those are just the initial aspects of web scraping. Scraping tools and <a href="http://danwin.com/works/coding-for-journalists-101-a-four-part-series/" target="_blank">customized scripts</a> offer further benefits, including:
<ul>
	<li>Scheduling a scraper to      run at regular intervals</li>
	<li>Re-formatting data to      clarify it, filter it, or make it compatible with other sets of data (for      example, converting lat-long coordinates to postcodes, or feet to meters)</li>
	<li>Visualizing data (for      example as a chart, or on a map)</li>
	<li>Combining data from more      than one source (for example, scraping a list of company directors and      comparing that against a list of donors)</li>
</ul>
Journalists have used web scraping to tell a number of important stories in the public interest. Many investigations have relied on scrapers to pull and organize data from the Web. Now some programmer journalists are working to develop new tools to expand and redefine what web scrapers can do.

@OWNIeu talks about the state of open data:
<blockquote class="twitter-tweet"><p>The Open Data movement has made incredible progress in the last year, but challenges remain ahead <a href="http://t.co/lcRzJfGU" title="http://bit.ly/vrCo3W">bit.ly/vrCo3W</a> <a href="https://twitter.com/search/%2523OGDcamp">#OGDcamp</a></p>&mdash; Owni Europe (@OwniEU) <a href="https://twitter.com/OwniEU/status/130977170393808896" data-datetime="2011-10-31T11:59:25+00:00">October 31, 2011</a></blockquote>
<script src="//platform.twitter.com/widgets.js" charset="utf-8"></script>