This post is less of an example of good practice, and more of an illustration of how technology is currently hampering best practice in one important area.

Politics is all about people, but its also about geographic neighbourhoods and communities.


To use data to help to understand voters and to understand where they are and how their neighbourhoods and communities work, data needs to be mapped out. And here is the problem. Mapping out data is tough. There is no excuse for an organization to not gather data and to produce tables and graphs from it. That technology is on everyone's computer and is extremely accessible. But technology hasn't yet brought mapping out data in to the hands of the many.

There are a number of barriers that make even basic maps (like the one above) out of the reach of most small organizations and political campaigns, including:
  1. GIS programs are expensive and inaccessible. Many organizations don't have the money to buy them or to hold on to someone with the skills to use them. We need a way to get mapping out to organizations and campaigns without them having to invest in expensive software and staff with specialist skills.

  2. Shapefiles are tough to acquire, often out of data and frequently almost impossible to match back to the data that you're trying to map out. Most organizations don't have the time to invest in finding, cleaning, checking and matching up shapefiles. We need an organization to gather recent shapefiles and make them available with a key that allows them to be matched back to other data sources. Or even better, we need a way to map out data without needing shapefiles to make it useable.

  3. Output is inaccessible to most users. While a map like the ones above provide a helpful overview of the top-level information. A well-constructed pdf can allow user to zoom in and see more detail, but what is really needed is the ability to personalize it. For users to turn on and off features. To see satellite view, to see roads and then to zoom out and see just the data again if they so choose.
The only example I've yet seen of data really being mapped out in a way that non-expert users can access it and play with it combines data from a site that combined U.S. Census Bureau data with Google Maps. It's called World Wide Webfoot Maps (Thanks to Google Maps Mania).

Here is an example:

- Race and density
- Age distribution
- Housing units
- Total population density
- Male population percentage
- Female population percentage
- Average Household Size
- Average Family Size
- Blacks per housing unit
- Percentage of population 18-22

In this example someone has done (1) and (2) for you already. They've gathered the data and the shapefiles and matched them and programmed a web interface. What we need is some way for organizations and political campaigns to be able to upload their custom data and see it mapped out in an accessible way. I'm keeping my eye open for developments in this area, but please post a comment if you have ideas or solutions!
0

Add a comment

  1. I gave a talk at the Big Data Insight Group in London recently and they've just posted my talk online.


    I talk about how we've helped EMI Music make use of data and about how we're doing so in zeebox.

    One of the themes throughout my talk is the importance of people. Both in terms of how we use data to help people make decisions and about how we need to understand the people we're trying to help, in order to give them what we need. Technology enables this, but without the right people and without understanding people, technology is as good as useless.


    I also talk about how important skills and judgement are. And that, although it's sometimes seen as the things that drives decisions, it's usually or perhaps always used alongside skills and judgement. 


    I think that admitting to the role of skills and judgement isn't being 'anti-data'. I think that being honest about this enables and empowers us to better use data in the right ways. And it certainly helps people to feel comfortable with data, also!

    With the right people in place and data playing the right role in an organisation, the opportunity for data to help an organisation is massive. The way that EMI Music has embraced data across the organisation alongside skills and judgement shows that this is the case.


    0

    Add a comment

  2. We all know there are decisions where you need data to help you make them and there are decisions where data just isn't that important. This morning XKCD did a wonderful job of illustrating it. http://xkcd.com/1036/

    Buying a lamp is a creative decision. Turn your eye away from the reviews and go with your heart :)

    The same is true of many decisions data folks are asked to help with every day in organisations. We shouldn't be afraid to champion this strategy there, either!

    0

    Add a comment

  3. We sat down recently to talk data and insight. Here is what we talked about, plus a little video of me talking about insight at both zeebox and EMI.

    http://www.thebigdatainsightgroup.com/site/article/david-boyle-emi-zeebox-data-driven-includes-video
    0

    Add a comment

  4. I don't like the term 'scientist' as it makes the role sound unaccessible and elite. Google's Hal Varian said "the sexy job in the next ten years will be statisticians" ... but I don't like that term either. I'd replace 'statisticians' with 'working with data' or something ... and then I believe it!  I think data people have a tendency to overplay the role of the 'statistics' and magic of it and underplay the importance of the 'bringing it to life' and 'helping people understand / make use of it' parts of working with data.

    I thought about this because of this cool article in The Guardian about data scientists.

    As it points out, "science" is defined as "systematic study of natural or physical phenomena". I guess that's us all. Perhaps I shouldn't shy away from that phrase.

    The journalist describes the role well, as "someone who can bridge the raw data and the analysis - and make it accessible. It's a democratising role; by bringing the data to the people, you make the world just a little bit better." Perfect, eh?

    One last quote: "the four qualities of a great data scientist are creativity, tenacity, curiosity, and deep technical skills." That list sounds pretty good to me, also. So perhaps I should rename this the 'data scientist' blog and be done :)



    0

    Add a comment

  5. Some fun from http://fosslien.com/ via http://www.freakonomics.com/2012/02/29/the-life-of-the-number-crunching-analyst/


    I particularly like this one:

    0

    Add a comment

  6. So much data, so easily displayed in such a small but easy to understand format. I need say no more. I'm in love with the new sparlklines just made available in Google Spreadsheets: http://support.google.com/docs/bin/answer.py?hl=en&answer=2371371


    It's this simple:

    Google Spreadsheets is rapidly becoming my go to choice for building business dashboards. Bye, bye cost. Bye, bye developers (would be VERY sad not to work with them, of course). Bye, bye Microsoft!

    6

    View comments


  7. I spoke on a panel last night on the subject 'data as the new black gold'. There are three challenges I think this metaphor poses to the data world.







    First, that of crude oil. Data is everywhere in organisations, but too often left in it's crude form: gloopy and unusable. The oil industry had to work this out before it could be mainstream. It had to refine oil to a form that works for consumers day-to-day and it had to make it available to consumers in ways that fitted in to their daily life. It's trivial to stop by a petrol station and pick up some oil in a format you can instantly make use of. Data doesn't yet work the same way: it's rare to find an organisation that appropriately refines it and then makes it available to it's people in a way they can access and make use of as part of their day-to-day work.


    Second, I think we need to demand higher 'miles per gallon' from our data. Often we gather fantastic raw data, capable of being a really powerful part of decision making ... but then business leaders don't ask interesting questions of it. They don't demand smart analysis and challenge the data to offer insight. It's like demanding that cars offer higher miles per gallon from the oil they are burning.


    Finally, I think we need to embrace hybrid technology. In cars that's about oil being only part of the story for how the car gets powered. In data it's about saying that data is only part of the story for how organisations get powered. We need to be honest and bold about the role of skills & judgement alongside data in powering organisations. Too many people believe / pretend that data alone can power organisations to greatness. Everything I've seen tells me that data is necessary but not sufficient: smart people to use the data alongside their expertise is ALWAYS required. The data world should be honest about this and build data and systems around that truth. I've always found that has a much greater impact :)
    0

    Add a comment

  8. I've used a lot of word clouds recently. But I think of them as charts really, since they are still pretty faithful to the underlying data. The size of the word is proportional to the number of times that word is in the data set. Simple.

    But reading a cool data visualization book I came across this. Really it not based on 'data', but it's interesting his words and their location on the page conveys such a lot of information. Perhaps some good, well placed words can replace the need to chart actual data?

    http://creativeroots.org/2011/03/italy-infographic-map/
    0

    Add a comment

  9. Simple, easy to read, but really powerful. Nice little sparklines spotted in the papers from the 20 week scan my wife just had. Cool little chart like this should be everywhere!

    And by the way, it's a boy!
    0

    Add a comment

Labels
If you like this you'll like:
Info Clarity Archive
Loading