Transparent screen, by Kathy McLeod, used under the Creative Commons licence, with thanks.

At mySociety we like transparency – it’s baked into most of our projects.

TheyWorkForYou attempts to make it easier to find out what your MP has been doing in Parliament. WhatDoTheyKnow tries to make it easier to find out what’s going on inside other public bodies. FixMyStreet and the upcoming FixMyTransport also use transparency to help get problems resolved.

We think transparency is a good thing for many reasons, but one of its rarely mentioned virtues is how valuable transparency can be for the people within the organisations which are transparent.

Transparency can be useful because it means people outside an organisation can make critical, constructive suggestions about how you can improve, and it lowers the odds that people in one part of your own organisation will be ignorant of the activities of people in other parts.

Research

To that end we commissioned Tobias Escher of the Oxford Internet Institute to conduct detailed analysis into two of our major websites – TheyWorkForYou and WriteToThem.

We were not highly prescriptive in our instructions, and we certainly didn’t ask Tobias to ‘discover’ pre-determined findings. All we did was ask Tobias to find out who was coming to the sites, what they were doing, and whether or not the sites could be considered to be succeeding.  We didn’t do it for a PR stunt:  we did it so we could learn from our mistakes, and so that we could share those learnings with others who might benefit.

His detailed, quantitative analysis holds the sites up to mySociety’s own stated aims, for the first time. And we’ve published both documents, in full, below.

Swings and Roundabouts

It was great to discover that we have, indeed, attained some of our goals by running these sites. For example, one of the reasons we set up TheyWorkForYou and WriteToThem was to make representatives accessible to people who were newcomers to the democratic process. It was therefore heartening to read that 60% of visitors to TheyWorkForYou had never previously looked up who represents them, and two in five users of WriteToThem have never before contacted one of their political representatives.

But, as you would expect with any properly neutral evaluation, it’s not all good news. Our sites aim to reach a wide range of people, but compared to the average  British internet user, WriteToThem users are twice as likely to have a higher degree and a higher income. It also seems that users are disproportionately male, white, and over 35. These figures and many more are available within these highly readable papers – Tobias did a terrific job in gathering and analysing a huge amount of data, and then making it easy to understand.

Stories

These reports are rich with data, from how visitor numbers boomed during the MPs’ expenses scandal to which MPs most people sign up to receive alerts about. You can also read how a budget airline almost brought a site to its knees in 2007; what part Joanna Lumley plays in our history; and how many visits to TheyWorkForYou actually come from within Parliament itself.

TheyWorkForYou and WriteToThem have inspired many people around the world to set up similar (and not so similar) sites inspired by the vision of using the Internet to lower barriers to democracy. However, until now we’ve never seen a really clear-eyed assessment of what seems to work, and what doesn’t.

If you’re at all interested in using the Internet to engage people with democratic systems, Tobias Escher’s excellent research papers will make a compelling read. Thank you Toby!

The reports

Download Tobias Escher’s research report on WriteToThem.com

or TheyWorkForYou research report by Tobias Escher

…and do come back and tell us what you found interesting.

PS

We hope to publish two evaluation reports like this at the start of each new year from now on. Next year’s sites will probably be FixMyStreet and WhatDoTheyKnow. Do get in touch if you’d like to input!