TheyWorkForYou

TheyWorkForYou homepage

TheyWorkForYou is mySociety’s most visited site, providing citizens with a range of information on their politicians, such as:

• Who their local MP is
• What MPs said in Parliament
• Summaries of how MPs have voted
• Text of debates in Parliament
• Video of MPs talking in debates
• Written questions MPs have submitted to government departments, and the answers they’ve got back
• Email alerts whenever an MP speaks, or a topic is mentioned in Parliament
• Email alerts to notify you of upcoming debates or topics
• Comments and annotations from our users on what has been said

TheyWorkForYou was visited around 3.5 million times in 2010 (according to Piwik Web Analytics) and has become a small institution in British politics.

The site was built by volunteers such as Phil Gyford, and is now looked after mainly by mySociety senior developers Matthew Somerville and Francis Irving. You can read more about it here and here.

Want to keep up with our latest news? You can read recent blog posts about TheyWorkForYou below, follow us on Twitter or like us on Facebook.

December 23rd

Santa's Chocolate Coin Mint by Johnathan_W

If you haven’t got a penny,

A ha’penny will do,

If you haven’t got a ha’penny,

Then God bless you.

We wish you all a merry and prosperous Christmas – and for those of you who are already feeling quite prosperous enough, may we point you in the direction of our charitable donations page?

mySociety’s work is made possible by donations of all sizes and from all sorts of people. Those donations help fund all the online projects we create; projects that give easy access to your civic and democratic rights. If that’s important to you, show your appreciation, and we promise we’ll make the best use of every penny.

Thank you for sticking with us through this month-long post. We hope you’ve found it interesting and we wish you the very merriest of Christmases.

We hope you’ll continue to follow us on Twitter, Facebook, or Google+ – see our Contacts page to find individual projects’ social media links.

December 22nd

Santa Watching by LadyDragonflyCC

What’s behind the door? A letter to Santa.

Dear Santa,

We think we’ve been pretty good this year. We’ve tried to keep our local neighbourhood clean, help with problems, and aid those in need, so we’re hoping there are a few presents coming our way.

If you can fit them down the chimney, here’s what we’re dreaming of:

More publicly available data Of course, we were delighted to hear in Mr Osborne’s autumn statement that all sorts of previously-inaccessible data will be opened up.

We’re wondering whether this new era will also answer any of our FixMyStreet geodata wishes. Santa, if you could allocate an elf to this one, we’d be ever so pleased.

Globalisation …in the nicest possible way, of course. This year has seen us work in places previously untouched by the hand of mySociety, including Kenya and the Philippines. And we continue to give help to those who wish to replicate our projects in their own countries, from FixMyStreet in Norway to WhatDoTheyKnow in Germany.

Santa, please could you fix it for us to continue working with dedicated and motivated people all around the world?

A mySociety Masters degree We’re lucky enough to have a team of talented and knowledgeable developers, and we hope we will be recruiting more in the coming year. It’s not always an easy task to find the kind of people we need – after all, mySociety is not your average workplace – so we’ve come to the conclusion that it’s probably easiest to make our own.

Back in February, Tom started thinking about a Masters in Public Technology. It’s still something we’re very much hoping for. Santa, is it true you have friends in academic circles?

FixMyTransport buy-in - from everyone! Regular users of FixMyTransport will have noticed that there are different kinds of response from the transport operators: lovely, fulsome, helpful ones, and formulaic ones. Or, worse still, complete refusal to engage.

Santa, if you get the chance, please could you tell the operators a little secret? Just tell them what those savvier ones already know – that FixMyTransport represents a chance to show off some fantastic customer service. And with 25,000 visitors to the site every week, that message is soon spread far and wide.

December 21st

New Year Resolution coaster by BazaarBizarreSF

What’s behind the window? 10 red-faced novice joggers.

It’s not long now until you’ll be making your new year’s resolutions. But will motivation drop off by February? Time to acquaint yourself with one of mySociety’s clever little projects: Hassleme.

Hassleme sends you reminders to do whatever it is you want to do, whether that’s to go for a run, tell someone you love them, or write another chapter of your blockbuster novel. Think of it as benign nagging.

Yes, you could set up your Google calendar to do just the same, but here’s the clever bit – Hassleme sends reminders at “semi-unpredictable intervals” . You can set a rough time period, such as every three days or every year – but you’ll never know precisely when that reminder will drop into your inbox.

You can even make a joint resolution, as a family, perhaps, or even in the office. Input multiple email addresses and we’ll randomise who gets each reminder – ideal for allocating tasks fairly.

Or use it to send a message to yourself ten years hence. Here are some examples from people who have done just that.

December 20th

Elves by Choo Yut Shing

What’s behind the door? Santa’s little helpers.

mySociety runs some pretty ambitious projects. There’s TheyWorkForYou, which publishes all parliamentary activity since 1935, as well as representatives’ voting records. Then there’s WhatDoTheyKnow, which has sent, and archived, over 30,000 freedom of information requests.

FixMyStreet maps all of Great Britain and sends your reports to the correct council contact. And now we also run FixMyTransport, with its details of over 300,000 public transport routes and stops.

None of these projects runs itself. mySociety’s core team only consists of a few people, so we rely on dedicated volunteers to help us manage the day-to-day maintenance of these sites. Our volunteers have been key to forging a community around each site, and to helping us understand exactly what we want the sites to be.

For example, our FixMyTransport volunteers (aka Anoraks) spend a lot of time leaving helpful comments on users’ problems, often before the operators can get around to answering themselves. Leading by example, they’re making FixMyTransport into a friendly and useful community, encouraging other users to make very constructive contributions, too.

The TheyWorkForYou volunteer team spent quite a bit of time analysing voting records earlier this year, allowing us to add more policy lines to each MP’s page, and providing a snapshot of their affiliations.

And, although WhatDoTheyKnow has been around for three years, the team still find themselves actively debating site policy.

We’re always delighted to welcome new volunteers. If you’re interested, drop us a line at hello@mysociety.org, or come along to one of our pub-meets. There’s one tomorrow! See the Dec 16th advent calendar entry, below, or watch this blog for details of the next one.

December 19th

Image by Smoobs

What’s behind the door? A little donkey.

If you’re using public transport this Christmas, make sure you pack all the essentials: good food, presents – and the web address for FixMyTransport.com.

We hope you have a smooth journey, but if not FixMyTransport will allow you to report overcrowding, delays, or freezing cold carriages – and all on-the-go, if you have a smartphone.

Christmas is for giving, so share that URL with family, friends, and even your fellow passengers, should you find yourself in a coach or train that’s going nowhere. The power to contact the nation’s transport operators directly may just be the greatest gift you’ll ever give.

Well, ok, maybe that’s putting it a bit strongly, but when we see new bus stops being installed, new ticket machines, and longer trains being commissioned, we do start to hear angels sing.

Start your report here, or click on issues near you to see what’s irking passengers in your area. Transport all running smoothly? Lucky you – but the recent issues page is always an interesting read.

December 16th

What’s behind the door? A cup of good cheer.

Holiday Cheer by John Morgan

Our last pub-meet of the year will be the usual chance to come and have a chat with the mySociety team and volunteers. Reindeer antlers and Santa hats are optional, but welcome. Mulled wine may be in evidence. Mince pies could well be found on the premises.

If you’ve been wanting to ask more about any of our projects, to find out about volunteering – or if you would just like a chat and a drink with friendly people – please do pop by.

When? This Wednesday, the 21st of December, from about 6pm and into the evening.

Where? We’ll be at the Prince Arthur, near Euston station in London (map). One or more of us will be wearing a mySociety hooded top, to help you identify us.

One of our New Year’s resolutions is to have meet-ups in places other than London, so if you live outside the capital, watch this space.

Spread the word Because we’re one of those new-fangled digital-type organisations, we encourage use of a hashtag: #mySocial. And you can let us know you’re coming by dropping us a tweet on @mySociety.

December 15th

What’s behind the door? A half-dead Christmas tree.

Time Over, Trees by Bruno Sanchez-Andrade Nuño

Christmas comes but once a year… and in its wake, the inevitable slew of dumped Christmas trees and uncollected bins.

In Swindon last year, household bins weren’t collected for three weeks. In Canterbury, a puzzled American tourist mistook the dead fir trees on every street for some kind of crazy English tradition.

Perhaps worse (certainly when it comes to timing), Midnight Mass was made considerably less pleasant for this church-goer in Appledore when he stepped in some dog poop.

We know councils are doing their best to clear things up in the new year, up and down the country – but if those browning Christmas trees, overflowing bins and bottle-littered streets are getting you down, don’t forget FixMyStreet.com.

December 14th

Puds in the Making by Infobunny

What’s behind the door? A steaming Christmas pudding.

TheyWorkForYou.com keeps a complete record of parliamentary business as far back as 1935. So not only does it  help  you stay up to date with the latest business in Parliament, it also acts as a fascinating, searchable archive.

Consider, for example:

• Why was an American actress refused permission to act in the pantomime Mother Goose? (More details in this 1936 newspaper)
• Just two months after WW2 broke out, which German goods were found on British shelves?
• How many Christmas cards did Tony Blair send in 2004?
• If church bells could only be rung as a signal of invasion, would ringing them on Xmas day cause confusion?
• Was Aberdeen worse hit than the rest of the country when it came to making Christmas puddings?
• Who played Father Christmas at the Westminster party this year?

You can search for any word or phrase on TheyWorkForYou.com. Click on ‘more options’, and you can also restrict the dates you search within.

December 13th

What’s behind the door? An icy pothole.

Roadworks by John Ashby

Does it count as bleak mid-winter yet? After the mild start to the season, in some parts of the country it still feels as if the really cold weather is yet to come.

And yet, the freeze won’t be long in coming. Uneven pavements and potholes turn from a mild inconvenience to a real hazard in the ice – and you will certainly have already noticed if your streetlights aren’t coming on, now that the dark evenings are here.

So here’s for one last big push on our Fix Before the Freeze campaign. Make sure you report all those pesky potholes, uneven pavements, and broken street lights before the snow and ice get here in earnest, and help make your local community a safer place this winter.

December 12th

What’s behind the door? An angelic host, complete with shiny halos.

Image by Mikael Colville-Andersen

Our website Pledgebank has been used for some good causes around Christmas time. It’s based on the simple idea of promising that you will do something if other people promise to, too. It’s an effective way of taking an action and multiplying its impact.

In previous years, we’ve seen a pledge to visit people who may be alone at Christmas, and another to walk for an hour on Christmas day, among others.

If you’ve got plans this Christmas – say, donating to charity, giving gifts to the poor, or even organising a party,  Pledgebank could be the tool that tips the balance and helps you get the people-power you need.

Pledgebank isn’t just for individuals: Barnet council have been innovative in their usage of the Pledgebank software for the good of their community. Check out how they are using it to arrange a collection of gifts for the needy, and gritting.

December 9th

Snowman Neighbor by Melinda Shelton

What’s behind the door? Frosty the headless snowman.

FixMyStreet is our website for reporting problems such as potholes or broken streetlights, but last January, one user in Brighton and Hove wanted to express his outrage about something else.

Unfortunately, the council have rather less control over the kicking down of snowmen. Much as we sympathise with the frustrated anonymous reporter, we can’t really blame the council for not responding to this particular complaint.

Meanwhile, in Midlothian, we see nature doing the fixing but the council apparently taking the credit, much to our user’s displeasure.

If your neighbourhood suffers from uncleared snow, by all means use FixMyStreet.com to report it this year. If you feel the gritting could have been better, report it. If your snowman suffers an injury, however, maybe keep it to yourself.

December 8th

Tree Baubles by Paula Bray

What’s behind the door? A boring old bauble again.

What is a “Christmas Tree bill”?

A search through Hansard reveals that this is a commonly-used term in Parliament, and it refers to a bill which, as it passes through its various stages, has all sorts of “baubles” hung on it – that is to say, small, unrelated issues which are added to the main legislation.

The term apparently originated in the States, but has become commonplace in UK parliamentary discourse – and indeed provides an opportunity for some florid extemporising, as David Burrowes, Private Secretary, demonstrated recently in a debate about knife crime:

“As we look forward to Christmas and see today the Third Reading of a criminal justice Bill, I am reminded of previous Government Bills that ended up as Christmas tree Bills with baubles being hung on them at any given opportunity as they went through Parliament. I am sure that as this Bill goes to the other place, Ministers will want to ensure that further baubles are not hung on it in the form of extra pieces of law that take the fancy of noble Lords, as well as any little elves.”

Did you know that you can subscribe to any word or phrase on TheyWorkForYou? It’s very handy for making sure you know whenever your pet topic is debated. Set up your alert here.

December 7th

What’s behind the door? A kindly Santa Claus

Random Xmas by Knitting Iris

Our website WriteToThem.com allows you to contact your elected representatives – even if you don’t know who they are.

When you input your postcode, you’re given a list of your local councillors, MPs, MEPs and anyone else who represents you in any of our governmental bodies. The site then allows you to contact them directly.

That’s all very well, but what about the highest administration of them all – the one who decides if you’ve been naughty or nice? Sadly, WriteToThem.com does not cover Lapland, but we do have a helpful page providing Santa’s postal address in full.

Meanwhile, it’s just a thought – but you might find that putting your wishlist in front of your local representatives actually has more effect than a letter sent up the chimney, especially if it concerns your civic or community rights. Start here.

December 6th

What’s behind the door? A fizzling, blinking neon light

Image by David Zellaby

Our parents always told us that if decorations weren’t removed by Twelfth Night, terrible things would happen – but it seems that some councils are not so superstitious. Users of our website FixMyStreet reveal the occasionally erratic handling of this tradition.

7th of January was already too late for a resident of Durham. How would he have felt had he lived in Thatcham, where decorations were still up on the 18th of January?

It gets worse. In Birmingham, one lonely decoration was spotted on the 31st of January. In Consett, not only were the decorations taken down after Epiphany had passed, but they had been on 24 hours a day for the entire Xmas period. In the village of Cark, the Christmas tree was blocking access to a car park in early February. But we think Bournemouth takes the prize, with a Christmas decoration reported as still being in place on the 15th of March.

People are always complaining that Christmas starts too early – and now it seems it’s also dragging on too late. If you’d like to report council decorations that have outstayed their welcome, don’t forget FixMyStreet.com this January.

The 5th of January, in fact, if you’d like to adhere to Twelfth Night superstition. We’ll be looking out for the spike in users on that day.

December 5th

The Great British Property Scandal

What’s behind the door? An inn, with no vacancies over the Christmas period

It’s more than 2,000 years since a heavily pregnant Mary was told there was no room at the inn. With zoning restrictions a thing of the far-distant future, an empty stable was repurposed for her use, and… well, you know the rest.

Today, if there’s an empty stable (or, more likely, a house) near you, Channel 4 want to know about it. They are broadcasting the first in their Great British Property Scandal series tonight, examining the causes behind homelessness.

Key to the campaign is the fact that there are over a million empty properties in the UK, while two million families need a home. On their site you’ll find an empty property spotter tool, which allows you to report any vacant buildings to your council. There’s also an app.

Those tools have been built by a crack team of mySociety developers, drawing on our extensive experience of mashing up postcode and constituency data, and sending reports off to the right council contacts. If you’re wondering where we honed such skills, look no further than FixMyStreet, WriteToThem, and TheyWorkForYou, among other mySociety projects.

Not everyone knows that mySociety are available for contracting. All revenue from our commercial activities goes towards funding our not-for-profit projects. It’d really make our Christmas special if you were to spread the word, next time you hear of someone in need of innovative and really rather well-priced development work.

December 2nd

Tweet Worthy by Alexander Baxevanis

What’s behind the door? Ten Lords a-tweeting

Why is a Christmas card better than a tweet? It turns out not to be the start of a bad joke…

As Roger Gale MP revealed in a debate on the use of electronic devices (including mobile phones) in the Chamber of the House of Commons, “multi-tasking and a dual use of time” means that in the six weeks before Christmas “committee tables will suddenly be piled with Christmas cards being signed while Members are also participating in Committee business”.

Gale’s point is that such behaviour is excusable, but that having MPs updating their Twitter and Facebook statuses in the Chamber would be a bridge too far. What do you reckon? Personally we’d rather have a stream of useful comment, accessible from our phones or desktop computers, than a hastily-signed Christmas card.

Whether you’re a social media junkie, or agree that such things are unwelcome in the workplace, the entire debate is worth a read – along with hundreds of thousands of other speeches and statements from Lords and MPs, available on mySociety’s TheyWorkForYou.com.

December 1st

Children everywhere open the first door of their Advent calendars today – and we’re digging deep into the mySociety vat of Christmas spirit and presenting our very own countdown to the 25th. Didn’t think a civic and democratic charity had much in common with Christmas? Well, we’re here to prove otherwise.

Between now and the 25th, we’ll be updating this post each weekday with a Christmassy nugget from our archives. Enjoy them, and here’s hoping that Santa brings you whatever your heart desires, whether it’s the reply to that FOI request you put in on WhatDoTheyKnow.com, or the improved bus service you asked for on FixMyTransport.com.

Street Decoration by Sylvain Racicot

What’s behind the door? A string of flashing lights

As Christmas lights go on in towns and cities across the country, your inner Scrooge might be prompted to ask just how much they’re costing the public purse.

Never fear, Bah Humbuggers, for this is a topic that has been thoroughly explored by the users of our Freedom of Information request website WhatDoTheyKnow.com. See, for example, how Manchester cannily bartered for free celebrity appearances last year, while Lewisham puts importance on low-energy lightbulbs.

You can also check Westminster, Lewes, and Cardiff’s costs – and plenty more besides. We think that Leeds has the highest expenditure mentioned, at £477,600 for this year, but leave us a comment if you find a higher one.

Don’t forget that if you want to know how much your own council spent on Christmas decorations – or indeed anything else – you have the right to submit an  FOI request. Just remember to check that the information isn’t already available online before you do.

If you’ve visited our parliamentary site TheyWorkForYou.com, you’ll have noticed that on each MP’s page there is a short summary of his or her voting record on various key issues.

These issues have always been carefully chosen to give a simple but neutral top-line view of each MP’s voting activity. Judging by Twitter, they’re a fairly popular part of the site, too.

There’s way, way more tedious complexity behind producing these little summaries than you might think, and due to a lack of appropriately skilled people in our team over the last year we had let our vote analyses get a bit behind the times. If you’re really interested you can read about why authoring these things in such a scrupulously balanced way is so time consuming here.

We’re posting today to tell you that we have recruited a pair of excellent new part-time voting analysts, David and Ambreen, and they have recently produced the first of a new generation of voting summaries.

The first shows how each MP has voted on increasing the rate of VAT, and second on the recent changes to university tuition fees. We have also increased the number of votes which feed into the EU integration policy to bring it more up to date.

To see this new data, just pop along to TheyWorkForYou’s home page, stick in your postcode, and check out your own MPs’ page. Then, if you want to be made aware as soon as we’ve published the next analyses, please follow our new TheyWorkForYou Twitter account.

Lastly, I just want to say thank you to the vote analysts Ambreen and David, to senior developer Matthew and to uber-volunteer Richard Taylor for kicking this vital part of TheyWorkForYou back into top gear.

Image by European Parliament.

TheyWorkForYou has, until now, only covered things that have already happened, be that Commons main chamber debates since 1935, Public Bill committees back to 2000, or all debates in the modern Northern Ireland Assembly.

Upcoming business

From today, we are taking the UK Parliament’s upcoming business calendar and feeding it into our database and search engine, which means some notable new features. Firstly, and most simply, you can browse what’s on today (or the next day Parliament is sitting), or 16th May. Secondly, you can easily search this data, to e.g. see if there will be something happening regarding Twickenham. And best of all, if you’re signed up for an email alert – see below for instructions – you’ll get an email about any matching future business along with the matching new Hansard data we already send. We currently send about 25,000 alerts a day, with over 65,000 email addresses signed up to over 111,000 alerts.

Mark originally wrote some code to scrape Parliament’s business papers, but this sadly proved too fragile, so we settled on Parliament’s calendar which covers most of the same information and more importantly has (mostly) machine-readable data. Duncan and I worked on this intermittently amidst our other activities, with Duncan concentrating on the importer and updating our search indexer (thanks as ever to Xapian) whilst I got on with adding and integrating the new data into the site.

New TheyWorkForYou home page

I’ve also taken the opportunity to rejig the home page (and fix the long-standing bug with popular searches that meant it was nearly always Linda Gilroy MP!) to remove the confusingly dense amount of recent links, bring it more in line with the recently refreshed Scottish Parliament and Northern Ireland Assembly home pages, and provide more information to users who might not have any idea what the site covers.

Signing up for an email alert: If you want to receive an email alert on a particular person (MP, Lord, MLA or MSP), visit their page on TheyWorkForYou and follow the “Email me updates” link. If you would like alerts for a particular word or phrase, or anything else, simply do a search for what you’re after, then follow the email alert or RSS links to the right of the results page.

One of the most popular features on TheyWorkForYou is the plain English, non-judgemental vote analyses on MP pages that say things like “voted strongly against introducing a smoking ban“.  We call these ‘policies’, and they are authored by skilled people using the volunteer run PublicWhip website.

Making each one of these policies is a painstaking task, requiring good knowledge of how the Parliamentary voting system works, good writing skills, patience, and the strength of character not to let your own views about the issues cloud the analysis. It is of utmost importance to both mySociety and our users that these policies are fair and trustworthy.

Earlier this year we started to update the process by which we made new policies to make it even more rigorous, which we wrote about here. Marcus Fergusson and Stephen Young came onboard and did sterling work, but they have now moved on to greater things, and so we’re looking to recruit two to three new people to do this job. Uber volunteer Richard Taylor has been helping out recently, but this is really a job for two or more people.

You might very well ask ‘why two people, given the work is part time?’. The answer is that we really want every new policy to be cross-checked by two different people every time it is added or amended. This is to help eliminate possible mistakes, and prevent any unconscious biases.

We pay for this work on a piece work basis – £160 a time for a combination of one new policy authored, and one other policy double-checked. This money comes mainly from people making small donations, which I think helps keep everyone focussed on how important it is to get these right. We hope to add about two new policies a month, once the new team is up to speed.

If you’d like to be considered, please email hello@mysociety.org with ‘mspolicies’ in the subject line. Applications close 22nd November 2010.

The two days leading up to election day are a hugely important time for less politically-obsessive voters. The parties know that a lot of people are only starting to seriously think how to vote today and tomorrow, and TheyWorkForYou saw its biggest spike ever the day before the election, way back in 2005.

This means it’s a super-important time to get trustworthy, non-partisan information in front of as many people as possible. And you can help by doing the following simple things:

1. Go to your constituency page on the TheyWorkForYou Election Quiz and take a good look at the answers. Is there anything surprising in the answers? Has anyone failed to respond who really shouldn’t? Is there anything funny in the responses? Make a couple of notes about what you think are the most interesting findings.

2. If you know the name of your local papers or radio stations, try to Google for the email or phone number of the news desk. If you don’t know the names, try sticking the name of your nearest town into a media database like this, to get a phone number or email address.

3. If possible, you should start your pitch by phoning rather than emailing. If you get a phone number for a news desk, give them a bell and say that you’re a volunteer from “The country’s largest non-partisan election information project”, and ask for the email of a specific person who might be interested in a story about what local candidates are saying.

4. Once you have an email address of a specific journalist, compose a locally specific email for them, along the following lines:

“Hi X,

I’m a resident of Z constituency, and this election I’ve been one of 6000 volunteers helping  to build an unprecedented project to get candidates across the country to go on the record, in conjunction with the website TheyWorkForYou.com. It’s a strictly non-partisan project, aimed at giving voters a really clear, spin-free view of what their candidates stand for. I’d really appreciate it if you could give it some coverage before election day.

In my constituency, N candidates have completed our survey. From this we can see some quite interesting things, namely:

* Candidate A thinks…

* Candidate B thinks…

Would you be so kind as to print a story encouraging people to check our their candidates via TheyWorkForYou.com, and mentioning some of the highlights I’ve included?

all the best,

Your name, email, phone”

5. An hour after you send the email through, give the journalist a call back to see if they need any more help.

6. If you do this, please leave us a comment on this post so we know who’s had a go!

Thank you for helping spread some non-partisan information this election time, and enjoy the election…

As you may know, TheyWorkForYou are conducting a survey of candidates for Parliament. You can view the questions for your constituency on this list.

Quite a few people have been asking how we worked out the questions. There are two parts to this, one local and one national.

Local questions

We used the power of volunteers.

Thousands of DemocracyClub members were asked to suggest local issues in there area. These were then edited by other volunteers, to have consistent grammar, and be worded as statements to agree/disagree with, and filtered to remove national issues. The full criteria and examples are available.

You can view the issues for any constituency on the DemocracyClub site. They are in the “local questions” tab. e.g. For Liverpool, Riverside (where I live) you would go here.

We’ve ended up with local issues for about 85% of constituencies. They’re really interesting and high quality, and quite unique for a national survey.

Thank you to all the volunteers who helped make this happen!

National questions

This was hard, because we felt that asking more than 15 questions would make the survey too long. We also wanted to be sure it was non-partisan.

We convened a panel of judges, either from mySociety/Democracy Club or with professional experience in policy, and from across the political spectrum. They were:

• James Crabtree, chair of judges, trustee of mySociety, journalist for Prospect magazine
• Tim Green, Democracy club developer, Physics student, Cambridge University.
• Michael Hallsworth, senior researcher, Institute for Government.
• Will Davies, sociologist at University of Oxford, has worked for left of centre policy think tanks such as IPPR and Demos.
• Andrew Tucker, researcher at Birkbeck, worked for Liberal Democrats from 1996-2000.
• Robert McIlveen, research fellow, Environment and Energy unit at Policy Exchange, did PhD on Conservative party election strategy.

They met at the offices of the Institute for Government, and had a 3 hour judging session on 29th March 2010. They were asked to think of 8-15 questions, with multiple choice answers, which could usefully be answered both by members of the public and prospective candidates for national office.

To ensure maximum transparency, the discussions of the judges were recorded. You can download the recordings in two parts: part 1, part 2 (2 hours, 20 mins total).

Details of the broad framework the judges operated under are given by the chair of judges, James Crabtree, a trustee of mySociety, in the opening to the recordings.

Please do ask any questions in the comments below.

The following is a message that we’d like to see emailed around within political parties of all stripes. If you work for a party, or know anyone who does, please send it along:

———-

Hi there,

TheyWorkForYou.com has sent online surveys to nearly 3000 candidates
across the UK, including most of your party’s candidates. If you don’t know it, TheyWorkForYou is probably the largest politician transparency website in the UK, with about 3m visitors last year.

The survey we’ve sent is a rigorously neutral attempt to clarify candidates positions on many of the biggest issues at the election. It is also a long-term document – the data that comes from candidate responses will be viewed millions of times between now and the general election after this one. It also contains both local and national questions.

There are 6000+ volunteers now nagging non-responsive candidate.  You can help your party improve its responsiveness rating, here, but passing on the word that TheyWorkForYou’s survey is not push-polling, not single issue, not short-termist:
http://www.democracyclub.org.uk/twfy/chart/

Please help us by passing on the message that TheyWorkForYou will be one of the main ways that new MPs from all parties (and none) will be scrutinised and neither we nor new MPs want to start our relationship with a “refused to go on the record” badge on their pages.

If you are a candidate, and you want to do the survey, check your email for TheyWorkForYou (no spaces). If you don’t have it, drop a mail to developers@democracyclub.org.uk and it’ll be sent along shortly.

many thanks,

The staff and volunteers at TheyWorkForYou and Democracy Club

In January last year, at our yearly staff and volunteers retreat, we decided that TheyWorkForYou should do something special for the general election. We decided that we wanted to gather information on where every candidate in every seat stood on what most people would think were the biggest issues, not just nationally but locally too.

Our reasons for setting this ambitious goal were two fold. First, we thought that pinning people down to a survey that didn’t reward rhetorical flourishes would help the electorate cut through the spin that accompanies all elections. But even more important was to increase our ability to hold new MPs to account: we want users of TheyWorkForYou in the future to be able to see how Parliamentary voting records align with campaign statements.

This meant doing quite a lot of quite difficult things:

1. Working out who all the candidates are (thousands of them)
2. Working out how to contact them.
3. Gathering thousands of local issues from every corner of the country, and quality assuring them.
4. Developing a balanced set of national issues.
5. Sending the candidates surveys,  and chasing them up.

The Volunteer Army

This has turned out to be a massive operation, requiring  the creation of the independent Democracy Club set up by the amazing new volunteers Seb Bacon and Tim Green,  and an entire candidate database site YourNextMP, built by another new volunteer Edmund von der Burg.  Eventually we managed to get at least one local issue in over 80% of constituencies, aided by nearly 6000 new volunteers spread from Lands End to John O’Groats. There’s at least one volunteer in every constituency in Great Britain, and in all but three in Northern Ireland. Volunteers have done more than just submit issues, they’ve played our duck house game (you can still win!)  to help gather thousands of email addresses, phone numbers, and postal addresses.

The Survey

What we ended up with is a candidate survey that is different for every constituency – 650 different surveys, in short. The survey always contains the same 15 national issues (chosen by a politically balanced panel held at the Institute for Government)  and then anything between zero and ten local issues. We’ve seen everything from cockle protection to subsidies for ferries raised – over 3000 local issues were submitted, before being painstakingly moderated, twice, by uber-volunteers checking for for spelling, grammar, obvious bias and straightforward interestingness (it isn’t really worth asking candidates if they are in favour of Good Things and against Bad Things).

In the last couple of days we’ve started to send out the first surveys – we’ve just passed 1000 emails, and there are at least 2000 still to be sent.

The Output

We’re aiming to release the data we are gathering on candidates positions on 30th April. We’ll build a nice interface to explore it, but we also hope that others will do something with what we are expecting to be quite a valuable dataset.

The Pressure

Candidates are busy people, so how do we get their attention? Happily, some candidates are choosing to answer the survey just because TheyWorkForYou has a well know brand in the political world, but this has limits.

The answer is that we are going to ask Democracy Club, and it’s army of volunteers to help. We’ll shortly roll out a tool that will tell volunteers which of their candidates haven’t taken the opportunity to go on the record , and provide a range of ways for them to push for their candidates to fill it in.

It would be a lie to say we’re confident we’ll get every last candidate. But we are confident we can make sure that no candidate can claim they didn’t see, or didn’t know it was important to their constituents. And every extra voice we have makes that more likely.

Join Democracy Club today

Making Parliament clearer; mySociety announces a new process for monitoring MP's votes. (Image: Monet)

mySociety is lucky enough to have a number of small donors who give us monthly donations, normally ranging from £5-£20 (if you like our work and want to support us, please do join them!). Today we’re announcing a change to TheyWorkForYou which is supported by these donations.

One of the most popular features on TheyWorkForYou is the vote analysis – the bit that tells you that your MP “voted strongly against introducing a smoking ban” and so on. These voting analyses cut through a massive wall of parliamentary opacity whilst still allowing visitors to examine the details first hand. Despite each analysis resulting in just a single line on TheyWorkForYou, each one is rather time-consuming to construct, and TheyWorkForYou has not updated them as much as our users deserve.

Thanks to our small donors we’ve now been able to commission two part time researchers, Marcus Fergusson and Stephen Young, to help add new vote analyses more regularly. We’re pleased to say that we’ve just rolled out the first new policies, covering issues relating to schools, inquests and the House of Lords. We aim to add a couple of new vote analyses a month for the foreseeable future.

We take the business of authoring analyses that are scrupulously fair and neutrally worded extremely seriously. To this end we have replaced our previously ad-hoc approach with a newly instituted process designed to ensure the maximum rigour and balance, and to ensure we focus on issues which MPs thought were important even if they were not so well covered by the media.

TheyWorkForYou’s analysis of MP’s voting positions relies on The Public Whip, a project run by Julian Todd which tracks which way MPs vote.

The new process for analysing MP’s positions works like this:

1. A list of votes in the current Parliament, ordered with the highest turnout at the top, is taken as a starting point. The turnout figure used is corrected to account for party abstentions.
2. mySociety’s researchers work down that list writing explanations in easy to read terms describing what the vote was about; they also identify other related votes on the same issue and research those too.
3. A “policy position on the issue” is then chosen against which MP’s votes are compared to determine to what extent they agree or disagree with it. Policy positions are written to be intelligible and interesting to a wide range of users and in such a way that votes to change the status quo are ultimately described on TheyWorkForYou MP pages as votes “for” that change.

We hope you find these analyses useful. Thanks to Richard Taylor for his divisions list and help with this post.

Current Birmingham parliamentary boundaries

Birmingham parliamentary boundaries at the next election

Parliamentary boundary changes appear to be a source of confusion to many people and organisations. The facts are quite simple – parliamentary boundary changes, proposed by the various Boundary Commissions, do not take effect until the next general election. Until then, your MP remains whoever they have been, no matter what literature you may get through your letter box, or what anyone may tell you.

As one example, take Birmingham City Council. Their page on constituencies and wards correctly states that Birmingham is divided into eleven parliamentary constituencies, but then goes on to list only ten – they are listing the new constituencies which do not yet exist, as Birmingham is losing one constituency at the next election. It appears that they have organised themselves along the new boundaries in advance – which is fine, but this doesn’t affect current Parliamentary representation, and so they should explain this clearly, as otherwise members of the public get confused (and blame us for giving them the “wrong” MP, when we haven’t done so). As you can see from the maps above (which highlight Birmingham, Hall Green), the constituencies will be changing their boundaries quite a bit, and we have had reports of people receiving letters from candidates in the next election who are MPs of different neighbouring constituencies, simply referring to themselves as an MP, which is a great source of confusion.

St Josephs Avenue is just below the Royal Orthopaedic Hospital

An inhabitant of St Josephs Avenue, Birmingham (behind the Royal Orthopaedic Hospital), which is currently within the Selly Oak parliamentary constituency (red), and the Northfield ward of Birmingham City Council (green), would, on looking at Birmingham City Council’s website, assume they’re in a parliamentary constituency called Northfield. Northfield is currently the constituency to the west of Selly Oak; at the next election, its boundary with Selly Oak will change to the blue line, at which point St Josephs Avenue will be in the Northfield constituency. But not until then.

Map of Streatham constituency at next election

Current Streatham parliamentary boundary

As another example (chosen purely as it has come up in user support), the Labour candidate for Streatham has a page about the constituency – obviously you would expect a candidate to be talking about the future constituency, but would it hurt to add some explanation that Streatham is currently a slightly different shape?

Boundaries of different things are all independent – if a ward boundary moves due to some local issue, the corresponding Parliamentary boundary does not necessarily change with it (probably not, in fact). So when Birmingham changed its ward boundaries back in 2003, they became out of sync with the Parliamentary constituencies. From the next election, things will be more in sync as the new Parliamentary boundaries are based on more recent ward boundaries, but this will again separate over time. All we can do is always clearly explain the current situation, and ask that others do the same.

Image from jaygoldman

Note: This post is a work in progress, I need your help to improve it, especially with knowledge of non-English sites

I was recently in Washington DC catching up with mySociety’s soul-mates at the Sunlight Foundation. As we talked about what was going on in the field of internet-enabled transparency, it came clear to me that there are now more identifiable categories of transparency website than there used to be.

Identifying and categorising these types of site turns out to be surprisingly useful.  First, it can help people ask “Why don’t we have anyone doing that in our country?” Second, it can help mySociety to make sure that when we’re planning ahead we don’t fail to consider certain options that be currently off our radar. Also, it gives me an excuse to tell you about some sites that you may not have seen before.

Anyway, enough preamble. Here they are as I see them – please give me more suggestions as you find them. As you can see there’s a lot more activity in some fields than others.

1. Transparency blogs & newspapers – At the technically simplest, but most manual labour-intensive end of the scale is sites, commercial and volunteer driven, whose owners use transparency to help them to write stories. Given almost every political blog does this a bit, it can be hard to name specific examples, but I will note that Heather Brooke is the UK’s pre-eminent FOI-toting journalist/blogger, and we’ve just opened a blog for our awesome volunteers on WhatDoTheyKnow to show their FOI skills to an as-yet unsuspecting public.

2. What Politicians do in their parliaments – These sites primarily include lists of politicians, and information about their primary activities in their assemblies, such as voting or speaking. This encompasses mySociety’s TheyWorkForYou.com, Rob McKinnon’s one man labour of love TheyWorkForYou.co.nz, Italy’s uber-deep OpenPolis.it (6 layers of government, anyone?), Germany’s almost-un-typable Abgeordnetenwatch,  Romania’s writ-wielding IPP.ro, Josh Tauberer’sGovTrack.us, plus the bonny bouncing babies OpenAustralia and Kildare Street (Ireland). Of special note here are Mzalendo (Kenya) who unlike everyone else, can’t reply on access to a parliamentary website to scrape raw data from, and Julian Todd’s UNDemocracy (International), that has to fight incredible technical barriers to get the information out.

3. Databases of questions and answers posed to politicians – These sites let people post politicians questions, and the publish the questions and answers. The Germans running Abgeordnetenwatch (Parliament Watch) seem to have had considerable success here, with newspapers citing what politicians say on their site. Yoosk has some politicians in the UK on it, too.

4. Money in politics – This comes in two forms, money given to candidates (MAPlight), and money bunged by politicians to their favourite causes (Earmark watch). In the UK, as far as I know, the Electoral Commission’s database remains currently unscraped, perhaps because the data is so ungranular.

5. Government spending – where the big money goes. In the US the dominant site is FedSpending.org, and in the UK we have ukpublicspending.co.uk.

6. Websites containing bills going through parliament, or the law as voted on – This includes the increasingly substantial OpenCongress in the US which saw major traffic during the Health Care debates, and the UK government’s own Acts database and  Statute Law Database. Much of the legal database field, however, remains essentially private.

7. Services that create transparency as a side effect of delivering services – Our own sites lead the way here: FixMyStreet‘s public problem reports and WhatDoTheyKnow’s FOI archive are both created by people who aren’t primarily using the site to enrich it – they’re using it to get some other service.

8. Election websites – These come in many forms, but what they have in common is their desire to shed light on the positions and histories of candidates, whether incumbents or new comers. The biggest beast here is Stemwijzer (Netherlands), probably in relative terms the most used transparency or democracy site ever. However these sites are popular in several places,  the big but highly labour intensive VoteSmart (US), Smartvote.ch (Switzerland), plus others.  mySociety is shortly to start to recruit constituency volunteers to help with our take on this problem, keep an eye on this blog if you want to know more.

9. Political document archives - This is a new category, now occupied by Sunlight’s Partytime archive for invitation to political events, and TheStraightChoice, Julian Todd and Richard Pope’s wonderful new initiative for archiving election leaflets and other paper propoganda.

10. Bulk data - Online transparency pioneer Carl Malamud doesn’t do sites, he does data. Big globs zipped up and made publicly available for coders and researchers to download and process. The US government has now stepped into this field itself with Data.gov, doubtless soon to be followed by data.gov.uk.

——

Please don’t shoot me if I’ve missed anything here, the world is a big place. But I thought that was a useful and interesting exercise, and I hope you’ll both find it useful, and help me improve it too. Comment away.

Hansard's Parliamentary Debates by hugovk (cc)

The House of Commons debate coverage on TheyWorkForYou has recently extended back from the 2001 general election to the 1935 general election, and our knowledge of MPs now extends back to the start of the 19th century. This means TheyWorkForYou now includes things such as Anthony Eden on the Suez Canal in 1956, saying “there was not foreknowledge that Israel would attack Egypt“; the debate the day after Bloody Sunday in 1972; Geoffrey Howe’s resignation statement in 1990; Neville Chamberlain on the eve and start of the second World War in 1939; and Winston Churchill‘s speeches to the House, such as We shall fight on the beaches and This was their finest hour in 1940. This and much, much more are available and searchable using our new improved advanced search, which allows you to filter by e.g. date range or person. We hope people enjoy researching this huge wealth of information (I certainly do), and add useful annotations to the text to help other people.

This would not have been possible without the original project by Parliament to digitise historical copies of Hansard and make them available, nor the internal Parliamentary project to clean up the data, match up speaker names, and so on. The project was kindly funded by the Ministry of Justice’s Innovation Fund, which also supported the creation of FixMyStreet and GroupsNearYou.

As a new edition has just been released, and I’ve had to tweak the parser to cope with the new highlighting, it’s a good time to write a brief article on TheyWorkForYou’s handling of the House of Commons Register of Members’ Financial Interests (Register of Members’ Interests as was before the current edition). Way back in the day, a scraper/parser was written (by either Julian or Francis) that monitors the Register pages on www.parliament.uk for new editions, and downloads and broadly parses the HTML into machine-readable data. The XML produced can be found at http://ukparse.kforge.net/parldata/scrapedxml/regmem/ – TheyWorkForYou then pulls in this XML into its database, and makes the latest data available on every MP’s page.

However, as it’s been scraping/parsing the Register since 2000, we can do more than that. Each MP’s page contains a link to a page giving the history of their entry in the Register – when things were added, removed, or changed. You can also view the differences between one edition of the Register and the next, or view a particular edition in a prettier form than the official site. There’s a central page containing everything Register-related at http://www.theyworkforyou.com/regmem/

Update: The Telegraph posted a retraction yesterday.

You may have seen coverage on various websites saying that a civil servant was sacked after posting a comment on TheyWorkForYou.

We’ve no idea what this story is about, but we’re pretty certain it has nothing whatsoever to do with TheyWorkForYou. No journalist bothered to contact us before running the story.

• There is no comment on TheyWorkForYou containing the text quoted in that article, nor anything like it, nor has there ever been. Nor in fact (as we’ve checked), on HearFromYourMP, WriteToThem, or WhatDoTheyKnow.
• Only one comment has been left on any contribution by Hazel Blears in 2009, and it’s definitely not related to this.
• 27 comments were left on 13th May, the date the comment was apparently posted; we’ve read them all and they’re all nothing to do with this.

So frankly, we’ve no idea what’s going on.

What we do know is that the implication that mySociety would merrily hand over sensitive personal data that ends up in getting someone sacked, without fighting tooth and nail for their privacy every inch of the way, is a complete misinterpretation of the way we work and the things we hold most dear. No-one has ever contacted us to ask us to hand over such data, nor have we ever done so.

We think what might have happened is a simple mis-remembering of the website that contained the problematic comment. We’re hoping to get in touch with Lisa Greenwood so we can get full details before asking the various media companies that have run with this for a correction.

Richard Pope has been redesigning mySociety’s biggest site TheyWorkForYou.com for a couple of months.

He’s done a heroic job, as has Matthew with his epic import of Hansard data from 1935 onwards.  TheyWorkForYou is a much better site for their combined work recently. We’ll be writing more on the historic stuff soon.

There are a few things I’d like from you as a member of the mySociety community:

1. Please say a big thanks to Richard. This was not an easy or relaxing task at all, and he’s done it brilliantly. Just check a Lords debate to see the attention to detail. We are a very lucky organisation to have him, as he’s always in demand.

2. Please give some constructive criticism on how it could be even better (please note, focussing on design here, we already have a load of feature priorities to deliver).

3. Anyone who could help supply a redesigned logo, or some nicely processed parliamentary-themed artwork to sit in the background grey-boxes on the homepage would be doing a very Good Deed for mySociety.

And lastly, please do pledge to become a TheyWorkForYou Patron, so we can keep doing things like this in the future!

‘Thumbs up’ by Carf (cc)

A few days ago mySociety asked the known possible candidates for Speaker to endorse 3 principles relating to making Parliament more transparent on the Internet.

We’ve now had endorsements which you can read on the individual pages of Sir George Young, Sir Menzies Campbell, Frank Field, Tony Wright and Sir Alan Beith , which until Parmijit Dhanda declared this morning, represented endorsement by 50% of the possible field. We also just recieved a typically frank and interrogative phonecall from Ann Widdecombe, who will be writing a formal response soon.

So, come on, John Bercow, Alan Haselhurst, Patrick Cormack, Sylvia Heal, and Chris Mullin. What’s holding up your replies? The days counter on your pages is telling the world how quick you are to respond…

Update: 11 June - John Bercow has now endorsed, and we’ve written to Margaret Beckett and Parmjit Dhanda, who’ve just declared their candidacies.

Update 2: Chris Mullin has told us he is ‘not a candidate’.

Update 3: Sir Alan Haselhurst has also endorsed.

Update 4 – Speaker Election Day: And Sir Michael Lord endorses too.

In less than 24 hours we’ve seen the first reply to our emails asking possible Speaker candidates to endorse our three principles. It is from Sir George Young – we’re looking forward to seeing the responses from the others that we wrote to.

Sir George is broadly supportive, which is great, and we’ve printed his reply in full on his own TheyWorkForYou MP page.

In the mean time, please do write to your MP and ask them to ensure that whoever they vote for, it is a candidate who has endorsed mySociety’s three simple principles, You really can have an impact on this issue: MPs are desperate to be seen to be acting for their constituents right now.

NB mySociety is strictly non-partisan and non-party aligned. We want all candidates from all parties to endorse these principles, and we have ensured that none of the wording of the principles leans towards any particular party or set of beliefs not connected to transparency in the modern age.

Speaker’s Chair (Parliamentary Copyright)

mySociety has today emailed (and in one case, posted) a set of 3 Principles which we believe it is important that all candidates for Speaker endorse, before the election of a new Speaker by MPs.

1. Voters have the right to know in detail about the money that is spent to support MPs and run Parliament, and in similar detail how the decisions to spend that money are settled upon.

2. Bills being considered must be published online in a much better way than they are now, as the Free Our Bills campaign has been suggesting for some time.

3. The Internet is not a threat to a renewal in our democracy, it is one of its best hopes. Parliament should appoint a senior officer with direct working experience of the power of the Internet who reports directly to the Speaker, and who will help Parliament adapt to a new era of transparency and effectiveness.

We will be posting the status of requests on the likely candidates web pages where we expect large numbers of people to see them before the vote in late June. We have also taken the unusual step of allowing possible candidates to leave a statement of up to 150 words on the principles.

(NB no candidates have actually declared at this stage, so we are starting with the BBC’s list of possibles)

Rationale

mySociety helped lead the campaign back in January to prevent the last ditch attempts to conceal MPs’ expenses. We did so not because, like the newspapers, we wanted to revel in embarrassment and scandal, but because we believe that in the Internet age, the only way for our democracy and government to thrive is if they are open and connected to the net as the rest of us expect them to be. The dramatic events seen in Parliament in recent days vindicate the view that secrecy breeds poor policies and seeds untrustworthy behaviour in the weaker willed.

Furthermore, more than a simple attitude of openness is required of the new Speaker: the public needs a genuine will to push for technological reform using the power of the Internet that will take both open-mindedness and a willing to tread on toes, especially in some parts of the unelected establishment.

Case in point: Over the last two years we have been trying to persuade Parliament to acknowledge that the way it publishes its Bills online is hopelessly inadequate for the Internet age. The campaign has faltered, despite multi partly endorsement from 140 MPs and a campaign membership of thousands. To see why, just take a look at this colourful and error-crammed internal email that we uncovered using the Freedom of Information Act, published for the first time today.

The new Speaker will have a tough job on their hands to overcome resistance of this kind. The best thing we can do is help the new Speaker, whoever they are, assume their new job with a clear mandate from the public, as well as from members.

Act!

That is why, as a final part of this call, we are asking you, our community, to write to your MP today to let them know that you expect them to vote for a candidate that has endorsed the principles above. Your voices to your own constituency MPs can resonate in a way that no blog post or newspaper article ever can. Go to it.

UPDATE: If you approve of what we did this week, and what to help make sure we can still do it in the future, please pledge to support us: http://www.pledgebank.com/supportmysociety

The vote on concealing MPs’ expenses has been cancelled by the government!

In other words – we won!

This is a huge victory not just for transparency, it’s a bellwether for a change in the way politics works. There’s no such thing as a good day to bury bad news any more, the Internet has seen to that.

Over 7000 people joined a Facebook group, they sent thousands of emails to over 90% of all MPs. Hundreds of thousands of people found out about the story by visiting TheyWorkForYou to find something they wanted to know, reading an email alert, or simply discovered what was going on whilst checking their Facebook or Twitter pages. Almost all of this happened, from nowhere, within 48 hours, putting enough pressure on Parliament to force change.

Make no mistake. This is new, and it reflects the fact that the Internet generation expects information to be made available, and they expect to be able to make up their own minds, not be spoon fed the views of others. This campaign was always about more than receipts, it was about changing the direction of travel, away from secrecy and towards openness.

Today we stopped moving in the wrong direction. Tomorrow we start moving the right way. Sign up to our news mailing list (box on the right) to get updates on what mySociety gets up to.

7,000 members on the Facebook group, over 93% of MPs contacted. Lots of news coverage: BBC, Daily Mail, Guardian, Telegraph, Times. John Mann MP makes a good point in a letter to the Guardian: “Few of my constituents care about the detail of how I spend their money as long as I do a good job, but nearly all of them care that they have the right to find out if they really feel the need to.”

Tom has updated the main blog post with a quote from President Obama’s speech that I thought was worth repeating, on why this is a much bigger issue than some bits of paper and some minor embarrassment: “And those of us who manage the public’s dollars will be held to account – to spend wisely, reform bad habits, and do our business in the light of day – because only then can we restore the vital trust between a people and their government.”

If you haven’t already, do write to your MP, and pick up the phone and call your local radio and TV news stations to let them know about this.

We’ve been shown or seen a few responses from MPs, after people wrote to them, saying that they are worried about their addresses being made public. If this is their main barrier to voting No on Thursday, they have nothing to worry about: they voted to exclude their residential addresses (and expenses on security, and future/regular travel) from the Freedom of Information Act in July 2008.

In fact, one of the reasons it is costing so much money to collate and edit these expenses is staff have been going through and making sure precisely that such information would not be released.

It is sad that MPs don’t seem to know what the law is, and I hope someone will stand up in the debate on Thursday and make this point.

A few moments ago the team rolled out changes to our biggest and best known site, TheyWorkForYou.com meaning that every visitor to any page of the site will be greeted with a call to arms on the issue of some MPs voting this Thursday to conceal their expenses. And after the vote, we’ll be prominently publishing who voted which way – there should be a couple of million visitors at least before the next election.

Our explicit goal is to have a lot of constituents from around the country let their MPs know they won’t be impressed with a ‘yes’ vote or an abstention (the same thing in this case), and to build our Facebook group to the point where the mainstream media starts to take notice of this Net driven discontent.

Please do everything you can to get as many people as possible writing to their MPs and joining that Facebook group. We’re doing our bit – please do yours. Together we can stop the encouraging trend of more openness in our Parliament scrunching into reverse.

Last week I gave my first presentation by video conference. It was to the intriguing Circus Foundation, who are running a series of workshops on new democracy. It came about because I was a bit busy and tired to travel from Cambridge into London. Charles Armstrong, from the Circus Foundation, suggested that I present over the Internet.

We used Skype audio and video, combined with GoToMeeting so my laptop screen was visible on a projector to an audience in London. Apparently my voice was boomed round the room. It was a slightly odd experience, more like speaking on the radio. However, I had a good serendipitous one to one chat while we were setting up, with Jonathan Gray from OKFN.

I was asked to give a quick overview of mySociety, as a few people in the audience hadn’t heard of us, and also to talk about how I saw the future of democracy. I talked about three of our sites, and what I’d like to see in each area in 10 years time.

• TheyWorkForYou opens up access to conventional, representational democracy, between and during elections. In 10 years time, I asked for Parliament to publish all information about its work in a structured way, as hinted at in our Free Our Bills campaign. So it is much easier for everyone to help make new laws better.
• FixMyStreet is local control of the things people care about, a very practical democracy. In 10 years time I’d like to see all councils running their internal systems (planning, tree preservation orders… everything that isn’t about individuals) in public, so everyone can see and be reassured about what is being done, why and where.
• WhatDoTheyKnow shows the deep interest that there is by the public in the functioning of all areas of government. In 10 years time, I’d like to see document management systems in wide use by public authorities that publish all documents by default. Only if overridden for national security or data protection reasons would they be hidden.

Charles Armstrong, from the Circus Foundation, has written up the workshop.

Downsides of the video conferencing were that I couldn’t hear others speak, as they didn’t have the audio equipment. I had to take questions via Charles. This meant I also couldn’t participate in the rest of the evening, or easily generally chat to people. All very solvable problems, with a small amount of extra effort – Charles is going to work on it for another time.

Of course this also all saves on carbon emissions (cheekily, taking off my mySociety hat for a moment, sign up to help lobby about that).

My house mate just said that his friend, who is at sixth form college, just had a PSHE (personal, social and health education) lesson in which they studied the website TheyWorkForYou.com.

Apparently it is good and I should go to it.

The epic task of manually matching each of the 42,019 video clips of MPs was started way, way back, ooh, about 12 whole weeks ago. Two days ago the Number 1 rated volunteer timestamper in our league table, Abi Broom, completed the last clip in our database, bringing her personal tally to 8,543 clips.

Abi Broom, No1 timestamping league table champ

Last night we went out and met with Abi and Robert Whittakker, one of the other super-timestampers who had done over 2,000 himself.

As a result of their efforts, and those of hundreds of other volunteers, we have put all the video that we have of the House of Commons sitting over the last year online, next to the text of the debates. The many thousands of people per day who visit TheyWorkForYou can, as a direct consequence of this work, now see video of most of the debates for the last year. When people embed clips on their own sites, that’ll also be thanks in part to our volunteers.

Robert Whittaker, down in 5th place with a measly 2047 clips to his name

When Parliament starts again in the Autumn there’ll be another 300-400 clips a day to do, but we have a feeling the only problem doing them will be who gets to them first.

In the meantime, we’ll soon be working on another game-like toy to help create more data. Hint – it might have something to do with GroupsNearYou.

One of the special pieces of magic in TheyWorkForYou is its email alerts, sending you mail whenever an MP says a word you care about in Parliament. Lots of sites these days have RSS, and lots have search, but surprisingly few offer search based email alerts. My Mum trades shares on the Internet, setting it to automatically buy and sell at threshold values. But she doesn’t have an RSS reader. So, it’s important to have email alerts.

So naturally, when we made WhatDoTheyKnow, search and search based email alerts were pretty high up the list, to help people find new, interesting Freedom of Information requests. To implement this, I started out using acts_as_solr, which is a Ruby on Rails plugin for Solr, which is a REST based layer on top of the search engine Lucene.

I found acts_as_solr all just that bit too complicated. Particularly, when a feature (such as spelling correction) was missing, there were too many layers and too much XML for me to work out how to fix it. And I had lots of nasty code to make indexing offline – something I needed, as I want to safely store emails when they arrive, but then do the risky indexing of PDFs and Word documents later.

The last straw was when I found that acts_as_solr didn’t have collapsing (analogous to GROUP BY in SQL). So I decided to bite the bullet and implement my own acts_as_xapian. Luckily there were already Xapian Ruby bindings, and also the fabulous Xapian email list to help me out, and it only took a day or two to write it and deploy it on the live site.

If you’re using Rails and need full text search, I recommend you have a look at acts_as_xapian. It’s easy to use, and has a diverse set of features. You can watch a video of me talking about WhatDoTheyKnow and acts_as_xapian at the London Ruby User Group, last Monday.

TheyWorkForYou now finds whenever an old version of Hansard is referenced (which they do by date and column number, e.g. Official Report, 29 February 2008, column 1425) and turns the citation into a link to a search for the speeches in that column on that date. This only really became feasible when we moved server, upgraded Xapian, and added date and column number metadata (among others), allowing much more advanced and focussed searching – the advanced search form gives some ideas. Perhaps in future we’ll be able to add some crowd-sourcing game to match the reference to the exact speech, much like our video matching (nearly 80% of our archive done!). :)

Kudos to Google and Yahoo! for spotting this change within a couple of days, as they’re now so busy crawling everything for changes that they’re slowing the whole website down… ;-)

If you enter your postcode on TheyWorkForYou and it’s Scottish or Northern Irish, you’re now presented with your MSPs and MLAs as well as your MP, which makes sense given the site covers their Parliament and Assembly respectively. :-) You also get an extra tab in the navigation linking through to Your MSPs or MLAs. In order to do this, I needed a quick way of determining if a postcode was Northern Irish or Scottish. Northern Ireland was easy, as all postcodes there begin with BT. I assumed Scotland was also easy, which turned out to be true apart from the TD postcode area that straddled the border like a mail-sorting Niagara Falls. After some very dull investigation, I eventually worked out that e.g. most of TD15 is in England, but (amongst others) TD15 1X* is in Scotland, except for TD15 1XX which is apparently back in England. The final result was the postcode_is_scottish() function in postcode.inc, which (hopefully) correctly determines if a given postcode is Scottish or not – perhaps someone else will find it useful.

Debate pages that have at least one timestamped speech (such as the previously mentioned last week’s Prime Minister’s Questions) have a video fixed to the bottom right hand corner (if your browser is recent enough) showing that debate. While playing the video, the currently playing speech is highlighted with a yellow background, and you can start watching from any timestamped speech by clicking the “Watch this” link by any such speech. So how does all that work?

I’m very proud of this feature, I wasn’t sure it would be possible, and it’s very exciting. :-)

Flash has an ExternalInterface API, where JavaScript can call functions in the Flash, and vice-versa. When the video player loads, it requests an XML list from the server of all speech GIDs and timestamps for the current debate (here’s the file for the above debate). So when someone clicks a “Watch this”, it calls a moveVideo function in main.mxml with the GID of the speech, which loops through all the speeches and moves to the correct point if possible.

The highlighting works the other way – as the video is playing, it checks to see which speech we’re currently in, and if there’s been a change, it calls the updateSpeech function in TheyWorkForYou’s JavaScript, which finds the right row in the HTML and changes the class in order to highlight it. Quite straightforward, really, but it does make following the debate very simple and highlights the linking between the video and the text, all done by our excellent volunteers (join in! :) ).

Talking of our busy timestampers, I’ve also been busy making improvements (and fixing bugs) to the timestamping interface to make things easier for them. As well as warnings when it looks like two people are timestamping the same debate at the same time, various invisible things have been changed, such as using other people’s timestamps to make the start point for future timestamps on the same day more accurate. I also added a totaliser, using the Google Chart API, for which you simply have to provide image size and percentage complete.

Approaching 45% of our entire archive of video timestamped, with the totaliser approaching the chartreuse :-)

Previous articles

1. The Flash player
2. Seeking
3. Highlighting the current speech

Our video is streamed via progressive HTTP, using lighttpd and mod_flv_streaming. This works by having keyframe metadata at the start of the FLV (Flash video) file (we add ours using yamdi as that doesn’t load the whole file into memory first), which maps times within the video to byte positions within the file. When someone drags the position slider, or presses a skip button, the player actually changes the source of the video to something like file.flv?start=<byte position> which starts a new download from that point in the video. This means you can seek to parts of the video not yet downloaded, which is definitely a required feature.

The video is split up into programme chunks, according to BBC Parliament’s schedule, so each Oral Questions will (approximately) be its own video chunk, and the main debates will be a couple of chunks. By default, the video player will show a screengrab from the start of the video, as that’s all that’s available when it first loads (you have to load the start of the FLV file to fetch the keyframe metadata in order to move anywhere else :) ). I wanted the player to show a relevant screengrab before you hit Play, so came up with the slightly messy workaround of setting the volume to 0, seeking and playing the video for under a second in order to start it from the new point and show the video, then stopping it and resetting the volume. It works most of the time :-)

Some of our video chunks have jumps in them, due to problems in downloading the original WMV stream. The timestamping interface has a link for people to let us know of such problems, so that we can mark the relevant speeches as missing video and not have them be offered to future timestampers. One valiant volunteer, Tim, let us know about two such videos, but with the added oddity that if you let them play, they would happily carry on past their “end” point, but this made timestamping those speeches quite difficult.

I started investigating, firstly noting that both videos should have been 6 hours long, but were both listed as 1:20:24, which I thought was a bit of an odd coincidence. After reading the FLV file specification, it turned out that 32-bit millisecond timestamps in FLV are split into two – first the low 24 bits, then the high 8 bits. 2^24 = 16,777,216, which in milliseconds is 4 hours, 39 minutes, 37 seconds, which is pretty much exactly what the two videos’ durations were short by! All the timestamps in our FLV files were not setting the high byte, so after 4:39:37, they were wrapping round to 0 (and thus 6 hours became 1:20:24ish).

Our video processing consists of four major steps – the downloading script uses ffmpeg to convert each 75 minute chunk from WMV to MPEG; then nightly processing uses ffmpeg again to convert the right bits of these MPEG files to FLV, mencoder to join the relevant FLV files into one FLV chunk, then yamdi to add the metadata. My first try at a solution was to alter yamdi to increment the high byte itself, which fixed the duration display and let you seek to high times, but when you tried to go to e.g. 5 hours, the video started playing from the right point but the video thought it was playing from 20 minutes in. This would obviously confuse timestamping!

As the FLV files produced by ffmpeg were all under 75 minutes long, they couldn’t have the problem. It turned out we were running an old version of mencoder, and updating that and converting all our long video files fixed the problem. Phew :-)

Join us later today for my third short technical talk on TheyWorkForYou video, where I’ll explain how our Flash application talks to the HTML and vice-versa to enable the “Watch this” and highlighting of speeches.

1. The Flash player
2. Seeking
3. Highlighting the current speech

TheyWorkForYou video timestamping has been launched, over 40% of available speeches have already been timestamped, and (hopefully) all major bugs have been fixed, so I can now take a short breather and write this short series of more technical posts, looking at how the front end bits I wrote work and hang together.

Let’s start with the most obvious feature of video timestamping – the video player itself. :) mySociety is an open-source shop, so it was great to discover that (nearly all of) Adobe Flex is available under the Mozilla Public Licence. This meant I could simply download the compiler and libraries, write some code and compile it into a working SWF Flash file without any worries (and you can do the same!).

Writing a Flex program is split into three main areas – MXML that lays out your application, defines any web services you’re using and so on; CSS to define the style of the various components; and ActionScript to deal with things like events, or talking to the JavaScript in the parent HTML. My code is probably quite shoddy in a number of places – it’s my first application in Flex :-) – but it’s all available to view if you want to take a peek, and it’s obviously running on the live TheyWorkForYou site.

To put a video component in the player is no harder than including an <mx:VideoDisplay> element – set the source of that, and you have yourself a video player, no worrying about stream type, bandwidth detection, or anything else. :) You can then use a very useful feature called data binding to make lots of things trivial – for example, I simply set the value of a horizontal slider to be the current playing time of the video, and the slider is then automatically in the right place at all times. On the downside, VideoDisplay does appear to have a number of minor bugs (the most obvious one being where seeking can cause the video to become unresponsive and you have to refresh the page; it’s more than possible it’s a bug in my code, of course, but there are a couple of related bugs in Adobe’s bug tracker).

As well as the buttons, sliders and the video itself, the current MXML contains two fades (one to fade in the hover controls, one to fade them out), one time formatter (to format the display of the running time and duration), and three web services (to submit a timestamp result, delete a mistaken timestamp, and fetch an array of all existing timestamps for the current debate). These are all called from various places within the ActionScript when certain events happen (e.g. the Now button or the Oops button is clicked).

Compiling is a simple matter of running mxmlc on the mxml file, and out pops a SWF file. It’s all straightforward, although a bit awkward at first working again with a strongly-typed, compiled language after a long time with less strict ones :-) The documentation is good, but it can be hard to find – googling for [flex3 VideoDisplay] and the like has been quite common over the past few weeks.

Tomorrow I will talk about moving around within the videos and some bugs thrown up there, and then how the front end communicates with the video in order to highlight the currently playing speech – for example, have a look at last week’s Prime Minister’s Questions.

1. The Flash player
2. Seeking
3. Highlighting the current speech

Wow! The video timestamping site on TheyWorkForYou has been live for just under ten days, but you’ve already managed to timestamp almost 14,000 clips – that’s almost 40% of our entire video archive!

Thank you for all the good work – and especially to our top timestampers. David Jones, Alex Hazell and Lee Maguire are currently the top three in the overall rankings, but there are five more people who have timestamped more than 500 clips, another seventeen people who have done 100 clips or more, and more than 100 people who’ve done anything from 1 to 100 clips. And of course, there’s also a fair few anonymous people who haven’t yet registered, so their individual contributions to the “anonymous” total of 3349 clips are not recorded on the league tables. Remember, we’ll be handing out prizes to the top timestampers, so get registered before you timestamp your next video!

We’re starting to collect a list of notable clips that we can use to compile a “best of parliament” video gallery – if you would like to nominate a particular speech, please leave a comment below or send an email to team@theyworkforyou.com – just tell us the name of the MP speaking, and the URL of the page where this speech appears on theyworkforyou.com. We’ll put the best of them together and publish a list later this summer.

We’re very excited to announce that our Parliamentary website TheyWorkForYou.com now includes video of debates in the House of Commons – but we need your help to match up each speech with the video footage.

It’s really easy to help out. We’ve built a really simple, rather addictive system that lets anyone with a few spare minutes match up a randomly-selected speech from Hansard against the correct snippet of video. You just listen out for a certain speech, and when you hear it you hit the big red ‘now’ button. Your clip will then immediately go live on TheyWorkForYou next to the relevent speech, improving the site for everyone. Yay!

You can start matching up speeches with video snippets right away, but if you take 30 seconds to register a username then we’ll log every speech that you match up and recognise your contribution on our “top timestampers” league table. We’ll send out mySociety hoodies to the top timestampers – they’re reserved exclusively for our volunteers as a badge of honour.

We think that this really easy approach to crowd-sourcing data about online video could come in useful in many different situations – not just for politics – and we hope that it gets used all over the place. It might even be a world first, we’re not sure. If you’d like us to create something similar for your local legislature, sports team, Am Dram group or anything else that can be audio or video recorded then please get in touch. We’d also really appreciate your feedback on the current beta system – please send your email to hello@mysociety.org.

Note to MPs, researchers, office staff, campaigners and bloggers – we know that you want to concentrate on matching up the speeches of a particular MP, or of a particular debate. If this sounds like you, please send an email to hello@mysociety.org with what you want, and we’ll help you do it.

Background

This project was initially commissioned and funded by the BBC, who asked mySociety to create a searchable, online video archive of debates based on footage from BBC Parliament. We were thrilled to help out, because we think that it will enhance the public understanding of – and respect for – the work of Parliament. The initial goal of this project was to use the BBC’s captions to help chop up the video into different speeches. Tom Loosemore arranged for access to the BBC’s internal captions data, Etienne Pollard was commissioned to build an open source recording/transcoding/web-serving system (and then donated some of his wages back to pay for enough hard drive space for the video!), Stef Magdalinski donated a network storage array to hold the disks. However, after lots of hard work trying to get our computers to automatically slice up the video into chunks according to the BBC’s captions we concluded that this on its own wasn’t sufficiently accurate to reliably match up every speech in Hansard with the appropriate snippet in our video footage.

Adversity, however, is a great source of innovation. Matthew Somerville, working on a spec first sketched out by Tom Steinberg customised the flash interface substantially so that users could watch video and help add correct timestamps. Now that’s built, what remains is for you to do your part! What’s more, once we get a significant number of speeches timestamped we can start providing web feeds and APIs for MPs to embed video footage directly on their own websites, and video of your MP’s most recent speeches on their MP page on TheyWorkForYou.

There are some conflicting views about whether this all online video of Parliament is a good idea – for instance, this video snippet (created using the new system) shows that the Deputy Leader isn’t so keen on the idea of Parliamentary footage appearing on sites like YouTube. Or perhaps she’s just been misunderstood – now you can judge for yourself what she was saying, based on her appearance and intonation. On the other hand, the BBC seem to understand the benefit of putting video content online (and they’re a fully paid up member of ParBol, the Parliamentary Broadcasting group), and Parliament themselves have an alternative set of online video streams. Unfortunately the official Parliamentary video service can’t be integrated with Hansard, is only available in Windows Media format, only has enough storage to keep the most recent 28 days of footage in archive, and doesn’t even attempt to break up the video into individual speeches apparently you can search for speeches after all, although this capability isn’t actively advertised. It perhaps goes without saying that mySociety considers it an important public service for citizens to be able to find footage of their MPs doing their work, and we will resist attempts to deny this service to citizens.

One final thing – we’re currently trying to persuade the clerks in Parliament to tweak their internal processes a bit, and make it easier for people to see how laws are made. It’s called the Free Our Bills campaign, and we need as many people as possible to join the campaign, so that we can bring law-making into the 21st century. Please sign up now!

Update 1.40PM
There are already over 1000 timestamps, and we’ve not even gone for any media coverage yet. Well done all!

Update 11.00AM on Thursday 5 June 2008
6769 speeches have now been timestamped, which is exactly 20% of the current total of 33838 speeches. Thanks for all your efforts, and keep up the good work!

We’re busy as bees, lots of things happening, increasingly many of which are commercial, and we can’t talk about until they’re released.

Commercial? But you’re a charity! Yes – but just as Oxfam have a trading subsidiary company which runs the second hand clothes shops, we have a trading subsidiary company that sells services relating to the websites that we make (structural details here).

Everything from other small charities to large media companies are buying our services – which range from customised versions of FixMyStreet, through to strategic consulatancy. If you’ve got something that you think we might be able to help with, email Karl. He’s easier to talk to than us geeks.

Meanwhile we’re cracking on with our free services for the public, which are increasingly funded by this commercial work.

TheyWorkForYou recently launched a Scottish version, thanks to volunteer Mark Longair, and Matthew. More goodies in store as the Free Our Bills campaign unfolds. We’ve started a sprint to get a photo for every MP’s page. If you work for or are an MP or have copyright of a photo of one that we’re missing, then email it to us.

WhatDoTheyKnow is getting lots of polishing – the new site design that Tommy has been working on is nearly ready. Today I just turned on lots of new email alerts and RSS feeds, so you can get emailed, for example, when a new request is filed to a particular public body, or when a request is successful.

Our super ace volunteers have been busy adding public authorties to the site, and we now have 1153 in total. We’re getting a steady trickle of good requests (pretty graph) coming in. Blogs such as Blind man’s buff and confirm or deny are sorting the wheat from the chaff. Do blog about and link to any interesting requests that you see!

Other things in the works are a much needed revamp of www.mysociety.org, some interesting things on GroupsNearYou, and no doubt squillions of other things. I’ll let Matthew post up anything I’ve missed :)

Last week at the SustainIT eWell-Being Awards, we picked up an award for FixMyStreet. The judges said it was “[a]n excellent example of an independent website which empowers the general public in their dealings with their local council. It is a relatively simple application, yet highly effective and replicable.” One example the accompanying Independent supplement mentioned was “a community in Great Yarmouth which joined forces through FixMyStreet to clear their local unused railway track. The site made possible a dialogue between community members and the council’s community development worker, who organised a “clear up” day where locals could get involved with rectifying the situation, with tools, insurance and even a barbeque provided.” It’s great to see that sort of thing happening on the site, and also great to be recognised in this way.

In a spirit of celebration (though more to celebrate the endorsements the campaign has received), TheyWorkForYou now covers the Scottish Parliament – see the TheyWorkForYou news for more information.

New statistics, made by Francis, for your interest and elucidation. They’ll make their way onto TheyWorkForYou shortly.

mySociety has never run a campaign before today. And we’re not sure anyone’s ever run a campaign featuring a charismatic duck-billed platypus escaping from under the closing jaws of a Parliamentary portcullis.

Update 15.34 25/03/2008
Conservative Party leader David Cameron has just endorsed the campaign in this video.

Update 17.14 25/03/2008
Now kind words from techy Lib Dem MP Lynne Featherstone.

Update 11.38 1/04/2008
We’ve just recieved this fantastic endorsement from Nick Clegg, leader of the Liberal Democrats:

“Parliament belongs to the people. It’s time to open it up so people can find out what’s going on. mySociety has done a brilliant job in recent years in doing that – and it’s time to take this project to the next level and get information about the laws Parliament passes into the public domain.

“It takes a new MP months to figure out how the tortuous bills procedures work – so how we expect the voters to know what’s going on, I have no idea. The changes MySociety are calling for are vital so that every MP is fully accountable for the decisions they take on behalf of their constituents.

“I fully support the Free our Bills campaign, and will do all I can in Parliament to win this battle.”

Thanks Nick!

Matthew and I have been sitting next to each other today looking at the outputs of his lovely new custom built conversion tracking system, designed to ensure that the optimal number of users who just come to one of our services as a one off get signed up to something else longer lasting.

I’ve been banging on for ages about how government should seize on cross selling people who’ve just finished using one online service into using another of a more democratic nature, so it seems worth spelling out some of the lessons.

First, there’s some interesting data from the last few weeks, since our newest conversion tracking infrastructure has been running in its nice new format.

One of the adverts randomly served to users of WriteToThem (after they’ve finished sending their letter) encourages them to sign up to TheyWorkForYou email alerts – the service people use to get emailed whenever their MP speaks in Parliament. The advert features a slogan of encouragement, and a pre-populated email form containing the user’s email, and a ‘Subscribe me’ button. This advert was shown to 2328 users last month, of whom 676 became TheyWorkForYou email subscribers, which is a pretty cool 29.04% conversion rate. However, we also showed another advert for the same service, to the same WriteToThem users, which also had the same button and text, but which hid the form (and their address). That was shown to 2216 users of whom 390 signed up, a more modest 17.6%. So the impact of simply showing an email box with the users email address in it, versus hiding it, was worth 10% more users. Why? Go figure!

So now we’ve canned the advert that hides the address form, and instead we’re comparing two different adverts both of which feature the pre-populated signup form, but which use different words. It’s probably too early to judge, but the new ad appears to have a very similar conversion rate suggesting it might be hard to squeeze many more subscribers out of this page. We’ll keep trying though!

Another thing we learned of interest was that monthly subscribers to email alerts on TheyWorkForYou were down year on year in the month before we added this new advertising & conversion tracking system, even though the total number of visitors were clearly up on the same month last year. This appears to suggest that two things are happening. First RSS is catching on, so some users who would previously have got email alerts are subscribing to RSS feeds instead. Second, it suggests that the TheyWorkForYou user audience might have been getting more saturated with regulars – proportionally fewer new users coming (although more visitors in absolute terms) so fewer people signing up to get alerts. The cross marketing and conversion tracking seems to have reversed that trend, which is awesome.

We also advertise several different services to people who just finish signing up to get email alerts on TheyWorkForYou itself. We’ve just noticed that a full 25% of people shown the advert to sign up for HearFromYourMP proceed to sign up. We’ve therefore just decided to dump other adverts shown on TheyWorkForYou (such as advertisements for other sorts of TheyWorkFor you email alert) and concentrate on just cross selling HearFromYourMP. A back of the envelope calculation suggests that by just advertising this one site from the completion page we should get an extra 10,000 subscribers to HearFromYourMP this year on top of the organic growth. Not bad for a few minutes analysis, and a number likely to make a fair few more MPs post messages to their patiently waiting constituents.

One last interesting thing (at least to me) is how some more demanding services are a much harder sell than others to users. So asking people to make new groups on GroupsNearYou.com or report a problem in a street on FixMyStreet tend to result in more traditional online marketing scale conversion rates of 0.1% to 2%. Still worth doing, and so we compare different versions of those ads too, to try and eke up those rates for these sites that arguably have more tangible, direct impacts on people and communities.

It will be a challenge for mySociety’s future to work out how to trade off impact against scale of service use – are 10 HearFromYourMP subscribers worth one pothole that doesn’t get fixed? Answers on a postcard…

Some of the work we do at mySociety these days is policy related, and happens behind the scenes. I’m conscious that we haven’t been blogging here like we did in the early days, and that is partly because advice and consultancy often have to be confidential.

Two speeches, both of which mention TheyWorkForYou, were recently given by senior members of the UK’s two main opposing parties. They’re both worth reading, and will set you thinking about how much further mySociety’s work can be taken.

First a recent speech by Tom Watson MP, a Cabinet Office Minister on “Transformational Government”. He talks about the massive change we are living through, in terms of how IT can and will improve Government.

Less than a decade ago, people were just recipients of information, they got what they were given when they were given it. Today, the most successful websites are those that bring together content created by the people who use them (Tom Watson)

Second a speech by David Cameron, Leader of the Opposition, which talks a lot about open knowledge. Can local government be transformed by better information? TheyWorkForYou for local councils?

We will require local authorities to publish this information – about the services they provide, council meetings and how councillors vote – online and in a standardised format. (David Cameron)

Google have launched a new UK politics site at google.co.uk/politics. mySociety were delighted to be asked to build a TheyWorkForYou widget for this site. There’s no doubt that this sort of modular re-purposing of our information is going to happen a lot more in the future, and it’s great to start out with the best of possible partners.

Some lovely new volunteers have been working their socks off to add the Scottish Parliament to TheyWorkForYou. Yay!

Unfortunately, the server that TheyWorkForYou sits on is almost full, so we can’t launch their hard work. Boo!

TheyWorkForYou isn’t an externally funded project, and we need funding from other sources to keep it growing and improving. So if the season has filled you with generosity of spirit, why not drop us a few pennies to pay for some upgrades? Any extra beyond what we need will go into the general pot to keep mySociety running and the developers from starving.