Well, it certainly all happened over the weekend: the resignation of one Secretary of State on Friday and the quick appointment of another by Saturday.
It all left a lot of people wondering just who this Stephen Crabb fellow was, and what he stood for.
Fortunately, there’s a very handy website where you can look up the details, debates and voting records of every MP — we refer, of course, to our very own TheyWorkForYou. Over the weekend, we saw the link to Crabb’s voting record shared across social media (and even good old traditional media; we were also mentioned on Radio 4’s Any Answers). Naturally, most interest was around Crabb’s voting habits when it comes to welfare and benefits.
The upshot of this was that TheyWorkForYou saw almost three times our normal traffic for a Saturday. Over the weekend, 30% of all page views were for Crabb’s profile or voting records. In contrast, just 1.83% thought to check out his predecessor’s record: yesterday’s news already, it seems.
So Stephen Crabb’s the new guy, and you may want to keep up to date with his contributions to Parliament. Sign up here and we’ll send you an email every time he speaks.
We recently added an Environment section to voting pages on TheyWorkForYou, so now you can see exactly how your MP voted on issues like fracking, measures to prevent climate change, and green energy, all in one place, like this:
Votes on environmental issues are clearly a priority for our users. They’ve been one of the most-requested additions in the TheyWorkForYou postbag over the last couple of years, and we’re glad to have fulfilled those requests, even if it took a while.
At the same time, we’ve also made several other additions to existing sections on voting pages, so now you can check how your MP has voted in these areas:
- Assisted dying
- Trade union regulation
- Taxation of banks
- Enforcement of immigration rules
- MPs’ veto over laws only affecting their part of the UK (AKA English votes for English laws)
To check your own MP’s voting record, head over to TheyWorkForYou.com, and input your postcode on the homepage. Then click ‘voting record’ at the top of your MP’s page.
If you have strong opinions about how your MP voted on any issue, don’t forget, you can let them know by clicking on ‘Send a Message’, which will take you over to WriteToThem.com.
Back in November 2013, we asked you what improvements you’d like to see on TheyWorkForYou.
One answer dominated: you wanted more information about how MPs vote.
Adding information on voting has been the single biggest project on the site since its launch, and has required several different phases of development. We announced each of these as it happened, but now that we’re at the end of this large piece of work, it seems like a good time for a complete overview.
So let’s take a look at exactly what it has involved—and, more importantly, what it means for you.
We’ll start with a rundown of features, then go into more detail about how they are created at the end of the post, for those who are interested.
What vote information means for you
1. You can easily see how your MP voted
Just how much do you know about how your MP voted on the stuff that matters? Most of us would have a hard time keeping up with every vote, simply because it isn’t information that’s widely publicised.
On TheyWorkForYou, you can see a run-down of how any MP has voted on key policies, by visiting their page on the site and clicking the ‘voting record’ tab (see image, above). We’ve created summaries of their stance on all kinds of matters, including the EU, same-sex marriage, NHS reform and a lot more.
Each of these summaries is compiled from every vote the MP has made on a motion that impacts on that policy.
You can click ‘show votes’ (see image above) to see the specific votes that go to make up any particular stance, and we’ve laid them all out in plain English so that it’s easy to grasp exactly what the issue is.
And from there you can click through to the website Public Whip, where you can explore votes in more detail, including lists of who voted for or against any given motion.
2. You can find out how strongly your MP feels
When we first presented voting information, we said that an MP had voted ‘strongly for’ or ‘moderately against’ certain policies, which led to quite a large postbag from people asking, “How can you vote strongly, surely you either vote for or against?”.
We wrote in the second half of this blog post about the wording changes we made to clarify the fact that these stances are calculated from a number of votes.
3. You can assess if your MP is a sheep or a lone wolf
We’ve pulled out all the votes which differ substantially from the way that the majority of each MP’s party voted. If your MP has voted against the flow, you’ll see something like this on their page:
Why do we highlight this type of vote? Because we think they’re a really good indication of where an MP feels strongly enough about something to risk sticking their neck out. It’s also a great way to check the truth when people say, “MPs? They’re all the same”.
4. You can understand the background to the votes
Generally speaking, there’s a debate before any vote takes place in Parliament, covering all the matters which may be topmost in MPs’ minds before they cast their lot.
Clicking on the ‘show full debate’ link from the topic pages (see image above) will give you the full context.
How we compile vote information
If that all seems nice and simple, well, great! That was our aim.
Putting it all together definitely wasn’t so simple, though. Voting information has never been previously presented all in one place in quite this way before—on TheyWorkForYou or anywhere else, to the best of our knowledge—so we had to figure out how to import the data and how best to display it.
As with much of our work, it’s a mixture of manual graft and automating whatever we can. Some things, like rewriting votes so that everyone can understand them, can’t be done by a computer. But many of our users are surprised to learn just how much of what we publish out is untouched by human hand.
Our Developer Struan, who did the most recent round of work on the voting records, said:
We get all our voting data from PublicWhip, a site set up by Francis Irving (once of mySociety) and Julian Todd. Public Whip takes the data we [TheyWorkForYou] produce from Hansard and extracts only the information on votes (or divisions in Parliamentary jargon) that take place in Parliament. It then allows you to look up how an MP or a Lord voted.
Let’s just think about that for a moment. We’re looking at a process where Parliament publishes Hansard, TheyWorkForYou scrapes the data and re-presents it, Public Whip extracts the voting information and presents that, and TheyWorkForYou takes that voting information back for its own voting pages. Simple…
One of the first things we did was to ‘translate’ the votes into plain English, so that it was very clear what was being voted for or against— and if you want to read more about that process, we talked about it in a blog post back in July 2014.
That allowed us to move to the next phase, as Struan explains:
Public Whip groups related votes together into policies, e.g renewing Trident, so you can see how an MP voted on the policy as a whole.
It does this by saying which way an MP would have to vote each of the divisions in the policy if they agreed with the policy. It then takes the MP’s votes on each division in the policy and assigns a score to it based on how they voted. These scores are then added up and compared to the score they would get if they always voted in agreement with the policy. The closer the MP’s score is to the score of an MP who always voted in agreement with the policy, the more they agree with the policy.
Thanks to Public Whip’s grouping, we were able to start compiling our MPs’ voting records along those same policy lines.
One of the most fiddly parts of the process was figuring out how to ensure that the information we present is a true, non-biased representation of the MP’s intentions. You might think that a vote is quite a simple matter – it’s either a yes or a no for a particular motion. But as soon as we started displaying votes within a policy, things got a bit trickier.
Some divisions in a policy can be marked as important and voting with the policy in those divisions is worth more points. This is to prevent voting in agreement on a set of minor votes, e.g “Parliament will commission a report on the future of Trident”, outweighing voting against something important, e.g. “Renew Trident”. It also reflects the way Parliament works, often with several smaller votes on parts of a bill and then a vote on the bill as a whole.
For clarity I should point out here that sometimes voting no in a division is a vote for the policy, e.g voting no in a “This house believes Trident should not be renewed” division would clearly be a vote for our example “Renew Trident” policy.
This approach also helps where one vote straddles several topics: for example, consider a vote against the Budget when the Budget contains many proposals including, say, the capping of VAT. It’s quite possible that an MP may be for the capping of VAT but broadly against several other motions covered by the Budget, and so decides to vote against it on balance. So long as we mark the Budget vote as a weak vote for the capping of VAT, its significance should be properly accounted for.
Where we don’t have enough information to show a stance, for example where an MP never voted on the topic, is too new to have had a chance to vote on the topic, or all their votes on the topic have been labelled as ‘weak’, we say so:
A final little subtlety is the difference between “Never voted” on a policy and votes where the MP was absent. If it says an MP has never voted on a policy that means they were elected after all the divisions in the policy took place so did not have a chance to vote on them. Absent means they could have voted in the divisions but did not.
Absent votes count towards your score but at half the rate of voting in agreement with the policy. This is so that an MP who votes in agreement with the policy in one division and then misses all the other divisions shows as agreeing with the policy rather than against as it would if no score was assigned to absent votes. That does currently mean that if they were always absent it shows, slightly unhelpfully, as “a mixture of for and against”.
It’s not an ideal system as it does produce some odd results occasionally but it mostly works.
To show where an MP has voted against the majority of their party, we have to figure out a similar score across the party as a whole.
This is exactly the same process, only we add up all the votes by all the MPs but the maths is pretty much the same.
All in a day’s work
As mentioned at the top of this post, vote information was our most-requested addition. And rightly so! Our MPs represent us, so naturally we want to see their track records, quickly and easily.
If you’re not an expert, you might not have known how to find this information before. And that’s essentially what TheyWorkForYou aims to do: make the workings of Parliament more accessible for everyone.
Parliamentary copyright images are reproduced with the permission of Parliament.
For a while now, TheyWorkForYou has shown how your MP voted on key topics.
What it hasn’t done, until this week, is give a crucial piece of context. That is, how do your MP’s votes differ from those of their colleagues in the same party?
We all know that, on many issues, the whip ensures that MPs vote according to the party line rather than their own convictions. So in theory, by examining the votes which diverge from the majority party vote, we might get the clearest picture of what an MP truly cares about.
And now, we’ve added a small piece of code to the site, which allows us to do just that. At the top of your MP’s page, you’ll now see text along these lines:
If your MP never disagrees with their party, you’ll just see the top line followed by a random selection of votes.
The importance of wording
The screenshot above shows another small change we’ve made to TheyWorkForYou: just a matter of wording, this time.
When we first started displaying how MPs had voted, we used terms such as “voted strongly for”, “voted moderately against”, etc. This was to allow us to represent a range of positions along a spectrum for each topic.
For every topic, such as EU Integration, or smoking bans, several different votes are analysed. The ‘show votes’ button, as seen above, takes you to a page where these are listed.
However, we received a steady stream of emails, tweets and Facebook messages asking how an MP can vote ‘strongly’ or ‘moderately’ for something. To a fly-by reader, it seemed nonsensical, because of course they were thinking of that fact that MPs vote for or against a single motion.
To counteract this, we’ve used words which we hope encapsulate the concept of a series of votes over time – words like ‘consistently’, ‘occasionally’ and ‘never’.
Choosing these words proved to be harder than we’d anticipated, and, after a long heated discussion between colleagues, resulted in a straw poll asking anyone we could find to arrange pieces of paper in a line to indicate how they perceived their strength.
We finally came up with an answer that the majority agreed on—and we haven’t had any mail on the subject since then. Let’s cautiously call that a win for careful wording.
Has he or she reflected your interests? One key way of checking that is to look at their voting record.
We’d like everyone to know exactly how their MP voted over the last parliament, so we’ve made some changes to TheyWorkForYou that make votes easier to understand.
See an example here, or read on to find out how to check your own MP’s voting record.
A complex matter
TheyWorkForYou publishes activity from Parliament each day.
This content includes parliamentary votes, along with the debates that they are part of. But it’s not always obvious to the lay reader exactly what’s being voted on.
Take a look at this debate, for example, on exemptions for smoke-free premises. By the time you’ve waded through the first clause,
“The appropriate national authority may make regulations providing for specified descriptions of premises, or specified areas within specified descriptions of premises, not to be smoke-free despite section 2”
– you may well be lost. And who would blame you?
Making it nice and simple
We don’t think you should have to be an expert to check your own MP’s voting record, and our new pages for each voting stance are here to help.
For some time now we’ve given you summaries of how your MP voted on certain topics, with a link to the votes that helped us understand each MP’s position on that stance.
Now we’ve created a page for each stance, and worded it in plain English so that anyone can understand exactly what it means.
See for yourself
Here’s how to see how your own MP voted (or we should say ‘previous MP’, since until the General Election, no MPs are now in office):
Go to TheyWorkForYou.com and input your postcode on the homepage.
You’ll be taken to the page of your (former) MP. Click on the ‘voting record’ tab.
Choose a topic you’re interested in, and click the ‘Details’ link on the far right.
You’ll see a plain English description of the stance, followed by descriptions of all the votes that were considered to contribute to it.
Want to see the context? Click on ‘show full debate’ and you’ll be taken to the full record of that vote.
Let us know what you think
These pages are still a work in progress, so we’ve included a feedback box at the top of each voting stance page. Do be sure to let us know if there’s anything else you’d like to see on them.
If you have feedback about how your MP has voted, mind you, that’s another matter… one you might want to reflect at the ballot box.
An analysis, with code and data, of which Commons votes would have had different results, if Scottish MPs’ votes hadn’t been counted since 1997.
By Richard Taylor and Anna Powell-Smith.
PublicWhip is a wonderful thing. Founded and still run by independent volunteers, it contains the results of every House of Commons vote since 1997, scraped from the official web pages and presented as simple structured data. Here at mySociety, we’ve used it to power TheyWorkForYou for many years.
Most recently, it helped our staffer Richard create the new voting analyses on TheyWorkForYou’s MP pages. Want a quick, simple summary of your MP’s voting history on same-sex marriage or climate change, or on any of 62 other major issues? You’ll now find the answer on your MP’s TheyWorkForYou page, all based on PublicWhip data.
But here’s the most exciting thing about PublicWhip. If you know how to get around its slightly forbidding exterior, it contains a treasure-trove of data on MPs’ voting patterns, all structured, openly-licensed and ready for anyone to analyse.
A data challenge
Recently, while discussing the upcoming Scottish referendum, Richard posed a question to Anna: could PublicWhip data tell us which House of Commons votes would have had different results, if Scottish MPs’ votes hadn’t been counted?
This is interesting because if the Scottish people vote “yes” to independence on September 18th, we may see (probably not as soon as 2015, but perhaps soon thereafter) a House of Commons without Scottish MPs. No-one really knows how such a Parliament would be different.
While it was widely reported that that Scottish MPs’ votes carried the decision to introduce student tuition fees and foundation hospitals in England, those were just two high-profile votes. To our knowledge, no-one has published a comprehensive analysis of all votes that were carried by the Scottish MPs.
Anna chose to accept Richard’s challenge, and to use PublicWhip data to carry out this analysis. You can see all their code, and the data they produced, on GitHub.
The headline finding is that only 21 votes (out of nearly 5000 since 1997) would have gone differently if Scottish MP’s votes hadn’t been counted. This surprised Anna, who expected more.
Secondly, if there’s any visible pattern, it’s that English MPs seem to have a stronger civil-libertarian bent than their Scottish counterparts. High-profile votes on 42-day detention, “glorifying terrorism”, allowing the Lord Chancellor to suspend inquests, and on control orders: according to Anna’s analysis, all would have gone differently if Scottish MPs had not been in the chamber.
Other than that – Anna comments – the key finding is perhaps the absence of any other strong trend.
Here is the full list of votes that would have gone differently – click on the date to see the full vote details on PublicWhip. If Scottish MPs hadn’t been in the chamber:
- 5 Sep 2014 The majority of MPs would have voted to send the Affordable Homes Bill to a Select Committee rather than a Public Bill Committee.
- 29 August 2013 The majority of MPs would have voted to agree that a strong humanitarian response to the use of chemical weapons in Syria was required from the international community, and that it may, if necessary, require military action. (You may remember that David Cameron called MPs back from their summer break to vote on this, and MPs rejected the motion.)
- 29 Jan 2013 The majority of MPs would have voted against postponing a review of the boundaries of parliamentary constituencies until 2018 and against delaying a review of the effect of reducing the number of MPs.
- 31 Oct 2012 The majority of MPs would have voted against calling on the UK Government to seek a real-terms cut in the European Union budget.
- 24 Apr 2012 The majority of MPs would have voted to require products containing halal and kosher meat to be labelled as such.
- 24 Feb 2010 The majority of MPs would have voted for restrictions on the amount of carbon dioxide electricity generation plants are permitted to emit.
- 9 Nov 2009 The majority of MPs would have voted against allowing the Lord Chancellor (a minister) to suspend an inquest and replace it with an inquiry and against allowing the use of intercepted communications evidence in inquests.
- 8 Dec 2008 The majority of MPs would have voted to immediately starting the proceedings of a committee of MPs to investigate the House of Commons procedures in light of the seizure by the police of material belonging to Damian Green MP.
- 12 Nov 2008 The majority of MPs would have voted to require membership of new regional select committees to be determined taking account of the proportion of members of each party representing constituencies in the relevant region and for at least one member from each of the three largest parties to be on each committee.
- 11 Jun 2008 The majority of MPs would have voted against extending the period of police detention without making any criminal charges of terrorist suspects from 28 days to 42 days.
- 2 Jun 2008 The majority of MPs would have voted to require the National Policy Statement to contain policies which contribute to the mitigation of, and adaptation to, climate change.
- 15 Mar 2006 The majority of MPs would have voted against a proposed timetable for the Parliamentary consideration of the Education and Inspections Bill.
- 2 Nov 2005 The majority of MPs would have voted against making glorifying the commission or preparation of acts of terrorism an offence.
- 2 Nov 2005 The majority of MPs would have voted to make the offence of Encouragement of Terrorism only apply to cases where an individual intended their actions to encourage terrorism.
- 28 Feb 2005 The majority of MPs would have voted to give a greater role to the courts in relation to the imposition of control orders.
- 22 Apr 2004 The majority of MPs would have voted against installing a security screen separating the public gallery from the House of Commons Chamber.
- 31 Mar 2004 The majority of MPs would have voted against the introduction of variable university tuition fees (top-up fees) of up to £3,000 per year in place of the previous fixed fee of £1,250 per year.
- 27 Jan 2004 The majority of MPs would have voted against allowing university tuition fees to increase from £1,125 per year to up to £3,000 per year, and against making other changes to higher education funding and regulation arrangements.
- 19 Nov 2003 The majority of MPs would have voted against introducing NHS foundation trusts, bodies with a degree of financial and managerial independence from the Department of Health.
- 4 Feb 2003 The majority of MPs would have voted for an 80% elected House of Lords.
- 29 Oct 2002 The majority of MPs would have voted against starting sittings of the House of Commons on Tuesdays at 11.30am rather than 2.30pm.
In the 1997-2001 Parliament, Anna’s code found no votes that would have had different results.
IMPORTANT DISCLAIMER! We can’t conclude that all of the above would necessarily have become law if Scottish MPs had not been in the chamber. Bills don’t become law until they have passed through the House of Lords – not to mention the many other forces of history that would have acted differently.
Get the code and the data
You can see the code used for this analysis, and the full datasets, on GitHub. You can adapt it yourself if you want to do your own analyses.
This analysis is the work of one volunteer: we welcome any corrections. Like PublicWhip itself, the whole point is that it is out in open for anyone to analyse and improve.
Image by Catherine Bebbington. Parliamentary copyright image reproduced with the permission of Parliament.
Our team member Richard has now analysed every single one of those votes, and his findings have been added to each MP’s information on TheyWorkForYou.
We hope that’s great news for users: it means that we can now present a really full picture of how your MP voted on key topics.
It’s also potentially useful for developers, eDemocracy hackers and campaign groups, who can pick up our data and use it as they please.
So what exactly is the data?
Often MPs vote on motions which are, at first glance, rather incomprehensible and cryptic. They might vote for example on a motion to accept:
Amendments (a) to (d) proposed in lieu of Lords amendments 1 to 4 and 6.
We’ve done the research to determine what MPs were actually voting on in each case, and turned their archaic language into plain English.
For every vote we’ve written a sentence to describe the effect of voting either “aye” or “no”. In relation to one MP’s vote on the evening of the 9th of July 2014 we write:
Mark Pawsey MP, Rugby voted for a residence test as an eligibility criteria for civil legal aid; subject to exceptions for refugees and those who have sought asylum.
In addition to describing every vote, we have decided whether it should be considered relevant to the topics we list on each MP’s page (see an example MP here, or check your own MP by inputting your postcode on the homepage, then clicking ‘voting record’ on your MP’s page).
If a vote was relevant to one of the statements we show on TheyWorkForYou, we then determined whether voting ‘aye’ or ‘no’ was a vote for or against the statement and if the vote was very important, or less important. By clicking on the green ‘details’ button beside each statement on an MP’s voting record you can see exactly which individual votes contributed to it as well as how we calculated which wording such as “moderately for” or “strongly against” to apply in each case.
Matters MPs have voted on since the 2010 general election have ranged from bankers’ bonuses to same sex marriage; from food banks to the “bedroom tax” (all of which have contributed to statements we show on TheyWorkForYou); from daylight saving to the regulation of hairdressers (neither included) – and plenty more. (We’ve written previously about how we select which topics to show on TheyWorkForYou.)
Of course, Parliament continues to hold votes, and we’ll be continuing to analyse the results as they come in – but it is good to know that we are bang up to date.
How can this data be used?
We have plenty of ideas ourselves, and we want to hear yours, too. With the forthcoming general election, one obvious use is for ‘who should I vote for?’ tools, which match users’ opinions with those of each party.
There’s also potential for comparisons between what constituents believe and what their elected representative has voted for.
No doubt there are many other ideas that haven’t even occurred to us yet – please do get in touch if you have ideas and you’d like to use this data.
You may remember that earlier this year we added new pages to TheyWorkForYou, showing MPs’ voting records in detail.
We’ve continued work on assessing votes, and you can now check your MP’s stance on seven new issues:
In Constitutional Reform:
- Transferring more powers to the Welsh Assembly
- Transferring more powers to the Scottish Parliament
In Foreign Policy and Defence:
- Strengthening the Military Covenant
In Social Issues:
- Laws to promote equality and human rights
In Taxation and Employment:
- An annual tax on the value of expensive homes (popularly known as a mansion tax)
And in Miscellaneous:
- Culling badgers to tackle bovine tuberculosis
- Requiring pub companies to offer pub landlords rent-only leases
- Restricting the scope of legal aid
- Greater regulation of gambling
Check your own MP’s voting record here – just input your postcode on the homepage, then click on the ‘voting record’ tab on your MP’s page (or click ‘see full list’).
And don’t forget, if you want to discuss what you find with your MP you can use WriteToThem.com afterwards.
Do you know how your MP voted on the issues that matter to you?
If not, take a look at the new Voting Record section for your MP – accessed easily via TheyWorkForYou.com. Even if you don’t know who your MP is, we’ve made it easy to find their voting activities, and to easy understand their big decisions at a glance.
We’ve been working hard to increase the coverage of votes (we admit – they had got a bit out of date), as well as to make the experience of reading them much more pleasant. There are now so many bits of analysis we’ve actually split a separate voting page out for each MP, accessible from their main TheyWorkForYou page.
Now you can see how your MP voted on issues like these:
- Benefit levels – what goes up or down
- Foreign policy – including military decisions
- Social issues – eg gay marriage
- Constitutional issues – for example, how many MPs there are
Keeping things objective
TheyWorkForYou is a trusted, non-partisan service so we work hard to ensure that these voting lines are unbiased and neutrally worded.
We’re so keen to ensure that we don’t accidentally introduce unconscious biases, that we try to avoid entirely the business of picking which topics to analyse. Instead, we prioritise our analysis based on what gets voted on by lots of MPs (accounting for whole party abstentions), not what gets talked about in the news, or what we care about ourselves.
Wording is important
We have decided to prioritise clarity over expressing every detailed nuance of votes – this is an intentional choice, reflecting our priority of reaching citizens who have never paid attention to their MPs before. Consequently, vote summaries need to be concise and not use jargon.
For example, would we be wrong to use the common term ‘bedroom tax’? It’s a phrase that a lot of people would recognise from the press coverage, but the government’s preferred term is ‘removal of the spare room subsidy’.
In the end, we went with reducing housing benefit for social tenants deemed to have excess bedrooms (which Labour describe as the “bedroom tax”) – a balance between objectivity and clarity.
The bottom line
We’ve made lot of changes to the display for information on MPs recently. So if you have any feedback, good or bad, please us know what you think by leaving a comment below, or dropping us a line.
These issues have always been carefully chosen to give a simple but neutral top-line view of each MP’s voting activity. Judging by Twitter, they’re a fairly popular part of the site, too.
There’s way, way more tedious complexity behind producing these little summaries than you might think, and due to a lack of appropriately skilled people in our team over the last year we had let our vote analyses get a bit behind the times. If you’re really interested you can read about why authoring these things in such a scrupulously balanced way is so time consuming here.
We’re posting today to tell you that we have recruited a pair of excellent new part-time voting analysts, David and Ambreen, and they have recently produced the first of a new generation of voting summaries.
The first shows how each MP has voted on increasing the rate of VAT, and second on the recent changes to university tuition fees. We have also increased the number of votes which feed into the EU integration policy to bring it more up to date.
To see this new data, just pop along to TheyWorkForYou’s home page, stick in your postcode, and check out your own MPs’ page. Then, if you want to be made aware as soon as we’ve published the next analyses, please follow our new TheyWorkForYou Twitter account.
Lastly, I just want to say thank you to the vote analysts Ambreen and David, to senior developer Matthew and to uber-volunteer Richard Taylor for kicking this vital part of TheyWorkForYou back into top gear.
Image by European Parliament.