Just recently, we’ve noticed a couple of MPs dismissing TheyWorkForYou as ‘not an official source’, with one even claiming that it ‘distorts the truth’.
This pains us a little. Because, while it’s true that we’re not ‘official’ — we’re not run by Parliament — we think that these assertions are slightly misleading themselves.
So, here’s a handy rundown of our methods and provenance to clear a few points up. Feel free to share it next time you see someone questioning the authority of data shared from TheyWorkForYou.
1. We do not have a political agenda
We do not pursue a party political agenda, and in fact we go to great pains to ensure that TheyWorkForYou, as with all mySociety’s output, is entirely politically neutral.
We tread this line both because we believe it is the right thing to do, and because it’s a condition of our charitable status that we do not campaign on behalf of any political party.
That said, we do have one agenda: that of making the democratic process more accessible for everyone. Just like the name of the website says, MPs work on behalf of us. That being the case, shouldn’t everyone be able to understand exactly what it is that they do, and hold them accountable if they don’t live up to expectations?
We provide facts and tools that anyone can use to make up their own mind — not just political experts or those who already understand the jargon. That was the point behind the site when we launched back in 2004, and it remains the driving force behind TheyWorkForYou.
2. Our data is largely created by Parliament
We are not of Parliament, nor are we funded by it (we’re an independent charity). However, the vast majority of the content on TheyWorkForYou comes directly from official Parliamentary sources such as Hansard, the official record of each day’s debates.
Parliament, rather handily, provides the raw data to anyone who wants it, in the form of a ‘feed’ that can be used in websites, apps or other tools.
TheyWorkForYou takes this data and presents it in a way that’s easy to read, browse, search, etc. We add a few features, such as email alerts, and through the use of some light coding we create and present statistics like the number of times an MP has spoken, or whether they have rebelled against the way that the majority of their party voted.
In a nutshell: although we’re dealing with exactly the same data that Parliament outputs, we also provide a few services that Parliament doesn’t, or which it didn’t when we first launched TheyWorkForYou.
3. TheyWorkForYou is mostly updated by machines
Contrary to popular belief, TheyWorkForYou is not compiled by a roomful of elves with keyboards. Nor do humans do very much editing of the site on a day-to-day basis. Almost all the content is fetched from those parliamentary sources and then published out automatically, through the magic of code.
It’s also code that does automated calculations so that we can present statistics like the number of speeches made, or written questions submitted, by each MP.
4. But there are some things we have to do by hand
So in large part, TheyWorkForYou is a machine that we just keep ticking over smoothly.
However, there is one important function of the site which can’t be entirely compiled by code, and that’s the summaries of how MPs have voted.
TheyWorkForYou is the only place to present votes in the way that we do. On each MP’s page you can see a list of where they stand on key topics, and you can also dive in more deeply to understand the individual votes that went to make up that stance.
Why can’t a machine output information like this? Well, it can (and does) do the first part, which is to fetch every record of where an MP has participated in a vote. But what it can’t do is categorise the votes into topic areas, and tell us how much significance to attach to a vote within a wider topic.
For example: imagine a series of votes on an initiative to bring more women into the workplace. A key vote might push for legislation requiring all workplaces to work towards a 50/50 gender split.
But there might also be votes on issues such as workplaces being obliged to run annual audits, or to publish their gender-based employment statistics; or on whether the government should allocate a chunk of budget towards helping workplaces meet their targets in this area, or on which date the legislation should be implemented by.
While it’s clear that all of these votes are relevant to the topic, some of them can be seen to have more weight when we consider the question, ‘has this MP voted for or against (or a mixture of for and against) encouraging equality in the workplace?’.
That is the part where we employ a human being to assess each vote and decide how much importance it should be given. You can read more about this process in this blog post.
5. We are committed to transparency
Because of our drive for neutrality, we are super-scrupulous about ensuring that everything to do with the voting records we publish is as transparent and measured as possible.
We often debate the wording used to describe a vote (for clarity as well as to expunge any bias), and other nuances too, as they arise. We have these discussions in public, on TheyWorkForYou’s Github repository.
(Note: this exchange has been edited to exclude some information not relevant to the point it illustrates; the full text can be seen on Github).
Since introducing dedicated, easy-to-follow voting pages for each MP on the site back in 2015, we’ve gone on to make improvements where needed.
For example, we’ve added contextual data underneath each topic, because one thing that’s become clear is that even factual data can be misleading if you don’t present the whole picture:
More recently, our attention was drawn towards potential confusion around the fact that recently-elected MPs voting in 2016 on a newly-arisen point about an inquiry into the Iraq war were being compared to those MPs who participated in multiple votes back in 2002-2003.
This is the sort of nuanced issue that can be difficult to foresee when writing the code that runs the site: fortunately, TheyWorkForYou undergoes a continual process of refinement.
Which leads us to the next point:
6. We’re still working on it
Sometimes, putting an automated action in place can bring unforeseen results.
One example of this is the fact that if an MP has voted only once within the group of votes which go to make up a topic — let’s say, they’ve participated in a single vote on same-sex marriage, but perhaps all the other votes in that category predated their entry to the House — at the moment TheyWorkForYou marks them as voting ‘consistently’ for or against same-sex marriage. Which is accurate when looked at in one way, but at the same time, not.
When this sort of thing arises, we add it to our development list for discussion, and implement a fix as soon as we can fit it in to our other priorities. You can join in the debate, too. If you spot something that you think should be done differently, you can let us know.
7. Facts are facts
But back to the overall aim of presenting accurate, trustworthy facts. One thing that’s worth remembering is that when it comes to votes, we can only publish one thing: whether the MP voted for, or against, the motion.
We cannot speculate on whether an MP has voted one motion through against his or her conscience, because it has been bundled in with other matters which they considered a higher priority.
We can’t detect those occasions when an MP of one party has traded votes with an MP from the opposite party, so that neither of them need turn up, nor do we know if an MP is ill, having a baby, or tied up with important diplomatic duties abroad.
We do not attempt to include context such as ‘this MP spoke prior to the vote to give nuance to their decision’ — although you can, of course, find all debates on TheyWorkForYou and research the background for yourself. Perhaps the closest thing we have to this kind of context is that the site automatically detects when an MP has voted differently to the majority of his or her party colleagues, in which case we flag it up as a ‘rebellion’.
And — perhaps the one that MPs object to the most often — we cannot include details of whether they were whipped (ie, told how to vote by the party) because that is not officially recorded anywhere. If we could, we’d love to — but TheyWorkForYou, as per point 2, can only import data that exists.
Besides, some MPs will vote against the whip, if they feel strongly enough. As Peter Lilley noted in 2013, that has become more and more common. Why? He credits the internet, the ease with which constituents can contact their MPs to put forward their points of view and — oh, what’s this? — “websites such as theyworkforyou.com [that] make it easier than ever to see how an MP voted on gay marriage, war or Europe”.
As one of our team puts it, “Politicians should be held accountable for what they actually do, not what they claim they might have done under different circumstances”. A vote is a vote, and it is sometimes remarkable to us how many MPs object to seeing a factual list of how they have voted, in black and white.
8. We must be doing something right…
175,000 people use TheyWorkForYou every month; hundreds of thousands have signed up to receive email alerts when their chosen keyword is mentioned or their MP has spoken.
When there’s an election, some important political news, or someone new is appointed to a position in the Cabinet, we see a huge upturn in the number of times our content — and especially voting records — is shared on social media. There’s a real thirst for this information to be provided in a way that anyone can understand: how else can we make important decisions such as who to vote for?
It’s not just the electorate, though. Each month brings around 5,000 visits from within Parliament itself, which is a good measure that we’re providing, at least, some things which aren’t as accessible via the official channels.
9. We’re open to discussion
We are more than happy to hear from MPs who, having understood the points above, believe that their activity has been misrepresented.
As we say, there is always room for improvement as we try to keep the balance between making information as easy as possible for non-experts to follow, and ensuring that it’s non-biased and non-ambiguous as we do so.
But we hope this piece has shown the steps we are taking as we strive to do just that.
10. We are a charity, and we need new sources of funding
Historically, TheyWorkForYou, as with mySociety’s other projects, has been largely supported by grant funding: money that has come from foundations and philanthropic organisations who believe that there should be a service like TheyWorkForYou that makes the UK’s parliaments easier to understand for everyone.
Right now, though, there is no such income for our Democracy work. We are having to explore new models for its survival. Meanwhile if you’d like to help ensure that TheyWorkForYou can keep running, please make a donation.
This week, we heard from a user whose MP’s agent had threatened to take him to court if he shared an image, showing TheyWorkForYou data, on social media. Here’s what we think of that.
Available to all
Prior to an election, you’ll see all sorts of messaging trying to turn you towards, or against, specific candidates — some from political parties, some from independent campaigning groups, and some just from individuals who feel strongly.
At mySociety, we’re non-partisan: we strive for neutrality in our websites and services, and they are available to everyone, no matter which part of the political spectrum you are on. We won’t tell you how to vote; we will, however, present the facts and give you the tools that allow you to make up your own mind.
When we looked into the image our user had wanted to share, we found that there are many similar images, generated from a single source, using TheyWorkForYou voting data to highlight the voting records of Conservative MPs in marginal seats. Here’s what they look like:
And for political balance, here’s an image with a similar intent, highlighting a Labour MP’s voting record (but not from this election, sorry: we have been unable to find anything more up to date, but feel free to send us any you’ve seen and we’ll add them to this post):
We have no problem with our data being shared in this way, so long as the wording is unchanged, and the source is credited (as clearly it hasn’t been in our latter example). Adding the source benefits everyone, because while top-line statements like these are, of necessity, brief in a shareable image, they are backed up on TheyWorkForYou with links to the actual votes that substantiate them.
As we say, this data is available to anyone, and TheyWorkForYou covers every MP, so there’s no unfair political advantage being gained here. The votes are statements of fact; and indeed there may well be people looking at a list like that and finding that, actually, they quite agree with everything on the list, in which case the image would be having the opposite effect from that intended.
If you read our blog post from yesterday, you’ll know that we’ve recently introduced Facebook and Twitter share buttons to make it super-easy to share any MP’s votes. So, in short: share our stuff. That’s part of what it’s for.
And yet, the user we mentioned had been told by someone working on behalf of the MP’s campaign that he would be ‘taken to court’ if he shared such an image, as it was ‘based on unreliable data’.
All of our voting analyses are based on the official data put out by Parliament, and we do our utmost to ensure that they are fair: while much of TheyWorkForYou’s content is published out via automated processes, we recognise that voting data is too subtle and sensitive to manage in any way other than manually. That’s why all our voting information is painstakingly compiled by hand, in a process we’ve described previously in this post.
MPs do occasionally contact us to question the wording of certain voting topics, and we are always happy to explain how we arrived at them, and improve them if we agree that the votes have been misrepresented.
We would be quite happy to hear directly from the MP in question and to discuss any information which they perceive as inaccurate: we note that their voting page has been in place on TheyWorkForYou since August 2015 (it has been viewed by over 5,500 people, 67 of them from within the Houses of Parliament) and in that time we have not been contacted with any query.
TheyWorkForYou makes politics accessible for everyone. Your donations help us.Donate now
In order to make debates and votes a bit easier to find, understand and share, we’ve recently introduced some new features on TheyWorkForYou.
What am I looking for?
Our users frequently write to us to say that they can’t find a specific vote on TheyWorkForYou — and that’s often because descriptions of votes in the media, or in conversation, don’t reflect the way they are referred to in Parliament.
The official record, for example, will not bring you a vote titled ‘Snooper’s Charter’, ‘Bedroom Tax’ or ‘Brexit’: you’ll have to know enough to search for the ‘Investigatory Powers Bill’, ‘Social Tenants Deemed to Have Excess Bedrooms’, or ‘Exiting the European Union’.
So we’ve put in place a few different ways to find the content that matters to you.
99% of the time when people ask us where to find a particular vote, it’s something that happened in the last few days, or at most, weeks.
So now, you’ll see a new ‘Recent Votes‘ tab in the main TheyWorkForYou menu, which leads to a page listing the last 30 votes:
If you’ve entered your postcode on the homepage (or your browser cookies remember you from previous visits), you’ll also see your own MP’s stance under each vote, like this:
There’s one important point about this page: it only contains those votes for which we currently have policy lines — that is to say, the votes we include on MPs’ pages. That’s because they are the ones for which we already have a plain English description. Fortunately, these are almost always the ones that people are most interested in.
If you want to find a vote that isn’t on this page, you can always look on Public Whip, which is where the raw voting data that feeds TheyWorkForYou comes from.
If you click through from any of those listings, you’ll get a page dedicated to that particular vote.
Here you’ll see something that we know is important to many of our users, set out nice and clearly: the ‘division’, ie which MPs voted for and against, who was absent and who abstained.
Again, if you’ve entered your postcode on the site, you’ll also see how your own MP voted, in the top section of the page:
But even better, if what you’re most interested in is your own MP’s position in a specific vote, you’ll get this version of the page when you click through from their voting record — as clear as we can make it:
So that’s all fine and dandy for people who think in terms of MPs and votes. But for a long time, we’ve wanted to explore ways to make parliamentary content more welcoming for complete political newbies.
We’ve been meeting with groups of young people around the UK to find out more about how they access politics, and one finding is that they think in terms of issues. Politics comes through the lens of topics like ‘the NHS’, ‘the environment’ or ‘Brexit’.
For that reason, we’ve created topic pages like this one, which gather together a lot of relevant and immediate content, showing how your MP voted, how all relevant votes went, debates and a chance to sign up for email alerts:
We’ll be adding more of these as time goes on.
Easier to share
The final feature we’ve introduced was a direct result of observing the way that you, our users, share our content on Facebook and Twitter.
We started collecting examples of where people had made a screenshot of voter records in order to make a political point, and we soon saw that this was a very common thing to do, especially at key points like the current run-up to the General Election, or a party leadership campaign.
To save you the bother of making and saving a screenshot, we’ve now added these share buttons at the foot of each section of votes on MPs’ pages:
That’s it for now, but this is all part of a rolling program of improvements, so do feel free to feed back with any related features you’d like to see.
It’s official, there’s going to be a General Election in the UK on June 8th.
As you might suspect mySociety has lots of tools and services that you might find useful during the campaign whether you just want to find out the voting record of your current MP or if you’re planning on building a website or app to cover the campaign.
First things first: TheyWorkForYou.com already covers in lots of detail who your MPs are and how they voted. This should be your first port of call so that you can evaluate your incumbent MP, especially when you’re thinking about who to vote for next.
Over the next couple of weeks we are going to make some changes here and there to make relevant parts of the voting record more prominent, and more clearly explain how we calculate the voting records themselves.
If you’re planning on using the data we have in TheyWorkForYou you can access information on UK politicians, parliamentary debates, written answers, and written ministerial statement via our API at theyworkforyou.com/api
Tomorrow we’ll share a blog post explaining in a little more technical detail how to access the API and some advice on how to get the most out of the service.
Building a service or website that covers all or part of the country and want an easy way to let your users identify which constituency they are in? Then MapIt is your friend.
It already powers most of our own services and is widely used by the likes of Government Digital Services and our friends at Democracy Club.
You can sign up for for free at mapit.mysociety.org and if you need more calls it’s easy to upgrade to a monthly plan – you can get 10,000 calls a month for free if you are a charity or working on an open project – if you think you are going to be busier than that (a) congrats and (b) drop us an email at firstname.lastname@example.org
Helping Democracy Club
Speaking of Democracy Club we’re going to be wholeheartedly supporting their efforts to crowdsource a full set of candidate data in the run up to the election – they are gathering all of their ideas together in this Google Doc https://goo.gl/8WtZvc
We had planned to make some updates and amends to the YourNextRepresentative service that supports Democracy Club’s WhoCanIVotefor.co.uk site in the quiet period between major elections, ahem, but with the snap election called we’ll be doing what we can to make the site run faster and make whatever UI tweaks and fixes we can in the time available.
They will no doubt be looking for help in sourcing candidate data, so please do sign up to help and find out what you can do democracyclub.org.uk/blog/2017/04/18/its-ge2017
In summary and to make it easy you can find all of our relevant #GE2017 datasets and APIs here data.mysociety.org/datasets/?category=ge2017
It’s not too late to let your current MP know what you think on any subject of your choice via WriteToThem.com.
And finally, don’t forget to register to vote yourself at gov.uk/register-to-vote
If you’ve used a mySociety website and made a difference, large or small, we’d love to interview you.
A few weeks ago, we heard how Open Data Consultant Gavin Chait used WhatDoTheyKnow to help people setting up businesses .
But you don’t need to be a professional to have achieved something with our sites. We want to know what you’re doing with WhatDoTheyKnow, FixMyStreet, TheyWorkForYou, WriteToThem — or any of our other web tools.
Have you managed to solve a persistent problem in your community by reporting it via FixMyStreet? Used data from TheyWorkForYou to inform a campaign? Or maybe you’ve put WriteToThem on your website and rallied people to contact their MP about something important.
Whatever it is, big or small, we want to hear about it. Please do let us — and the world — know what you’ve achieved with mySociety’s sites.
Ready? Click here to send us a couple of sentences about what you’ve achieved, and if we think we can feature your story, we’ll follow up with an email interview.
Today we’ve added twelve new topics to the voting pages for every MP on TheyWorkForYou. Covering important areas such as membership of the EU, mass surveillance of data, and military action against Daesh/ISIL, these voting lines will help give an even better at-a-glance picture of what your MP stands for, and how that was reflected in Parliament.
Check your own MP’s votes on these topics by inputting your postcode on the TheyWorkForYou homepage:
and then clicking on the ‘voting record’ tab:
You’ll see all your MP’s voting lines laid out in several topic areas on a single page:
From there, it’s easier to explore further by clicking ‘show votes’, which will take you to a page listing every vote taken into consideration when calculating the MP’s stance.
For a full explanation on the methodology behind these pages — a combination of manual and automated inputs — see our previous blog post.
How do we choose which topics to include? It’s all driven by what MPs have voted on in Parliament, and consequently how much data there is to draw from in any specific subject area (there are also a few ‘topics in waiting’: areas we know we want to cover, but where there need to be some more votes before we have sufficient data to present meaningful stances).
New topics in full
The new voting lines we’ve added are:
- In Constitutional Reform
- Reducing the voting age
- In Home Affairs
- Mass surveillance of people’s communications and activities
- Merging police and fire services under Police and Crime Commissioners
- In Transport (a new topic area)
- High speed rail network
- Greater public control of bus services
- Publicly-owned railways
- In Foreign Policy & Defence
- UK membership of the EU
- The right to remain for EU nationals
- Military action against the group known as ISIS, ISIL or Daesh
- In Taxation & Employment
- The reduction of Capital Gains Tax
- In Housing (a new topic area)
- Secure tenancies for life
- Charging a market rent to high earners renting a council home
We hope this helps you see, even more clearly, the effect your MP has had on a broad range of national and international issues.
Don’t forget that we also offer the chance to discuss these votes (or any other issue) with your MP. Just click the ‘send a message’ button at the top of the page to go to WriteToThem.com, where you can compose a message to your representatives quickly and easily.
- In Constitutional Reform
— mysociety (@mysociety) June 27, 2016
That’s the tweet we put out on Monday, after a few days of the fastest-moving politics the UK had seen in years. Little did we know that there was plenty more to come.
And it’s true. Everyone is talking politics — in the street, in the pub, on Facebook. Everyone wants information; everyone wants to express their opinions: which means that TheyWorkForYou and WriteToThem are pretty useful right now.
This has been an interesting week for us here at mySociety. As well as engaging in the same scrolling through fast-changing news stories as the rest of the nation, we’ve been dashing to make a few changes to our sites.
In general, our working methods favour considered actions. We ticket ideas, we discuss them, we prioritise and schedule them, we peer review them, and then they go live. It’s an excellent system for ensuring that work is both necessary and robust. It’s not quite so ideal for working on a new feature you need, like, yesterday, so this has been a change of pace for us.
Information is key
Here’s our first significant addition. Before you email your MP on matters concerning Brexit, it’s useful to know where they stand, so we quickly created an infobox for MPs’ pages on TheyWorkForYou (based on data from the BBC):
Neither of our parliamentary sites needed structural changes: fortunately, they are built robustly and hosted on servers which cope with increased visitor numbers when they occur.
And they are occurring. In a week that has seen the referendum, the resignation of the Prime Minister, mass shadow cabinet resignations, and Conservative leadership nominees, you have had plenty to research and plenty to write to your representatives about.
Here’s what visitor numbers for TheyWorkForYou look like — five times the usual traffic:
And six times as much as usual for WriteToThem:
Increased traffic is no problem (quite the contrary; we love it!), but there were some things that needed our attention. More users means more user support, so we’ve spent more time than usual answering questions about who we are, how we generate our data, what to do if a confirmation email doesn’t arrive, and so on.
Oh, and about that data:
All these resignations- will nobody think of the people who maintain parliamentary monitoring websites?
— Myf Nixon (@mockduck) June 27, 2016
Lots of what’s published on TheyWorkForYou updates automatically, but not necessarily immediately. Parliamentary roles, for example, are only scheduled to update weekly.
That doesn’t allow for the rate of resignations and replacements that we’ve seen in the shadow cabinet this week, so our developers have had to go in and manually set the update code running.
We wanted to remind people that TheyWorkForYou is a great place to research the facts about those standing in a leadership contest. In particular, our voting record pages set out clearly and simply what each MP’s stance is on key issues.
So we’ve been tweeting and Facebooking reminders like this:
At times, the news moved too fast for us to keep up:
Oops! Meanwhile, we also have another useful source of information: the Conservative party speeches that were removed from the internet in 2013 and which we republished on our SayIt platform:
We’re working on improving the way that TheyWorkForYou pages look when you share them on Facebook and Twitter, which seems sensible given that they are being shared so much right now.
Well, it certainly all happened over the weekend: the resignation of one Secretary of State on Friday and the quick appointment of another by Saturday.
It all left a lot of people wondering just who this Stephen Crabb fellow was, and what he stood for.
Fortunately, there’s a very handy website where you can look up the details, debates and voting records of every MP — we refer, of course, to our very own TheyWorkForYou. Over the weekend, we saw the link to Crabb’s voting record shared across social media (and even good old traditional media; we were also mentioned on Radio 4’s Any Answers). Naturally, most interest was around Crabb’s voting habits when it comes to welfare and benefits.
The upshot of this was that TheyWorkForYou saw almost three times our normal traffic for a Saturday. Over the weekend, 30% of all page views were for Crabb’s profile or voting records. In contrast, just 1.83% thought to check out his predecessor’s record: yesterday’s news already, it seems.
So Stephen Crabb’s the new guy, and you may want to keep up to date with his contributions to Parliament. Sign up here and we’ll send you an email every time he speaks.
We recently added an Environment section to voting pages on TheyWorkForYou, so now you can see exactly how your MP voted on issues like fracking, measures to prevent climate change, and green energy, all in one place, like this:
Votes on environmental issues are clearly a priority for our users. They’ve been one of the most-requested additions in the TheyWorkForYou postbag over the last couple of years, and we’re glad to have fulfilled those requests, even if it took a while.
At the same time, we’ve also made several other additions to existing sections on voting pages, so now you can check how your MP has voted in these areas:
- Assisted dying
- Trade union regulation
- Taxation of banks
- Enforcement of immigration rules
- MPs’ veto over laws only affecting their part of the UK (AKA English votes for English laws)
To check your own MP’s voting record, head over to TheyWorkForYou.com, and input your postcode on the homepage. Then click ‘voting record’ at the top of your MP’s page.
If you have strong opinions about how your MP voted on any issue, don’t forget, you can let them know by clicking on ‘Send a Message’, which will take you over to WriteToThem.com.
In case you hadn’t heard, yesterday Parliament debated whether Donald Trump should be barred entry to the UK.
This is a bit of an occasion, because the first petition has been signed by more people than any other in this Parliament. It has 573,971 signatures, and its title is “Block Donald J Trump from UK entry”. The second petition is titled “Don’t ban Trump from the United Kingdom”. That petition is curious. It has 42,898 signatures, but 30,000 signatures were removed because they were thought to be suspect and coming from one source.
Now, regular TheyWorkForYou readers know that parliamentary debates are often interesting, sometimes thought-provoking, and occasionally amusing. The Trump debate is a great example of all of those things.
But most people see the goings-on in Parliament as very dull. Today, you might want to do someone a favour, and point them towards this particular debate, which you can see in full here.
As always with TheyWorkForYou content, it’s easy to search, share or link to any individual section. And as if that’s not enough, this debate contains the only use of the word wazzock yet recorded in Parliament. Now that’s got to be worth a share.