What we’ve done — and what we want to do
Wikidata now has up-to-date and consistent data on political position holders in current national legislatures for at least 39 countries (and work in progress for over 60 countries), thanks to work by volunteer community members on the Wikiproject every politician. mySociety worked as part of this project with a Wikimedia Foundation grant in 2017-18.
There is now a real possibility for Wikidata to become the definitive source of data about democracies worldwide — but only if that data can be maintained sustainably. A significant risk is that elections and other major political changes quickly render data on political position holders and legislatures in Wikidata out-of-date.
We’re proposing a Wikidata post-election updating toolkit project, which aims to ensure that data on elected representatives is substantially correct and complete within a month following an election, leading to improved quality and consistency of data in Wikidata over time. We’ll work as part of the Wikidata community to create and signpost tools and pathways that help contributors to quickly, easily and consistently update data following an election or other political change.
How community members can get involved in the project
If you’re already active around data relevant to political position holders, legislatures, or elections in Wikidata, we’d like your feedback and help to test the new tools and guidance and ensure that they are consistent with the emerging consensus around modelling these types of data.
In particular, if you live in a country or major region that has an upcoming election, please talk to us about piloting the tools! We’d like for you to test the project tools and guidance to update data following your country’s election, and to give us feedback on the value and appropriateness of the approach in your context and political system.
In general, we’re keen to encourage discussion and evaluation of Wikidata as a source of current position holder data.
Please review our proposal
If you’re interested in this, and are active on Wiki projects, please have a look and review our proposal here.
Image: Mike Alonzo
You may remember that thanks to a grant from the Wikimedia Foundation, mySociety has been working to support increasingly authoritative data on the world’s politicians, to exist on Wikidata as a key part of developing the concept of the Democratic Commons.
And, this summer mySociety welcomed two members of staff to support with the community work around both Wikidata and the Democratic Commons. In May, I (Georgie) joined in the role of ‘Democratic Commons Community Liaison’ and in late June I was joined by Kelly, mySociety’s first ever ‘Wikimedia Community Liaison’… and it’s about time you started to hear more from us!
I’ve been climbing the learning curve: exploring the potential moving parts of a global political data infrastructure, finding out how the communities of Wikidata and Wikipedia operate, attempting to take meaningful notes at our daily meetings for the tool the team developed to improve political data on Wikidata and making sense of the complexity in creating interface tools to interpret the political data already in Wikidata. Oh, and supporting a “side-project” with Open Knowledge International to try and find every electoral boundary in the world (can you help?).
And if you are in any of the relevant open Slack channels (what is Slack?), you may have seen my name on the general introduction pages, as I have been shuffling around the online community centres of the world — off Wikidata Talk that is — trying to find the people interested in, or with a need for, consistently and simply formatted data on politicians, but who aren’t already part of the Wikidata community.
That’s because, the issue the Democratic Commons seeks to address is the time-consuming business of finding and maintaining data on politicians, work that we suspect is duplicated by multiple organisations in each country (often all of them having a similar aim), that is slowing down delivering the stuff that matters. This has certainly been mySociety’s experience when sharing our tools internationally.
And the solution we propose — the Democratic Commons — is that if people and communities worked together to find and maintain this data, it would be better for everyone… ah the paradox of simplicity.
Update on efforts to support the Democratic Commons concept
With each interaction and conversation that we’ve had about the Democratic Commons with partners, we’ve continued to learn about the best role for us to play. Here are some initial actions and thoughts that are shaping the work; please feel free to comment, or even better, get involved 🙂
Making sure the concept is a good fit through user research
We have set a goal to carry out user research on the concept of the Democratic Commons. So far, we have lined up calls with campaign staff (who are interested in using and supporting open political data through their UK campaigning work) and journalists in Nigeria (who have expressed a need for the data) and I am lining up more calls — if you have a need for or can contribute political data, let’s talk.
Bringing the Open Data/Civic Tech and Wiki communities together?
From my experience to date, the Civic Tech and Wiki communities appear to operate quite separately (I am very open to being proved wrong on this point!).
I am just getting started within the Wikidata/ Wikimedia communities (that’s more for Kelly) but on the Open Data/ Civic tech side, there are questions about data vandalism and the potential to trust the data from Wikidata, arguments on the benefit of using Wikidata (especially where you already have a lot of useful data) and on whether there is a need to invest time in learning SPARQL, the query language that allows faster retrieval and manipulation of data from databases.
Misconceptions are not unusual in communities online or offline, but it is a gap that our work focus, communications and tools hope to help close. If you have ideas on blogs, video tutorials or articles to share to read around these concepts, please get in touch.
Working openly in existing global communities (off Wiki)
We are aware that, off-Wiki mySociety is leading the work to develop the Democratic Commons, however, we know that we need to be delivering this work in the open for it to be owned by other people outside of mySociety, and finding the right homes to talk about it (off Wiki) has been important. In order to work openly, we have a shared #DemocraticCommons Slack channel with mySociety and Code for All; see ‘Get involved’ below to find out how to join the conversation.
We also plan to document the learning involved in the process through blog posts and documentation, to be uploaded publicly.
And, supporting local communities to develop, where possible
A global network such as Code for All is very useful in supporting a concept like the Democratic Commons, however, the bulk of need for the data will likely be country-specific. Together with our partners and collaborators, we are exploring what is needed and how to support local communities:
- Through the remainder of our Wikimedia Foundation Grant, we are supporting community events and editathons: in Lebanon with SMEX, in France with newly formed organisation F0rk, and in Spain with Wikimedia España.
- Some groups we are working with, such as Code for Pakistan, plan to set up a channel on their Slack instance and use their Whatsapp community to discuss the data use and maintenance.
- In my own country, the UK, we are talking to mySociety’s community and collaborators to understand how the Democratic Commons could benefit organisations and work in practice here. If you want to be involved in this work, please contact me.
- We are listening to understand what support is needed with collaborators in the global South, as we’re well aware that it is a lot to ask people to work on a voluntary basis and that adequate support is needed. I hope we can share the learning and use it to shape any future projects that may emerge.
How to get involved in the Democratic Commons?
- Contribute to the Wikidata community: If you are Wikidata user, or keen to learn, visit the Wikidata project page on political data. If you need guidance on tasks, do feel free to add to the Talk page to ask the community, or get in touch with Kelly, our Wikimedia Community Liaison: email@example.com.
- Join the conversation on Code for All Slack: If you would like to join the Slack conversation, join here: https://codeforall.org/ (scroll down and find the ‘Chat with us’ button).
- Look for electoral boundary data: We are working with Open Knowledge to find electoral boundary data for the whole world. See more about that here.
- Keep up to date and subscribe to our Medium blog: Sometimes these Democratic Commons posts are a bit too in-depth for the general mySociety readership, so for those who are really interested, we plan to share all we are learning here.
- Share the concept with contacts: Please share the message on your platforms and encourage potential users to take part in research and get involved. We recognise that our view — and reach — can only be anglo-centric, and we’d so appreciate any translations you might be able to contribute.
- Tell us (and others) how you think you would use the data: This can’t just be about collecting data; it’s about it being used in a way that benefits us all. How would the Democratic Commons help your community? We would love people to share any ideas, data visualisations, or theories, ideally in an open medium such as blog posts. Please connect with Georgie to share.
- Something missing from this list? Tell us! We’re @mySociety on Twitter or you can email firstname.lastname@example.org or email@example.com .
Image: Toa Heftiba
We, and Open Knowledge International, are looking for the digital files that hold electoral boundaries, for every country in the world — and you can help.
Yeah, we know — never let it be said we don’t know how to party.
But seriously, there’s a very good reason for this request. When people make online tools to help citizens contact their local politicians, they need to be able to match users to the right representatives.
So head on over to the Every Boundary survey and see how you can help — or read on for a bit more detail.
Data for tools that empower citizens
If you’ve used mySociety’s sites TheyWorkForYou — or any of the other parliamentary monitoring sites we’ve helped others to run around the world — you’ll have seen this matching in action. Electoral boundary data is also integral in campaigning and political accountability, from Surfers against Sewage’s ‘Plastic Free Parliament’ campaign, to Call your Rep in the US.
These sites all work on the precept that while people may not know the names of all their representatives at every level — well, do you? — people do tend to know their own postcode or equivalent. Since postcodes fall within boundaries, once both those pieces of information are known, it’s simple to present the user with their correct constituency or representative.
So the boundaries of electoral districts are an essential piece of the data needed for such online tools. As part of mySociety’s commitment to the Democratic Commons project, we’d like to be able to provide a single place where anyone planning to run a politician-contacting site can find these boundary files easily.
And here’s why we need you
Electoral boundaries are the lines that demarcate where constituencies begin and end. In the old days, they’d have been painstakingly plotted on a paper map, possibly accessible to the common citizen only by appointment.
These days, they tend to be available as digital files, available via the web. Big step forward, right?
But, as with every other type of political data, the story is not quite so simple.
There’s a great variety of organisations responsible for maintaining electoral boundary files across different countries, and as a result, there’s little standardisation in where and how they are published.
How you can help
We need the boundary files for 231 countries (or as we more accurately — but less intuitively — refer to them, ‘places’), and for each place we need the boundaries for constituencies at national, regional and city levels. So there’s plenty to collect.
As we so often realise when running this sort of project, it’s far easier for many people to find a few files each than it would be for our small team to try to track them all down. And that, of course, is where you come in.
Whether you’ve got knowledge of your own country’s boundary files and where to find them online, or you’re willing to spend a bit of time searching around, we’d be so grateful for your help.
Fortunately, there’s a tool we can use to help collect these files — and we didn’t even have to make it ourselves! The Open Data Survey, first created by Open Knowledge International to assess and display just how much governmental information around the world is freely available as open data, has gone on to aid many projects as they collect data for their own campaigns and research.
Now we’ve used this same tool to provide a place where you can let us know where to find that electoral boundary data we need.
Where to begin
Thanks for your help — it will go on to improve citizen empowerment and politician accountability throughout the world. And that is not something everyone can say they’ve done.
Image credit: Sam Poullain
It’s been a few months since we first announced our Democratic Commons project under the banner of “shared code, data and resources where anyone can contribute, and anyone can benefit” — but if we’ve been silent since then, it’s certainly not for a lack of activity.
Quite the reverse, in fact: we’ve been busy bringing new team members on board and getting stuck in with the time-consuming and often fiddly process of data gathering and sharing.
When we’re in the midst of all this hard work, it’s sometimes hard to remember to talk about how everything’s going; but it’s always interesting, so here’s a snapshot of where we are now.
Those of us working on Democratic Commons are only a small team within the smallish organisation mySociety. Gathering in-depth data on politicians all around the world takes more time and more local knowledge than we have ourselves, so we’re working with partners located within our target countries.
Distintas Latitudes have been handling Latin America – they’ve been great at gathering data and explaining the various differences between the political systems in each country we’ve worked together on.
In India, Factly and Gender And Politics have done the most amazing job in gathering a full national and state level dataset for politicians right across the country. We were astounded, as that is a LOT of data (over 3,500 records and counting so far).
And in South East Asia we’re working with OCF, with whom we’ve had a long association (you may remember TICTeC Taiwan, for example). OCF have helped us with data for Taiwan and South Korea so far, and are set to work with us on seven more countries before December 2018.
Finally, a special mention goes to OpenLeb of Lebanon, who are working hard to start finding data in a country where data is not usually open. We genuinely could not do this work without our partners and we are eternally grateful for their help.
As is probably clear from the above, we often select which countries to work on by our ability to find a community or organisation that will extend help. A nice side effect of this is that we’re strengthening the connections and bonds between mySociety and organisations with similar missions in many different places.
Growing the community of such organisations across the world is going to be the primary focus of our new Community Manager Georgie, whom you will no doubt hear a lot from over the next few months.
She’s going to be finding out who’s already using data like this, who’s maintaining it, who’s interested in running projects with it or doing research — and seeing if there’s also an appetite there to keep the data up to date. This is because the data will really only be useful to people if it’s well maintained and current!
Working with Wikidata
Early on, we recognised that improving the political data available in Wikidata, rather than ringfencing it all within EveryPolitician, was going to be an efficient way to maximise the benefits of the Democratic Commons project.
What does this mean in practice? Well, in our first phase we’ve targeted 13 places in which to locate the data and load it into Wikidata: Mexico, Brazil, Colombia, Paraguay, Chile, Canada, Italy, Estonia, Lebanon, India, S Korea, Taiwan and Hong Kong.
Ultimately, we want to help make any and all information about politicians at every level freely and openly available via the Commons; but for now, our initial scope looks at representatives at national, regional, and city legislatures.
Now that a lot of this work is being done on or in Wikidata, we’re creating tools to make processes smoother and faster. The main ones of these are around verifying data and creating statements in Wikidata; we hope that when we’ve completed these they’ll be valuable to the whole Wikidata community beyond just the Democratic Commons project.
Step by step
We’re focusing on getting what we’re terming ‘Outline Data’ for each place loaded into Wikidata first. This type of data helps us model the political system, as it tells us what the legislature looks like — for example, whether it is unicameral, bicameral or different to those; what it calls members of the legislature; what term the legislature is on and how long that lasts; and often how many seats that legislature contains.
Once we have that outline data, we then need some information about people holding seats in those legislatures. We try and start with five examples of each type of role at each level, then we can send this ‘Seed Data’ off to hopefully crowdsource the rest of the data: more on that in a bit!
Meanwhile, our GIS expert Will is working on boundaries. Boundary data is hard — like, really hard! This is one of the most challenging areas of the project but it’s also one of the most important. Without electoral boundaries we don’t know what area a politician is representing and a lot of the tools we think this data would be useful for just won’t work.
However, boundaries aren’t always released openly or completely, especially when it comes to local level constituencies, and even when we do find them, understanding whether we have all the data we need to represent politicians correctly can be really tricky.
Because we like to keep really busy, we’ve also been starting to collaborate with other organisations such as Open Knowledge and CLEA on how to raise the visibility of the availability (or lack, more likely) of open sources of official boundary data.
Working with Facebook
You may remember our ongoing work to connect Facebook users with their politicians after an election, in countries around the world.
We’re also working with Facebook to run some crowdsourcing experiments that will gather more data on politicians. I mentioned ‘Seed Data’ above. For each country, this gets fed to Facebook, and allows them to create questions which they can send to users to ask them who their representatives are at different levels of government.
We then get this data back and our partners help us verify it and put it into Wikidata so it becomes open and available for anyone to use. Facebook has a reach we would never be able to manage on our own.
So that’s where we are
As I’ve hopefully demonstrated in this post, the work is extremely challenging. That’s why we’re sometimes a little slow in updating where we’ve got to — but we genuinely believe that that having this data out there in the open will pave the way for so many exciting new political data-based projects and research. And so, onwards!
Image: Ben White (Unsplash)
Yesterday Matt explained what we hope to achieve with the Democratic Commons, our drive for shared, high-quality political Open Data.
If you read that and thought, ‘Blimey, that sounds like a lot of work’ — well, we thought so too. Hence, three new job openings.
As so often at mySociety, the skills we’re looking for aren’t exactly mainstream: on the other hand, if you do have a particular interest in the field, the chances are you’ll be a very good match.
So if you’re a bit of a geek about political boundary data…
Or if you have big ideas about how to build and maintain a large-scale distributed architecture for sourcing and updating basic political information…
Or if writing queries to extract data from Wikidata sounds like something you might do just for kicks … well, then the chances are that you’d fit in very well.
Find out more about all the vacancies here and please do pass them along to anyone who might fit the bill.
And because we know that it can be hard to make a big decision, especially before you know exactly what a workplace is like, we’ve done two things: we’ve expanded our Careers page to include more of a description of our so-called ‘company culture’, and we’ve opened up a blog post where you can ask us anything about working here.
Back in September mySociety’s Chief Executive Mark introduced the idea of the ‘Democratic Commons’: a grand vision where political data is open to all, for the benefit of all. Since then we’ve been quietly working away on making the concept a reality, with some activity more clearly feeding into it, like our current series of events for GLOW, and some requiring a bit of explanation, like our relationship with Facebook — but what we haven’t really done to date is expand on what the Democratic Commons means and why we believe it is so important.
So let’s take a go at a clear definition.
The Open Data Institute have been promoting the idea of data infrastructure for some time now:
A data infrastructure consists of data assets, the organisations that operate and maintain them and guides describing how to use and manage the data.
It underpins transparency, accountability, public services, business innovation and civil society.
Our vision for the Democratic Commons begins with this concept and advocates for a particular strand within it. It promotes the building of an open, sustainable data infrastructure for political data on a global scale. So nothing too grand then!
In essence this is an evolution of our EveryPolitician project — it takes the lessons we learned there and uses them to underpin a new approach. But it is also the culmination of many years of running and developing projects all over the world and facing the same challenges with the data needed to get started time and again: lists of politicians not up to date, or in an unusable format; ‘unique’ IDs being less than unique; administrative boundaries not being available, available under restrictive license or in some entirely unhelpful format.
The effort and cost of just getting this initial data in place — before you can even start the real work of empowering citizens or holding power to account — is often so high that it stymies teams from the off. We want to change this. We want organisations who are interested in running transparency or accountability projects in their countries to be able to find all this infrastructure in place and get to building straight away.
Beyond this core goal we also want to provide richer open data because the better the data the better the questions that can be asked of it and if, as Giuseppe Sollazzo says, data journalism is the future of Open Data, then we need to make sure that we can provide those journalists the answers they need (and maybe help tackle #fakenews a bit in the doing so!).
In no way do we see ourselves as the gatekeepers for this data and instead we are seeking to be true to the concept of ‘commons’ from the start — working with the global communities and platforms that already exist in support of Open Data and content.
We’ve already started to work with the Wikimedia Foundation through our project with Wikidata and see this as a cornerstone of any approach to the Democratic Commons. Of course we also want to speak to members of the OpenStreetMap community about their experiences with administrative boundaries and we’ll be reaching out to them soon.
In the coming weeks we are going to be recruiting for some additional colleagues to help us with all of this so if political and or geographical data is your thing please keep an eye out.
Even with some additions to the team there’s no way we can achieve this alone — we’ve already collaborated with partner organisations like Code4Japan and Open Knowledge Foundation Deutschland — and there will be many more partnerships to come. You can expect to read much more about that in future months.
Earlier this month, Mark laid out the concept of a Democratic Commons for the Civic Tech community: shared code, data and resources where anyone can contribute, and anyone can benefit.
He also talked about exploring new models for funding the kind of work that we do in our Democracy practice at mySociety.
For many years, our Better Cities work has been proof of concept for one such model: we provide data and software as a service (FixMyStreet, MapIt, Mapumental) to paid clients, the revenue from which then funds our charitable projects. Could a similar system work to sustain our Democracy practice?
That’s the hope, and with Facebook who we first worked with during the UK General Election in June, providing the data that helped people see and connect with their elected representatives, we’ve already seen it in action.
This kind of project is positive on multiple levels: it brings us an income, it brings the benefits of democratic engagement to a wider audience than we could reach on our own, and it contributes data back into EveryPolitician and Wikidata, that everyone can use.
The UK election was only the first for which we did this work: we’ve gone on to provide the same service for the French elections and more recently for the rather more eventful Kenyan ones — currently on hold as we await the re-run of the Presidential election next month. And now we’re doing the same for the German elections, where candidate data is being shared this week.
As we’re learning, this is definitely not one-size-fits-all work, and each country has brought its own interesting challenges. We’re learning as we go along — for example, one significant (and perhaps obvious) factor is how much easier it is to work with partners in-country who have a better understanding of the sometimes complex political system and candidates than we can ever hope to pick up. Much as we might enjoy the process, there’s little point in our spending days knee-deep in research, when those who live in-country can find lists of candidates far more quickly, and explain individual levels of government and electoral processes far better.
Then, electoral boundaries are not always easy to find. We’ve used OpenStreetMap where possible, but that still leaves some gaps, especially at the more granular levels where the data is mainly owned and licensed by the government. It’s been an exercise in finding different sources and putting them all together to create boundary data to the level required.
Indeed, that seems to be a general pattern, also replicated across candidate data: at the national level, it’s easy to find and in the public domain. The deeper you go, the less those two descriptors hold true. It was also at this point that we realised how much, here in the UK, we take for granted things like the fact that the spelling of representatives’ names is usually consistent across a variety of sources — not always a given elsewhere, and currently something that only a human can resolve!
What makes all the challenges more worthwhile, though, is that we know it’s not just a one-off push that only benefits a single project. Nor is the data going straight into Facebook, never to be seen again.
Much of what we’re collecting, from consistent name data to deep-level boundaries data, is to be made available to all under open use licenses. For example, where possible we can submit the boundaries back to OpenStreetMap, helping to improve it at a local granular level across whole countries.
The politician data, meanwhile, will go into Wikidata and EveryPolitician so that anyone can use it for their own apps, websites, or research.
There are also important considerations about how this type of data will be used and where and when it is released in the electoral process; finding commercial models for our Democracy work is arguably a more delicate exercise than on some of our other projects. But hopefully it’s now clear exactly how a project like this can both sustain us as a charity, and have wider benefits for everyone — the holy grail for an organisation like us.
At the moment it’s unclear how many such opportunities exist or if this is a one-off. We’re certainly looking for more avenues to extend the scope of this work and keen to hear more ideas on this approach.
Your donations keep our sites running.Donate now
mySociety was built on its Democracy practice, a pioneer in providing simple- to-use tools that demystify the democratic process, allow citizens to understand how decisions are being made on their behalf and ensure that their voices are heard by elected representatives.
We’ve been on a long journey, from the early days of FaxYourMP which eventually became WriteToThem, to our pivotal TheyWorkForYou service which has both stretched the ambitions of Parliament in the UK and led us to develop similar services in Kenya, South Africa and beyond.
Amidst all of this has been our ongoing push to better standardise and make accessible more Open Data on politicians around the world; initially through our Poplus and Pombola projects, but more recently – and with more success – through our EveryPolitician service which has blossomed into a remarkable dataset of almost 4 million datapoints on over 72,000 politicians in 233 countries and territories.
Despite these successes I don’t think we’ve yet sufficiently cracked the challenge at scale of enabling more organisations to monitor and report upon the work of more politicians in more countries. We need to do something about that.
One of the principles that has always underpinned mySociety is that we carry our work out in the open, freely available for others to use. But, as is common with many Open Source projects, we do most of the development work ourselves internally. While community contributions are very welcome, practicality has dictated that more often than not, these are more commonly directed to raising tickets rather than making changes to the actual code.
Unchecked, this situation could lead to us being too internally focused; on developing everything ourselves rather than recognising where we can achieve our objectives by supporting other projects.
Fortunately our collaboration with Wikidata, announced earlier this year, suggests what promises to be a clear way forward to scaling up the impact of our work: we recognised that EveryPolitician could only become sustainable at scale as part of a wider community effort if we want our data to be used more widely.
By contributing to what we’ll call the Democratic Commons — a concept of shared code, data and resources where anyone can contribute, and anyone can benefit — we can help build and strengthen core infrastructure, tools and data that allow other democracy organisations and campaigners to hold their own governments to account.
This was notably put into practice for the snap General Election in the UK in June, where rather than build something new ourselves we directly supported the work of Democracy Club in their efforts to source candidate data and ensured that our existing services like MapIt, TheyWorkForYou and WhatDoTheyKnow were easily accessible for other campaigning and democracy organisations to put into use.
More recently we’ve established a commercial partnership with Facebook to provide them with accurate and independent lists of candidates and elected representatives matched to their relevant Facebook profile pages for the UK, French and Kenyan elections.
There’s a wider benefit to this kind of commercial work, beyond its being a useful source of additional revenue for mySociety. More importantly, it will allow us to feed the data that we source back into the Democratic Commons. It can contribute to EveryPolitician and Wikidata, and even improve boundary data internationally through OpenStreetMap, which in turn powers our own Global MapIt service.
Why is this important now?
Well, it’s not just the rather obvious observation that working with other people is a good idea. The reality is that we need to face the fact that our Democratic practice is just not fully funded, and, as with WhatDoTheyKnow.com, at best we’ll need to consider how more of our services in the UK can be run and directly supported by volunteers and the wider community.
At worst it’s quite possible that we’ll be forced to close some of our popular UK services and restrict the further development of our democracy work internationally.
In April next year we come to the end of our six-year grant agreement with the Omidyar Network who have given us tremendous support over that time. This will leave a substantial hole in our core funding and it’s one reason why we’ve been so diligently focused on developing appropriate new commercial services like FixMyStreetPro and WhatDoTheyKnowPro.
Without sufficient unrestricted core funding — that is, funding which can be applied wherever in the organisation it is most needed — we need to rely much more on specific project funding wherever we can find it. In most cases, however, this project funding comes with its own set of tasks to deliver, and there’s a tendency to want new shiny things, rather than supporting the maintenance of our existing projects. This is especially true of our Democracy work which relies more heavily on grant funding than commercial alternatives.
Sensibly directing our own work more towards contributions to external projects is also a hedge, should we need to find new homes for our services or shutter them for the time being.
In the meantime we’ll be speaking to more funders who we hope might recognise the importance of supporting and building the essential infrastructure of the Democratic Commons, but in the event that isn’t forthcoming we’ll do what it takes to ensure our work to date continues to have some value and impact.
As we start to map out a path to a sustainable future for mySociety and its community, I’d appreciate all thoughts on where we go next with this — after all, we can’t do this without your help.
Millions of people reached for their phone on June 9, and checked Facebook for the result of the UK General Election.
Now, you may or may not be one of those people yourself, but there’s no disputing that many of us turn to social media as our primary source for big news. Through the night, Facebook was a place where we could express feelings about the results as they came in, share news stories and ask questions: it gives us a rounded view of an event like an election, quite unlike any you’ll receive from traditional media.
And the morning after, those logging in to Facebook may have seen something like this — an invitation to follow your newly-elected or re-elected MP and other elected representatives, from local councillors to MEPs:
We’re glad to say that mySociety has been working alongside Facebook to help make this happen.
Reaching people where they are
mySociety has a mission to make democracy more accessible for everyone, and via our websites TheyWorkForYou and WriteToThem, we serve and inform more than 400,000 UK citizens per month.
That figure has, as we’d expect, spiked in the last few weeks as people rush to check their MPs’ track records, all the better to cast an informed vote; but all the same, we’re well aware that 400,000 users is only a small proportion of the country’s electorate.
What’s more, our research has consistently shown that our services don’t adequately reach the people that need them most: our typical user is male, reasonably affluent, well-educated, older and white — I mean, we’re glad to be there for everyone, but generally speaking this is a demographic that can inform itself quite readily without any extra help.
That’s not a problem Facebook has, though, with their 32 million UK users. 75% of them log in on a daily basis, and almost half are under the age of 30*.
That’s why we were so keen to join forces with the Facebook Civic Engagement team, to help this large online audience see who their representatives are today.
Facebook for engagement
You may not have been aware that Facebook has a dedicated political engagement team — unless you came to TICTeC this year, of course, in which case you’d have seen a walkthrough of the extensive research that’s gone into their election offerings globally — but if you use Facebook at all, and if you’re in a country that has recently had an election, you’ve probably seen some of their work.
Over the last few weeks in the UK, people on Facebook were alerted to each stage of the electoral process. They were invited to check who their candidates were and what they stood for; offered a reminder to vote and provided information on where and how to do so; and finally, encouraged to share the fact that they had voted, tapping into the proven peer encouragement effect.
mySociety behind the scenes
Thanks to our experience running TheyWorkForYou and WriteToThem, plus the support we receive from Commercial Evaluations and their Locator Online service and our involvement with Democracy Club’s WhoCanIVoteFor.co.uk, we have access to accurate and up-to-date data on candidates and representatives at every level, from local councillors up to MEPs, and including MPs — all linked to the relevant constituencies.
In all, this totaled around 23,000 people. What we needed to discover was how many of them were on Facebook — and could we accurately link our records to their Facebook pages?
Working together with Facebook, we built an admin tool that displayed likely pages to our team, on the basis of names, locations and the really giveaway information, such as ‘Councillor’, ‘MP’ or the constituency name in the page title. Some representatives didn’t have individual pages, but ran a party page; those counted too (and of course, a fair proportion of representatives have no Facebook presence at all).
While our tool filtered the results reasonably well, it was still necessary to make a manual check of every record to ensure that we were linking to the correct representative, and not, say, someone who happened to have the same name and live in the same town. We needed to link, of course, only to ‘official’ pages; not representatives’ personal pages full of all those things we use Facebook for on a day-to-day basis. Those holiday snaps, Candy Crush results and cat memes won’t help constituents much: what we were looking for was the kind of page where constituents could message their reps, find out about surgery times, and get the latest news from their constituency.
Now of course, until the results came in, no-one knew precisely which candidates would be MPs! So a small crack team of mySociety people worked through Thursday night to do the final matching. It was a very long night, but we hope that the result will be an awful lot more people following their representatives, and so quite effortlessly becoming more politically engaged, thanks to a platform which they already visit on a regular basis.
Last you heard from from the EveryPolitician team we were talking about integrating EveryPolitician more deeply with Wikidata.
Here’s a quick update on what to expect in the coming months and a note on how you can get involved – we are going to need a lot of help!
Before we can make headway on a deeper integration, there are some pretty foundational pieces of the puzzle we need to put in place.
Some key data is missing, and you may be surprised to discover that it is pretty basic stuff. Take a look at this for example:
This is from a report we have generated to highlight gaps in the links between items. Notice how not even all of the offices have been filled in on the country page, let alone who occupies those offices?
This is the type of foundational data we are hoping to get in place over the next little while, and you can help…
How you can get involved
Over the coming weeks we’re going to be conducting a few experiments in public and trying to get data into Wikidata. We’ll need as much help as we can get!
The experiments will focus on using Wikidata to attempt to answer some questions we find interesting and see how we can expose gaps and inconsistencies in the data. In doing this, we’ll be pointing to specific reports we have generated and asking you to help us fill in the gaps.
Our first question will be:
“What is the gender breakdown of heads of government across the world?”
We’ll be blogging about the investigation over on Medium. The first post is already there:
Keen to dive straight in? Help us fill in the blanks you see in this report! If you are familiar with Wikidata, you will probably be able to get started straight away, but there are also tips and pointers in the Medium post if you want a bit more guidance.
You can get notified of the challenges to complete the data as soon as they are published by following the EveryPolitician bot on Twitter.
Want even more details on our plans?
We should also mention that we’ve updated our proposal to the Wikimedia Foundation to make a couple of things clearer about the problem we are trying to solve and our proposed solution (the proposal is still being reviewed). If you are interested in the nitty-gritty, that’s the best place to get the full overview of what we are planning.