Skip navigation

  Help us to make more
useful things.
Donate to mySociety

mySociety blog » News

Political parties don’t know where the boundaries are

Monday, January 4th, 2010 by Matthew Somerville

In my last blog post, I explained the new service TheyWorkForYou offers to show you what constituency you will be in at the next general election. Now I’m going to show you why you shouldn’t use anything else.

The defintions of the boundaries for the forthcoming constituencies in England were originally published in The Parliamentary Constituencies (England) Order 2007 (SI 2007/1681), based on ward boundaries as they were on 12th April 2005. However, due to some local government changes since that date, The Parliamentary Constituencies (England) (Amendment) Order 2009 (SI 2009/698) was published changing the boundaries for four constituencies – Daventry, South Northamptonshire, Wells, and Somerton & Frome – to be based on the new council wards as they were on 3rd May 2007.

The forthcoming constituencies in Northern Ireland were defined in The Parliamentary Constituencies (Northern Ireland) Order 2008 (SI 2008/1486). In this, Derryaghy ward was split between two constituencies – Belfast West is given “that part of Derryaghy ward lying to the north of the Derryaghy and Lagmore townland boundary.”

All of which means that other sites that try to tell you what constituency you will be in at the election invariably get it wrong.

Both Labour and the Conservatives say that BA6 8NJ is in Wells at the next election, when it will be in Somerton & Frome. Both say that NN12 8NF will be in Daventry, when it will be in South Northamptonshire. I assume that both sites are using boundary data predating the Amendment Order from March 2009. The Conservatives also say that BT17 0XD will be in Lagan Valley when it will be in Belfast West; Labour simply say “Northern Ireland” for any Northern Irish postcode you provide.

The Liberal Democrats site currently returns no results for any postcode, which I assume is a bug :)

The current boundary between Belfast West and Lagan Valley.

The /current/ boundary between Belfast West and Lagan Valley. (Image produced from the Ordnance Survey electionmap service. Image reproduced with permission of Ordnance Survey and Land and Property Services)

The official election-maps.co.uk service (from where TheyWorkForYou gets its boundary maps) returns the correct results for BA6 8NJ and NN12 8NF, but doesn’t have future boundaries for Northern Ireland. It’s not clear that it doesn’t, as searching for Lagan Valley with “future boundaries” selected returns a result, but that result is the current boundary. This can be seen from the picture on the right – as is clear from the quote I gave above, everything within Derryaghy ward north of the Lagmore/Derryaghy boundary will be in Belfast West at the next election. Plus the site doesn’t work without JavaScript.

TheyWorkForYou’s “constituency at the next election” service gives BA6 8NJ in Somerton & Frome, NN12 8NF in South Northamptonshire, and BT17 0XD in Belfast West. There is enough confusion with the changes to boundaries for everywhere except Scotland, that it is somewhat frustrating to have it compounded by sites giving incorrect information. The lack of any official service also doesn’t help.

Constituency boundaries at the next election

Thursday, December 24th, 2009 by Matthew Somerville

Constituency boundaries are changing at the next general election in England, Wales, and Northern Ireland. After some amount of fiddling (I’ll go into technical details in another post, but it wasn’t as easy as just importing some shapefiles), as a slightly early Christmas present, TheyWorkForYou now has a section where you can enter your postcode to find out what constituency you are currently in, and what constituency you will be voting in at the election, along with maps of before and after:

http://www.theyworkforyou.com/boundaries/

This service is also available through the TheyWorkForYou API. This is a facility we have been asked for frequently, more so as we approach the forthcoming election; the large amount of boundary changes have led to confusion from our users and elsewhere, so this will hopefully prove useful.

One site that will need the boundaries before the election is DemocracyClub – join to help make this coming election the most transparent ever!

Side effects of the above process include updated council boundaries, so those councils on WriteToThem that we’ve had switched off since May due to lack of boundary data are now back; a more up-to-date postcode dataset; and the beginnings of parish council support (as in they’re now in the database, but the front-end doesn’t know what to do with them yet).

I hope you all have a happy Christmas and New Year.

mySociety DemocracyPub: Manchester, 20th Jan

Thursday, December 17th, 2009 by sam
Thursday 20th January, in Manchester, mySociety, Democracy
Club, and friends invite you to join us in the Briton’s
Protection from 7:30 for conversation on democracy,
engagement and tea.
mySociety runs projects such as TheyWorkForYou.com,
FixMyStreet.com and WhatDoTheyKnow.com, while DemocracyClub.co.uk is the new
independent volunteer network for the upcoming
election to keep track of how parties campaign in your local
community when they think no one elsewhere will notice.
Come join us in the pub (20th Jan, 7:30), or sign up online at
http://www.democracyClub.co.uk
The Briton’s Protection is just behind the Bridgewater Hall,
postcode M1 5LE. You’ll find us in one of the two back
rooms, wearing a mySociety hoodie or carrying a clear sign.
Tom looks like this: http://www.mysociety.org/about/

Wednesday 20th January, in Manchester; mySociety, Democracy Club, and friends invite you to join us in the Briton’s Protection from 7:30 for conversation on democracy, engagement and tea.

mySociety runs projects such as TheyWorkForYou.com,FixMyStreet.com and WhatDoTheyKnow.com, while DemocracyClub.co.uk is the new independent volunteer network for the upcoming election to keep track of how parties campaign in your local community when they think no one elsewhere will notice.

Come join us in the pub (20th Jan, 7:30), or you can sign up to Democracy Club at                            http://www.democracyClub.co.uk

The Briton’s Protection is just behind the Bridgewater Hall, postcode M1 5LE. You’ll find us in one of the two backrooms, wearing a mySociety hoodie or carrying a clear sign. Tom has his picture here: http://www.mysociety.org/about/

A Facebook event is now open.

mySociety’s Next 12 months – Part 1

Wednesday, December 16th, 2009 by Tom Steinberg

Over the last weekend of November 2009 a group of 21 mySociety staff, volunteers and trustees went to a house outside of Bristol to wrestle with the question of what mySociety should build over the next 12 months. This was the fourth time we’ve done it, and these meetings have become a crucial part of our planning.  This year, we were talking not just about what new features to add to our current sites, but also about the possibility of building an entirely new website for the first time in a couple of years. The discussions were lively and passionate because we know we have a lot to live up to: not only is our last major new site (WhatDoTheyKnow) likely to cross the 1 million unique visitors threshold this year, but we understood that there were people and organisations who weren’t there who would be counting on us to set the bar high.

A chunk of the weekend involved vetting the 227 project ideas that were proposed via our Call for Proposals. I’m going to write a separate post on our thoughts about that process, but if you look at the list below you may spot things that were submitted in that call.

One nice innovation that helped us whittle down our ideas from unmanageable to manageable numbers was a pairwise comparison game to help us prioritise ideas, build custom for the occasion by the wonderful and statistically talented Mark Longair.  In other words, we used the technique that powers  KittenWar.com to help decide our key strategic priorities for the next year: after all , if we don’t, who will?

game-with-previous-answers-no-statssml

Screenshot from the pairwise comparison game that Mark Longair coded

By the end of the weekend we had not battened everything down – there are too many uncertainties around how much time we will have, and some key ideas that need more speccing.  However, we were able to put various things into different buckets, marked according to size and degree of certainty.  So here goes:

1. Things which were decided at the last retreat, which we are definitely building,  and which (mostly) need doing before next year’s stuff starts getting built

  • A top level page for each bill on TheyWorkForYou
  • Future business (ie the calendar) for events in the House of Commons, including a full set of alerting options.
  • Video clips on MP pages on TheyWorkForYou
  • Epicly ambitious election data gathering and  quiz building with the lovely volunteers at DemocracyClub

2. Small new things that we are very probably doing because there was lots of consensus

  • Publish a standard that councils can use to post problems like potholes in their databases to FixMyStreet and other similiar sites.
  • Template requests in WhatDoTheyKnow so that users are strongly encouraged to put in requests that are well structured.
  • After the next general election, email new MPs with various bits of info of interest to them including their new login to HearFromYourMP, their page on TheyWorkForYou, explanation of how WriteToThem protects them from spam and abuse, a double check that their contact details are correct, and a introduction to the fact that we record their correspondance responsiveness and voting records.
  • Add to WhatDoTheyKnow descriptions about what kind of public authority a specific entity is (ie ’school’, ‘council’) and the information they are likely to hold if FOIed.
  • Show divisions (parliamentary votes) properly on debate pages on TheyWorkForYou, ie show the results of a vote on the same page as the debate where the issue was discussed, with full party breakdowns on each division.
  • Add “How to benefit from this site” page on TheyWorkForYou, inspired by OpenCongress.org
  • Help Google index TheyWorkForYou faster by creating a sitemap.xml file that is dynamically updated.
  • Using the data we expect to have from DemocracyClub’s volunteers, send a press release about every new MP and to all relevent local newspapers
  • Incorporate a council GeoRSS problem feed into FMS

3. Slighty more time consuming things we are very probably doing because there was lots of consensus

  • 1 day per month developer time that customer support guru Debbie Kerr gets to allocate as she see fit.
  • Premium account feature on WhatDoTheyKnow to hide requests so that journalists and bloggers can still get scoops and then share their correspondance later.
  • Add Select Committees to TheyWorkForYou, including email alerts on calls for evidence.
  • Take professional advice on how to handle PR around the election

4. Much more time consuming things and things around which there is less consensus. NB – We do not currently have the resources to do everything on this list next year – it is an ambitious target list.

  • Primary New site: TBA in a new post
  • Add a new queue feature to WhatDoTheyKnow so that users can write requests, then table them for comments from other users and expert volunteers before they are sent to the public authority
  • Relaunch our Volunteer tasks page on our sites, keep it populated with new tasks, specifically allocate resources to handhold potential volunteers. Allocate time to see if any of the ideas that we didn’t build could be parcelled into volunteer tasks.
  • Secondary New site (if we have a lot more time than we expect): Exploit extraordinary richness of Audit Comission local government target data in a TheyWorkForYou-like fashion.
  • FixMyStreet to become international with  a) maps for most of the world b)  easy to follow instructions explaining how to supply mySociety with the required data to us to enable us to turn on FixMyStreet in non UK countries or areas. This data would includ  ie gettext powered text translation files,  shapefiles of administrative boundaries, and lists of contact data.
  • Add votes and proceedings to TheyWorkForYou (where they reveal statutory instrument titles that are not debated but where the law gets changed anyway)
  • Carry out usability testing on TheyWorkForYou with then help of volunteer Joe Lanman – then implement changes recommended during a development process taking up to 10 days.
  • Add to TheyWorkForYou questions that have been tabled in the house of commons but which haven’t been answered yet.
  • Add a new interface for just councils so that they can say if a problem on FixMyStreet has changed status.

Phew. And that’s not even counting the projects we hope to help with in Central and Eastern Europe, our substantial commercial work, or the primary new site idea, which will be blogged in Part 2.

mySociety in Central and Eastern Europe

Thursday, October 15th, 2009 by tony

We know from our inboxes that there are people all over the world who would love to start sites like TheyWorkForYou.com, FixMyStreet.com, or WhatDoTheyKnow.com in their own countries. Building and running these sites is hard, though, and takes time, money, and love. Until now we haven’t been able to do much for these keen correspondents beyond sharing our ideas, sharing our code, and wishing people the very best of luck. We’re happy to say that for at least some of these people, things are about to change for the better.

CEE

derived from http://commons.wikimedia.org/wiki/File:Eastern-Europe-map2.svg

If you live in Central or Eastern Europe, we’re now in a position to help you get effective democracy and transparency websites built. mySociety have teamed up with the Open Society Institute (OSI) and together we are now looking for determined people with great ideas for new digital transparency and accountability services in their countries.

Over the next few months we are running a Call for Proposals, similar to the one we recently ran in the UK. The big difference is that this time we’re not looking for projects that we will build. We’re looking for projects you want to build, but that for lack of funds or lack of the right skills, you can’t get started yourself.

Each month the Open Society Institute and mySociety will work closely together to select a series of projects to fund and mentor. Crucially, the call isn’t solely for existing NGOs: the process is absolutely open to submissions from individuals or groups with no prior direct experience of working in the transparency and accountability sector, but who have a good idea that addresses a problem they see in their country. We will, however, look more favourably on applicants with access to the advanced programming skills required to build sites like this.

The criteria are simple, though demanding:

  1. The projects have to generate some kind of meaningful transparency, accountability, or democratic empowerment of another kind.
  2. The projects must seize the unique benefits that the Internet brings with it, such as scalability, two way communication, easy data analysis and so on.

More details are available over at our new CEE site, but even if you don’t live in one of the eligible countries please help us spread the word about this exciting new opportunity!

Fraction of FOI Requests Made via WhatDoTheyKnow.com Increasing Fast

Thursday, October 1st, 2009 by Richard Taylor, volunteer
WhatDoTheyKnow.com Logo

Statistics were recently released on the performance of UK central government departments with respect to their handling of freedom of information requests. The latest figures are for the second quarter of 2009. We have been able to use these to calculate the fraction of all requests which are made via mySociety’s freedom of information website WhatDoTheyKnow.com.

  • 13.1% of all FOI requests to “Departments of State” in the second quarter of 2009 were made via WhatDoTheyKnow.com. In absolute terms this was 753 out of 5769 requests; this is up from 8.5% in the first quarter of 2009.
  • 32.3% of FOI requests to the Home Office (which includes the UKBA and the IPS) were made via WhatDoTheyKnow in the second quarter of 2009. In absolute terms this was 206 out of 638 requests.
  • The latest figures show that in twelve of the UK’s twenty-one Departments of State more than 10% of FOI requests were made via WhatDoTheyKnow.

What these statistics mean is that an ever increasing fraction of the information released in response to freedom of information requests is being archived and made publicly available by WhatDoTheyKnow.com. Hopefully this will reduce the number of duplicate requests being submitted and ensure the information released is made available to the widest possible audience which in-turn should increase the chances it is acted on.

Only forty-three central government bodies have their freedom of information performance monitored centrally. This is a tiny fraction of the three thousand or so bodies currently listed by WhatDoTheyKnow.

Raw Data

Duncan Parkes is our new Core Developer

Tuesday, September 29th, 2009 by Tom Steinberg

Duncan Parkes

We are very happy to announce that Duncan Parkes has joined mySociety, bringing our team of full time core developers up to four.

Duncan is the incredibly prolific author of screen scrapers for the lovely PlanningAlerts.com which he runs with Richard Pope.

He also has a PhD in Mathematics, which I expect you’ll want to read all of here, and is an editor of Open Source programming books with APress. During the vetting process he listed one of the passions of his life as being ‘Unit Testing‘, which, combined with his love of postbox crowdsourcing, made picking him more or less a no brainer.

In the short run we’ve let him loose, under the tutelage of Francis Irving, on the scaling challenges presented by Mapumental – I can’t wait to see what comes out of it.

Freedom of Information Workshop For Republic Activists

Monday, September 21st, 2009 by Richard Taylor, volunteer
WhatDoTheyKnow.com Logo

On Saturday John Cross and Richard Taylor, two volunteers who work on mySociety’s freedom of information website WhatDoTheyKnow.com, gave a workshop on FOI to a meeting of activists from Republic, an organisation which campaigns for an elected head of state in the UK.

mySociety and WhatDoTheyKnow are non-partisan and don’t get involved in campaigning except in specific areas relating to openness and transparency. That said, members of the WhatDoTheyKnow team are be happy to consider invitations from any groups wishing to hold a workshop discussing freedom of information.

Many of those present at Saturday’s event were active campaigners on a wide range of subjects ranging from human rights to fair trade as well as having an interest in constitutional reform. The FOI workshop was oversubscribed with the majority of those present at the event deciding to attend the session. Unlike a previous workshop held at OpenTech where most attendees had made an FOI request themselves prior to the event, at this workshop all but one had not done so.

The Royals and FOI
Given the audience, the status of the royals with respect to FOI was particularly pertinent. The FOI act exempts information if it relates to: “communications with Her Majesty, with other members of the Royal Family or with the Royal Household, or the conferring by the Crown of any honour or dignity”. This exemption does not apply though if it is determined that it is in the public interest for the information to be released. The requirement for this public interest test is under threat as the Prime Minister has been moving to strengthen the restrictions on releasing information related to the Royal family. On the 10th of June 2009 in a speech to Parliament on Constitutional Renewal Gordon Brown said:

…we have considered the need to strengthen protection for particularly sensitive material, and there will be protection of royal family and Cabinet papers as part of strictly limited exemptions.

Following that speech BBC journalist Martin Rosenbaum obtained a statement from the Ministry of Justice clarifying that in practice what Gordon Brown’s words meant was:

… the relevant exemption in the Freedom of Information Act will be made absolute for information relating to communications with the Royal Household that is less than 20 years’ old.

In FOI jargon an “absolute exemption” is one not subject to a public interest test.

Even with the law as it stands it is not easy to obtain information on how the royals are, or are attempting to, influence government. For example John Cross has asked the Ministry of Justice to supply him with copies of correspondence they had received from the Queen and Prince of Wales. They rejected his request on the grounds that the public interest in non-disclosure exceeded the public interested in disclosure; as well as suggesting exemptions relating to “information provided in confidence” and “personal information” also applied.

The Royal Household’s position on FOI
The Royal Household is not subject to the freedom of information act; though it has made a statement on the subject saying:

Despite its exemption from the FOI Acts, the Royal Household’s policy is to provide information as freely as possible in other areas, and to account openly for its use of public money.

WhatDoTheyKnow’s policy is to include such organisations which have indicated they are willing to voluntarily comply with the act to the site. While we list The Royal Household, at the time of writing no-one has yet used the facility to request information.

Using WhatDoTheyKnow for Campaigning
While we stress the importance of keeping freedom of information requests focused, FOI is a powerful tool for campaigners. We were asked if it would be possible for a group like Republic to set up an account on WhatDoTheyKnow for their campaign? The answer to this is: “Yes! – WhatDoTheyKnow wants to encourage groups to use the site”. The information commissioner has confirmed that it is acceptable to use the name of a “corporate body” when making a FOI request, that’s a broad term which encompasses many organisations, groups and charities.

Republic themselves use FOI extensively and often generate major national news stories as a result of responses to their requests. They want to be able to either offer journalists exclusive stories or write a press release based on information released. They can’t do this if the story gets out first via WhatDoTheyKnow so would be interested in an ability to make requests initially in private. mySociety and WhatDoTheyKnow have been considering an option for journalists to be able to make hidden requests via the site. Such a feature could potentially generate an income stream for the site as well as encourage a greater proportion of FOI requests to be made via it. Once the article had been published then the FOI correspondence could be opened up to the public providing access to the source material backing up the story.

As well as meeting those who use, or might want to use, the site to make requests WhatDoTheyKnow also wants to engage positively with public authorities; we see them as important users of our service too. Developer Francis Irving represented the site at the FOI Live conference for information professionals in June and will be speaking at the Freedom of Information Scotland conference in December.

Parliamentary boundary changes

Monday, September 21st, 2009 by Matthew Somerville
Current Birmingham parliamentary boundaries

Current Birmingham parliamentary boundaries

Birmingham parliamentary boundaries at the next election

Birmingham parliamentary boundaries at the next election

Parliamentary boundary changes appear to be a source of confusion to many people and organisations. The facts are quite simple – parliamentary boundary changes, proposed by the various Boundary Commissions, do not take effect until the next general election. Until then, your MP remains whoever they have been, no matter what literature you may get through your letter box, or what anyone may tell you.

As one example, take Birmingham City Council. Their page on constituencies and wards correctly states that Birmingham is divided into eleven parliamentary constituencies, but then goes on to list only ten – they are listing the new constituencies which do not yet exist, as Birmingham is losing one constituency at the next election. It appears that they have organised themselves along the new boundaries in advance – which is fine, but this doesn’t affect current Parliamentary representation, and so they should explain this clearly, as otherwise members of the public get confused (and blame us for giving them the “wrong” MP, when we haven’t done so). As you can see from the maps above (which highlight Birmingham, Hall Green), the constituencies will be changing their boundaries quite a bit, and we have had reports of people receiving letters from candidates in the next election who are MPs of different neighbouring constituencies, simply referring to themselves as an MP, which is a great source of confusion.

St Josephs Avenue, and the Royal Orthopaedic Hospital are currently in Selly Oak, but will be in Northfield

St Josephs Avenue is just below the Royal Orthopaedic Hospital

An inhabitant of St Josephs Avenue, Birmingham (behind the Royal Orthopaedic Hospital), which is currently within the Selly Oak parliamentary constituency (red), and the Northfield ward of Birmingham City Council (green), would, on looking at Birmingham City Council’s website, assume they’re in a parliamentary constituency called Northfield. Northfield is currently the constituency to the west of Selly Oak; at the next election, its boundary with Selly Oak will change to the blue line, at which point St Josephs Avenue will be in the Northfield constituency. But not until then.

Map of Streatham constituency at next election

Map of Streatham constituency at next election

Current Streatham parliamentary boundary

Current Streatham parliamentary boundary

As another example (chosen purely as it has come up in user support), the Labour candidate for Streatham has a page about the constituency – obviously you would expect a candidate to be talking about the future constituency, but would it hurt to add some explanation that Streatham is currently a slightly different shape?

Boundaries of different things are all independent – if a ward boundary moves due to some local issue, the corresponding Parliamentary boundary does not necessarily change with it (probably not, in fact). So when Birmingham changed its ward boundaries back in 2003, they became out of sync with the Parliamentary constituencies. From the next election, things will be more in sync as the new Parliamentary boundaries are based on more recent ward boundaries, but this will again separate over time. All we can do is always clearly explain the current situation, and ask that others do the same.

Nine is the number: The different flavours of transparency website in 2009

Monday, September 14th, 2009 by Tom Steinberg

Image from jaygoldman

Note: This post is a work in progress, I need your help to improve it, especially with knowledge of non-English sites

I was recently in Washington DC catching up with mySociety’s soul-mates at the Sunlight Foundation. As we talked about what was going on in the field of internet-enabled transparency, it came clear to me that there are now more identifiable categories of transparency website than there used to be.

Identifying and categorising these types of site turns out to be surprisingly useful.  First, it can help people ask “Why don’t we have anyone doing that in our country?” Second, it can help mySociety to make sure that when we’re planning ahead we don’t fail to consider certain options that be currently off our radar. Also, it gives me an excuse to tell you about some sites that you may not have seen before.

Anyway, enough preamble. Here they are as I see them – please give me more suggestions as you find them. As you can see there’s a lot more activity in some fields than others.

1. Transparency blogs & newspapers – At the technically simplest, but most manual labour-intensive end of the scale is sites, commercial and volunteer driven, whose owners use transparency to help them to write stories. Given almost every political blog does this a bit, it can be hard to name specific examples, but I will note that Heather Brooke is the UK’s pre-eminent FOI-toting journalist/blogger, and we’ve just opened a blog for our awesome volunteers on WhatDoTheyKnow to show their FOI skills to an as-yet unsuspecting public.

2. What Politicians do in their parliaments – These sites primarily include lists of politicians, and information about their primary activities in their assemblies, such as voting or speaking. This encompasses mySociety’s TheyWorkForYou.com, Rob McKinnon’s one man labour of love TheyWorkForYou.co.nz, Italy’s uber-deep OpenPolis.it (6 layers of government, anyone?), Germany’s almost-un-typable Abgeordnetenwatch,  Romania’s writ-wielding IPP.ro, Josh Tauberer’sGovTrack.us, plus the bonny bouncing babies OpenAustralia and Kildare Street (Ireland). Of special note here are Mzalendo (Kenya) who unlike everyone else, can’t reply on access to a parliamentary website to scrape raw data from, and Julian Todd’s UNDemocracy (International), that has to fight incredible technical barriers to get the information out.

3. Databases of questions and answers posed to politicians – These sites let people post politicians questions, and the publish the questions and answers. The Germans running Abgeordnetenwatch (Parliament Watch) seem to have had considerable success here, with newspapers citing what politicians say on their site. Yoosk has some politicians in the UK on it, too.

4. Money in politics – This comes in two forms, money given to candidates (MAPlight), and money bunged by politicians to their favourite causes (Earmark watch). In the UK, as far as I know, the Electoral Commission’s database remains currently unscraped, perhaps because the data is so ungranular.

5. Government spending – where the big money goes. In the US the dominant site is FedSpending.org, and in the UK we have ukpublicspending.co.uk.

6. Websites containing bills going through parliament, or the law as voted on – This includes the increasingly substantial OpenCongress in the US which saw major traffic during the Health Care debates, and the UK government’s own Acts database and  Statute Law Database. Much of the legal database field, however, remains essentially private.

7. Services that create transparency as a side effect of delivering services – Our own sites lead the way here: FixMyStreet’s public problem reports and WhatDoTheyKnow’s FOI archive are both created by people who aren’t primarily using the site to enrich it – they’re using it to get some other service.

8. Election websites – These come in many forms, but what they have in common is their desire to shed light on the positions and histories of candidates, whether incumbents or new comers. The biggest beast here is Stemwijzer (Netherlands), probably in relative terms the most used transparency or democracy site ever. However these sites are popular in several places,  the big but highly labour intensive VoteSmart (US), Smartvote.ch (Switzerland), plus others.  mySociety is shortly to start to recruit constituency volunteers to help with our take on this problem, keep an eye on this blog if you want to know more.

9. Political document archives - This is a new category, now occupied by Sunlight’s Partytime archive for invitation to political events, and TheStraightChoice, Julian Todd and Richard Pope’s wonderful new initiative for archiving election leaflets and other paper propoganda.

10. Bulk data - Online transparency pioneer Carl Malamud doesn’t do sites, he does data. Big globs zipped up and made publicly available for coders and researchers to download and process. The US government has now stepped into this field itself with Data.gov, doubtless soon to be followed by data.gov.uk.

——

Please don’t shoot me if I’ve missed anything here, the world is a big place. But I thought that was a useful and interesting exercise, and I hope you’ll both find it useful, and help me improve it too. Comment away.

Engaging constituents – you’re doing it wrong!

Thursday, September 3rd, 2009 by Tim Morley

In an earlier post, I compared one of mySociety’s sites to another with very similar functionality which had been commissioned by a group of councils, and concluded that mySociety were living up to their aim of “showing the public sector how to use the internet most efficiently to improve lives”.

This week, Paul Clark MP (Gillingham, also Minister for Transport) announced, on Twitter no less, that he was working on “[his] version of FixMyStreet”, and requested feedback about the site.

Tweet by Paul Clark MP about his new website LetsGetItSorted.com

There are numerous things here to be applauded, not least that an MP is using several new media channels to engage in conversation with his constituents. However, the same question as before comes to mind – is this site going to do anything new, or anything better, than the mySociety site that it replicates?

Perhaps it will target a wider range of reports than FixMyStreet; perhaps users will feel more comfortable using the familiar Google Maps, if that’s what the developers plump for; time will tell.

FixMyStreet.comFor what it’s worth, I can’t escape the feeling that a prominent link to FixMyStreet – like the one to the left – would fulfill the needs of both the provider and the users of PaulClarkMP.co.uk, and would take a tiny fraction of the time to implement, but I look forward to being proved wrong.

Still, at least Mr Clark cites FixMyStreet as the example he’s trying to emulate, rather than Medway Council’s own website. Here’s their form for reporting graffiti. Brace yourself, it’s not pretty.

mySociety Call for Proposals 2009

Thursday, August 6th, 2009 by Tom Steinberg

Go straight to the 2009 Call for Proposals

Do you have a ‘mySocietyish’ idea that you’d like to see become reality? Is there something radical about the sites we already run that should change? Do you have any smart ideas about helping more people to benefit from the services we already offer? Or would you just like to read and comment on ideas submitted by other people?

If the answer to any of these questions is yes, then we’d like you to submit your idea to our 2009 Call for Proposals (built for us by Richard Pope). We’ve run these twice before in 2003 and 2006, resulting in the launch and success of sites such as WriteToThem and WhatDoTheyKnow.

Just as on previous occasions we’ll pick a winner and some runners up, but also just as before we can only promise to do our best – we don’t have the resources to solemnly promise to build the winner, whatever it might be.

What We’re Looking For (or, an insight into the mySociety mindset)

The characteristics of the winning and runner up ideas are highly likely to include one or more of the following factors. Don’t try and include all of them, that’d be silly :)

  1. They have to involve the Internet. We don’t do clay modelling.
  2. They will capitalise on one or more things that the Internet does really well, better than offline or other forms. WhatDoTheyKnow, for example, seizes on the fact that email can be simultaneously published and rerouted – a simple but critical insight.
  3. They will either be a whole new website idea, or a smart and impactful modification of something we already do.
  4. They will be ideas that have clear social, civic or democratic benefits that are really easy to explain to the least political person you know, even if the technology behind them is fiendishly complicated.
  5. They will have some characteristic that will widely spread the word that the service exists, or that other mySociety services exist.
  6. They will offer brilliant value for money, even if they’re expensive to build in the first instance.
  7. They will be genuinely new ideas
  8. They won’t contain the phrase ’social media’

We might well change these guidelines a bit as the first responses come in. The call will stay open until September 15th, and we’ll hope to announce the winners in early October.

So what are you waiting for – check out the 2009 Call for Proposals

RIP Angie Martin 1974-2009

Monday, July 20th, 2009 by Tom Steinberg

It is with overwhelming sadness that I write to tell our community that Angie Martin, mySociety’s fourth core developer, has died. She was taken from us by the cancer that she had been fighting since soon after we hired her less than two years ago.

Possessed of an almost unbelievably upbeat personality, Angie brought not only her formidable Perl skills, but her blazing warmth of character to our team. In remission during our yearly retreat in January this year, she combined laughter with a typically tough line of questioning on ideas she thought insufficiently robust. With typical disgregard for cool, her CV noted that she was “known to enjoy wrangling regular expressions on a Sunday Morning”. She didn’t see any contradiction between being a successful woman and a geek, throwing herself wholeheartedly into the Mac-toting, perlmonger ethos. She even brought her husband Tommy with her, who became a significant volunteer.

Given her habit of plain speaking, it is pointless to pretend that Angie was able to make the contribution to mySociety’s users or codebase that she wanted to. What she achieved in terms of difficult coding during recovery from chemotherapy was incredible, breathtaking – but she wanted to change the world. It now falls to the rest of us, and our supporters, to live up to the expectations she embodied, to continue to push every day, using skills like those that she had to help people with everyday problems. We now have to ask ‘What would Angie do?’, as well as ‘What would Chris do?’. It is a lot to live up to.

She was a mySociety core developer: I hope that meant as much to her as it meant for me to have her as one of my coders.  Remember and Respect.

Updated: Angie changed her surname upon getting married, a couple of months ago. I have just read she wanted to be remembered as Angie Martin, and so I have made that change. Read this tribute on the Lasso list.

Updated 21 7 2009: Tommy has just told me that those wishing to may memorial donations should send them to Hospice at Home.

What percentage of FOI requests are made using WhatDoTheyKnow?

Thursday, July 16th, 2009 by Francis Irving

The volunteer team behind our Freedom of Information (FOI) site
WhatDoTheyKnow.com
, has used statistics released by the Ministry of Justice to discover the proportion of all FOI requests being made via the site.

They found that in the first quarter of 2009, 8.5% of all requests made to central government departments were made using WhatDoTheyKnow. In absolute terms that was 514 of 6019 requests.

The breakdown by department is given in the below table. Notably, one in five FOI requests to the Home Office (122 of 643) were made via WhatDoTheyKnow.

Department Total FOI Requests Requests Via WDTK WDTK Share
Home Office 643 122 19.0%
Department for Children, Schools and Families 217 27 12.4%
Department for Environment, Food and Rural Affairs 131 16 12.2%
Department of Health 423 40 9.5%
Ministry of Defence 758 70 9.2%
Foreign and Commonwealth Office 281 25 8.9%
Communities and Local Government 204 18 8.8%
Cabinet Office 274 23 8.4%
Department for Transport 586 41 7.0%
Department for Work and Pensions 533 34 6.4%
HM Treasury 446 27 6.1%
Department for Business, Enterprise and Regulatory Reform 216 12 5.6%
Department of Energy and Climate Change 55 3 5.5%
Department for Innovation, Universities and Skills 74 4 5.4%
Attorney General’s Office 19 1 5.3%
Ministry of Justice 757 38 5.0%
Department for International Development 80 4 5.0%
Scotland Office 58 2 3.4%
Department for Culture, Media and Sport 176 6 3.4%
Northern Ireland Office 65 1 1.5%
Export Credits Guarantee Department 9 0 0.0%
Wales Office 14 0 0.0%
Q1 2009 Totals 6019 514 8.5%

WDTK = WhatDoTheyKnow; Source for total FOI request statistics : Statistics for Q1 2009 (released on the 25th of June 2009); Extended table covering all monitored bodies available.

The Ministry of Justice only monitors, and provides statistics on, 44 bodies’ compliance with the Freedom of Information Act; WhatDoTheyKnow currently lists 2910. We cover a wide range of local bodies including Primary Care Trusts, Local Councils and the Police. There is no national monitoring of how many FOI requests are made to such bodies, or how well they perform when responding to requests.

If you want to see such performance statistics, please help categorise more of the responses made via the site. It can be quite addictive!

Thanks to Richard Taylor for doing this research – see his blog post for some more details, including some information about Scotland.

TheyWorkForYou back to 1935

Tuesday, July 14th, 2009 by Matthew Somerville
Hansards Parliamentary Debates by hugovk (cc)

Hansard's Parliamentary Debates by hugovk (cc)

The House of Commons debate coverage on TheyWorkForYou has recently extended back from the 2001 general election to the 1935 general election, and our knowledge of MPs now extends back to the start of the 19th century. This means TheyWorkForYou now includes things such as Anthony Eden on the Suez Canal in 1956, saying “there was not foreknowledge that Israel would attack Egypt“; the debate the day after Bloody Sunday in 1972; Geoffrey Howe’s resignation statement in 1990; Neville Chamberlain on the eve and start of the second World War in 1939; and Winston Churchill’s speeches to the House, such as We shall fight on the beaches and This was their finest hour in 1940. This and much, much more are available and searchable using our new improved advanced search, which allows you to filter by e.g. date range or person. We hope people enjoy researching this huge wealth of information (I certainly do), and add useful annotations to the text to help other people.

This would not have been possible without the original project by Parliament to digitise historical copies of Hansard and make them available, nor the internal Parliamentary project to clean up the data, match up speaker names, and so on. The project was kindly funded by the Ministry of Justice’s Innovation Fund, which also supported the creation of FixMyStreet and GroupsNearYou.

TheyWorkForYou nothing to do with this sacked civil servant story

Monday, July 6th, 2009 by Matthew Somerville

Update: The Telegraph posted a retraction yesterday.

You may have seen coverage on various websites saying that a civil servant was sacked after posting a comment on TheyWorkForYou.

We’ve no idea what this story is about, but we’re pretty certain it has nothing whatsoever to do with TheyWorkForYou. No journalist bothered to contact us before running the story.

  • There is no comment on TheyWorkForYou containing the text quoted in that article, nor anything like it, nor has there ever been. Nor in fact (as we’ve checked), on HearFromYourMP, WriteToThem, or WhatDoTheyKnow.
  • Only one comment has been left on any contribution by Hazel Blears in 2009, and it’s definitely not related to this.
  • 27 comments were left on 13th May, the date the comment was apparently posted; we’ve read them all and they’re all nothing to do with this.

So frankly, we’ve no idea what’s going on.

What we do know is that the implication that mySociety would merrily hand over sensitive personal data that ends up in getting someone sacked, without fighting tooth and nail for their privacy every inch of the way, is a complete misinterpretation of the way we work and the things we hold most dear. No-one has ever contacted us to ask us to hand over such data, nor have we ever done so.

We think what might have happened is a simple mis-remembering of the website that contained the problematic comment. We’re hoping to get in touch with Lisa Greenwood so we can get full details before asking the various media companies that have run with this for a correction.

TheyWorkForYou Redesign

Friday, July 3rd, 2009 by Tom Steinberg

Richard Pope has been redesigning mySociety’s biggest site TheyWorkForYou.com for a couple of months.

He’s done a heroic job, as has Matthew with his epic import of Hansard data from 1935 onwards.  TheyWorkForYou is a much better site for their combined work recently. We’ll be writing more on the historic stuff soon.

There are a few things I’d like from you as a member of the mySociety community:

1. Please say a big thanks to Richard. This was not an easy or relaxing task at all, and he’s done it brilliantly. Just check a Lords debate to see the attention to detail. We are a very lucky organisation to have him, as he’s always in demand.

2. Please give some constructive criticism on how it could be even better (please note, focussing on design here, we already have a load of feature priorities to deliver).

3. Anyone who could help supply a redesigned logo, or some nicely processed parliamentary-themed artwork to sit in the background grey-boxes on the homepage would be doing a very Good Deed for mySociety.

And lastly, please do pledge to become a TheyWorkForYou Patron, so we can keep doing things like this in the future!

Speaker Election Day: Who’s in and who’s out

Monday, June 22nd, 2009 by Tom Steinberg

As the decisive voting day dawns, mySociety has eight full or partial endorsements of our 3 Principles from possible candidates for Speaker of the Commons. We hope you take a look at what they said in full on their TheyWorkForYou pages. Just five possible candidates didn’t reply in writing, or at all – those absentees being Patrick Cormack, Sylvia Heal, Margaret Beckett, Parmijit Dhanda and Ann Widdecombe (who did phone, but doesn’t seem to have followed up with email). Interestingly, the five non-respondants included both candidates whose offices don’t accept email (Beckett and Cormack).

The last time MPs voted for a speaker, the one candidate who didn’t show at the hustings went on to win. Let’s hope MPs learned the lesson of voting for a candidate who isn’t willing to stand up and be counted when it comes to the issues that make their job so critical…

Say hello to Mapumental

Monday, June 1st, 2009 by Tom Steinberg

We’ve been hinting for a while about a secret project that we’re working on, and today I’m pleased to be able to take the wraps off Mapumental. It’s currently in Private Beta but invites are starting to flow out.

Built with support from Channel 4’s 4IP programme, Mapumental is the culmination of an ambition mySociety has had for some time – to take the nation’s bus, train, tram, tube and boat timetables and turn them into a service that does vastly more than imagined by traditional journey planners.

In its first iteration it’s specially tuned to help you work out where else you might live if you want an easy commute to work.

Francis Irving, the genius who made it all work, will post on the immense technical challenge overcome, soon. My thanks go massively to him; to Stamen, for their lovely UI, and to Matthew, for being brilliant as always.

Words don’t really do Mapumental justice, so please just watch the video :) Update: Now available here in HD too

Also new: We’ve just set up a TheyWorkForYou Patrons pledge to help support the growth and improvement of that site. I can neither confirm nor deny that pledgees might get invites more quickly than otherwise ;)

3 Principles we are asking Speaker candidates to endorse: You can help right now

Thursday, May 21st, 2009 by Tom Steinberg
Speakers Chair (Parliamentary Copyright)
Speaker’s Chair (Parliamentary Copyright)

mySociety has today emailed (and in one case, posted) a set of 3 Principles which we believe it is important that all candidates for Speaker endorse, before the election of a new Speaker by MPs.

1. Voters have the right to know in detail about the money that is spent to support MPs and run Parliament, and in similar detail how the decisions to spend that money are settled upon.

2. Bills being considered must be published online in a much better way than they are now, as the Free Our Bills campaign has been suggesting for some time.

3. The Internet is not a threat to a renewal in our democracy, it is one of its best hopes. Parliament should appoint a senior officer with direct working experience of the power of the Internet who reports directly to the Speaker, and who will help Parliament adapt to a new era of transparency and effectiveness.

We will be posting the status of requests on the likely candidates web pages where we expect large numbers of people to see them before the vote in late June. We have also taken the unusual step of allowing possible candidates to leave a statement of up to 150 words on the principles.

(NB no candidates have actually declared at this stage, so we are starting with the BBC’s list of possibles)

Rationale

mySociety helped lead the campaign back in January to prevent the last ditch attempts to conceal MPs’ expenses. We did so not because, like the newspapers, we wanted to revel in embarrassment and scandal, but because we believe that in the Internet age, the only way for our democracy and government to thrive is if they are open and connected to the net as the rest of us expect them to be. The dramatic events seen in Parliament in recent days vindicate the view that secrecy breeds poor policies and seeds untrustworthy behaviour in the weaker willed.

Furthermore, more than a simple attitude of openness is required of the new Speaker: the public needs a genuine will to push for technological reform using the power of the Internet that will take both open-mindedness and a willing to tread on toes, especially in some parts of the unelected establishment.

Case in point: Over the last two years we have been trying to persuade Parliament to acknowledge that the way it publishes its Bills online is hopelessly inadequate for the Internet age. The campaign has faltered, despite multi partly endorsement from 140 MPs and a campaign membership of thousands. To see why, just take a look at this colourful and error-crammed internal email that we uncovered using the Freedom of Information Act, published for the first time today.

The new Speaker will have a tough job on their hands to overcome resistance of this kind. The best thing we can do is help the new Speaker, whoever they are, assume their new job with a clear mandate from the public, as well as from members.

Act!

That is why, as a final part of this call, we are asking you, our community, to write to your MP today to let them know that you expect them to vote for a candidate that has endorsed the principles above. Your voices to your own constituency MPs can resonate in a way that no blog post or newspaper article ever can. Go to it.


News & information:
Projects:
Contact & information:
Technical:

mySociety is a project of UK Citizens Online Democracy (UKCOD). UKCOD is a registered charity in England and Wales, no. 1076346.