FixMyTransport probably wouldn't have helped Mr Robinson (who survived)

I must admit that I’m pretty happy to announce mySociety’s  plans to build our first major new non-comercial website since WhatDoTheyKnow.com launched in 2008. Late in 2010 we plan to launch FixMyTransport , a site focussed on connecting and empowering people who share transport problems of different kinds. The fantabulous Louise Crow will be lead developer.

Crucially, we at mySociety are under no illusions that it is an order of magnitude more difficult to get a new ticket machine in your station than it is to get your local council to fill a pothole (FixMyStreet surveys report 2371 problems fixed in the last month alone). The difficulty of achieving even minor changes to transport services and infrastructure is why we are simultaneously announcing our plan to build FixMyTransport on top of a major new back end system called Project Fosbury.

Project Fosbury is about helping people get over difficult obstacles.  It is a modular platform for breaking down a complicated civic task into pieces which can then be allocated to one or more people. So someone asking their council to change the timing on some traffic lights might be allocated the tasks of:

• Writing to their councillors
• Obtaining local policy on traffic light timings from the council
• Getting people to join a mini-campaign group
• Videoing the problem
• Sending a letter to a local newspaper

Each task will ultimately be carried out entirely within a joined up infrastructure, each module being built to mySociety’s habitually stringent rule that “it must be easy and satisfying to someone who’s never engaged politically before”. We will work to create incentive structures, peer pressure, and hopefully a sense of fun. There will be a single public home page for each mini campaign, showing recent activities on the site, as well as integrating with external social media.  We hope to repeat the FixMyStreet phenomena where some  ‘insoluble’ problems suddenly become soluble once they’re in the public domain.

Now for the credit where it is due. mySociety’s sysadmin Keith Garrett suggested FixMyTransport back in January 2008.

The actual mechanics of breaking the problem into pieces (the idea that became Project Fosbury) came from a wide discussion at our retreat, with excellent suggestions coming particularly from Richard Pope. But the more general idea that the Internet hasn’t yet produced a really good system for bringing people together to solve everyday problems (as opposed to chat, or win the US presidency) came from numerous Call for Proposals submissions, including ones from Mark W, Rob Shorrock, Peter Silverman, Mahmood Choudhury and more.

mySociety will be building this site using money donated by people like you, profits from commercial projects, and any specific funding we can raise around it. If you know of anyone or any organisation that you think might like to support FixMyTransport or Project Fosbury, please do get in touch.

Peter Collingbourne got fed up with this, and luckily for us, he can code too. He forked our source code repository, and made a nice patch in his own copy of it.

He then told us about it, and I merged his changes into the main WhatDoTheyKnow code, tested them out on my laptop, then made them live. It all work perfectly first time. Peter even added the new dependency on vpim to WhatDoTheyKnow conf/packages.

Now if you go to an Outlook attachment on WhatDoTheyKnow,
such as this one you’ll just see the files, and be able to download them, and view them as HTML as normal. They’ll also get indexed by the search (although I need to do a rebuild for that for it to work with old requests).

Thanks Peter!

If you want to have a go making an improvement to a mySociety site, you can get the code for most of them from our github repositories. For some sites, there’s an INSTALL.txt file explaining how to get a development environment set up. Let us know if you do anything – even incremental improvements to installation instructions are really useful. And new, useful, features like Peter’s are even more so.

The defintions of the boundaries for the forthcoming constituencies in England were originally published in The Parliamentary Constituencies (England) Order 2007 (SI 2007/1681), based on ward boundaries as they were on 12th April 2005. However, due to some local government changes since that date, The Parliamentary Constituencies (England) (Amendment) Order 2009 (SI 2009/698) was published changing the boundaries for four constituencies – Daventry, South Northamptonshire, Wells, and Somerton & Frome – to be based on the new council wards as they were on 3rd May 2007.

The forthcoming constituencies in Northern Ireland were defined in The Parliamentary Constituencies (Northern Ireland) Order 2008 (SI 2008/1486). In this, Derryaghy ward was split between two constituencies – Belfast West is given “that part of Derryaghy ward lying to the north of the Derryaghy and Lagmore townland boundary.”

All of which means that other sites that try to tell you what constituency you will be in at the election invariably get it wrong.

Both Labour and the Conservatives say that BA6 8NJ is in Wells at the next election, when it will be in Somerton & Frome. Both say that NN12 8NF will be in Daventry, when it will be in South Northamptonshire. I assume that both sites are using boundary data predating the Amendment Order from March 2009. The Conservatives also say that BT17 0XD will be in Lagan Valley when it will be in Belfast West; Labour simply say “Northern Ireland” for any Northern Irish postcode you provide.

The Liberal Democrats site currently returns no results for any postcode, which I assume is a bug :)

The /current/ boundary between Belfast West and Lagan Valley. (Image produced from the Ordnance Survey electionmap service. Image reproduced with permission of Ordnance Survey and Land and Property Services)

The official election-maps.co.uk service (from where TheyWorkForYou gets its boundary maps) returns the correct results for BA6 8NJ and NN12 8NF, but doesn’t have future boundaries for Northern Ireland. It’s not clear that it doesn’t, as searching for Lagan Valley with “future boundaries” selected returns a result, but that result is the current boundary. This can be seen from the picture on the right – as is clear from the quote I gave above, everything within Derryaghy ward north of the Lagmore/Derryaghy boundary will be in Belfast West at the next election. Plus the site doesn’t work without JavaScript.

TheyWorkForYou’s “constituency at the next election” service gives BA6 8NJ in Somerton & Frome, NN12 8NF in South Northamptonshire, and BT17 0XD in Belfast West. There is enough confusion with the changes to boundaries for everywhere except Scotland, that it is somewhat frustrating to have it compounded by sites giving incorrect information. The lack of any official service also doesn’t help.

Constituency boundaries are changing at the next general election in England, Wales, and Northern Ireland. After some amount of fiddling (I’ll go into technical details in another post, but it wasn’t as easy as just importing some shapefiles), as a slightly early Christmas present, TheyWorkForYou now has a section where you can enter your postcode to find out what constituency you are currently in, and what constituency you will be voting in at the election, along with maps of before and after:

http://www.theyworkforyou.com/boundaries/

This service is also available through the TheyWorkForYou API. This is a facility we have been asked for frequently, more so as we approach the forthcoming election; the large amount of boundary changes have led to confusion from our users and elsewhere, so this will hopefully prove useful.

One site that will need the boundaries before the election is DemocracyClub – join to help make this coming election the most transparent ever!

Side effects of the above process include updated council boundaries, so those councils on WriteToThem that we’ve had switched off since May due to lack of boundary data are now back; a more up-to-date postcode dataset; and the beginnings of parish council support (as in they’re now in the database, but the front-end doesn’t know what to do with them yet).

I hope you all have a happy Christmas and New Year.

Wednesday 20th January, in Manchester; mySociety, Democracy Club, and friends invite you to join us in the Briton’s Protection from 7:30 for conversation on democracy, engagement and tea.

mySociety runs projects such as TheyWorkForYou.com,FixMyStreet.com and WhatDoTheyKnow.com, while DemocracyClub.co.uk is the new independent volunteer network for the upcoming election to keep track of how parties campaign in your local community when they think no one elsewhere will notice.

Come join us in the pub (20th Jan, 7:30), or you can sign up to Democracy Club at                            http://www.democracyClub.co.uk

The Briton’s Protection is just behind the Bridgewater Hall, postcode M1 5LE. You’ll find us in one of the two backrooms, wearing a mySociety hoodie or carrying a clear sign. Tom has his picture here: http://www.mysociety.org/about/

A Facebook event is now open.

A chunk of the weekend involved vetting the 227 project ideas that were proposed via our Call for Proposals. I’m going to write a separate post on our thoughts about that process, but if you look at the list below you may spot things that were submitted in that call.

One nice innovation that helped us whittle down our ideas from unmanageable to manageable numbers was a pairwise comparison game to help us prioritise ideas, build custom for the occasion by the wonderful and statistically talented Mark Longair.  In other words, we used the technique that powers  KittenWar.com to help decide our key strategic priorities for the next year: after all , if we don’t, who will?

Screenshot from the pairwise comparison game that Mark Longair coded

By the end of the weekend we had not battened everything down – there are too many uncertainties around how much time we will have, and some key ideas that need more speccing.  However, we were able to put various things into different buckets, marked according to size and degree of certainty.  So here goes:

1. Things which were decided at the last retreat, which we are definitely building,  and which (mostly) need doing before next year’s stuff starts getting built

• A top level page for each bill on TheyWorkForYou
• Future business (ie the calendar) for events in the House of Commons, including a full set of alerting options.
• Video clips on MP pages on TheyWorkForYou
• Epicly ambitious election data gathering and  quiz building with the lovely volunteers at DemocracyClub

2. Small new things that we are very probably doing because there was lots of consensus

• Publish a standard that councils can use to post problems like potholes in their databases to FixMyStreet and other similiar sites.
• Template requests in WhatDoTheyKnow so that users are strongly encouraged to put in requests that are well structured.
• After the next general election, email new MPs with various bits of info of interest to them including their new login to HearFromYourMP, their page on TheyWorkForYou, explanation of how WriteToThem protects them from spam and abuse, a double check that their contact details are correct, and a introduction to the fact that we record their correspondance responsiveness and voting records.
• Add to WhatDoTheyKnow descriptions about what kind of public authority a specific entity is (ie ’school’, ‘council’) and the information they are likely to hold if FOIed.
• Show divisions (parliamentary votes) properly on debate pages on TheyWorkForYou, ie show the results of a vote on the same page as the debate where the issue was discussed, with full party breakdowns on each division.
• Add “How to benefit from this site” page on TheyWorkForYou, inspired by OpenCongress.org
• Help Google index TheyWorkForYou faster by creating a sitemap.xml file that is dynamically updated.
• Using the data we expect to have from DemocracyClub’s volunteers, send a press release about every new MP and to all relevent local newspapers
• Incorporate a council GeoRSS problem feed into FMS

3. Slighty more time consuming things we are very probably doing because there was lots of consensus

• 1 day per month developer time that customer support guru Debbie Kerr gets to allocate as she see fit.
• Premium account feature on WhatDoTheyKnow to hide requests so that journalists and bloggers can still get scoops and then share their correspondance later.
• Add Select Committees to TheyWorkForYou, including email alerts on calls for evidence.
• Take professional advice on how to handle PR around the election

4. Much more time consuming things and things around which there is less consensus. NB – We do not currently have the resources to do everything on this list next year – it is an ambitious target list.

• Primary New site: TBA in a new post
• Add a new queue feature to WhatDoTheyKnow so that users can write requests, then table them for comments from other users and expert volunteers before they are sent to the public authority
• Relaunch our Volunteer tasks page on our sites, keep it populated with new tasks, specifically allocate resources to handhold potential volunteers. Allocate time to see if any of the ideas that we didn’t build could be parcelled into volunteer tasks.
• Secondary New site (if we have a lot more time than we expect): Exploit extraordinary richness of Audit Comission local government target data in a TheyWorkForYou-like fashion.
• FixMyStreet to become international with  a) maps for most of the world b)  easy to follow instructions explaining how to supply mySociety with the required data to us to enable us to turn on FixMyStreet in non UK countries or areas. This data would includ  ie gettext powered text translation files,  shapefiles of administrative boundaries, and lists of contact data.
• Add votes and proceedings to TheyWorkForYou (where they reveal statutory instrument titles that are not debated but where the law gets changed anyway)
• Carry out usability testing on TheyWorkForYou with then help of volunteer Joe Lanman – then implement changes recommended during a development process taking up to 10 days.
• Add to TheyWorkForYou questions that have been tabled in the house of commons but which haven’t been answered yet.
• Add a new interface for just councils so that they can say if a problem on FixMyStreet has changed status.

Phew. And that’s not even counting the projects we hope to help with in Central and Eastern Europe, our substantial commercial work, or the primary new site idea, which will be blogged in Part 2.

derived from http://commons.wikimedia.org/wiki/File:Eastern-Europe-map2.svg

If you live in Central or Eastern Europe, we’re now in a position to help you get effective democracy and transparency websites built. mySociety have teamed up with the Open Society Institute (OSI) and together we are now looking for determined people with great ideas for new digital transparency and accountability services in their countries.

Over the next few months we are running a Call for Proposals, similar to the one we recently ran in the UK. The big difference is that this time we’re not looking for projects that we will build. We’re looking for projects you want to build, but that for lack of funds or lack of the right skills, you can’t get started yourself.

Each month the Open Society Institute and mySociety will work closely together to select a series of projects to fund and mentor. Crucially, the call isn’t solely for existing NGOs: the process is absolutely open to submissions from individuals or groups with no prior direct experience of working in the transparency and accountability sector, but who have a good idea that addresses a problem they see in their country. We will, however, look more favourably on applicants with access to the advanced programming skills required to build sites like this.

The criteria are simple, though demanding:

1. The projects have to generate some kind of meaningful transparency, accountability, or democratic empowerment of another kind.
2. The projects must seize the unique benefits that the Internet brings with it, such as scalability, two way communication, easy data analysis and so on.

More details are available over at our new CEE site, but even if you don’t live in one of the eligible countries please help us spread the word about this exciting new opportunity!

Statistics were recently released on the performance of UK central government departments with respect to their handling of freedom of information requests. The latest figures are for the second quarter of 2009. We have been able to use these to calculate the fraction of all requests which are made via mySociety’s freedom of information website WhatDoTheyKnow.com.

• 13.1% of all FOI requests to “Departments of State” in the second quarter of 2009 were made via WhatDoTheyKnow.com. In absolute terms this was 753 out of 5769 requests; this is up from 8.5% in the first quarter of 2009.
• 32.3% of FOI requests to the Home Office (which includes the UKBA and the IPS) were made via WhatDoTheyKnow in the second quarter of 2009. In absolute terms this was 206 out of 638 requests.
• The latest figures show that in twelve of the UK’s twenty-one Departments of State more than 10% of FOI requests were made via WhatDoTheyKnow.

What these statistics mean is that an ever increasing fraction of the information released in response to freedom of information requests is being archived and made publicly available by WhatDoTheyKnow.com. Hopefully this will reduce the number of duplicate requests being submitted and ensure the information released is made available to the widest possible audience which in-turn should increase the chances it is acted on.

Only forty-three central government bodies have their freedom of information performance monitored centrally. This is a tiny fraction of the three thousand or so bodies currently listed by WhatDoTheyKnow.

Raw Data

• Freedom of Information Act: statistics on implementation in central government – UK Ministry of Justice
• Detailed statistics on WhatDoTheyKnow’s share of requests on a per department basis.

We are very happy to announce that Duncan Parkes has joined mySociety, bringing our team of full time core developers up to four.

Duncan is the incredibly prolific author of screen scrapers for the lovely PlanningAlerts.com which he runs with Richard Pope.

He also has a PhD in Mathematics, which I expect you’ll want to read all of here, and is an editor of Open Source programming books with APress. During the vetting process he listed one of the passions of his life as being ‘Unit Testing‘, which, combined with his love of postbox crowdsourcing, made picking him more or less a no brainer.

In the short run we’ve let him loose, under the tutelage of Francis Irving, on the scaling challenges presented by Mapumental – I can’t wait to see what comes out of it.

On Saturday John Cross and Richard Taylor, two volunteers who work on mySociety’s freedom of information website WhatDoTheyKnow.com, gave a workshop on FOI to a meeting of activists from Republic, an organisation which campaigns for an elected head of state in the UK.

mySociety and WhatDoTheyKnow are non-partisan and don’t get involved in campaigning except in specific areas relating to openness and transparency. That said, members of the WhatDoTheyKnow team are be happy to consider invitations from any groups wishing to hold a workshop discussing freedom of information.

Many of those present at Saturday’s event were active campaigners on a wide range of subjects ranging from human rights to fair trade as well as having an interest in constitutional reform. The FOI workshop was oversubscribed with the majority of those present at the event deciding to attend the session. Unlike a previous workshop held at OpenTech where most attendees had made an FOI request themselves prior to the event, at this workshop all but one had not done so.

The Royals and FOI
Given the audience, the status of the royals with respect to FOI was particularly pertinent. The FOI act exempts information if it relates to: “communications with Her Majesty, with other members of the Royal Family or with the Royal Household, or the conferring by the Crown of any honour or dignity”. This exemption does not apply though if it is determined that it is in the public interest for the information to be released. The requirement for this public interest test is under threat as the Prime Minister has been moving to strengthen the restrictions on releasing information related to the Royal family. On the 10th of June 2009 in a speech to Parliament on Constitutional Renewal Gordon Brown said:

…we have considered the need to strengthen protection for particularly sensitive material, and there will be protection of royal family and Cabinet papers as part of strictly limited exemptions.

Following that speech BBC journalist Martin Rosenbaum obtained a statement from the Ministry of Justice clarifying that in practice what Gordon Brown’s words meant was:

… the relevant exemption in the Freedom of Information Act will be made absolute for information relating to communications with the Royal Household that is less than 20 years’ old.

In FOI jargon an “absolute exemption” is one not subject to a public interest test.

Even with the law as it stands it is not easy to obtain information on how the royals are, or are attempting to, influence government. For example John Cross has asked the Ministry of Justice to supply him with copies of correspondence they had received from the Queen and Prince of Wales. They rejected his request on the grounds that the public interest in non-disclosure exceeded the public interested in disclosure; as well as suggesting exemptions relating to “information provided in confidence” and “personal information” also applied.

The Royal Household’s position on FOI
The Royal Household is not subject to the freedom of information act; though it has made a statement on the subject saying:

Despite its exemption from the FOI Acts, the Royal Household’s policy is to provide information as freely as possible in other areas, and to account openly for its use of public money.

WhatDoTheyKnow’s policy is to include such organisations which have indicated they are willing to voluntarily comply with the act to the site. While we list The Royal Household, at the time of writing no-one has yet used the facility to request information.

Using WhatDoTheyKnow for Campaigning
While we stress the importance of keeping freedom of information requests focused, FOI is a powerful tool for campaigners. We were asked if it would be possible for a group like Republic to set up an account on WhatDoTheyKnow for their campaign? The answer to this is: “Yes! – WhatDoTheyKnow wants to encourage groups to use the site”. The information commissioner has confirmed that it is acceptable to use the name of a “corporate body” when making a FOI request, that’s a broad term which encompasses many organisations, groups and charities.

Republic themselves use FOI extensively and often generate major national news stories as a result of responses to their requests. They want to be able to either offer journalists exclusive stories or write a press release based on information released. They can’t do this if the story gets out first via WhatDoTheyKnow so would be interested in an ability to make requests initially in private. mySociety and WhatDoTheyKnow have been considering an option for journalists to be able to make hidden requests via the site. Such a feature could potentially generate an income stream for the site as well as encourage a greater proportion of FOI requests to be made via it. Once the article had been published then the FOI correspondence could be opened up to the public providing access to the source material backing up the story.

As well as meeting those who use, or might want to use, the site to make requests WhatDoTheyKnow also wants to engage positively with public authorities; we see them as important users of our service too. Developer Francis Irving represented the site at the FOI Live conference for information professionals in June and will be speaking at the Freedom of Information Scotland conference in December.