mySociety blog

Image by PMC FirstPix

Just a week after WhatDoTheyKnow’s big, round number, FixMyStreet also passed a significant milestone.

200,000 reports have been sent through FixMyStreet since its launch in February 2007. It currently sends an average of 250+ messages about potholes, broken streetlights, and other problems to local authorities each day. So far this month, we’ve processed just over 5,000 reports.

Those reports are the work of over 87,000 people, 52% of whom had never before reported an issue to the council. That statistic is important to us: we aim to make it easy to access civic rights, especially for people doing so for the first time.

FixMyStreet.com is a site with a simple premise, and it hasn’t changed greatly since 2007 – though it is currently undergoing a facelift, bringing it more in line with today’s design expectations. Last year we introduced user accounts and zoomable maps, along with a few tweaks here and there.

Like other mySociety projects, FixMyStreet is, of course, built on open code, so that it can be replicated by anyone with a little technical knowledge. The FixMyStreet interface is already up and running in Norway, and soon, the Philippines will see trials of their own version – proving that the model can work in very different infrastructures. Meanwhile, the basic FixMyStreet concept has been replicated in Brazil, New Zealand, and South Korea. Here in the UK, some councils have bought FixMyStreet to embed into their own websites.

FixMyStreet sends reports to the council, and also publishes them online – so each report is read by many people. This simple system helps them find out more about their local community, and what the council are doing to get things fixed.

Uneven paving stones and malfunctioning pelican crossings may not be the stuff of high drama, but against expectations, FixMyStreet does make for fascinating reading sometimes. Take a look at this page if you’d like to see some of the more unusual reports. And if you’d like some insight into some of the issues our developers deal with, you might like to read Matthew Somerville’s solution to the dog poo problem. It’s all glamour at the cutting edge of FixMyStreet.

Photo from Wikimedia Commons

As 2012 kicks off, we’re looking for talented, passionate and diversely skilled people to join our team.

This year we’ll be pushing out internationally, improving our core UK sites and doing more commercial business. To do this, we need some more lovely, dilligent people to help us.

We’ve set up this new jobs page, where you can see what we’re looking for.

Please tell your nicest friends!

Image by Adam Tinworth

Some time in the middle of last night, our Freedom of Information site WhatDoTheyKnow.com was used to send its 100,000th FOI request. It was a simple one, made to the Queen Victoria Hospital NHS Foundation Trust.

WhatDoTheyKnow was launched in February 2008, with these aims: to make it easy to file a FOI request, and to keep a public archive of the requests and (more importantly) the responses received from public bodies. The Freedom of Information Act had been in force since 2005, but we wanted to make it fully accessible to people who were not journalists, lobbyists or professional operatives – it is a law that gives us all a right, not just those experts.

At base, mySociety is about giving people power to people who don’t believe that they have any way of affecting the world around them. Giving practical access to the right enshrined in this Act was and is a meaningful way of advancing that goal.

Then, thanks to a flash of inspiration from our late colleague Chris, we saw a great opportunity to increase the value created by the existence of the Act: we built a system that published the entire exchange of messages between users and public bodies online.

We believe that because of this decision to publish all exchanges with public bodies, WhatDoTheyKnow represents a very unusual phenomenon: a third-party web site that takes an existing piece of legislation and makes it better value for money for the taxpayer. Public money was already being spent answering FOI, but by running WhatDoTheyKnow we could magnify the value generated by each request by making it public, without requiring anyone who worked in a public sector to retrain, buy a new computer system or spend any new money.

And this theory turned out to be right. For every request made on the site, around twenty people come to read materials contained on WhatDoTheyKnow. The multiplier is remarkable, and one of the things that we think is most worth celebrating about this site.

WhatDoTheyKnow’s success is only possible because of a team of fantastically dedicated volunteers. These loyal enthusiasts have helped countless users, and do a simply amazing amount of maintenance work to keep the site friendly, helpful and effective. They are astonishingly talented, principled and knowledgeable, and mySociety owes them a debt of gratitude it will never really be able to pay back.

However, to give them a bit of the credit they deserve, and to highlight some of the countless uses of WhatDoTheyknow, we asked them to pick out some notable requests from the last four years.

Helen “The use of the site by campaign groups like the Campaign for Better Transport to find out about bus subsidy cuts as part of their save our buses campaign.”

John “There was the accidental release of how tax is applied to the Royal Family – which resulted in a Daily Mail front page story.”

Alex “This request about the Warmfront boiler installation scheme has a significant number of annotations. What makes it different is that the user patiently persisted with her original FOI requests, and then has carried on by continuing to help loads more people with details of how to complain and lobby for help and general warm encouragement.”

WhatDoTheyKnow is one of mySociety’s most visited sites, with one and a half million unique visitors in 2011. Like our other projects, it was built as an open source project. Thanks to the Open Society Foundation, we are in the process of making it much easier to re-deploy around the world, under the brand name ‘Alaveteli’.  As we speak, there are sites based on our code in places as far apart as New Zealand, Kosovo, Brazil, and the EU, and we’re looking forward to helping people from around the world create more grandchild sites in the years ahead.

Our 100,000 request milestone comes at an interesting time for the Freedom of Information Act. It’s currently under scrutiny by the Justice Select Committee, who are investigating whether it works effectively and in the way that it was intended.

As you might expect, at mySociety, we’re passionate about the right to information. We’ll be submitting evidence to the Justice Select Committee to show just how vital FOI is to good government and a good society. If FOI has touched your life, you might want to do the same.

December 23rd

Santa's Chocolate Coin Mint by Johnathan_W

If you haven’t got a penny,

A ha’penny will do,

If you haven’t got a ha’penny,

Then God bless you.

We wish you all a merry and prosperous Christmas – and for those of you who are already feeling quite prosperous enough, may we point you in the direction of our charitable donations page?

mySociety’s work is made possible by donations of all sizes and from all sorts of people. Those donations help fund all the online projects we create; projects that give easy access to your civic and democratic rights. If that’s important to you, show your appreciation, and we promise we’ll make the best use of every penny.

Thank you for sticking with us through this month-long post. We hope you’ve found it interesting and we wish you the very merriest of Christmases.

We hope you’ll continue to follow us on Twitter, Facebook, or Google+ – see our Contacts page to find individual projects’ social media links.

December 22nd

Santa Watching by LadyDragonflyCC

What’s behind the door? A letter to Santa.

Dear Santa,

We think we’ve been pretty good this year. We’ve tried to keep our local neighbourhood clean, help with problems, and aid those in need, so we’re hoping there are a few presents coming our way.

If you can fit them down the chimney, here’s what we’re dreaming of:

More publicly available data Of course, we were delighted to hear in Mr Osborne’s autumn statement that all sorts of previously-inaccessible data will be opened up.

We’re wondering whether this new era will also answer any of our FixMyStreet geodata wishes. Santa, if you could allocate an elf to this one, we’d be ever so pleased.

Globalisation …in the nicest possible way, of course. This year has seen us work in places previously untouched by the hand of mySociety, including Kenya and the Philippines. And we continue to give help to those who wish to replicate our projects in their own countries, from FixMyStreet in Norway to WhatDoTheyKnow in Germany.

Santa, please could you fix it for us to continue working with dedicated and motivated people all around the world?

A mySociety Masters degree We’re lucky enough to have a team of talented and knowledgeable developers, and we hope we will be recruiting more in the coming year. It’s not always an easy task to find the kind of people we need – after all, mySociety is not your average workplace – so we’ve come to the conclusion that it’s probably easiest to make our own.

Back in February, Tom started thinking about a Masters in Public Technology. It’s still something we’re very much hoping for. Santa, is it true you have friends in academic circles?

FixMyTransport buy-in - from everyone! Regular users of FixMyTransport will have noticed that there are different kinds of response from the transport operators: lovely, fulsome, helpful ones, and formulaic ones. Or, worse still, complete refusal to engage.

Santa, if you get the chance, please could you tell the operators a little secret? Just tell them what those savvier ones already know – that FixMyTransport represents a chance to show off some fantastic customer service. And with 25,000 visitors to the site every week, that message is soon spread far and wide.

(more…)

Image by John Blackbourn, used under the Creative Commons licence, with thanks

In the nine days our Fix Before the Freeze campaign has been running, there’s been a 47% increase in reports on FixMyStreet.com. Thank you to everyone who has spread the word or remembered to use the site to get something fixed.

As you may remember, the campaign encourages you to report problems such as broken streetlights or potholes before winter comes. It’s great to see this start to happen, and we hope you’ll experience the benefits once the cold weather takes grip. Hey, you might even find that the warm glow of community spirit cuts a few quid from your fuel bills…

Meanwhile, we’re sure there are still plenty of pavements, roads and amenities that could do with a patch-up before winter. So if there’s a gap on a notice board near you, don’t forget our print-outs and resources here. How about printing out a few and leaving them in your local library, cafe, or community centre?

You may already be aware of our website FixMyStreet.com, which helps you report common street problems – such as potholes and uneven pavements – to the relevant local council. This year, we thought we’d give people a gentle nudge before winter comes.

Many of the 1,000  issues which the site deals with every week are of the sort which are far better seen to before the big freeze. Potholes only worsen with the frost, and no-one wants a dodgy streetlight once the long dark nights are here.

How to join Fix Before the Freeze

• Check for problems Will your walk home from work tonight be in the dark? Look out for areas that could be better lit or paths that might cause people to stumble in the dark.

• Report it If you see something that is better fixed before the freeze, now’s the time to let your council know. It only take a minute at FixMyStreet.com.

• Spread the word We’ve created the image above as a website icon, flier, and poster. Follow the links at the foot of this post to download them, or use the code if you’d prefer to link back. Why not put one on your blog, hand them out at work, or stick one in your window? Please spread the word among friends and family too.

• Spread the word further We’d be grateful for mentions on your preferred social media hang-out (you can use the #FB4TF hashtag).

• Keep in touch You can ‘like’ us on Facebook here, or follow us on Twitter here.

Let’s get our local communities as safe as they can be, before the cold weather hits.

Downloads

Click on each thumbnail to be taken to the actual-size resource, then right click or ctrl+click to save a copy to your hard drive.

A4 sheet of fliers to print out:

Poster to print out:

Badge for your blog or website (165×165 pixels):

(If you’d like a larger image, feel free to save the one at the top of this post).

HTML for inserting the badge onto your site without downloading – just copy and paste the below into your HTML editor:

<a href=”http://www.mysociety.org/?p=4790″ title=”Find out more about Fix Before the Freeze from FixMyStreet.com”><Img alt=”Fix Before the Freeze – report those dangerous potholes and  broken streetlights before winter hits” src=”http://www.mysociety.org/wp/wp-content/uploads/2011/11/fixbeforethefreezebadge165.gif”></a>

Image by Waldo Pepper, used under the Creative Commons licence, with thanks.

FixMyStreet, is, as its name suggests, a system that reports street problems to the relevant local council. But at heart, it’s a problem-reporting system that could be adapted for a multitude of different uses.

For example, with just a few modifications, large institutions such as hospitals could use it for everyone – staff, visitors, patients – to report maintenance issues. Same for universities, especially those spread over large campuses. Supermarket chains could adapt it so that people could report abandoned trolleys – in fact we’ve been admiring an Aussie site that’s way ahead of us on that idea.

We’ve been enjoying thinking of new possible uses, from the practical to the frankly rather ridiculous, but we’re also keen to hear any ideas we might not have thought of. Is there an area in your life – personal or professional – that would be made much easier if you had an easy way to report it on-the-go? What challenges do you see, and why hasn’t it been done  before? Ideas below, please.

After several years of hosting, mySociety has migrated out of Easynet’s Brick Lane Data Center, and we now live on virtual machines hosted at a top secret location in the north of England. Most of our old hardware is no longer in use. It’s redundant. We don’t need it any more. But we don’t want to throw it all in a skip, that would be terrible.

Sooo… we’d like to find a lovely new home for it all. And this unique opportunity to own a piece of mySociety may be of interest to YOU.

Here are the technical details of the various machines we are getting rid of – check it out for what’s currently available.

Update: all gone!

The Rules:

1. The servers don’t come with disks: as part of our privacy procedures, all disks have been removed and destroyed to protect our and our users’ data.

2. You’ll need to be able to pick them up ASAP from a central London location (WC2).

3. You’ll need to be available to do so during office hours or very shortly afterwards (evenings or weekends aren’t possible, sorry).

4. Note that they are large and heavy so you may well need a car.

For more information, or even better, if you’re thinking “Sold! I’ll take the lot!”, then get in touch with Abi, our friendly office manager, on hello@mysociety.org.

If you feel guilty about relieving a registered charity of its assets, you can even make us a donation (voluntary, but we’d be appropriately grateful).

Transit Distress by Eric Parker - used with thanks under the Creative Commons licence

FixMyTransport was launched a month ago. It is now well on its way to listing 1,000 individual complaints, suggestions and requests to the public transport operators of Great Britain.

As the sample size grows, we’re able to see just what provokes the country’s mild-mannered passengers into action. There are the diurnal irritations – the leaky station roof, constant announcements, smelly trains; there is the discomfort of overcrowding and overheated buses.

All of which are important, of course. And in this, FixMyTransport is achieving its aim of allowing people to make their reports to the operators, while at the same time creating small bunches of people who read those reports and think, ‘Hey, me too!’.

But FixMyTransport is not just for the little gripes. It’s uncovering some pretty big issues, too. Prime among these is the issue of accessibility: reports have come in of buses driving away rather than let a wheelchair user on; a disabled passenger who has surmised that it’s easier to invite friends to come to him rather than try to navigate London’s public transport system; a station from which those with restricted mobility can only travel in one direction.

What next?

The big question for us is, what happens now? Are these reports making anything better? In some cases, yes.

There is the train that will now stop at intermediate stations, and the pedestrian crossings that are no longer blocked by buses. Little things that’ll make a big difference to the people who reported them. But the pay-off is not always so immediate. Bigger issues are obviously not going to be fixed overnight. And some problems won’t be fixed, for a multitude of reasons – they don’t fit in with the operators’ plans, or they’re not budgeted for, or they just aren’t seen as sufficiently important.

How is FixMyTransport going to crack those? Well, it was set up so that you can show your operator that there is demand, that budgets need to be massaged, or that plans should change. If you’ve used the site, you may well have been on the receiving end of a comment from one of the team, nudging you to spread the word of your campaign, among friends, family, and fellow-passengers.

The fact that people can sign up to your page helps make FixMyTransport different from just contacting the operator directly. We also reckon it’ll make a difference when it comes to getting changes. Consider, for example, the campaign to get increased cycle parking at Cambridge station – with 176 supporters (and still growing every day), our biggest yet. It’s been picked up by local press, talked about on Twitter – and eventually, National Express won’t be able to ignore the public demonstration of a palpable need.

Well, that’s the plan. We know it’s early days, and that FixMyTransport represents a massive sea change for some operators who are not used to interacting openly and online.

If you’ve written an impassioned, well-reasoned request, gathered supporters and spread the word far and wide, and still hit a brick wall, we have other suggestions. FixMyTransport allows us to get you writing to your local councillor, to the local paper, or to relevant groups like Passenger Focus, Transport for All, and the Campaign for Better Transport. These groups have been bashing away at the big problems like accessibility for far longer than we have, and it makes sense to tap into their expertise.

We know that for some issues, it’ll be a long game – just as it’ll be a long game trying to get every operator fully signed-up to the notion of transparent online interaction. But we’ll keep trying, and we hope you will too.

It’s high time we updated you on Mapumental, our journey-time mapping project. For those who may not remember, Mapumental is based on a simple idea: to visualise transit times, by public transport, from or to any postcode in Great Britain.

It all began in 2006, when the Department for Transport approached us to see what we might do with public transport data; in 2009 we won an investment loan from Channel 4 and Screen West Midlands which enabled us to build a beta tool – you might have played with it. If not, go on, have a go. It’s fun!

It’s been quite a long journey to where we are today. Unlike many mySociety projects, funding for Mapumental’s development came from a commercial investment loan, with a condition that we set it up as a business. For that reason, it’s not enough that it’s beautiful and useful – we need to find ways for it to be profitable, too. All revenues are set to come back to fund our not-for-profit activities.

We could tell from very early on in the project that Mapumental would be a sought-after tool for all sorts of purposes, from business to personal use. For example, you can see commute times at a glance, so it’s great for house-hunters and job-seekers. Consequently, it’s also great for the property and recruitment industries.

“Your maps look amazing, such a great way of representing what could be really boring data, but isn’t.” – A jobseeker

We can see loads of other possibilities too – like urban planning. This sort of analysis would have been far more expensive in the past; with Mapumental, planners can see at a glance how accessible a new development would be by public transport. Its potential uses are wide-ranging, answering questions for businesses, organisations, charities, and public facilities – especially those wanting to maximise accessibility or encourage use of greener transport options.

“The maps are a fantastic, a great tool and should be used for every planning application. I will be using Mapumental for all of our projects!” – Lee Taylor, Veridis Design

We’ve recently refined a product that’s pared down from the dynamic maps you may remember from that beta tool: static maps. These are simple, non-interactive maps which show transit time in bands. They’re flexible in that they can be generated for any postcode, with any maximum travel time, and depict travel at any given time of day.

We can provide a one-off map for personal use, or batches of many thousands of maps – as we have done for estate agents Foxtons, who now have a Mapumental map on every property listing.

As we generate more and more maps for different uses, showing different parts of the country, we’re really enjoying digging out all sorts of surprising facts – like how it’s quicker to travel from Watford to Westminster than it is from some parts of Harringay. Or how Cardiff University students might sensibly live at all points east as far as Newport, but will be stymied for transport in the west if they live anywhere other than Barry or Bridgend.

In fact, our very favourite use so far has come from an individual who centred his map around his home postcode. He tells us he has printed it off and put it up by the front door, so that on his way out of the house, he can find a new and surprising destination for day-trips.

Find out more on the Mapumental website – and please do spread the word among friends and colleagues who might benefit from a Mapumental map.

Our monthly pub meets are proving to be a great place for friendly discussions and meeting new folk. The next one is on Tuesday the 20th, again at the Counting House pub. You are invited!

We’re generally to be found in one of the back rooms upstairs and at least one of us will be wearing a mySociety hoodie. We’ll try and tweet on the @mySociety Twitter account to say exactly where we are – it’s a big pub and it can be crowded early on in the evenings.

If you’d like to tweet about the night, or put photos on Instagram or Flickr, you can use the hashtag #mysocial.

7.30, Tuesday 20th September at the Counting House
50 Cornhill
London
EC3V 3PD

Map here. The nearest Underground stations are Monument and Bank.

Image by Yi-tao 'Timo' Lee, used with thanks.

Just like the famous Yellow Pages ad, FixMyTransport is not only there for the nasty things in life.

Quite late in FixMyTransport’s development, we realised that praise is a form of feedback and that this channel ought to be open to our users, too – that’s why on every page for a stop or a route, you’ll see a stonking great button inviting you to ‘say something nice’ – here’s an example: a station manager giving the type of good service that gladdens the heart.

There’s also a little love for Pulborough station, nice words for Brighton’s well-informed station staff, an example of a very accommodating bus driver, and a comment that makes me want to take the 37 bus to Clapham Junction right now.

We haven’t really stressed this side of FixMyTransport, so we’re really glad to see people finding it for themselves and putting it to good use. If you encounter particularly excellent service on your next journey, and you want to spread the love too, just remember the big blue button. We’re sure the operators will be very glad to hear from you.

So. Yesterday we officially launched FixMyTransport, a site that has been in ‘quiet beta’ for a few weeks. Not such a big event, you might think – after all, the site has been open for public use; the only difference was that we were announcing it.

I think we’ve all been gratifyingly taken aback by just how much use the site has seen in the last 24 hours. Thanks to mentions in some of the mainstream press, but equally because of a veritable outpouring of tweets and retweets, word spread quickly. We experienced a 550% rise in visitor numbers (the servers took it in their stride, we are glad to say). Over the course of the day, the number of reports on the site doubled, with more than 70 totally new campaigns being created and many more problems being sent to operators. With each report came more tweets, more blog posts and more users signing up to campaigns.

We’re seeing the idea we worked on become a reality, and that’s both exciting and full of surprises. We knew what we would use such a site for, but we had no idea which issues would most motivate our users (at the latest reckoning, it’s poor air conditioning, delays, and, above all, a lack of decent information).

If you haven’t had a chance to see what FixMyTransport is all about yet, take a look at some of these examples:

• A passenger who has to travel west when she wants to go east
• What sounds like a complete no-brainer of a suggestion
• A sensible placatory move Virgin could extend to delayed passengers
• A call for longer commuter trains

Many of these examples see users (not just the operators, but ordinary people) who know a lot more than we do about public transport in this country weighing in with useful insights, which is fantastic.

Don’t forget you can search your local region for reports. If you find one you agree with, lending your support is as easy as clicking a single button, and then spreading the word with a tweet, a Facebook status or however you see fit.

Excuse the puns – they are hard to avoid – but we have the sense that we’re at the beginning of a very exciting journey here. And we’re sure we’re going to enjoy the ride. Thanks to everyone who’s come on board so far.

Everyone at mySociety is quite bubbling with excitement at the news that we’re today officially launching FixMyTransport.com , mySociety’s first new core charitable website since WhatDoTheyKnow launched in 2008. We’ve never before launched a site that took so much work to build, or that contained so much data.

What is it for?

FixMyTransport has two goals – one in your face, and the other more subtle.

The first goal, as the site’s name suggests, is to help people get common public transport problems resolved. We’re talking broken ticket machines, gates that should be open and stations without stair-free access. We’ll help by dramatically lowering the barrier to working out who’s responsible, and getting a problem report sent to them – a task that would have been impossible without the help of volunteers who gathered a huge number of operator email addresses for us. Consequently the service works everywhere in Great Britain, our database has over 300,000 stops and routes for train, tube, tram, bus, coach and ferry.

The second goal – the subtle one – is to see if it is possible to use the internet to coax non-activist, non-political people into their first taste of micro-activism. Whilst the site intentionally doesn’t contain any language about campaigning or democracy, we encourage and provide tools to facilitate the gathering of supporters, the emailing of local media, the posting of photos of problems, and the general application of pressure where it is needed. We also make problem reports and correspondence between operators and users public, which we have frequently seen create positive pressure when used on sister sites FixMyStreet and WhatDoTheyKnow.

Who made it?

FixMyTransport was largely built by one remarkable coder – Louise Crow, who started as a volunteer and who is now one of our longest serving core developers. She spent 18 months coding the site almost entirely by herself, wrestling with truly tortuous data problems and collaborating with Birmingham’s fantastic SuperCool design to make it look lovely (you should hire them, they’re great).  She also tolerated my ‘aspirational scattergun’ school of project management with remarkable good humour. She really is the king of transport coding.

Credit must also go to mySociety core dev Dave Whiteland, who made the Facebook integration work, despite not having an account himself!

Why is it dedicated to Angie Martin?

Angie Martin was a mySociety coder for an all-too-brief period before she succumbed to cancer at a devastatingly early age. We’re dedicating this site to her in remembrance of a great, self taught perl monger who should still be here.

We’ll be posting further blog posts about the development process, the data challenges, and the overall project philosophy. In the mean time, please keep arms and legs inside the carriage – FixMyTransport is just about to depart.

We had a complaint that FixMyStreet maps weren’t displaying on someone’s computer. We hadn’t had any other complaints, and we quickly narrowed it down to the fact that the person was on the internet using a tethered T-Mobile phone.

T-Mobile (and Orange, and quite possibly others) are injecting JavaScript and altering content served over their networks. Their reason for doing this, according to their websites (T-Mobile, Orange), is to compress images and video sent to your browser, so as to speed up your browsing. Seeing it in action, they also inline some CSS and JavaScript, though not all, and remove comments from external files.

However, their implementation breaks things. In this particular instance, the T-Mobile JavaScript comment stripper appears to be searching for “/*” and “*/” and removing everything inbetween. This might work in most cases; however in the jQuery library, we find a string containing “*/*”, and later down the file, another string containing “*/*”. T-Mobile remove everything between the things it thinks are comment markers, even though they’re actually contained within strings, causing the jQuery library to be invalid JavaScript and stopping anything using jQuery from running.

Their decision to inline lots of the CSS also seems a bit odd – sure, on a mobile this might be quicker, but even ignoring tethering nowadays plenty of mobiles have caches too and having the CSS download once and be cached would seem better than adding weight to every page download. But I’m sure they’ve studied their decision there, and it doesn’t make any difference to the actual browsing, as opposed to the comment removal.

To turn off this feature on your mobile phone or broadband, visit accelerator.t-mobile.co.uk or accelerator.orange.co.uk on your connection and pick the relevant option – if anyone knows of similar on other networks, do leave updates in the comments.

From a FixMyStreet point of view – whilst FixMyStreet functions just fine without JavaScript, I had made the (perhaps incorrect) decision to put the map inside a <noscript> element, to prevent a flash of map-oddity as the JavaScript map overlaid the non-JS one. However, this meant in this circumstance the map did not work, as JavaScript was enabled, but jQuery was unable to be loaded. I haven’t decided whether to change this behaviour yet; obviously it would help people in this situation as the map would still display and function as it does for all those without JavaScript, but for those with JavaScript it does look a bit jarring as the page loads. Any suggestions on a better approach welcome :)

Thanks everyone who’s turned up so far for a drink and a chat at our monthly pub meets. The next one is on Wednesday the 17th, again at the Counting House pub. You are invited!

If you’d like to tweet about the night, or put photos on Instagram or Flickr, you can use the hashtag #mysocial.

7.30, Wednesday 17th August at the Counting House
50 Cornhill
London
EC3V 3PD

Map here. The nearest Underground stations are Monument and Bank.

Back in November 2006 we launched Number 10’s petitions website. We were pretty proud of the usability-centred site we built – we can still lay a pretty good claim to it being one of the biggest democracy sites (measured in terms of people transacting) that the world’s ever seen.

Over 12 million signatures had been added to petitions by the time the site was switched off after the 2010 general election. We were particularly proud of developing a system that was highly load-tolerant: we once survived over 20,000 people signing within a single hour, all whilst running on a pair of cheap little servers. That performance on so little hardware was down to the raw brilliance represented by a coding team made up of Francis Irving, Matthew Somerville, and the late, great Chris Lightfoot.

We’re also pleased that the popularity of the site led to the irresistible rise of the belief that the public should be able to petition the government via the internet. So even though our site was mothballed, Parliament and DirectGov have taken over the idea, and the commitment has been upped a notch, from ‘we’ll send a reply’ to ‘we’ll talk about it’. To be clear, we are not, nor have ever been a community interested in replacing representative democracy with direct democracy, but anything that can squeeze any drop of change from Parliament is worth a small celebration.

What’s most pleasing, though, is that we’ve been able to take the open source code built for Number 10, improve and expand upon it to develop a hosted petitions service for local councils around the country, or the rest of the world. And this is where we found the most important lesson for us: local petitions can be awesome, and despite the much smaller numbers of signatories involved, we’ve been more widely and frequently impressed by local petitions and responses than at the more glamorous national level. We’re particular fans of Hounslow Borough Council who have given positive and detailed feedback on all sorts of genuine local issues, as well as working hard to let local residents know that the service exists.

Just recently we launched a site to make it really easy to find local council petition websites, because there are hundreds hidden away (we built some; most are supplied by other vendors). If we could see anything result from today’s huge explosion of interest in online petitions, it would be that people might start to look local, and explore what petitions in their community could mean.

If you’ve visited our parliamentary site TheyWorkForYou.com, you’ll have noticed that on each MP’s page there is a short summary of his or her voting record on various key issues.

These issues have always been carefully chosen to give a simple but neutral top-line view of each MP’s voting activity. Judging by Twitter, they’re a fairly popular part of the site, too.

There’s way, way more tedious complexity behind producing these little summaries than you might think, and due to a lack of appropriately skilled people in our team over the last year we had let our vote analyses get a bit behind the times. If you’re really interested you can read about why authoring these things in such a scrupulously balanced way is so time consuming here.

We’re posting today to tell you that we have recruited a pair of excellent new part-time voting analysts, David and Ambreen, and they have recently produced the first of a new generation of voting summaries.

The first shows how each MP has voted on increasing the rate of VAT, and second on the recent changes to university tuition fees. We have also increased the number of votes which feed into the EU integration policy to bring it more up to date.

To see this new data, just pop along to TheyWorkForYou’s home page, stick in your postcode, and check out your own MPs’ page. Then, if you want to be made aware as soon as we’ve published the next analyses, please follow our new TheyWorkForYou Twitter account.

Lastly, I just want to say thank you to the vote analysts Ambreen and David, to senior developer Matthew and to uber-volunteer Richard Taylor for kicking this vital part of TheyWorkForYou back into top gear.

Image by European Parliament.

Last month’s pubmeet was fun, but it was rather crowded, so we’re moving venues. This month, our chosen pub is the Counting House, which is cavernous as well as rather beautiful. Please do join us for a drink, to ask questions or suggest new ideas – or just for a chat.

If you’d like to tweet about the night, or put photos on Instagram or Flickr, you can use the hashtag #mysocial to make sure that others find ‘em.

7.30, Wednesday 20th July at the Counting House
50 Cornhill
London
EC3V 3PD

Map here. The nearest Underground stations are Monument and Bank.

This post explains how various aspects of the new FixMyStreet maps work, including how we supply our own OS StreetView tile server and how the maps work without JavaScript.

Progressive enhancement

During our work on FiksGataMi (the Norwegian version of FixMyStreet) with NUUG, we factored out the map code (for the Perlmongers among you, it’s now using Module::Pluggable to pick the required map) as FiksGataMi was going to be using OpenStreetMap, and we had plans to improve our own mapping too. Moving to OpenLayers rather than continuing to use our own slippy map JavaScript dating from 2006 was an obvious decision for FiksGataMi (and then FixMyStreet), but FixMyStreet maps have always been usable without JavaScript, utilising the ancient HTML technology of image maps to provide the same functionality, and we wanted to maintain that level of universality with OpenLayers. Thankfully, this isn’t hard to do – simply outputting the relevant tiles and pins as part of the HTML, allowing latitude/longitude/zoom to be passed as query parameters, and a bit of maths to convert image map tile clicks to the actual latitude/longitude selected. So if you’re on a slow connection, or for whatever reason don’t get the OpenLayers JavaScript in some way, the maps on FixMyStreet should still work fine. I’m not really aware of many people who use OpenLayers that do this (or indeed any JavaScript mapping API), and I hope to encourage more to do so by this example.

Zooming

We investigated many different maps, and as I wrote in my previous blog post, we decided upon a combination of OS StreetView and Bing Maps’ OS layer as the best solution for the site. The specific OpenLayers code for this (which you can see in map-bing-ol.js is not complicated (as long as you don’t leave in superfluous commas breaking the site in IE6!) – overriding the getURL function and returning appropriate tile URLs based upon the zoom level. OpenLayers 2.11 (due out soon) will make using Bing tiles even easier, with its own seamless handling of them, as opposed to my slight bodge with regard to attribution (I’m displaying all the relevant copyright statements, rather than just the one for the appropriate location and zoom level which the new OpenLayers will do for you). I also had to tweak bits of the OpenLayers map initialisation so that I could restrict the zoom levels of the reporting map, something which again I believe is made easier in 2.11.

OpenStreetMap

Having pluggable maps makes it easy to change them if necessary – and it also means that for those who wish to use it, we can provide an OpenStreetMap version of FixMyStreet. This works by noticing the hostname and overriding the map class being asked for; everything necessary to the map handling is contained within the module, so the rest of the site can just carry on without realising anything is different.

OS StreetView tile server

Things started to get a bit tricky when it came to being ready for production. In development, I had been using http://os.openstreetmap.org/ (a service hosted on OpenStreetMap’s development server) as my StreetView tile server, but I did not feel that I could use it for the live site – OpenStreetMap rightly make no reliability claims for it, it has a few rendering issues, and we would probably be having quite a bit of traffic which was not really fair to pass on to the service. I wanted my own version that I had control over, but then had a sinking feeling that I’d have to wait a month for something to process all the OS TIFF files (each one a 5km square) into millions and millions of PNG tiles. But after many diversions and dead ends, and with thanks to a variety of helpful web pages and people (Andrew Larcombe’s guide to his similar install was helpful), I came up with the following working on-demand set-up, with no pre-seeding necessary, which I’m documenting in case it might be useful to someone else.

Requests come in to our tile server at tilma.mysociety.org, in standard OSM/Google tile URL format (e.g. http://tilma.mysociety.org/sv/16/32422/21504.png. Apache passes them on to TileCache, which is set up to cache as GoogleDisk (ie. in the same format as the URLs) and to pass on queries as WMS internally to MapServer using this layer:

[sv]
type=WMS
url=path/to/mapserv.fcgi?map=os.map&
layers=streetview
tms_type=google
spherical_mercator=true

MapServer is set up with a Shapefile (generated by gdaltindex) pointing at the OS source TIFF and TFW files, meaning it can map tile requests to the relevant bits of the TIFF files quickly and return the correct tile (view MapServer’s configuration – our tileserver is so old, this is still in CVS). The OUTPUTFORMAT section at the top is to make sure the tiles returned are anti-aliased (at one point, I thought I had a choice between waiting for tiles to be prerendered anti-aliased, or going live with working but jaggedy tiles – thankfully I persevered until it all worked :) ).

Other benefits of OpenLayers

As you drag the map around, you want the pins to update – the original OpenLayers code I wrote used the Markers layer to display the pins, which has the benefit of being simple, but doesn’t fit in with the more advanced OpenLayers concepts. Once this was switched to a Vector layer, it now has access to the BBOX strategy, which just needs a URL that can take in a bounding box and return the relevant data. I created a subclass of OpenLayers.Format.JSON, so that the server can return data for the left hand text columns, as well as the relevant pins for the map itself.

Lastly, using OpenLayers made adding KML overlays for wards trivial and made those pages of the site much nicer. The code for displaying an area from MaPit is as follows:

    if ( fixmystreet.area ) {
        var area = new OpenLayers.Layer.Vector("KML", {
            strategies: [ new OpenLayers.Strategy.Fixed() ],
            protocol: new OpenLayers.Protocol.HTTP({
                url: "/mapit/area/" + fixmystreet.area + ".kml?simplify_tolerance=0.0001",
                format: new OpenLayers.Format.KML()
            })
        });
        fixmystreet.map.addLayer(area);
        area.events.register('loadend', null, function(a,b,c) {
            var bounds = area.getDataExtent();
            if (bounds) { fixmystreet.map.zoomToExtent( bounds ); }
        });
    }

Note that also shows a new feature of MaPit – being able to ask for a simplified KML file, which will be smaller and quicker (though of course less accurate) than the full boundary.