Ah, summer: walks in the park, lazing in the long grass, and the sound of chirping crickets – all overlaid with the clatter of a thousand keyboards.

That may not be your idea of summer, but it’s certainly the ways ours is shaping up. We’re participating in Google’s Summer of Code, which aims to put bright young programmers in touch with Open Source organisations, for mutual benefit.

What do the students get from it? Apart from a small stipend, they have a mentored project to get their teeth into over the long summer hols, and hopefully learn a lot in the process. We, of course, see our code being used, improved and adapted – and a whole new perspective on our own work.

Candidates come from all over the world – they’re mentored remotely – so for an organisation like mySociety, this offers a great chance to get insight into the background, politics and technical landscape of another culture. Ideas for projects that may seem startlingly obvious in, say, Latin America or India would simply never have occurred to our UK-based team.

This year, mySociety were one of the 180 organisations participating. We had almost 100 enquiries, from countries including Lithuania, India, Peru, Georgia, and many other places. It’s a shame that we were only able to take on a couple of the many excellent applicants.

We made suggestions for several possible projects to whet the applicants’ appetite. Mobile apps were popular, in particular an app for FixMyTransport. Reworking WriteToThem, and creating components to complement MapIt and PopIt also ranked highly.

It was exciting to see so many ideas, and of course, hard to narrow them down.

In the end we chose two people who wanted to help improve our nascent PopIt service. PopIt will allow people to very quickly create a public database of politicians or other figures. No technical knowledge will be needed – where in the past our code has been “Just add developers”, this one is “Just add data”. We’ll host the sites for others to build on.

Our two successful applicants both had ideas for new websites that would use PopIt for their datastore, exactly the sort of advanced usage we hope to encourage. As well as making sure that PopIt actually works by using it they’ll both be creating transparency sites that will continue after their placements ends. They’ll also have the knowledge of how to set up such a site, and in our opinion that is a very good thing.

We hope to bring you more details as their projects progress, throughout the long, hot (or indeed short and wet) summer.

PS: There is a separate micro-blog where we’re currently noting some of the nitty gritty thoughts and decisions that go into building something like PopIt. If you want to see how the project goes please do subscribe! The Components mailing list is also a good way of staying in touch.

Top image by Elaine Millan, used with thanks under the Creative Commons licence.

mySociety’s sites are all open-source, which means that anyone can take our code and build their own sites with it. That’s been a core mySociety principle from the very beginning, but as time has passed, we’ve realised that we could have made the process easier.

Until recently, you had to be pretty techie to use our code. But now, under the banner DIY mySociety, we’re actively working to lower the bar. Firstly, and most importantly, we’re in the process of rewriting much of our code so that it’s nearer ‘plug and play’ status than previously. Then, we’re backing it up with documentation in the form of easy-to-read handbooks, and supportive communities.

If you’ve ever thought of replicating a mySociety-style site in your own neck of the woods, take a peek over at diy.mysociety.org. We’ll be regularly updating with news and advice.

Image by Kenny Louie, used with thanks under the Creative Commons licence.

Image from The Somers Town Coffeehouse site

Our regular informal meet-up will be on Wednesday 18th April. Like last month, we’ll be at the Somers Town Coffeehouse near Euston for drinks and chat.

As always, everyone is welcome. There’s no agenda – just a chance to have a talk with mySociety staff, volunteers, and the other interesting people that turn up. It’s also a good opportunity to find out about volunteering, or ask questions about our work.

We’ll be there from 7.30pm and there’ll be at least one mySociety hooded top in evidence, so that you can find us easily (logo as at the top of this page).

Here’s a map.

As usual, our dedicated hashtag is #mySocial. Hope to see you there!

FixMyStreet, our site for reporting things like potholes and broken street lights, has had something of a major redesign, kindly supported in part by Kasabi. With the help of Supercool, we have overhauled the look of the site, bringing it up to date and making the most of some lovely maps. And as with any mySociety project, we’d really appreciate your feedback on how we can make it ever more usable.

The biggest change to the new FixMyStreet is the use of responsive design, where the web site adapts to fit within the environment in which it’s being viewed. The main difference on FixMyStreet, besides the obvious navigation changes, is that in a small screen environment, the reporting process changes to have a full screen map and confirmation step, which we thought would be preferable on small touchscreens and other mobiles. There are some technical details at the end of this post.

Along with the design, we’ve made a number of other improvements along the way. For example, something that’s been requested for a long time, we now auto-rotate photos on upload, if we can, and we’re storing whatever is provided rather than only a shrunken version. It’s interesting that most photos include correct orientation information, but some clearly do not (e.g. the Blackberry 9800).

We have many things we’d still like to do, as a couple of items from our github repository show. Firstly, it would be good if the FixMyStreet alert page could have something similar to what we’ve done on http://planningalerts.barnet.gov.uk/, providing a configurable circle for the potential alert area. We also are going to be adding faceted search to the area pages, allowing you to see only reports in a particular category, or within a certain time period.

Regarding native phone apps – whilst the new design does hopefully work well on mobile phones, we understand that native apps are still useful for a number of reasons (not least, the fact photo upload is still not possible from a mobile web app on an iPhone). We have not had the time to update our apps, but will be doing so in the near future to bring them more in line with the redesign and hopefully improve them generally as well.

The redesign is not the only news about FixMyStreet today

As part of our new DIY mySociety project, we are today publishing an easy-to-read guide for people interested in using the FixMyStreet software to run versions of FixMyStreet outside of Britain. We are calling the newly upgraded, more re-usable open source code the FixMyStreet Platform.

This is the first milestone in a major effort to upgrade the FixMyStreet Platform code to make it easier and more flexible to run in other countries. This effort started last year, and today we are formally encouraging people to join our new mailing list at the new FixMyStreet Platform homepage.

Coming soon: a major upgrade to FixMyStreet for Councils

As part of our redesign work, we’ve spoken to a load of different councils about what they might want or need, too. We’re now taking that knowledge, combining it with this redesign, and preparing to relaunch a substantially upgraded FixMyStreet for Councils product. If you’re interested in that, drop us a line.

Kasabi: Our Data is now in the Datastore

Finally, we are also now pushing details of reports entered on FixMyStreet to Kasabi’s data store as open linked data; you can find details of this dataset on their site at http://kasabi.com/dataset/fixmystreet. Let us know if it’s useful to you, or if we can do anything differently to help you.

Technical details

For the web developers amongst you – we have a base stylesheet for everyone, and another stylesheet that is only included if your browser width is 48em or above (an em is a unit of measurement dependent on your font size), or if you’re running Internet Explorer 6-8 (as they don’t handle the modern CSS to do this properly, we assume they’ll want the larger styles) using a conditional comment. This second stylesheet has slight differences up to 61em and above 61em. Whilst everything should continue to work without JavaScript, as FixMyStreet has done with its map-based reporting since 2007, where it is enabled this allows us to provide the full screen map you can see at large screen sizes, and the adjusted process you see at smaller resolutions.

We originally used Modernizr.mq() in our JavaScript, but found that due to the way this works (adding content to the end of the document), this can cause issues with e.g. data() set on other elements, so we switched to detecting which CSS is being applied at the time.

On a mobile, you can see that the site navigation is at the end of the document, with a skip to navigation link at the top. On a desktop browser, you’ll note that visually the navigation is now at the top. In both cases, the HTML is the same, with the navigation placed after the main content, so that it hopefully loads and appears first. We are using display: table-caption and caption-side: top in the desktop stylesheet in order to rearrange the content visually (as explained by Jeremy Keith), a simple yet powerful technique.

From a performance point of view, on the front page of the site, we’re e.g. using yepnope (you can get it separately or as part of Modernizr) so that the map JavaScript is downloading in the background whilst you’re there, meaning the subsequent map page is hopefully quicker to load. I’m also adding a second tile server today – not because our current one isn’t coping, it is, but just in case something should happen to our main one – we already have redundancy in our postcode/area server MapIt and our population density service Gaze.

If you have any technical questions about the design, please do ask in the comments and I’ll do my best to answer.

Image from The Somers Town Coffeehouse site

This month’s informal gathering will be on Tuesday 20th March at the Somers Town Coffeehouse near Euston (yes, despite its name, it’s a pub).

As always, everyone is welcome. There’s no agenda – just a chance to have a chat with mySociety staff, volunteers, and the other interesting people that turn up. It’s also a good opportunity to find out about volunteering, or ask questions about our work.

We’ll be there from 7.30pm and there’ll be at least one mySociety hooded top in evidence, so that you can find us easily (logo as at the top of this page).

Here’s a map.

As usual, our dedicated hashtag is #mySocial. Hope to see you there!

Looking down onto the street from the barangay centre in Basak San Nicholas, Cebu

At mySociety we take some pride in knowing that FixMyStreet has helped rid the world of thousands of potholes over the years, but of course our contribution to unbroken roads is merely the start of the process. Certainly, reporting a hole on FixMyStreet is easy (we’ve gone out of our way to make sure that is the case), but we do appreciate that a hole remains a hole until somebody takes the trouble to actually fill it in. So really it is all the inspectors, despatchers, logistic and supply teams, fleet mechanics, and repair crews who make the world a smoother, less perforated place.

We’re currently working on a pilot project in the city of Cebu (the “second city” of the Philippines) with the World Bank and transport experts ITP that will implement a FixMyStreet-based reporting service as part of the ongoing battle to keep its roads and streetlights in good repair. Later in the year we will have more to report, but for now—before anything is up and running—we can start by saluting the work of some of the remarkable people who fix the roads (and replace the bulbs) there.

As the winter closed in here in the UK, we ran a “Fix Before the Freeze” campaign encouraging people to report potholes before the frost made things worse. Frost damage isn’t an issue in Cebu, but monsoon weather is, and during the wettest time of the the year it’s simply impractical for holes to be filled with the hot mix method (which is the best way to effect a long-term repair). Every day, the highway departments are faced with the unrelenting logistical problems that arise from marshalling a limited number of crews with a finite amount of asphalt to combat a cityful of holes. Add to this the churn of a thriving city: repairing the surfaces of busy urban roads is a hazardous occupation at the best of times, but especially so in a place like the Philippines where exuberant driving styles can make British traffic seem almost restful.

O don’t tell the mice, don’t tell the moles,
My father’s the chief inspector of HOLES
—Ted Hughes

Danong at DPWH with his exquisite whiteboard map and magnetic markers. The quality of the draughtsmanship of the diagrams of repairs and road layouts we saw in his office is amazing. Even the writing on the wall is beautifully hand-lettered.

Cebu’s large network of roads needs constant inspection in this war of material attrition. An inspector can perhaps hope to cover up to 30km of single-lane road in a day, but with a road network like Cebu’s this is never enough. We met Nicomedes, senior manager at DPWH, who long ago adopted the weekend practice of packing a lunch and spending each Saturday inspecting the “mountain barangay” routes that might otherwise never make it onto the schedule. He’s made it a matter of personal pride to be familiar with roads on the outskirts of Cebu city that many of its inhabitants may never even see.

The problems for road maintenance specific to an environment like Cebu include encroachment—where access to the road for repairs can be difficult because everyday life overspills its edges—and the often dense layout of narrow, unnamed alleys. Cebu is divided into barangays (somewhat similar to parishes or wards in the UK), each of which has a community centre and a team responsible for managing local issues. The FixMyStreet pilot project will be working with these enthusiastic barangay teams to run a system of local hole triage that would make local councils in the UK envious.

A middle-of-the-street game of slipper-throwing under way in barangay Luz, Cebu

So next time you click on FixMyStreet to report a pothole—whether it’s a gaping chasm or a worrying case of alligator cracking*—remember that you are taking part in the international battle against unwanted holes.

* alligator cracking: technical term describing fragmented road surface; does not involve actual alligators

Chris Lightfoot (by Gavin Bell)

My friend and mySociety’s first developer Chris Lightfoot died five years ago today. He killed himself in his own flat for reasons that we will never really know, but which are doubtless linked to the depression which he’d been fighting for years. He was just 28, but had already achieved so much that The Times ran an obituary of him. He would have laughed mightily about the fact that this is now behind a paywall.

To mark this occasion I wanted to write something for mySociety staff and volunteers who never knew Chris, and for a wider audience of people who work in places like GDS, Code For America or indeed anyone with an interest in politics and governance. What Chris represented is too important to be lost in the grief at his passing.

The basic fact to understand about Chris was that he was a very specific kind of polymath – one perfectly suited to the internet age. What I mean by this is that he did much more than simply master varying disciplines:  he saw and drew connections between fields. He wouldn’t just master cartographic principles, engage in politics and, as Francis Irving put it, ‘write Perl like other people write English’: he invariably saw the connections and mixed them up in meaningful and often pioneering ways.

Moreover, this mixing of disciplines was conducted at a furious, restless pace, and knew absolutely no concept of ‘too hard’ – problems were either fundamentally impossible, or ‘trivially soluble’, to use one of his favourite and most gloriously under-stated phrases. Who else would build the technology to break a captcha, just to investigate what American truck rental costs tell us about internal migration in America, for fun?  The answer is trivial.

That he was a genius is not what I want you to understand. Telling you that someone you never met was smarter than you is not helpful, and doesn’t fulfil my promise to tell you why understanding Chris matters.

What is fundamentally valuable about Chris’ legacy (besides piles of code that power services still running today) is that his story signals how we all need to change our conception of what it means to be ‘wise enough to rule’. Let me explain.

Unlike most of us, Chris had the luxury of being able to pick any field of study that interested him, dig up some books and papers, and teach himself a graduate-level understanding in what felt like a few days. It is hard to express quite how fast he could consume and internalise complex new information, and how relentlessly he went at it. To note that he got six A grades at A-level is too puerile a précis, but it is indicative.*

Again, I am not telling you this to make you feel stupid: what matters is what he chose to do with this gift.  What he chose to do was built an ever-expanding palette of skills from which he could paint as he pleased. And what he chose to paint was a vision of a better, saner world.

This painting ranged across a huge expanse of topics and disciplines: nuclear engineering, political ideologies, constitutional law, military history, statistics, psephology, economics, security engineering, behavioural psychology, propaganda, intellectual propery law and more. His favourite brushes were Perl and a blog composed of prose so sharp and funny that George Bernard Shaw would not have been displeased by the comparison. I still wish I could write half as well as him.

What I want to communicate most is this: the disciplines he chose to study form a combined19th, 20th and 21st century curriculum of skills required by modern leaders, both leaders of political organisations and government bureaucracies.  Chris’s life was the invention of a massively expanded, far more up to date version of the traditional Politics, Philosophy and Economics course that this country still uses to educate its elites.

Some of these disciplines are timeless, like the understanding of ideologies or economics. Some represent vital new issues that emerged in the 20th century, like nuclear energy and world-scale warfare. But mixed in there are wholly new, alien group of skills that the recent SOPA, Wikileaks and ID cards debacles show that modern leaders haven’t got anywhere near to internalising: they include knowledge about security engineering, intellectual property and how new technologies clash with old laws and ideologies. They are skills that nobody used to think were political, but which are now centre stage in a polity that can’t keep up.

This doesn’t mean Chris would have made a perfect leader: I used to argue with him a lot about how he weighed up the costs and benefits of different issues. But what he fundamentally had right was the understanding that you could no longer run a country properly if the elites don’t understand technology in the same way they grasp economics or ideology or propaganda. His analysis and predictions about what would happens if elites couldn’t learn were savage and depressingly accurate.

The canon of Chris’s writings and projects embody the idea that what good governance and the good society look like is now inextricably linked to an understanding of the digital. He truly saw how complex and interesting the world was when you understood power as well as networking principles in a way that few have since.

There is, of course, much more to say about Chris’s life. His blog, built on software that foresaw Posterous, is wonderful, hilarious and utterly readable, so you can learn more yourself. Martin Keegan’s obituary is touching and a much better portrait of how much fun it was to be friends with Chris. I hope to memorialise what he represents to me, if I can. But for now, I’ll sign off with a quote from a blog commentor:

“Chris was kind enough to take the time to reply to me, an internet nobody whom he didn’t know from a bar of soap, on a fairly complex statistical question once. He took a lot of time and effort in his response, and he made sure I understood it properly. It’s not often you find knowledgeable people willing to take their own time to educate an unknown person. We need more people like him, not less.”

* For US readers, this is like having a GPA of 4.0, but achieved across twice as many subjects as you actually need to take.

Image taken from Prince Arthur's website

What is a mySociety pubmeet? Just an informal evening when we guarantee that a few of us will be in a pub, happy to chat about anything at all.

If you have questions about any of our projects, ideas for new ones, or want to find out more about volunteering, then you’ll be very welcome.

Where? This month, we’ll be in the Prince Arthur, near Euston Station. Google map here.

When? Wednesday, 22nd February. Feel free to drop by, any time from 7.30 pm to 10.30 pm. Maybe let us know that you’re coming, by email or tweet, so that if numbers start looking large, we can book a space.

We’re easy to spot – at least one of us will be wearing a mySociety hooded top, complete with luminous green logo, as seen at the top of this page.

Tell your friends The more the merrier! If you like your social media, you can use the #mySocial hashtag.

But I don’t live in London… We are planning on having pubmeets in other UK cities soon. Watch this space!

An MP page scorecard from the re-launched Mzalendo

When TheyWorkForYou was built by a group of volunteer activists, many years ago, it was a first-of-a-kind website. It was novel because it imported large amounts of parliamentary data into a database-driven website, and presented it clearly and simply, and didn’t supply newspaper-style partisan editorial.

These days dozens of such sites exist around the world. But today sees the launch of a rather-special new transparency site: Mzalendo, covering the Parliament of Kenya.

Mzalendo (which means ‘Patriot’ in Swahili) has been around for a few years too, as a blog and MP data website founded by volunteer activists Conrad and Ory. However, over the last few months mySociety’s team members Paul, Jessica and Edmund, plus the team at Supercool Design have been helping the original volunteers to rebuild the site from the ground up. We think that what’s launched today can stake a claim to being a true ‘second generation’ parliamentary monitoring site, for a few reasons:

• It is entirely responsively designed, so that it works on the simplest of mobile web browsers from day one.
• All the lessons we learned from storing political data wrongly have been baked into this site (i.e we can easily cope with people changing names, parties and jobs)
• Every organisation, position and place in the system is now a proper object in the database. So if you want to see all the politicians who went to Nairobi University, you can.
• There is lots of clear information on how parliament functions, what MPs and committees do, and so on.
• It synthesizes some very complex National Taxpayer’s Association data on missing or wasted money into a really clear ‘scorecard‘, turning large sums of money into numbers of teachers.

The codebase that Mzalendo is based on is free and open source, as always. It is a complete re-write, in a different language and framework from TheyWorkForYou, and we think it represents a great starting point for other projects. Over the next year we will be talking to people interested in using the code to run such sites in their own country. If this sounds like something of interest to you, get in touch.

Meanwhile, we wish Ory and Conrad the best of luck as the site grows, and we look forward to seeing what the first users demand.

Image by PMC FirstPix

Just a week after WhatDoTheyKnow’s big, round number, FixMyStreet also passed a significant milestone.

200,000 reports have been sent through FixMyStreet since its launch in February 2007. It currently sends an average of 250+ messages about potholes, broken streetlights, and other problems to local authorities each day. So far this month, we’ve processed just over 5,000 reports.

Those reports are the work of over 87,000 people, 52% of whom had never before reported an issue to the council. That statistic is important to us: we aim to make it easy to access civic rights, especially for people doing so for the first time.

FixMyStreet.com is a site with a simple premise, and it hasn’t changed greatly since 2007 – though it is currently undergoing a facelift, bringing it more in line with today’s design expectations. Last year we introduced user accounts and zoomable maps, along with a few tweaks here and there.

Like other mySociety projects, FixMyStreet is, of course, built on open code, so that it can be replicated by anyone with a little technical knowledge. The FixMyStreet interface is already up and running in Norway, and soon, the Philippines will see trials of their own version – proving that the model can work in very different infrastructures. Meanwhile, the basic FixMyStreet concept has been replicated in Brazil, New Zealand, and South Korea. Here in the UK, some councils have bought FixMyStreet to embed into their own websites.

FixMyStreet sends reports to the council, and also publishes them online – so each report is read by many people. This simple system helps them find out more about their local community, and what the council are doing to get things fixed.

Uneven paving stones and malfunctioning pelican crossings may not be the stuff of high drama, but against expectations, FixMyStreet does make for fascinating reading sometimes. Take a look at this page if you’d like to see some of the more unusual reports. And if you’d like some insight into some of the issues our developers deal with, you might like to read Matthew Somerville’s solution to the dog poo problem. It’s all glamour at the cutting edge of FixMyStreet.