We’ve recently introduced two new ways to locate yourself, and your reports, on FixMyStreet.

From up in the air

You might have noticed a discreet little ‘aerial’ button on the bottom of FixMyStreet’s map pages recently.

This toggles the view from the usual Ordnance Survey maps to a Bing aerial satellite view:

We hope this will make it easier for people to locate their reports accurately, in those cases where it’s a bit easier to identify landmarks from above.

This isn’t an entirely new departure for FixMyStreet: as far back as 2013 the site we made for the City of Zurich had a satellite view as default — and indeed, it still does.

At the moment, this feature is available on the nationwide fixmystreet.com, and on fifteen client authorities’ sites. Why not all authorities’ implementations? It’s basically to do with whether they have their own map servers: where we host the maps, it’s obviously more straightforward for us to deliver the alternative view.

Open Location Codes

Another option to help you find just the right spot for your report comes with the introduction of Open Location Codes, also known as OLCs or Plus Codes.

Coincidentally, these also have a connection with Zurich, as they were developed in Google’s offices there. They’re basically a more convenient and quicker way of entering latitude and longitude, and can be used to identify any spot on the planet (though of course, each FixMyStreet site has its own bounds).

As their name suggests, OLCs are open source and available for anyone to use. Want to try it out? Google Maps on mobile gives you an OLC when you drop a pin: see more details here.

This function adds to the number of ways you can search for a location on FixMyStreet from the homepage search box, which include inputting a postcode, a street name, an area, a town or city, latitude and longitude, and allowing the site to auto-locate you.

So here’s hoping these developments will allow for ever more accuracy in report locations.

 

—

Image: William Hook

 

When you consider that FixMyStreet has been running for over a decade, it’s not really surprising that the maps in some areas are a little over-crowded with pins.

That can be a problem for anyone trying to make a new report — even when you zoom right in, we were beginning to find that in some very congested areas, it was difficult to place a new pin without clicking on an existing one.

We’ve tried to remedy this in various ways in the past. For a while we only displayed newer reports by default, a decision which we discarded when we brought in pagination, allowing users to click through batches of reports rather than seeing them all in one long list on a single page.

For some time now we’ve also provided the option to hide the pins completely, via this button both on the desktop and app versions:

And there’s also a ‘hide pins’ option at the foot of the map:

But even so, arriving at a map absolutely covered in pins and having to look around for that button doesn’t exactly seem like a nice, smooth user journey, so we’ve revisited the matter.

Why not just delete the old reports?

We’ve always had a policy of keeping every report live on FixMyStreet (unless it’s reported to us as abusive, or its maker contacts us to ask us to remove it — and even in this latter case we’d prefer to retain the content of the report while anonymising it).

This is because the reports made to councils build up to create an invaluable archive of the issues that various regions of the country face, through time.

The historic collection of reports allows planners to understand recurring or seasonal problems; and researchers use this data as well, to get insights into all sorts of issues. For examples, see Réka Solymosi’s presentation at TICTeC on using FixMyStreet data to understand what counts as ‘disorder’ in the environment, or mySociety’s own research on why some areas of the country report on FixMyStreet more than others.

And so here’s what we’ve done

• When you visit a map page on the main FixMyStreet site, by default, you’ll again only see reports that are less than six months old, and that are still open.

A report remains ‘open’ until the council marks it as ‘closed’, or a user or the council marks it as ‘fixed’. ‘Closed’ means that the council doesn’t intend to do further work on the issue, which can be for reasons such as the issue not falling within their responsibilities or because it is part of their regular maintenance schedule and will be seen to in time.

• You can still opt to see closed and fixed reports by selecting from the dropdown at the top of the list:
• And you can also still see reports older than six months by clicking the checkbox:
• The two filters work together, giving you the options of displaying:
  • Open reports less than six months old (the default)
  • Open reports of any age
  • All reports less than six months old
  • All reports of any age
  • Any combination of open/closed/fixed reports less than six months old
  • Any combination of open/closed/fixed reports of any age

To keep things simpler for app users, the display there is set to only show newer, open reports, so if you want the full range of options, you’ll need to switch to viewing the site on a desktop.

Additionally, reports that have been closed for six months without any update being made will now no longer allow updates. If you need to update an issue that falls into this category, we recommend starting a new report (possibly linking to the old one for reference if it provides useful information for the council).

But you might not see this everywhere

Some councils use FixMyStreet Pro as their own fault-reporting software. These councils can opt whether or not to adopt these defaults, so your experience may be slightly different when visiting FixMyStreet via your local council’s own site.

We think that we’ve arrived at a more intuitive solution than those we tried before — and we hope that these options will suit everyone, whether you’re a user in a hurry coming to make a quick report, or someone who’d like to see a more in-depth history of the area. Give it a go, and then let us know your thoughts.

 

—
Banner image: Jim Tilley (CC by-nc-nd/2.0)

If you visit FixMyStreet and suddenly start seeing spots, don’t rush to your optician: it’s just another feature to help you, and the council, when you make a report.

In our last two blog posts we announced Buckinghamshire and Bath & NE Somerset councils’ adoption of FixMyStreet Pro, and looked at how this integrated with existing council software. It’s the latter which has brought on this sudden rash.

At the moment, you’ll only see such dots in areas where the council has adopted FixMyStreet Pro, and gone for the ‘asset locations’ option: take a look at the Bath & NE Somerset installation to see them in action.

What is an asset?

mySociety developer Struan explains all.

Councils refer to ‘assets’; in layman’s language these are things like roads, streetlights, grit bins, dog poo bins and trees. These assets are normally stored in an asset management system that tracks problems, and once hooked up, FixMyStreet Pro can deposit users’ reports directly into that system.

Most asset management systems will have an entry for each asset and probably some location data for them too. This means that we can plot them on a map, and we can also include details about the asset.

When you make a report, for example a broken streetlight, you’ll be able to quickly and easily specify that precise light on the map, making things a faster for you. And there’s no need for the average citizen to ever know this, but we can then include the council’s internal ID for the streetlight in the report, which then also speeds things up for the council.

Map layers

So, how do we get these assets on to the map? Here’s the technical part:

The council will either have a map server with a set of asset layers on it that we can use, or they’ll provide us with files containing details of the assets and we’ll host them on our own map server.

The map server then lets you ask for all the streetlights in an area and sends back some XML with a location for each streetlight and any associated data, such as the lamppost number. Each collection of objects is called a layer, mostly because that’s how mapping software uses them. It has a layer for the map and then adds any other features on top of this in layers.

Will these dots clutter up the map for users who are trying to make a report about something else?

Not at all.

With a bit of configuration in FixMyStreet, we associate report categories with asset layers so we only show the assets on the map when the relevant category is selected.

We can also snap problem reports to any nearby asset which is handy for things like street lights as it doesn’t make sense to send a report about a broken street light with no associated light.

Watch this space

And what’s coming up?

We’re working to add data from roadworks.org, so that when a user clicks on a road we’ll be able to tell them if roadworks are happening in the near future, which might have a bearing on whether they want to report the problem — for example there’s no point in reporting a pothole if the whole road is due to be resurfaced the next week.

Then we’ll also be looking at roads overseen by TfL. The issue with these is that while they are always within a council area, the council doesn’t have the responsibility of maintaining them, so we want to change where the report is going rather than just adding in more data. There’s also the added complication of things like “what if the issue is being reported on a council-maintained bridge that goes over a TFL road”.

There’s always something to keep the FixMyStreet developers busy… we’ll make sure we keep you updated as these new innovations are added.

—

From a council and interested in knowing more? Visit the FixMyStreet Pro website

The FixMyStreet codebase is used all over the world by people running versions of the site for their own country or jurisdiction. This week, we’re proud to announce the release of FixMyStreet version 2.0.

This version contains a wide array of new features that benefit FixMyStreet sites’ users, administrators, and the officials who receive reports. They include elements that the UK FixMyStreet was the first to trial, such as nicer-looking HTML emails for users and authorities, the ability to filter reports by multiple states and categories, a new admin user system with graduated permissions, and various bugfixes and development improvements.

Over the next few weeks, we’ll be publishing a series of blog posts over on fixmystreet.org/blog/, examining the changes in detail. If you run a FixMyStreet site, or you’re just interested in coding and technical issues, you may find them of interest. Meanwhile, here’s the broad overview.

New front-end features

• HTML email: There is now the option for all emails sent by FixMyStreet to be HTML formatted where previously they were plain text only. This includes confirmation and questionnaire emails to the user, and report emails to the public body. These emails include any image added to the report, plus a small static map of the problem’s location.
  
  

• State/category filtering and sorting of list pages: When viewing a list of reports, you can now filter and sort them in pretty much any way you choose, including sorting by most- or least-recently updated, newest or oldest, or most commented. You can also select multiple categories or states (e.g. “fixed”).
  
  

• Pretty area highlighting on body pages: The highlighting of areas on a body page has been inverted, so that the unimportant parts of the map are shaded and you can interact more easily with reports on the page.
  
  

• Users can now update their own email address This was a frequent request from users and we’re glad to report that they can now do it themselves on their account page.

• Performance improvements: When looking at reports from a list page, the other report pins stay visible so that it is easier to switch between them. The report itself is being pulled in behind the scenes, meaning the whole page does not need to reload. The map no longer extends underneath the sidebar and header, which makes things easier, and a scroll wheel can now zoom the map in and out.
  
  

• 

  Making privacy options clearer: The reporting form has been separated into public and private sections, to make it clearer which parts of what you provide will be made visible on the site.

  Showing the relevant recipient: If you live in an area where there’s more than one body, the category you pick normally dictates which body we send your report to. Now, when you select the category we update the name of the body given at the top of the report page, if we know that the report will be sent there.
  
  

New admin user system

Admin users can now use the same log-in right across the site – whether they’re making a report like a standard user, or logging in to make edits and moderate the site.

In the past, the distinction between admin and other users was black and white. As an admin user, you had access to every part of the site, but users can now be given individual permissions for various layers of access. These include:

• Proxy users This layer grants the ability to create a report or update on behalf of a body, or as another user. We envisage this being useful in a body’s contact centre, where they receive a report over a phone and enter it into FixMyStreet as that user;
• Report editors Giving the power to edit a report’s category, state, or location. If the admin user changes the category, and that change means that a different body is now responsible for the report, it will be re-sent;
• List makers, who can compile their own shortlist of reports they wish to go and inspect. This may be useful for a contractor or team who wishes to compile the day’s tasks;
• Quick responders These users have access to response templates, allowing them to edit and publish templated updates;
• Prioritisers These users may set different priorities on reports;
• Trusted users A simple reputation system, which e.g. potentially lets reports from trusted users be actioned more quickly.

The admin report edit form has also been greatly improved, including a map to update a report’s location (and re-sending the report if the body changes), and much tidier layout.

Bugfixes and development changes

Bugfixes include updating the top-level domain (TLD) list for email validation, hiding authorities which don’t exist any more on the all reports page, and fixing the previously-broken photo preview display after form submission. We have dropped support for Internet Explorer 6.

If you’re a re-user of the codebase, there are a number of changes that will hopefully help you out. See the extended version of this blog post on fixmystreet.org for more details.

If you have any questions, or problems installing the code, please do get in touch, or post on our mailing list.

Census data: there’s lots of it. It contains fascinating insights.

But as with many huge datasets, those insights are not always easy to find at first glance — nor is it easy for the untrained observer to see which parts are relevant to their own lives.

Wazimap in South Africa takes the country’s census data and turns it into something the user can explore interactively. Originally conceived as a tool for journalists, it turned out to be so accessible that it’s used by a much wider range of the population, from school children to researchers. It’s a great example of how you can transform dry data into something meaningful online, and it’s all done using free and open source tools.

Our points-to-boundaries mapping software MapIt is part of that mix, putting the data in context and ensuring that visitors can browse the data relevant to specific provinces, municipalities or wards.

We asked Greg Kempe of Code for South Africa, to fill us in on a bit more.

What exactly is Wazimap?

Wazimap helps South Africans understand where they live, through the eyes of the data from our 2011 Census. It’s a research and exploration tool that describes who lives in South Africa, from a country level right down to a ward, including demographics such as age and gender, language and citizenship, level of education, access to basic services, household goods, employment and income.

It has helped people understand not just where they work and live, but also that data can be presented in a way that’s accessible and understandable.

Users can explore the profile of a province, city or ward and compare them side-by-side. They can focus on a particular dataset to view just that data for any place in the country, look for outliers and interesting patterns in the distribution of an indicator, or draw an indicator on a map.

Of course Wazimap can’t do everything, so you can also download data into Excel or Google Earth to run your own analysis.

Wazimap is built on the open source software that powers censusreporter.org, which was built under a Knight News Challenge grant, and is a collaboration between Media Monitoring Africa and Code for South Africa.

Due to demand from other groups, we’ve now made Wazimap a standalone project that anyone can re-use to build their own instance: details are here.

How did it all begin?

Media Monitoring Africa approached Code for South Africa to build a tool to help journalists get factual background data on anywhere in South Africa, to help encourage accurate and informed reporting.

Code for South Africa is a nonprofit that promotes informed decision-making for positive social change, so we were very excited about collaborating on the tool.

How exactly does MapIt fit into the project?

Mapit powers all the shape boundaries in Wazimap. When we plot a province, municipality or ward boundary on a map in Wazimap, or provide a boundary in a Google Earth or GeoJSON download, MapIt is giving Wazimap that data.

We had originally built a home-grown solution, but when we met mySociety’s Tony Bowden at a Code Camp in Italy, we learned about MapIt. It turned out to offer better functionality.

What level of upkeep is involved?

Wazimap requires only intermittent maintenance. We had municipal elections in August 2016 which has meant a number of municipal boundaries have changed. We’re waiting on Statistics South Africa to provide us with the census data mapped to these new boundaries so that we can update it. Other than that, once the site is up and running it needs very little maintenance.

What’s the impact of Wazimap?

We know that Wazimap is used by a wide range of people, including journalists, high school geography teachers, political party researchers and academics.

It has helped people understand not just where they work and live, but also that data can be presented in a way that’s accessible and understandable.

Code for South Africa has been approached a number of times, by people asking if they might reuse the Wazimap platform in different contexts with different data. Most recently, youthexplorer.org.za used it to power an interactive web tool providing a range of information on young people, helping policy makers understand youth-critical issues in the Western Cape.

We also know that it’s been used as a research tool for books and numerous news articles.

The success of the South African Wazimap has driven the development of similar projects elsewhere in Africa which will be launching soon, though MapIt won’t be used for those because their geography requirements are simpler.

What does the future hold?

As we’re building out Wazimap for different datasets, we’re seeing a need for taking it beyond just census data. We’re making improvements to how Wazimap works with data to make this possible and make it simpler for others to build on it.

Each new site gives us ideas for improvements to the larger Wazimap product. The great thing is that these improvements roll out and benefit anyone who uses it across every install.

—

Thanks very much to Greg for talking us through the Wazimap project and its use of MapIt. It’s great to hear how MapIt is contributing to a tool that, in itself, aids so many other users and organisations.

If you’ve visited the MapIt site this week, you might have noticed a change: we’ve introduced key-based authentication for API users.

This enables us to be more flexible about how we provide our service, which means you can be more flexible about how you serve your users.

MapIt is both an open source application and, via https://mapit.mysociety.org, a web service. Use of the API is free for low-volume, charitable use, while all other uses require a licence.

For the moment API keys are optional. We’ll always offer a free level of service to support independent developers and charities.

We’ll have more details soon about the increased flexibility this change will bring.

—

Image: Clare Black (CC)

Our Mapumental software shows journey times on a map, with exciting results.

But there’s more: combined with other datasets, it can answer a wide variety of questions, be put to a wide variety of uses across many industries.

Most recently, we worked on a version for the Dolphin Square Foundation. Their remit requires them to find properties within a specific travel time from the centre of London, and with the best net yield—a perfect challenge for Mapumental. You can read what we did here.

You may see some similarities with our Mapumental Property, which combines house prices with transit time, so property hunters can see what’s available both within their budget and within a tolerable commute of their workplace.

We’ve used Mapumental for many a time-based travel conundrum, like our project with the Fire Protection Agency that drew on fire engine response times to  calculate risk-based insurance premiums for any given postcode. Or the work we did for the Welsh Government, plotting accessibility of schools.

Like we said, Mapumental is flexible enough to work in all sorts of fields, for all sorts of purposes. Take a look at our Dolphin Square case study to find out more about its latest incarnation.

 

—

Image: Garry Knight (CC)

A Freedom of Information request sent through WhatDoTheyKnow asked for a ‘geographically accurate’ map of the London Underground, Overground, Docklands Light Railway and National Rail services.

The response provided just that. If you’re used to the rigid lines of the iconic tube map, there’s plenty to surprise and delight you here, as Buzzfeed via City Metric were quick to point out.

According to a postscript on that story, TfL have since commented:

This map was produced for engineering works planning and wasn’t designed for customer use, however we are happy to make any maps available which help our customers to travel in London. This map will therefore be added to our website.

Great result. We hope that thanks to Buzzfeed’s viral spread, from today, plenty more people understand the potential of FOI to change things for the benefit of many.

Not many people realise that we fund a proportion of our charitable work by carrying our commercial development and consultancy work for a wide range of clients.

Last year, we scoped, developed and delivered a real variety of digital tools and projects. Some of the projects were surprising. Some of them made us gnash our teeth, a bit, as we grappled with new problems. But all of them (and call us geeks if you like) got us very excited.

Here are just twelve of our personal high points from last year. If you have a project that you think we might be able to help you with in 2015, we’d love to hear from you!

1. We Changed the Way in Which Parliament Does Digital

This time last year, a small team from mySociety was poring over analytics, interview content and assorted evidence from Parliament projects dating back last 2-3 years, to help us put together a simple set of recommendations to conclude our review.

11 months later, Parliament have announced their first Head of Digital, fulfilling one of our key recommendations.

2. We helped the MAS and the FCA protect financial consumers

Two of our projects helped people financially.

We built the Money Advice Service’s (MAS) first responsive web application, the Car Cost Calculator.

This tool takes one simple thing you know (the car you wish to buy) and tells you roughly how much it’ll cost to run that car against any others you might be interested in. It has been one of MAS’ most successful online tools in terms of traffic and conversion.

We also built the Financial Conduct Authority’s Scam Smart tool, aiming to prevent financial scams.

This tool helps users considering a financial investment to check a potential investment. Users enter information about the type of investment, how they heard about it and the details of the company offering it to them and get back tailored guidance and suggested next steps to help them ensure the investment is bona fide.

3. We Gave Power to the People of Panama (soon)

Working with the The National Authority for Transparency & Access to Information (ANTAI) and the Foreign & Commonwealth Office (FCO), we set up our first government-backed instance of our Freedom of Information platform, Alaveteli, in Panama.

This project will ensure that Panama’s FOI legislation is promoted and used, but it will also shine a light on ANTAI, who are responsible for ensuring ministries and organisations publish their information, and handling case appeals.

4. We Mapped All the Public Services in Wales

After we extended the Mapumental API to produce data output suitable for GIS (geographical information systems), the Welsh Government were able to map public services in Wales for their Index of Multiple Deprivation calculations.

Over the course of the year they have calculated travel times for over seventy thousand points of interest.

5. We Launched a New Organisation in Four Weeks

Simply Secure approached us in dire need of a brand, an identity and a website to accompany the launch of their new organisation to help the world build user-friendly security tools and technologies.

Cue four weeks of very intense work for mySociety’s designer, supported by members of the commercial team. And we did it.

6. We Printed Stuff BIG (and found people jobs)

mySociety developer Dave Arter figured out how to generate A1 sized maps from Mapumental for every job centre in the UK – all 716 of them.

Xerox will be using these with the DWP to help job seekers find work that is within reach by public transport. As a byproduct, Mapumental now handles high-fidelity print based outputs: get in touch if that is of interest.

7. We Opened Up Planning Applications

With Hampshire County Council we had the opportunity to build a new application to help assist members of the public and business better understand what was happening around them. For us, it was also the first application in which we worked closely with a provider of a linked data store, in this case Swirrl.

When Open Planning goes live, it will look to help improve social engagement and the economy of Hampshire through better understanding and transparency of planning data.

8. We Proved (Again) That FixMyStreet Isn’t All About Potholes

After a spate of cyclists’ deaths in London last year, we felt that the moment was right to build something that would support cycle safety in the UK.

We launched Collideoscope on October the 7th with our first sponsor—Barts Charity, with the aim of generating data both on incidents involving cycles, and near misses.

9. We Helped Launch a Film

We built a tool for the British Museum, to go alongside the general release of Vikings Live. The Norse Names project brought a sense of context and personalisation to a dataset gathered by the University of Nottingham.

10. We Made Data More Exciting

In 2013, we built an interface to help people explore the data in the National Rail Passenger Survey (NRPS) data explorer  for Passenger Focus.

This year, they asked us to build something similar for bus users. We’re entering the final week of development now, and the finished product should be launched in March.

The main aim of this site? To take data that could be considered pretty dry, and make it a lot more engaging.

11. We Fixed Yet More Potholes

This year Warwickshire, East Sussex, Hart & Harrogate joined the list of councils using FixMyStreet as their main street fault reporting platform.

That means that residents of those places can now make their reports direct from their council’s website, or via FixMyStreet, and either way they’ll have all the benefits of FixMyStreet’s smooth report-making interface.

12. We Showed Parliament the Way

And so, we end where we began. While Parliament were busy interviewing candidates for their new ‘Head of Digital’ position, we were commissioned to demonstrate what Hansard might look like were a platform like SayIt used instead of the largely print-based publishing mechanisms used today.

The result was shared internally. While SayIt may not be the end solution for Parliament, it’s great to have had some input into what that solution might be.

And in 2015…?

Got a project that you’d like us to be involved in?

Get in touch and tell us about it.

Image credits:

Eggs: Craig Sunter; Parliament: Greg Dunlap; Bubble car: Allen Watkin; To the Trains: Nic McPhee; Potholes: Tup Wanders; Parliament Duncan Harris. All Creative Commons.

 

So we wanted to build an app for FixMyStreet. Easy: we just had to make a cut-down version of the website, right?

Hmm, not quite.

In our two recent posts, we announced the new FixMyStreet apps, and their developer Struan went into some technical detail about why and how we built them.

Now he explains a little more about what informed the decisions he made during the apps’ development.

Moving the map, not the pin

When you use the desktop version of FixMyStreet, the first thing it asks for is your location, and there’s a good reason for that. It’s such a good reason that it needed to apply to the app as well.

On the desktop site we ask you to input your postcode or street name. With a mobile app, it’s much more likely that you’ll be reporting a problem that’s right in front of you, so we can usually skip that step and show you a map of your current location.

However, while the accuracy of geolocation technology is pretty good, it’s not perfect, so we wanted to let users fine-tune the location.

On the website you click on the map to drop a pin where the problem is, but we’ve found this isn’t the best solution on a small screen. Fingers are big and the end of a pin is small so it can take several clicks to correctly position the pin.

We quickly realised that having a central static crosshair, and moving the map to the location was a much easier and more accurate way to set a location.

Sending reports made offline

As we explained in the previous post, one of the benefits of the apps over the mobile site is that you can make reports even if you have no phone coverage. The app stores all the details until you get back within range and you’re ready to send it off.

One decision we made, which might seem initially puzzling, is that these offline reports don’t automatically get sent off to the council once you’re back within range of a phone or wifi signal.

There are two linked reasons for this, and they’re both related to the fact that FixMyStreet lets you report a problem even if you don’t know who to send it to.

Simply, before we can work out who to send the report to, we need to know exactly where you are – and that you are within FixMyStreet’s area of coverage (ie, within the UK).

Your location also dictates the categories that we show you. Each council has its own categories, and in areas covered by two tiers of government, each council will deal with different types of report. So for example, your county council might deal with potholes, while your district council handles dog fouling.

Once you’re back online we can check that the location is one we can accept a report about, and then fetch the list of categories for you to pick from.

In effect, this delay is also a second chance for you to check your report before you send it off, although that was never the reason for the decision!

The constant map

The final decision we made was to leave the map in the background at every step of the app process.

We initially designed it with the map only appearing when you needed it, but having the map underlying the reporting process provides a nice bit of continuity with the website, and seemed to make the app cohere better too. So, while there’s no particular reason for it to be there, we made the decision to keep things uniform.

If anything else about the app has got you wondering, do feel free to leave a comment below!

Photos by Cali4Beach and Christopher Bulle, and adapted from an image by Premshree Pillai (CC)