Links

• Online version of this document
• Application form
• Potential collaborators form
• Join the research commissioning mailing list/Research pool
• Download PDF

In one sentence

mySociety is looking for an individual, organisation or joint team to explore requests made through WhatDoTheyKnow.com to understand how requests for environmental information are being used in practice, highlighting success stories in releasing information at the local level, problems requesters encountered, and suggestions on how mySociety could better make use of the environmental information requests. 

About mySociety

mySociety is the charity behind UK civic services like TheyWorkForYou, WhatDoTheyKnow, FixMyStreet, and WriteToThem. We build open, digital solutions to help repower democracy, in the UK and around the world.

mySociety’s climate programme is funded by Quadrature Climate Foundation and the National Lottery Community Fund.

About mySociety’s existing work in this area 

mySociety’s Climate Programme is exploring how digital tools and approaches can work to reduce the third of UK emissions that local authorities have influence over. A key focus of this work is improving the quality and quantity of information that exists around local climate action. We make local authority plans more accessible and visible, campaign for better official data, and support pooling and crowdsourcing of data to improve knowledge and accountability for climate action. You can read more about mySociety’s Climate programme here.

WhatDoTheyKnow.com is a website built by mySociety, and administered by mySociety in partnership with volunteers, that helps people make Freedom of Information (FOI) requests and publishes the results in public. Over 900,000 FOI requests have been made through this platform. We have published research looking at the scale of FOI in local government, and in improving FOI through the UK, and Europe. 

About this project

Our ultimate goal in our climate work is to decrease UK carbon emissions that are either directly controlled or influenced by UK local government. Our main approach is by improving the information environment so that a variety of local institutions and actors are better able to understand the current situation, share knowledge on their approaches, and take more informed action. We have done this by making local authorities own plans and documents more discoverable and searchable, supporting crowdsourcing of information about plans and actions, pooling information held by different groups of campaigners, and arguing for improved publishing of official information. 

Another method open to us is to use (or facilitate the use of) Freedom of Information laws to get more official data and information into the public domain. Freedom of Information laws give a wide range of public access to information held by authorities. This is useful in releasing information about authorities’ own plans and actions, but is also useful in releasing underlying information which local authorities, so that other organisations (including companies, charities, and other public sector bodies) can use to inform their own approach and actions. 

The Environmental Information Regulations (EIR) substantially overlap with Freedom of Information. EIR requests make it easier to ask for and receive information specifically related to the environment, and covers a wider range of organisations than the general Freedom of Information law. We believe there is the potential to use improved support and guidance for Environmental Information Requests to facilitate more information relevant to local climate action being released, and being made discoverable by local authority actors, civil society and communities. This might take the form of modifications to WhatDoTheyKnow, or light-weight specialist services that sit on top of WhatDoTheyKnow’s FOI archive and infrastructure (similar to FragDenStaat’s Climate Helpdesk). 

But before we can do that, we want to understand more about Environmental Information Requests. WhatDoTheyKnow’s archive gives us access to a huge number of requests made for environmental information, but we understand very little about the contents of these requests. 

Based on a quick text search, we have a maximum of 70,000 requests that in some way mention environmental information regulations. As part of our wider pool of 1 million FOI requests, there may be other requests with environmental interests that have not explicitly mentioned EIR. We are looking for a contractor to explore the large WhatDoTheyKnow dataset, and highlight themes, patterns, and individual examples that show how EIRs are being used, obstacles users are encountering, and the implications of this for mySociety’s future work in this area. 

The available budget for this work is up to £8000-10,000 (inclusive of VAT), and the project would need to be completed by the end of July. There is a small amount of flexibility on this end date – but we are looking to make decisions in August about best ways to follow up the project in September. 

What we want to know more about

The broad goal of this project is to refine our understanding of how EIR works in practice. We’ve broken this into six areas we’d like to understand more about. 

1. EIRs have fewer exemptions, and a higher threshold for withholding material on public interest grounds, than FOI and. In principle, relevant information should be easier to get through EIR, but it is unclear how much this is significant in practice. We want to know more about the kinds of information that are successfully being released through EIR.
2. EIRs apply to more types of organisation – and organisations that have an important local footprint may be accessible to FOI. We want to know about the kinds of institutions and authorities who are or could be releasing information under EIR that is relevant to our local emissions goals.
3. Authorities should consider which regime a request falls under – and default to the more permissive EIR regime when a request is for environmental information. We want to know if there are cases where information is being withheld under FOI but should have been considered under EIR.
4. EIR might be more poorly understood by both requesters and authorities – information may be being incorrectly withheld that should be released. We want to understand any patterns of refusal that would inform advice tools. 
5. At the moment we don’t have an automatic way of identifying EIR responses (when authorities have judged a request under these rules), but it should be possible to create classification rules that separate them from FOI requests. We want to refine this approach so we can more consistently identify and analyse EIR responses, so they can be in current or future local climate services.
6. The big way in which EIRs are less accessible is that authorities can charge fees without a minimum amount of time taken, which is the case for FOI requests. Generally we think this doesn’t happen much (the ICO’s guidance is not to charge for a reasonable request), but we don’t know. We want a clearer sense of how often authorities ask that requesters pay a fee for environmental information.

What we are looking for in and from a partner

Expertise / skill set

We think there are a few different approaches to this project and are open to a range of approaches. In general we anticipate two main kinds of applicants: one leaning more on technical ability, and the other on specialist knowledge of FOI and EIR, or environmental data more broadly. For either kind of applicant, we can provide basic support in the other skillset. The ideal candidate would cover all of these bases (where a subject matter expert makes the technical search process sharper) – and we can help facilitate partnership applications between technical and specialist partners who might otherwise submit separately. If you are interested in this route, please fill out this collaboration form and we can help put you in contact. 

The key thing an applicant needs to have is an approach to searching the large quantity of information on WhatDoTheyKnow. At a minimum this requires some technical skills and ability to navigate the site – but beyond that might be accomplished by large scale text analysis, or a sampling and search method. WhatDoTheyKnow’s search allows searching for specific search terms – but the search count is not always accurate for larger queries. 

For technical strategies, we can provide data exports to enable searches off-platform. But for subject matter experts, we can also provide an Excel sheet of links to URLs that have triggered particular keywords, and authorities. 

Something that is important to us is being able to point to individual examples – and so approaches based on aggregate analysis (which might be the better approach to identify the scale of fees being charged, for instance, or automatically analyse themes of requests) need to also be able to drill down to individual requests. 

With this in mind, the following is a list of skills we would expect the candidate to have a couple but not necessarily all of the following:

• Technical skills
  • Experience with search and processing large amounts of text delivered in a mostly unstructured way.
  • Experience with Natural Language Processing (NLP) or automated topic extraction. 
• Subject matter skills
  • Knowledge and experience of Freedom of Information and/or Environmental Information Requests
    • Especially practical understanding of refusal and appeal grounds in both FOI and EIR.
  • Less important, but understanding of the wider European context of Environmental Information Regulations might provide additional understanding of potential approaches mySociety could take in the UK. 

Alignment with values and aims

Our Repowering Democracy strategy puts a special emphasis on embedding equity and inclusion in our work practices and services, and our work aims in general to fulfil values of equity/justice, openness and collaboration. 

Applicants should consider if this presents any obstacles to a working relationship, and think about how these values should be reflected in the project plan, either in terms of subject matter to investigate, or research approach.

Working practices

mySociety works flexibly and remotely, and there is no requirement to work from or visit an office. Applicants can distribute their work as appropriate over the time available, but we would expect regular check-ins on progress to be arranged over that period. A shared Slack channel and a specific contact person will be used to help coordinate and quickly share questions and information between mySociety and the researcher. 

Successful applicants would be expected to abide by the mySociety Code of Conduct in mySociety communications channels and events. 

Outputs and deliverables

The purpose of this project is to inform mySociety’s future projects, especially forming the base of knowledge around the use of EIRs for a prototyping week.

We are open to the form of outputs – this may take the form of one large report, briefings around our individual question areas, proposed amendments to guidance, etc. For technical submissions, analysis code under an appropriate licence would form part of the output.

The outputs should also work as a general contribution to knowledge of the current use of EIRs, and we might either publish or edit down and publish these briefings/reports.

Q&A and contact details

The application timeline includes a Q&A event, to which you can sign up at the link at the top of this document. The Q&A session will include an element to help individual researchers coordinate to form a joint submission (applications are also welcome from individual researchers). Answers will be made available in a video on this page for applicants who cannot take part. Questions can be emailed to the contact address below. 

Please send any queries or questions to research-commissioning+eir2023@mysociety.org and mention which project it is in regard to. Questions in advance are preferred and will be prioritised in the session. 

Your application

Applications can be submitted by individuals, organisations, or joint teams of individuals/organisations. These should be sent to research-commissioning+eir2023@mysociety.org by the closing date. 

You should submit a short application, of up to 4 pages of A4. A template for the response can be downloaded at the link at the top of this page, and covers: 

• Who you are (whether an individual, organisation, or joint team).
• A description of your previous experience/previous work and why you want to take on this project.
  • To the extent that this is possible, this should be anonymous and not include names of the org or members of the team (to help with anonymous stages of the recruitment process)
• How you would approach and deliver this project – a short project plan with approximate timings. 
  • This could include discussion of appropriate outputs for the project, and balancing technical and subject matter requirements. 
• The total value (£) of your proposal (including VAT), and high-level breakdown of costs (perhaps an indication of days per person, any other expenses). This does not need to include production costs of the report. 
  • Given the cost of the project, we will not be giving a great deal of weight to budget plans so please keep this short and high-level – we can dig into further details during interviews, if necessary.
• A short description of the individuals or team who will do the work, including biographies

There is a separate equalities monitoring form to fill out, which is processed separately from the main application (there is a link to the form in the application form). This is for understanding the reach of our method of distributing the call for proposals. 

If you are interested in joining a ‘researcher pool’ mailing list that we will contact with details of future projects, please see the link at the top of this document. 

Application timeline

If there are changes during this timeline, the table on the website version of this form will be updated. 

Stage	Date	Description
Call for proposals published	7 March 2023
Q&A Webinar	21 March 2023	An open, online public event for interested bidders to learn more about the project and ask questions. This will be recorded and available afterwards. You can submit questions in advance to research-commissioning@mysociety.org. Questions in advance are preferred.
Questions answered	23 March 2023	Video of the webinar to be made available to all potential bidders, in addition to answers to any other questions submitted via email
Deadline for applications	31 March 2023 (end of day)
Initial decisions	7th April 2023	Applicants to be informed whether they have made it through to a short panel interview (and may be asked for a sample of existing work). Applicants not progressing past this stage to be offered written feedback
Interviews	w/c 10 April 2023	Format to be decided, but this will likely be a one-hour panel interview with several people involved in the climate programme, towards the end of the week (14th, 15th April)
Final decision	w/c 18 April 2023	Remaining applicants to be informed of the final decision. Applicants not progressing to be offered feedback
Project briefing/kick-off meeting	End of w/c 18 April 2023	To include a brief introduction to mySociety, discussion of any onboarding required and approach to project management, communication and catch-ups
Project deadline	End of July 2023	End of project (Time range of project is a little flexible – we want it to inform decisions in August about any follow up work in September)

What happens after the project 

We intend to publish the report or briefs you produce, credited to you, on the mySociety website, licensed under a Creative Commons licence (see recent publications on research.mysociety.org for details). We may make some light edits (beyond proofreading) before we publish. You will be free to make publicly available your own version should you wish to, and any other material based on the research you conducted. 

We will convene a short ‘lessons learned’ session for the contractor and mySociety to discuss how the project went – what went well and anything that could have been improved. We will also discuss any future work based on the delivered project (e.g. if you are an academic and might want to co-author an article) and our ongoing relationship. We would also like to arrange a presentation on the project to mySociety staff, and there may also be an opportunity to promote the work in a public event held by mySociety (budgeting for this would be separate to the project above). 

Terms and conditions

Interested parties must be UK-based individuals or organisations.

 

Questions and Answers

 

For data analysis, what format is the data available in?

We create a regular research export of the database in CSV format. This doesn’t include the last few months of data and removes requester names where possible (this is generally available on the website, but we are trying to future proof against information being too available if redactions are needed in future).

There is a a data table of requests made by authority, and then a dataset of the individual messages (with full text) for each request. 

We currently don’t make the downloaded files themselves available in bulk (but are accessible through the site) – but the bulk export does include any cached conversion of a word document or pdf attached.

We can produce reduced data sets limited to specific authorities or keywords. For instance, to those flagged as potentially EIR projects at the start.

WhatDoTheyKnow data sharing policy for bulk data

What is the time scale for the research?

Broadly we’re looking for work to be completed by the End of July to help us inform how we spend our time in September. Depending on the nature of outputs, there may be some flexibility around this.

The retained EU law will ‘sunset’ EIR at the end of the year, unless explicitly retained. How does this work relate to that?

Our current default assumption is “everything will be fine” and this project can proceed as if EIR will continue past 2023. In the event it is looking like everything is not fine, this research helps us understand more about the impact of EIRs for campaigning purposes.

How have you handled projects like this before and how have they worked?

We’ve previously commissioned two pieces of research: one was about how we should commission research, the other was the role of local government in climate change. In both case we worked with a sole researcher, with regular check-in meetings and a shared slack channel. That said, we’re open to group applications (and this project may be appropriate for that). Neither of those projects was particularly data heavy, but we have worked to provide external researchers with data before. 

What support will you give the project?

The main support and contact for the project will be Alex Parsons (Senior researcher) from aa research and data perspective. There is limited available of the WhatDoTheyKnow on a day to day basis team – but I can either answer questions or get answers to questions we need to know.

—

If you have any other questions about this project or the application, please email : research-commissioning+eir2023@mysociety.org

As a joint project between mySociety and the Centre for Public Data, we have written a set of simple principles for how to get the most impact out of publishing public data.  You can read the report online, or download it as a PDF. 

Fragmented public data is a problem that happens when many organisations are required to publish the same data, but not to a common standard or in a common location. Data is published, but without work to join up the results, it rarely has the intended impacts. 

The results of this are frustrating for everyone. Data users cannot easily use the data, policy makers do not see the impact they want, and publishers in public authorities are required to produce data without seeing clear results from their work. 

Better and more consistent publication of data by local authorities helps enable understanding and action at scale across a range of areas. At the same time, we recognise that the technical advice given has assumed higher levels of technical capacity that in practice is possible for many data publishing tasks. Our goal has been to make sure our advice makes data more accessible, while having a realistic idea of technical capacities and support needed for data publishing. 

This report recommends three minimum features for a data publishing requirement to be successful: 

1. A collaborative (but compulsory) data standard to agree the data and format that is expected.
2. A central repository of the location of the published data, which is kept up to date with new releases of data.
3. Support from the data convener to make publication simple and effective – e.g. through validation and publication tools, coordinating returns, and technical support.

We recommend that:

• Whenever government imposes duties on multiple public authorities to publish datasets in future, it should also provide the staff and budget to enable these features.
• The Central Data and Digital Office should publish official guidance covering the above.

You can read the report online, or download it as a PDF. 

Better data publishing helps climate action

This project is informed by recurring frustrations we have run into in our work. Projects such as KeepItIntheCommunity, which mapped registered Assets of Community Value, were much more complicated than they needed to be because while transparency was required of authorities, coordination was not – meaning the task of keeping the site comprehensive and updated was enormously difficult. In principle, we could build a tool that empowered communities in line with the intentions of the original policy makers. In practice, a lack of support for basic data publishing made the project much harder than it needed to be.

This problem also affects our work around local government and reducing emissions. Local government has influence over one third of emissions, but much of that is indirect rather than from the corporate emissions of the authority directly.  As such, many activities (and datasets) of local government have climate implications, even if the work or data is not understood as climate data. For instance, the difficulty in accessing the asset data of local authorities makes it harder for civil society to cross-reference this information with the energy rating of properties, and produce tools to help councils understand the wider picture. 

In future we will be publishing in more detail the kind of data we think is needed to support local authorities in emission reduction – but emissions reduction cannot be isolated from the general work of local authorities. Improving the consistency of the data that is published helps everyone better understand the work that is happening, and makes local government more efficient. 

Sign up to hear more about our climate work, or to the monthly mySociety newsletter. 

Photo credit: Photo by Olav Ahrens Røtne on Unsplash

The ICO has launched a consultation on how it plans to prioritise Freedom of Information (FOI) complaints. 

We have prepared a draft response that explains the context of the consultation, and our current position. 

We are releasing this draft before the deadline for feedback so we have time to get input from WhatDoTheyKnow users or other interested organisations/individuals.

If you have any comments on our response, please fill out this survey.

If you’d like to make your own response, you can also respond to the ICO directly. You do not have to have an opinion on all questions to make a response. The deadline for submissions is 5pm on 19th December 2022.

A summary of our planned response:

• The ICO thinking strategically about how to prioritise case work is a really useful exercise; our main concern is whether there are better, higher impact uses of time than those proposed. 
• The purpose of the complaints system is not to release information, but to steer the whole FOI regime. Rather than focus on high impact requests, it would be better to look for strategic interventions to unblock common problems experienced by high impact requesters. 
  • Recommendation: Add a prioritisation criteria and process around administrative silence/stonewalling.
  • Recommendation: Use discretion to pay special attention to complaints from authorities where there are repeated problems. 
  • Recommendation: Build statistical knowledge of the whole FOI system (especially internal review) to support earlier and more effective intervention.
• We disagree in principle with prioritising classes of requesters (e.g.. journalists and civil society organisations), and on practical grounds do not think this is the most effective way of achieving the ICO’s goals.
  • Recommendation: reframe these as criteria for the kinds of requests from these groups that would benefit from faster treatment (e.g. time sensitive requests, stonewalling).
  • Recommendation: Alternatively, redefine criteria as kinds of activity rather than requester (‘journalism’ rather than ‘journalists’). Make these more porous categories (where many requests may qualify) and only fast-track a certain percentage of them to manage the overall volume. 
  • Recommendation: As one of these porous categories, if the destination of the request is to a public repository (like WhatDoTheyKnow), this should be seen as a request having a higher public impact. 
• The consultation reflects a view that the impact of FOI is primarily through intermediaries, making high impact requests in the public interest. We believe that the public interest needs to be viewed as wider than the result of high impact requests. There is enormous public value collectively even for privately motivated requests.
  • Recommendation:  Change the definition of frivolous from ‘low public interest in information requested’ to ‘low public interest in pursuing the complaint’.

Our reasoning can be read in full, and there are bullet pointed summaries for each consultation question towards the end of the document if you are looking for inspiration for your own response. 

Header image: Photo by Mihai Lazăr on Unsplash

---

---

Freedom of Information is a right that gives people power over public authorities. The case for FOI is often made on the high profile investigations and the public disclosure of scandals. But the value can be also seen in the quiet success of ordinary citizens being able to access information from the public authorities that hold power over their lives.

We ran a poll with Opinium to find out how widespread the use of Freedom of Information is. We found that 10% of UK adults have used FOI to try and get information they thought would be useful to themselves, their community or wider society. When including people who made a request as part of their work, this figure goes up to 14%. 

Giving evidence to Parliament, the former Information Commissioner said that “one in 1,000 citizens in the UK will file a Freedom of Information Act request, but journalists are standing in their shoes. It is through journalists that the public can understand or get to know why decisions are being made on their behalf. Journalists, public interest researchers and advocacy groups are important requesters”.  This is an important point about the value of Freedom of Information even if it is only used by a few, but based not just on our polling but the ICO’s own polling, this figure is 100 times too small. Freedom of Information is not a niche right, or mainly used by journalists,  but has been used by millions of people. 

Alongside a team of volunteers, mySociety runs WhatDoTheyKnow, a website that helps people make freedom of information requests (so far over 850,000 requests), and displays the results of those requests in public, so more people have access to the results. 

Through running this website, we’re very aware of the many different ways Freedom of Information is used by people, in ways that are not captured by official FOI statistics. We want more and more people to be able to use their information rights, and we want more and more of them to be using WhatDoTheyKnow so that what they find out is available to all.

We want to be doing more to support and advocate for people using their right to know, and see it as our role to be a voice for our users, and this large group of ordinary FOI users, in arguments about the future of Freedom of Information.

We’re proud of what we’re able to do with a small budget, but we want to do more. If you want to help us do that, there’s a number of things you can do:

• If you’ve benefited from Freedom of Information, or support our mission to make information more accessible, please consider making a regular or one-off donation to support our work. 
• If you’re not able to donate now, please join our newsletter so we can keep you up to date with our work and campaigns. 
• If you’re a journalist, researcher or campaigner, have a look at our pro service, which for £10 a month provides a wealth of features to help make and manage requests. 
• If you’re interested in volunteering time, WhatDoTheyKnow as a day-to-day service is run by a dedicated group of volunteers. If you’re interested in getting involved, you can learn more on the volunteering page. 

To read more about the numbers behind the polling, and how we validated it, please see this companion blog post. 

---

Header image: Photo by Samuel Regan-Asante on Unsplash

---

This blog post is a companion post to a shorter blog post explaining the significance of this polling to mySociety’s FOI work.

We know very little about the real picture of Freedom of Information use because there are not comprehensive statistics. Information on users of Freedom of Information is very hard to come by.  We have some information through a survey we run on WhatDoTheyKnow, but we know this only covers the minority of requesters who use our service. 

Knowing about this picture is important to us for several reasons.

The first reason is one of the big benefits to society of WhatDoTheyKnow is that we make public information easier to discover without explicitly asking for it. If we can know more about how many FOIs are being made in total, we can have a better sense of what proportion of this information we’re publishing (based on some of the maths below, It’s probably somewhere from 5-10%). 

The second reason is that conversations about the pros and cons of freedom of information can be dominated by the problems journalists experience in requesting information from the central government. This is a big and important problem, but it shifts the general understanding of the impact freedom of information has had on our society. Through WhatDoTheyKnow, we get a glimpse of a bigger world when citizens are making requests that affect them and their communities – but we don’t see everything, and getting more information about this is vital in informing how we approach our policy and campaigning work. 

As part of a “Giving Tuesday”, Opinium gave five survey questions (for a national representative survey panel)  to a number of charities, including mySociety. We used one of these questions to find out how many people had made a freedom of information request. The rest of this blog post explains the results of that survey. 

The question we asked

Our data comes from an Opinium survey of a representative selection of UK adults that ran between 30th November – 3rd December 2021. Respondents were asked:

The Freedom of Information Act gives you the right to request a large range of information from public authorities (government departments, local authorities, NHS trusts, schools, etc). These are called Freedom of information requests. Have you ever made a Freedom of Information request?

Respondents had the option of responding:

• No I haven’t made a request, and I am not aware of Freedom of Information
• No, I am aware of freedom of information but haven’t used it
• Yes, as part of my job
• Yes, to find out something that might be useful for me personally
• Yes, to find out something that might be useful to my community/society in general
• I’m not sure / NA

Results

mySociety/Opinium polling in 2021 found that 10% of UK adults have used FOI to try and get information they thought would be useful to themselves, their community or society. When including people who made a request as part of their work, this figure goes up to 14%. When looking just at personal use, the figure is 6%. Overall, a majority of people (62%)  had either used FOI or were otherwise aware of it. 

There was a small gender difference in both awareness and use of FOI, with men having higher awareness than women (68% to 57%), and greater use (16% to 11%). Our polling found that the 18-34 age group were the least aware of Freedom of Information (55%), but were also the age group most likely to have made an FOI request (25%). This is possibly partially explained by a much higher rate of using it as part of employment in younger demographics (12% compared to 6% overall), but the number using it for other reasons is still notably higher (some more discussion of this further down). Looking at respondents by nation/region, there was a less than expected proportion of people who made a request in Wales (6%) and Northern Ireland (2%), but a greater number who made a request in London (28%).

Validating these figures

When I first saw some of these figures, I was a little surprised and wanted to explore some different ways to validate the number.

Digging into it, I found that other polls asking different versions of the question show a similar figure, and back of the envelope calculations based on known statistics suggest the basic ballpark is right – there are millions, rather than hundreds of thousands, of people who have used the Freedom of Information Act. 

Part of the reason this figure might be surprising is that our statistical picture of Freedom of Information is so poor, we have  very little idea of the scale of it – and what we do know is misleading as to that scale.  For instance, a recent Financial Times article, when highlighting the (bad) trend of how central governments are withholding more and more information requested, falls into the trap of assuming that this picture represents all freedom of information requests. But departments and ministries are not the only public bodies that receive Freedom of Information requests. In fact there’s good reason to believe they receive only a small percentage of the overall total. 

Most FOI requests in the UK are not covered by official statistics. In 2017, we did a meta-FOI to ask local authorities about the number of FOIs they received. We calculated around 467k were made that year, compared to 46k made in that same year to the central government. From running WhatDoTheyKnow, we know that only 10% of requests made through the site go to the central government departments that are covered in the statistics. 

As the number of Freedom of Information requests is much higher than the official statistics show, this helps explain why the number of requesters can be far higher than expected. Not only are there many more public bodies outside central government, but these bodies are closer to people’s day to day lives, and so a broader range of people might want information, and find it through the Freedom of Information Act. 

Polling by the UK’s Information Commissioners

The clearest reassurance of the 10%ish figure is that a similar poll found a very similar number. Polling by the Information Commissioner’s Office in 2021 found 49% were aware of “the right to request information held by public organisations”. This is lower than our equivalent question, where 62% had either made use of FOI, or were aware of it and not used it. However in the same 2021 survey, 10% of respondents to the ICO’s survey said they had already made use of “the right to request information held by public organisations”. In the previous year this figure was 12%. This figure is very close to our figure of 10-14% making use of FOI, and it is reassuring to see something in this ball park come from a different survey company.

Both these surveys might be wrong of course, but polling by the Scottish Information Commission in 2022 found an even higher number. This poll found 36% of a weighted sample of Scottish respondents had at some time “asked for information from a Scottish public body by letter, email or online form”. 18% said they did this annually or more frequently. This is a much higher number than the other survey. There are several possible reasons why.

1. There is a genuine difference in awareness and use of rights between Scotland and the rest of the UK. 
2. The way this question is phrased should also include requests for personal information (subject access requests) as well as freedom of information requests.
3. This version of the question does not ask about a right, just if someone did something that might have engaged the Freedom of Information Act. This might catch people who get through the process unaware they may have benefited or made use of information rights.

How should we interpret this? There is no strong reason to believe the use of rights is significantly different in Scotland. The Scottish figure was 63% awareness of freedom of Information, which is higher than the ICO UK-wide, but in the same general area as our UK-wide polling, which did not show a significant difference for Scotland. Similarly, our survey found a statistically significant difference in use of FOI by respondents in London and did not find this for Scotland. 

As for subject access requests, we actually know from the (really good) statistics recorded in Scotland that around one-quarter of information requests are subject access requests. So even applying this correction, this question is still suggesting around double the figure from our survey. This is likely to be part of the explanation, but is not all of that. 

This leaves the possibility that by not prompting about rights or freedom of information, this is capturing a set of people who are coming into contact with information rights issues without noticing it. It is possible to exercise your freedom of information rights without being aware you are doing so. My first freedom of information request was made this way as a student, asking OFCOM if they held some information from the Broadcasting Complaints Commissions’s archive. If you email your local council wanting to know something, it should be processed under the Freedom of Information Act, even if you were unaware of it. This is likely to include some interactions with authorities that will have existed before FOI (and information may have been made available) but which is now covered formally through the Freedom of Information process. For example, a request for library opening times could be processed as an FOI request, but may well have been answered before the FOI act existed.

If this is an explanation for a higher number in response to the OSIC survey, it might also explain the higher proportion of 18-34 respondents in our poll who had used Freedom of Information for personal reasons. Contact with public bodies for information is more likely now to be by email, and trigger the formal FOI process. There is more to explore here around possible shifting patterns of first contact with FOI. 

Back of the envelope calculation based on WhatDoTheyKnow statistics

The relevant polling we have is supportive of our poll not being outrageously high. The other approach is to try a very back of the envelope approach based on known statistics to see if this is a reasonable amount of FOIs to have been made. 

Based on previous research by mySociety and the Constitution Unit, we have estimates for the number of FOIs made to local authorities in 2005-2010 and 2017. Filling in the extra years between those dates, extending forward, and doubling the number (roughly 48% of requests made through WhatDoTheyKnow are to local authorities – but we don’t know if this applies more generally or not), this gives roughly 11 million FOI requests all time. On WhatDoTheyKnow there are an average of six requests per user (again, don’t know if this applies more generally) – so applying that ratio gives roughly 2 million requesters all time. A figure of 10% of UK adults would expect roughly 4.3 million requesters all time. 

To get the two numbers more  into sync some combination of the following could be true:

• More local government requests have been made all time than this assumes.
  • Not impossible given this is based on three data points (all of which are incomplete surveys and require some amount of extrapolation).
• A greater proportion of requests being made to non-local government bodies than happens in WhatDoTheyKnow
  • No way of knowing this without a complete statistical picture.
  • OSIC statistics show a higher 60% statistic in Scotland being made to local government.
  • Given there are many  more non-local government public authorities in the rest of the UK, it is reasonable to guess it’s closer to the WhatDoTheyKnow statistic of 50%, but could it be lower than that?
• The ratio between requesters and requests is different outside of WhatDoTheyKnow.
  • Arguments both ways, WhatDoTheyKnow is missing all the ‘not intentionally using FOI’  one-offs, but also some of the bulk requesters who don’t want the results to be public on WhatDoTheyKnow. 

Given so many of these numbers are made-up or trying to generalise from WhatDoTheyKnow to all uses of FOI, there is no real reason not to prefer the figure two separate polls agree on. That said, it is reassuring it is in the right order of magnitude (still talking millions rather than hundreds of thousands of FOI users). This question would be helped by a complete statistical picture of FOI in the UK, and to be honest, that would be so useful, it’d be fine if it proved our current numbers wrong. 

---

Header image: Photo by Mitchell Luo on Unsplash

Demographic difference graphs

Download the polling tables.

The following graphs show the demographic split on aspects of the FOI polling. Where the percentage for a category is higher than would be expected statistically if there was no difference between groups, it is highlighted in blue. If it is smaller than would be expected, it is highlighted in red. For non-highlighted categories there is insufficient data to say the category differs from the general average.

Data users in the UK often encounter fragmented public data, where  public authorities are each spending money to publish data independently, but their outputs are difficult to find and join together. This means that a lot of effort is going into creating data which cannot be used to its full potential.

As a joint project between mySociety and the Centre for Public Data, we are writing what we hope is a simple approach to help address this problem. 

Our current thinking is that some level of central coordination is required to accompany a central mandate to publish. Public bodies need support and coordination to publish data to a lightweight common standard and in a common location.

We want to kick the wheels of this conclusion, identify existing attempts to fix the problem, and talk to people who produce and use the data to see what the obstacles are. If you’re interested, get in touch at research-publicdata@mysociety.org, or drop your views in this survey. 

What is fragmented public data?

Fragmented public data is when many public authorities are required to publish the same data, but not to a common standard (structure) or in a single location – so data becomes fragmented across multiple locations and multiple formats. 

For example, every English local authority is currently supposed to publish all spending over £500 each month. From Adur to Wyre Forest, council officers are working hard to publish monthly spending. 

In theory, this data should be being used by companies, researchers and journalists to provide insight into spending, spot fraud, and find opportunities to sell to councils.

But in practice, to use the data, you’ll need to search all 333 council websites each month, then import each spreadsheet into a central database – and you’ll spend a lot of time pulling your hair out, because the spreadsheets don’t use a consistent format. 

As a result, not much has actually been done with all this data. And the grand promises that spending data would unleash an ‘army of armchair auditors’ have largely failed to materialise. 

Why does this matter?

This is a problem because most of the effort is already being spent to do the job ineffectually. Councils do a lot of work to produce this data, and companies and analysts waste time fixing import scripts or crowdsourcing data, rather than creating new products or insights — and for many organisations, the skills and resources required to create national level datasets are beyond them.

This is not an isolated problem – there are many other examples of fragmented data. 

From assets of community value to election information to council land and property assets, data is often published in a fragmented and hard to reassemble way. 

For many datasets, while individual disclosures are useful, the combined data is much more than the sum of its parts because it allows real understanding of the picture across the whole country, and makes it easier to draw comparisons between different areas.

Across all these datasets the potential loss is huge – and just a bit of extra work could unlock huge amounts of the overall value of the data. We want to fix this for data that is already being published, and make sure that datasets in future are published in the best possible way. 

So what can we do?

The big problem is one of coordination. We think the UK’s central data teams just need to help public authorities do two things:

1. Use a lightweight common standard
2. Report the location of the data in a central register.

By taking things that individual authorities are doing anyway, but getting an agreed format and location, all the individual datasets become far more useful. But the details of the standard are less important than the fact that the government and legislators should be as interested in this side of the problem as they are in requiring the data to be published in the first place. 

We’re keen to learn lessons from previous attempts to do this, and reviewing old publication guides, our initial conclusion is that these over-complicated the idea of what open data is (with a fixation on file formats and linked standards), rather than simple interventions that help both publishers and users (where generally, the best approach is probably an Excel template with common headers). Common standards need to be a compromise between technical requirements and the people who work in local authorities who produce this data.

We’re encouraged by an approach taken by the Scottish Parliament, where publication of compliance with climate change duties was mandated in a particular format – and a consultation on this process found most organisations involved thought standard reporting was an improvement. We’re interested in any other examples of this kind of approach. 

What are we doing now?

We’re trying to explore this problem a bit more, to understand the scale of the problem, and the viability of our approach.

We are interested in talking to:

• People who have run into this issue, what they were trying to do, if they were able to overcome it, or if they had to give up.
• People who publish information in public bodies to understand what their restrictions are
• People or organisations with experience in trying to coordinate a single standard or location for public data releases.

Get in touch at research-publicdata@mysociety.org, or drop your views in this survey. 

—

Header image: Photo by Olav Ahrens Røtne on Unsplash

The right to access information requires high quality oversight. Studies of effectiveness of Access to Information (ATI) legislation tells a clear story: the benefits of greater transparency and access to information can only be realised when this system is actively enforced. To be effective, the whole system of ATI review and appeal has to be designed as a system of cultural change. The system has to use limited resources in a strategic way to reform cultures of unnecessary secrecy in government that protect corruption and inefficiency in public life. 

Building on a comprehensive picture of appeal systems and processes across Europe, our new report argues for the value of specialised oversight bodies (Information Commissioners), who have independence from government and the power to compel compliance from authorities. In countries that use a system of internal review, better monitoring and interventions are necessary to ensure this system enhances rather than detracts from access to information.

The report can be read online, or downloaded as a pdf. 

Summary of recommendations:

• Better investment in the resources, capacities and independence of Information Commissioners improves the quality of the ATI regime, attacks corruption, and strengthens good governance.
• Specialist Information commissioners are preferable to general ombudsman, bringing more specific knowledge, and are a more suitable structure to shepherd the access to information regime. 
• The power to enforce decisions is a required tool for driving culture change in public authorities. 
• Systems of internal review should be replaced by commissioner-led systems of appeal, where information commissioners have understanding of appeals across the entire system, and can use internal review as a strategic choice, rather than a hurdle before an appeal can be considered. 
• In general, oversight bodies and civil society rarely have high quality information about full workings of the ATI system. We argue that better quality statistics are a valuable tool in demonstrating the value of the system, and in allowing targeted focus on problems. 

Fundamentally, good ATI regimes are important because of the effects they have in society, strengthening anti-corruption and good policy-making approaches. Better oversight is a cost-effective way of unlocking these wider benefits. This report explores how technical details of how the oversight system works are important in achieving these overall objectives.

The report can be read online, or downloaded as a pdf. 

mySociety’s climate programme is focused around reducing the carbon emissions that are within the power and influence of local authorities in the UK. 

A big area of ignorance for us was the public understanding of local government and its role in combating climate change. We anticipated that in general there might be low public understanding, but we wanted to know more about the shape of that understanding, and how that might affect how we approach our work.  

We commissioned Tom Sasse to write a literature review to help us understand more about this area. The report can be read online or downloaded as a PDF. 

The report has seven key messages:

Net zero is a national mission on a huge scale. It will mean changes to our landscapes and lifestyles, our physical infrastructure and energy systems, our homes, our diets, the way we travel. As well as being necessary, it should be a positive transition (think cleaner, healthier, more productive communities). But it will require some big investments, which need to be paid for fairly, and changes in people’s lives. Broad support will be critical.

To be successful, net zero will require strong local direction. This is the message from a growing chorus of voices (and not just diehard devolution advocates). Central government will have to take some decisions and set direction. It overwhelmingly controls funding. But the path to net zero will be different across the UK: rural areas face very different issues to dense urban ones. Councils are well placed to understand local concerns, needs and capabilities – and build support for local transition pathways. They can act as conveners, working with local citizens, businesses and community groups.

Local climate action is gearing up, but councils face constraints. Councils hold key levers in housing, transport and planning; in all, they exercise powers or influence over around a third of all UK emissions. Almost all have a net zero target and four fifths have published a climate action plan. But these vary in scope and detail, and many councils are still getting to grips with how to cut (or just measure) emissions. Some have started engaging citizens. But in general councils lack funding and capabilities, which is holding back action.

The public supports stronger climate action. In the last three years public concern about climate change has climbed from mid-ranking to be the third most important issue facing the country – and this change appears pretty robust. Cost of living pressures present challenges, but recent polling shows the public still overwhelmingly supports the UK’s net zero target. Most people think stronger action is needed to meet it.

The public supports more local involvement in net zero. Trust and satisfaction with government has been in decline, but attitudes towards local councils have held up much better (44% trust their local councillor vs 19% for government ministers). In particular, people much prefer councillors when asked who should make decisions about their local areas. They think local areas have a high degree of responsibility for tackling climate change, and believe central government should provide more funding to enable local action.

Public understanding of local government is relatively low. The public makes little distinction between different tiers of government. While people know councils are responsible for some highly visible services like waste collection, their understanding of the range of actions local authorities could take to tackle climate change is limited.

Climate action will need to be framed around local concerns. The public are particularly keen on certain net zero policies including frequent flier levies, carbon taxes, improved public transport, and support for replacing gas boilers and installing energy efficiency. But there has been less polling on preferences around local action. People have some concerns about how costs and impacts will fall, and when asked about priorities for their local area, they tend to raise wider issues like vibrant high streets or youth employment.

The report concludes by offering recommendations on four areas where mySociety could make a difference: supporting efforts to address information gaps and raise awareness, which could help provide a stronger foundation for local climate action; supporting wider use of public engagement, and helping councils to achieve wider reach via digital tools; helping to address knowledge gaps around public opinion and preferences for local net zero action; and supporting more effective ways of monitoring and tracking progress in local climate action.

Reflections on the report:

While we anticipated (and the report confirms) low public awareness around some aspects of local authorities, the process of writing the report helped expose some questions we’ve been dancing around the edges of, about how local authorities relate to their communities. For instance, our work is focused on the potential of local authorities to reduce emissions, but there are different opinions on exactly the proportion of emissions local authorities could have influence over. Depending who you ask, it can be anywhere between almost no emissions, and almost all emissions. This report helps navigate that area, in particular distinguishing between where local authorities are genuinely best placed to take action (and how this capacity could be improved), versus where central government may want to shift responsibility without properly enabling action. 

This report has been helpful in encouraging clearer thinking about what we mean when we talk about ‘local action’. Some sources slide between talk of local action (from communities) and local action (from local authorities). Accepting a framing that local authorities are not only better placed than central government to work with local communities (certainly true) but are the same thing as their local communities (definitely not true) hides a large problem area where local authorities’ ability to work in and with their community can be substantially improved. Being clear-eyed about the current situation, as well as the potential for change, is essential for the success of our programme of work. 

The report can be read online or downloaded as a PDF. 

__

Photo credit: Photo by Luke Porter on Unsplash

The goal of mySociety’s climate programme is to try and reduce the estimated 33%  of UK emissions that are within the scope of local authorities’ activities. To be systematic about what that might mean, we’ve tried to categorise all local authority services and activities into three broad areas:

• Service delivery is where councils’ direct  or outsourced activities have an implication for emissions. This includes their own facilities, services run directly or those externally procured. For instance, waste disposal and coastal protection are both services in this category, and our initial pass put 71 services in this category.
• Enforcement and regulation is where councils have power to reduce third party/citizen emissions through regulatory frameworks. This might include transport or building regulation, or enforcement of regulations of the private rental sector (80 services). 
• Place making is where local government have a coordinating/enabling role in emissions generated by third parties/citizens within their boundaries. This will involve fewer actual duties to take action, but a greater coordinating role, including general planning and research, borrowing and investment powers or strategic economic planning (90 services). 

Using the ESD standard list of services provided by local authorities in England and Wales, a first pass identified services that might have relevance to emissions reduction (trying to be inclusive when in doubt). A second pass then assigned those services to at least one of the categories above. 

The results of this process are in a GitHub repository. This is an initial test of this concept and the list, and classifications may be refined over time. Future additions might further distinguish powers from duties (where authorities can take action versus when they have to take action) and broad/specific service descriptions. 

Internally, we’re using this list as a reminder of the wide range of activities local authorities have responsibility for, and to consider whether different groups of these services may be suitable for similar kinds of external interventions or services we might build as part of our work. As a dataset, this might eventually be able to add value directly to services. For instance the description data could be used in a machine learning approach as described in this paper for tagging and improving search of plans in the Climate Action Plan Explorer. 

Alternative approaches

The Climate Change Committee report on local authorities has two alternate ways of dividing local government functions. 

The first is a list of areas of local government responsibility that relate to emissions:

• An overarching role to support the economic, health and social wellbeing of communities
• Powers to ensure buildings meet basic energy efficiency standards
• Duties to prevent homelessness and prevent hazards in housing
• Duties to manage risk including climate risks such as flooding
• Duties and powers to protect the environment, wildlife and heritage
• Duties to collect and dispose of waste
• Borrowing and investment powers

The second is a 6 stage “onion” diagram of activities based on the Centre for Sustainability model, where each layer accounts for a larger slice of emissions, but is less directly under the power of the council:

• Direct control: buildings, operations, travel
• Procurement: plus commissioning & commercialisation
• Place shaping: using powers to control development and transport
• Showcasing: innovating, piloting, demonstrating and sharing good practice, scaling and replicating
• Partnerships: leading bringing people and organisations together, coordinating and supporting others, joining others’ partnerships
• Involving, Engaging and Communicating: translating global and national climate change targets for local relevance, with stakeholders to raise awareness, involving people & ideas for local solutions

Most of these fit into the placemaking category used above, but more generally our approach recognises a distinct regulation role that might be supported in a different way by potential future services to placemaking approaches. 

—

Header image:  愚木混株 cdd20 on Unsplash

In one sentence

TICTeC Action Lab #1 is looking for an individual, organisation or joint team to produce a piece of work to showcase examples of where civic tech interventions have resulted in tangible improvements and benefits for governments/public institutions and their citizens.

About TICTeC Action Lab #1

As part of the TICTeC Labs programme, mySociety convened the TICTeC Action Lab #1 working group in order to take ideas raised at Civic Tech Surgery #1 forward, and decide together what piece of work would be useful to commission to help civic tech organisations around the world to work more effectively with governments/public institutions.

The TICTeC Labs programme is looking at six key dilemmas facing civic tech. The first of those challenges was how civic tech organisations can work effectively with public and private institutions. Our Civic Tech Surgery #1 discussed some of the challenges and suggested some ways forward. Our Action Lab #1 considered those ideas and decided on a piece of work that could be commissioned to help solve some of the problems raised.

TICTeC Action Lab #1 is comprised of 6 individuals from across the world, who between them have many years of experience working on civic tech and/or the issues that surround the effectiveness of civic tech. You can read more about Action Lab #1 members here.

About this project

TICTeC Action Lab #1 members agreed to commission a piece of work that showcases examples of where civic tech interventions have resulted in tangible improvements and benefits for governments/public institutions and their citizens.

The Action Lab believes highlighting successful examples will help civic tech organisations across the world to work more effectively with governments, as it will help them to promote the benefits of civic tech and inspire and motivate government actors, as well as themselves, to start similar civic tech projects in their contexts.

Therefore, the primary target audience for this work are public institutions across the world, as well as civic tech organisations themselves who want to be inspired. The work should include:

• Examples of civic tech organisations working with public institutions (e.g. local governments/councils; national governments; government departments/agencies etc) on civic tech/digital democracy projects that have resulted in tangible improvements for the public institutions and their citizens. By ‘civic tech organisations’, we mean organisations that focus on informing citizens, connecting them with each other and getting them to engage with their governments in order to work together for the public good.
• Examples from multiple countries, ensuring that examples from both the Global South and the Global North are represented.
• Specific details on how the civic tech/digital democracy projects were set up and why; what the challenges were; what the tangible improvements were; and any other details that would be helpful for other civic tech organisations and public institutions who may like to replicate the examples in their contexts.

There is $2500 USD (inclusive of taxes) available for this work. We are open to what form this piece of work takes – e.g. it could be a set of case studies; interviews; visualisations/images; a literature review; a graphic novel even! Above all, we want the work to be as accessible as possible to ensure it can be easily used in practice. We ask applicants to let us know what approach they will take in their application.

It may be helpful for applicants to look back at schedules from previous TICTeC events to find examples of presentations that discuss how civic tech projects have led to tangible improvements.

How to apply

If you’re interested in producing this piece of work, then please fill in this application form by 28th March 2022. Applications will be reviewed by the TICTeC Labs team at mySociety and the TICTeC Labs Steering Group. Applicants will be notified of the status of their application no later than 15th April. The work will then need to be completed within 8 weeks of the successful applicant being appointed.

What happens after the project

We intend to publish the work you produce, credited to you, on the TICTeC and mySociety website, licensed under a Creative Commons licence. We may make some light edits (beyond proofreading) before we publish. You will be free to make publicly available your own version should you wish to, and any other material based on the research you conducted. The project will then be disseminated by TICTeC Action Lab members, the TICTeC Labs Steering group, and the TICTeC community to ensure it’s used as much as possible.

mySociety will convene a ‘report back’ event at the end of the TICTeC Labs programme to discuss how the programme went and the work commissioned by the programme and its participants. Authors of commissioned work will be invited to attend to present their work.

Any questions?

Please send any queries or questions to tictec@mysociety.org.