1. WhatDoTheyKnow and the Post Office Horizon scandal

    “Freedom Of Information. Three harmless words.”

    The Post Office Horizon scandal serves as a prime example of how, when official channels have failed, determined investigators can eventually unpick the truth and ensure that justice is served.  

    Horizon, the computerised system on which sub-postmasters were required to balance their tills, was riddled with technical faults that led to inaccurate accounting. These faults could be exacerbated by technicians undertaking remote access without the knowledge of staff, overnight. But incompetence and denials from the top — even as far as government — meant that the blame fell on innocent sub-postmasters. 

    Justice has been a long time coming. Staff were subject to fines and even unfair imprisonment; families and friendships were destroyed. Years of diversions and cover-ups have now finally come to light, as you may have seen in the extensive media stories.

    One person who has been persistent in uncovering the details of the case over the years is Eleanor Shaikh, who has used WhatDoTheyKnow extensively in the pursuit of truth — you can see her requests here

    We asked Eleanor to tell us more about her ongoing work in this area, starting with why she got involved: in response, she pointed us towards a letter on Nick Wallis’ Post Office Scandal website.

    It begins: “I learned of the Post Office Horizon scandal through being a regular customer at my local post office in Farncombe, Surrey. My ex-Sub-Postmaster, Chirag Sidhpura, was hit by an alleged £57,000 shortfall in October 2017 and it did not take long to see that his case belonged to a more widespread and disturbing pattern.” 

    She goes on to explain, “I have seen first hand the silent devastation that this scandal has wrought upon three generations of this decent, hard-working family.” You can read the full letter here.

    Findings through FOI

    Freedom of Information has been a very effective mechanism for many of those involved in this investigation — a cover-up like this is a perfect demonstration of why we need the rights it confers. 

    As Eleanor explains, Over the years, a number of campaigners and journalists have turned to FOI as a tool for obtaining more information and joining the dots of this vast but well-concealed miscarriage of justice. Chipping away at the cover-up was one small way that outsiders could assist Sub-Postmasters on their long road to the truth, exoneration and redress.”

    Eleanor’s 150+ requests have led to some significant findings. She started off with a curiosity about how much had been known, but not publicly shared, by government.

    My initial focus was on what government knew of Horizon’s flaws”, she says; “how responsibly it monitored the unfolding scandal, and what was the extent of its involvement in the group litigation.

    “The FOI disclosures I received suggested that central government was not as oblivious to events as it would have us believe; the heavy redactions on these reports themselves bore witness to the fear of reputational damage to the department to which the documents alluded.”

    As time went on, Eleanor started uncovering more and more salient facts:

    “Probably the two most significant documents I’ve been able to unearth have been the 2016 Swift Review and an undated Post Office Security Team Compliance Document.

    “The review would seem to have suggested a moment of alignment when both government and the Post Office were committed to investigating Horizon issues beyond all doubt. 

    “It took seven months to receive a response, but disclosure was made by both parties along with requested email correspondence which showed that the PO’s CEO, Paula Vennells, was aware that the review was being undertaken in 2015 but that the PO Chair, Tim Parker, declined to share its findings with the Post Office Board even as the spectre of litigation loomed in 2016. 

    “This was despite the review’s strong warnings that miscarriages of justice might have taken place, its clear identification of Horizon’s fundamental operational problems and an acknowledgment of the possibility of remote access.” 

    These were all crucial details in understanding the full picture, and fed into news coverage of the scandal. There was also something Eleanor hadn’t been specifically looking for that recently made headline news.

    While requesting information on the way in which the Post Office monitored its investigations, Eleanor happened across something rather shocking:

    “What was disclosed was a document which used deeply offensive racial identification codes, so inflammatory that it attracted widespread media coverage.” You can see, for example, the BBC’s coverage of this revelation here.

    “Thanks to the WhatDoTheyKnow website, once it caught the attention of social media, any journalist could get instant access to the original document.”

    FOI was necessary 

    One thing that this investigation highlights is that the checks and balances built into our justice system are sometimes inadequate. The Horizon case was examined in High Court, and  has been the subject of two governmental inquiries, one of which is ongoing. But it is citizen reporters using their Right to Information that have filled some of the gaps.

    “Despite much crucial information having been released into the public domain during the 2018-19 High Court litigation, many details of the scandal remained hidden”, explains Eleanor. 

    “The BEIS Select Committee Inquiry, which heard evidence from early 2020, afforded a brief window of opportunity. But its independent work was abandoned soon after it began when the Department for BEIS (now DBT) put in place its own inquiry.

    “The Government was adamant that this inquiry would not have statutory powers, meaning it had no authority to command witnesses to give evidence, nor powers to demand the disclosure of documents. Moreover BEIS could keep its own failures of oversight beyond public scrutiny by restricting the scope of the inquiry. 

    “At this moment there was a very real danger that the true depths and extent of the scandal might never reach public consciousness and that those who’d facilitated the miscarriage of justice may never be identified.

    “Ministers and Whitehall officials were attempting to shield themselves from scrutiny and to diffuse an information time-bomb by behaving as if it wasn’t there. But questions needed answers and if the government was refusing to launch a full public inquiry in 2020, then it had to be inquiry by FOI.

    WhatDoTheyKnow played a part

    We asked Eleanor how integral WhatDoTheyKnow was to her investigation. 

    “The WhatDoTheyKnow website proved itself to be an invaluable resource. Through its gateway, information and correspondence with authorities is released directly into the public domain in a way which is both transparent and accessible to all; that’s really important in the context of the Horizon scandal.

    “Disclosures are easily accessed by others and can be shared on social media. WhatDoTheyKnow has enabled intrepid journalists who follow the scandal — such as Nick Wallis, Karl Flinders and Tony Collins — to extend the reach of any new and significant information.” 

    A turning point

    “Thankfully”, continues Eleanor, “in June 2021 the inquiry was elevated to a statutory footing in response to ground-breaking rulings at the Court of Appeal. This was a turning point and teams of formidable lawyers set to work in supporting Sir Wyn Williams in his long-awaited public inquiry; the Chair now had the power to determine its scope of issues and assumed far greater powers to elicit the disclosure of evidence. 

    “But there was still a role for FOI research in areas which may lie beyond the inquiry’s remit or which haven’t yet come under its scrutiny.

    And FOI also had another significant, but unexpected outcome: 

    “One release prompted a review of the Post Office’s entire disclosure processes to the public inquiry. That a key document had never been passed to inquiry lawyers triggered a remedial disclosure exercise so significant that it resulted in the release of thousands more documents and a temporary suspension of the inquiry’s work. 

    “A single FOI disclosure triggered a wholly unforeseeable domino effect.”

    Three harmless words

    At the start of all this, Eleanor says, “FOI was an unfamiliar avenue for me.” Since then, she’s clearly become something of an expert, with FOI being a major part of her investigations.

    Reflecting on the rights that FOI confers, she says: “There is some irony that the Government which oversaw the launch of the doomed Horizon project in the late 1990s was at the same time drawing up legislation which granted our right to Freedom of Information. It’s poignant too that Tony Blair who decided that the flawed Horizon project must proceed at all costs, was at the same time doing all he could to delay the implementation of the FOI Act.

    “In his memoirs, Blair revealed his regret over the decision which gave the public the right to probe the Government’s shortcomings. He feared information would be weaponised by opponents:

    Freedom of Information. Three harmless words. I look at those words as I write them, and feel like shaking my head till it drops off my shoulders. You idiot. You naive, foolish, irresponsible nincompoop. There is really no description of stupidity, no matter how vivid, that is adequate. I quake at the imbecility of it…What I failed to realise is that we would also have our skeletons rattling around the cupboard…The Freedom of Information Act was then being debated in Cabinet Committee. It represented a quite extraordinary offer by a government to open itself and Parliament to scrutiny. Its consequences would be revolutionary; the power it handed to the tender mercy of the media was gigantic. We did it with care, but without foresight. Politicians are people and scandals will happen’.1

    “Thankfully, many individuals have been making full use of FOI to help prise the rattling skeletons of the Horizon scandal from their cupboard. Each disclosure adds to our understanding of how things went so deeply and disastrously wrong. And, as sub-postmasters continue to dig for information across their multiple battle fronts, long may FOI continue to make its small contribution to their uphill struggle for justice.”

    Many thanks to Eleanor for sharing this detailed account. You can read her findings on Horizon’s early years in her report Origins of a Disaster.

     —

    Image: Mark Percy (CC by-sa/2.0)

    1Quote from Blair’s memoirs Tony Blair The Journey Hutchinson, 2010, cited in an article The Blair Memoirs and FOI, also 2010 by Maurice Frankel, Director of the Campaign for Freedom of Information, accessed 10.10.23

  2. CE UK and mySociety are using people power and Freedom of Information to bring transparency to local climate action

    A story in this week’s Financial Times [paywalled] has brought the EPC ratings of council-owned properties into the public conversation. This story was based on data obtained through FOI requests as part of the Council Climate Action Scorecards project, which we’ve been working on in partnership with Climate Emergency UK (CE UK).

    What you can read in the FT is one story pulled from a wealth of data, but there’s more to come. Our WhatDoTheyKnow Projects tool allowed CE UK’s team of volunteers to conduct a nationwide survey of every council through well-placed FOI requests covering the use of renewable energy, plans for retrofitting, green skills training, road expansion and more. 

    The data they gathered has allowed for the understanding of councils’ action on a nationwide scale. This level of oversight has not previously been possible: as with so much about the Scorecards project, it is allowing councils to take more informed action on climate, and individuals to clearly understand what is being done.

    Why local action matters

    In the UK, it is estimated that around one third of carbon emissions are in some way under the influence of local authorities. 80% of UK councils have declared a ‘climate emergency’ to indicate they recognise the scale of the problem of climate change, and are in a position to take practical steps to be part of the solution. To help local authorities achieve the goals they set themselves (and to push them to go further), we need to engage with the plans that local authorities are making, and the actions they are starting to take. 

    In 2021, CE UK and mySociety worked together to produce the first Council Climate Plan Scorecards. CE UK’s upcoming launch is the second iteration of the Scorecards. It is much bigger and more ambitious in scope than the last: it scores not the plans, but the climate actions of every local authority in the UK. 

    FOI requests were just one part of the process. As well as giving CE UK access to WhatDoTheyKnow Projects, we developed a crowdsourcing tool for volunteers to use while marking across the 90+ datapoints collected for each council. 

    How do you score action?

    CE UK moved from scoring plans to scoring actions. That required new approaches to gathering the information. 

    The questions CEUK used in the new Scorecards are the result of a long and thorough process of research and refinement. Building on their own research and expertise, they conducted one-on-one consultations with approximately 80 organisations and sector-specific experts. An advisory group of environmental and local government experts provided further discussion and refinement, to help build a list of questions that would practically be possible to answer, and that would reveal important information about the climate actions of councils. 

    The aim was to identify areas where information was publicly accessible; but also where gaps existed, especially in operational matters that aren’t often made public. Additionally, CE UK wanted to investigate whether councils are truly implementing the actions outlined in their climate action plans, including aspects like lobbying for additional powers.

    Making use of Freedom of Information

    Freedom of Information laws means that a huge range of information held by public authorities (including local councils) can be requested by any person who asks. This provides a legal tool to create greater transparency where information is not being published proactively.

    For CE UK, the potential of FOI for the Scorecards project was clear – but there were concerns. In consultations with council staff, there was pushback regarding the use of FOI requests due to the potential time and financial burden on council officers who work on climate – with some requests for a more informal survey approach to be used. But the drawback of that would be making good data dependent on goodwill everywhere. FOI requests provided a way to make sure the scorecards were not just effective for councils who engaged with the process and provide an approach that was fair across the country. 

    To balance a process where they want to encourage positive engagement from councils, with one that works without that, CE UK’s approach was to plan out the most efficient and least burdensome use of FOI requests. 

    Based on feedback from the advisory group, and trial runs to a small number of councils, they eliminated questions that were less important and useful, made more ‘yes/no’ or ‘single number’ responses, and learned where certain questions weren’t relevant to certain areas or groups of councils. 

    The subsequent FOI requests became more streamlined, and this resulted in quicker response times for the final requests than they had in the trial – as the information sought was more direct and concise.

    In the end, CE UK submitted a total of over 4,000 FOI requests to councils across the UK. The questions were divided into 11 categories, with some being specific to certain types of councils, such as district councils or combined authorities. The next stage was taking these 4,000 requests and getting them into a form that can be used for the scorecards. 

    Crowdsourcing and review process

    CE UK used WhatDoTheyKnow to manage their FOI request process. mySociety’s WhatDoTheyKnow acts as a public archive for requests – requests made through the site have the responses shown in public to bring more information into the open  – making it more discoverable by other people interested in the information, and reducing the need for duplicate requests being made. As of 2023, a million requests for information have been made through the site, with hundreds of thousands of pieces of information being released. 

    A feature we are trialling with a range of organisations is WhatDoTheyKnow Projects, which integrates crowdsourcing tools into WhatDoTheyKnow, and allows the task of extracting information into a new dataset to be spread out. The goal is that this helps organisations be more ambitious in finding out information and helps people work together to create genuinely new and exciting datasets, that no single organisation has ever seen. 

    As CE UK’s approach already made heavy use of volunteers and crowdsourcing, this was a natural fit.  Alongside a wider group of 200 volunteers working on getting answers to the other questions, 15 volunteers specifically worked on the FOI requests. These volunteers were a mixture of people with prior experience or professional interest in FOI requests, campaigners well-versed in FOI processes, and individuals new to the concept but eager to engage in activism.

    After the crowdsourcing of FOI data was complete, it joined the rest of the data in the new tool mySociety had developed for helping volunteers crowdsource information for the Scorecards.  

    From here, councils were given access to the data collected about them and given a right of reply to correct any inaccuracies or point towards information not previously discovered or disclosed. The results of this process will then be reviewed to produce the final Scorecards data, which will be launched this month.

    But the Scorecards data will not be the only useful thing that will come out of this process. Because of how WhatDoTheyKnow was used, to see evidence supporting the final Scorecards, people will be able to click through and see the original responses, for instance, to see what councils have lobbied on support for their climate work. 

    Some of the FOIs are being used to construct datasets that have a broader impact, and here we come back to that FT story on the Energy Performance Certificate (EPC) ratings of council-owned houses. Building these new public datasets will be useful for councils to understand their own situation, and as we see with the news story, more broadly to understand the challenges ahead for local governments to meet net zero emissions goals. 

    Onwards

    The original Scorecards project has already been influential on how local governments understand their own plans, and how organisations like the UK’s Climate Change Committee understand the role and progress of local government in the challenges ahead. When the next generation of Scorecards is released, we hope that they continue to be useful in shaping and improving local government action around climate change.

    mySociety believes that digital technology can be used to help people participate more fully in democracy, make governments and societies more transparent, and bring communities together to address societal challenges.

    The Scorecards project showcases how the combination of digital tools, people power, and the right to information produces powerful results. We hope that the impact of this project can inspire and make possible similar approaches for other problems, or in other countries.

  3. ICO advisory note on publishing spreadsheets

    Following the PSNI and other recent data breaches, the ICO has issued guidance to public authorities. This guidance suggests a temporary stop on publishing Excel-style spreadsheets in response to FOI requests made via online platforms like WhatDoTheyKnow. The full advisory note is available online

    The advisory note emphasises that this is not a reason not to disclose requested information. Instead, the ICO says to release the information from original source spreadsheets as a CSV file – a simpler format than Excel Workbooks, with less potential for including hidden sheets or metadata that can lead to an accidental breach.

    A focus on file formats is a blunt measure, and one that will need to be superseded by better procedures and technical processes.

    We support authorities releasing data in the most appropriate format for the information being requested. This may sometimes mean an extract from a table, and sometimes a complete document. Excel spreadsheets are legitimate public documents, and information released in this format can be hugely valuable. It’s important to develop processes where they can be released safely. 

    Significant data breaches involving Excel files clearly show the risks when data management and release processes fail. These include not just breaches we see through WhatDoTheyKnow, but through disclosure logs and releases made directly to requesters. This is an opportunity for public authorities, the ICO and us at WhatDoTheyKnow to reflect on how we can best deliver the huge benefits of public transparency while safeguarding personal data. 

    Modern authorities need to be good at handling data. Data breaches happen at the intersection of technical and human processes. The FOI team can be the last link in the chain of a data breach when they release the information, but the root cause often goes back to wider organisational issues with the handling of sensitive data.

    In the short run, the ICO has recommended training for staff involved with disclosing data. Many teams already have excellent processes and do excellent work, but all authorities should take this opportunity to consider their responsibility on the data they hold, and have appropriate processes in place.

    Long term progress means developing good universal processes that keep data safe, regardless of the format of the data or how the data is released. All FOI releases should in principle be treated as if they are being released to the public, because the authority’s ability to stop a data breach ends when the information is released. Making FOI responses public produces huge efficiencies for the public sector, increasing transparency in practice, and multiplying the benefit to society of the information released. 

    Technology can also be part of the solution – we need to understand more about why existing technical ways of removing hidden information from Excel spreadsheets are not being used (as described in the ICO’s established guidance on disclosing information safely), and how new tools or guidance can make it easier to release data safely. 

    A core part of our work at WhatDoTheyKnow is dealing with the practical reality of promoting public transparency while protecting personal information. We take data breaches seriously and have processes in place for dealing with them as promptly as possible. We continue to plan and work to help reduce the occurrences and impact of personal data breaches through both our procedures and technical approach. 

    By monitoring how authorities respond to requests on WhatDoTheyKnow, we will seek to understand how this guidance is working in practice, and engage with the ICO and other organisations to promote effective long term approaches to this problem. 


    Notes on the content of the advisory

    Below is our understanding of the advisory note by subject matter:

    Freedom of Information requests

    • Continue to comply with FOI responsibilities. This guidance is about releasing information in a way that reduces risk of accidental disclosure. 
    • Temporarily, do not release original source spreadsheets to online platforms like WhatDoTheyKnow. Instead – convert and release to CSV files.
    • If that is not possible, then:
      • Ask if the Excel sheet can be sent to a separate (non-public) address. Proceed with the original address if they ask for this. 
      • In all releases, go through processes to ensure there is no data breach in the material. 

    General data management

    • Excel files are unsuitable working environments when they become very large (hundreds of thousands of rows). Authorities need to switch to appropriate data management systems that are more appropriate for managing larger amounts of data.  
    • Staff who use data software and are involved in disclosing information need continuous training.  
    • Understanding of pivot tables and their risks should be incorporated into data management.

    The ICO plans to update their guidance on Disclosing Information Safely

    The checklist released accompanying the advisory has several useful steps on checking for hidden data in Excel sheets. However, on the ‘considered alternative ways to disclose’ step, refer back to the steps in the advisory note. Information converted to CSV can be released to WhatDoTheyKnow in compliance with the advisory note. The advisory note says that the source dataset should continue to be released to WhatDoTheyKnow if it cannot be converted, the requester does not want to use an alternative route, and the authority is confident it does not contain a data breach.

  4. PSNI data breach

    On the afternoon of Tuesday 8 August 2023, we ​​were contacted by the Police Service of Northern Ireland (PSNI) with a request to remove a response that they had made to a Freedom of Information request submitted through WhatDoTheyKnow.

    As many news stories have since reported, the response contained personal information pertaining to a large number of Police Officers and civilian staff. In line with our policies around serious data breaches, we took rapid action to hide the material from public view and subsequently deleted it. We also submitted cache removal requests to ensure that any copies of the information would be removed from search engines as soon as possible.

    The overwhelming majority of requests and responses that we process through WhatDoTheyKnow are unproblematic. However, we take the responsibilities that come with operating a large platform extremely seriously, especially around the personal data breaches that can occur when authorities’ release processes fail. 

    We recognise the significant impact that serious data breaches like this one have on the people affected and on their families, and we are assessing whether there is more we can do to help authorities avoid making such breaches in future.

    Image: Jason Leung

  5. As time goes by

    By law, a public authority usually has to respond to a request made under the Freedom of Information Act 2000 promptly, and within 20 working days. However, there are instances when this deadline may be extended. 

    This usually happens when the authority needs to conduct a public interest test to determine whether it’s in the public interest to apply one of the many exemptions in the Act, or whether they should release the information.

    We’ve observed a recurring trend where the Foreign, Commonwealth and Development Office (FCDO) has been frequently extending the response deadline to consider the public interest. This has resulted in significant delays in the provision of responses.

    We’ve tracked 35 requests where the FCDO has taken over 100 days to respond. Here are four of the most notable delays that we’ve come across:

    • This request for briefing notes prepared for then Prime Minister David Cameron’s 2013 trip to China is still unanswered after more than 430 working days and 21 Public Interest extensions.
    • A request concerning UK-AIS commercial deals took 388 working days to answer.
    • In another case, 274 working days after the requester asked for the information, the department sent them a letter giving them just seven days to respond if they still wanted their request to be processed. 
    • A request about various projects in Turkey took 239 working days to be answered.

    While the Information Commissioner’s Office (ICO) suggests that the process of considering the public interest shouldn’t typically take more than an additional 20 working days, the law itself doesn’t set a time limit, which restricts the options available to requesters to challenge this practice.The situation is better if you have asked for information from a Scottish public authority, as these requests are handled under different legislation. The Freedom of Information (Scotland) Act does not allow for additional time to be taken when assessing the public interest in releasing information, which means that Scottish public authorities must do so within the original 20-working-day timeframe. The Independent Commission on Freedom of Information that the Public Interest Test extension be abolished, and replaced with a time limited extension that covered requests that were complex to handle, a call which we echoed.  

    If you find that an authority has sought to extend the response deadline for one of your requests multiple times, we would strongly recommend that you lodge a complaint with the ICO. This is quick and easy to do using their online complaint form. They will typically write to the authority, asking them to respond to your request within 10 working days. You can find examples on WhatDoTheyKnow where requesters have successfully done this. Although the ICO is continuing to work through a large casework backlog, our experience is that they usually handle complaints of this nature promptly.

    We are continuing to collect examples of delays caused by authorities conducting public interest tests. If you know of any that we’ve missed, please contact us and let us know, especially if you have personal experiences to share.

    Image: Lucian Alexe

  6. FOI helps campaigns — sometimes in unexpected ways

    Several Olympics team members have trained and competed on the athletics track in Tooting Bec, London, and it’s a valued facility for local schools and athletics clubs alike. But by 2021, runners were finding that the surface had degraded so much that it was becoming dangerously hard to run on and training in spikes was no longer possible. After rainfall, the uneven surface would be covered in puddles: no longer was it fit for serious training or holding athletics competitions.

    In fact, as campaigners pointed out, the track hadn’t been resurfaced for 36 years. Mandy Brown was one of those who campaigned for its refurbishment, and told us how Freedom of Information requests made through WhatDoTheyKnow helped provide the evidence needed to persuade Wandsworth Council to make an upgrade.  

    As she explained, though, the battle wasn’t as simple as ‘one FOI request and done’. Putting in a request for what they’d thought of as a potential killer stat bore little fruit in the end — but as is so often the case, FOI supported the campaign in other, unforeseen ways.

    What was that killer stat?

    “Well, we wanted to know spend on the nearby Battersea Park track, which is in a more affluent ward, so we could compare it to spend on Tooting Bec track where the local population is less affluent and more diverse,” says Mandy, explaining the FOI request they submitted

    The thinking was that they might be able to use any disparity in funding to point out the lack of fairness in funding decisions — but the truth turned out to be more complex. There might not have been money for the Tooting track, but there had been funding for a gym in the borough; and England Athletics had been joint funders on the Battersea refurbishment, so it’s not as if the council had shelled out the full amount.

    It’s never a waste of time asking for information, though: bringing the facts into the open means that public debate can be based on truth and not assumptions. Plus, the mere fact that citizens have an eye on council expenditure can have an effect, as Mandy says:

    “I do think repeated requests for information on the basis of the rejection of the initial application for funding played their part,” says Mandy, who submitted requests such as this one for minutes of the meeting where funding was discussed.

    “Now, I believe that what really made the difference in the end was the PR campaign. This led to coverage in both local and national press. But in fact, that was boosted by information from someone else’s FOI request!

    “We spotted from another request on WhatDoTheyKnow that pre-covid, more than 80,000 people used the track every year. This turned out to be an incredibly useful statistic to include in our press releases and interviews, and was picked up in every piece of coverage including Wandsworth Council’s own announcement when they finally agreed to fund the resurfacing. 

    “So when all’s said and done, WhatDoTheyKnow played an important part in the overall campaign due to this publicly-available stat on track usage, and the general pressure applied by asking questions on the spend and decision-making process.” 

    Thanks to Mandy for sharing this story: we believe that Freedom of Information is always useful in campaigning, for the reasons she mentions, and because public debate always benefits from an injection of factual information. 

    And you never know: that FOI request you make today could be uncovering information that will inform someone else’s campaign in the future — a neat demonstration of why WhatDoTheyKnow publishes requests and responses in its permanent public archive.

     —

    Image: Wandsworth Council (CC by-nc-nd/2.0)

  7. Paul Bradshaw and WhatDoTheyKnow

    Paul Bradshaw’s name is well known to those working around data and journalism in the UK. He has authored and contributed to several books on the topic, leads an MA in Data Journalism at Birmingham City University, and acts as a consultant in BBC England’s data unit.

    In mySociety’s twentieth anniversary year, we’re looking to see where we’ve had impact, and in a recent conversation with Paul we were pleased when he noted that WhatDoTheyKnow was a something of a catalyst to his work around Freedom of Information for journalism.

    In 2009, Paul secured funding from Channel 4 and Screen West Midlands to set up Help Me Investigate, a platform for collaborative journalism. As it happens, that year the same source of funding supported our time-mapping service Mapumental, and Will Perrin’s hyperlocal blog project Talk About Local. The three projects were often covered in the press as harbingers of a new, digital way of doing things.

    The basic principle of Paul’s platform was that the internet permits collaboration between many people, each of whom can contribute a small piece towards the labour-intensive work of investigative journalism. It’s an approach we are all very familiar with these days: it is, of course, what we now call crowdsourcing — something mySociety has made use of in many of its own projects through the years, including our own WhatDoTheyKnow Projects.  

    A user, curious to get to the bottom of something, would share a central question and list out the tasks that needed to be completed in order to answer it. And of course, as often as not, some of these tasks would be the placing of FOI requests through our site, WhatDoTheyKnow.

    “When I launched Help Me Investigate”, says Paul, “WhatDoTheyKnow was a major tool in our toolkit, allowing us to easily share FOI requests that others could clone or learn from.” 

    Even more than that, he reckons WhatDoTheyKnow was “probably responsible both for me getting started with FOI, and for teaching others to use the FOI Act.”

    Since WhatDoTheyKnow’s beginnings, the aim has been to make FOI more accessible to everyone, so this was great to hear. We know that it’s a big leap to become ‘a person who submits FOI requests’, so what does that look like in practice?

    “Firstly”, says Paul, “the site reduced the barriers considerably when it came to making an FOI request: knowing where to send that request is a big mental barrier when you lack confidence navigating faceless organisations; and having examples to look at also makes a big difference in being able to imagine what one looks like.”

    Once someone has become adept with the Act, we can’t ask for much more than that they pass that knowledge onto others, creating a cascading effect of individuals who understand their rights and how to use them to uncover information. Paul is an example of exactly that:

    “It made it possible for me to share that knowledge with others. I’ve used it with hundreds of journalism students to introduce them to FOI: ‘copy this request, find your organisation, paste, and send’ helps get them started, and empowers students who might be otherwise feeling disempowered.”

    As proof of impact goes, ‘hundreds of journalism students learning how to use FOI’ certainly seems like a good one — it means that WhatDoTheyKnow has indirectly brought countless FOI-based stories to the public. 

    Paul listed some of the FOI-based investigations undertaken by users of his site — now no longer live, but visible through the Internet Archive. These include the uncovering of a £2.2 million overspend on Birmingham City Council’s website; police claims of sabotage against Climate Camp protesters; and the varying availability of hormonal contraceptives across different postcodes.

    It’s been fascinating to explore Help Me Investigate‘s archived pages, and a real reminder of what people can do when they come together. We are glad that WhatDoTheyKnow has played such a key part in that, and in the training of so many future journalists.

     

    Image: Ashkan Forouzani

  8. Ever more transparency for Alaveteli

    Here at WhatDoTheyKnow, mySociety’s service which publishes Freedom of Information requests and responses online, we care a lot about how transparent public authorities are. That being so, it’s only right that we try to be transparent, too. Of course, we already strive to be as transparent as we can, but we’ve recently increased how much information we provide about requests that we’ve had to stop publishing.

    It’s really rare that we stop publishing the entirety of a request, but since starting to produce annual transparency reports, we’ve noticed that in those exceptional cases, we weren’t always able to be clear about why we had to do it. Our records were kept in our support mail system, and couldn’t be published on WhatDoTheyKnow due to some technical limitations.

    Since October 2022, if you visit a link to a request that has been removed, where the information exists, you’ll now see a brief message explaining why the request isn’t available. We were already doing something similar for instances where we’ve had to hide individual messages or attachments. While the information necessary to display these more detailed reasons isn’t always available, especially for older requests, we hope that this small improvement is yet another beneficial improvement to how we run the site.

    Screenshot of a request that has been removed from WhatDoTheyKnow with the message: "Request has been removed. This request has been hidden. We consider it is not a valid FOI request as it was correspondence about personal circumstances, and we have therefore hidden it from other users. If you are the requester, then you may sign in to view the request. Please contact us if you have any questions." The text is linked to sign in and to contact us at the appropriate places.

    Alaveteli, the software platform that powers WhatDoTheyKnow and many other Freedom of Information services globally, doesn’t just let us choose between something being visible or not;we can choose between several levels of visibility. These range from completely publicly visible, to visible only to those with a direct link, to visible only to the user who originally made the request, to visible only to the WhatDoTheyKnow administration team, which we only use in some of the most serious cases.

    Screenshot of Alaveteli's admin interface for editing a request's basic details. Two fields are highlighted in the screenshot. The first is "Prominence", which is a drop-down menu set to "normal". Below that, there is the text "(backpage means hidden from internal and external search engines; hidden means completely hidden; super users can see anything)". The second highlighted field is "Reason for prominence", which is a currently blank paragraph input box. Below the input box is the text "This reason is shown in public. If left blank, a generic reason of 'There are various reasons why we might have done this, sorry we can't be more specific here.' will be shown.".

    This feature allows us to minimise the potential negative impact of publication, while retaining as many of the benefits as possible, with varying levels depending on the results of our carefully considered, case-by-case assessments.


    Image: Mehdi MeSSrro (Unsplash License)

  9. How many rubber bands the Royal Mail uses, and other amazing facts revealed through FOI

    We recently ran a survey, asking the public to tell us how they’ve used our Freedom of Information site, WhatDoTheyKnow. 

    To get people thinking, we put a number of prompts on social media: we asked journalists to tell us what stories they’ve uncovered through the site; and campaigners and activists to tell us how they’ve used FOI to underpin their efforts.

    But WhatDoTheyKnow isn’t just useful for grand causes. Our final prompts (example below) asked: Did you use WhatDoTheyKnow just because you wanted to know something?

    Have you used WhatDoTheyKnow just because you wanted to know something? Image of an older woman looking skywards and touching her chin.

    For all that FOI can be used to uncover vitally important information — information that changes hearts and minds, that even potentially brings down governments — there’s no doubt that it is also a useful tool for the person who simply starts wondering about something, and knows that the answer is held by our public authorities.

    Such a person is Bristolian Steve Woods, who has been using WhatDoTheyKnow since its launch in 2008 — and continues to lodge a request whenever something piques his interest. From the cost of the Mayor of Bristol’s trip to a sustainable cities and towns conference in Geneva, to more details about an art piece named the Black Cloud Pavilion, and noble enquiries about the local council’s commitment to open standards, Steve has made 60 requests through WhatDoTheyKnow at the time of writing. 

    We asked him to explain more about some of the more unusual ones.

    The rubber bands request

    “How many elastic bands – in terms of either numbers or weight – does the Royal Mail procure and/or consume per year?” was the main information that Steve asked for in this request.

    He explains, “As a child in the 1950s and ’60s, I was taught not to litter, so I got really frustrated at seeing the large number of rubber bands dropped in the street by posties as they undid the bundles of letters on their rounds.”

    Royal Mail obliged with a full response, and the answer may astound you: you can see the exact figures here.

    Turned out that Steve wasn’t the only one interested in this figure. “The FoI request is cited on Wikipedia“, says Steve, “and resulted in a piece in the Daily Telegraph. My late brother-in-law used to take the paper and my nieces were delighted to see their uncle’s name in it.”

    The Benin Bronze request

    Earlier this year, Steve asked the council for updates on progress with repatriating an artefact acquired by dubious means and added to the city museum’s collection in 1935. 

    “Some years ago, the local media reported that this object was to be repatriated to Nigeria”, begins Steve’s request, adding: “There have been no subsequent reports of its repatriation, so I am assuming this has still to happen.”

    We asked Steve to tell us more. “Bristol City Museum & Art Gallery has a single bronze as looted from the Oba’s palace in 1897”, he says. “I learned that discussions about repatriation are still continuing.”

    This request is a great example of how FOI can be used to obtain fuller background detail than is discoverable from newspaper coverage, especially once the media has moved on from a story. The response from the council provides these insights:

    “Representatives from NCMM [National Commission for Museums and Monuments] were due to come to Bristol in April 2022 but in the end their busy itineraries couldn’t allow for that. They have become even busier in recent months due to the increased amount of global returns, and pledges to return, that have taken up their time. They have concentrated their efforts with larger institutions but we await direction from them on what they would like to happen next in the Bristol case.”

    Meanwhile, Steve points out, “The museum has contributed to the Digital Benin project“.

    The city services requests

    Steve has also found FOI to be a useful tool for bringing improvements to his local area. “I have made various requests over the years about litter, fly-tipping and enforcement around environmental crimes. 

    “In conjunction with working with local ward councillors and council officers, these have yielded positive results in the form of more enforcement officers – despite overall council job cuts – plus regular meetings at both ward and citywide level involving council officers, its waste management company, councillors, voluntary sector organisations and other interested parties.”

    In 2009, Steve asked what proportion of his council tax was accounted for by weekly food waste collections, explaining his motivation thus: “My brown food waste recycling box was not emptied for one month while [waste management firm] SITA’s workforce was recently on strike. Via my council tax, I paid Bristol City Council for this service, which was not provided.”

    The obliging response broke the figures down and came to the conclusion that each payer of council tax contributed 5p per week towards food waste collection.

    The Colston request

    The toppling of the Edward Colston statue and subsequent re-examination of Colston’s legacy in the city is something that is of interest to many Bristolians, and at the time of writing Steve has just received a response to his request asking what progress has been made by the council in renaming streets named after the slave trader.

    “We require that all property owners on a given street provide their consent for its name to be changed, as such a move incurs administrative costs for those individuals/businesses to change legal documents etc. We have no plans to change this position,” says the council.

    “We would therefore need to see overwhelming support from property owners on a given road in order to consider contacting all of them to confirm their unanimous consent to begin the process of changing their street’s name. This has not happened for any of the roads that your request mentioned.”

     —

    Thanks to Steve for letting us know about his long and interesting use of FOI over the last decade and a half – we hope that he will continue to be curious about the events that unfolds around him, and will continue to use WhatDoTheyKnow to satisfy that curiosity.


    Support us in making information available to all
    Donate now
  10. mySociety and Black Thrive: Stop & Search Dashboard

    Supported by the Wellcome Data Prize in Mental Health, mySociety are providing technical support to the organisation Black Thrive, whose work addresses the inequalities that negatively impact the mental health and wellbeing of Black people. Their question: does disproportional use of police stop and search impact the mental health of young Black people in England and Wales? This project aims to find out.

    Late last year mySociety provided some low-key support during the Discovery phase of the project as Black Thrive were developing their statistics package to extract and enhance data from data.police.uk to make the data more accessible and research-ready (for example, by making it easier to combine the data with other datasets such as Understanding Society, a longitudinal household panel study).

    We’re pleased to say that the project made an impact, and we’ll now be more actively sharing our expertise in creating data-heavy, citizen-focused services by collaborating with Black Thrive, King’s College London, and UNJUST CIC in the Prototyping phase of the Data Prize.

    Now that Black Thrive have built an automated way of gathering the data and creating the analysis, the next phase focuses on presenting these in an open dashboard that’s straightforward for anyone to use and understand. We’ll also be looking at mechanisms for automatically keeping the data up to date, and adding new datapoints when they become available.

    Having built several dashboards into our own services including WhatDoTheyKnow and FixMyStreet, we’ve got some great experience to build off; plus bags of experience in sourcing and munging lots of disparate data from our EveryPolitician project. More recently we’ve been making local council Climate Action Plans explorable and accessible, and also creating an easy-to-use data hub for data about local MPs, constituencies, public opinion and the climate and nature movement so this project sits comfortably within our wheelhouse.

    In fact, as it happens, we’re currently using very similar tech on another project, our Local Intelligence Hub prototype, and we’re going to use it as the basis for this new dashboard. Nothing like a bit of crafty repurposing where it helps save time and effort! 

    Here’s a sneak peek of how it’s looking at this early stage:

    Black Thrive Stop & Search Dashboard proof of concept using the Local Intelligence Hub prototype

    Watch this space and we’ll be sure to keep the updates coming as we progress.

    Image: Chris White (CC by-nc-nd/2.0)


    Like what we do? Help us bring more projects like this into the world.
    Donate now