1. Forward into alpha: what we’ve learned about Alaveteli Professional

    As we recently mentioned, one of mySociety’s current big projects is Alaveteli Professional, a Freedom of Information toolset for journalists.

    It’s something we wanted to build, and something we believed there was a need for: but wanting and believing do not make a sound business case, and that’s why we spent the first few weeks of the project in a ‘discovery’ phase.

    Our plan was to find out as much as we could about journalists, our prospective users — and particularly just how they go about using FOI in their work. Ultimately, though, we were seeking to understand whether journalists really would want, or need, the product as we were imagining it.

    So we went and talked to people at both ends of the FOI process: on the one hand, journalists who make requests, and on the other, the information officers who respond to them.

    Since we’re planning on making Alaveteli Professional available to partners around the world, it also made sense to conduct similar interviews outside the UK. Thanks to links with our Czech partner, running Informace Pro Všechny on Alaveteli, that was a simple matter. A recent event at the Times building in London also allowed us to present and discuss our findings, and listen to a couple of interesting expert presentations: Matt Burgess of Buzzfeed talked about some brilliant use of FOI to expose criminal landlords, and listed FOI officers’ biggest complaints about journalists. Josh Boswell of the Sunday Times was equally insightful as he ran through the ways that he uses FOI when developing stories.

    These conversations have all helped.

    The life of an investigative journalist is never simple

    Alaveteli Professional process diagram drawn by Mike Thompson

    The insights our interviewees gave us were turned by Mike Thompson (formerly of mySociety, and brought back in for this phase) into a simple process model showing how journalists work when they’re pursuing an investigation using FOI.

    After conceiving of a story that requires input from one or more FOI request, every journalist will go through three broad phases: research; request and response; and the final data analysis and writing. The more complicated cases can also involve refused requests and the appeals process.

    For a busy working journalist, there are challenges at every step. Each of these adds time and complexity to the process of writing a story, which is an anathema to the normal daily news cycle. FOI-based stories can be slow, and timing unpredictable — editors do not particularly like being told that you’re working on a story, but can’t say when it will be ready, or how much value it will have.

    During the research phase diligent journalists will make a time-consuming trawl through resources like authorities’ own disclosure logs and our own site WhatDoTheyKnow (or its equivalents in other countries), to see if the data they need has already been released.

    Where a ‘round robin’ request is planned, asking for information from multiple authorities — sometimes hundreds — for information, further research is needed to ensure that only relevant bodies are included. In our two-tired council system, where different levels of authority deal with different responsibilities, and not always according to a consistent pattern, that can be a real challenge.

    Wording a request also takes some expertise: get that wrong and the authorities will be coming back for clarification, which adds even more time to the process.

    Once the request has been made it’s hard to keep on top of correspondence, especially for a large round robin request. Imagine sending a request to every council in the country, as might well be done for a UK-wide story, and then dealing with each body’s acknowledgements, requests for clarifications and refusals.

    When the responses are in journalists often find that interpretation is a challenge. Different authorities might store data or measure metrics differently from one another; and pulling out a meaningful story means having the insight to, for example, adjust figures to account for the fact that different authorities are different sizes and cater for differently-dispersed populations.

    Sadly, it’s often at this stage that journalists realise that they’ve asked the wrong question to start with, or wish that they’d included an additional dimension to the data they’ve requested.

    What journalists need

    As we talked through all these difficulties with journalists, we gained a pretty good understanding of their needs. Some of these had been on our list from the start, and others were a surprise, showing the value of this kind of exploration before you sit down to write a single line of code.

    Here’s what our final list of the most desirable features looks like:

    An embargo We already knew, anecdotally, that journalists tend not to use WhatDoTheyKnow to make requests, because of its public nature. It was slightly sobering to have this confirmed via first person accounts from journalists who had had their stories ‘stolen’… and those who admitted to having appropriated stories themselves! Every journalist we spoke to agreed that any FOI tool for their profession would need to include a way of keeping requests hidden until after publication of their story.

    However, this adds a slight dilemma. Using Alaveteli Professional and going through the embargo-setting process introduces an extra hurdle into the journalist’s process, when our aim is, of course, to make the FOI procedure quicker and smoother. Can we ensure that everything else is so beneficial that this one additional task is worthwhile for the user?

    Talking to journalists, we discovered that almost all are keen to share their data once their story has gone live. Not only does it give concrete corroboration of the piece, but it was felt that an active profile on an Alaveteli site, bursting with successful investigations, could add to a journalist’s reputation — a very important consideration in the industry.

    Request management tools Any service that could put order into the myriad responses that can quickly descend into chaos would be welcome for journalists who typically have several FOI requests on the go at any one time.

    Alaveteli Professional’s dashboard interface would allow for a snapshot view of request statuses. Related requests could be bundled together, and there would be the ability to quickly tag and classify new correspondence.

    Round-robin tools Rather than send a notification every time a body responds (often with no more than an acknowledgement), the system could hold back, alerting you only when a request appears to need attention, or send you status updates for the entire project at predefined intervals.

    Refusal advice Many journalists abandon a request once it’s been refused, whether from a lack of time or a lack of knowledge about the appeals process. WhatDoTheyKnow Professional would be able to offer in-context advice on refusals, helping journalists take the next step.

    Insight tools Can we save journalists’ time in the research phase, by giving an easy representation of what sort of information is already available on Alaveteli sites, and by breaking down what kind of information each authority holds? That could help with terminology, too: if a request refers to data in the same language that is used internally within the council, then their understanding of the request and their response is likely to be quicker and easier.

    Onwards to Alpha

    We’re currently working on the next part of the build — the alpha phase.

    In this, we’re building quick, minimally-functional prototypes that will clearly show how Alaveteli Professional will work, but without investing time into a fully-refined product. After all, what we discover may mean that we change our plans, and it’s better not to have gone too far down the line at that point.

    If you are a journalist and you would like to get involved with testing during this stage and the next — beta — then please do get in touch at alaveteli-professional@mysociety.org.


    Image: Goodwines (CC by-nc-nd/2.0)

  2. Journalists celebrate Freedom of Information: corruption in student unions

    All this week, we’ll be celebrating International Right to Know Day and the 250th anniversary of Freedom of Information with some insights from journalists who have used FOI in their work.

    Some journalists focus on very specific areas in their use of FOI.

    Dániel G. Szabó is an editor on Hungary’s Atlatszo Oktatas, a blog hosted on the major news outlet Atlatszo, and run largely by students. He revealed how FOI has been the key to exposing corruption in the country’s student unions.

    Dániel G. SzabóOur project Transparent Education was established on freedom of information.

    It’s a blog focusing on corruption in higher education in Hungary, with a very heavy reliance on freedom of information requests and the analysis of the data acquired through FOI.

    Hungarian student unions, where future political elites learn the basics of democracy, are infected with corruption and our blog works to reveal it.

    We established the national jurisprudence on the accountability of student unions: courts ruled in our cases for the first time that student unions are to respond freedom of information requests and their expenditures should be transparent.

    We sued many state-financed and also religious schools, and tracked the fate of several million euros spent by student union officials who are in their twenties. Without freedom of information laws and court rulings, the data on these funds would have never came to light.

    If you’re a journalist yourself, you might be interested in our latest project.

    But don’t forget, FOI isn’t just for journalists: anyone can make their own requests for information at WhatDoTheyKnow.com.

    Image: Bicanski (CC-0)

  3. Journalists celebrate Freedom of Information: Croatia

    All this week, we’ll be celebrating International Right to Know Day and the 250th anniversary of Freedom of Information with some insights from journalists who have used FOI in their work.

    Today, we hear from Danela Žagar, a journalist by profession and currently working at the Croatian NGO the Centre for Peace Studies. Danela says:

    In Croatia unfortunately, there still remains a culture of secrecy, left over from the previous regime when everything connected with the state, public authorities, local governments and public companies was enveloped in a thick veil of secrecy. To a great extent, it still is.

    But the paradigm is changing and the public are beginning to demand and expect the important principles of transparency and openness, for data to be available to the public and in an accessible format.

    That said, the government still has a fear of citizens as the people who vote them in. It’s clear that many facts are still hidden despite the existence of the Information Commissioner. We still have not reached the level of openness that many other countries enjoy as standard, or at least are on their way towards.

    The FOI Act is a valuable tool for journalists, and in Croatia its true potential is just being discovered. We have the right to access accurate information in a timely fashion thanks to the Media Act, but unfortunately it often happens that spokesmen for the public authorities hijack access to information.

    FOI allows journalists to obtain this information — and by using the Alaveteli website imamopravoznati.org journalists can follow their own requests, and also track other interesting questions and answers from public authorities.

    Since transparency is key to democracy and a fundamental prerequisite for ensuring public confidence in the work of institutions and politicians, the right of access to information is an important tool in all fields of social engagement in Croatia.

    Journalists and civil society organisations often expose the bad work of politicians through this tool.

    Check the next installment to learn how a journalist in Hungary uncovered a mire of corruption… in Student Unions.

    If you’re a journalist yourself, you might be interested in our latest project.

    But don’t forget, FOI isn’t just for journalists: anyone can make their own requests for information at WhatDoTheyKnow.com.

    Image: Andi Weiland | berlinergazette.de (CC by 2.0)

  4. Journalists celebrate Freedom of Information: Hungary

    Today is International Right to Know Day! 2016 is also the 250th anniversary of Freedom of Information and we’ve been marking these two facts all week with insights from journalists who have used FOI in their work.

    Here’s Katalin Erdélyi, a journalist who works with Atlatszo.hu. That’s the news service that’s closely affiliated to Alaveteli site KiMitTud.

    We began by asking Katalin to tell us about a memorable story that had been written with the aid of FOI.

    Katalin ErdélyiThe Museum of the Fine Arts in Budapest lent 10 antique paintings to a company tied to the PM’s personal advisor Arpad Habony.

    The value of the paintings was HUF 400 million (~ GB £1.06 million) but the company paid only HUF 150,000 (~ GB £400) per month for them, and they hadn’t insured the paintings either.

    We filed a lawsuit because the museum refused my request to publish information on where the paintings were.

    After a year and a half in court we won the case, and the museum had to publish the information that during the whole lending period the paintings were in a private apartment where the PM’s advisor is a frequent visitor.

    After my article was published the Minister of Culture issued a written notice to the director of the museum because he hadn’t asked for his permission for the loan. The director of the museum later admitted he was on friendly terms with the PM’s advisor. He was the best man at Habony’s wedding which was held at the museum. Habony wasn’t charged any rental fees.

    What’s the significance of FOI in your opinion?

    Freedom of Information is important because citizens have the right to know what, why, how and at what costs are things happening in the country where they live and work.

    The state spends their taxes, therefore it is right to expect it to operate in a transparent way. And if someone knows they can be checked up on at any time, they will pay attention to what they do.

    The right to information is a foundation of democracy, a check on power, and it pays an important role in fighting illegal activities and corruption.

    What has Freedom of Information meant to you, as a journalist?

    FOI is very important for investigative journalism.

    If contracts of public spending weren’t open to public, many corruption cases would never be revealed. The Hungarian government has amended the FOI law several times in the past few years, and always in the negative direction.

    Each time they limit the data that falls under the scope of the FOI Act, so that they can keep dubious affairs secret. This causes the risk of corruption to rise even higher, and our work has become even more challenging.

    When the right to information is wide, and public spending is transparent, it’s much easier to notice suspicious cases.

    Do you consider FOI to be a vital tool for the future?

    It’s very important to apply FOI in as many places and as widely as possible. If there’s no FOI, there’s no democracy.

    If we let political interests become more important than FOI we will end up in a dictatorship. The task and interest of the non-governmental organisations is to check on power, and this is only possible with freedom of information.

    We have to stand up for it everywhere, every time.

    Read the next installment to learn how a journalist in Croatia has used FOI.

    If you’re a journalist yourself, you might be interested in our latest project.

    But don’t forget, FOI isn’t just for journalists: anyone can make their own requests for information at WhatDoTheyKnow.com.

    Image: KovacsDaniel CC BY-SA 3.0

  5. Journalists celebrate Freedom of Information: UK (part 2)

    All this week, we’ll be celebrating International Right to Know Day and the 250th anniversary of Freedom of Information with some insights from journalists who have used FOI in their work.

    Today we hear from Martin Rosenbaum, the BBC’s Freedom of Information specialist.

    Martin Rosenbaum

    Since 2005 I and my colleagues in the BBC have used FOI as the foundation for certainly hundreds and hundreds, possibly thousands, of news stories and investigations at national and regional levels, across a wide range of topics — health, education, policing, environment, transport, foreign policy, and so on.

    Image by Ben Welsh Martin Rosenbaum discusses British open data laws on Thursday, Feb. 24, 2011.This has included revelations on important issues from staff shortages in A&E departments to how officials wrongly dismissed predictions about levels of Eastern European immigration, from which makes of cars are most likely to fail MOT tests to the numbers of parents withdrawing their children from schools, from the cost of policing football games to the identities of individuals who have turned down honours.

    Journalism is based on asking people questions, but of course much of the time there’s no guarantee you will actually get them answered.

    Freedom of information is a rare and valuable tool because it provides a legal right to some information — a right that can be enforced when necessary by independent bodies, the Information Commissioner and the Information Rights Tribunal. And that means FOI provides the power to obtain certain material in the public interest that otherwise could not be squeezed out of reluctant public authorities.

    FOI has made a crucial difference to what the media can find out and what the public knows about what central and local government and the public sector is doing.

    Read the next post to learn how FOI has been used by journalists in Hungary.

    If you’re a journalist yourself, you might be interested in our latest project.

    But don’t forget, FOI isn’t just for journalists: you can make your own requests for information at WhatDoTheyKnow.com.

     


    Image: Martin Rosenbaum by Ben Welsh CC BY-2.0

  6. Journalists celebrate Freedom of Information: UK

    All this week, we’ll be celebrating International Right to Know Day and the 250th anniversary of Freedom of Information with some insights from journalists who have used FOI in their work.

    Here in the UK, two names are particularly linked to FOI: Professor Heather Brooke, the investigative journalist who is responsible for the publication of MPs’ expenses, and Martin Rosenbaum, the BBC’s FOI correspondent.

    Today we hear from Heather about the importance of FOI and how she’s used it, and tomorrow you can read Martin’s views.

    Heather Brooke

    I took two important FOI cases through the legal appeals process: one seeking the minutes to a BBC Board of Governors Meeting after the Hutton Inquiry1, and my notable legal victory against the House of Commons for details of MPs’ expenses2.

    Paul Clarke [CC BY-SA 3.0 (http://creativecommons.org/licenses/by-sa/3.0)], via Wikimedia CommonsThis victory in the UK High Court fundamentally changed law and policy, and for the first time in its history Parliament had to account to an outside body over how MPs’ claimed expenses.  The court ruling and subsequent leak of the data led to a number of high-level political resignations as well as full-scale reform of the parliamentary expense regime and passage of the Recall of MPs Act 2015. A new government was elected in May 2010 on a mandate of transparency in part due to the scandal

    I made extensive use of the UK’s Freedom of Information Act, filing about 500 FOIs and writing some 60 newspaper and magazine articles about the law and its impact on democracy from 2005-2010. I used the law to map and monitor public bodies for the first time in a citizen-friendly way in Your Right to Know. Through FOI I was able to flag up current and future problems such as secrecy in food safety regulation, the postcode lottery for criminal justice, the amounts police spend on public liability claims and propaganda.

    Freedom of Information, rooted in Enlightenment values, contains within it a key principle of democracy that there must be access to information (and knowledge) for all equally. My approach in my 25-year journalistic career has been to use FOI as a means of testing the promise and practice of democracy.  By their responses to FOI requests, we see how agencies truly think about citizens’ rights to access and participate in the political system.

    Read the next installment to learn how Martin Rosenbaum’s use of FOI has underpinned hundreds, if not thousands, of news stories at the BBC.

    If you’re a journalist yourself, you might be interested in our latest project.

    But don’t forget, FOI isn’t just for journalists: you can make your own requests for information at WhatDoTheyKnow.com.

    1Guardian Newspapers Ltd and Heather Brooke v IC and the BBC (2007) EA/2006/0011; EA/2006/0013
    2Corporate Officer of the House of Commons v Information Commissioner & Heather Brooke, Ben Leapman, Jonathan Michael Ungoed-Thomas [2008] EWHC 1084 (Admin) (16 May 2008)

    Images: Cameramen at the Hutton Inquiry by Ben Sutherland CC BY-2.0; Heather Brooke by Paul Clarke CC BY-SA 3.0 via Wikimedia Commons.

  7. Alaveteli Professional – learning more about journalistic use of Freedom of Information

    In the last few weeks, we’ve started conducting background research interviews for our new project, Alaveteli Professional. Alaveteli Professional will be a companion service to Alaveteli, our Freedom of Information platform – initially it will be aimed specifically at journalists, but it should be of interest to anyone who uses Freedom of Information in their work.

    Why are we doing this project?

    Alaveteli Professional is an unusual project for mySociety. Our mission is to create digital tools that empower citizens in their interactions with the state, and people in power. Usually that means that we create tools which we intend to be used by as broad a range of people as possible – we think a lot about how to design and build for people in their role as citizens, which is a role we all experience. But with Alaveteli Professional, we’re focusing on journalists, a specific professional group. Why is that?

    Citizen empowerment doesn’t always happen by direct interaction with institutions. Feeling empowered and capable of affecting what happens in your community requires knowing what’s going on in your community. Although models of journalism are changing, whether you’re getting your news from The Times, or from Buzzfeed, whether it’s funded by a paywall or by crowdsourcing, it’s hard to imagine a future in which ordinary people can be well-informed, without specialists doggedly asking questions of power, putting information from different sources together, and helping make sense of what’s going on.

    Alaveteli-powered sites like WhatDoTheyKnow have been successful in giving ordinary people a simple way to ask questions of government and to share the responses with everyone automatically online. But we know that the way the sites work doesn’t always match the needs of someone who’s working on assembling a bigger story that they may want to break elsewhere. We’d love to see the work put into Alaveteli so far also go to serve the goal of informing people through high quality public interest stories in media platforms with a long reach.

    That’s why we were delighted to get funding for the project from the Google Digital News Initiative, which aims ‘to support high quality journalism and encourage a more sustainable news ecosystem through technology and innovation’.

    What we’re doing

    The initial research for the project has been an interesting and exciting process, and not just because it has meant actually ‘leaving for work’ in the morning, rather than spending the day entirely in the virtual world of remote working. For me, one of the real joys of working on digital tools is the opportunity to spend some time in different domains of life and think about how they work.

    We’ve been talking to media professionals who use Freedom of Information requests in their jobs, trying to understand what parts of the process are painful or unnecessarily time consuming. We’re also talking to FOI officers, and other people who’ve thought deeply about journalistic use of FOI, in an effort to understand the ecosystem of people and motivations – and answer questions of who is doing what and why. It’s been a real pleasure to explore these questions with people who’ve been incredibly generous with their time and ideas.

    The process of making a Freedom of Information request can sometimes seem quite similar to an adversarial legal system – with the requester pitted against an institution that’s reluctant to release information, and FOI law defining the obligations, exemptions, and public interest tests that set the landscape in which the two sides are in conflict. But as with any other domain, the more you dig into it, the more interesting complexity you find in both sides, and in the interaction between the two.

    There are freelance journalists working against the clock to turn around a story they can sell, but also data journalism groups in larger institutions making frequent requests as part of ‘business as usual’, and pushing out stories to their regional colleagues. As you would expect, there’s competition between journalists and media institutions, but also surprising opportunities for collaboration and shared resources. There’s a significant amount of collaboration between requesters and authorities – in some cases producing nuanced national public-interest data sets that neither could generate alone. There’s a lot of diversity in the authorities that are subject to Freedom of Information law – from tiny schools and parish councils to huge central government departments, police and health authorities. There’s also still variation in how different authorities store similar data and how they respond to FOI requests.

    What’s next?

    At this point, we’re trying to get the best sense we can of both the details and the big picture. We’re also starting to ask where we could reduce friction, encourage responsible practices, save time in such a way that it benefits the system as a whole, and increase the chance of ordinary people becoming better informed about what is being done with their money and in their name by institutions. It’s an exciting part of the project, as we start to discard some of the preconceptions we had about what might be useful, and get more confident in the value of others. I’m looking forward to starting to put those ideas into practice in the form of simple prototypes that we can put back in front of people.

    Image: Dean Hochman (CC by 2.0)