London Datastore

London Datastore
Name	London Datastore
Type	Open data portal
Owner	Greater London Authority
Established	2010
Location	London

London Datastore is an open data portal launched to publish datasets relating to the Greater London Authority, City of London Corporation, and agencies serving the London Borough of Camden, London Borough of Hackney, London Borough of Islington, and other London boroughs. The platform was introduced during the tenure of Boris Johnson (mayor) and expanded under Sadiq Khan to support transparency initiatives associated with institutions such as the Transport for London, Metropolitan Police Service, and the National Health Service (England) components serving the capital.

History

The portal was created in response to global open data movements influenced by projects like Data.gov (United States), data.gov.uk, and municipal efforts in New York City and San Francisco. Early development involved collaboration among the Greater London Authority, civic technologists from groups like MySociety and Open Knowledge Foundation, and academic partners from University College London, London School of Economics, and the King's College London. The initiative paralleled policy drivers including the Freedom of Information Act 2000 reforms and international standards advanced by the Open Government Partnership. Over time the platform integrated datasets produced by bodies such as Codecademy-affiliated developers, Ordnance Survey releases, and contributions linked to projects at Imperial College London.

Purpose and Scope

The portal's stated aims align with commitments to transparency championed by the Greater London Authority, the Mayor of London, and civic groups including Transparency International and the Joseph Rowntree Foundation. It serves researchers at institutions like the London School of Economics, journalists at outlets such as the BBC, The Guardian, and the Financial Times, and practitioners from Transport for London and the Environment Agency. The scope includes spatial data tied to Ordnance Survey National Grid, public transport metrics from Transport for London timetables, and public health statistics relevant to NHS England trusts operating in London.

Data Collections and Datasets

Collections range across thematic areas produced by agencies including Metropolitan Police Service crime logs, Transport for London ridership figures, Office for National Statistics demographic releases, and environment measurements from the Environment Agency. Notable datasets mirror work by academic centres at Queen Mary University of London, Goldsmiths, University of London, and think tanks such as the Institute for Fiscal Studies and the Resolution Foundation. Spatial layers reference products from the Ordnance Survey and mapping standards used by projects connected to OpenStreetMap contributors. Historical datasets link to archives held by The National Archives (United Kingdom), while urban indicators reflect analyses by Centre for Cities and London Councils.

Platform and Technology

Technically, the portal has relied on open-source components and commercial services similar to those used by CKAN-based platforms and cloud providers like Amazon Web Services or Microsoft Azure in public-sector deployments. The infrastructure supports formats such as GeoJSON, CSV (file format), and Shapefile packages used by GIS teams at Ordnance Survey and university research groups. APIs facilitate programmatic access akin to endpoints offered by data.gov.uk and interoperability efforts promoted by the Open Data Institute. Visualization and analytics tools used by external partners include QGIS, Tableau (software), and libraries maintained by contributors to GitHub projects.

Access, Use and Licensing

Datasets are published under licences consistent with those endorsed by the Open Government Licence and mirror practices recommended by the Open Knowledge Foundation and the National Archives (United Kingdom). Access methods include web download, API queries used by developers from Code for America-inspired civic corps and analysts at research centres like The Alan Turing Institute. Licensing choices aim to balance reuse by commercial actors, NGOs such as Shelter (charity), and academics at UCL Institute of Health Informatics while respecting data protection rules from the Information Commissioner's Office and provisions in laws such as the Data Protection Act 2018.

Governance and Funding

Governance is anchored in the Greater London Authority with strategy inputs from the Mayor's office and advisory engagement from civic groups including Open Data Institute and MySociety. Funding has combined GLA budget lines, grants from philanthropic entities like the Royal Society and project funding aligned with European programmes similar to initiatives funded by the European Commission prior to the UK's exit from the European Union. Operational partnerships involve data provision agreements with bodies such as Transport for London, the Metropolitan Police Service, and local borough councils across London Borough of Westminster and London Borough of Tower Hamlets.

Impact and Reception

The portal has been cited in research by institutions such as University College London and think tanks including the Institute for Government for enabling civic apps, investigative reporting by organisations like The Guardian and the BBC, and academic studies published in journals associated with Nature (journal) and The Lancet. It supported projects tracking mobility trends used by Transport for London planners and public health modelling by teams connected to Imperial College London during public emergencies. Critics from groups including Privacy International and commentators in outlets like The Financial Times have raised questions about data quality, granularity, and privacy safeguards overseen by regulators such as the Information Commissioner's Office.

Category:Open data portals Category:Greater London Authority