Open Data Cube

Open Data Cube
Name	Open Data Cube
Developer	Open Data Cube Community
Released	2015
Programming language	Python
Operating system	Cross-platform
License	Open-source

Open Data Cube is an open-source geospatial data management and analysis platform designed to index, store, and provide time-series access to satellite imagery and other raster datasets. It enables systematic analysis of temporal and spatial patterns for environmental monitoring, natural resources management, disaster response, and research by integrating diverse datasets and queryable indexing. The project emerged from collaborations among research institutions, government agencies, and non-governmental organizations to operationalize long-term earth observation workflows.

Overview

The platform provides a standardized approach to cataloguing and querying large collections of remote sensing products produced by providers such as European Space Agency, National Aeronautics and Space Administration, United States Geological Survey, Japan Aerospace Exploration Agency, and Planet Labs. It was influenced by architecture patterns from initiatives like Google Earth Engine, GEOSS, and Group on Earth Observations while promoting decentralised deployments similar to efforts by OpenStreetMap and Creative Commons. Partners and implementers include national bodies such as Geoscience Australia, Kenya Space Agency, and multilateral programs like United Nations Environment Programme and World Bank projects. The project aligns with standards produced by Open Geospatial Consortium and practices used by research groups at :Category:Remote sensing research institutions.

Architecture and Components

The software stack centers on a PostgreSQL database extended with PostGIS and cloud-native object stores used by providers including Amazon Web Services, Google Cloud Platform, and Microsoft Azure. Core components consist of an indexing service, a product definition model, and API layers implemented in Python libraries and web services compatible with frameworks like Django and Flask. The architecture integrates with processing engines such as Dask, Apache Spark, and container orchestration via Kubernetes for distributed computation. Client toolchains include command-line utilities, Jupyter notebooks popular at Massachusetts Institute of Technology and University of Oxford, and integrations to visualization platforms like QGIS and MapServer.

Data Models and Supported Datasets

Data models are expressed as product definitions that describe how raster bands, masks, and metadata map to storage objects from missions including Landsat program, Sentinel-2, MODIS, and commercial providers like Maxar Technologies. The schema supports multi-dimensional arrays and metadata standards from ISO 19115 and interoperability with catalogues such as Catalog Service for the Web and OGC Web Coverage Service. Implementations often ingest derived datasets from projects like Global Forest Watch, Group on Earth Observations Biodiversity Observation Network, and reanalysis products from European Centre for Medium-Range Weather Forecasts. Community-driven collections have been built for regional inventories such as those maintained by Geoscience Australia and national initiatives in Kenya and Colombia.

Use Cases and Applications

Adopters apply the platform to operational monitoring for deforestation tracking used by groups cooperating with WWF and Conservation International, agricultural monitoring alongside agencies like Food and Agriculture Organization, water resource assessments informing World Bank programs, and disaster mapping coordinated with International Federation of Red Cross and Red Crescent Societies. Research groups at University of Cambridge, University of California, Berkeley, and CSIRO leverage the system for climate impact studies, land cover change analysis, and urban expansion monitoring linked to municipal projects in cities such as Nairobi and Canberra. Humanitarian applications have supported response activities with partners like United Nations Office for the Coordination of Humanitarian Affairs and Médecins Sans Frontières.

Deployment and Scalability

Deployments range from single-node setups for academic laboratories at institutions like Imperial College London to large-scale national systems operated by agencies such as Geoscience Australia and cloud-native deployments by contractors to World Bank and United Nations programs. Scalability is addressed through tiling strategies, chunking, and distributed compute using Dask clusters, containerised workflows on Kubernetes, and object storage optimised on Amazon S3 or Google Cloud Storage. Operational considerations include metadata curation, provenance tracking informed by PROV-O practices, and integration with authentication systems like OAuth 2.0 and identity providers used by projects at European Commission research initiatives.

Community, Governance, and Development

The project is stewarded by a global community of contributors from academia, national mapping agencies, non-profit organisations, and private companies including implementers that have built regional programmes in Kenya, Nigeria, Peru, and Australia. Governance practices follow open-source norms seen in communities around Apache Software Foundation projects and coordinate via collaborative platforms used by contributors at The Open Data Institute, Digital Earth Africa, and research networks associated with Future Earth. Development is tracked through public repositories and issue trackers mirroring workflows common to projects like QGIS and GDAL, with documentation and training materials produced by partners including Group on Earth Observations and universities in consortia such as Committee on Earth Observation Satellites-aligned networks.

Category:Remote sensing