NDGF

NDGF
Name	NDGF
Formation	2006
Headquarters	Nordic countries
Region served	Denmark, Finland, Iceland, Norway, Sweden

NDGF The Nordic Data Grid Facility (NDGF) is a distributed computing and data infrastructure initiative serving scientific communities across the Nordic region. It provides storage, high-throughput computing, data management, and middleware integration to large-scale projects in particle physics, astronomy, bioinformatics, and climate science. NDGF coordinates resources among national research centers, universities, and international collaborations to enable data-intensive research and cross-border workflows.

Overview

NDGF operates as a pan-Nordic e-infrastructure linking national centers in Denmark, Finland, Iceland, Norway, and Sweden with international projects such as the CERN-based Large Hadron Collider, the European Space Agency, and the European Research Council initiatives. NDGF aggregates compute clusters, tape libraries, and high-capacity storage across partner sites to support experiments like ATLAS, ALICE, and other collaborations associated with Worldwide LHC Computing Grid. It acts alongside infrastructures including European Grid Infrastructure and Nordic e-Infrastructure Collaboration to provide middleware, authentication, and data transfer services for researchers affiliated with institutions such as the University of Oslo, University of Helsinki, Uppsala University, and University of Copenhagen.

History and Development

NDGF evolved from early grid efforts in the early 2000s that built on middleware projects like gLite and ARC (Advanced Resource Connector), and from national computational initiatives in the Nordic region. The facility formalized coordination in 2006 to meet demands from experiments at CERN and from large-scale projects supported by the NordForsk funding framework. NDGF adapted to transitions in middleware and architecture driven by technology from vendors and projects including OpenStack, GlusterFS, and EOS (CERN) storage concepts, while integrating with continental programs such as the European Grid Infrastructure and pan-European authentication services like eduGAIN.

Architecture and Technical Infrastructure

NDGF’s architecture is federated, combining compute clusters at partner sites such as CSC – IT Center for Science and national laboratories across the Nordic countries. The infrastructure uses grid middleware, storage elements, and tape archives interoperable with dCache, CASTOR (CERN) concepts, and data movement tools like FTS (File Transfer Service). Identity federation and authorization rely on services akin to eduGAIN and certificate authorities such as Nordic Certificate Authority-style providers. Networking interconnects rely on research and education backbones, including GÉANT, national networks like SUNET, NORDUnet, and international links to CERN and major data centers. The stack accommodates workload managers and batch systems derived from projects including HTCondor, SLURM-based clusters, and middleware adapters for experiment-specific orchestration such as PanDA for ATLAS.

Services and Operations

NDGF offers services including distributed storage provisioning, tape access, high-throughput compute queues, data replication, and long-term archiving tailored for physics experiments and other data-intensive disciplines. Operational activities include data placement policies, monitoring with tools influenced by Nagios and Grafana ecosystems, and incident response coordinated across partner operations centers and site administrators at institutions like SINTEF and national research infrastructures. NDGF supports user communities through helpdesk procedures, user authentication mapped to institutional identities represented in eduGAIN, and data management strategies used by collaborations such as IceCube Neutrino Observatory and radio astronomy arrays associated with LOFAR.

Governance and Funding

NDGF is governed through a consortium model linking national partners, universities, and research centers in the Nordic countries. Decision-making involves technical boards, resource coordinators, and executive committees drawn from stakeholders including national research councils and institutions like NordForsk and national ministries of research. Funding has combined national contributions, project grants from European bodies such as the European Commission under Framework Programme calls, and project-specific support from collaborations like CERN. Procurement and budgeting follow policies aligned with participating institutions including universities and national laboratories.

Collaborations and Impact on Research Communities

NDGF collaborates with international infrastructures and scientific collaborations, enabling experiments such as ATLAS, ALICE, CMS, and multi-messenger projects connecting IceCube Neutrino Observatory, LOFAR, and space missions coordinated with European Space Agency. Its services have supported publications and discoveries by researchers at institutions like University of Bergen, Aalto University, Chalmers University of Technology, and Technical University of Denmark. By providing cross-border data sharing and compute capacity, NDGF has strengthened Nordic participation in global projects administered by organizations such as CERN, the European Research Council, and the European Strategy Forum on Research Infrastructures, while fostering collaborations with initiatives including OpenAIRE and national research infrastructures.

Category:Research infrastructure Category:Nordic countries