Fermilab Scientific Data Facility

Fermilab Scientific Data Facility
Name	Fermilab Scientific Data Facility
Established	21st century
Location	Batavia, Illinois
Type	Scientific data center
Operator	Fermi National Accelerator Laboratory

Fermilab Scientific Data Facility is a dedicated data-center complex that supports high-energy physics experiments, neutrino research, and particle-physics computing projects at Fermi National Accelerator Laboratory in Batavia, Illinois. The facility provides compute, storage, networking, and archival services to collaborations running experiments such as those associated with the Tevatron, the Large Hadron Collider, and long-baseline neutrino programs, while interfacing with national and international infrastructures like Oak Ridge National Laboratory, Lawrence Berkeley National Laboratory, and the European Organization for Nuclear Research. It integrates resources to serve projects funded by the United States Department of Energy, coordinated with agencies such as the National Science Foundation and international university consortia.

Overview

The facility functions as a regional and international hub connecting experiments, institutions, and projects including MINOS, NOvA, DUNE, CMS, ATLAS, and legacy datasets from CDF and D0. It provides services used by collaborations from University of Chicago, University of California, Berkeley, Massachusetts Institute of Technology, Stanford University, and other research centers affiliated with organizations such as SLAC National Accelerator Laboratory, Brookhaven National Laboratory, and Lawrence Livermore National Laboratory. The center's design emphasizes interoperability with grid and cloud initiatives like Open Science Grid, Globus, and commercial platforms represented by Amazon Web Services and Google Cloud Platform in cooperative arrangements with national research infrastructures.

History and Development

The development timeline traces back to data-management challenges observed during operations at Fermilab in the era of the Tevatron collider and subsequent shifts toward global collaborations exemplified by LHC experiments. Major milestones include upgrades aligned with milestones from collaborations such as DUNE planning, the advent of petascale datasets during CMS and ATLAS runs, and coordinated projects with agencies including the Department of Energy and institutions like National Energy Research Scientific Computing Center (via Lawrence Berkeley National Laboratory). Partnerships with international research bodies including CERN, the European Grid Infrastructure, and university consortia supported expansion phases that mirrored data strategies developed at Argonne National Laboratory and Pacific Northwest National Laboratory.

Architecture and Infrastructure

Physical infrastructure includes hardened server halls, high-density racks, and modular expansion lanes designed alongside standards promoted by Uptime Institute tiers and engineering collaborations with firms used by SLAC National Accelerator Laboratory and Oak Ridge National Laboratory. Networking integrates high-bandwidth links to the Energy Sciences Network and peering with Internet2 and regional research networks used by National Center for Supercomputing Applications. Storage architectures leverage object stores, tape libraries compatible with LTO standards, and parallel filesystems similar to implementations at NERSC; compute clusters support workload managers like HTCondor and container platforms influenced by Kubernetes deployments at research institutions such as Stanford University and MIT.

Data Management and Services

Core services include data ingestion pipelines, metadata catalogs, archival retrieval, and preservation strategies developed in collaboration with experts from University of Illinois Urbana–Champaign, Carnegie Mellon University, and Cornell University. The facility supports distributed data workflows using tools interoperable with ROOT and analysis frameworks used by ATLAS and CMS collaborations, and integrates authentication and authorization infrastructures aligned with InCommon federations and identity providers used by DOE laboratories. Data lifecycle management follows practices comparable to those at CERN and RAL for long-baseline and collider datasets, offering user portals, APIs, and batch submission interfaces adopted by groups at University of Michigan, Columbia University, and Yale University.

Research Applications and Users

Primary users include collaborations working on experiments such as DUNE, NOvA, MINOS+, MicroBooNE, and computationally intensive analyses for CMS and ATLAS physics. The facility also supports cross-disciplinary projects involving teams from Purdue University, Princeton University, Rutgers University, and international partners in Europe and Asia tied to CERN and regional labs. Use cases encompass event reconstruction, Monte Carlo production, detector simulation, and machine-learning workflows influenced by techniques developed at Google Research and academic centers like UC Berkeley and MIT CSAIL.

Governance, Funding, and Partnerships

Governance is provided by the laboratory’s senior management in coordination with program offices of the United States Department of Energy Office of Science, with funding from DOE, contributions from participating universities, and cooperative agreements with agencies including the National Science Foundation. Strategic partnerships involve collaborations with CERN, Oak Ridge National Laboratory, Lawrence Berkeley National Laboratory, and commercial partners for cloud and hardware provisioning. Advisory committees often draw members from institutions such as Fellowship programs and panels including representatives from University of Chicago, Argonne National Laboratory, and international research councils.

Security, Compliance, and Sustainability

Security and compliance follow DOE policies and standards compatible with federal guidance used at Brookhaven National Laboratory and Los Alamos National Laboratory, covering physical security, cybersecurity, and data protection frameworks employed by NERSC and other national centers. Sustainability efforts echo initiatives at Lawrence Berkeley National Laboratory and Oak Ridge National Laboratory to reduce energy use through chilled-water systems, free-air cooling, and modular power designs, while procurement strategies reference vendors experienced with research infrastructures used by SLAC National Accelerator Laboratory.

Category:Data centers Category:Fermilab