NOIRLab Astro Data Lab

NOIRLab Astro Data Lab is a science platform operated by NSF's NOIRLab that provides integrated access to large astronomical datasets and scalable analysis tools. It is designed to enable data-intensive science and discovery without requiring users to download massive datasets to their local computing resources. The platform is a core component of NOIRLab's data-centric mission, supporting research across fields like galactic astronomy, extragalactic astronomy, and cosmology.

Overview

The Astro Data Lab was established to address the challenges of the big data era in astronomy, exemplified by surveys from facilities like the Vera C. Rubin Observatory and the Dark Energy Spectroscopic Instrument. It is part of the Community Science and Data Center (CSDC) within NSF's NOIRLab, which also operates the Astro Data Archive. The platform is physically hosted in Tucson, Arizona, leveraging the computational infrastructure of the National Optical Astronomy Observatory. Its development aligns with the data science strategies of the National Science Foundation and the Astro2020 Decadal Survey.

Data and Services

The platform hosts curated, analysis-ready datasets from major optical and near-infrared sky surveys. Core datasets include the complete catalogs from the Dark Energy Survey (DES), the Pan-STARRS1 survey, and the DECam Legacy Survey. It also provides access to value-added data products, such as the NOIRLab Source Catalog, which combines measurements from multiple surveys. These services integrate with the NASA/IPAC Extragalactic Database and the Sloan Digital Sky Survey catalog archives, creating a federated data ecosystem. The underlying data storage and management utilize technologies like Apache Parquet for efficient querying.

Science Platform and Tools

The Astro Data Lab provides a cloud-based Jupyter Notebook environment with pre-configured software stacks, including popular libraries like Astropy, SciPy, and scikit-learn. A key feature is its implementation of a Table Access Protocol (TAP) service, allowing users to perform sophisticated SQL queries on multi-terabyte catalogs directly via the ADQL query language. Specialized analysis tools include the Source Characterization Tool for measuring object properties and the Image Cutout Service for retrieving survey images. The platform's architecture is built on Kubernetes for scalable container orchestration, facilitating reproducible research.

Community and Science Impact

The platform supports a wide range of scientific investigations, from discovering Milky Way satellite galaxies and stellar streams to studying the large-scale structure of the universe. It has been instrumental in projects like the Backyard Worlds: Planet 9 citizen science initiative, which searches for brown dwarfs and Planet Nine candidates. Research enabled by the Astro Data Lab has been published in journals such as The Astrophysical Journal and the Astronomical Journal. The platform also plays a key role in training and education, hosting workshops in collaboration with the American Astronomical Society and programs like the NOIRLab Summer Student Program.

Access and User Support

Access to the Astro Data Lab is free and open to the global astronomical community, requiring only a standard NOIRLab User Portal account. The platform offers extensive documentation, tutorials, and example notebooks to help users navigate its capabilities. User support is provided by a dedicated team of scientists and engineers from the Community Science and Data Center. For large-scale or collaborative projects, users can request dedicated resource allocations. The platform's development is guided by user feedback gathered through forums and events like the annual NOIRLab Users Meeting.

Category:Astronomical databases Category:NSF's NOIRLab Category:Astronomical research institutes