Astro Data Lab

Astro Data Lab. A science platform developed and operated by NSF's NOIRLab to provide integrated access to large astronomical datasets and scalable analysis tools for the research community. It is part of the Astroinformatics ecosystem, designed to enable data-intensive science from major survey telescopes like the Vera C. Rubin Observatory and the Dark Energy Spectroscopic Instrument. The platform allows scientists to perform complex analyses close to the data, minimizing the need for large data transfers and facilitating reproducible research.

Overview

The Astro Data Lab was established to address the challenges posed by the petabyte-scale data volumes from modern digital sky surveys. It operates as a core component of the Community Science and Data Center (CSDC) within NSF's NOIRLab, which also manages data from the Gemini Observatory and the Kitt Peak National Observatory. The platform's architecture is built on a cloud-based infrastructure, providing a Jupyter Notebook server environment and access to a curated, query-ready data repository. This model supports the FAIR principles for scientific data management, ensuring data are Findable, Accessible, Interoperable, and Reusable. Its development aligns with the broader goals of the National Science Foundation to enhance cyberinfrastructure for astronomy.

Data and Tools

The platform hosts major public datasets, including those from the Dark Energy Survey, the Sloan Digital Sky Survey (SDSS), and the Pan-STARRS1 survey. A key offering is the NOIRLab Source Catalog, a multi-survey catalog combining measurements from these and other archives. Core analysis tools include a powerful query service using the PostgreSQL-based ADQL (Astronomical Data Query Language) and the TAP (Table Access Protocol) standard. Users can leverage a suite of Python libraries, such as Astropy, for analysis within the platform's virtual environments. The lab also provides specialized software like the LSST Science Pipelines for precursor work related to the Vera C. Rubin Observatory.

Science Applications

Research enabled by the Astro Data Lab spans numerous fields in astrophysics. It is extensively used for studies of Galaxy evolution and the large-scale structure of the universe, leveraging the deep, wide-field imaging from surveys like the Dark Energy Survey. Scientists utilize its catalogs to identify and characterize Quasars, Brown dwarfs, and Trans-Neptunian objects. The platform's ability to cross-match datasets facilitates time-domain astronomy, supporting research on Variable stars and Supernovae. Its infrastructure is also critical for preparing the community for the data deluge expected from the Legacy Survey of Space and Time (LSST).

Access and Usage

Access to the Astro Data Lab is freely available to the global astronomical community after registration with a NOIRLab account. The primary interface is a web portal that provides documentation, example notebooks, and direct links to the JupyterHub analysis environment. Users are allocated computational resources, including CPU and memory, within a shared environment to run their analysis scripts. The platform supports collaborative research, allowing users to share notebooks and scripts. For large-scale or proprietary projects, researchers can apply for dedicated resource allocations through the NOIRLab proposal system.

Related Projects

The Astro Data Lab is conceptually and technically related to several other major data-intensive astronomy platforms. It shares similarities with the Mikulski Archive for Space Telescopes (MAST) at the Space Telescope Science Institute, which serves data from Hubble Space Telescope and James Webb Space Telescope. The IRSA (Infrared Science Archive) at IPAC provides analogous services for infrared missions like the Spitzer Space Telescope. Within the optical survey domain, it is a partner and complement to the SciServer platform at Johns Hopkins University, which also hosts SDSS data. Its development informs and is informed by the emerging Astro2020 decadal survey recommendations on data archives and cyberinfrastructure. Category:Astronomical databases Category:NSF's NOIRLab Category:Astroinformatics