This article was accepted into the corpus but its outbound wikilinks were never NER-processed — typical at the deepest BFS hop or when the run's entity cap was reached. No expansion funnel to show.
| htslib | |
|---|---|
| Name | htslib |
| Developer | Wellcome Sanger Institute, European Bioinformatics Institute, community contributors |
| Initial release | 2008 |
| Operating system | Linux, macOS, Windows |
| Genre | Bioinformatics library |
| License | MIT License |
htslib
htslib is a C library for processing high-throughput sequencing data, providing performant parsers, writers, and indexes for commonly used genomic file formats. It underpins numerous Broad Institute tools and integrates with projects from the European Bioinformatics Institute, the Wellcome Sanger Institute, and contributors across the Open Bioinformatics Foundation community. Designed for interoperability, portability, and speed, htslib supports workflows used by researchers at institutions such as National Institutes of Health, European Molecular Biology Laboratory, and Cold Spring Harbor Laboratory.
htslib originated from the evolution of tools associated with the Broad Institute's sequencing efforts and the development of the SAM/BAM specification. Early lineage traces to work by teams at the Wellcome Trust Sanger Institute and collaborations involving the 1000 Genomes Project and the Genome Reference Consortium. As sequencing scaled during initiatives like the Human Genome Project follow-on projects and the ENCODE Project, demand for standardized formats led to consolidations within the Global Alliance for Genomics and Health. Community stewardship transitioned the codebase through contributions from groups at the European Bioinformatics Institute, the National Center for Biotechnology Information, and independent developers. Over successive releases, htslib incorporated indexing advances used in large consortia such as The Cancer Genome Atlas and project infrastructures like Galaxy.
htslib exposes a modular, thread-safe architecture implemented in C that emphasizes low-level I/O, indexing, and format abstraction. Core components include readers and writers for formats standardized by committees like the SAM/BAM specification, compression backends compatible with standards from organizations like the Internet Engineering Task Force, and multithreading facilities inspired by parallel computing practices at laboratories such as Lawrence Berkeley National Laboratory. The library interoperates with language bindings developed by teams at the University of Oxford, the University of California, Santa Cruz, and community groups associated with the Open Source Initiative. Design decisions reflect performance engineering approaches used at institutions like Argonne National Laboratory and Oak Ridge National Laboratory.
htslib implements parsers and serialization for formats central to genomics: formats defined by the SAM/BAM specification, the Variant Call Format standardized by projects like 1000 Genomes Project, compressed container formats influenced by standards from the Internet Engineering Task Force, and coordinate-sorted indexes similar to methods used by the Genome Analysis Toolkit teams. Supported data types include sequence alignments commonly handled in pipelines at Broad Institute workflows, variant records used by groups at Wellcome Sanger Institute variant catalogs, and annotation tracks compatible with tools developed at European Bioinformatics Institute and UCSC Genome Browser resources. File indexing strategies in htslib reflect practices established by the Genome Reference Consortium and by consortia such as Human Cell Atlas.
htslib offers a stable C API consumed by projects in multiple languages and research centers like Stanford University, Harvard University, and Massachusetts Institute of Technology. Bindings and wrappers have been implemented for platforms maintained by teams at Python Software Foundation-affiliated projects, as seen in integrations with software developed at Broad Institute and community packages from the Bioconductor Project. The API exposes abstractions for file streams, iterators, and header manipulation used in pipelines at European Bioinformatics Institute and tested in infrastructures at National Institutes of Health centers. Development workflows utilize continuous integration practices practiced by organizations like GitHub and Travis CI to validate compatibility with toolchains from Apple Inc. and Microsoft.
Bundled utilities built on the htslib API form essential parts of production pipelines at institutions such as Broad Institute and Wellcome Sanger Institute. Command-line programs provide conversion, indexing, and querying capabilities modeled on utilities that emerged from projects like the Sequence Alignment/Map toolset. These utilities integrate into workflow managers used by groups behind Nextflow, Snakemake, and Cromwell to orchestrate analyses in environments run by European Bioinformatics Institute and cloud providers like Amazon Web Services and Google Cloud Platform.
Performance engineering in htslib has been driven by needs from large-scale efforts such as The Cancer Genome Atlas and population genomics projects including UK Biobank. Benchmark suites compare I/O throughput, random-access latency, and CPU efficiency against implementations maintained at organizations like the Broad Institute and research computing centers such as Lawrence Livermore National Laboratory. Optimizations leverage SIMD approaches explored in collaborations with compute centers at Argonne National Laboratory and parallel I/O techniques used by high-performance computing teams at Oak Ridge National Laboratory.
htslib is widely adopted by bioinformatics projects and consortia including the 1000 Genomes Project, Genome Reference Consortium, ENCODE Project, and clinical sequencing groups at academic medical centers like Johns Hopkins University and Mayo Clinic. Downstream software, wrappers, and language bindings originate from ecosystems such as Bioconductor Project, research groups at Stanford University School of Medicine, and commercial entities in genomics infrastructure. Educational resources from institutions like Cold Spring Harbor Laboratory and community training at conferences such as Bioinformatics Open Days propagate knowledge of htslib practices across the bioinformatics community.
Category:Bioinformatics software