zlib

zlib
Name	zlib
Author	Jean-loup Gailly; Mark Adler
Developer	Community
Released	1995
Operating system	Cross-platform
Genre	Data compression library
License	permissive license

zlib

zlib is a software library for data compression that implements the DEFLATE algorithm and provides lossless compression for applications on platforms such as Unix, Linux, Microsoft Windows, macOS, FreeBSD and Android. The library is closely associated with formats and standards like ZIP (file format), gzip, PNG and protocols like HTTP/1.1 and TLS. zlib is widely used in projects ranging from Apache HTTP Server and Nginx to OpenSSL, SQLite, Git and many Linux kernel subsystems.

History

zlib was created in 1995 by Jean-loup Gailly and Mark Adler, building on earlier work including the DEFLATE specification by Phil Katz and the PKZIP ecosystem. Its development intersected with efforts by organizations such as IETF, Internet Engineering Task Force working groups on RFC 1951, RFC 1950, and standards bodies like ISO. Over time, contributions have come from developers associated with NetBSD, FreeBSD, Red Hat, Debian, Canonical and corporations like Google and Microsoft. The project’s history includes integration into major software such as gzip, PNG reference implementations, and incorporation into libraries for SQLite and OpenSSL.

Design and features

The library implements the DEFLATE combination of LZ77 (derived from work by Abraham Lempel and Jacob Ziv) and Huffman coding concepts associated with David A. Huffman. Design goals emphasized portability for environments including POSIX, Windows NT, VMS and embedded platforms developed by companies like ARM Holdings and Texas Instruments. Features include stream-oriented APIs, flexible compression levels, checksum support based on Adler-32 and compatibility with CRC32 used in the PKZIP and gzip ecosystems. zlib’s architecture supports memory-constrained contexts found in products by Sony, Nokia, Samsung, and telecom vendors such as Ericsson.

Implementation and APIs

Implemented in the C programming language, the codebase exposes functions usable from languages and runtimes including Python, Java, Ruby, Perl, PHP, Node.js, .NET Framework and Go via bindings and wrappers maintained by ecosystems such as CPython, OpenJDK, RubyGems, PEAR, and npm. The API offers inflate/deflate streams, buffer-oriented compression, and utilities for header management compatible with gzip headers and zlib wrapper format defined in relevant RFCs. Implementations within projects like libpng, curl, Qt and Boost demonstrate reference integration patterns and interoperability with build systems such as CMake, Autoconf and make.

Performance and benchmarks

Performance characteristics have been benchmarked against compressors and libraries such as LZMA, bzip2, LZ4, Zstandard, Snappy, and implementations in Intel and AMD optimized libraries. Benchmarks consider metrics like throughput, latency, compression ratio, and CPU utilization on hardware including x86-64 servers, ARM mobile SoCs, and PowerPC appliances. Optimizations for specific instruction sets such as SSE2, AVX2, and NEON have been explored by contributors from Intel Corporation, AMD, Google, and academic groups at institutions like MIT and Stanford University. Comparisons often appear in performance reports by organizations such as Phoronix, SPEC, and vendor whitepapers from Oracle Corporation and IBM.

Licensing and legal issues

zlib is distributed under a permissive license authored by Mark Adler and Jean-loup Gailly that has been adopted and accepted by projects including GNU Project software and corporate distributions from Red Hat and Debian. The license’s compatibility with licenses such as the MIT License, BSD licenses, and the GNU Lesser General Public License facilitated inclusion in projects like Linux kernel, OpenSSL, Mozilla Firefox, and Chromium. Legal discussions have involved organizations such as Software Freedom Conservancy, Free Software Foundation, and corporate legal teams at Microsoft, Apple Inc., and Google when packaging or redistributing combined works.

Adoption and uses

zlib is embedded in a broad ecosystem spanning application software, operating systems, network protocols, and file formats. Notable adopters include Apache Software Foundation projects like Apache HTTP Server, Nginx, databases such as PostgreSQL and MySQL, compression utilities like gzip and zip implementations, and multimedia formats including PNG and PDF. It is used in version control systems like Git, container platforms like Docker, virtualization stacks including QEMU and KVM, and security libraries like OpenSSL and GnuTLS. zlib’s portability and simplicity have enabled use in embedded firmware by vendors such as Intel Corporation, Qualcomm, Broadcom, and consumer device makers like Apple Inc. and Samsung Electronics.

Category:Data compression software