Video codecs

Video codecs
Name	Video codecs
Developer	Various
Released	1980s–present
Format	Digital video

Video codecs are algorithms and software systems that encode and decode moving images for storage, transmission, and playback. They balance compression efficiency, computational complexity, and perceptual quality to enable applications ranging from broadcast television to streaming, video conferencing, and digital cinema. Engineers and organizations across industry and academia collaborate through standards bodies and open projects to evolve codec designs and deployments.

Overview

Video codecs operate at the intersection of signal processing, applied mathematics, and computer engineering, bringing together contributions from institutions such as Bell Labs, MIT, Stanford University, Fraunhofer Society, University of California, Berkeley, and companies including Apple Inc., Microsoft, Google LLC, IBM, Intel, and NVIDIA. Standards and interoperability work is coordinated by organizations like the Moving Picture Experts Group, the International Telecommunication Union, the Internet Engineering Task Force, and the European Broadcasting Union. Proprietary ecosystems are supported by firms such as Sony Corporation, Samsung Electronics, Qualcomm, Huawei Technologies, and Cisco Systems, while open-source communities around projects like FFmpeg, x264, x265, libvpx, and AOMedia Video 1 provide reference implementations used in products from Netflix to YouTube.

History and development

Early practical codecs emerged from research at Bell Labs and laboratories at AT&T Corporation during the 1980s, influenced by developments at ITU-T and MPEG-1 work led by the Moving Picture Experts Group. Milestones include the standardization of MPEG-2 for digital television and DVD Forum adoption, the pervasive adoption of H.264/MPEG-4 Part 10 driven by companies like Cisco Systems and VideoLAN, and later advances toward HEVC/H.265 with contributions from MPEG and ITU-T. Alliance-driven efforts such as the Alliance for Open Media brought industry players including Google LLC, Microsoft, Amazon (company), Apple Inc., Netflix, and Intel together to develop modern open designs. The transition from hardware encoders in devices by Panasonic Corporation and Canon Inc. to software and GPU-accelerated encoders from NVIDIA and AMD reflects shifts in compute and distribution paradigms.

Technical principles

Codec design draws on transform coding techniques like the Discrete Cosine Transform (used in MPEG-2 and H.264) and newer transforms such as the Discrete Wavelet Transform and integer approximations used in HEVC. Motion compensation and prediction use block-based algorithms pioneered in MPEG-1 and refined across H.264/AVC and HEVC to exploit temporal redundancy. Entropy coding methods such as Huffman coding, Context-adaptive binary arithmetic coding, and CABAC reduce statistical redundancy. Rate–distortion optimization links to research from Bell Labs and University of Illinois Urbana-Champaign to trade bitrate against perceptual metrics developed by groups like ITU-R and SMPTE. Hardware implementations involve instruction sets and accelerators from ARM Holdings, Intel Corporation, and NVIDIA for real-time encoding in devices from Sony cameras to Apple iPhones.

Major codecs and formats

Prominent legacy and modern codecs include MPEG-1, MPEG-2, MPEG-4 Part 2, H.264, HEVC, AV1, VP8, VP9, and experimental neural approaches such as learned codecs from research labs at Google Research, MIT CSAIL, Facebook AI Research, and DeepMind. Container and transport formats interacting with codecs include MP4, Matroska, MPEG-TS, WebM, QuickTime, and streaming protocols like HTTP Live Streaming and Dynamic Adaptive Streaming over HTTP. Professional formats tied to production workflows include ProRes from Apple Inc., DNxHD from Avid Technology, and standards used in cinemas standardized by Digital Cinema Initiatives.

Applications and use cases

Codec technology underpins services and devices across entertainment, communications, and industry: over-the-top platforms such as Netflix, YouTube (service), Hulu, and Amazon Prime Video; real-time conferencing in Zoom Video Communications, Skype, and Webex; broadcast standards managed by European Broadcasting Union and NAB (National Association of Broadcasters); and surveillance systems by companies like Axis Communications. Codecs enable bandwidth-constrained delivery over networks managed by AT&T, Verizon Communications, China Mobile, and Deutsche Telekom, and support storage formats in professional camera systems by RED Digital Cinema and Arri. Live sports distribution, virtual reality projects by Oculus VR (Facebook Technologies), and remote sensing from agencies like NASA rely on codec tradeoffs for latency, quality, and robustness.

Licensing and standards

Licensing regimes vary: patented technologies are often licensed via patent pools and organizations such as MPEG LA, HEVC Advance, and Via Licensing, while royalty-free options promoted by the Alliance for Open Media offer alternative commercial models. Standardization and recommendations are issued by ISO/IEC, ITU-R, ITU-T, and MPEG, with patent policy interactions involving companies including Samsung Electronics, Qualcomm, Huawei Technologies, and Panasonic Corporation. Intellectual property considerations affect device makers such as Apple Inc. and Google LLC in decisions about which codecs to implement and which licensing terms to accept.

Future trends and research

Research trends include neural video compression from institutions like University College London and tech labs at OpenAI, integration of perceptual metrics developed by SMPTE and ITU-T, and low-latency codecs for cloud gaming from NVIDIA and Microsoft Azure. Work on energy-efficient codec implementations ties to semiconductor roadmaps at TSMC and Intel Corporation, while standardization efforts by MPEG and Alliance for Open Media continue to evolve profiles and extensions for immersive media, high dynamic range workflows championed by Dolby Laboratories, and error resilient delivery for satellite and mobile networks operated by Eutelsat and SES S.A..

Category:Digital media