MPEG-H 3D Audio

MPEG-H 3D Audio
Name	MPEG-H 3D Audio
Developer	Moving Picture Experts Group
Released	2015
Latest release	MPEG-H 3D Audio ISO/IEC 23008-3
Operating system	Cross-platform
Genre	Audio coding, Spatial audio
License	ISO/IEC standards

MPEG-H 3D Audio is an ISO/IEC standardized audio coding system designed for immersive and object-based sound reproduction for broadcast, streaming, cinema, and interactive media. It merges channel-based, object-based, and Higher Order Ambisonics techniques to support flexible rendering across loudspeaker arrays, headphones, mobile devices, and home theater systems. The standard was developed by the Moving Picture Experts Group with contributions from broadcasters, consumer electronics manufacturers, and content creators to address next-generation spatial audio demands.

Overview

MPEG-H 3D Audio was standardized by Moving Picture Experts Group under ISO/IEC as part of the MPEG family of standards alongside MPEG-2, MPEG-4, and MPEG-DASH. It enables representation of audio as a combination of fixed channels, audio objects, and Higher Order Ambisonics streams to support immersive experiences similar to those sought by Dolby Laboratories, DTS, and SMPTE. Early demonstrations occurred at industry events such as IBC (conference), CES, and NAB Show, with pilot deployments by broadcasters including NHK, BBC, NRK (Norway), and ARD (broadcaster). The format interoperates with delivery ecosystems involving vendors like Samsung Electronics, Sony Corporation, LG Electronics, and LG Chem-related AV divisions.

Technical Architecture and Components

MPEG-H 3D Audio architecture separates content creation, encoding, transport, and rendering. Core components include the encoder specified in ISO/IEC 23008-3, the decoder for consumer devices, and an authoring toolchain used by facilities such as Technicolor, Fraunhofer IIS, Dolby Laboratories research teams, and university labs like IRCAM and AES (Audio Engineering Society) research groups. The format defines metadata models for upmixing, downmixing, object metadata, and scene description with influence from organizations like ETSI, EBU, and 3GPP. MPEG-H integrates with container formats used by MPEG-4 Part 14 and transport protocols common in DVB, ATSC 3.0, and adaptive streaming via MPEG-DASH and companies such as Akamai Technologies.

Coding Tools and Profiles

Coding tools in MPEG-H include perceptual audio coding similar to techniques used by Fraunhofer IIS in MP3 and AAC, parametric coding, spatial audio object coding, and HOA compression. Profiles define combinations for low-latency broadcast, high-quality studio mixing, and mobile delivery; they parallel profile strategies used in HEVC and AV1 video ecosystems. Toolsets reference psychoacoustic models developed in collaborations with institutions like NHK Science & Technology Research Laboratories and ITU-R study groups, and leverage bitrate control strategies employed by Apple Inc. and Netflix for streaming.

Applications and Use Cases

Use cases span broadcast sports and live events by FOX Sports, Eurosport, and Sky Group; cinema and home theater by collaborations with Dolby Laboratories and Sony Pictures Entertainment; virtual and augmented reality projects at companies like Google, Meta Platforms, Microsoft, and Epic Games; and gaming engines including Unity Technologies and Epic Games (Unreal Engine). Production workflows at studios such as Warner Bros., Universal Pictures, and post houses like Deluxe Entertainment Services Group use MPEG-H for object-based mixing, while broadcasters like KBS (Korean Broadcaster) and RTVE explore immersive radio. Live music events and immersive installations have been staged by companies like Live Nation Entertainment and venues such as Royal Albert Hall.

Standardization and Industry Adoption

The standardization process involved stakeholders from ITU, IEC, ISO, and regional forums like ETSI and EBU. Adoption has proceeded via pilot transmissions in DVB-T2 trials, integration into ATSC 3.0 reference stacks, and certification activities led by industry consortia including HD Forum and consumer electronics alliances like CTA (Consumer Technology Association). Broadcasters such as BBC and NHK have published test content; device makers including Samsung, LG, Sony, and chip vendors like Qualcomm Technologies and Intel Corporation implemented decoders. Content providers including Netflix and Amazon Studios have evaluated object-based approaches informed by MPEG-H research.

Compatibility and Implementation

MPEG-H decoders have been implemented in software and hardware by semiconductor firms including Broadcom, Amlogic, and Realtek Semiconductor. Integration is available in consumer devices like TVs from Samsung Electronics and Sony Corporation, set-top boxes from Humax, mobile devices from LG Electronics and Samsung, and AV receivers from Yamaha Corporation and Onkyo Corporation. Interoperability testing occurred at interoperability events involving IIS Fraunhofer labs, EBU Tech, and testbeds at NHK. Interfacing with streaming services leverages standards used by MPEG-DASH, Apple HTTP Live Streaming, and CDN operators such as Limelight Networks, Cloudflare, and Akamai Technologies.

Limitations and Future Developments

Limitations include adoption rate compared with incumbent formats from Dolby Laboratories (e.g., Dolby Atmos) and DTS, processing complexity similar to HEVC in video, and challenges in loudspeaker layout standardization reminiscent of debates around 5.1 surround sound and 7.1 surround sound. Future developments focus on tools for lower-latency immersive telepresence for platforms like Zoom Video Communications and Cisco Systems, integration with next-generation codecs such as MPEG-I and convergence with open-source initiatives led by Xiph.Org Foundation and AOMedia (e.g., AV1). Research at universities including MIT, Stanford University, TU Berlin, and University of York addresses perceptual metrics, object-based mixing practices used in Istanbul Technical University labs, and standardized evaluation procedures advocated by AES and ITU-R.

Category:Audio coding formats