HEIF

HEIF
Name	High Efficiency Image File Format
Extension	.heif, .heic
Owner	Moving Picture Experts Group
Genre	Image container format
Released	2015
Latest release	2019 (ISO/IEC 23008-12)
Open	ISO standard

HEIF HEIF is a modern image container format developed to store individual images, image sequences, and related metadata using efficient compression codecs. It was standardized by ISO/IEC and is associated with advances in video compression, multimedia frameworks, and operating system support that link to developments from Apple Inc., Microsoft, Google LLC, MPEG, and other standards bodies. HEIF aims to improve storage efficiency, metadata capability, and feature extensibility relative to predecessors adopted by institutions like Adobe Systems, Nikon Corporation, and Samsung Electronics.

Overview

HEIF is defined in the ISO/IEC standards framework and interoperates with codecs from organizations such as Moving Picture Experts Group and Joint Photographic Experts Group. It acts as a container similar in concept to MP4 and QuickTime File Format, enabling encapsulation of images encoded by codecs associated with projects like High Efficiency Video Coding (HEVC) from ITU-T, AOMedia Video 1 (AV1) from the Alliance for Open Media, and JPEG 2000 extensions. Platform vendors and camera manufacturers including Apple Inc., Sony Corporation, Canon Inc., and Huawei have integrated HEIF support into products that also leverage multimedia frameworks like FFmpeg, GStreamer, and ImageMagick.

History and development

Work on HEIF traces to standardization activities in ISO/IEC committees and the Moving Picture Experts Group's efforts to create efficient image containers aligned with HEVC development by ITU-T Study Group 16 and collaborative projects with ISO/IEC JTC 1/SC 29. Early adoption milestones involved Apple Inc. announcing support for HEIF in iOS 11 and macOS High Sierra, while other players such as Microsoft Corporation and Google LLC evaluated or added support across Windows 10, Android, and cloud services from Amazon Web Services and Dropbox. Camera and smartphone makers including Nokia Corporation, LG Electronics, and Xiaomi explored HEIF for storage and capture pipelines. Industry forums like Blu-ray Disc Association and academic conferences including ICIP and CVPR discussed encoding efficiency, metadata schemas, and interoperability.

Technical specifications

The format is specified in ISO/IEC 23008-12 and uses the ISO Base Media File Format as a foundation, which links to standards underpinning MP4 and MOV. HEIF defines item types, sample tables, and metadata containers that interact with codec-specific sample entries for HEVC, AV1, and other codestreams. Profiles and brands reference work from MPEG-H, MPEG-4, and codec specifications by Cisco Systems and Bell Labs researchers. Technical elements include support for image sequences, image derivations, layers, alpha channels, auxiliary images, and timed metadata consistent with mechanisms in MPEG-4 Part 12 and ISO/IEC 14496-12.

Features and extensions

HEIF supports advanced capabilities such as multiple images per file, image sequences for animations, lossless and lossy coding via HEVC or AV1, and auxiliary items for depth maps and transparency—features leveraged in devices from Apple Inc. and cameras from Canon Inc. and Sony Corporation. Extensions enable use of metadata standards like EXIF, XMP, and ICC profiles for color management favored by Adobe Systems workflows and printing houses. Support for derived images allows non-destructive edits similar to features in Capture One and Adobe Lightroom, while container extensibility permits new codecs through liaison with organizations such as ITU-T and AOMedia.

Software and hardware support

Software ecosystems including FFmpeg, GStreamer, ImageMagick, Photoshop, and native viewers in iOS and macOS provide varying degrees of HEIF handling, while cloud platforms from Google Cloud Platform and Microsoft Azure offer processing pipelines. Hardware vendors like Intel Corporation, Qualcomm, ARM Ltd., NVIDIA Corporation, and Samsung Electronics have implemented hardware acceleration for HEVC decoding and, more recently, for AV1, influencing HEIF performance on devices from Dell, HP Inc., Lenovo, and smartphone makers. Mobile operating systems—iOS, Android, and HarmonyOS—and desktop systems—Windows 10 and macOS—differ in native codec licensing and API exposure.

Adoption and compatibility

Adoption spans consumer electronics manufacturers, software vendors, and online platforms including Apple Inc., Google LLC, Facebook, Twitter, Instagram, Snap Inc., and cloud services like Dropbox. Web ecosystem support involves initiatives from WHATWG and W3C discussions on image formats, while browser vendors including Mozilla Foundation, Google Chrome Team, Microsoft Edge Team, and Apple WebKit handle HEIF via built-in codecs or by falling back to JPEG or PNG. Camera manufacturers such as Canon Inc., Nikon Corporation, Fujifilm, and Sony Corporation incorporate HEIF output in mirrorless and smartphone cameras, affecting workflows in content creation suites from Adobe Systems and publishing platforms like WordPress.

Criticism and legal issues

Critics point to patent and licensing complexities tied to HEVC and other codecs, implicating entities like MPEG LA, Via Licensing, Qualcomm, and corporate patent pools that affect adoption by Google LLC and open-source projects. Legal disputes and licensing negotiations have involved major companies including Apple Inc., Samsung Electronics, Dolby Laboratories, and consortiums such as MPEG Steering Committee, raising concerns similar to past debates around MP3 and H.264/MPEG-4 AVC. Compatibility fragmentation and limited universal browser support have prompted discussions within W3C and among developers at GitHub and Stack Overflow about fallback strategies, codec patents, and royalty-free alternatives championed by Alliance for Open Media.

Category:Image file formats