OpenXR

OpenXR
Name	OpenXR
Developer	Khronos Group
Initial release	2019
Stable release	1.0 (2019)
License	Permissive specification
Website	Khronos Group

OpenXR is an open, royalty-free standard that defines an application programming interface for virtual reality and augmented reality devices. It was created to enable interoperability among hardware vendors such as Oculus VR, HTC Corporation, Microsoft, Valve Corporation, and software platforms like Unity (game engine), Unreal Engine, and Blender (software). The specification aims to reduce fragmentation across head-mounted displays from companies including Sony Interactive Entertainment, Google, and Apple Inc. while supporting ecosystems maintained by organizations such as the Khronos Group, Linux Foundation, and standards efforts in ISO/IEC contexts.

Overview

OpenXR provides a cross-platform API layer that exposes runtime capabilities of devices from Meta Platforms, Inc., HTC Corporation, Valve Corporation, Microsoft Corporation, and display manufacturers like Samsung Electronics and LG Corporation. By abstracting device-specific functions, it allows applications built with engines like Unity (game engine), Unreal Engine, Godot (game engine), and middleware from NVIDIA Corporation and AMD to run on disparate hardware backends. The standard defines core concepts such as sessions, spaces, and action sets used by development tools like Visual Studio, Xcode, and integrated development environments at companies like JetBrains.

History and Development

Work on the API began with collaboration between members of the Khronos Group and companies including Oculus VR, Valve Corporation, Microsoft, Google, Sony Interactive Entertainment, and Epic Games. The 1.0 release in 2019 followed prior efforts by proprietary layers such as OpenVR and platform-specific APIs like Windows Mixed Reality and Google ARCore. Contributors from corporations such as Intel Corporation, NVIDIA Corporation, Qualcomm, Facebook (company), Magic Leap, and academic labs at institutions like Massachusetts Institute of Technology and Stanford University participated in working groups and interoperability events with consortia such as W3C and IEEE. Subsequent versions incorporated feedback from pilot implementations by vendors like HTC Corporation and research projects at University of California, Berkeley.

Architecture and Components

The specification delineates a modular architecture including runtime, loader, and layer concepts. Runtimes are implemented by vendors like Microsoft Corporation (for Windows 10), Valve Corporation (for SteamVR), and Meta Platforms, Inc. (for Oculus Rift). The loader and loader layers interact with application libraries produced for engines such as Unity (game engine) and Unreal Engine, and middleware from Autodesk and Pixar. Core components include Instance, System, Session, Space, Swapchain, and Actions; these map to device capabilities from companies like Vuzix, Pimax, and HP Inc.. Extension mechanisms allow contributions from vendors like Qualcomm for mobile SoC features and NVIDIA Corporation for foveated rendering.

Features and Specifications

OpenXR specifies interfaces for tracking, input, rendering, and composition. Input action abstraction supports controllers from Valve Corporation and Sony Interactive Entertainment as well as hand and eye tracking from Leap Motion and Tobii. Tracking spaces accommodate coordinate systems used by HTC Corporation and Oculus VR, while rendering integration supports graphics APIs such as Vulkan, OpenGL, Direct3D 11, and Direct3D 12. Features include predicted display timing, late-latch techniques used by NVIDIA Corporation and AMD, and support for passthrough AR modes implemented by Magic Leap and Microsoft HoloLens. The extension model allows vendor-specific functions, for example proprietary layers for passthrough, hand mesh access, or advanced foveation from Qualcomm.

Implementations and Ecosystem

Multiple open-source and commercial implementations exist: runtime implementations in SteamVR by Valve Corporation, platform runtimes by Microsoft for Windows Mixed Reality, and vendor SDKs from Oculus VR and HTC Corporation. Engine integrations are provided by Unity Technologies and Epic Games; toolchains from Autodesk and Blender Foundation include exporters and importers. Community projects on platforms like GitHub and package managers such as npm or Conan (package manager) host bindings and helper libraries. Certification and compliance testing involve test suites developed by Khronos Group and interoperability events with participants from NVIDIA Corporation, AMD, Intel Corporation, and academic partners.

Adoption and Use Cases

OpenXR has been adopted for gaming titles from publishers like Electronic Arts, Activision Blizzard, and Ubisoft, industrial training platforms from Siemens, Boeing, and General Electric, and simulation systems in research at MIT, Stanford University, and Carnegie Mellon University. It supports enterprise AR solutions from PTC (company), Microsoft Dynamics 365, and medical visualization vendors collaborating with hospitals such as Mayo Clinic and Cleveland Clinic. Use cases span location-based entertainment operated by Disney, architectural visualization by firms working with Autodesk Revit, and academic research in cognitive science at institutions like Harvard University.

Governance and Versioning

Governance is led by the Khronos Group working group with participating members including Microsoft Corporation, Valve Corporation, Meta Platforms, Inc., Google LLC, Apple Inc., Intel Corporation, NVIDIA Corporation, AMD, Qualcomm, and others. Releases follow a versioning and extension policy published by the consortium, with conformance tests and an official conformance logo managed by Khronos Group committees. The roadmap has been shaped by inputs from industry standards bodies such as IEEE and collaboration events with organizations like W3C and national research agencies.

Category:Virtual reality