Microsoft Mixed Reality Capture Studios

Microsoft Mixed Reality Capture Studios
Name	Microsoft Mixed Reality Capture Studios
Location	Redmond, Washington, United States
Established	2016
Owner	Microsoft Corporation

Microsoft Mixed Reality Capture Studios Microsoft Mixed Reality Capture Studios operated as a pioneering volumetric video facility developed by Microsoft Corporation near the Microsoft Redmond campus to produce high-fidelity three-dimensional performances for immersive platforms. The studio's work integrated advances from research groups such as Microsoft Research and product teams working on HoloLens to serve clients spanning entertainment, sports, and cultural institutions. The facility combined expertise drawn from collaborations with organizations like BBC, Paramount Pictures, Disney, and academic partners including Stanford University and MIT.

History

The studio was announced in 2016 alongside investments by Microsoft Corporation in immersive technologies and followed demonstrations at events including Xbox E3 and Microsoft Build. Early projects involved partnerships with media companies such as HBO, Netflix, Warner Bros., and Universal Pictures to explore volumetric capture for franchises like Star Trek influences and cinematic production experiments. Leadership and research came from teams linked to Alex Kipman's mixed reality initiatives and engineering groups formerly collaborating with Nokia imaging teams and Rare's motion technologies. Public showcases appeared at venues like SIGGRAPH, CES, and SXSW, and the studio contributed assets to experimental exhibits at institutions such as the Smithsonian Institution and the Museum of Modern Art.

Technology and Facilities

The facility housed a multi-camera rig inspired by approaches used by companies like The Mill, Industrial Light & Magic, and Framestore but tailored to volumetric capture pipelines. Its hardware combined high-resolution CMOS cameras similar to models used by RED Digital Cinema and synchronized lighting systems drawing on standards from Arri and Kino Flo. Processing infrastructure leaned on compute resources comparable to deployments by NVIDIA GPU clusters and server designs favored by Dell Technologies and HP Enterprise. Software integrations referenced algorithms developed in publications from ETH Zurich and research groups at Carnegie Mellon University for photogrammetry, multi-view stereo, and neural rendering. The studio's physical space included green-screen volumes, calibration rigs similar to those used by ILM, and storage systems adopting architectures used by Amazon Web Services S3 workflows.

Capture Process

Performances were recorded using techniques comparable to volumetric systems from Microsoft Research, Depthkit, and 3Lateral (now part of Epic Games through MetaHuman pipelines). The capture pipeline combined synchronized multi-view capture, depth reconstruction methods discussed in papers from University of Oxford and ETH Zurich, and mesh processing influenced by tools from Autodesk and Pixar's research groups. Post-processing used photogrammetry steps also employed by teams at Epic Games and animation studios like Weta Digital to produce textured 3D meshes and point-cloud sequences consumable by playback engines such as Unity (game engine) and Unreal Engine. The workflow enabled iteration with motion capture systems used by companies like Vicon and OptiTrack for skeletal alignment and animation retargeting to virtual avatars.

Applications and Use Cases

The studio's output targeted scenarios in immersive media embraced by organizations including Marvel Studios, Lucasfilm, and National Geographic. Use cases included virtual performances for HoloLens enterprise demos, archival projects for cultural heritage partners like the British Museum and Louvre, and sports visualizations for leagues such as the NBA and FIFA. Educational pilots connected to universities such as Harvard University, Yale University, and University of California, Berkeley explored applications in remote instruction and museum digitization. Collaborations with broadcasters like NBC, CNN, and Al Jazeera examined novel storytelling formats, while agencies such as NASA and ESA investigated volumetric visualization for training and outreach.

Partnerships and Collaborations

The studio partnered with a diverse set of entertainment and research organizations. Notable collaborations included production work with Warner Bros. Pictures, Paramount Pictures, Disney Research, and Sony Pictures Entertainment for promotional content. Technology partnerships involved integrations with NVIDIA for rendering, cloud services with Microsoft Azure, and middleware tie-ins to Unity Technologies and Epic Games. Academic collaborations connected to labs at Stanford University, Massachusetts Institute of Technology, Carnegie Mellon University, and University College London for advances in capture algorithms. Cultural and institutional partnerships included projects with the Smithsonian Institution, Tate Modern, and Guggenheim Museum for digitization and exhibition.

Reception and Impact

Critics and industry observers from outlets such as The Verge, Wired, The New York Times, and Variety (magazine) noted the studio's role in accelerating volumetric content production and influencing workflows at post-production houses like Industrial Light & Magic and Framestore. The studio's demonstrations influenced hardware product discussions at Microsoft Build and Game Developers Conference panels and informed design decisions for successor platforms including later generations of HoloLens and mixed reality tooling. Academic citations appeared in conferences such as SIGGRAPH, CVPR, and ECCV, while commercial impact resonated in adoption conversations among studios including Blue Sky Studios, Laika (company), and streaming services like Amazon Prime Video. The facility helped set benchmarks for capture fidelity used by both legacy studios and emergent virtual production companies.

Category:Microsoft Category:Mixed reality