MetaPatent applicationAR, VR & displaysInterest 7/10

Meta patents 3D video capture using cameras on smart glasses and hats

Patent drawing
Patent drawing from the official filing.

Meta describes a method for creating 3D videos of real-world spaces using extended reality devices like smart glasses. The system combines images from multiple cameras with depth sensor data to build a video that lets users look around and move through the scene.

Why it mattersThis could make recorded memories feel more like places you can walk through rather than flat videos, enhancing how we share and relive experiences.

In the filing’s own words

Aspects of the present disclosure are directed to generating and providing three-dimensional spatial videos of a real-world environment by extended reality (XR) systems, such as augmented reality (AR) systems (e.g., smart glasses). For example, a spatial video generation system can provide 3D spatial video capturing capabilities to XR systems that can allow virtual reality (VR) and mixed reality (MR) systems to have immersive video replay in which users can have the experience of moving through and interacting with the captured real-world environment. The XR system can be equipped with multiple cameras and depth sensors for 3D spatial video capturing. In some implementations, additional cameras can be provided on other wearable devices in communication with the XR system, such as a hat.

What exactly they claim (claim 1)

1. A method for generating three-dimensional spatial video for an extended reality playback system, the method comprising: obtaining multiple images of a real-world environment, wherein the multiple images were contemporaneously captured from multiple perspectives by multiple cameras disposed at spatially disparate locations on an extended reality system; obtaining depth data corresponding to the real-world environment, wherein the depth data was captured by one or more depth sensors on the extended reality system; augmenting the multiple images with the obtained depth data; and generating the three-dimensional spatial video of the real-world environment by stitching together the multiple augmented images, wherein the extended reality playback system renders the three-dimensional spatial video.

Facts

Company
Meta (Meta Platforms Technologies, LLC)
Official title
SPATIAL VIDEO GENERATION VIA IMAGE DATA CAPTURED BY EXTENDED REALITY SYSTEMS
Publication number
US20260342951A1
Application number
19631080
Filed
Mar 27, 2026
Published
Oct 29, 2026
Inventors
5
Claims
20

Classified under

H04N 13/156 Electricity & electronicsG06T 7/337 Physics & computingG06T 7/70 Physics & computingH04N 13/194 Electricity & electronicsH04N 13/243 Electricity & electronicsH04N 13/282 Electricity & electronics

More from Meta in AR, VR & displays

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.