Meta patents 3D video capture using cameras on smart glasses and hats
Meta describes a method for creating 3D videos of real-world spaces using extended reality devices like smart glasses. The system combines images from multiple cameras with depth sensor data to build a video that lets users look around and move through the scene.
In the filing’s own words
Aspects of the present disclosure are directed to generating and providing three-dimensional spatial videos of a real-world environment by extended reality (XR) systems, such as augmented reality (AR) systems (e.g., smart glasses). For example, a spatial video generation system can provide 3D spatial video capturing capabilities to XR systems that can allow virtual reality (VR) and mixed reality (MR) systems to have immersive video replay in which users can have the experience of moving through and interacting with the captured real-world environment. The XR system can be equipped with multiple cameras and depth sensors for 3D spatial video capturing. In some implementations, additional cameras can be provided on other wearable devices in communication with the XR system, such as a hat.
What exactly they claim (claim 1)
1. A method for generating three-dimensional spatial video for an extended reality playback system, the method comprising: obtaining multiple images of a real-world environment, wherein the multiple images were contemporaneously captured from multiple perspectives by multiple cameras disposed at spatially disparate locations on an extended reality system; obtaining depth data corresponding to the real-world environment, wherein the depth data was captured by one or more depth sensors on the extended reality system; augmenting the multiple images with the obtained depth data; and generating the three-dimensional spatial video of the real-world environment by stitching together the multiple augmented images, wherein the extended reality playback system renders the three-dimensional spatial video.
Facts
- Company
- Meta (Meta Platforms Technologies, LLC)
- Official title
- SPATIAL VIDEO GENERATION VIA IMAGE DATA CAPTURED BY EXTENDED REALITY SYSTEMS
- Publication number
- US20260342951A1
- Application number
- 19631080
- Filed
- Mar 27, 2026
- Published
- Oct 29, 2026
- Inventors
- 5
- Claims
- 20
Classified under
H04N 13/156 Electricity & electronicsG06T 7/337 Physics & computingG06T 7/70 Physics & computingH04N 13/194 Electricity & electronicsH04N 13/243 Electricity & electronicsH04N 13/282 Electricity & electronicsMore from Meta in AR, VR & displays
- Meta patents VR avatars that mimic facial expressions from voice Sep 15, 2026
- Meta patents headset sensors that track facial muscle blood flow Nov 10, 2026
- Meta patents spatial mouse for pointing at and controlling real-world objects Sep 24, 2026
- Meta patents glasses that build custom menus based on what you ask for Oct 29, 2026
- Meta patents AR notifications that grow when you look at them Sep 1, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
