Meta patents method to build detailed XR worlds using a headset and phone
Meta describes a system where a headset scans a room to create a basic 3D model and then identifies specific spots that need more detail. It guides a user to take high-quality photos of those spots with a phone, which are then merged into the model to create a sharper digital twin of the space.
In the filing’s own words
Aspects of the present disclosure provide technology for generating an extended reality (XR) environment using data from multiple devices. The method includes performing an initial scan of a real environment using sensors from a primary XR device, such as a head mounted device (HMD), to generate a baseline 3D model. The method then analyzes this model to define regions requiring additional data. Based on these defined regions, the method identifies specific areas of interest and guides a user to capture high-resolution images of these areas using a secondary mobile device. The captured images are received and integrated with the baseline model to generate an updated, high-fidelity XR environment. This hybrid approach combines the spatial awareness of an HMD with the high-quality imaging of a mobile device to create a complete and detailed digital twin of a physical space more efficiently.
What exactly they claim (claim 1)
1. A method for generating an extended reality environment using data from multiple devices, the method comprising: performing an initial scan of a real environment using sensors from an extended reality device; generating an initial extended reality environment from the initial scan; defining regions, of the initial extended reality environment, that each require additional spatial and/or dimensional data; identifying, based on the defined regions, multiple areas of interest to be captured by a mobile device; receiving, from the mobile device, multiple images, each image associated with at least one of the multiple areas of interest; and generating an updated extended reality environment based on the initial extended reality environment and the multiple images associated with the multiple areas of interest.
Facts
- Company
- Meta (Meta Platforms Technologies, LLC)
- Official title
- Generating an Extended Reality Environment Using Multiple Devices
- Publication number
- US20260320931A1
- Application number
- 19570535
- Filed
- Mar 18, 2026
- Published
- Oct 15, 2026
- Inventors
- 5
- Claims
- 20
Classified under
G06T 19/006 Physics & computingG02B 27/017 Physics & computingG06T 15/08 Physics & computingG06T 17/20 Physics & computingG06V 10/25 Physics & computingMore from Meta in AR, VR & displays
- Meta patents VR avatars that mimic facial expressions from voice Sep 15, 2026
- Meta patents spatial mouse for pointing at and controlling real-world objects Sep 24, 2026
- Meta patents AR notifications that grow when you look at them Sep 1, 2026
- Meta patents AR glasses with antennas built into the lenses Sep 8, 2026
- Meta patents auto-pause for VR headsets when you take them off Oct 6, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.