Meta patents using a phone's camera to track your head for virtual avatars
Meta describes a system that uses the sensors and camera on a handheld device, like a smartphone, to track the position of a user's head. It then uses this data to place a digital avatar and virtual objects in a 3D space that matches the user's real-world movements.
In the filing’s own words
In one embodiment, a computing system may determine a device pose of a handheld device in a real-world space based on one or more sensors associated with the handheld device. The system may determine a head pose of a first user associated with the handheld device based on face-tracking data of the handheld device, the head pose being with respect to the handheld device in the real-world space. The system may render a first avatar associated with the first user in a virtual space based on the head pose of the first user in the real-world space. The system may render one or more virtual objects in the virtual space to the first user based on the head pose of the first user in the real-world space.
What exactly they claim (claim 1)
1. A method comprising, by a computing system: rendering a first avatar associated with a first user in a virtual space based on a head pose of the first user in a real-world space, the rendering including: generating a representation of a first action performed by the first user, and refraining from generating an additional representation of a second action performed by the user; and rendering at least one virtual object in the virtual space to the first user based on the head pose of the first user in the real-world space.
Facts
- Company
- Meta (Meta Platforms Technologies, LLC)
- Official title
- ACCESSING ARTIFICIAL REALITY CONTENT THROUGH A HANDHELD DEVICE
- Publication number
- US20260295410A1
- Application number
- 19696124
- Filed
- Jun 2, 2026
- Published
- Oct 1, 2026
- Inventors
- 1
- Claims
- 20
Classified under
A63F 13/52 Human necessitiesA63F 13/65 Human necessitiesA63F 13/822 Human necessitiesG06F 3/012 Physics & computingG06T 15/005 Physics & computingG06T 15/60 Physics & computingMore from Meta in AR, VR & displays
- Meta patents VR avatars that mimic facial expressions from voice Sep 15, 2026
- Meta patents spatial mouse for pointing at and controlling real-world objects Sep 24, 2026
- Meta patents AR notifications that grow when you look at them Sep 1, 2026
- Meta patents AR glasses with antennas built into the lenses Sep 8, 2026
- Meta patents auto-pause for VR headsets when you take them off Oct 6, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.