/Patent Tracker
MetaGranted patentAR, VR & displaysInterest 6/10

Meta patents secure way to show your body in VR apps

Meta describes a system for virtual reality headsets that uses machine learning to detect your body in camera feeds. It then places a secure version of your body into the virtual scene by writing directly to the display buffer after other apps have finished, ensuring other apps cannot see or change your image.

Why it mattersThis helps protect user privacy and ensures your avatar looks correct in mixed reality apps, even when other software is running in the background.

In the filing’s own words

The disclosed artificial reality system can provide a user self representation in an artificial reality environment based on a self portion from an image of the user. The artificial reality system can generate the self representation by applying a machine learning model to classify the self portion of the image. The machine learning model can be trained to identify self portions in images based on a set of training images, with portions tagged as either depicting a user from a self-perspective or not. The artificial reality system can display the self portion as a self representation in the artificial reality environment by positioning them in the artificial reality environment relative to the user's perspective in the artificial reality environment. The artificial reality system can also identify movements of the user and can adjust the self representation to match the user's movement, providing more accurate self representations.

What exactly they claim (claim 1)

1. A method for providing a secured self representation of a user in an artificial reality (XR) environment, the method comprising: receiving, by a secure application with permission to write to an output frame buffer, one or more images captured in real time by one or more cameras on an XR system; selecting, by the secure application and a machine learning model trained to identify a portion of the user in an image, a secured self representation in each of the one or more images, wherein the secured self representation includes the portion of the user; accessing, by the secure application, the frame buffer through which one or more other applications are providing XR content in the XR environment; determining a portion of the frame buffer relative to the secured self representation; and displaying, in the XR environment, the secured self representation by writing the secured self representation to the portion of the frame buffer after the one or more other applications have written to the frame buffer, wherein: the one or more other applications cannot access the secured self representation written to the frame buffer; and the one or more other applications cannot access the one or more images received by the secure application.

Facts

Company
Meta (Meta Platforms Technologies, LLC)
Official title
Providing a secured self-representation by writing to a portion if a frame buffer after other applications have written to the frame buffer, where the other applications cannot access the secured-self representation or the images received by a secure application
Patent number
US12737996B2
Application number
18497754
Filed
Oct 30, 2023
Granted
Sep 15, 2026
Inventors
3
Claims
20

Classified under

G06T 19/006 Physics & computingG06N 20/00 Physics & computingG06T 15/205 Physics & computingG06V 40/10 Physics & computing
Read the full filing (official PDF) ↗ Open in the Patent Tracker

More from Meta in AR, VR & displays

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.