MetaGranted patentAR, VR & displaysInterest 8/10

Meta patents headset sensors that track facial muscle blood flow

This patent describes a method for using sensors inside a VR headset to detect subtle changes in blood flow within facial arteries. By analyzing these signals with machine learning, the system identifies specific facial expressions and updates the user's digital avatar in real time.

Why it mattersThis technology could make virtual interactions feel more natural by allowing avatars to mimic real human facial expressions without external cameras.

In the filing’s own words

A method for updating a subject avatar with a facial expression collected in real time. The method includes receiving, from a sensor on a facial interface of a headset, a signal indicative of a movement in a facial muscle from a user of the headset, determining a facial expression of the user with the signal from the sensor in the facial interface of the headset, based on a machine learning algorithm trained to associate the facial expression to the movement of the facial muscle, adjusting a subject avatar for the user of the headset based on the facial expression, and providing the subject avatar to an immersive reality application hosted by a remote server. A headset, a computer-readable medium storing instructions which, when executed by a processor cause the headset to perform the above method, and the processor, are also provided.

What exactly they claim (claim 1)

1. A computer-implemented method, comprising: receiving, from a sensor on a facial interface of a first headset, a signal indicative of a movement in a facial muscle from a first user of the first headset; determining, based on the signal, a degree of activation of the facial muscle based on changes in blood flow in facial arteries associated with contractions of facial muscles of the first user; determining a facial expression of the first user with the signal from the sensor in the facial interface of the first headset, based on a machine learning algorithm trained to associate the facial expression with the movement of the facial muscle based at least in part on the degree of activation of the facial muscle; adjusting a subject avatar of the first user of the first headset based on the facial expression; and providing, from a remote server hosting an immersive reality application, the adjusted subject avatar to one or more headsets used by multiple users in the immersive reality application.

Facts

Company
Meta (Meta Platforms Technologies, LLC)
Official title
Embedded sensors in immersive reality headsets to enable social presence
Patent number
US12793310B2
Application number
18053276
Filed
Nov 7, 2022
Granted
Nov 10, 2026
Inventors
5
Claims
20

Classified under

G06T 13/40 Physics & computingG06F 3/012 Physics & computingG06F 3/013 Physics & computingG06F 3/017 Physics & computingG06T 17/10 Physics & computing

More from Meta in AR, VR & displays

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.