MetaGranted patentAR, VR & displaysInterest 6/10

Meta patents AR glasses that suggest actions based on past habits

Patent drawing
Patent drawing from the official filing.

Meta describes a system for augmented reality headsets that uses artificial intelligence to predict helpful actions for users. The device analyzes camera data to recognize when a user is in a specific place or time, then suggests activities like playing music based on their previous behavior.

Why it mattersThis filing shows how Meta plans to make its AR glasses more proactive by learning from user routines to automate simple tasks without manual input.

In the filing’s own words

Features described herein generally relate to predicting policies with an artificial intelligence (AI) platform based on shared or similar interactions. Particularly, data that includes information about users and a corpus of policies is collected, embeddings are generated for the collected data, and policies are predicted based on the embeddings. The policies can be predicted based on content-based filtering, collaborative filtering, and/or game theory approaches.

What exactly they claim (claim 1)

1. An extended reality system comprising: a head-mounted device comprising a display that displays content to a user and one or more cameras that capture images of a visual field of the user wearing the head-mounted device; and a processor to perform operations including: obtaining an artificial-intelligence model that includes: one or more user embeddings based on data about a user profile for the user, wherein each user embedding of the one or more user embeddings is a vector representation of one or more features extracted from the user profile; one or more policy embeddings based on policies in a corpus of policies, wherein each policy embedding of the one or more policy embeddings is a vector representation of one or more features extracted from the policies in the corpus of policies, and the policies in the corpus of policies were (i) determined based on camera data from the one or more cameras of the head-mounted device indicating past activities performed by the user and (ii) include a sensor-based condition and a desired user activity from among the past activities based on satisfaction of the sensor-based condition; predicting, by a virtual assistant application using the artificial-intelligence model, policies for the user to implement at the head-mounted device for suggesting desired user activities, wherein the predicting comprises: determining a score for each of the policies in the corpus of policies based on respective calculated similarity measures between each user embedding of the one or more user embeddings and each policy embedding of the one or more policy embeddings; and identifying policies in the corpus of policies, wherein the score for each identified policy is greater than a predetermined threshold; providing, via the display, the identified policies to the user; receiving, a user input via a user interface, the user input indicating acceptance of a respective identified policy of the identified policies; while the user is determined to be wearing the head-mounted device, executing the respective identified policy, including: determining, based on camera data from the one or more cameras of the head-mounted device, that the user has entered a room of a house during a predefined time of day as specified by a sensor-based condition associated with the respective identified policy; and in response to the determining, executing a respective desired user activity that is associated with satisfaction of the sensor-based condition, including presenting, via a speaker of the head-mounted device, music to the user.

Facts

Company
Meta (Meta Platforms Technologies, LLC)
Official title
Predicting context aware policies based on shared or similar interactions
Patent number
US12776108B2
Application number
18458365
Filed
Aug 30, 2023
Granted
Oct 27, 2026
Inventors
6
Claims
19

Classified under

G06T 19/006 Physics & computingG02B 27/017 Physics & computingH04L 67/306 Electricity & electronicsG02B 2027/0138 Physics & computing

More from Meta in AR, VR & displays

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.