Meta patents XR system that suggests automated rules based on user behavior
Meta describes an extended reality system that uses cameras to track user activities in real and virtual environments. It then uses AI to suggest automated policies, such as when to trigger specific actions on the head-mounted device, which users can approve or modify.
In the filing’s own words
Features described herein generally relate to generating and modifying policies with an artificial intelligence (AI) platform based on user activities. Particularly, data comprising characteristics of activities performed by a user in real-world and virtual environments is collected, a control structure is predicted based on the data and model parameters learned from historical policies, and a new policy is generated or a pre-existing policy is modified based on the control structure.
What exactly they claim (claim 1)
1. An extended reality system comprising: a head-mounted device comprising a display that displays content to a user and one or more cameras; one or more processors; and one or more memories accessible to the one or more processors, the one or more memories storing a plurality of instructions executable by the one or more processors, the plurality of instructions comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising: collecting, at the one or more cameras, data comprising characteristics of activities performed by the user in a real-world environment, a virtual environment, or a combination thereof; at a first point in time: generating a policy based on the data and model parameters learned from historical policies, wherein the policy comprises one or more actions and one or more conditions for executing the one or more actions via the head-mounted device, and wherein the one or more actions and the one or more conditions are determined from the characteristics of the activities; presenting, at the display of the head-mounted device, a user interface that includes a representation of the policy; and in response to receiving a user input indicating that the user approves of the policy, saving the policy; and at a second point in time, after the first point in time: generating a modified policy based on, at least, user interactions via the head-mounted device with respective actions executed in accordance with the policy, wherein the modified policy comprises one or more modified actions and one or more modified conditions for executing the one or more modified actions via the head-mounted device; presenting, at the display of the head-mounted device, another user interface that includes a representation of the modified policy; and in response to receiving another user input indicating that the user approves of the modified policy, using the modified policy to determine when to execute the one or more modified actions via the head-mounted device.
Facts
- Company
- Meta (Meta Platforms Technologies, LLC)
- Official title
- Authoring context aware policies with intelligent suggestions
- Patent number
- US12749240B2
- Application number
- 18458576
- Filed
- Aug 30, 2023
- Granted
- Sep 29, 2026
- Inventors
- 6
- Claims
- 13
Classified under
G06F 3/0484 Physics & computingG06F 3/0482 Physics & computingG06N 20/00 Physics & computingG06T 11/60 Physics & computingG06V 20/20 Physics & computingG06T 2200/24 Physics & computingMore from Meta in AR, VR & displays
- Meta patents VR avatars that mimic facial expressions from voice Sep 15, 2026
- Meta patents spatial mouse for pointing at and controlling real-world objects Sep 24, 2026
- Meta patents AR notifications that grow when you look at them Sep 1, 2026
- Meta patents AR glasses with antennas built into the lenses Sep 8, 2026
- Meta patents auto-pause for VR headsets when you take them off Oct 6, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
