Apple patents XR hints that guide users based on their body position
Apple has filed a patent for an extended reality system that uses sensors on a worn device to detect when a user needs help. The system analyzes this data to show digital instructions that guide the user’s movement relative to their body.
In the filing’s own words
Various implementations disclosed herein provide augmentations in extended reality (XR) using sensor data from a user worn device. The sensor data may be used to understand that a user’s state is associated with providing user assistance, e.g., a user’s appearance or behavior or an understanding of the environment may be used to recognize a need or desire for user assistance. The augmentations may assist the user by enhancing or supplementing the user’s abilities, e.g., providing guidance or other information about an environment to disabled/impaired person.
What exactly they claim (claim 1)
1. A method comprising: at an electronic device having a processor; capturing sensor data while the electronic device is worn by a user in a physical environment, wherein a user assistance feature is enabled on the device to assist with physical environment understanding based on a user state; in accordance with the accessibility feature being enabled: determining the user state in the physical environment based on monitoring the sensor data, wherein the user state corresponds to a user requirement for assistance in the physical environment; and presenting content based on the user state, the content at least partially based on the user requirement for assistance in the physical environment, wherein the content provides the assistance by guiding the user, wherein the assistance provides instruction for the user to move relative to a direction of a torso of the user.
Facts
- Company
- Apple (Apple Inc.)
- Official title
- EXTENDED REALITY ASSISTANCE BASED ON USER UNDERSTANDING
- Publication number
- US20260278925A1
- Application number
- 19673520
- Filed
- May 11, 2026
- Published
- Sep 17, 2026
- Inventors
- 5
- Claims
- 20
Classified under
G06T 17/00 Physics & computingG06F 3/011 Physics & computingG06F 3/017 Physics & computingG06T 7/70 Physics & computingG06V 40/174 Physics & computingG06V 40/28 Physics & computingMore from Apple in AR, VR & displays
- Apple patents AR glasses that zoom in on what you look at Sep 8, 2026
- Apple patents finger ring that controls VR with taps and waves Sep 15, 2026
- Apple patents head-mounted device that types via eye swipes and hand pinches Oct 6, 2026
- Apple patents eye-tracking and hand gestures to select screen items Oct 20, 2026
- Apple patents AR glasses that adjust lenses to fit your eyes Sep 17, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.