Apple patents AR system that fades virtual objects based on where you look
Apple has been granted a patent for a method that tracks a user's head or body movement within a mixed reality environment. The system checks if a virtual object is blocking a real-world item and determines if the user is looking at the virtual item or the real one behind it. If the user is looking at the real object, the system makes the virtual object transparent or moves it to reveal the real item.
In the filing’s own words
In an exemplary process, a computer-generated reality environment comprising a virtual object is presented and user movement that occurs in a physical environment is detected. In response to determining that the detected user movement is toward the virtual object and that the virtual object obstructs a real object from the physical environment, a determination is made whether the detected user movement is directed to the virtual object or the real object. In accordance with a determination that the detected user movement is directed to the real object, a visual appearance of the virtual object is modified, where modifying the visual appearance of the virtual object comprises displaying presenting at least a portion of the real object. In accordance with a determination that the detected user movement is directed to the virtual object, the presentation of the virtual object is maintained to obstruct the real object.
What exactly they claim (claim 1)
1. An electronic device, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: presenting, via a display device, a virtual object in a respective region of a physical environment; detecting, via one or more sensors, user movement that occurs in a physical environment, wherein the user movement includes movement towards the respective region of the physical environment; determining that at least a portion of the virtual object in the respective region of the physical environment is presented in front of a real object in the physical environment from a perspective of a user viewing the display device; and in response to detecting the user movement and determining that at least the portion of the virtual object is presented in front of the real object in the physical environment from the perspective of the user viewing the display device: determining whether the detected user movement is directed to the real object or the portion of the virtual object presented in front of the real object from the perspective of the user viewing the display device; in accordance with a determination that the detected user movement is directed to the real object, modifying a visual appearance of the virtual object in the respective region of the physical environment, wherein modifying the visual appearance of the virtual object in the respective region of the physical environment comprises presenting at least a portion of the real object; and in accordance with a determination that the detected user movement is directed to the portion of the virtual object presented in front of the real object from the perspective of the user viewing the display device, maintaining the presentation of at least the portion of the virtual object in front of the real object from the perspective of the user viewing the display device.
Facts
- Company
- Apple (Apple Inc.)
- Official title
- Presenting an environment based on user movement
- Patent number
- US12743857B2
- Application number
- 18385851
- Filed
- Oct 31, 2023
- Granted
- Sep 22, 2026
- Inventors
- 2
- Claims
- 22
Classified under
G06T 19/006 Physics & computingG06F 3/011 Physics & computingG06F 3/017 Physics & computingMore from Apple in AR, VR & displays
- Apple patents AR glasses that zoom in on what you look at Sep 8, 2026
- Apple patents finger ring that controls VR with taps and waves Sep 15, 2026
- Apple patents head-mounted device that types via eye swipes and hand pinches Oct 6, 2026
- Apple patents eye-tracking and hand gestures to select screen items Oct 20, 2026
- Apple patents AR glasses that adjust lenses to fit your eyes Sep 17, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.