Apple patents AR interface to control external devices
Apple describes a system where a computer-generated view of the physical environment is shown on a display, with interactive elements (affordances) overlaid on external devices. When a user activates one of these elements, the external device sends media content, which is then presented on the display.
In the filing’s own words
In some exemplary processes for controlling an external device using a computer-generated reality interface, a view of a physical environment that includes the external device is provided through a display, and an affordance corresponding to the external device is displayed on the display. In response to a user input corresponding to activation of the affordance, the external device provides information including a media item and the media item is presented.
What exactly they claim (claim 1)
1. An electronic device, comprising: a display; one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: providing, through the display, a view of a physical environment that includes an external device, wherein at least a portion of the external device is visible through the display; receiving, from the external device, first information specifying a function of the external device; while providing the view of the physical environment, displaying, on the display, an affordance corresponding to the function of the external device specified in the received first information; detecting a user input corresponding to activation of the affordance; in response to detecting the user input corresponding to activation of the affordance, causing the external device to provide second information including a media item; receiving the second information including the media item from the external device; and presenting the media item included in the second information.
Facts
- Company
- Apple (Apple Inc.)
- Official title
- Controlling external devices using reality interfaces
- Patent number
- US12801325B2
- Application number
- 19054559
- Filed
- Feb 14, 2025
- Granted
- Nov 17, 2026
- Inventors
- 2
- Claims
- 20
Classified under
G06F 3/1423 Physics & computingG02B 27/0093 Physics & computingG02B 27/017 Physics & computingG06F 3/013 Physics & computingG06F 3/017 Physics & computingG06F 3/0346 Physics & computingMore from Apple in AR, VR & displays
- Apple patents AR glasses that zoom in on what you look at Sep 8, 2026
- Apple patents finger ring that controls VR with taps and waves Sep 15, 2026
- Apple patents head-mounted device that types via eye swipes and hand pinches Oct 6, 2026
- Apple patents eye-tracking and hand gestures to select screen items Oct 20, 2026
- Apple patents AR glasses that adjust lens spacing to fit your eyes Nov 3, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
