Apple patents 3D scene saving that suggests actions based on where you look
Apple describes a system where a device captures a 3D view of a scene when you ask to save an object. It then uses image recognition and your eye tracking data to suggest actions in other apps, such as opening a related service or tool.
In the filing’s own words
Disclosed are techniques for determining and presenting suggested actions based on content such as live views of three-dimensional scenes and saved views of three-dimensional scenes.
What exactly they claim (claim 1)
1. One or more computer systems configured to communicate with one or more image sensors and a display generation component, the one or more computer systems comprising: one or more processors; and one or more memories storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: receiving, by a first computer system of the one or more computer systems, a user input corresponding to a request to save an object in a three-dimensional (3D) scene; in response to receiving the user input corresponding to the request to save the object in the 3D scene, capturing, by the first computer system and via the one or more image sensors, a view of the 3D scene; detecting, by the first computer system, attention of a user of the first computer system, wherein the attention of the user of the first computer system is detected when the user input corresponding to the request to save the object in the 3D scene is received; and after the view of the 3D scene is captured via the one or more image sensors, displaying, by a second computer system of the one or more computer systems and via the display generation component, a first user interface of a first application, wherein: displaying the first user interface of the first application includes displaying a first suggestion graphical element; the first suggestion graphical element is selectable to cause the second computer system to perform, via a second application different from the first application, a first suggested action; and the first suggested action is determined based on performing image recognition on the view of the 3D scene and based on context information that is different from the view of the 3D scene, wherein the context information includes the attention of the user of the first computer system.
Facts
- Company
- Apple (Apple Inc.)
- Official title
- PROVIDING SUGGESTIONS BASED ON SAVED CONTENT
- Publication number
- US20260267487A1
- Application number
- 19535934
- Filed
- Feb 10, 2026
- Published
- Sep 10, 2026
- Inventors
- 10
- Claims
- 30
Classified under
G06F 3/04842 Physics & computingG06F 3/017 Physics & computingG06F 3/0481 Physics & computingG06F 3/04883 Physics & computingG06F 9/451 Physics & computingMore from Apple in AR, VR & displays
- Apple patents AR glasses that zoom in on what you look at Sep 8, 2026
- Apple patents finger ring that controls VR with taps and waves Sep 15, 2026
- Apple patents head-mounted device that types via eye swipes and hand pinches Oct 6, 2026
- Apple patents eye-tracking and hand gestures to select screen items Oct 20, 2026
- Apple patents AR glasses that adjust lenses to fit your eyes Sep 17, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.