Apple patents AR headsets that guess where you look to save power
Apple describes a method for AR and VR headsets that uses a trained computer program to predict where a user will look next. The system renders the area in front of the eyes at high quality while filling the rest of the view with lower-quality images to reduce the workload on the hardware.
In the filing’s own words
Generating synthesized data includes capturing one or more frames of a scene at a first frame rate by one or more cameras of a wearable device, determining body position parameters for the frames, and obtaining geometry data for the scene in accordance with the one or more frames. The frames, body position parameters, and geometry data are applied to a trained network which predicts one or more additional frames. With respect to virtual data, generating a synthesized frame includes determining current body position parameters in accordance with the one or more frames, predicting a future gaze position based on the current body position parameters, and rendering, at a first resolution, a gaze region of a frame in accordance with the future gaze position. A peripheral region is predicted for the frame at a second resolution, and the combined regions form a frame that is used to drive a display.
What exactly they claim (claim 1)
1. A method comprising: determining current body position parameters in accordance with the one or more frames; predicting a future gaze position based on the current body position parameters; rendering, at a first resolution, a gaze region of a frame in accordance with the future gaze position; and predicting a peripheral region of the frame outside the gaze region, wherein the predicted peripheral region is associated with a second resolution.
Facts
- Company
- Apple (Apple Inc.)
- Official title
- Deep Learning Based Causal Image Reprojection for Temporal Supersampling in AR/VR Systems
- Publication number
- US20260301118A1
- Application number
- 19697202
- Filed
- Jun 3, 2026
- Published
- Oct 1, 2026
- Inventors
- 4
- Claims
- 20
Classified under
G06T 3/4046 Physics & computingG06T 7/60 Physics & computingG06T 7/70 Physics & computingG06T 15/005 Physics & computingG06T 2207/20084 Physics & computingG06T 2207/30196 Physics & computingMore from Apple in AR, VR & displays
- Apple patents AR glasses that zoom in on what you look at Sep 8, 2026
- Apple patents finger ring that controls VR with taps and waves Sep 15, 2026
- Apple patents head-mounted device that types via eye swipes and hand pinches Oct 6, 2026
- Apple patents eye-tracking and hand gestures to select screen items Oct 20, 2026
- Apple patents AR glasses that adjust lenses to fit your eyes Sep 17, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.