Apple patents faster way to mix real and virtual video
Apple describes a method for blending live camera footage with digital objects by processing the video in overlapping sections. This allows the device to show the first part of the mixed image before the second part is fully ready, keeping the motion smooth.
In the filing’s own words
In one implementation, a method of pipelined blending an image with virtual content is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes capturing, with the image sensor, a first portion of an image of a physical environment. The method includes warping the first portion of the image of the physical environment to generate a warped first portion. The method includes blending the warped first portion with a first portion of virtual content to generate a blended first portion. The method includes displaying, on the display, the blended first portion. The method includes capturing, with the image sensor, a second portion of the image of the physical environment. The method includes warping the second portion of the image of the physical environment to generate a warped second portion. The method includes blending the warped second portion with a second portion of the virtual content to generate a blended second portion. The method includes displaying, on the display, the blended second portion, wherein displaying the blended first portion is initiated before blending the warped second portion is completed.
What exactly they claim (claim 1)
1. A method comprising: at a device including an image sensor, a display, one or more processors, and non-transitory memory: capturing, with the image sensor at a first frame rate, a plurality of images of a physical environment; transmitting a subset of the plurality of images of the physical environment; receiving control parameters based on the subset of the plurality of images of the physical environment; processing the plurality of images of the physical environment based on the control parameters; and displaying, on the display at the first frame rate, the plurality of processed images of the physical environment.
Facts
- Company
- Apple (Apple Inc.)
- Official title
- PASSTHROUGH PIPELINE
- Publication number
- US20260289904A1
- Application number
- 19695220
- Filed
- Jun 2, 2026
- Published
- Sep 24, 2026
- Inventors
- 4
- Claims
- 20
Classified under
G06T 15/503 Physics & computingG06T 3/18 Physics & computingMore from Apple in AR, VR & displays
- Apple patents AR glasses that zoom in on what you look at Sep 8, 2026
- Apple patents finger ring that controls VR with taps and waves Sep 15, 2026
- Apple patents head-mounted device that types via eye swipes and hand pinches Oct 6, 2026
- Apple patents eye-tracking and hand gestures to select screen items Oct 20, 2026
- Apple patents AR glasses that adjust lenses to fit your eyes Sep 17, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.