Apple patents display method that blends UI with camera feed
This patent describes a way to show user interface elements over a live camera view. It uses specific blending effects to make these elements look like they are part of the real-world background.
In the filing’s own words
An electronic device may include a display and a camera. The camera may capture images of a physical environment around the electronic device. The images of the physical environment may sometimes be displayed on the display as a background layer (e.g., for a pass-through video feed). A user interface may be displayed over the pass-through video feed. Operating the display may include rendering one or more layers of one or more user interface elements, with at least one user interface element being encoded with a lightening or darkening effect. The one or more layers of one or more user interface elements may be composited together and subsequently composited with the pass-through video feed. Compositing the user interface composite with the pass-through video feed may cause the encoded lightening or darkening effect to be applied to the pass-through video feed.
What exactly they claim (claim 1)
1. A method of operating a display, comprising: rendering one or more layers of one or more elements, wherein a first element in the one or more elements is encoded with a lightening or darkening effect; compositing the one or more layers of one or more elements to create a first composite; compositing the first composite with a background layer to create a second composite, wherein compositing the first composite with the background layer comprises applying the lightening or darkening effect of the first element to the background layer to blend the colors of the first composite and the background layer; and displaying the second composite on the display.
Facts
- Company
- Apple (Apple Inc.)
- Official title
- Displays with lightening and darkening effects
- Patent number
- US12802397B2
- Application number
- 18339089
- Filed
- Jun 21, 2023
- Granted
- Nov 17, 2026
- Inventors
- 2
- Claims
- 21
Classified under
G06V 10/60 Physics & computingG06T 7/50 Physics & computingH04N 5/272 Electricity & electronicsMore from Apple in AR, VR & displays
- Apple patents AR glasses that zoom in on what you look at Sep 8, 2026
- Apple patents finger ring that controls VR with taps and waves Sep 15, 2026
- Apple patents head-mounted device that types via eye swipes and hand pinches Oct 6, 2026
- Apple patents eye-tracking and hand gestures to select screen items Oct 20, 2026
- Apple patents AR glasses that adjust lens spacing to fit your eyes Nov 3, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
