AppleGranted patentAR, VR & displaysInterest 6/10

Apple patents display method that blends UI with camera feed

Patent drawing
Patent drawing from the official filing.

This patent describes a way to show user interface elements over a live camera view. It uses specific blending effects to make these elements look like they are part of the real-world background.

Why it mattersIt could improve how apps like maps or messaging look when overlaid on a camera view, making the digital content feel more integrated with the physical world.

In the filing’s own words

An electronic device may include a display and a camera. The camera may capture images of a physical environment around the electronic device. The images of the physical environment may sometimes be displayed on the display as a background layer (e.g., for a pass-through video feed). A user interface may be displayed over the pass-through video feed. Operating the display may include rendering one or more layers of one or more user interface elements, with at least one user interface element being encoded with a lightening or darkening effect. The one or more layers of one or more user interface elements may be composited together and subsequently composited with the pass-through video feed. Compositing the user interface composite with the pass-through video feed may cause the encoded lightening or darkening effect to be applied to the pass-through video feed.

What exactly they claim (claim 1)

1. A method of operating a display, comprising: rendering one or more layers of one or more elements, wherein a first element in the one or more elements is encoded with a lightening or darkening effect; compositing the one or more layers of one or more elements to create a first composite; compositing the first composite with a background layer to create a second composite, wherein compositing the first composite with the background layer comprises applying the lightening or darkening effect of the first element to the background layer to blend the colors of the first composite and the background layer; and displaying the second composite on the display.

Facts

Company
Apple (Apple Inc.)
Official title
Displays with lightening and darkening effects
Patent number
US12802397B2
Application number
18339089
Filed
Jun 21, 2023
Granted
Nov 17, 2026
Inventors
2
Claims
21

Classified under

G06V 10/60 Physics & computingG06T 7/50 Physics & computingH04N 5/272 Electricity & electronics

More from Apple in AR, VR & displays

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.