AppleGranted patentAR, VR & displaysInterest 8/10

Apple patents camera display that blends with real world

Illustration of the invention
Illustration based on the patent drawing. Not a photo of a real product.
Patent drawing
Patent drawing from the official filing.

Apple describes a method where a device camera captures a scene and warps the image so it looks continuous with the real world outside the screen. The system adjusts the picture based on the user's position and corrects colors to match the surrounding environment.

Why it mattersThis technology could make screens look like transparent windows, allowing digital content to sit seamlessly within your physical surroundings.

In the filing’s own words

Presenting an image of a scene may include capturing an image of a scene by a camera of an electronic device, wherein the electronic device comprises the camera and a display, and wherein the camera and the display have a first spatial relationship, determining a second spatial relationship between a viewpoint and the display of the electronic device, warping the image to obtain an image of a first portion of the scene based on the first spatial relationship and the second spatial relationship, and presenting the warped image on the display, wherein, from the viewpoint, the image of the first portion of the scene is substantially contiguous with a second portion of the scene visible outside an edge of the electronic device.

What exactly they claim (claim 1)

1. A method for presenting an image of a scene, comprising: capturing, by a camera of an electronic device, image data of a scene, wherein the electronic device comprises the camera and a display; generating warped image data of the scene to obtain a warped image, comprising: modifying the image data such that the warped image, when presented on the display, aligns with a first view of the scene outside the electronic device from a first viewpoint of a user of the electronic device, and performing color correction on the image data based on coloring in the scene; and presenting the warped image on the display.

Facts

Company
Apple (Apple Inc.)
Official title
Camera-based transparent display
Patent number
US12793170B2
Application number
18907344
Filed
Oct 4, 2024
Granted
Nov 10, 2026
Inventors
3
Claims
20

Classified under

G06T 3/18 Physics & computingG06T 7/50 Physics & computingG06T 7/70 Physics & computingG06V 20/10 Physics & computingH04N 5/2621 Electricity & electronicsH04N 9/73 Electricity & electronics

More from Apple in AR, VR & displays

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.