Apple patents camera display that blends with real world


Apple describes a method where a device camera captures a scene and warps the image so it looks continuous with the real world outside the screen. The system adjusts the picture based on the user's position and corrects colors to match the surrounding environment.
In the filing’s own words
Presenting an image of a scene may include capturing an image of a scene by a camera of an electronic device, wherein the electronic device comprises the camera and a display, and wherein the camera and the display have a first spatial relationship, determining a second spatial relationship between a viewpoint and the display of the electronic device, warping the image to obtain an image of a first portion of the scene based on the first spatial relationship and the second spatial relationship, and presenting the warped image on the display, wherein, from the viewpoint, the image of the first portion of the scene is substantially contiguous with a second portion of the scene visible outside an edge of the electronic device.
What exactly they claim (claim 1)
1. A method for presenting an image of a scene, comprising: capturing, by a camera of an electronic device, image data of a scene, wherein the electronic device comprises the camera and a display; generating warped image data of the scene to obtain a warped image, comprising: modifying the image data such that the warped image, when presented on the display, aligns with a first view of the scene outside the electronic device from a first viewpoint of a user of the electronic device, and performing color correction on the image data based on coloring in the scene; and presenting the warped image on the display.
Facts
- Company
- Apple (Apple Inc.)
- Official title
- Camera-based transparent display
- Patent number
- US12793170B2
- Application number
- 18907344
- Filed
- Oct 4, 2024
- Granted
- Nov 10, 2026
- Inventors
- 3
- Claims
- 20
Classified under
G06T 3/18 Physics & computingG06T 7/50 Physics & computingG06T 7/70 Physics & computingG06V 20/10 Physics & computingH04N 5/2621 Electricity & electronicsH04N 9/73 Electricity & electronicsMore from Apple in AR, VR & displays
- Apple patents AR glasses that zoom in on what you look at Sep 8, 2026
- Apple patents finger ring that controls VR with taps and waves Sep 15, 2026
- Apple patents head-mounted device that types via eye swipes and hand pinches Oct 6, 2026
- Apple patents eye-tracking and hand gestures to select screen items Oct 20, 2026
- Apple patents AR glasses that adjust lens spacing to fit your eyes Nov 3, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.