Apple patents showing real-world objects in virtual video calls
Apple describes a system that adds objects from a user's physical room into a 3D virtual meeting space. It detects actions like sitting or picking up a cup and displays a matching virtual object to provide context for other participants.
In the filing’s own words
Various implementations provide a representation of at least a portion of a user within a three-dimensional ( 3 D) environment other than the user’s physical environment. Based on detecting a condition, a representation of another object of the user’s physical environment is shown to provide context. As examples, a representation of a sitting surface may be shown based on detecting that the user is sitting down, representations of a table and coffee cup may be shown based on detecting that the user is reaching out to pick up a coffee cup, a representation of a second user may be shown based on detecting a voice or the user turning his attention towards a moving object or sound, and a depiction of a puppy may be shown when the puppy’s bark is detected.
What exactly they claim (claim 1)
1. A method comprising: at one or more processors: generating a view of a three-dimensional (3D) environment, the view depicting a representation of at least a portion of a remote user, wherein the remote user is in a physical environment different than the 3D environment; determining that a condition to provide context regarding the physical environment is satisfied; and based on determining that the condition to provide context is satisfied, receiving information about characteristics of a context feature representing an object to provide the context, wherein the received information is limited to avoid revealing a private attribute of the physical environment of the remote user; and updating the view of the 3D environment to include the context feature representing the object of the physical environment of the remote user.
Facts
- Company
- Apple (Apple Inc.)
- Official title
- SHOWING CONTEXT IN A COMMUNICATION SESSION
- Publication number
- US20260301340A1
- Application number
- 19705281
- Filed
- Jun 11, 2026
- Published
- Oct 1, 2026
- Inventors
- 5
- Claims
- 20
Classified under
G06T 19/006 Physics & computingG06V 10/235 Physics & computingG06V 10/255 Physics & computingMore from Apple in AR, VR & displays
- Apple patents AR glasses that zoom in on what you look at Sep 8, 2026
- Apple patents finger ring that controls VR with taps and waves Sep 15, 2026
- Apple patents head-mounted device that types via eye swipes and hand pinches Oct 6, 2026
- Apple patents eye-tracking and hand gestures to select screen items Oct 20, 2026
- Apple patents AR glasses that adjust lenses to fit your eyes Sep 17, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.