Google patents AR system that links physical objects to show context
Google describes a method for augmented reality systems to identify specific parts of objects and their relationships to other items in a room. The system uses a model to create a query about these connections and then displays a visual overlay with relevant information.
In the filing’s own words
A method including identifying a first object in a physical environment at a first scale of interaction corresponding to a component of the first object, identifying a second object in the physical environment at a second scale of interaction corresponding to a functional relationship between the second object and at least one of the first object or a third object, generating, using a first model, a prompt based on the first object, the second object, and the third object, retrieving, using a second model, information based on the prompt, and displaying a visual overlay based on the information. In some implementations, the first model and the second model can be a multi-modal model that includes the first model and the second model.
What exactly they claim (claim 1)
1. A method, comprising: identifying a first object in a physical environment at a first scale of interaction corresponding to a component of the first object; identifying a second object in the physical environment at a second scale of interaction corresponding to a functional relationship between the second object and at least one of the first object or a third object; generating, using a model, a prompt based on the first object, the second object, and the third object; retrieving, using the model, information based on the prompt; and displaying a visual overlay based on the information.
Facts
- Company
- Google (GOOGLE LLC)
- Official title
- SELECTING CONTEXT FOR CUSTOMIZED ACTIONS
- Publication number
- US20260319581A1
- Application number
- 19642963
- Filed
- Apr 9, 2026
- Published
- Oct 15, 2026
- Inventors
- 6
- Claims
- 20
Classified under
G06F 3/013 Physics & computingG06F 3/017 Physics & computingG06F 3/167 Physics & computingG06F 40/00 Physics & computingG06T 7/75 Physics & computingG06T 15/06 Physics & computingMore from Google in AR, VR & displays
- Google patents video conference stage with built-in teleprompter Sep 15, 2026
- Google patents VR headset that checks your eyesight Oct 20, 2026
- Google patents glasses that share one lens for cameras and projectors Oct 20, 2026
- Google patents AR glasses with two separate screens in one lens Oct 1, 2026
- Google patents AR glasses that switch light paths to widen the view Oct 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.