Google patents camera-based navigation that uses sound to keep you oriented
This filing describes a system that uses a camera to identify known landmarks in the environment to determine exactly where a device is pointing. By comparing the camera's view to these landmarks, the system calculates a precise orientation and provides navigation instructions. If the user turns away from the intended path, the system delivers audio cues to help them realign without needing to look at a screen.
In the filing’s own words
A system and method for perspective-aligned environmental guidance and orientation calibration include receiving image data from an imaging device and feature profiles for a set of candidate features. A feature analysis module identifies a feature from the set within the image data based on a correspondence between the image data and a feature profile. An orientation computation module calculates an orientation of the imaging device by comparing a field of view of the image data to a location of the feature, resulting in a six-degree-of-freedom calibration. An instruction synthesis module provides a navigation action via an output device based on the orientation and a navigation path. The instruction synthesis module provides the navigation action via a spatial audio signal in response to a determination that the orientation has deviated from a target heading, resulting in a reduction of cognitive load and a persistent orientation calibration.
What exactly they claim (claim 1)
1. A method comprising: receiving image data from an imaging device and a plurality of feature profiles for a set of candidate features determined based on a position of the imaging device; identifying a feature from the set of candidate features included in the image data based on a correspondence between the image data and a respective feature profile of the plurality of feature profiles; determining an orientation of the imaging device by comparing a field of view of the image data to a location of the feature; and providing, via an output device, an action determined based on the orientation and a navigation path.
Facts
- Company
- Google (GOOGLE LLC)
- Official title
- PERSPECTIVE-ALIGNED ENVIRONMENTAL GUIDANCE AND ORIENTATION CALIBRATION
- Publication number
- US20260318700A1
- Application number
- 19639889
- Filed
- Apr 6, 2026
- Published
- Oct 15, 2026
- Inventors
- 7
- Claims
- 20
Classified under
G01C 21/3629 Physics & computingG06T 7/73 Physics & computingG06V 10/44 Physics & computingG06V 20/50 Physics & computingG06T 2207/30244 Physics & computingMore from Google in AR, VR & displays
- Google patents video conference stage with built-in teleprompter Sep 15, 2026
- Google patents VR headset that checks your eyesight Oct 20, 2026
- Google patents glasses that share one lens for cameras and projectors Oct 20, 2026
- Google patents AR glasses with two separate screens in one lens Oct 1, 2026
- Google patents AR glasses that switch light paths to widen the view Oct 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.