Google patents earbuds that track what you look at in stores
Google describes a system where earbuds use built-in sensors to figure out which way your head is pointing. By combining this with your location in a store, the system calculates exactly which products you are looking at without you doing anything.
In the filing’s own words
Systems ( 312) and methods ( 400) are provided for passively collecting context data associated with in-store shopping by a user. In this regard, one or more processors ( 202, 204) may receive, from each earbud in a pair of earbuds ( 238) worn by a user, sensor data corresponding to an orientation of each respective earbud ( 240, 242). Based on the received sensor data, the one or more processors ( 202, 204) may determine the gaze directions of the user as the user travels within a store and one or more products viewed by the user while traveling within the store by comparing, using a content map ( 128) of the store, the gaze directions of the user to product locations storing products, wherein the one or more products are the context data.
What exactly they claim (claim 1)
1. A method for passively collecting context data, the method comprising: receiving, by one or more processors, location data of a user as the user travels within a facility; receiving, by the one or more processors, from one or more inertial measurement units (IMU) in each earbud of a pair of earbuds worn by the user, sensor data corresponding to an orientation of each respective earbud; determining, by the one or more processors, based on the received sensor data, gaze directions of the user as the user travels within the facility; determining, by the one or more processors, one or more products viewed by the user while traveling within the facility by comparing, using a content map of the facility, the gaze directions of the user to product locations storing products, wherein comparing the gaze directions of the user to the product locations comprises, for one or more of the gaze directions: determining, from the location data, a location of the user when the gaze direction was determined; and determining whether a ray from the location of the user in the gaze direction intersects products of the product locations, wherein the one or more products are the products the rays intersects, and wherein the ray has a width representing the user's viewing area when looking in the determined gaze direction; and generating, by the one or more processors, the context data, wherein the context data comprises the one or more products.
Facts
- Company
- Google (Google LLC)
- Official title
- Visual attention-based surfacing using inferred head pose with product locations
- Patent number
- US12793122B2
- Application number
- 18565363
- Filed
- Dec 29, 2022
- Granted
- Nov 10, 2026
- Inventors
- 1
- Claims
- 16
Classified under
G06Q 30/0639 Physics & computingG06Q 30/0255 Physics & computingH04W 4/026 Electricity & electronicsH04W 4/38 Electricity & electronicsMore from Google in Wearables
- Google patents earbuds that verify identity using ultrasound in the ear canal Oct 6, 2026
- Google patents wristband that reads hand gestures from blood flow Oct 13, 2026
- Google patents earbuds that detect jaw movement to switch modes Sep 8, 2026
- Google patents headset that tracks eye recovery after surgery Nov 17, 2026
- Google patents smartwatch guide for pointing your arm at satellites Sep 10, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.