Google patents hand tracking to link virtual objects to real items
This patent describes a method where a device detects the orientation of a user's hand to identify when they are touching a physical object. It then determines a specific feature of that object and creates a matching virtual item linked to it. The system uses hand position data to bridge the gap between physical actions and digital overlays.
In the filing’s own words
A method includes receiving an indicator of an orientation of a hand of a user. The method further includes identifying, based on the indicator, that the user is interacting with a real-world object. The method further includes determining, based on the indicator, a characteristic of the real-world object. The method further includes generating a virtual object related to the real-world object and the characteristic. The method further includes associating the virtual object with the real-world object.
What exactly they claim (claim 1)
1. A method comprising: receiving an indicator of an orientation of a portion of a user; identifying, based on the indicator, that the user is interacting with a real-world object; determining, based on the indicator, a characteristic of the real-world object; generating a virtual object related to the real-world object and the characteristic; and associating the virtual object with the real-world object.
Facts
- Company
- Google (GOOGLE LLC)
- Official title
- OBJECT IDENTIFICATION USING HAND DATA
- Publication number
- US20260358881A1
- Application number
- 19200192
- Filed
- May 6, 2025
- Published
- Nov 12, 2026
- Inventors
- 2
- Claims
- 20
Classified under
G06F 3/011 Physics & computingG06T 11/00 Physics & computingG06V 10/70 Physics & computingG06V 20/20 Physics & computingG06T 2200/24 Physics & computingG06V 40/11 Physics & computingMore from Google in AR, VR & displays
- Google patents head-wearable device that stores personal memories Nov 5, 2026
- Google patents video conference stage with built-in teleprompter Sep 15, 2026
- Google patents VR headset that checks your eyesight Oct 20, 2026
- Google patents glasses that share one lens for cameras and projectors Oct 20, 2026
- Google patents radar to track tiny hand movements for VR games Nov 10, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
