Samsung patents VR hand tracking that guesses where your hand is going
This patent describes a method for head-mounted displays to track a user's hand more smoothly. When the hand moves too fast for the camera to catch up, the system predicts its path by looking at where the user's eyes are focused in previous moments.
In the filing’s own words
A method for a hand tracking of a hand of a user in a Head Mounted Display (HMD) device, includes: detecting, during at least one current frame associated with a field-of-view (FOV) of the HMD device, a disproportionate hand movement while the hand tracking of the hand is performed; predicting, when the disproportionate hand movement is detected, a trajectory of a movement of the hand, based on a correlation between an eye gaze location of the user and a hand location of the user in one or more previous frames associated with the FOV of the HMD device; and performing, when the disproportionate hand movement is detected, the hand tracking, based on the predicted trajectory of the movement of the hand.
What exactly they claim (claim 1)
1. A method for a hand tracking of a hand of a user in a Head Mounted Display (HMD) device, the method comprising: detecting, during at least one current frame associated with a field-of-view (FOV) of the HMD device, a disproportionate hand movement while the hand tracking of the hand is performed; predicting, when the disproportionate hand movement is detected, a trajectory of a movement of the hand, based on a correlation between an eye gaze location of the user and a hand location of the user in one or more previous frames associated with the FOV of the HMD device; and performing, when the disproportionate hand movement is detected, the hand tracking, based on the predicted trajectory of the movement of the hand.
Facts
- Company
- Samsung (SAMSUNG ELECTRONICS CO., LTD.)
- Official title
- METHODS AND SYSTEMS FOR HAND TRACKING IN HEAD MOUNTED DISPLAY DEVICE
- Publication number
- US20260277323A1
- Application number
- 19683106
- Filed
- May 20, 2026
- Published
- Sep 17, 2026
- Inventors
- 8
- Claims
- 20
Classified under
G06F 3/013 Physics & computingG06F 3/017 Physics & computingG06T 7/248 Physics & computingG06T 2207/20084 Physics & computingG06T 2207/30196 Physics & computingMore from Samsung in AR, VR & displays
- Samsung patents screen that predicts where your eyes will look next Sep 29, 2026
- Samsung patents AR headset that adjusts images using eye tracking Sep 17, 2026
- Samsung patents camera feature that identifies objects and shows AR info Sep 17, 2026
- Samsung patents method to animate avatars from photos and voice Sep 24, 2026
- Samsung patents AR glasses that blend real objects into virtual scenes Oct 1, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.