Meta patents hand gestures to control AR headsets without controllers
This patent describes a system for controlling an artificial-reality headset using hand movements instead of physical controllers. It allows users to perform different actions based on whether they use one finger or multiple fingers, and adjusts how inputs work when multiple input methods are not available.
In the filing’s own words
A method of performing input gestures to control user interface elements is described. The method includes, at a first point in time while multi-modal gestures are available via at least two input devices associated with the artificial-reality headset, detecting a first input via an input device of the at least two input devices and performing an action at the artificial-reality headset. In response to detecting a second input via another input device of the at least two input devices, performing another action within a user interface presented via the artificial-reality headset. The method further includes, at a second point in time, after the first point in time, and while multi-modal gestures are no longer available via the at least two input devices associated with the artificial-reality headset, detecting the first input via the input device of the at least two input devices.
What exactly they claim (claim 1)
1. A non-transitory computer-readable storage medium comprising instructions which, when executed by one or more processors, causes the one or more processors to: while an artificial-reality headset is worn by a user: at a first point in time and while multi-modal gestures are available via at least two input devices associated with the artificial-reality headset: in response to detecting a first input via a first input device of the at least two input devices, perform a first action at the artificial-reality headset, wherein the first input is one input of a first input tier set including (i) a first input tier including one or more inputs associated with navigation control commands, and the first input tier is associated with inputs performed with a single digit of a hand of the user, or (ii) a second input tier including one or more other inputs associated with system control commands for the artificial-reality headset, and the second input tier is associated with inputs performed with at least two digits of the hand of the user; in response to detecting a second input via a second input device of the at least two input devices, perform a second action within a user interface presented via the artificial-reality headset; and at a second point in time, after the first point in time, and while multi-modal gestures are no longer available via the at least two input devices associated with the artificial-reality headset: in response to detecting the first input via the first input device of the at least two input devices, perform the second action within the user interface presented via the artificial-reality headset.
Facts
- Company
- Meta (Meta Platforms Technologies, LLC)
- Official title
- Multi-modal inputs for wearable devices, and systems and methods of use thereof
- Patent number
- US12737052B2
- Application number
- 18909860
- Filed
- Oct 8, 2024
- Granted
- Sep 15, 2026
- Inventors
- 2
- Claims
- 20
Classified under
G06F 3/017 Physics & computingG06F 3/167 Physics & computingMore from Meta in AR, VR & displays
- Meta patents VR avatars that mimic facial expressions from voice Sep 15, 2026
- Meta patents spatial mouse for pointing at and controlling real-world objects Sep 24, 2026
- Meta patents AR notifications that grow when you look at them Sep 1, 2026
- Meta patents AR glasses with antennas built into the lenses Sep 8, 2026
- Meta patents auto-pause for VR headsets when you take them off Oct 6, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.