Meta patents spatial mouse for pointing at and controlling real-world objects
Meta describes a system that uses a handheld device with sensors to point at physical objects in a room. The system identifies the object, highlights the specific part you are pointing at, and executes a command based on that selection.
In the filing’s own words
A system of the subject technology includes an apparatus including a number of sensors to detect one or more objects pointed to by a spatial mouse. The system further includes a processor to process data from the plurality of sensors, recognize the objects based on the processed data and execute a command based on the recognized objects.
What exactly they claim (claim 1)
1. An apparatus, comprising: a plurality of sensors configured to detect at least one object identified based on an indication by a spatial mouse, the at least one object being external to the spatial mouse; and a processor configured to: process data from the plurality of sensors; recognize at least one object based on the data that is processed; and render, responsive to the recognition of the at least one object, a visual indicator extending from the spatial mouse to an intersection point on the at least one object; highlight a part of the at least one object associated with the intersection point, the highlighting comprising: segmenting the part of the at least one object relative to a rest of the at least one object, and modifying at least one cue specific to the part as compared to the rest of the at least one object; and execute a command based on the at least one object that is recognized.
Facts
- Company
- Meta (Meta Platforms Technologies, LLC)
- Official title
- SPATIAL MOUSE FOR SMART HOME AND OBJECT INTERACTIONS
- Publication number
- US20260288246A1
- Application number
- 19087282
- Filed
- Mar 21, 2025
- Published
- Sep 24, 2026
- Inventors
- 4
- Claims
- 20
Classified under
G06F 3/017 Physics & computingG06V 20/20 Physics & computingMore from Meta in AR, VR & displays
- Meta patents VR avatars that mimic facial expressions from voice Sep 15, 2026
- Meta patents AR notifications that grow when you look at them Sep 1, 2026
- Meta patents AR glasses with antennas built into the lenses Sep 8, 2026
- Meta patents auto-pause for VR headsets when you take them off Oct 6, 2026
- Meta patents AR glasses that merge multiple cameras for sharper views Sep 17, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.