MetaGranted patentAR, VR & displaysInterest 6/10

Meta patents hand gestures to assemble virtual objects in extended reality

This patent describes a system for using hand gestures to interact with 3D models in an extended reality headset. Users can switch modes to move individual parts of an object and then snap them together into a complete structure by moving them near a virtual boundary.

Why it mattersIt offers a more intuitive way to design or visualize complex products by allowing users to physically assemble virtual components rather than just viewing them.

In the filing’s own words

A method of interacting with extended reality (XR) objects within a computer aided design is described. The method includes, while presenting an XR representation of an object and in response to a first gesture, initiate a first XR mode that allows the user to manipulate a plurality of component parts of the object within the XR representation. The method includes, in response to a second gesture directed to a component part of the plurality of component parts of the XR representation, cause a manipulation to the component part. The method includes, in response to a third hand gesture, initiate a second XR mode, the second XR mode causing presentation of an XR augment that defines a boundary. The method further includes, in response to movement of at least one component part to within a threshold distance of the boundary, coupling together the plurality of component parts to form the object.

What exactly they claim (claim 1)

1. A non-transitory computer readable storage medium including instructions that, when executed by an extended-reality headset, cause the extended-reality headset to: while presenting, using a lens system of the extended-reality headset, an extended reality (XR) representation of an object within a portion of a field of view of a user wearing the extended-reality headset: in response to a first hand gesture performed by the user directed to the XR representation, initiate a first XR mode that allows the user to manipulate a plurality of component parts of the object within the XR representation; while the first XR mode is active and in response to a second hand gesture performed by the user directed to a component part of the plurality of component parts of the XR representation, cause a manipulation to the component part based on the second hand gesture; in response to a third hand gesture performed by the user, initiate a second XR mode, the second XR mode causing presentation of an XR augment that defines a boundary for receiving one or more of the plurality of component parts; and while the second XR mode is active and in response to movement of at least one component part of the plurality of component parts to within a threshold distance of the boundary, couple together the plurality of component parts to form the object in a structurally correct sequence.

Facts

Company
Meta (Meta Platforms Technologies, LLC)
Official title
Techniques for interacting with component parts of an object represented by an extended-reality representation of the object using hand gestures in an extended-reality environment, and systems and methods of use thereof
Patent number
US12793368B2
Application number
19017171
Filed
Jan 10, 2025
Granted
Nov 10, 2026
Inventors
2
Claims
20

Classified under

G06T 19/20 Physics & computingG06F 3/017 Physics & computingG06T 2200/24 Physics & computingG06T 2210/04 Physics & computingG06T 2219/004 Physics & computingG06T 2219/016 Physics & computing

More from Meta in AR, VR & displays

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.