Nvidia patents method to build 3D models of unknown objects from images
Nvidia describes a technique for creating a 3D shape of an object by analyzing multiple images of it. The system tracks the object's position and orientation across these images to build a digital representation. This data can then be used to plan a robot's path or display mixed reality content.
In the filing’s own words
Apparatuses, systems, and techniques for constructing a data structure to store a shape of an object based at least in part on a portion of multiple images, and obtaining poses of the object by tracking a pose of the object through the multiple images based at least in part on the data structure. Optionally, the poses may be used to generate a plan for a path of a device to travel, generate a rendering of at least a portion of a Mixed Reality (“MR”) display to be viewed by a user, and/or the like.
What exactly they claim (claim 1)
1. A computer-implemented method, comprising: constructing a data structure to store a shape of an object based at least in part on input data from each image of a plurality of images that depict at least a portion of the object; tracking, based at least in part on information stored in the data structure, a pose of the object through the plurality of images to obtain a plurality of poses of the object; and generating, using the plurality of poses, at least one of a plan for a path of a device to travel or a rendering of at least a portion of a Mixed Reality (“MR”) display to be viewed by a user.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- Tracking and 3D reconstruction of unknown objects
- Patent number
- US12762718B2
- Application number
- 18509627
- Filed
- Nov 15, 2023
- Granted
- Oct 13, 2026
- Inventors
- 5
- Claims
- 26
Classified under
G06T 7/248 Physics & computingG06T 7/11 Physics & computingG06T 7/70 Physics & computingG06T 17/00 Physics & computingG06T 19/006 Physics & computingG06T 2207/10016 Physics & computingMore from Nvidia in AI & software
- Nvidia patents AI coach that analyzes your gameplay to suggest strategies Oct 13, 2026
- Nvidia patents AI system that writes and voices character conversations Sep 10, 2026
- Nvidia patents system that uses AI to find bugs in game videos Sep 17, 2026
- Nvidia patents AI method to make digital characters move realistically Sep 8, 2026
- Nvidia patents AI system that builds image generators from text prompts Sep 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.