Nvidia patents method to auto-label camera images using maps for AI training
Nvidia describes a system that automatically creates training data for neural networks by matching camera images with existing map data. It assigns labels to features in the images based on their location in the map, reducing the need for manual labeling.
In the filing’s own words
Systems and methods related to ground truth data generation using maps and sensor data are disclosed. In some embodiments, a label corresponding to a feature included in a map may be assigned to an image based at least on the feature also being depicted in the image. In these and other embodiments, the labeled image may be used as training data (e.g., ground truth data) for one or more neural networks.
What exactly they claim (claim 1)
1. A method, comprising: performing one or more operations of a first machine using one or more neural networks, wherein at least one parameter of the one or more neural networks is updated using training data that is generated, at least, by: assigning a label to an image captured using a camera of a second machine while the second machine is disposed in an environment at a pose, the label corresponding to a feature of the environment that is depicted in the image, the assigning of the label being based at least on: information corresponding to the feature as obtained from map data corresponding to the environment; a determination, based at least on the map data and the pose, that the feature is observable by the camera at the pose; the image being captured while the second machine is disposed at the pose; an alignment of the image with a map corresponding to the map data; and the label already being applied to the feature in the map data.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- AI-based machine control
- Patent number
- US12791353B2
- Application number
- 18815398
- Filed
- Aug 26, 2024
- Granted
- Nov 10, 2026
- Inventors
- 2
- Claims
- 20
Classified under
G01C 21/3841 Physics & computingG05D 1/0274 Physics & computingG05D 1/246 Physics & computingG06T 7/75 Physics & computingG06T 11/20 Physics & computingG06T 17/00 Physics & computingMore from Nvidia in AI & software
- Nvidia patents AI coach that analyzes your gameplay to suggest strategies Oct 13, 2026
- Nvidia patents AI system that writes and voices character conversations Sep 10, 2026
- Nvidia patents system that uses AI to find bugs in game videos Sep 17, 2026
- Nvidia patents chip that turns text into video using noise reduction Nov 5, 2026
- Nvidia patents system that translates specific speakers in group conversations Nov 12, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
