Nvidia patents AI that makes virtual characters move naturally around 3D objects
Nvidia describes a method that combines a pre-trained motion model with a component that reads 3D scene data. This allows the system to generate realistic human movements that account for the specific shapes and objects in the environment.
In the filing’s own words
A motion diffusion model may be pre-trained on motion data, and a scene-aware component (e.g., one or more layers of a neural network) may be connected and used to extract and inject a representation of scene information into the pre-trained motion diffusion model. For example, to predict orientations of joint waypoints along a path through a particular 3D scene, a scene-aware input channel that accepts a representation of the 3D structure of the scene may be added to a pre-trained motion diffusion model. To predict orientations of joint waypoints along a path that interacts with a 3D object in the 3D scene, a scene-aware input channel that accepts a representation of the 3D object and/or a surface thereof may be added to a pre-trained motion diffusion model. As such, the resulting scene-aware motion diffusion model(s) may be tuned on motion-scene data and used to generate human motion.
What exactly they claim (claim 1)
1. A processor comprising: one or more processing units to provide a representation of at least a navigable portion of a three-dimensional (3D) scene to a pre-trained motion diffusion model to generate a representation of scene-aware motion comprising one or more orientations of one or more joint waypoints along one or more paths of a character at least partially depicted in the 3D scene.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- Scene-aware synthetic human motion generation using neural networks
- Patent number
- US12737956B2
- Application number
- 18415496
- Filed
- Jan 17, 2024
- Granted
- Sep 15, 2026
- Inventors
- 4
- Claims
- 20
Classified under
G06T 13/40 Physics & computingG06T 2210/56 Physics & computingMore from Nvidia in AI & software
- Nvidia patents AI coach that analyzes your gameplay to suggest strategies Oct 13, 2026
- Nvidia patents AI system that writes and voices character conversations Sep 10, 2026
- Nvidia patents system that uses AI to find bugs in game videos Sep 17, 2026
- Nvidia patents AI method to make digital characters move realistically Sep 8, 2026
- Nvidia patents AI system that builds image generators from text prompts Sep 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.