Nvidia patents AI coach that analyzes your gameplay to suggest strategies
Nvidia describes a system that uses neural networks to compare a player's video and controls against a reference gameplay clip. It converts these visual and input data into text descriptions, which a language model then uses to generate specific gaming strategy advice.
In the filing’s own words
Apparatuses, systems, and techniques to generate gaming strategies using neural networks. In at least one embodiment, one or more neural networks are used to generate one or more gaming strategy outputs based, at least in part, on one or more text inputs describing one or more multimedia gaming contents.
What exactly they claim (claim 1)
1. A processor comprising: one or more circuits to: generate, by a first neural network encoder, from a reference gameplay video, a reference gameplay frame embedding, and from a user gameplay video, a user gameplay frame embedding; generate, by a second neural network encoder, from a first set of control commands associated with the reference gameplay video, a reference control embedding, and from a second set of control commands associated with the user gameplay video, a user control embedding; transform, by a text generation neural network, a combination of at least the user gameplay frame embedding, the user control embedding, the reference gameplay frame embedding, and the reference control embedding into one or more text inputs describing one or more multimedia gaming contents; and generate, by a neural network language model, one or more gaming strategy outputs based, at least in part, on the one or more text inputs describing the one or more multimedia gaming contents.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- Neural network based gaming assistant
- Patent number
- US12762350B1
- Application number
- 18422849
- Filed
- Jan 25, 2024
- Granted
- Oct 13, 2026
- Inventors
- 3
- Claims
- 20
Classified under
G06F 40/40 Physics & computingA63F 13/40 Human necessitiesG06V 10/82 Physics & computingMore from Nvidia in AI & software
- Nvidia patents AI system that writes and voices character conversations Sep 10, 2026
- Nvidia patents system that uses AI to find bugs in game videos Sep 17, 2026
- Nvidia patents AI method to make digital characters move realistically Sep 8, 2026
- Nvidia patents AI system that builds image generators from text prompts Sep 15, 2026
- Nvidia patents AI that makes virtual characters move naturally around 3D objects Sep 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.