Nvidia patents system that uses AI to find bugs in game videos
Nvidia describes a testing platform that watches recorded gameplay to find errors. It picks out important video frames and uses visual language models to spot visual glitches or issues, while also analyzing audio for problems. A large language model then combines these findings into a detailed bug report for developers.
In the filing’s own words
In various examples, a game development testing platform is presented that leverages visual language models (VLMs) to identify and analyze bugs within video gameplay. The platform processes captured gameplay video to produce keyframes, representing unique and significant frames. Keyframes may be selected based on computing embedding vectors and dissimilarity scores for individual video frames. The platform may perform keyframe chunking to produce keyframe packets for VLM evaluation. The VLM, provided with keyframe packets and context description prompts, detects bugs within the gameplay video. Additionally, audio inputs may be incorporated for comprehensive analysis. The VLM outputs a structured data object listing detected bugs, which may be consolidated into a comprehensive bug report by a Large Language Model (LLM). This report, augmented with annotated gameplay videos, facilitates efficient bug tracking and resolution and may be integrated with a game developer's bug tracking systems to streamline the debugging process.
What exactly they claim (claim 1)
1. One or more processors comprising processing circuitry to: generate a plurality of keyframes based at least on an input representing a stream of video data frames; obtain a prompt descriptive of visual content of the video data frames and one or more target anomalies; apply the prompt and at least one segment of the plurality of keyframes to a first language model, wherein the first language model evaluates the at least one segment of the plurality of keyframes to detect instances of the one or more target anomalies based at least on the prompt and the at least one segment of the plurality of keyframes, and generates one or more structured data objects comprising data indicative of the detected instances of the one or more target anomalies; and generate a comprehensive bug report based on consolidating the one or more structured data objects using one or more second language models.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- MULTIMODAL BUG DETECTION IN GAME DEVELOPMENT
- Publication number
- US20260279046A1
- Application number
- 19098487
- Filed
- Apr 2, 2025
- Published
- Sep 17, 2026
- Inventors
- 4
- Claims
- 20
Classified under
G06V 20/41 Physics & computingG06F 11/3696 Physics & computingG06V 20/49 Physics & computingG06V 20/70 Physics & computingMore from Nvidia in AI & software
- Nvidia patents AI coach that analyzes your gameplay to suggest strategies Oct 13, 2026
- Nvidia patents AI system that writes and voices character conversations Sep 10, 2026
- Nvidia patents AI method to make digital characters move realistically Sep 8, 2026
- Nvidia patents AI system that builds image generators from text prompts Sep 15, 2026
- Nvidia patents AI that makes virtual characters move naturally around 3D objects Sep 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.