Nvidia patents method to skip redundant video frames for AI analysis
Nvidia describes a system that decides which video frames to analyze by measuring how much movement occurs between them. It compares each new frame to the previous one and to a broader context, using these scores to determine if the frame is worth processing with neural networks.
In the filing’s own words
Various examples, systems, and methods are disclosed relating to contextual filtering for vision language model (VLM) processing. A system can detect a motion between a first frame of image data and a second frame of image data. A system can determine a first similarity score between the first frame and the second frame and a second similarity score between the second frame and a context for processing of the second frame. A system can generate a combined score. A system can process the second frame using one or more neural networks responsive to determining that one or more frame selection criteria are satisfied based at least on the combined score.
What exactly they claim (claim 1)
1. One or more processors comprising one or more circuits to: detect a motion between a first frame of image data and a second frame of image data; determine a first similarity score between the first frame and the second frame and a second similarity score between the second frame and a context for processing of the second frame; and process the second frame using one or more neural networks responsive to determining that one or more frame selection criteria are satisfied based at least on the motion, the first similarity score, and the second similarity score.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- SYSTEMS AND METHODS OF CONTEXTUAL FILTERING FOR VLM PROCESSING
- Publication number
- US20260301396A1
- Application number
- 19097028
- Filed
- Apr 1, 2025
- Published
- Oct 1, 2026
- Inventors
- 5
- Claims
- 20
Classified under
G06V 10/82 Physics & computingG06V 10/761 Physics & computingG06V 10/768 Physics & computingG06V 20/70 Physics & computingG06V 10/95 Physics & computingG06V 20/20 Physics & computingMore from Nvidia in AI & software
- Nvidia patents AI coach that analyzes your gameplay to suggest strategies Oct 13, 2026
- Nvidia patents AI system that writes and voices character conversations Sep 10, 2026
- Nvidia patents system that uses AI to find bugs in game videos Sep 17, 2026
- Nvidia patents AI method to make digital characters move realistically Sep 8, 2026
- Nvidia patents AI system that builds image generators from text prompts Sep 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.