Nvidia patents method to boost video resolution using AI diffusion models
Nvidia describes a system that uses two neural network models to create high-resolution videos. The first model aligns images into a standard-resolution video, while the second model upsamples it to a higher resolution.
In the filing’s own words
In various examples, systems and methods are disclosed relating to aligning images into frames of a first video using at least one first temporal attention layer of a neural network model. The first video has a first spatial resolution. A second video having a second spatial resolution is generated by up-sampling the first video using at least one second temporal attention layer of an up-sampler neural network model, wherein the second spatial resolution is higher than the first spatial resolution.
What exactly they claim (claim 1)
1. A system, comprising one or more processors to: align a plurality of images into frames of a first video using a first neural network model; and generate a second video by up-sampling the first video using a second neural network model, wherein the second video has a resolution that is higher than a resolution of the first video, wherein the first neural network is updated according to one or more temporal incoherencies in mapping latent encodings from a latent space to an image space, wherein the first neural network model comprises a first diffusion model and a second diffusion model; the first diffusion model is to generate a third video; and the second diffusion model is to generate the first video by generating at least one frame between two consecutive frames of the third video.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- High-resolution video generation using image diffusion models
- Patent number
- US12764354B2
- Application number
- 19010882
- Filed
- Jan 6, 2025
- Granted
- Oct 13, 2026
- Inventors
- 7
- Claims
- 18
Classified under
H04N 21/234363 Electricity & electronicsG06T 9/00 Physics & computingG06V 10/24 Physics & computingG06V 10/25 Physics & computingG06V 10/82 Physics & computingH04N 7/0117 Electricity & electronicsMore from Nvidia in AI & software
- Nvidia patents AI coach that analyzes your gameplay to suggest strategies Oct 13, 2026
- Nvidia patents AI system that writes and voices character conversations Sep 10, 2026
- Nvidia patents system that uses AI to find bugs in game videos Sep 17, 2026
- Nvidia patents AI method to make digital characters move realistically Sep 8, 2026
- Nvidia patents AI system that builds image generators from text prompts Sep 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.