Sony patents AI method to create extra video frames for smoother motion
Sony describes a technique that uses neural networks to predict and insert new video frames between existing ones. The system learns to generate these synthetic frames by comparing its predictions against actual video data to improve accuracy.
In the filing’s own words
Frame generation super sampling may include generating an image frame embedding from a first image frame in an image stream and predicting a synthetic second image frame in the image stream using the image frame embedding of the first image in the image stream. The synthetic second image is displayed frame after the first image frame in the image stream.
What exactly they claim (claim 1)
1. A method comprising: initializing weights of an encoder neural network; providing, to the encoder neural network, a first image frame from an image stream; predicting, by the encoder neural network, image embeddings for the first image frame; using the image embeddings and by a decoder neural network, predicting a next image in the image stream; determining if a loss calculated based on the predicted next image and a second image frame from the image stream that is the next image after the first image frame satisfies a threshold; and in response to determining that the loss satisfies the threshold, training the encoder neural network.
Facts
- Company
- Sony (Sony Interactive Entertainment Inc.)
- Official title
- GENERATION SUPER SAMPLING
- Publication number
- US20260320740A1
- Application number
- 19717281
- Filed
- Jun 23, 2026
- Published
- Oct 15, 2026
- Inventors
- 1
- Claims
- 20
Classified under
G06T 3/4046 Physics & computingG06F 3/0354 Physics & computingMore from Sony in AI & software
- Sony patents AI that plays video games in your style Oct 6, 2026
- Sony patents AI that swaps game visuals for accessibility formats Sep 17, 2026
- Sony patents AI that changes game characters based on your play Oct 1, 2026
- Sony patents method to turn 2D videos into high-detail 3D animations Oct 15, 2026
- Sony patents AI bots that mimic your friends' gaming styles Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.