SonyGranted patentAI & softwareInterest 6/10

Sony patents method to speed up high-quality video rendering

Patent drawing
Patent drawing from the official filing.

Sony describes a system that speeds up the creation of high-resolution video by using a computer program to learn from a small sample of the footage. It first renders a tiny part of the video in low and high quality to teach the software how to improve the image, then applies that knowledge to the rest of the video to make it look sharper faster.

Why it mattersThis could help video creators and game developers produce high-quality visuals more quickly without waiting for long processing times.

In the filing’s own words

An information processing device ( 1) includes a tuning unit ( 13) and an upconverter ( 14). The tuning unit ( 13) fine-tunes an image processing network (NW) using, as a learning data set, a first low-resolution video (LV 1) and a high-resolution video (HV) corresponding to a part of a sequence. The upconverter ( 14) up-scales a second low-resolution video (LV 2) corresponding to the remaining part of the sequence using the image processing network (NW) that has been fine-tuned.

What exactly they claim (claim 1)

1. An information processing device comprising: circuitry configured to fine-tune an image processing network using, as a learning data set, a first low-resolution video and a high-resolution video corresponding to a part of a sequence; up-scale a second low-resolution video corresponding to a remaining part of the sequence by using the image processing network that has been fine-tuned; select a first video area for fine tuning from the sequence; generate the first low-resolution video by rendering video content of the first video area at a low resolution and generate the second low-resolution video by rendering video content of a second video area other than the first video area at a low resolution; and generate the high-resolution video by rendering the video content of the first video area at a high resolution.

Facts

Company
Sony (Sony Group Corporation)
Official title
Information processing device, information processing method, and computer-readable non-transitory storage medium for reducing high-definition rendering processing time
Patent number
US12802158B2
Application number
18730131
Filed
Jan 10, 2023
Granted
Nov 17, 2026
Inventors
1
Claims
13

Classified under

G06T 3/40 Physics & computingG06T 5/60 Physics & computingG06V 10/761 Physics & computingG06T 2207/10016 Physics & computingG06T 2207/20081 Physics & computingG06V 10/774 Physics & computing

More from Sony in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.