DisneyGranted patentAI & softwareInterest 4/10

Disney patents video and audio sync using compressed data

Patent drawing
Patent drawing from the official filing.

Disney has received a patent for a system that keeps video and audio in sync by compressing both into simplified data patterns. It breaks video into small image patches and audio into samples, encodes them, and uses these compressed versions to align the original media.

Why it mattersThis technique could help streaming services maintain perfect lip-sync even when video and audio are processed at different speeds or resolutions.

In the filing’s own words

A system includes a hardware processor and a memory storing a video/audio (V/A) synchronizer including video and audio encoders. The hardware processor executes the V/A synchronizer to receive raw video and audio extracted from media content, partition the raw video into video frame patches, partition the raw audio into audio samples, pre-process the video frame patches and the audio samples for encoding. The hardware processor further executes the V/A synchronizer to encode, using the video encoder, the pre-processed video frame patches to provide pre-processed and encoded video frame patches used to provide a latent representation of the raw video, encode, using the audio encoder, the pre-processed audio samples to provide pre-processed and encoded audio samples used to provide a latent representation of the raw audio, and synchronize, using the latent representations of the raw video and the raw audio, the raw audio with the raw video.

What exactly they claim (claim 1)

1. A system comprising: a hardware processor; and a memory storing a software code; the hardware processor configured to execute the software code to: receive raw video and raw audio extracted from media content; partition the raw video into a plurality of video frame patches; partition the raw audio into a plurality of audio samples; encode the plurality of video frame patches to provide a plurality of encoded video frame patches; encode the plurality of audio samples to provide a plurality of encoded audio samples; provide, using one or more of the plurality of encoded video frame patches, a latent representation of the raw video; provide, using the plurality of encoded audio samples, a latent representation of the raw audio; and synchronize, using the latent representation of the raw video and the latent representation of the raw audio, the raw audio with the raw video.

Facts

Company
Disney (Disney Enterprises, Inc.)
Official title
Video and audio synchronization with dynamic frame and sample rates
Patent number
US12804217B2
Application number
19337415
Filed
Sep 23, 2025
Granted
Nov 17, 2026
Inventors
8
Claims
24

Classified under

H04N 21/4307 Electricity & electronicsH04N 19/60 Electricity & electronics

More from Disney in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.