/Patent Tracker
DisneyPatent applicationAudio & voiceInterest 6/10

Disney patents AI method to sync new audio with video timing

Patent drawing
Patent drawing from the official filing.

Disney describes a technique that extracts the timing and pauses from a video's original audio track. It then uses a language model to rewrite the script so that a new text-to-speech voice matches the original rhythm and gaps.

Why it mattersThis could help creators quickly produce dubbed or modified audio that stays perfectly in sync with existing video footage.

In the filing’s own words

Embodiments provide techniques for audio synchronization with improved timing alignment. The audio extracted from a video file is transcribed to generate an original script. Pause and timing information is extracted from the audio, where the pause and timing information comprises at least one of pauses, natural gaps, or a duration of a speech segment in the audio. A new script is generated from the original script using a language model, where the new script is structured to align with the pause and timing information of the audio. The synthesized audio is generated using the new script with a text-to-speech model.

What exactly they claim (claim 1)

1. A method, comprising: transcribing audio extracted from a video file to generate an original script; extracting pause and timing information from the audio, wherein the pause and timing information comprises at least one of pauses, natural gaps, or a duration of a speech segment in the audio; generating a new script from the original script using a language model, wherein the new script is structured to align with the pause and timing information of the audio; and generating synthesized audio using the new script with a text-to-speech (TTS) model.

Facts

Company
Disney (Disney Enterprises, Inc.)
Official title
AUDIO SYNCHRONIZATION THROUGH LARGE LANGUAGE MODELS AND DIFFERENTIAL EQUATION-BASED MEL SPECTOGRAM INVERSION
Publication number
US20260310723A1
Application number
19169314
Filed
Apr 3, 2025
Published
Oct 8, 2026
Inventors
6
Claims
20

Classified under

G06F 16/7844 Physics & computingG06F 16/7834 Physics & computingG06F 40/58 Physics & computingG10L 13/08 Physics & computingG10L 15/26 Physics & computing
Read the full filing (official PDF) ↗ Open in the Patent Tracker

More from Disney in Audio & voice

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.