Disney patents tool to sync dubbed audio with original video
Disney has been granted a patent for a method that automatically checks if dubbed audio lines up with the original video track. The system uses a trained model to compare the original sound with the translated version to find any timing gaps. It then calculates and outputs the exact offset needed to fix the synchronization.
In the filing’s own words
In some embodiments, a method analyzes a first sample of a first audio signal to determine a first representation in a space. A plurality of second samples for a second audio signal is analyzed to determine a plurality of second representations in the space. The method compares the first representation and the plurality of second representations in the space to select a second representation. An offset is determined between the first sample and a second sample that is associated with the second representation. The offset is output.
What exactly they claim (claim 1)
1. A method comprising: analyzing a first sample of a first audio signal to determine a first representation in a space; analyzing a plurality of second samples for a second audio signal to determine a plurality of second representations in the space, wherein the first audio signal is a reference audio signal in an original language of a video and the second audio signal is a dubbed audio signal in a translation of the original language for the video, and wherein the first representation and the plurality of second representations are generated by a model trained to recognize offset issues in a dubbing process; comparing distances in the space between the first representation and the plurality of second representations in the space to select a second representation; determining an offset between the first sample in the first audio signal and a second sample in the second audio signal that is associated with the second representation; and outputting the offset.
Facts
- Company
- Disney (Disney Enterprises, Inc.)
- Official title
- Automatic detection of alignment between two audio signals
- Patent number
- US12772002B2
- Application number
- 18776765
- Filed
- Jul 18, 2024
- Granted
- Oct 20, 2026
- Inventors
- 5
- Claims
- 20
Classified under
H04R 5/04 Electricity & electronicsH04S 7/301 Electricity & electronicsH04S 2400/15 Electricity & electronicsH04S 2420/03 Electricity & electronicsMore from Disney in Audio & voice
- Disney patents water harp that plays music when streams are broken Sep 8, 2026
- Disney patents AI method to sync new audio with video timing Oct 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.