/Patent Tracker
SonyGranted patentAudio & voiceInterest 6/10

Sony patents audio balancing for mixed live streams and app sounds

Sony describes a system that automatically adjusts the volume of different audio sources, such as a streamer's microphone, game sounds, and viewer comments, before they are sent to an audience. The technology sets a maximum volume limit for each sound type to ensure no single source drowns out the others in the final broadcast.

Why it mattersThis could make live streams and interactive video calls easier to listen to by preventing loud background noises or overlapping voices from becoming too harsh for the viewer.

In the filing’s own words

A device and method are provided that adjust voices of a plurality of sound sources included in distribution content from an information processing device and make it easier to hear sound of each sound source by a reception terminal that receives and reproduces distribution content. A first output voice adjustment unit executes adjustment processing on an output voice of each of the plurality of sound sources, and content including synthesized voice data obtained by synthesizing the output voices corresponding to the sound sources adjusted by the first output voice adjustment unit is output. The first output voice adjustment unit executes output voice adjustment processing for matching a maximum value of a volume level corresponding to a frequency of the output voice of each sound source to a target level. Moreover, a second output voice adjustment unit executes the output voice adjustment processing in accordance with a content type or scene.

What exactly they claim (claim 1)

1. An information processing device comprising: circuitry configured to input an output voice of each of a plurality of sound sources and execute adjustment processing on the output voice of each of a first sound source, a second sound source, and a third sound source of the plurality of sound sources, wherein the output voice associated with the first sound source corresponds to a distribution user voice input via a microphone, the output voice associated with the second sound source corresponds to operation of an application, and the output voice associated with the third sound source corresponds to a viewing user comment input via a network; synthesis synthesize the output voice corresponding to each of the plurality of sound sources having been adjusted to generate synthesized voice data; and output content including the synthesized voice data, wherein the adjustment processing includes: analyzing a volume level corresponding to a frequency regarding the output voice of each of the first, second, and third sound sources of the plurality of sound sources, and setting a maximum value of the volume level corresponding to the frequency of the output voice of each of the first, second, and third sound sources to a target level for the output of the content that includes the synthesized voice data, wherein output volume corresponding to the synthesized voice data is limited to no greater than the target level for each of the first, second, and third sound sources of the plurality of sound sources.

Facts

Company
Sony (Sony Group Corporation)
Official title
Information processing device, information processing method, and program
Patent number
US12744050B1
Application number
18684196
Filed
Mar 23, 2022
Granted
Sep 22, 2026
Inventors
1
Claims
19

Classified under

G10L 21/0364 Physics & computingG10L 13/033 Physics & computingG10L 21/034 Physics & computing
Read the full filing (official PDF) ↗ Open in the Patent Tracker

More from Sony in Audio & voice

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.