Nvidia patents AI system that writes and voices character conversations
Nvidia describes a system where multiple AI agents work together to create audio conversations. One agent writes a script based on user inputs like topics and character roles, while another directs the flow. Specialized agents then generate realistic, emotional speech for each character using voice cloning technology.
In the filing’s own words
In various examples, techniques for audio and/or other content generation for agentic AI systems and applications are described herein. Systems and methods described herein may use inputted information-such as a topic, a number of characters, roles for the characters, identities of the characters, a number of scenes, a plain language description, and/or the like-to generate a conversation between characters. For instance, a screenwriter agent may process the inputted information to generate a script associated with the conversation. A director agent may then use the script to manage the performance of the conversation, such as by controlling the dialogue between character agents. For instance, the character agents may generate speech corresponding to different scenes of the conversation as provided by the director agent, where the character agents may use voice cloning to cause the voices of the characters to sound realistic, human, and/or emotional.
What exactly they claim (claim 1)
1. A method comprising: receiving input data representative of information associated with creating a conversation between at least a first character and a second character; generating, using one or more language models and based at least on the information, a script associated with the conversation; generating, using the one or more language models and based at least on a first scene of the script, first audio data representative of first synthetic speech for the first character; generating, using the one or more language models and based at least on a second scene of the script, second audio data representative of second synthetic speech for the second character; and causing, using the first audio data and the second audio data, output associated with at least the first synthetic speech and the second synthetic speech.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- AUDIO CONTENT GENERATION FOR AGENTIC AI SYSTEMS AND APPLICATIONS
- Publication number
- US20260268890A1
- Application number
- 19075605
- Filed
- Mar 10, 2025
- Published
- Sep 10, 2026
- Inventors
- 3
- Claims
- 20
Classified under
G10L 13/08 Physics & computingG10L 25/63 Physics & computingMore from Nvidia in AI & software
- Nvidia patents AI coach that analyzes your gameplay to suggest strategies Oct 13, 2026
- Nvidia patents system that uses AI to find bugs in game videos Sep 17, 2026
- Nvidia patents AI method to make digital characters move realistically Sep 8, 2026
- Nvidia patents AI system that builds image generators from text prompts Sep 15, 2026
- Nvidia patents AI that makes virtual characters move naturally around 3D objects Sep 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.