Amazon patents voice assistants that adjust personality based on your mood
Amazon has patented a system that allows voice assistants to detect a user's emotional state from their speech and adjust their conversational style accordingly. The technology analyzes both the words spoken and the tone of voice to determine the user's sentiment, then instructs the language model to emphasize specific personality traits in its response. This ensures the assistant's reply matches the emotional context of the conversation rather than using a static, one-size-fits-all approach.
In the filing’s own words
Techniques for simulating emotional intelligence in language model-based conversational agents through situationally adaptive trait expression are described. A text representation of a recording of a verbal request of a user recorded by a device and a paralinguistic caption indicative of a paralinguistic sentiment of the recording are sent to a user sentiment classifier model, which generates an estimated actual sentiment of the user. A first set of instructions are selected based at least in part on the estimated actual sentiment of the user, and include at least one trait to emphasize in a response to the verbal request. A first prompt to generate the response to the verbal request is sent to a language model, the first prompt including the first set of instructions. The response to the verbal request is received from the language model, and the response is sent to a rendering component for output by the device.
What exactly they claim (claim 1)
1. A computer-implemented method comprising: receiving a text representation and a paralinguistic caption of a verbal request of a user recorded by a remote device, wherein the text representation is a speech-to-text translation of the verbal request and the paralinguistic caption is indicative of a paralinguistic sentiment of the user; selecting a set of static instructions for a language model, the set of static instructions including a set of traits that can be assumed in generating a response to the verbal request, wherein the set of traits are selected based on a characteristic associated with the verbal request; sending, to the language model, a first prompt including the set of static instructions, wherein the language model processes the first prompt for a first period of time; sending, to a user sentiment classifier model, the text representation and the paralinguistic caption; receiving, from the user sentiment classifier model, an indication of an estimated actual sentiment of the user; selecting, during at least a portion of the first period of time, a set of dynamic instructions based on an indication of an estimated actual sentiment of the user, wherein the set of dynamic instructions includes a trait in the set of traits to emphasize in generating the response to the verbal request; sending, to the language model, a second prompt to generate a response to the verbal request, the second prompt including the set of dynamic instructions; receiving, from the language model, the response to the verbal request, the response including one or more tags indicative of directives for rendering the response; and sending, to a text-to-speech component, the response to the verbal request and the one or more tags to be rendered as audio playback by the remote device.
Facts
- Company
- Amazon (Amazon Technologies, Inc.)
- Official title
- Emotional intelligence in language model-based conversational agents through situationally adaptive trait expression
- Patent number
- US12784746B1
- Application number
- 18901508
- Filed
- Sep 30, 2024
- Granted
- Nov 3, 2026
- Inventors
- 5
- Claims
- 20
Classified under
G10L 15/183 Physics & computingG10L 13/02 Physics & computingG10L 15/1815 Physics & computingG10L 15/22 Physics & computingMore from Amazon in AI & software
- Amazon patents system that cites sources for AI answers Sep 29, 2026
- Amazon patents tech to swap words in movies using actor's voice Sep 8, 2026
- Amazon patents ML tool to add graphics to live sports from moving cameras Sep 15, 2026
- Amazon patents shopping assistant that remembers your search filters Oct 6, 2026
- Amazon patents system where AI agents split tasks and talk to each other Oct 20, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.