Sony patents game interface that adjusts complexity based on player emotion
Sony describes a system where AI trackers monitor a user's physical cues to predict their emotional state. The software then uses this prediction to automatically change the complexity of the game's user interface, such as adding or removing visual overlays.
In the filing’s own words
A method including receiving an input from a user for an interaction application that is executing. The method including receiving a first plurality of multimodal cues from a plurality of trackers, wherein each of the plurality of trackers is configured to track a corresponding cue using artificial intelligence. The method including providing the first plurality of multimodal cues to an artificial intelligence (AI) model configured to classify one or more emotions of a user, wherein the AI model generates a first predicted emotion based on the first plurality of multimodal cues. The method including determining a modification to content generated by the interaction application in response to the input, wherein the modification to the content is determined based on the predicted emotion. The method including providing the modification to the interaction application, wherein the interaction application is configured to generate modified content based on the modification.
What exactly they claim (claim 1)
1. A method, comprising: receiving an input from a user for an interaction application during execution of the interaction application; receiving a plurality of cues from a plurality of trackers, wherein each tracker of the plurality of trackers is configured to generate a respective cue using artificial intelligence (AI); providing the plurality of cues to an AI model that is configured to receive input including one or more cues and to generate output including a classification of at least one emotion based on the one or more cues; obtaining, as output from the AI model, a predicted emotion of the user; generating initial content for the interaction application in response to the input from the user, wherein the initial content comprises a user interface having a first complexity level; determining, based on the predicted emotion of the user, a modification to be made to the initial content, the modification including an overlay; generating the overlay; and applying the overlay to the initial content to generate modified content for the interaction application, wherein applying the overlay to the initial content changes the first complexity level of the user interface such that the modified content comprises a modified user interface having a second complexity level that is different from the first complexity level.
Facts
- Company
- Sony (Sony Interactive Entertainment Inc.)
- Official title
- Artificial intelligence determined emotional state with dynamic modification of output of an interaction application
- Patent number
- US12758872B2
- Application number
- 18591752
- Filed
- Feb 29, 2024
- Granted
- Oct 13, 2026
- Inventors
- 2
- Claims
- 19
Classified under
A63F 13/40 Human necessitiesA61B 5/165 Human necessitiesA63F 13/60 Human necessitiesG06N 20/00 Physics & computingMore from Sony in AI & software
- Sony patents AI that plays video games in your style Oct 6, 2026
- Sony patents AI that swaps game visuals for accessibility formats Sep 17, 2026
- Sony patents AI that changes game characters based on your play Oct 1, 2026
- Sony patents method to turn 2D videos into high-detail 3D animations Oct 15, 2026
- Sony patents AI bots that mimic your friends' gaming styles Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.