Sony patents AI that reshapes app screens based on how you use them
Sony describes a system where an AI model looks at an app's current screen and your actions to suggest a different layout. The new screen keeps the same core functions but presents them in a way the AI thinks fits your current task better.
In the filing’s own words
Techniques for artificial intelligence (AI)-based user interface presentation are described. In an example, a computer system executes an application remotely from a device. The application has a first graphical user interface (GUI) that can be presented at the device. The computer system generates an input to an AI model based on the first GUI and a user input to the application at the device. The computer system receives, from the AI model and based on the input, an output indicating a second GUI that has at least one function of the application common with the first GUI. The computer system causes the device to present the second GUI based on the output.
What exactly they claim (claim 1)
1. A computer-implemented method comprising: executing an application remotely from a device, the application having a first graphical user interface (GUI) that can be presented at the device; generating an input to an artificial intelligence model based on the first GUI and a user input to the application at the device; receiving, from the artificial intelligence model and based on the input, an output indicating a second GUI that has at least one function of the application common with the first GUI; and causing the device to present the second GUI based on the output.
Facts
- Company
- Sony (Sony Interactive Entertainment Inc.)
- Official title
- ARTIFICIAL INTELLIGENCE-BASED USER INTERFACE PRESENTATION
- Publication number
- US20260277630A1
- Application number
- 19080213
- Filed
- Mar 14, 2025
- Published
- Sep 17, 2026
- Inventors
- 5
- Claims
- 20
Classified under
G06F 9/451 Physics & computingMore from Sony in AI & software
- Sony patents AI that plays video games in your style Oct 6, 2026
- Sony patents AI that swaps game visuals for accessibility formats Sep 17, 2026
- Sony patents AI that changes game characters based on your play Oct 1, 2026
- Sony patents method to turn 2D videos into high-detail 3D animations Oct 15, 2026
- Sony patents AI bots that mimic your friends' gaming styles Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.