Sony patents AI that helps gamers with limited hand movement
Sony has filed a patent for a system that uses an AI model to assist video game players who have difficulty using standard controllers. The system reads which buttons a user can press and identifies physical limitations, then generates the necessary control signals to play the game.
In the filing’s own words
System and method herein use AI model-generated control outputs to improve game controllers and user's video game experiences. The system is configured receive, from a controller including controls manually actuatable by a user, controls actuation information (e.g., left trigger, left button, left joystick actuation, etc.) associated with a video game, and determine accessibility information of the user that indicates a limitation to manual actuation of the controller (e.g., injury to left causing less than 50% actuation of left controls). A control output is generated by using an artificial intelligence (AI) model. The AI model is trained to assist video game users with controller inputs in association with accessibility limits for using the controllers, and generate control outputs based on the controls actuation information and the accessibility information. The control output can be used to cause control of executing the video game.
What exactly they claim (claim 1)
1. A system comprising: at least one processor; and at least one memory storing instructions that, upon execution by the at least one processor, configure the system to: receive, from a controller comprising controls manually actuatable by a user, controls actuation information associated with playing a video game; determine accessibility information associated with the user, the accessibility information indicating a limitation to manual actuation of the controller; generate a control output by using an artificial intelligence (AI) model, the AI model trained to assist video game users with controller inputs in association with one or more accessibility limits for using controllers, the control output generated based on the controls actuation information and the accessibility information; and cause control of executing the video game based on the control output.
Facts
- Company
- Sony (SONY INTERACTIVE ENTERTAINMENT INC.)
- Official title
- AI-ASSISTED USER INPUT FOR ACCESSIBILITY
- Publication number
- US20260273392A1
- Application number
- 19079249
- Filed
- Mar 13, 2025
- Published
- Sep 17, 2026
- Inventors
- 4
- Claims
- 20
Classified under
A63F 13/22 Human necessitiesA63F 13/53 Human necessitiesA63F 13/79 Human necessitiesMore from Sony in AI & software
- Sony patents AI that plays video games in your style Oct 6, 2026
- Sony patents AI that swaps game visuals for accessibility formats Sep 17, 2026
- Sony patents AI that changes game characters based on your play Oct 1, 2026
- Sony patents method to turn 2D videos into high-detail 3D animations Oct 15, 2026
- Sony patents AI bots that mimic your friends' gaming styles Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.