Sony patents tool that maps game scenes from screen recordings
Sony has been granted a patent for a system that records a video game as it runs to automatically map out its different levels and menus. The software analyzes the changing images to identify specific scenes and how players move between them, creating a visual diagram of the game's structure. It also detects interactive buttons on the screen to understand what choices are available at each step.
In the filing’s own words
Disclosed is an information processing apparatus for acquiring a plurality of display screens that are displayed chronologically while a target program is executed, identifying, on the basis of the plurality of display screens, a plurality of scenes presented by the target program and transition relations between the scenes, and generating a transition diagram that indicates a transition between the scenes.
What exactly they claim (claim 1)
1. An information processing apparatus comprising: one or more processor; and one or more computer-readable media storing instructions which, when executed by the one or more processors, cause the information processing apparatus to perform operations comprising: acquiring a plurality of display screens that are displayed chronologically while a target program is executed; identifying, on a basis of the plurality of display screens, a plurality of scenes presented by the target program, transition relations between the plurality of scenes, and a plurality of user-selectable options on at least one of the plurality of display screens; (i) generating, on a basis of the plurality of display screens including each of the plurality of user-selectable options, a screen image indicating a state where none of the plurality of selectable options are chosen, and identifying the plurality of selectable options according to the screen image, and/or (ii) identifying, on a basis of a result of comparison between the plurality of display screens, a region where the plurality of user-selectable options are displayed, and identifying the plurality of user-selectable options according to the identified region; and generating a transition diagram that indicates a transition between the plurality of scenes in accordance with steps (i) and/or (ii).
Facts
- Company
- Sony (Sony Interactive Entertainment Inc.)
- Official title
- Information processing apparatus, information processing method, and program
- Patent number
- US12769641B2
- Application number
- 18561306
- Filed
- May 26, 2021
- Granted
- Oct 20, 2026
- Inventors
- 5
- Claims
- 20
Classified under
G06F 11/3688 Physics & computingG06F 11/3698 Physics & computingG06V 20/62 Physics & computingG06V 30/10 Physics & computingG06V 2201/02 Physics & computingMore from Sony in AI & software
- Sony patents AI that plays video games in your style Oct 6, 2026
- Sony patents AI that swaps game visuals for accessibility formats Sep 17, 2026
- Sony patents AI that changes game characters based on your play Oct 1, 2026
- Sony patents method to turn 2D videos into high-detail 3D animations Oct 15, 2026
- Sony patents AI bots that mimic your friends' gaming styles Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.