Sony patents method to save game scenes as 3D data using AI
Sony has filed a patent for a system that allows users to save a specific moment in a 3D digital environment. The technology uses machine learning to analyze the saved image and create a 3D model of that scene, allowing the user to view it from different angles later.
In the filing’s own words
In a main image output phase in which a content application is executed, a content server receives a user operation to save a scene being displayed. A plurality of pseudo-viewpoints are set for the scene, images for learning are generated, and machine learning is performed, thereby 3D scene information of the scene is generated. In a saved scene viewing phase, the content server generates and outputs a display image representing the scene from an arbitrary viewpoint using the 3D scene information.
What exactly they claim (claim 1)
1. A device comprising: at least one processor; and a memory device storing instructions that, when executed by the at least one processor, cause the device to: generate a frame of a display image at a predetermined rate, the display image representing a three-dimensional display world, wherein a state of the three-dimensional display world changes in accordance with an operation at a viewpoint; generate a pseudo-viewpoint different from the viewpoint generate an image for learning corresponding to the pseudo-viewpoint; and generate three-dimensional scene information by machine learning using the image for learning as training data, the three-dimensional scene information representing three-dimensional information associated with the display world.
Facts
- Company
- Sony (Sony Interactive Entertainment Inc.)
- Official title
- IMAGE PROCESSING DEVICE AND IMAGE PROCESSING METHOD
- Publication number
- US20260268598A1
- Application number
- 19662342
- Filed
- Apr 29, 2026
- Published
- Sep 10, 2026
- Inventors
- 4
- Claims
- 20
Classified under
G06T 17/00 Physics & computingG06T 15/20 Physics & computingMore from Sony in AI & software
- Sony patents AI that plays video games in your style Oct 6, 2026
- Sony patents AI that swaps game visuals for accessibility formats Sep 17, 2026
- Sony patents AI that changes game characters based on your play Oct 1, 2026
- Sony patents method to turn 2D videos into high-detail 3D animations Oct 15, 2026
- Sony patents AI bots that mimic your friends' gaming styles Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.