Sony patents method to build 3D game scenes using limited camera angles
Sony describes a system that uses machine learning to create 3D scene data for video games by analyzing images generated from specific, restricted camera angles. The process involves generating training images within a set range and using them to teach the system how to reconstruct the 3D environment for display.
In the filing’s own words
An additional viewpoint setting unit of a content server acquires viewpoint restriction information from an application execution unit, and sets viewpoints for generating training images within a restriction range. The application execution unit generates images of a display world in correspondence with the set viewpoints. A three-dimensional (3D) scene information generation unit performs machine learning on the basis of the images generated by the application execution unit to generate 3D scene information associated with the display world. An arbitrary viewpoint image generation unit acquires viewpoint restriction information from the application execution unit, and generates images indicating the display world on the basis of arbitrary viewpoints within the restriction range.
What exactly they claim (claim 1)
1. An image processing device comprising: one or more memory devices configured to store an application program; one or more processors configured to: execute the application program; and generate, at a predetermined rate, a frame of a display image representing a three-dimensional display world where a situation changes in accordance with a user operation; and generate a training image different from the display image and representing the display world; perform a process including generating and using, for display, three-dimensional scene information indicating three-dimensional information of the display world by machine learning that uses the training image as supervised data; and limit a viewpoint set for the display world in the process based on viewpoint restriction information associated with the application program.
Facts
- Company
- Sony (Sony Interactive Entertainment Inc.)
- Official title
- IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, AND DATA STRUCTURE OF 3D SCENE INFORMATION FOR DISPLAY
- Publication number
- US20260268583A1
- Application number
- 19663105
- Filed
- Apr 29, 2026
- Published
- Sep 10, 2026
- Inventors
- 1
- Claims
- 20
Classified under
G06T 15/08 Physics & computingA63F 13/525 Human necessitiesG06T 11/60 Physics & computingMore from Sony in AI & software
- Sony patents AI that plays video games in your style Oct 6, 2026
- Sony patents AI that swaps game visuals for accessibility formats Sep 17, 2026
- Sony patents AI that changes game characters based on your play Oct 1, 2026
- Sony patents method to turn 2D videos into high-detail 3D animations Oct 15, 2026
- Sony patents AI bots that mimic your friends' gaming styles Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.