Sony patents streaming 3D worlds using compressed neural data
Sony describes a system where a server learns 3D environments using machine learning and then sends compressed versions of these environments to a device. The device reconstructs the 3D scene in real-time based on the user's current view angle.
In the filing’s own words
A content server obtains neural networks representing a plurality of types of three-dimensional scene information by generating training images representing each scene of a display world and performing machine learning. The content server generates a plurality of neural networks, divides each of the plurality of neural networks into packets, randomizes an order of packets, and transmits the packets to a client terminal. The client terminal renders display images corresponding to a latest display viewpoint by restoring the original neural network from the neural networks.
What exactly they claim (claim 1)
1. A content server comprising: one or more processors; and a memory device storing instructions that, when executed by the one or more processors, cause the content server to: generate, as training images, images representing each scene of a three-dimensional display world viewed from a plurality of viewpoints, wherein a state of the three-dimensional display world is configured to change according to an operation; obtain a plurality of types of three-dimensional scene information representing three-dimensional information of each scene by machine learning using the training images as labeled data; and transmit data of the plurality of types of three-dimensional scene information to a client terminal in an order of completion of the machine learning of each scene.
Facts
- Company
- Sony (Sony Interactive Entertainment Inc.)
- Official title
- CONTENT SERVER, CLIENT TERMINAL, IMAGE DISPLAY SYSTEM, DISPLAY DATA TRANSMISSION METHOD, AND DISPLAY IMAGE GENERATION METHOD
- Publication number
- US20260330749A1
- Application number
- 19691501
- Filed
- May 28, 2026
- Published
- Oct 22, 2026
- Inventors
- 3
- Claims
- 20
Classified under
G06T 15/20 Physics & computingG06F 3/013 Physics & computingG06N 3/045 Physics & computingG06T 3/40 Physics & computingG06T 15/08 Physics & computingMore from Sony in AI & software
- Sony patents AI that plays video games in your style Oct 6, 2026
- Sony patents AI that swaps game visuals for accessibility formats Sep 17, 2026
- Sony patents AI that changes game characters based on your play Oct 1, 2026
- Sony patents method to turn 2D videos into high-detail 3D animations Oct 15, 2026
- Sony patents AI bots that mimic your friends' gaming styles Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.