Sony patents method to shrink game assets using neural data
Sony describes a system where a cloud server captures video frames of a large game asset and converts them into a smaller neural representation. This compact data is then sent to the player's device, which uses it as input to render the object locally.
In the filing’s own words
Multi-dimensional neural object representations can be generated to use as placeholders for large-scale assets in cloud gaming development. For example, a method performed by a cloud server system can involve generating, by a game engine, a rendering of an asset in a gaming application. A virtual camera of the game engine can capture one or more video frames depicting the rendering of the asset. The method can involve generating, based on the video frames, a multi-dimensional neural object representation with a second data size. A first data size of the asset can be larger than the second data size. In response to receiving a request for the asset from a client device, the method can involve providing the multi-dimensional neural object representation of the asset such that the multi-dimensional neural object representation is included in an input to a rendering engine executed by the client device.
What exactly they claim (claim 1)
1. A method comprising, by a cloud server system: generating, by a game engine, a rendering of an asset in a gaming application; capturing, by a virtual camera of the game engine, one or more video frames depicting the rendering of the asset; generating, based at least in part on the one or more video frames, a multi-dimensional neural object representation of the asset, wherein a first data size of the asset is larger than a second data size of the multi-dimensional neural object representation; and responsive to receiving a request for the asset from a client device, providing the multi-dimensional neural object representation of the asset to the client device such that the multi-dimensional neural object representation is included in an input to a rendering engine executed by the client device.
Facts
- Company
- Sony (Sony Interactive Entertainment Inc.)
- Official title
- MULTI-DIMENSIONAL NEURAL OBJECT REPRESENTATIONS OF LARGE-SCALE ASSETS IN GAMING APPLICATIONS
- Publication number
- US20260273416A1
- Application number
- 19080144
- Filed
- Mar 14, 2025
- Published
- Sep 17, 2026
- Inventors
- 4
- Claims
- 20
Classified under
A63F 13/67 Human necessitiesA63F 13/5252 Human necessitiesA63F 13/533 Human necessitiesA63F 2300/538 Human necessitiesMore from Sony in Games & media
- Sony patents game engine that reshuffles scenes based on your heart rate Sep 8, 2026
- Sony patents game controls that learn your unique hand movements Oct 13, 2026
- Sony patents eSport events where fans' cheers give players in-game power-ups Oct 20, 2026
- Sony patents game gear design using AI mood boards Oct 20, 2026
- Sony patents game feature that warns players before they hit a hard part Sep 3, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.