Sony patents game streaming that sends text and video separately
Sony describes a method for cloud gaming where a server renders game graphics and text as two separate layers. The system compresses the visual scene but sends the text in its original, uncompressed form to the player's device. This allows the device to display crisp words while streaming the background video.
In the filing’s own words
A method including executing a video game on a server to generate draw calls for execution by one or more graphics processing units to render an image frame. The method including a first set of commands of one or more draw calls that are used to render text in the image frame. The method including identifying a second set of commands of one or more draw calls that are used to render a scene in the image frame. The method including executing the first set of commands to render the text. The method including executing the second set of commands to render the scene independent of rendering the text. The method including generating an encoded scene by encoding the rendered scene. The method including separately streaming to a client device the text and the encoded scene.
What exactly they claim (claim 1)
1. A method, comprising: executing an application on a server to generate a plurality of draw calls for execution to render an image frame; identifying a first set of commands of the plurality of draw calls directed to rendering text for the image frame; identifying a second set of commands of the plurality of draw calls directed to rendering a scene for the image frame; executing the first set of commands to render the text separately from the scene; executing the second set of commands to render the scene independent of the text; encoding the rendered scene to generate an encoded scene, wherein the rendered text remains unencoded; and separately streaming, via a network, the unencoded rendered text and the encoded scene to a client device.
Facts
- Company
- Sony (Sony Interactive Entertainment Inc.)
- Official title
- TEXT EXTRACTION TO SEPARATE ENCODING OF TEXT AND IMAGES FOR STREAMING DURING PERIODS OF LOW CONNECTIVITY
- Publication number
- US20260315917A1
- Application number
- 19717235
- Filed
- Jun 23, 2026
- Published
- Oct 15, 2026
- Inventors
- 2
- Claims
- 20
Classified under
A63F 13/355 Human necessitiesA63F 13/52 Human necessitiesG06T 9/00 Physics & computingG06T 11/60 Physics & computingG06T 15/005 Physics & computingG06T 2200/24 Physics & computingMore from Sony in AI & software
- Sony patents AI that plays video games in your style Oct 6, 2026
- Sony patents AI that swaps game visuals for accessibility formats Sep 17, 2026
- Sony patents AI that changes game characters based on your play Oct 1, 2026
- Sony patents method to turn 2D videos into high-detail 3D animations Oct 15, 2026
- Sony patents AI bots that mimic your friends' gaming styles Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.