Nvidia patents method to move data ahead of time using task maps
Nvidia describes a technique where a processor looks at a map of how a program uses data. It then copies that data from main memory into a faster, on-chip storage area before the program actually needs it.
In the filing’s own words
Apparatuses, systems, and techniques are to transfer data based, at least in part, on a computational graph. In at least one embodiment, a processor causes a compiler to generate instructions to prefetch one or more data values from dynamic random access memory (DRAM) into an in-processor cache based, at least in part, on a computational graph.
What exactly they claim (claim 1)
1. One or more processors, comprising: circuitry to, in response to an application programming interface (API) call: receive a computational graph representing one or more data dependencies, the one or more data dependencies indicating that one or more data values used by a first software instruction are to be used by a second software instruction; generate, based on the computational graph, one or more prefetch instructions; and cause, based on the one or more prefetch instructions, the one or more data values to be copied from a first storage location to a second storage location prior to execution of the second software instruction.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- DATA TRANSFER TECHNIQUE
- Publication number
- US20260300182A1
- Application number
- 19697422
- Filed
- Jun 3, 2026
- Published
- Oct 1, 2026
- Inventors
- 7
- Claims
- 20
Classified under
G06F 12/0862 Physics & computingG06F 12/1072 Physics & computingMore from Nvidia in Chips & hardware
- Nvidia patents method to skip zero data in neural network math Oct 13, 2026
- Nvidia patents hardware to speed up motion blur in ray tracing Oct 13, 2026
- Nvidia patents method to sync data across split processor chips Sep 17, 2026
- Nvidia patents chip math trick to speed up AI calculations Oct 8, 2026
- Nvidia patents data center cooling that uses cryogenic fluids Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
