Nvidia patents system to manage memory for hardware accelerators
Nvidia describes a method for managing memory in specialized computer chips called hardware accelerators. The system checks if a specific area of fast, on-chip memory is already being used for a task and reuses it if possible, or creates a new link to slower, off-chip memory if not.
In the filing’s own words
Various examples, systems, and methods relate to facilitating memory use by a hardware accelerator. A system can check whether an on-chip memory region has already been set up for a given use. If it has, the system can reuse it. If not, the system can allocate a new region and connect it to a larger off-chip memory. The system can determine whether to load data into on-chip memory or save data back to off-chip memory based on various rules.
What exactly they claim (claim 1)
1. A system, comprising: one or more processors to: allocate, via a firmware interface, a local memory region in a local memory of a hardware accelerator bound to an external memory region, the allocation returning a device pointer corresponding to a binding, the binding tracked using a resource identifier in a resource table corresponding with a non-privileged execution context; and provide the device pointer to a memory region accessible to the non-privileged execution context for at least one subsequent construction of at least one command buffer identifying the binding of the local memory region to the external memory region.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- Firmware-controlled memory binding and implicit data persistence for hardware accelerators
- Patent number
- US12743372B1
- Application number
- 19183568
- Filed
- Apr 18, 2025
- Granted
- Sep 22, 2026
- Inventors
- 4
- Claims
- 20
Classified under
G06F 12/0246 Physics & computingG06F 9/5016 Physics & computingG06F 12/1491 Physics & computingG06F 13/1642 Physics & computingG06F 13/1673 Physics & computingMore from Nvidia in Chips & hardware
- Nvidia patents method to skip zero data in neural network math Oct 13, 2026
- Nvidia patents hardware to speed up motion blur in ray tracing Oct 13, 2026
- Nvidia patents method to sync data across split processor chips Sep 17, 2026
- Nvidia patents chip math trick to speed up AI calculations Oct 8, 2026
- Nvidia patents data center cooling that uses cryogenic fluids Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.