Nvidia patents method to optimize code memory usage
Nvidia describes a technique for computer compilers to improve how programs use memory. The system tests different ways to handle data storage and picks the option that runs fastest based on predicted performance.
In the filing’s own words
Apparatuses, systems, and techniques to allocate and/or assign registers. In at least one embodiment, registers are allocated based, at least in part, on a set of estimated performance metrics associated with transformations generated prior to a register allocation phase of compilation.
What exactly they claim (claim 1)
1. One or more processors, comprising: circuitry to: identify a range of a software program that includes one or more memory operations: calculate a plurality of performance metrics estimating a change in a performance of the software program caused by replacing the one or more memory operations with two or more candidate replacement memory operations from a set of candidate replacement memory operations, wherein estimating the change in performance is based, at least in part, on one or more predicted memory operations to be performed during a later phase of compilation; select a replacement memory operation from the two or more candidate replacement memory operations based, at least in part, on the replacement memory operation having a lower cost than a second one of the two or more candidate replacement memory operations; and replace the one or more memory operations with the replacement memory operation.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- Memory modification technique using metrics
- Patent number
- US12769548B2
- Application number
- 18195303
- Filed
- May 9, 2023
- Granted
- Oct 20, 2026
- Inventors
- 1
- Claims
- 20
Classified under
G06F 9/3004 Physics & computingG06F 9/4881 Physics & computingG06F 11/3466 Physics & computingMore from Nvidia in Chips & hardware
- Nvidia patents method to skip zero data in neural network math Oct 13, 2026
- Nvidia patents hardware to speed up motion blur in ray tracing Oct 13, 2026
- Nvidia patents method to sync data across split processor chips Sep 17, 2026
- Nvidia patents chip math trick to speed up AI calculations Oct 8, 2026
- Nvidia patents data center cooling that uses cryogenic fluids Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.