Nvidia patents software that picks the fastest code version at runtime
Nvidia describes a system that precompiles multiple versions of the same program code, with some versions optimized for specific memory access patterns. At runtime, the system checks if the code will access overlapping memory locations and automatically selects the most efficient version to run.
In the filing’s own words
Apparatuses, systems, and techniques to perform versions of program code. In at least one embodiment, one or more versions of a plurality of versions of software code are performed. In at least one embodiment, one or more versions of a plurality of versions of software code are performed based, at least in part, on whether the versions of the program code access overlapping memory regions.
What exactly they claim (claim 1)
1. One or more processors, comprising: circuitry to: precompile a plurality of versions of program code, wherein a first version of the plurality of versions is compiled to comprise code to which optimizations based on access to non-overlapping memory locations have been applied, and a second version of the plurality of versions is compiled to comprise code to which the optimizations based on access to non-overlapping memory locations have not been applied; determine, based on a data structure generated at runtime, that a performance of the program code will not cause overlapping memory locations to be accessed; select the first version of the plurality of precompiled versions of program code based, at least in part, on the determination at runtime that the performance of the program code will not cause overlapping memory locations to be accessed; and cause the first version of the plurality of precompiled versions of program code to be performed.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- Program code versions
- Patent number
- US12743272B2
- Application number
- 17836810
- Filed
- Jun 9, 2022
- Granted
- Sep 22, 2026
- Inventors
- 2
- Claims
- 35
Classified under
G06F 8/71 Physics & computingMore from Nvidia in AI & software
- Nvidia patents AI coach that analyzes your gameplay to suggest strategies Oct 13, 2026
- Nvidia patents AI system that writes and voices character conversations Sep 10, 2026
- Nvidia patents system that uses AI to find bugs in game videos Sep 17, 2026
- Nvidia patents AI method to make digital characters move realistically Sep 8, 2026
- Nvidia patents AI system that builds image generators from text prompts Sep 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.