Nvidia patents system to automatically manage GPU workloads
Nvidia has patented a method that uses specific data tags to tell a graphics processor how to organize its internal tasks. The system reads these tags to automatically assign different parts of a program to specific hardware sections, ensuring each stage of the work gets the right amount of space and resources.
In the filing’s own words
Technology advancements in computer processors, including in particular graphics processing units (GPUs), have included the introduction of parallel processing capabilities which offer high compute throughput and memory bandwidth. Currently, programmers spend considerable time optimizing their code to best exploit the available parallel processor resources. However, some applications are still unable to consistently attain high compute throughput or memory bandwidth despite the presence of abundant parallelism. The present disclosure provides both hardware and software support for accelerating parallel processing pipelines.
What exactly they claim (claim 1)
1. A method, comprising: at a device: processing, in hardware, metadata defined for a program to be executed using a pipeline having one or more stages, wherein the metadata indicates: one or more processing contexts, an assignment of each processing context of the one or more processing contexts to a corresponding stage of the one or more stages in the pipeline, and resources to be used for each stage of the one or more stages, and wherein the processing includes: mapping the one or more processing contexts to one or more processing blocks of a processor core, sending each processing context of one or more processing contexts to a corresponding processing block of the one or more processing blocks, and using the metadata indicating the resources to be used for each stage of the one or more stages to allocate space in each processing block of the one or more processing blocks; and executing the one or more processing contexts on the processor core based on the mapping.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- Hardware and software support for parallel processing pipelines
- Patent number
- US12792358B2
- Application number
- 18651474
- Filed
- Apr 30, 2024
- Granted
- Nov 10, 2026
- Inventors
- 2
- Claims
- 34
Classified under
G06F 9/3869 Physics & computingG06F 8/45 Physics & computingG06T 1/20 Physics & computingMore from Nvidia in Chips & hardware
- Nvidia stacks memory directly on chips to boost data speed Nov 10, 2026
- Nvidia patents method to skip zero data in neural network math Oct 13, 2026
- Nvidia patents hardware to speed up motion blur in ray tracing Oct 13, 2026
- Nvidia patents method to sync data across split processor chips Sep 17, 2026
- Nvidia patents chip math trick to speed up AI calculations Oct 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.