NvidiaGranted patentChips & hardwareInterest 6/10

Nvidia patents system to automatically manage GPU workloads

Nvidia has patented a method that uses specific data tags to tell a graphics processor how to organize its internal tasks. The system reads these tags to automatically assign different parts of a program to specific hardware sections, ensuring each stage of the work gets the right amount of space and resources.

Why it mattersThis could make it easier for software developers to get the most out of powerful graphics chips without spending hours manually tweaking their code for efficiency.

In the filing’s own words

Technology advancements in computer processors, including in particular graphics processing units (GPUs), have included the introduction of parallel processing capabilities which offer high compute throughput and memory bandwidth. Currently, programmers spend considerable time optimizing their code to best exploit the available parallel processor resources. However, some applications are still unable to consistently attain high compute throughput or memory bandwidth despite the presence of abundant parallelism. The present disclosure provides both hardware and software support for accelerating parallel processing pipelines.

What exactly they claim (claim 1)

1. A method, comprising: at a device: processing, in hardware, metadata defined for a program to be executed using a pipeline having one or more stages, wherein the metadata indicates: one or more processing contexts, an assignment of each processing context of the one or more processing contexts to a corresponding stage of the one or more stages in the pipeline, and resources to be used for each stage of the one or more stages, and wherein the processing includes: mapping the one or more processing contexts to one or more processing blocks of a processor core, sending each processing context of one or more processing contexts to a corresponding processing block of the one or more processing blocks, and using the metadata indicating the resources to be used for each stage of the one or more stages to allocate space in each processing block of the one or more processing blocks; and executing the one or more processing contexts on the processor core based on the mapping.

Facts

Company
Nvidia (NVIDIA Corporation)
Official title
Hardware and software support for parallel processing pipelines
Patent number
US12792358B2
Application number
18651474
Filed
Apr 30, 2024
Granted
Nov 10, 2026
Inventors
2
Claims
34

Classified under

G06F 9/3869 Physics & computingG06F 8/45 Physics & computingG06T 1/20 Physics & computing

More from Nvidia in Chips & hardware

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.