Nvidia patents system to manage hardware tasks via firmware
Nvidia describes a method for managing commands sent to hardware accelerators, such as graphics or AI chips. The system uses firmware to organize these commands in a specific order and allows some tasks to run simultaneously if the necessary hardware resources are available.
In the filing’s own words
Various examples, systems, and methods relate to performing commands on a hardware accelerator using a set of instructions prepared in memory. A system can receive a list of commands from an application and provide them to firmware with a signal that informs the firmware to start processing. The firmware can run the commands on different parts of the hardware, such as a data mover or a processing unit. Some commands can run at the same time. The system can use tables to track which parts of memory or hardware command use and/or need.
What exactly they claim (claim 1)
1. A system, comprising: one or more processors to: construct, in memory of a hardware accelerator, a command buffer comprising a plurality of commands, wherein at least one command of the plurality commands identifies at least one resource via a resource identifier in a resource table inaccessible to a non-privileged execution context; provide, to at least one submission interface corresponding with the non-privileged execution context, submission information of the command buffer and a submission indicator corresponding to the submission information; and cause execution of the command buffer by a firmware component to (i) initiate execution of the plurality of commands in order of placement in the command buffer and (ii) issue at least one subsequent command for execution prior to completion of at least one previously issued command based on an availability of the at least one resource.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- FIRMWARE-CONTROLLED COMMAND DISPATCH AND RESOURCE-BASED ORCHESTRATION FOR HARDWARE ACCELERATORS
- Publication number
- US20260329674A1
- Application number
- 19183573
- Filed
- Apr 18, 2025
- Published
- Oct 22, 2026
- Inventors
- 3
- Claims
- 20
Classified under
G06F 9/544 Physics & computingG06F 9/546 Physics & computingG06F 2209/548 Physics & computingG06T 1/20 Physics & computingG06T 1/60 Physics & computingMore from Nvidia in Chips & hardware
- Nvidia patents method to skip zero data in neural network math Oct 13, 2026
- Nvidia patents hardware to speed up motion blur in ray tracing Oct 13, 2026
- Nvidia patents method to sync data across split processor chips Sep 17, 2026
- Nvidia patents chip math trick to speed up AI calculations Oct 8, 2026
- Nvidia patents data center cooling that uses cryogenic fluids Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.