NvidiaGranted patentChips & hardwareInterest 3/10

Nvidia patents API for moving data between memory locations

Patent drawing
Patent drawing from the official filing.

Nvidia describes a software interface that helps computer chips move large blocks of data from one memory area to another. It includes a system to track how much data is being moved so the computer knows when the task is finished.

Why it mattersThis is a technical improvement for managing data flow in high-performance computing, which is mostly relevant to engineers building advanced processors.

In the filing’s own words

Apparatuses, systems, and techniques to transform information corresponding to one or more memory transactions. In at least one embodiment, one or more circuits are to perform an application programming interface (API) to cause information corresponding to one or more memory transactions resulting from performance of the API to be transformed.

What exactly they claim (claim 1)

1. One or more processors, comprising: circuitry to, in response to an application programming interface (API) call, cause one or more memory transactions to asynchronously transform a first tensor into a different second tensor, wherein the API is to receive one or more source memory locations and one or more destination memory locations for the one or more memory transactions and to provide one or more functions to perform manual transaction accounting for the one or more memory transactions, and wherein the manual transaction accounting comprises updating an expected transaction count of a synchronization object based, at least in part, on an amount of data to be moved by the one or more memory transactions.

Facts

Company
Nvidia (NVIDIA Corporation)
Official title
Application programming interface to transform information corresponding to a memory transaction
Patent number
US12801384B2
Application number
18086433
Filed
Dec 21, 2022
Granted
Nov 17, 2026
Inventors
12
Claims
20

Classified under

G06F 9/30047 Physics & computingG06F 12/0862 Physics & computingG06T 1/20 Physics & computingG06F 3/0625 Physics & computingG06F 17/16 Physics & computingG06F 2212/608 Physics & computing

More from Nvidia in Chips & hardware

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.