Nvidia patents network cards that handle shared data updates
Nvidia describes a system where a network card processes specific data requests directly without waiting for the main computer's processor. It retrieves a number from shared memory, performs a quick calculation like adding or swapping it, and saves the result locally. This allows multiple computers to update the same piece of data without conflicting with each other.
In the filing’s own words
Systems and methods for atomic memory operations in a remote direct memory access network are disclosed. A system includes a network interface card (NIC) comprising a first memory and one or more processors coupled to the first memory. The one or more processors are to receive an atomic memory operation (AMO) remote procedure call (RPC) comprising a memory address and an AMO type. The one or more processors are further to retrieve a value corresponding to the memory address of the AMO RPC from a second memory. The one or more processors are further to perform an AMO corresponding to the AMO type on the value from the second memory to obtain a modified value. The one or more processors are further to store the modified value in the first memory.
What exactly they claim (claim 1)
1. A system comprising: data processing unit (DPU) associated with a network interface controller (NIC), the DPU comprising a first memory and one or more processors, coupled to the first memory, the one or more processors to: receive an atomic memory operation (AMO) remote procedure call (RPC) comprising a memory address associated with a second memory associated with one or more host processors and an AMO type; retrieve a value corresponding to the memory address of the AMO RPC from at least one of the first memory or the second memory; perform an AMO corresponding to the AMO type on the value from the second memory to obtain a modified value; and store the modified value in the first memory.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- Atomic memory operations
- Patent number
- US12761788B2
- Application number
- 18973733
- Filed
- Dec 9, 2024
- Granted
- Oct 13, 2026
- Inventors
- 5
- Claims
- 28
Classified under
G06F 3/0604 Physics & computingG06F 3/0638 Physics & computingG06F 3/067 Physics & computingG06F 9/547 Physics & computingMore from Nvidia in Chips & hardware
- Nvidia patents method to skip zero data in neural network math Oct 13, 2026
- Nvidia patents hardware to speed up motion blur in ray tracing Oct 13, 2026
- Nvidia patents method to sync data across split processor chips Sep 17, 2026
- Nvidia patents chip math trick to speed up AI calculations Oct 8, 2026
- Nvidia patents data center cooling that uses cryogenic fluids Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.