Nvidia patents chip design that runs math near memory
Nvidia describes a method where a processor located next to memory handles specific math tasks called tensor operations. Instead of sending data back to a main processor, this nearby chip performs the calculations and writes the results directly to the memory.
In the filing’s own words
One embodiment of a method for processing data includes receiving, by a first processor, first data from a first request transmitted by a second processor to a memory; performing, by the first processor, at least part of a tensor operation based on the first data and second data stored in the memory to generate a first output; and writing, by the first processor, the first output to the memory, where the first processor performs processing closer to the memory than the second processor performs processing.
What exactly they claim (claim 1)
1. A computer-implemented method for processing data, the method comprising: receiving, by a first processor, first data from a first request transmitted by a second processor to a memory; performing, by the first processor, at least part of a tensor operation based on the first data and second data stored in the memory to generate a first output; and writing, by the first processor, the first output to the memory, wherein the first processor performs processing closer to the memory than the second processor performs processing.
Facts
- Company
- Nvidia (NVIDIA CORPORATION)
- Official title
- TECHNIQUES FOR PERFORMING TENSOR OPERATIONS USING A NEAR-MEMORY PROCESSOR
- Publication number
- US20260267535A1
- Application number
- 19070236
- Filed
- Mar 4, 2025
- Published
- Sep 10, 2026
- Inventors
- 3
- Claims
- 20
Classified under
G06F 3/0625 Physics & computingG06F 3/0659 Physics & computingG06F 3/0673 Physics & computingMore from Nvidia in Chips & hardware
- Nvidia patents method to skip zero data in neural network math Oct 13, 2026
- Nvidia patents hardware to speed up motion blur in ray tracing Oct 13, 2026
- Nvidia patents method to sync data across split processor chips Sep 17, 2026
- Nvidia patents chip math trick to speed up AI calculations Oct 8, 2026
- Nvidia patents data center cooling that uses cryogenic fluids Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.