Nvidia patents method to split neural network tasks across chips
Nvidia describes a technique to speed up the final step of running AI models by copying data from one layer of the network to another computing resource. The system splits the work so that different parts of the neural network run on separate hardware units simultaneously.
In the filing’s own words
Apparatuses, systems, and techniques are described herein to speed up inferencing in a neural network by copying output from one layer of the neural network to another computing resource based on dependencies among layers in the network. In at least one embodiment, a processor comprising one or more circuits causes two or more subsequent layers of one or more neural networks to be performed on separate computing resources from a previous layer of the one or more neural networks.
What exactly they claim (claim 1)
1 - 20. (canceled)
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- TECHNIQUES FOR MODIFYING AND TRAINING A NEURAL NETWORK
- Publication number
- US20260268651A1
- Application number
- 19561382
- Filed
- Mar 9, 2026
- Published
- Sep 10, 2026
- Inventors
- 5
- Claims
- 21
Classified under
G06V 10/94 Physics & computingG06F 9/3877 Physics & computingG06F 18/214 Physics & computingG06N 3/04 Physics & computingG06N 3/08 Physics & computingG06T 7/0012 Physics & computingMore from Nvidia in Chips & hardware
- Nvidia patents method to skip zero data in neural network math Oct 13, 2026
- Nvidia patents hardware to speed up motion blur in ray tracing Oct 13, 2026
- Nvidia patents method to sync data across split processor chips Sep 17, 2026
- Nvidia patents chip math trick to speed up AI calculations Oct 8, 2026
- Nvidia patents data center cooling that uses cryogenic fluids Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.