Nvidia patents hardware that helps move data between chips in a processor
Nvidia describes a hardware feature for multi-chip processors that tracks which parts of the system are using specific memory locations. This tracking allows the computer to automatically move data between different memory areas when needed, improving efficiency.
In the filing’s own words
A hardware mechanism at each dielet of a multi-dielet processing system is aware of engine page-table binds at all the dielets, thereby providing accurate traffic notifications to software (e.g., a unified virtual memory driver) for on-demand page-migration between system memory and GPU memory. The mechanism broadcasts binding information to access counters on each dielet so the access counters are able to correlate engines requesting memory access with bound virtual memory pages and generate corresponding informative notifications. A flexible multi-dielet counter clear capability enables software to clear access counters.
What exactly they claim (claim 1)
1. A multi-chip module comprising: at least one input/output port; a first memory management unit (MMU) configured to exchange memory binding information with a second MMU on another multi-chip module; and an access counter circuit operatively coupled to the first MMU, the access counter circuit tracking memory accesses performed through the at least one input/output port and selectively generating notifications for use in memory page migration; wherein the access counter circuit is configured to track memory accesses originating from an engine disposed on another multi-chip module.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- Hardware assisted Page Migration in a Multi-Dielet Processing System
- Publication number
- US20260277809A1
- Application number
- 19667589
- Filed
- May 4, 2026
- Published
- Sep 17, 2026
- Inventors
- 6
- Claims
- 13
Classified under
G06F 12/0833 Physics & computingG06F 12/0882 Physics & computingMore from Nvidia in Chips & hardware
- Nvidia patents method to skip zero data in neural network math Oct 13, 2026
- Nvidia patents hardware to speed up motion blur in ray tracing Oct 13, 2026
- Nvidia patents method to sync data across split processor chips Sep 17, 2026
- Nvidia patents chip math trick to speed up AI calculations Oct 8, 2026
- Nvidia patents data center cooling that uses cryogenic fluids Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.