NvidiaGranted patentChips & hardwareInterest 3/10

Nvidia patents chip method for storing math results in specific memory spots

Nvidia describes a way for processors to handle complex math tasks called matrix multiply-accumulate operations. The system saves the results of these calculations in a specific, dedicated part of memory to ensure they are ready for the next step.

Why it mattersThis improves how computer chips handle heavy data tasks, which is useful for anyone interested in how graphics cards and AI processors work under the hood.

In the filing’s own words

Apparatuses, systems, and techniques to perform a matrix multiply-accumulate (MMA) instruction to exclusively store information to be used by the MMA instruction. In at least one embodiment, a processor retrieves matrix information from a memory that exclusively stores and performs a multiplication computation using said matrix information.

What exactly they claim (claim 1)

1. One or more processors, comprising: circuitry to: perform a matrix multiply accumulate (MMA) instruction to exclusively store in a specific location of memory one or more results generated as a result of performing the MMA instruction; and use a single cooperative thread array of a single processor core to control a plurality of processor cores to perform the MMA instruction based, at least in part, on an instruction that identifies an operating mode.

Facts

Company: Nvidia (NVIDIA Corporation)
Official title: Storing information for matrix multiply-accumulate operations
Patent number: US12730633B1
Application number: 18819921
Filed: Aug 29, 2024
Granted: Sep 8, 2026
Inventors: 8
Claims: 20

Classified under

G06F 9/3001 Physics & computingG06F 9/30036 Physics & computingG06F 9/3887 Physics & computingG06F 9/3893 Physics & computingG06F 7/5443 Physics & computingG06F 17/16 Physics & computing

Read the full filing (official PDF) ↗ Open in the Patent Tracker

More from Nvidia in Chips & hardware

Nvidia patents method to skip zero data in neural network math Oct 13, 2026
Nvidia patents hardware to speed up motion blur in ray tracing Oct 13, 2026
Nvidia patents method to sync data across split processor chips Sep 17, 2026
Nvidia patents chip math trick to speed up AI calculations Oct 8, 2026
Nvidia patents data center cooling that uses cryogenic fluids Oct 15, 2026

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.