Microsoft patents chip design that shares data between math units
Microsoft has been granted a patent for a specific layout of a computer chip component called a multiply-accumulator array. This design includes a shared memory area, or cache, that stores pieces of input data. By allowing different math units to access the same stored data, the chip can process information more efficiently without moving data around as much.
In the filing’s own words
Embodiments of the present disclosure include a multiply-accumulator (MAC) array circuit comprising an activation cache and a plurality of multiply-accumulator (MA) groups. The activation cache comprises cache lines configured to store sub-slices of an input activation array. The cache lines are coupled to particular MA groups. Activations stored in the cache lines may be used and reused across multiple MA groups.
What exactly they claim (claim 1)
1. A multiply-accumulator array circuit comprising: a plurality of multiply-accumulator circuit groups, the multiply-accumulator circuit groups comprising a plurality of multiplier circuits; and an activation cache circuit, the activation cache circuit configured to receive at least one sub-slice of activations from an input activation array, the activation cache circuit comprising a plurality of cache lines coupled to the plurality of multiply-accumulator circuit groups, the plurality of cache lines configured to store spatially local activations from the at least one sub-slice of activations, wherein the plurality of cache lines include a plurality of shared cache lines, wherein each shared cache line of the plurality of shared cache lines is coupled to two or more multiply-accumulator circuit groups of the plurality of multiply-accumulator circuit groups, wherein each of the plurality of multiply-accumulator circuit groups is coupled to a unique subset of the plurality of shared cache lines, wherein each of the plurality of multiply-accumulator circuit groups produce an output corresponding to a particular shared cache line of its respective unique subset, and wherein a particular multiply-accumulator circuit group is coupled to a portion of the plurality of cache lines comprising spatially local activations from the at least one sub-slice of activations, including at least one of the plurality of shared cache lines as at least one other multiply-accumulator circuit group, to process the spatially local activations from the at least one sub-slice of activations and generate a portion of an output array.
Facts
- Company
- Microsoft (Microsoft Technology Licensing, LLC)
- Official title
- Multiply-accumulator array circuit with activation cache
- Patent number
- US12801346B2
- Application number
- 17590798
- Filed
- Feb 1, 2022
- Granted
- Nov 17, 2026
- Inventors
- 2
- Claims
- 20
Classified under
G06F 7/5443 Physics & computingMore from Microsoft in Chips & hardware
- Microsoft patents DNA builder that adds bases in a chosen order Nov 10, 2026
- Microsoft patents chips with liquid cooling built inside Oct 1, 2026
- Microsoft patents light-based math for faster computing Oct 29, 2026
- Microsoft patents chip design that guesses code steps ahead Sep 8, 2026
- Microsoft patents 3D glass storage using laser light patterns Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
