MicrosoftGranted patentChips & hardwareInterest 4/10

Microsoft patents chip design that shares data between math units

Patent drawing
Patent drawing from the official filing.

Microsoft has been granted a patent for a specific layout of a computer chip component called a multiply-accumulator array. This design includes a shared memory area, or cache, that stores pieces of input data. By allowing different math units to access the same stored data, the chip can process information more efficiently without moving data around as much.

Why it mattersThis is a detailed engineering improvement for how processors handle data, which could lead to slightly more efficient chips for tasks like image processing or machine learning, though it is not a consumer-facing feature.

In the filing’s own words

Embodiments of the present disclosure include a multiply-accumulator (MAC) array circuit comprising an activation cache and a plurality of multiply-accumulator (MA) groups. The activation cache comprises cache lines configured to store sub-slices of an input activation array. The cache lines are coupled to particular MA groups. Activations stored in the cache lines may be used and reused across multiple MA groups.

What exactly they claim (claim 1)

1. A multiply-accumulator array circuit comprising: a plurality of multiply-accumulator circuit groups, the multiply-accumulator circuit groups comprising a plurality of multiplier circuits; and an activation cache circuit, the activation cache circuit configured to receive at least one sub-slice of activations from an input activation array, the activation cache circuit comprising a plurality of cache lines coupled to the plurality of multiply-accumulator circuit groups, the plurality of cache lines configured to store spatially local activations from the at least one sub-slice of activations, wherein the plurality of cache lines include a plurality of shared cache lines, wherein each shared cache line of the plurality of shared cache lines is coupled to two or more multiply-accumulator circuit groups of the plurality of multiply-accumulator circuit groups, wherein each of the plurality of multiply-accumulator circuit groups is coupled to a unique subset of the plurality of shared cache lines, wherein each of the plurality of multiply-accumulator circuit groups produce an output corresponding to a particular shared cache line of its respective unique subset, and wherein a particular multiply-accumulator circuit group is coupled to a portion of the plurality of cache lines comprising spatially local activations from the at least one sub-slice of activations, including at least one of the plurality of shared cache lines as at least one other multiply-accumulator circuit group, to process the spatially local activations from the at least one sub-slice of activations and generate a portion of an output array.

Facts

Company
Microsoft (Microsoft Technology Licensing, LLC)
Official title
Multiply-accumulator array circuit with activation cache
Patent number
US12801346B2
Application number
17590798
Filed
Feb 1, 2022
Granted
Nov 17, 2026
Inventors
2
Claims
20

Classified under

G06F 7/5443 Physics & computing

More from Microsoft in Chips & hardware

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.