AmazonGranted patentChips & hardwareInterest 6/10

Amazon patents chip design that simplifies math for AI tasks

Amazon has patented a specific circuit design for running artificial intelligence models on hardware. The design limits the numbers used in calculations to just five simple options, allowing the chip to use basic adders and switches instead of complex multipliers to process data.

Why it mattersThis approach could lead to more energy-efficient processors for running AI, which is a key focus for cloud providers trying to reduce data center costs.

In the filing’s own words

Some embodiments provide a neural network inference circuit (NNIC) for executing a neural network. The NNIC includes a set of circuits to compute a dot product of a set of inputs and a set of predefined weights. Each weight is one of a positive value, twice the positive value, the negation of the positive value, twice the negation of the positive value, and the value zero. The set of circuits includes an adder tree circuit to (i) receive at least a subset of the inputs, (ii) apply a negation factor to received inputs with negative corresponding weights, and (iii) add together the received inputs with the negation factors. The set of circuits includes, for each input of the subset of inputs, a circuit to configurably double the input when the weight corresponding to the input is either twice the positive value or twice the negation of the positive value.

What exactly they claim (claim 1)

1. A neural network inference circuit for executing a neural network, the neural network inference circuit comprising: a set of circuits to compute a dot product of (i) a set of input values for a computation node of the neural network and (ii) a set of predefined weight values for the computation node, wherein each weight value in the set of predefined weight values for the computation node comprises one of a positive value, twice the positive value, a negation of the positive value, twice the negation of the positive value, and the value zero, wherein the set of circuits comprises: an adder tree circuit to (i) receive at least a subset of the input values, (ii) apply a negation factor to received input values with negative corresponding weight values, and (iii) add together the received input values with the negation factors; and for each input value of the subset of input values, a circuit to configurably double the input value when the weight value corresponding to the input value is either twice the positive value or twice the negation of the positive value.

Facts

Company
Amazon (Amazon Technologies, Inc.)
Official title
Dot product computation circuits for handling quinary weights
Patent number
US12792895B1
Application number
18416265
Filed
Jan 18, 2024
Granted
Nov 10, 2026
Inventors
3
Claims
20

Classified under

G06N 3/063 Physics & computingG06F 7/523 Physics & computingG06N 3/0464 Physics & computing

More from Amazon in Chips & hardware

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.