Amazon patents chip design that simplifies math for AI tasks
Amazon has patented a specific circuit design for running artificial intelligence models on hardware. The design limits the numbers used in calculations to just five simple options, allowing the chip to use basic adders and switches instead of complex multipliers to process data.
In the filing’s own words
Some embodiments provide a neural network inference circuit (NNIC) for executing a neural network. The NNIC includes a set of circuits to compute a dot product of a set of inputs and a set of predefined weights. Each weight is one of a positive value, twice the positive value, the negation of the positive value, twice the negation of the positive value, and the value zero. The set of circuits includes an adder tree circuit to (i) receive at least a subset of the inputs, (ii) apply a negation factor to received inputs with negative corresponding weights, and (iii) add together the received inputs with the negation factors. The set of circuits includes, for each input of the subset of inputs, a circuit to configurably double the input when the weight corresponding to the input is either twice the positive value or twice the negation of the positive value.
What exactly they claim (claim 1)
1. A neural network inference circuit for executing a neural network, the neural network inference circuit comprising: a set of circuits to compute a dot product of (i) a set of input values for a computation node of the neural network and (ii) a set of predefined weight values for the computation node, wherein each weight value in the set of predefined weight values for the computation node comprises one of a positive value, twice the positive value, a negation of the positive value, twice the negation of the positive value, and the value zero, wherein the set of circuits comprises: an adder tree circuit to (i) receive at least a subset of the input values, (ii) apply a negation factor to received input values with negative corresponding weight values, and (iii) add together the received input values with the negation factors; and for each input value of the subset of input values, a circuit to configurably double the input value when the weight value corresponding to the input value is either twice the positive value or twice the negation of the positive value.
Facts
- Company
- Amazon (Amazon Technologies, Inc.)
- Official title
- Dot product computation circuits for handling quinary weights
- Patent number
- US12792895B1
- Application number
- 18416265
- Filed
- Jan 18, 2024
- Granted
- Nov 10, 2026
- Inventors
- 3
- Claims
- 20
Classified under
G06N 3/063 Physics & computingG06F 7/523 Physics & computingG06N 3/0464 Physics & computingMore from Amazon in Chips & hardware
- Amazon patents magnetic liquid that reshapes cooling paths for chips Nov 10, 2026
- Amazon patents using metal frames to send data between devices Sep 1, 2026
- Amazon patents flexible mat that detects when items are placed or removed Sep 15, 2026
- Amazon patents hardware chip that watches memory for security threats Sep 29, 2026
- Amazon patents chip design that simplifies AI math steps Oct 13, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.