Samsung patents method to fix errors in simplified AI calculations
This patent describes a way to make artificial neural networks run more efficiently by simplifying their math. It calculates a specific correction value, or bias, to offset the small errors that happen when data is rounded down to save space.
In the filing’s own words
The computing system includes a neural network system configured to drive an artificial neural network (ANN); and a quantization system configured to quantize the ANN, wherein the quantization system is further configured to quantize parameters of the ANN to generate the quantized parameters of the ANN, generate a quantization error of the parameters of the ANN based on the parameters of the ANN and the quantized parameters, generate a compensation bias based on the quantized parameters and the quantization error of the parameters of the ANN, and transmit the generated quantized parameters and the compensation bias to the neural network system.
What exactly they claim (claim 1)
1. A computing system comprising: a neural network system configured to drive an artificial neural network (ANN); and a quantization system configured to quantize the ANN, wherein the quantization system is configured to quantize parameters of the ANN to generate quantized parameters of the ANN, generate a quantization error of the parameters of the ANN based on the parameters of the ANN and the quantized parameters, generate a compensation bias based on the quantized parameters and the quantization error of the parameters of the ANN, and transmit the quantized parameters and the compensation bias to the neural network system, wherein the parameters of the ANN comprise a weight and a bias of the ANN and the quantized parameters include a quantized weight and a quantized bias, wherein the compensation bias is based on a result of at least one of a second multiply-accumulate (MAC) operation or a result of a third MAC operation, wherein the second MAC operation includes a reference sample and a quantization error of the weight as inputs and the third MAC operation includes a quantization error of the reference sample and the quantized weight as inputs, and wherein the neural network system is configured to receive a quantized input sample, receive the quantized parameters transmitted from the quantization system, receive the generated compensation bias transmitted from the quantization system, perform a first MAC operation based on the quantized input sample and the quantized parameters as inputs to the ANN, and generate a final operation result by applying the compensation bias to a result of the first MAC operation.
Facts
- Company
- Samsung (Samsung Electronics Co., Ltd.)
- Official title
- Quantization method of artificial neural network and operation method using artificial neural network
- Patent number
- US12743612B2
- Application number
- 17014158
- Filed
- Sep 8, 2020
- Granted
- Sep 22, 2026
- Inventors
- 3
- Claims
- 19
Classified under
G06N 3/08 Physics & computingG06N 3/04 Physics & computingMore from Samsung in AI & software
- Samsung patents tool to erase objects from photos using AI Sep 24, 2026
- Samsung patents drawing objects into photos with AI Oct 15, 2026
- Samsung patents AI that creates personalized exercise videos Sep 10, 2026
- Samsung patents AI summaries for paused TV shows based on your viewing habits Sep 24, 2026
- Samsung patents turning chat conversations into image prompts Oct 1, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.