Samsung patents image processor that adjusts filters based on pixel context
Samsung describes an image processing system that uses a convolutional neural network to analyze images in specific groups of data channels. The system creates an "attention map" to identify important areas and then generates unique filters for each pixel based on its location and neighbors. These customized filters are applied to the original image to produce a refined output.
In the filing’s own words
An image processing apparatus for processing an image by using one or more convolutional neural networks includes a memory storing one or more instructions, and at least one processor configured to execute the one or more instructions stored in the memory to obtain first feature data by performing a convolution operation between input data obtained from a first image and a first kernel, divide a plurality of channels included in the first feature data into first groups, obtain second feature data by performing a convolution operation between the first feature data respectively corresponding to the first groups and second kernels respectively corresponding to the first groups, obtain shuffling data by shuffling the second feature data, obtain output data by performing a convolution operation between data obtained by summing channels included in the shuffling data and a third kernel, and generate a second image based on the output data.
What exactly they claim (claim 1)
1. An image processing apparatus for processing an image by using one or more convolutional neural networks, the image processing apparatus comprising: a memory storing one or more instructions; and at least one processor configured to execute the one or more instructions stored in the memory to: divide a plurality of channels included in input information obtained from a first image into first groups; obtain output data respectively corresponding to the first groups, based on input data respectively corresponding to the first groups by: obtaining first feature data based on a first convolution operation being performed between input data and a first kernel; dividing a plurality of channels included in the first feature data into second groups; obtaining second feature data based on a second convolution operation being performed between the first feature data respectively corresponding to the second groups and second kernels respectively corresponding to the second groups; obtaining shuffling data by shuffling the second feature data; and obtaining the output data by performing a convolution operation between data obtained by concatenating channels included in the shuffling data and a third kernel, obtain output information corresponding to the input information, by summing channels included in the output data respectively corresponding to the first groups; obtain third feature data based on a third convolution operation being performed between the output information and a fourth kernel; divide a plurality of channels included in the third feature data into the first groups; obtain fourth feature data based on a fourth convolution operation being performed between the third feature data respectively corresponding to the first groups and fifth kernels respectively corresponding to the first groups; divide a plurality of channels included in the fourth feature data into the second groups and obtain second shuffling data by shuffling the fourth feature data respectively corresponding to the second groups; obtain fifth feature data based on a fifth convolution operation being performed between the second shuffling data and sixth kernels respectively corresponding to the second groups; obtain sixth feature data respectively corresponding to the first groups by summing channels included in the fifth feature data; generate an attention map including weight information corresponding to each of a plurality of pixels included in the first image, based on the sixth feature data; generate a spatially variable kernel corresponding to each of the plurality of pixels, based on the attention map and a spatial kernel including weight information according to a position relationship between each of the plurality of pixels and at least one neighboring pixel of each of the plurality of pixels; and generate a second image by applying the spatially variable kernel to the first image.
Facts
- Company
- Samsung (SAMSUNG ELECTRONICS CO., LTD.)
- Official title
- Image processing apparatus using convolutional neural networks and operating method thereof
- Patent number
- US12731369B2
- Application number
- 18072050
- Filed
- Nov 30, 2022
- Granted
- Sep 8, 2026
- Inventors
- 6
- Claims
- 11
Classified under
G06V 10/454 Physics & computingG06V 10/22 Physics & computingMore from Samsung in AI & software
- Samsung patents tool to erase objects from photos using AI Sep 24, 2026
- Samsung patents drawing objects into photos with AI Oct 15, 2026
- Samsung patents AI that creates personalized exercise videos Sep 10, 2026
- Samsung patents AI summaries for paused TV shows based on your viewing habits Sep 24, 2026
- Samsung patents turning chat conversations into image prompts Oct 1, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.