/Patent Tracker
SamsungGranted patentAI & softwareInterest 6/10

Samsung patents image processor that adjusts filters based on pixel context

Samsung describes an image processing system that uses a convolutional neural network to analyze images in specific groups of data channels. The system creates an "attention map" to identify important areas and then generates unique filters for each pixel based on its location and neighbors. These customized filters are applied to the original image to produce a refined output.

Why it mattersThis technique could help improve the quality of photos or videos processed by Samsung devices by allowing the software to focus more precisely on specific details in an image.

In the filing’s own words

An image processing apparatus for processing an image by using one or more convolutional neural networks includes a memory storing one or more instructions, and at least one processor configured to execute the one or more instructions stored in the memory to obtain first feature data by performing a convolution operation between input data obtained from a first image and a first kernel, divide a plurality of channels included in the first feature data into first groups, obtain second feature data by performing a convolution operation between the first feature data respectively corresponding to the first groups and second kernels respectively corresponding to the first groups, obtain shuffling data by shuffling the second feature data, obtain output data by performing a convolution operation between data obtained by summing channels included in the shuffling data and a third kernel, and generate a second image based on the output data.

What exactly they claim (claim 1)

1. An image processing apparatus for processing an image by using one or more convolutional neural networks, the image processing apparatus comprising: a memory storing one or more instructions; and at least one processor configured to execute the one or more instructions stored in the memory to: divide a plurality of channels included in input information obtained from a first image into first groups; obtain output data respectively corresponding to the first groups, based on input data respectively corresponding to the first groups by: obtaining first feature data based on a first convolution operation being performed between input data and a first kernel; dividing a plurality of channels included in the first feature data into second groups; obtaining second feature data based on a second convolution operation being performed between the first feature data respectively corresponding to the second groups and second kernels respectively corresponding to the second groups; obtaining shuffling data by shuffling the second feature data; and obtaining the output data by performing a convolution operation between data obtained by concatenating channels included in the shuffling data and a third kernel, obtain output information corresponding to the input information, by summing channels included in the output data respectively corresponding to the first groups; obtain third feature data based on a third convolution operation being performed between the output information and a fourth kernel; divide a plurality of channels included in the third feature data into the first groups; obtain fourth feature data based on a fourth convolution operation being performed between the third feature data respectively corresponding to the first groups and fifth kernels respectively corresponding to the first groups; divide a plurality of channels included in the fourth feature data into the second groups and obtain second shuffling data by shuffling the fourth feature data respectively corresponding to the second groups; obtain fifth feature data based on a fifth convolution operation being performed between the second shuffling data and sixth kernels respectively corresponding to the second groups; obtain sixth feature data respectively corresponding to the first groups by summing channels included in the fifth feature data; generate an attention map including weight information corresponding to each of a plurality of pixels included in the first image, based on the sixth feature data; generate a spatially variable kernel corresponding to each of the plurality of pixels, based on the attention map and a spatial kernel including weight information according to a position relationship between each of the plurality of pixels and at least one neighboring pixel of each of the plurality of pixels; and generate a second image by applying the spatially variable kernel to the first image.

Facts

Company
Samsung (SAMSUNG ELECTRONICS CO., LTD.)
Official title
Image processing apparatus using convolutional neural networks and operating method thereof
Patent number
US12731369B2
Application number
18072050
Filed
Nov 30, 2022
Granted
Sep 8, 2026
Inventors
6
Claims
11

Classified under

G06V 10/454 Physics & computingG06V 10/22 Physics & computing

More from Samsung in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.