/Patent Tracker
SamsungGranted patentAI & softwareInterest 6/10

Samsung patents video editing method to remove objects from moving footage

Samsung describes a method for electronic devices to remove specific objects from video clips. The system breaks the video into frames, creates a digital map of visual features, and uses a mask to identify the object to be deleted. It then blends information from neighboring frames to fill in the gaps left by the removed object.

Why it mattersThis technology could improve video editing tools by allowing users to erase unwanted items from moving videos more smoothly.

In the filing’s own words

A method performed by an electronic apparatus, includes: determining a local frame sequence from a video; obtaining a feature map sequence of the local frame sequence by encoding the local frame sequence; determining a feature flow sequence of the local frame sequence based on the feature map sequence of the local frame sequence and a mask image sequence regarding an object to be removed, the mask image sequence being corresponding to the feature map sequence; obtaining an updated feature map sequence of the local frame sequence, by performing, based on the feature flow sequence, feature fusion between adjacent feature maps in the feature map sequence; and obtaining a processed local frame sequence, by decoding the updated feature map sequence of the local frame sequence.

What exactly they claim (claim 1)

1. A method performed by an electronic apparatus, comprising: determining a local frame sequence from a video; obtaining a feature map sequence of the local frame sequence by encoding the local frame sequence; determining a feature flow sequence of the local frame sequence based on the feature map sequence of the local frame sequence and a mask image sequence regarding an object to be removed, the mask image sequence being corresponding to the feature map sequence; obtaining an updated feature map sequence of the local frame sequence, by performing, based on the feature flow sequence, feature fusion between adjacent feature maps in the feature map sequence; and obtaining a processed local frame sequence, by decoding the updated feature map sequence of the local frame sequence, wherein the determining the feature flow sequence of the local frame sequence based on the feature map sequence of the local frame sequence and the mask image sequence regarding the object to be removed comprises: determining an occlusion mask image sequence and the feature flow sequence of the local frame sequence based on the feature map sequence of the local frame sequence and the mask image sequence regarding the object to be removed, and wherein the obtaining the updated feature map sequence of the local frame sequence comprises: performing the feature fusion between adjacent feature maps in the feature map sequence based on the occlusion mask image sequence, the feature flow sequence, and the mask image sequence regarding the object to be removed.

Facts

Company
Samsung (SAMSUNG ELECTRONICS CO., LTD.)
Official title
Method performed by electronic apparatus, electronic apparatus and storage medium for video processing based on feature map
Patent number
US12749297B2
Application number
18368921
Filed
Sep 15, 2023
Granted
Sep 29, 2026
Inventors
7
Claims
19

Classified under

G06V 10/806 Physics & computingG06T 7/194 Physics & computingG06V 10/267 Physics & computing

More from Samsung in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.