AmazonGranted patentAI & softwareInterest 6/10

Amazon patents AI tool to create product videos with moving backgrounds

Amazon describes a system that uses three separate machine learning models to turn static product photos into short videos. The software identifies parts of the item that can move, creates a new background around the product, and combines these elements to generate an animation.

Why it mattersThis could make online shopping more engaging by automatically adding motion to product listings without needing manual video editing.

In the filing’s own words

Embodiments described herein can involve generating videos depicting items with animated backgrounds using machine learning. In an example, a computer system can generate a first input based at least in part on an image of an item. The computer system can cause one or more processors to use a first machine learning model to generate an animation depicting the item based at least in part on the first input. The computer system can generate a second input based at least in part on the animation and the image of the item. The computer system can cause the one or more processors to use a second machine learning model to generate a video depicting the item with an animated background based at least in part on the second input.

What exactly they claim (claim 1)

1. A computer system, comprising: one or more processors; and one or more memories storing executable instructions that, upon execution by the one or more processors, cause the computer system to perform operations to: access item information using an item identifier associated with an item, the item information comprising an item image and an item description; determine an animatable element associated with the item information; generate, by at least using a first machine learning model, a positive prompt and a negative prompt associated with the item information and the animatable element; generate an item mask by at least removing a background from the item image; generate, by at least using a second machine learning model, an outpainted image with an outpainted background based at least in part on the item mask, the positive prompt, the negative prompt, and the animatable element; generate an animation of the outpainted image and a mask animation of the item mask; generate, by at least using a third machine learning model different from the first machine learning model and the second machine learning model, an animated item video that depicts the item with an animated background based at least in part on the animation of the outpainted image and the mask animation; and include, in a network document, a link to the animated item video such that the animated item video is presented in a presentation of the network document.

Facts

Company
Amazon (Amazon Technologies, Inc.)
Official title
Generating videos of items with animated backgrounds using machine learning
Patent number
US12793315B1
Application number
18676045
Filed
May 28, 2024
Granted
Nov 10, 2026
Inventors
6
Claims
20

Classified under

G06T 13/80 Physics & computingG06T 7/194 Physics & computing

More from Amazon in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.