Amazon patents AI tool to create product videos with moving backgrounds
Amazon describes a system that uses three separate machine learning models to turn static product photos into short videos. The software identifies parts of the item that can move, creates a new background around the product, and combines these elements to generate an animation.
In the filing’s own words
Embodiments described herein can involve generating videos depicting items with animated backgrounds using machine learning. In an example, a computer system can generate a first input based at least in part on an image of an item. The computer system can cause one or more processors to use a first machine learning model to generate an animation depicting the item based at least in part on the first input. The computer system can generate a second input based at least in part on the animation and the image of the item. The computer system can cause the one or more processors to use a second machine learning model to generate a video depicting the item with an animated background based at least in part on the second input.
What exactly they claim (claim 1)
1. A computer system, comprising: one or more processors; and one or more memories storing executable instructions that, upon execution by the one or more processors, cause the computer system to perform operations to: access item information using an item identifier associated with an item, the item information comprising an item image and an item description; determine an animatable element associated with the item information; generate, by at least using a first machine learning model, a positive prompt and a negative prompt associated with the item information and the animatable element; generate an item mask by at least removing a background from the item image; generate, by at least using a second machine learning model, an outpainted image with an outpainted background based at least in part on the item mask, the positive prompt, the negative prompt, and the animatable element; generate an animation of the outpainted image and a mask animation of the item mask; generate, by at least using a third machine learning model different from the first machine learning model and the second machine learning model, an animated item video that depicts the item with an animated background based at least in part on the animation of the outpainted image and the mask animation; and include, in a network document, a link to the animated item video such that the animated item video is presented in a presentation of the network document.
Facts
- Company
- Amazon (Amazon Technologies, Inc.)
- Official title
- Generating videos of items with animated backgrounds using machine learning
- Patent number
- US12793315B1
- Application number
- 18676045
- Filed
- May 28, 2024
- Granted
- Nov 10, 2026
- Inventors
- 6
- Claims
- 20
Classified under
G06T 13/80 Physics & computingG06T 7/194 Physics & computingMore from Amazon in AI & software
- Amazon patents system that cites sources for AI answers Sep 29, 2026
- Amazon patents voice assistants that adjust personality based on your mood Nov 3, 2026
- Amazon patents tech to swap words in movies using actor's voice Sep 8, 2026
- Amazon patents ML tool to add graphics to live sports from moving cameras Sep 15, 2026
- Amazon patents shopping assistant that remembers your search filters Oct 6, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.