/Patent Tracker
SamsungPatent applicationAI & softwareInterest 6/10

Samsung patents turning text into video using key point tracking

Samsung describes a method for creating video clips from written descriptions by first converting the text into a mathematical format. A diffusion model then predicts the movement of specific points in the scene, which are mapped to images to build the final video frames.

Why it mattersThis approach could make it easier for creators to generate short video clips from simple text prompts without manually animating every frame.

In the filing’s own words

A method of generating a video clip from a text description is provided. The method may include receiving the text description of the video clip to be generated. The method may include obtaining, based on the received text description, a vector representation of the text description. The method may include obtaining a vector representation of a sequence of key points of the video clip to be generated, by a diffusion motion model based on the obtained vector representation of the text description. The method may include mapping the vector representation of the sequence of key points to a series of key point images of the video clip being generated, wherein each key point image from the series corresponding to a respective frame of the video clip being generated. The method may include generating a frame sequence of the video clip.

What exactly they claim (claim 1)

1. A method of generating a video clip from a text description, the method comprising: receiving the text description of the video clip to be generated, obtaining, based on the received text description, a vector representation of the text description, obtaining a vector representation of a sequence of key points of the video clip to be generated, by a diffusion motion model based on the obtained vector representation of the text description, mapping the vector representation of the sequence of key points to a series of key point images of the video clip being generated, wherein each key point image from the series corresponding to a respective frame of the video clip being generated, and generating a frame sequence of the video clip.

Facts

Company
Samsung (SAMSUNG ELECTRONICS CO., LTD.)
Official title
METHOD AND DEVICE FOR GENERATING VIDEO CLIP BASED ON TEXT DESCRIPTION AND SEQUENCE OF KEY POINTS SYNTHESIZED BY DIFFUSION MODEL
Publication number
US20260260396A1
Application number
19659362
Filed
Apr 27, 2026
Published
Sep 3, 2026
Inventors
6
Claims
20

Classified under

G06T 11/00 Physics & computingG06T 7/70 Physics & computingG06T 2207/20084 Physics & computing
Read the full filing (official PDF) ↗ Open in the Patent Tracker

More from Samsung in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.