/Patent Tracker
AmazonGranted patentAI & softwareInterest 7/10

Amazon patents ML tool to add graphics to live sports from moving cameras

Amazon has patented a method that uses machine learning to place digital graphics onto live video feeds of events. The system tracks specific points on a playing surface and calculates their position and visibility in each frame, even when the camera is moving in three dimensions.

Why it mattersThis technology could make it easier to add accurate, real-time data overlays to live sports broadcasts without manual adjustment for every camera angle.

In the filing’s own words

Techniques for providing graphic overlays on live videos using a machine learning (ML) model are described. According to some examples, a computer-implemented method includes receiving, at an on-site production service, a live stream of an event; generating, by a machine learning model of the on-site production service, a first inference of a first set of surface-anchored coordinates for a plurality of points of a playing surface of the event in a first frame of the live stream, and a first set of visibility probabilities for the plurality of points; generating, by the machine learning model of the on-site production service, a second inference of a second set of surface-anchored coordinates for at least one of the plurality of points of the playing surface of the event in a second frame of the live stream, and a second visibility probability for the at least one of the plurality of points; and inserting, by the on-site production service, a graphic into the first frame and the second frame of the live stream based at least in part on the first inference of the first set of surface-anchored coordinates for the plurality of points of the playing surface of the event in the first frame, and the second inference of the second set of surface-anchored coordinates for the at least one of the plurality of points of the playing surface of the event in the second frame.

What exactly they claim (claim 1)

1. A computer-implemented method comprising: receiving, at an on-site production service, a live stream of an event; generating, by a machine learning model of the on-site production service, a first inference of a first set of surface-anchored coordinates for a plurality of points of a playing surface of the event in a first frame of the live stream, and a first set of visibility probabilities for the plurality of points; generating, by the machine learning model of the on-site production service, a second inference of a second set of surface-anchored coordinates for at least one of the plurality of points of the playing surface of the event in a second frame of the live stream, and a second visibility probability for the at least one of the plurality of points; and inserting, by the on-site production service, a graphic into the first frame and the second frame of the live stream based at least in part on the first inference of the first set of surface-anchored coordinates for the plurality of points of the playing surface of the event in the first frame, and the second inference of the second set of surface-anchored coordinates for the at least one of the plurality of points of the playing surface of the event in the second frame, wherein the live stream is from a three-dimensionally movable camera, and a location of the three-dimensionally movable camera that generates the first frame is different in each of three-dimensions from a location of the three-dimensionally movable camera that generates the second frame.

Facts

Company
Amazon (Amazon Technologies, Inc.)
Official title
Computer-implemented methods for providing graphic overlays on live videos using a machine learning model
Patent number
US12739464B1
Application number
18528568
Filed
Dec 4, 2023
Granted
Sep 15, 2026
Inventors
10
Claims
20

Classified under

H04N 21/4316 Electricity & electronicsG06V 10/25 Physics & computingH04N 21/2187 Electricity & electronics
Read the full filing (official PDF) ↗ Open in the Patent Tracker

More from Amazon in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.