/Patent Tracker
NvidiaGranted patentAI & softwareInterest 6/10

Nvidia patents video system that spots actions using motion data

Nvidia describes a method for video analysis that identifies specific actions by tracking how objects move between frames. The system uses a neural network to classify these movements after cropping the video to focus only on the relevant objects.

Why it mattersThis technique could make security cameras or smart devices better at understanding what people are doing in real-time without needing massive amounts of processing power.

In the filing’s own words

Apparatuses, systems, and techniques to perform action recognition. In at least one embodiment, action recognition is performed using one or more neural networks and hardware accelerators, in which the one or more neural networks are processed based on, for example, one or more quantization and pruning processes.

What exactly they claim (claim 1)

1. A method, comprising: obtaining a plurality of frames of a video; determining one or more objects represented in the plurality of frames; causing a parallel processing unit to calculate a flow field representing movements of the one or more objects represented in one or more pixels among frames of the plurality of frames; obtaining one or more cropped movements by performing a first set of cropping operations on the flow field based at least in part on a set of bounding boxes corresponding to the objects; obtaining one or more cropped frames by performing a second set of cropping operations on the plurality of frames based at least in part on the set of bounding boxes; and causing a neural network to classify one or more actions performed by the one or more objects represented in the plurality of frames based at least in part on the one or more cropped movements and the one or more cropped frames.

Facts

Company
Nvidia (NVIDIA Corporation)
Official title
End-to-end action recognition in intelligent video analysis and edge computing systems
Patent number
US12743891B2
Application number
17225924
Filed
Apr 8, 2021
Granted
Sep 22, 2026
Inventors
2
Claims
20

Classified under

G06V 20/58 Physics & computingG06F 18/2411 Physics & computingG06N 3/045 Physics & computingG06N 3/08 Physics & computingG06T 1/20 Physics & computingG06V 40/25 Physics & computing
Read the full filing (official PDF) ↗ Open in the Patent Tracker

More from Nvidia in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.