/Patent Tracker
SamsungPatent applicationAI & softwareInterest 4/10

Samsung patents method to free up memory used by AI models

Samsung describes a system that monitors the state of a generative AI model running on a device. When specific conditions are met, the system temporarily frees up certain memory areas called DMA buffers and then restores them when needed.

Why it mattersThis filing focuses on optimizing how devices manage memory resources while running large AI models, which could help improve performance or battery life.

In the filing’s own words

Embodiments herein provide a method and system for recovering and restoring DMA buffers in a GenAI model by an electronic device. The method includes obtaining, by the electronic device, a state of the GenAI model based on one or more parameters; determining, by the electronic device, a trigger for a GenAI model memory shrinker (GAMS) based on the state of the GenAI model; determining, by the electronic device, at least one buffer from a plurality of DMA buffers associated with the GenAI model that are safe for recovering based on triggering the GAMS; executing, by the electronic device, a GAMS memory recovery operation for the at least one DMA buffer from the plurality of DMA buffers; and executing, by the electronic device, a GAMS buffer restore operation for the at least one DMA buffer from the plurality of DMA buffers.

What exactly they claim (claim 1)

1. A method for recovering and restoring direct memory access (DMA) buffers associated with a generative artificial intelligence (GenAI) model by an electronic device, comprising: obtaining, by the electronic device, a state of the GenAI model based on one or more parameters; determining, by the electronic device, a trigger for a GenAI model memory shrinker (GAMS) based on the state of the GenAI model; determining, by the electronic device, at least one buffer from a plurality of DMA buffers associated with the GenAI model that are safe for recovering based on triggering the GAMS; executing, by the electronic device, a GAMS memory recovery operation for the at least one DMA buffer from the plurality of DMA buffers; and executing, by the electronic device, a GAMS buffer restore operation for the at least one DMA buffer from the plurality of DMA buffers.

Facts

Company
Samsung (SAMSUNG ELECTRONICS CO., LTD.)
Official title
RECOVERING AND RESTORING DMA BUFFERS IN A GENAI MODEL BY AN ELECTRONIC DEVICE
Publication number
US20260288585A1
Application number
19555374
Filed
Mar 3, 2026
Published
Sep 24, 2026
Inventors
10
Claims
20

Classified under

G06F 11/1415 Physics & computingG06F 13/30 Physics & computingG06F 2201/805 Physics & computing
Read the full filing (official PDF) ↗ Open in the Patent Tracker

More from Samsung in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.