/Patent Tracker
SamsungPatent applicationAI & softwareInterest 4/10

Samsung patents method to extend language model memory

Patent drawing
Patent drawing from the official filing.

Samsung describes a system that identifies less important words in a language model's input and saves them separately to save space. When needed, the system retrieves these saved words and combines them with the current active context to maintain the full meaning of the conversation.

Why it mattersThis technique could allow AI models to process longer documents or conversations without losing track of earlier details, improving their ability to handle complex tasks.

In the filing’s own words

Systems and methods for increasing context length of a language model are disclosed. A first token associated with a language model is identified. The importance of the first token is detected to be below a threshold importance. A semantic shift of the first token is further detected. A first representation of the first token is stored in the storage device based on determining the importance of the first token and further based on identifying the semantic shift. A trigger is detected. A first representation of the first token is retrieved from the storage device based on detecting the trigger. The first representation of the first token is combined with one or more second representations of one or more second tokens associated with an active context.

What exactly they claim (claim 1)

1. A system comprising: a processor; a storage device; and a memory, wherein the memory stores instructions that, when executed by the processor, cause the processor to: identify a first token associated with a language model; detect importance of the first token being below a threshold importance; detect a semantic shift of the first token; store a first representation of the first token in the storage device based on determining the importance of the first token and further based on identifying the semantic shift; detect a trigger; retrieve the first representation of the first token from the storage device based on detecting the trigger; and combine the first representation of the first token with one or more second representations of one or more second tokens associated with an active context.

Facts

Company
Samsung (Samsung Electronics Co., Ltd.)
Official title
SYSTEMS AND METHODS FOR INCREASING CONTEXT LENGTH OF A LANGUAGE MODEL
Publication number
US20260300626A1
Application number
19265460
Filed
Jul 10, 2025
Published
Oct 1, 2026
Inventors
3
Claims
20

Classified under

G06F 40/284 Physics & computingG06F 40/30 Physics & computing
Read the full filing (official PDF) ↗ Open in the Patent Tracker

More from Samsung in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.