/Patent Tracker
GooglePatent applicationAI & softwareInterest 4/10

Google patents smart memory cache that uses AI to cut storage costs

Google has filed a patent for a method that manages temporary computer memory, known as a cache, by using a machine learning model to decide how long to keep specific pieces of data. The system calculates a 'time-to-live' for each item by weighing the cost of keeping it in memory against the cost of retrieving it later if it is removed. This approach aims to lower the total expense of running servers by dynamically adjusting how long data stays in fast memory.

Why it mattersThis is interesting to tech enthusiasts because it shows how machine learning is being applied to the basic plumbing of computing to make cloud services more efficient and potentially cheaper for users.

In the filing’s own words

Aspects of the disclosure are directed to a cache maintenance policy that reduces the total cost incurred by the cache, including the storage cost to maintain data in the cache and any costs associated with fetching requested data that is no longer in the cache. The cache maintenance policy uses a machine learning model to determine a time-to-live (TTL) for data based on access patterns and associated costs. Integrating the cache maintenance policy with a cache eviction policy results in reducing total cost to maintain the cache, particularly compared to fixed-size cache policies.

What exactly they claim (claim 1)

1. A method for elastic memory caching comprising: receiving, by one or more processors, a first request for a first entry in a cache; determining, by the one or more processors, a first time-to-live for the first entry based on a cache maintenance policy associated with a machine learning model trained to output time-to-live based on a cost to maintain entries in the cache and a cost to evict entries from the cache; receiving, by the one or more processors, at a time before the first time-to-live, a second request for the first entry in the cache; determining, by the one or more processors, a second time-to-live for the first entry based on the cache maintenance policy; and evicting, by the one or more processors, the first entry at a time equal to or after the second time-to-live; wherein: the machine learning model outputs a cost value from the cost to maintain entries in the cache and the cost to evict entries from the cache; and the first time-to-live and the second time-to-live are determined from respective cost values multiplied by a breakeven value.

Facts

Company
Google (Google LLC)
Official title
Elastic In-Memory Caching
Publication number
US20260277823A1
Application number
19079589
Filed
Mar 14, 2025
Published
Sep 17, 2026
Inventors
4
Claims
20

Classified under

G06F 12/121 Physics & computing
Read the full filing (official PDF) ↗ Open in the Patent Tracker

More from Google in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.