Google patents memory manager that tracks data usage to speed up computers
Google has been granted a patent for a system that monitors how often computer memory is accessed to improve performance. The technology uses a separate processor to track data requests and move frequently used information from slower storage to faster memory.
In the filing’s own words
Aspects of the disclosed technology include techniques and mechanisms for using far memory telemetry for hot and cold page management. A processor within a telemetry system parses page access requests transmitted from a central processing unit (CPU) to a computing system. The processor parses the request to determine whether a directory contains a record for the requested page. Based on determining the directory does not store a record for the requested page and based on determining the directory is not at capacity, the processor generates a record and stores the record in the directory. The processor transmits a signal to the computing system to determine whether to perform one or more actions on the pages identified in the directory, such as move a page from a far memory device to a near memory device based on directory data indicating a number of access requests associated with each page.
What exactly they claim (claim 1)
1. A system for managing pages in memory, the system comprising: one or more computing processors having near memory; far memory coupled to the one or more computing processors; and one or more telemetry processors, wherein the one or more telemetry processors are configured to: receive a page access request from the one or more computing processors; parse the page access request by: identifying a memory address associated with the requested page; identifying a page size of the requested page; determining a number of upper bits and lower bits of the memory address based on the page size; reducing the memory address into the upper bits and lower bits, wherein the lower bits are offset bits; and removing the offset bits from the memory address to generate a subset of bits that identify the requested page; query a directory using the subset of bits to determine that the directory contains a record associated with the requested page, the directory comprising a bitmap having a maximum number of bits corresponding to a capacity of the directory, the capacity of the directory corresponding to a capacity of records of pages capable of being maintained by the directory, wherein each bit or group of bits of the bitmap corresponds to different pages stored in the far memory, access counts for the different pages, and an access threshold indicating to transition a page from the far memory to the near memory; and in response to determining that the directory contains the record associated with the requested page, increment an access count associated with the requested page.
Facts
- Company
- Google (Google LLC)
- Official title
- Far memory telemetry for hot and cold page management
- Patent number
- US12769661B2
- Application number
- 18636879
- Filed
- Apr 16, 2024
- Granted
- Oct 20, 2026
- Inventors
- 3
- Claims
- 17
Classified under
G06F 12/0817 Physics & computingG06F 12/0246 Physics & computingG06F 12/0882 Physics & computingMore from Google in Chips & hardware
- Google patents quantum gates to simulate particle physics Sep 1, 2026
- Waymo patents lidar chips that split light into multiple beams Sep 8, 2026
- Google patents chip design to speed up AI math tasks Sep 8, 2026
- Google patents display that turns off colors to save battery Sep 8, 2026
- Google patents display tech that skips blank screen areas to save power Sep 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.