/Patent Tracker
AmazonGranted patentChips & hardwareInterest 3/10

Amazon patents faster virtual machine memory handling

Amazon has patented a method for virtualization hosts to handle memory requests from virtual machines more efficiently. When a virtual machine tries to access a memory address that isn't currently mapped, the system uses a specific tag stored in the memory management unit to immediately select the correct emulation routine, skipping the usual step of analyzing the address at the hypervisor level.

Why it mattersThis optimization could slightly improve the performance of cloud servers by reducing the overhead when virtual machines access memory, though it is a low-level technical improvement unlikely to be noticed by end users.

In the filing’s own words

A hypervisor comprising a plurality of emulation routines is launched at a host. Individual emulation routines are used to perform respective tasks by a hypervisor on behalf of guest virtual machines of the host. A guest virtual machine initiates an operation which requires access to a virtual address. Subsequent to a determination by a memory management unit of the host that a virtual-to-physical address translation mapping for the virtual address which permits the operation initiated by the guest virtual machine is not available, a task is performed using a particular emulation routine, without initiating an analysis using the virtual address at the hypervisor to select the particular emulation routine from the plurality of emulation routines.

What exactly they claim (claim 1)

1. A computer-implemented method, comprising: launching, at a virtualization host, a hypervisor comprising a plurality of emulation routines, wherein individual ones of the emulation routines are used to perform respective tasks triggered by operations initiated at one or more guest virtual machines launched at the virtualization host, wherein the respective tasks require a privilege level which is granted to the hypervisor and not granted to the one or more guest virtual machines, and wherein at least some of the respective tasks are associated with a corresponding hardware subcomponent of the virtualization host; initiating, by a particular guest virtual machine which was launched at the virtualization host, an operation which requires access to a particular virtual address; determining, by a memory management unit (MMU) of the virtualization host, that a valid virtual-to-physical address translation mapping for the particular virtual address which grants permission for the operation initiated by the particular guest virtual machine is not present in a set of address translation entries associated with the particular guest virtual machine; and based on (a) the determining by the MMU that the valid virtual-to-physical address translation mapping for the particular virtual address is not present and (b) a page tag associated with the particular virtual address, performing, at the virtualization host, a task using a particular emulation routine of the plurality of emulation routines, wherein the page tag is stored in a particular address translation entry of the set of address translation entries, and wherein the particular emulation routine is executed without the hypervisor utilizing the particular virtual address to select the particular emulation routine from the plurality of emulation routines.

Facts

Company
Amazon (Amazon Technologies, Inc.)
Official title
Page tag-based memory trap-and-emulate operations
Patent number
US12730664B1
Application number
18334311
Filed
Jun 13, 2023
Granted
Sep 8, 2026
Inventors
2
Claims
20

Classified under

G06F 9/45558 Physics & computingG06F 9/45545 Physics & computingG06F 2009/45583 Physics & computing

More from Amazon in Chips & hardware

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.