AmazonGranted patentNetworks & wirelessInterest 4/10

Amazon patents faster fix for dead cloud servers

Patent drawing
Patent drawing from the official filing.

This patent describes a system for cloud computing that quickly detects when a virtual server stops responding to traffic. Instead of waiting for a separate health check, the server's network manager immediately tells the traffic distributor to stop sending data to the broken server.

Why it mattersThis improves the reliability of cloud services by reducing the time it takes to route around failed servers, ensuring users experience fewer connection errors.

In the filing’s own words

An encapsulation packet, formatted according to an encapsulation protocol, is obtained at a virtualization manager of a server from a packet processing intermediary. The virtualization manager determines that the encapsulation packet includes an encapsulated packet directed to a virtualized run-time environment which was launched at the server. In response to a determination, by the virtualization manager, that the virtualized run-time environment is unable to process the encapsulated packet, the virtualization manager transmits a message to the packet processing intermediary, indicating that the virtualized run-time environment is unable to process the encapsulated packet.

What exactly they claim (claim 1)

1. A system, comprising: one or more processors and corresponding memory, of a load balancer, configured to distribute network packets among a set of target virtual machines of a virtualized computing service of a cloud computing environment; a set of target servers of the virtualized computing service, wherein individual target servers of the set of target servers comprise (a) a respective networking virtualization manager and (b) a respective target virtual machine of the set of target virtual machines; and a health monitoring service of the cloud computing environment; wherein one or more processors and corresponding memory, of the health monitoring service, is configured to: in response to determining, using a health monitoring algorithm which comprises transmission of out-of-band messages, that a target virtual machine of the set of target virtual machines is unresponsive, provide a notification of unresponsiveness of the target virtual machine to at least the load balancer; wherein one or more processors and corresponding memory, implementing a networking virtualization manager of a target server of the set of target servers, is configured to: receive an encapsulation packet from the load balancer, formatted in accordance with an encapsulation protocol of the virtualized computing service; determine that the encapsulation packet comprises an encapsulated packet directed to a particular target virtual machine which was launched at the target server; and in response to detecting, by the networking virtualization manager without communicating with the health monitoring service, that the particular target virtual machine is unable to process the encapsulated packet, transmit an in-band message to the load balancer, wherein the in-band message indicates that the particular target virtual machine is unable to process the encapsulated packet, and wherein the in-band message comprises a portion of content of the encapsulation packet; and wherein the one or more processors and corresponding memory, of the load balancer, is configured to: in response to the in-band message, store metadata indicating that additional encapsulated packets directed to the particular target virtual machine are not to be sent from the load balancer to the target server, wherein the metadata is stored without receiving an out-of-band notification indicating unresponsiveness of the particular target virtual machine from the health monitoring service.

Facts

Company
Amazon (Amazon Technologies, Inc.)
Official title
Accelerating remedial actions for network traffic of unresponsive virtual machines
Patent number
US12783274B1
Application number
18180075
Filed
Mar 7, 2023
Granted
Nov 3, 2026
Inventors
1
Claims
20

Classified under

G06F 9/45558 Physics & computingH04L 45/70 Electricity & electronicsG06F 2009/4557 Physics & computingG06F 2009/45591 Physics & computingG06F 2009/45595 Physics & computingH04L 47/125 Electricity & electronics

More from Amazon in Networks & wireless

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.