Amazon patents faster fix for dead cloud servers
This patent describes a system for cloud computing that quickly detects when a virtual server stops responding to traffic. Instead of waiting for a separate health check, the server's network manager immediately tells the traffic distributor to stop sending data to the broken server.
In the filing’s own words
An encapsulation packet, formatted according to an encapsulation protocol, is obtained at a virtualization manager of a server from a packet processing intermediary. The virtualization manager determines that the encapsulation packet includes an encapsulated packet directed to a virtualized run-time environment which was launched at the server. In response to a determination, by the virtualization manager, that the virtualized run-time environment is unable to process the encapsulated packet, the virtualization manager transmits a message to the packet processing intermediary, indicating that the virtualized run-time environment is unable to process the encapsulated packet.
What exactly they claim (claim 1)
1. A system, comprising: one or more processors and corresponding memory, of a load balancer, configured to distribute network packets among a set of target virtual machines of a virtualized computing service of a cloud computing environment; a set of target servers of the virtualized computing service, wherein individual target servers of the set of target servers comprise (a) a respective networking virtualization manager and (b) a respective target virtual machine of the set of target virtual machines; and a health monitoring service of the cloud computing environment; wherein one or more processors and corresponding memory, of the health monitoring service, is configured to: in response to determining, using a health monitoring algorithm which comprises transmission of out-of-band messages, that a target virtual machine of the set of target virtual machines is unresponsive, provide a notification of unresponsiveness of the target virtual machine to at least the load balancer; wherein one or more processors and corresponding memory, implementing a networking virtualization manager of a target server of the set of target servers, is configured to: receive an encapsulation packet from the load balancer, formatted in accordance with an encapsulation protocol of the virtualized computing service; determine that the encapsulation packet comprises an encapsulated packet directed to a particular target virtual machine which was launched at the target server; and in response to detecting, by the networking virtualization manager without communicating with the health monitoring service, that the particular target virtual machine is unable to process the encapsulated packet, transmit an in-band message to the load balancer, wherein the in-band message indicates that the particular target virtual machine is unable to process the encapsulated packet, and wherein the in-band message comprises a portion of content of the encapsulation packet; and wherein the one or more processors and corresponding memory, of the load balancer, is configured to: in response to the in-band message, store metadata indicating that additional encapsulated packets directed to the particular target virtual machine are not to be sent from the load balancer to the target server, wherein the metadata is stored without receiving an out-of-band notification indicating unresponsiveness of the particular target virtual machine from the health monitoring service.
Facts
- Company
- Amazon (Amazon Technologies, Inc.)
- Official title
- Accelerating remedial actions for network traffic of unresponsive virtual machines
- Patent number
- US12783274B1
- Application number
- 18180075
- Filed
- Mar 7, 2023
- Granted
- Nov 3, 2026
- Inventors
- 1
- Claims
- 20
Classified under
G06F 9/45558 Physics & computingH04L 45/70 Electricity & electronicsG06F 2009/4557 Physics & computingG06F 2009/45591 Physics & computingG06F 2009/45595 Physics & computingH04L 47/125 Electricity & electronicsMore from Amazon in Networks & wireless
- Amazon patents system to deliver data packets at exact same time Nov 3, 2026
- Amazon patents indoor map building using Wi-Fi signals Sep 29, 2026
- Amazon patents Wi-Fi backup that uses your phone when router dies Oct 6, 2026
- Amazon patents Wi-Fi and ultrasound combo to better detect when you are home Nov 3, 2026
- Amazon patents home mesh network for better wireless sensing Nov 3, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
