MicrosoftGranted patentNetworks & wirelessInterest 6/10

Microsoft patents routers that handle AI data tasks directly

Patent drawing
Patent drawing from the official filing.

This patent describes a router that performs specific data operations, like combining or sharing information, directly within the network hardware. Instead of sending data back to the main processors for these tasks, the router handles them immediately to reduce delay and save bandwidth.

Why it mattersIt could make large-scale AI training faster by reducing the time data spends traveling between servers.

In the filing’s own words

An enhanced router is described that improves network performance for AI workloads by providing in-network primitives that improve the performance of operations such as Broadcast and Reduce operations. The enhanced router leverages the observation that operations such as the Broadcast and Reduce primitives are more performant (e.g., reduced latency and bandwidth) when performed in the network rather than in graphics processing unites (GPUs) or central processing units (CPUs) which are often deployed as leaf nodes in a typical network topology in a datacenter.

What exactly they claim (claim 1)

1. A method for processing data packets in a computing network processing workloads in a virtualized computing network comprising a plurality of computing nodes and network devices configured to implement a software defined network (SDN), the computing nodes hosting virtual machines or containers and the network devices configured to process data packets associated with the workloads outside of the computing nodes, the method comprising: receiving, by the network device, a data packet associated with a workload being processed in the computing network; determining, by the network device, that the packet is associated with the workload being processed in the computing network; receiving, by the network device via a control plane, a primitive indicative of an operation to be performed on payloads of data packets associated with the workload; based on information contained in a header of the packet, performing, by the network device, the operation on a payload of the packet according to the primitive, eliminating round trip packet transmission between the network device and the computing nodes by performing the operation at the network device; and sending, by the network device, the processed packet to a destination address determined based on the header of the packet or additional configuration information.

Facts

Company
Microsoft (MICROSOFT TECHNOLOGY LICENSING, LLC)
Official title
Network device configured for workloads in software defined networks
Patent number
US12786117B2
Application number
18401309
Filed
Dec 29, 2023
Granted
Nov 3, 2026
Inventors
4
Claims
20

Classified under

H04L 45/74 Electricity & electronics

More from Microsoft in Networks & wireless

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.