Microsoft patents routers that handle AI data tasks directly
This patent describes a router that performs specific data operations, like combining or sharing information, directly within the network hardware. Instead of sending data back to the main processors for these tasks, the router handles them immediately to reduce delay and save bandwidth.
In the filing’s own words
An enhanced router is described that improves network performance for AI workloads by providing in-network primitives that improve the performance of operations such as Broadcast and Reduce operations. The enhanced router leverages the observation that operations such as the Broadcast and Reduce primitives are more performant (e.g., reduced latency and bandwidth) when performed in the network rather than in graphics processing unites (GPUs) or central processing units (CPUs) which are often deployed as leaf nodes in a typical network topology in a datacenter.
What exactly they claim (claim 1)
1. A method for processing data packets in a computing network processing workloads in a virtualized computing network comprising a plurality of computing nodes and network devices configured to implement a software defined network (SDN), the computing nodes hosting virtual machines or containers and the network devices configured to process data packets associated with the workloads outside of the computing nodes, the method comprising: receiving, by the network device, a data packet associated with a workload being processed in the computing network; determining, by the network device, that the packet is associated with the workload being processed in the computing network; receiving, by the network device via a control plane, a primitive indicative of an operation to be performed on payloads of data packets associated with the workload; based on information contained in a header of the packet, performing, by the network device, the operation on a payload of the packet according to the primitive, eliminating round trip packet transmission between the network device and the computing nodes by performing the operation at the network device; and sending, by the network device, the processed packet to a destination address determined based on the header of the packet or additional configuration information.
Facts
- Company
- Microsoft (MICROSOFT TECHNOLOGY LICENSING, LLC)
- Official title
- Network device configured for workloads in software defined networks
- Patent number
- US12786117B2
- Application number
- 18401309
- Filed
- Dec 29, 2023
- Granted
- Nov 3, 2026
- Inventors
- 4
- Claims
- 20
Classified under
H04L 45/74 Electricity & electronicsMore from Microsoft in Networks & wireless
- Microsoft patents camera-based data transfer between server displays Sep 22, 2026
- Microsoft patents system that uses AI to plan network capacity Oct 13, 2026
- Microsoft patents method to spot cloud outages by checking individual user traffic Sep 10, 2026
- Microsoft patents hand gestures to control devices without menus Sep 24, 2026
- Microsoft patents image-based method to detect phone tethering Oct 1, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
