Microsoft patents ML system that handles new user requests while previous ones run
This filing describes a computing system that processes machine learning requests in a non-blocking way. When a user submits a first request, the system starts processing it but remains free to accept and handle new, separate requests from the user before the first one finishes.
In the filing’s own words
A computing system including one or more processing devices configured to receive a first user input at a user interface of a machine learning (ML) system. In response to receiving the first user input, the one or more processing devices initiate a first model call to a first ML model. During execution of the first model call, the one or more processing devices receive one or more second user inputs and perform one or more second model calls to a second ML model to compute one or more second model outputs. The one or more processing devices output the one or more second model outputs to the user interface. Subsequently to outputting the one or more second model outputs, the one or more processing devices receive and output a first model output computed at the first ML model in response to receiving the first user input.
What exactly they claim (claim 1)
1. A computing system comprising: one or more processing devices configured to: receive a first user input at a user interface of a machine learning (ML) system; in response to receiving the first user input, initiate a first model call to a first ML model included in the ML system; during execution of the first model call: receive one or more second user inputs; perform one or more second model calls to a second ML model included in the ML system to compute one or more second model outputs based at least in part on the one or more second user inputs; and output the one or more second model outputs to the user interface; subsequently to outputting the one or more second model outputs, receive a first model output computed at the first ML model in response to receiving the first user input; and output the first model output to the user interface.
Facts
- Company
- Microsoft (Microsoft Technology Licensing, LLC)
- Official title
- MACHINE LEARNING SYSTEM WITH ASYNCHRONOUS COMMUNICATION
- Publication number
- US20260320475A1
- Application number
- 19174843
- Filed
- Apr 9, 2025
- Published
- Oct 15, 2026
- Inventors
- 2
- Claims
- 20
Classified under
G06N 20/00 Physics & computingG06F 9/451 Physics & computingMore from Microsoft in AI & software
- Microsoft patents method to check AI answers against verified facts Oct 20, 2026
- Microsoft patents AI that presents PowerPoint slides for you Sep 3, 2026
- Microsoft patents method to check if LLM answers are based on real data Sep 10, 2026
- Microsoft patents system to blend multiple AI agents into one chat Oct 1, 2026
- Microsoft patents system that answers questions using your screen history Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.