Microsoft patents system that picks how AI answers you
Microsoft describes a computing system that uses a specific machine learning model to decide how to respond to a user. Instead of always giving the same type of answer, the system looks at the user's input and the available devices to choose the best output format, such as text, audio, or visual data.
In the filing’s own words
A computing system including one or more input devices, output devices, and processing devices. The one or more processing devices receive a user input via an input device and receive interaction context metadata associated with the user input. The interaction context metadata includes an input modality of the user input and output modalities of the one or more output devices. At a multimodal machine learning (ML) system, the one or more processing devices select one or more of the output modalities at a modality selection ML model based at least on the user input and the interaction context metadata. At one or more generative ML models, based at least on the user input, the one or more processing devices compute one or more respective model outputs that respectively have the one or more selected output modalities. The one or more processing devices output the one or more model outputs.
What exactly they claim (claim 1)
1. A computing system comprising: one or more input devices; one or more output devices; and one or more processing devices configured to: receive a user input via an input device of the one or more input devices; receive interaction context metadata associated with the user input, wherein the interaction context metadata includes: an input modality of the user input; and a plurality of output modalities of the one or more output devices; at a multimodal machine learning (ML) system: at a modality selection ML model, select one or more of the output modalities based at least in part on the user input and the interaction context metadata; at one or more generative ML models, based at least in part on the user input, compute one or more respective model outputs that respectively have the one or more selected output modalities; and output the one or more model outputs.
Facts
- Company
- Microsoft (Microsoft Technology Licensing, LLC)
- Official title
- MACHINE LEARNING SYSTEM WITH MODALITY SELECTION MODEL
- Publication number
- US20260320413A1
- Application number
- 19174838
- Filed
- Apr 9, 2025
- Published
- Oct 15, 2026
- Inventors
- 2
- Claims
- 20
Classified under
G06N 3/10 Physics & computingG06N 3/0475 Physics & computingMore from Microsoft in AI & software
- Microsoft patents method to check AI answers against verified facts Oct 20, 2026
- Microsoft patents AI that presents PowerPoint slides for you Sep 3, 2026
- Microsoft patents method to check if LLM answers are based on real data Sep 10, 2026
- Microsoft patents system to blend multiple AI agents into one chat Oct 1, 2026
- Microsoft patents system that answers questions using your screen history Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.