Microsoft patents method for matching user queries to AI tools
Microsoft describes a system that converts user questions into mathematical data points to find the most relevant software tools in a database. It then builds a specific instruction set for AI agents, telling them exactly which tools to use to answer the user's request.
In the filing’s own words
Methods, systems, and apparatuses include receiving, via a conversational interface, user input from a user of an online system. A user input embedding is generated for the user input. A vector store is retrieved including tool description embeddings. A similarity search is performed using the user input embedding and the tool description embeddings. A set of tool descriptions is determined using results of the similarity search. A prompt is generated using the set of tool descriptions and the user input. Machine learning agents are applied to the prompt to cause the machine learning agents to use tools associated with the set of tool descriptions. A response to the prompt is received, from the machine learning agents, in response to the machine learning agents using the tools. An output to the user input based on the response is sent, via the conversational interface, to the user of the online system.
What exactly they claim (claim 1)
1. A method comprising: receiving, via a conversational interface, user input from a user of an online system; generating a user input embedding using the user input; retrieving a vector store comprising a plurality of tool description embeddings; performing a similarity search using the user input embedding and the plurality of tool description embeddings; determining a set of tool descriptions using the similarity search; generating a prompt using the set of tool descriptions and the user input; and applying one or more machine learning agents to the prompt to cause the one or more machine learning agents to use one or more tools associated with the set of tool descriptions by accessing an application programming interface for the one or more tools; receiving a response to the prompt, from the one or more machine learning agents, in response to the machine learning agents using the one or more tools; and sending, via the conversational interface, an output to the user input based on the response.
Facts
- Company
- Microsoft (Microsoft Technology Licensing, LLC)
- Official title
- Agent prompt generation using tool description embeddings
- Patent number
- US12769770B2
- Application number
- 18756384
- Filed
- Jun 27, 2024
- Granted
- Oct 20, 2026
- Inventors
- 6
- Claims
- 20
Classified under
G06F 16/3329 Physics & computingG06F 16/383 Physics & computingMore from Microsoft in AI & software
- Microsoft patents method to check AI answers against verified facts Oct 20, 2026
- Microsoft patents AI that presents PowerPoint slides for you Sep 3, 2026
- Microsoft patents method to check if LLM answers are based on real data Sep 10, 2026
- Microsoft patents system to blend multiple AI agents into one chat Oct 1, 2026
- Microsoft patents system that answers questions using your screen history Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.