/Patent Tracker
MicrosoftPatent applicationAI & softwareInterest 6/10

Microsoft patents method to grade and fix AI sub-agents in complex tasks

Patent drawing
Patent drawing from the official filing.

Microsoft describes a system that evaluates how well different parts of an AI workflow perform their specific jobs. It assigns scores to these components based on how closely their output matches the overall goal and their individual sub-tasks. If a component scores too low, the system automatically adjusts its settings or replaces it to improve the final result.

Why it mattersThis approach could help developers build more reliable AI systems by automatically identifying and fixing weak links in complex, multi-step tasks.

In the filing’s own words

Techniques are described herein that are capable of increasing effectiveness of an agentic AI flow based on output of an AI sub-agent. An extent to which an input-output pair corresponds to a goal of an agentic AI flow that is implemented by AI sub-agents in an agentic AI system may be determined to provide a first factor. Extents to which intermediate input-output pairs of the AI sub-agents correspond to sub-tasks in the agentic AI flow may be determined to provide a second factor. An evaluation of an effectiveness of an invocation path of the agentic AI flow may be performed to provide a third factor. Score(s) are assigned to the invocation path and/or the AI sub-agents using the first, second, and/or third factors. The effectiveness of the invocation path is increased by reconfiguring the invocation path and/or by reconfiguring or replacing an AI sub-agent.

What exactly they claim (claim 1)

1. A system comprising: a processor system; and a memory that stores computer-executable instructions that are executable by the processor system to at least: determine an extent to which an input-output pair corresponds to a goal of an agentic artificial intelligence (AI) flow that is implemented by a plurality of AI sub-agents in an agentic AI system, the input-output pair comprising an AI input that is provided as an input to the agentic AI system and an AI response that is received as an output of the agentic AI system in response to the AI input; determine extents to which intermediate input-output pairs of the AI sub-agents correspond to sub-tasks in the agentic AI flow that the AI sub-agents are responsible for performing, the intermediate input-output pairs comprising inputs to the AI sub-agents and outputs that are received from the AI sub-agents in response to the inputs; assign scores to the AI sub-agents using the extent to which the input-output pair corresponds to the goal of the agentic AI flow and the extents to which the intermediate input-output pairs of the AI sub-agents correspond to the sub-tasks that the AI sub-agents are responsible for performing; and as a result of a first score that is assigned to a first AI sub-agent being less than a threshold score, increase the extent to which the intermediate input-output pair of the first AI sub-agent corresponds to a first sub-task that the first AI sub-agent is configured to perform by reconfiguring an AI algorithm that defines the first AI sub-agent, wherein the AI sub-agents comprise the first AI sub-agent, wherein the scores comprise the first score.

Facts

Company
Microsoft (Microsoft Technology Licensing, LLC)
Official title
INCREASING EFFECTIVENESS OF AN AGENTIC AI FLOW BASED ON OUTPUT OF AN AI SUB-AGENT
Publication number
US20260300748A1
Application number
19090338
Filed
Mar 25, 2025
Published
Oct 1, 2026
Inventors
3
Claims
20

Classified under

G06N 3/092 Physics & computing
Read the full filing (official PDF) ↗ Open in the Patent Tracker

More from Microsoft in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.