Microsoft patents system that builds new AI agents when existing ones fail

1. A method for automatically enhancing a hub of large language model (LLM) agents, said method being performed by a cloud-based service and comprising: accessing a computer-based task that includes a set of parameters and requirements; accessing the hub of LLM agents, wherein the hub of LLM agents includes a plurality of different LLM agents, which include metadata comprising: (i) an identified core LLM used by said LLM agent, (ii) a score card for said LLM agent, and (iii) a listing of one or more functionalities said LLM agent is able to perform; querying the hub of LLM agents using the set of parameters and requirements to identify one or more LLM agents whose functionalities and score cards are determined to satisfy the set of parameters and requirements; based on said querying, identifying a set of LLM agents that are tasked with attempting to generate a solution for the computer-based task; determining that the set of LLM agents is deficient with respect to a particular functionality that is determined to be necessary to assist in generating the solution, wherein the set of LLM agents are determined to be deficient when the set of LLM agents are unable to achieve a threshold performance level with respect to the particular functionality; in response to determining that the set of LLM agents is deficient, authoring, by the cloud-based service, a new LLM agent that is defined to have the particular functionality determined to be necessary to assist in generating the solution; including the new LLM agent in the hub of LLM agents, wherein the new LLM agent is provided corresponding metadata detailing (i) a particular core LLM used by the new LLM agent, (ii) a particular score card for the new LLM agent, and (iii) a particular listing of functionalities for the new LLM agent, the particular listing of functionalities including the particular functionality; including the new LLM agent in the set of LLM agents; and tasking the set of LLM agents to operate in an attempt to generate the solution for the computer-based task.