Microsoft patents video tool to visualize how AI models process prompts
Microsoft has filed a patent for a debugging system that creates a visual map of how large language models process text. The tool breaks down user inputs into specific categories and links them to parts of the AI, allowing developers to see exactly how changes to the prompt affect the model's output in real-time video.
In the filing’s own words
Techniques for visualizing and debugging how large language models (LLMs) process input prompts are described. A system generates a model blueprint comprising nodes that represent key properties and expertise areas of an LLM. Input prompts are tokenized and categorized into elements such as thoughts, actions, and examples, which are then mapped to corresponding nodes in the blueprint through an adapter component. A debugging console provides an interactive interface for visualizing information flow through the LLM nodes and enables real-time modification of prompts to observe impacts on token selection and model behavior. The system generates video output that captures the interaction of the prompt with model nodes and resulting changes, allowing users to analyze and optimize prompt engineering for more reliable results. This visualization system transforms prompt engineering from trial-and-error to a systematic approach by providing detailed insights into how LLMs interpret and process prompts.
What exactly they claim (claim 1)
1. A system comprising: at least one processor; and at least one memory storage device storing instructions thereon, which, when executed by the at least one processor, cause the system to perform operations comprising: receiving an input prompt for a large language model (LLM); generating a model blueprint comprising nodes representing properties of the LLM that impact results generated by the LLM, wherein the nodes include expertise areas and token selection criteria of the LLM; categorizing tokens of the input prompt into categories comprising thoughts, actions, examples, and grounded data; rendering the model blueprint into a nodal format; generating, via a prompt-to-blueprint adapter, linkages between the categorized prompt tokens and corresponding nodes in the rendered model blueprint; providing a debugging console interface that: displays a visualization of information flow through the nodes of the LLM based on the generated linkages, enables modification of the input prompt to observe changes in node interactions, and displays impacts of the modifications on token nodes and category nodes of the model; and generating a video output representing the impact of the input prompt on the LLM model, wherein the video output visualizes the information flow through the LLM nodes and resulting token selections.
Facts
- Company
- Microsoft (Microsoft Technology Licensing, LLC)
- Official title
- VIDEO-BASED DEBUGGING AND SIMULATION SYSTEM FOR PROMPT IMPACT WITH LLM
- Publication number
- US20260278327A1
- Application number
- 19076706
- Filed
- Mar 11, 2025
- Published
- Sep 17, 2026
- Inventors
- 2
- Claims
- 20
Classified under
G06N 3/04 Physics & computingMore from Microsoft in AI & software
- Microsoft patents method to check AI answers against verified facts Oct 20, 2026
- Microsoft patents AI that presents PowerPoint slides for you Sep 3, 2026
- Microsoft patents method to check if LLM answers are based on real data Sep 10, 2026
- Microsoft patents system to blend multiple AI agents into one chat Oct 1, 2026
- Microsoft patents system that answers questions using your screen history Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.