Microsoft patents AI tool that reads your open windows to answer questions
This filing describes a system where an AI module answers user questions by checking what is currently happening on your computer. It uses specific tools to gather details about open windows and formats this data so the AI can understand your current screen context.
In the filing’s own words
Implementations for operating system state (OS) context management are provided. One example includes a computing system comprising processing circuitry and memory storing instructions that, during execution, cause the processing circuitry to perform the steps of: receiving a query containing a request for information relating to a current OS state; passing the query to an artificial intelligence (AI) module; and generating an answer to the query by: calling an OS state retrieval tool to perform a plurality of application programming interface (API) calls to retrieve current OS state information; formatting the current OS state information into a data structure describing graphical window context that is readable by the AI module; and passing, to the AI module, the formatted current OS state information and a prompt containing instructions for answering queries using the formatted current OS state information.
What exactly they claim (claim 1)
1. A computing system for operating system (OS) state context management, the computing system comprising: processing circuitry and memory storing instructions that, during execution, cause the processing circuitry to perform the steps of: receiving a query containing a request for information relating to a current OS state; passing the query to an artificial intelligence (AI) module; and generating an answer to the query by: calling an OS state retrieval tool to perform a plurality of application programming interface (API) calls to retrieve current OS state information; formatting the current OS state information into a data structure describing graphical window context that is readable by the AI module; and passing, to the AI module, the formatted current OS state information and a prompt containing instructions for answering queries using the formatted current OS state information, wherein the formatted current OS state information and the prompt is used by the AI module to generate the answer to the query.
Facts
- Company
- Microsoft (Microsoft Technology Licensing, LLC)
- Official title
- OPERATING SYSTEM STATE CONTEXT MANAGEMENT
- Publication number
- US20260310693A1
- Application number
- 19171093
- Filed
- Apr 4, 2025
- Published
- Oct 8, 2026
- Inventors
- 1
- Claims
- 20
Classified under
G06F 16/33295 Physics & computingG06F 16/338 Physics & computingG06F 16/583 Physics & computingMore from Microsoft in AI & software
- Microsoft patents method to check AI answers against verified facts Oct 20, 2026
- Microsoft patents AI that presents PowerPoint slides for you Sep 3, 2026
- Microsoft patents method to check if LLM answers are based on real data Sep 10, 2026
- Microsoft patents system to blend multiple AI agents into one chat Oct 1, 2026
- Microsoft patents system that answers questions using your screen history Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.