Microsoft patents AI that explains why it flags files as malware
Microsoft has patented a system that uses an AI model to decide if a file is malicious or safe. Unlike standard scanners, this system also asks the AI to provide a written explanation of its reasoning, which is then shown to the user. The system compares the new file to previously analyzed files to help the AI make its decision.
In the filing’s own words
Techniques are described herein that are capable of performing AI-based maliciousness classification with an explanation of reasoning. An AI model is caused to classify a file in a malicious class or a non-malicious class and to provide an explanation that describes reasoning used by the AI model for the classification by providing an AI prompt together with the file as inputs to the AI model. The AI prompt requests that the AI model choose between the malicious class and the non-malicious class and further requests the explanation. A response to the AI prompt is received from the AI model. The response includes an indication of a selected class in which the AI model classifies the file and further includes the explanation. The explanation is stored and/or is provided to the user via a user interface, and a security operation is performed with regard to the file.
What exactly they claim (claim 1)
1. A system comprising: a processor system; and a memory that stores computer-executable instructions that are executable by the processor system to at least: generate a target vector based at least on an identifier that identifies a target file, content of the target file, and an AI prompt; determine extents to which historical vectors associated with historical files, which are previously classified by an AI model, correspond to the target vector; select a first historical vector from the historical vectors based at least on the extent to which the first historical vector corresponds to the target vector being greater than or equal to an extent threshold; cause the AI model to classify the target file in a malicious class or a non-malicious class and to provide an explanation that describes reasoning used by the AI model in choosing the malicious class or the non-malicious class by providing the AI prompt together with the target file and classification information associated with the first historical vector as inputs to the AI model, the AI prompt requesting that the AI model choose between the malicious class and the non-malicious class and further requesting the explanation that describes the reasoning used by the AI model in choosing the malicious class or the non-malicious class; receive a response to the AI prompt from the AI model, the response comprising an indication of a selected class in which the AI model classifies the target file and further comprising the explanation that describes the reasoning used by the AI model in choosing the selected class, wherein the selected class is the malicious class or the non-malicious class; provide the explanation, which describes the reasoning used by the AI model in choosing the selected class, to a user via a user interface; and based at least on the indication of the selected class in which the AI model classifies the target file, perform a security operation with regard to the target file.
Facts
- Company
- Microsoft (Microsoft Technology Licensing, LLC)
- Official title
- AI-based file maliciousness classification with an explanation of reasoning
- Patent number
- US12737461B2
- Application number
- 18593851
- Filed
- Mar 1, 2024
- Granted
- Sep 15, 2026
- Inventors
- 12
- Claims
- 22
Classified under
G06F 21/56 Physics & computingG06N 5/04 Physics & computingG06N 20/00 Physics & computingMore from Microsoft in Security & privacy
- Microsoft patents system to call 911 for others during video calls Sep 22, 2026
- Microsoft patents system to block fake code suggested by AI Sep 15, 2026
- Microsoft patents one-way data flow to block network attacks Sep 10, 2026
- Microsoft patents voice coding that hides speaker identity for secure calls Sep 17, 2026
- Microsoft patents security checks for AI chats using user and model profiles Oct 1, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.