/Patent Tracker
MicrosoftGranted patentSecurity & privacyInterest 6/10

Microsoft patents AI that explains why it flags files as malware

Microsoft has patented a system that uses an AI model to decide if a file is malicious or safe. Unlike standard scanners, this system also asks the AI to provide a written explanation of its reasoning, which is then shown to the user. The system compares the new file to previously analyzed files to help the AI make its decision.

Why it mattersThis is interesting because it aims to make automated security decisions more transparent, allowing users to understand why a file was blocked rather than just seeing a generic warning.

In the filing’s own words

Techniques are described herein that are capable of performing AI-based maliciousness classification with an explanation of reasoning. An AI model is caused to classify a file in a malicious class or a non-malicious class and to provide an explanation that describes reasoning used by the AI model for the classification by providing an AI prompt together with the file as inputs to the AI model. The AI prompt requests that the AI model choose between the malicious class and the non-malicious class and further requests the explanation. A response to the AI prompt is received from the AI model. The response includes an indication of a selected class in which the AI model classifies the file and further includes the explanation. The explanation is stored and/or is provided to the user via a user interface, and a security operation is performed with regard to the file.

What exactly they claim (claim 1)

1. A system comprising: a processor system; and a memory that stores computer-executable instructions that are executable by the processor system to at least: generate a target vector based at least on an identifier that identifies a target file, content of the target file, and an AI prompt; determine extents to which historical vectors associated with historical files, which are previously classified by an AI model, correspond to the target vector; select a first historical vector from the historical vectors based at least on the extent to which the first historical vector corresponds to the target vector being greater than or equal to an extent threshold; cause the AI model to classify the target file in a malicious class or a non-malicious class and to provide an explanation that describes reasoning used by the AI model in choosing the malicious class or the non-malicious class by providing the AI prompt together with the target file and classification information associated with the first historical vector as inputs to the AI model, the AI prompt requesting that the AI model choose between the malicious class and the non-malicious class and further requesting the explanation that describes the reasoning used by the AI model in choosing the malicious class or the non-malicious class; receive a response to the AI prompt from the AI model, the response comprising an indication of a selected class in which the AI model classifies the target file and further comprising the explanation that describes the reasoning used by the AI model in choosing the selected class, wherein the selected class is the malicious class or the non-malicious class; provide the explanation, which describes the reasoning used by the AI model in choosing the selected class, to a user via a user interface; and based at least on the indication of the selected class in which the AI model classifies the target file, perform a security operation with regard to the target file.

Facts

Company
Microsoft (Microsoft Technology Licensing, LLC)
Official title
AI-based file maliciousness classification with an explanation of reasoning
Patent number
US12737461B2
Application number
18593851
Filed
Mar 1, 2024
Granted
Sep 15, 2026
Inventors
12
Claims
22

Classified under

G06F 21/56 Physics & computingG06N 5/04 Physics & computingG06N 20/00 Physics & computing

More from Microsoft in Security & privacy

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.