/Patent Tracker
MicrosoftPatent applicationSecurity & privacyInterest 7/10

Microsoft patents security checks for AI chats using user and model profiles

Patent drawing
Patent drawing from the official filing.

Microsoft describes a system that creates digital profiles of how an AI model typically behaves and how specific users usually interact with it. When a new prompt arrives, the system compares it against these profiles to detect unusual patterns that might indicate a security threat.

Why it mattersThis approach could help protect AI services from malicious attacks by identifying suspicious user behavior that deviates from normal usage patterns.

In the filing’s own words

Techniques are described herein that are capable of performing a security action based on anomaly detection using AI model profiles and user profiles. AI model profiles (e.g., a model-session profile, a model-response profile, and/or a model-response profile) associated with AI model(s) are generated. User profiles (e.g., user-session profiles, user-prompt profiles, and/or user-response profiles) associated with users of the AI model(s) are generated. A security action is performed with regard to an incoming AI prompt as a result of a difference between the incoming AI prompt and one or more of the AI model profiles and/or one or more of the user profiles being greater than or equal to a difference threshold.

What exactly they claim (claim 1)

1. A system comprising: a processor system; and a memory that stores computer-executable instructions that are executable by the processor system to at least: generate a model-session profile that represents semantic meanings of model sessions of an artificial intelligence (AI) model, a model session comprising a first subset of AI prompts received by the AI model during the model session and a first subset of AI responses generated by the AI model in response to the first subset of the AI prompts; generate a model-response profile that represents semantic meanings of the AI responses; generate user-session profiles that represent semantic meanings of user sessions of users with regard to the AI model, a user session comprising a second subset of the AI prompts that is received from a user at the AI model during the user session and a second subset of the AI responses that is generated by the AI model in response to the second subset of the AI prompts; generate user-prompt profiles for the users, a user-prompt profile representing a semantic meaning of a third subset of the AI prompts that is received from a user at the AI model; and trigger execution of an instruction, which causes a security action to be performed with regard to an incoming AI prompt, as a result of a difference between the incoming AI prompt and the model-session profile, the model-response profile, at least a subset of the user-session profiles, or at least a subset of the user-prompt profiles being greater than or equal to a difference threshold.

Facts

Company
Microsoft (Microsoft Technology Licensing, LLC)
Official title
SECURITY ACTION BASED ON ANOMALY DETECTION USING AI MODEL PROFILES AND USER PROFILES
Publication number
US20260300473A1
Application number
19705170
Filed
Jun 11, 2026
Published
Oct 1, 2026
Inventors
7
Claims
20

Classified under

G06F 21/54 Physics & computingG06N 20/00 Physics & computing
Read the full filing (official PDF) ↗ Open in the Patent Tracker

More from Microsoft in Security & privacy

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.