AmazonPatent applicationAI & softwareInterest 6/10

Amazon patents method to check if AI answers are backed by real data

Patent drawing
Patent drawing from the official filing.

This filing describes a system that checks whether an AI model's answers and the sources it cites are accurate. It works by searching the original training data to see if the AI's output matches verified information with a high level of confidence. The system can also test the AI during its training process to ensure it is learning the correct answers.

Why it mattersThis is interesting because it offers a way to reduce 'hallucinations' or made-up facts in AI responses, which is a major concern for users relying on AI for accurate information.

In the filing’s own words

Systems and methods are provided for a prompt and content generation service to validate generated references and training data sets of large language models (LLMs). The prompt and content generation service may determine if a reference generated by an LLM is valid by searching a training dataset for tokens using a prompt, generated answer, and generated reference for content and references in the training data set. If the prompt and content generation service finds content or a valid reference with a certain confidence level, the prompt and content generation service may indicate that the generated content and reference is valid. The prompt and content generation service may additionally validate a saved checkpoint during training of an LLM by executing use case scenarios against the LLM checkpoint and determining if expected answers match generated answers.

What exactly they claim (claim 1)

1. (canceled)

Facts

Company
Amazon (Amazon Technologies, Inc.)
Official title
REFERENCE AND TRAINING DATA VALIDATION FOR MACHINE LEARNING MODELS
Publication number
US20260350305A1
Application number
19637476
Filed
Apr 2, 2026
Published
Nov 5, 2026
Inventors
2
Claims
19

Classified under

G06F 40/20 Physics & computing

More from Amazon in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.