Amazon patents method to check if AI answers are backed by real data
This filing describes a system that checks whether an AI model's answers and the sources it cites are accurate. It works by searching the original training data to see if the AI's output matches verified information with a high level of confidence. The system can also test the AI during its training process to ensure it is learning the correct answers.
In the filing’s own words
Systems and methods are provided for a prompt and content generation service to validate generated references and training data sets of large language models (LLMs). The prompt and content generation service may determine if a reference generated by an LLM is valid by searching a training dataset for tokens using a prompt, generated answer, and generated reference for content and references in the training data set. If the prompt and content generation service finds content or a valid reference with a certain confidence level, the prompt and content generation service may indicate that the generated content and reference is valid. The prompt and content generation service may additionally validate a saved checkpoint during training of an LLM by executing use case scenarios against the LLM checkpoint and determining if expected answers match generated answers.
What exactly they claim (claim 1)
1. (canceled)
Facts
- Company
- Amazon (Amazon Technologies, Inc.)
- Official title
- REFERENCE AND TRAINING DATA VALIDATION FOR MACHINE LEARNING MODELS
- Publication number
- US20260350305A1
- Application number
- 19637476
- Filed
- Apr 2, 2026
- Published
- Nov 5, 2026
- Inventors
- 2
- Claims
- 19
Classified under
G06F 40/20 Physics & computingMore from Amazon in AI & software
- Amazon patents system that cites sources for AI answers Sep 29, 2026
- Amazon patents voice assistants that adjust personality based on your mood Nov 3, 2026
- Amazon patents tech to swap words in movies using actor's voice Sep 8, 2026
- Amazon patents ML tool to add graphics to live sports from moving cameras Sep 15, 2026
- Amazon patents shopping assistant that remembers your search filters Oct 6, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
