Nvidia patents method for choosing how to generate AI text responses
Nvidia describes a system that selects specific methods for generating text or data tokens based on user requests and set limits. The processor identifies which decoding technique to use and directs computing resources to execute it to create the final response.
In the filing’s own words
Apparatuses, systems, and techniques to identify one or more decoding techniques to be used based, at least in part, on one or more requests from one or more users. In at least one embodiment, a processor comprises processing circuitry to identify one or more decoding techniques to generate one or more responses to one or more requests based, at least in part, on one or more constraints, and cause one or more computing resources to perform the one or more decoding techniques to generate the one or more responses to the one or more requests.
What exactly they claim (claim 1)
1. One or more processors comprising processing circuitry to: identify one or more decoding techniques to generate one or more tokens as part of one or more responses to one or more requests based, at least in part, on one or more constraints; and cause one or more computing resources to perform the one or more decoding techniques to generate at least the one or more tokens as part of the one or more responses to the one or more requests.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- IDENTIFYING DECODING TECHNIQUES
- Publication number
- US20260288465A1
- Application number
- 19083260
- Filed
- Mar 18, 2025
- Published
- Sep 24, 2026
- Inventors
- 4
- Claims
- 19
Classified under
G06F 9/3818 Physics & computingG06F 9/5005 Physics & computingMore from Nvidia in AI & software
- Nvidia patents AI coach that analyzes your gameplay to suggest strategies Oct 13, 2026
- Nvidia patents AI system that writes and voices character conversations Sep 10, 2026
- Nvidia patents system that uses AI to find bugs in game videos Sep 17, 2026
- Nvidia patents AI method to make digital characters move realistically Sep 8, 2026
- Nvidia patents AI system that builds image generators from text prompts Sep 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.