Google patents feedback buttons for specific parts of AI answers
Google has patented a system that lets users click on specific images or text within an AI-generated answer to rate them. If a user marks a part as bad, the system asks why, then uses that specific complaint to adjust how the AI creates future responses.
In the filing’s own words
Implementations relate to providing a user feedback mechanism that enables a user to provide feedback towards one or more specific portions of a response. The response can be generated based on processing of a user query using a generative model such as a large language model (LLM). The one or more specific portions can be a textual portion that includes textual content, and/or a media content portion that include media content such as one or more images, one or more videos, one or more audio pieces, etc. The feedback towards one or more of the specific portions of the response can be utilized in training or fine-tuning the generative model (or an additional generative model) via approaches such as supervised training or reinforced learning.
What exactly they claim (claim 1)
1. A method implemented using one or more processors, the method comprising: receiving a user query, the user query being received via a user interface of a client device; generating, using a generative model, a generative response that is responsive to the user query and that includes at least media content to be rendered and one or more selectable elements to be rendered with respect to media content, wherein each of the one or more selectable elements are selectable and correspond to a respective type of user feedback that evaluates the media content with respect to the user query, and wherein the one or more selectable elements includes a given selectable element that corresponds to negative user feedback; causing the media content to be rendered at the user interface; causing the one or more selectable elements to be rendered at the user interface and with respect to the media content; in response to receiving user input that selects the given selectable element, of the one or more selectable elements, that corresponds to the negative user feedback: determining, based on the received user input that selects the given selectable element, user feedback that evaluates the media content with respect to the user query, wherein determining the user feedback that evaluates the media content with respect to the user query comprises: causing a feedback window to be rendered at the user interface, wherein the feedback window is rendered in response to receiving the user input that selects the given selectable element, and wherein the feedback window includes one or more selectable options each displaying a corresponding description that classifies the negative user feedback; receiving additional user input that selects one of the one or more selectable options; and determining a classification of the negative user feedback based on the additional user input; and training or fine-tuning the generative model based on at least the user feedback that evaluates the media content with respect to the user query, wherein training or fine-tuning the generative model based on the user query and the user feedback that evaluates the media content with respect to the user query comprises: in response to determining that the classification of the negative user feedback is a first classification: reinforcing the generative model to not output a tag or prompt utilized to obtain the media content in response to the user query, and in response to determining that the classification of the negative user feedback is a second classification different from the first classification: rewriting an input prompt that is processed as input using the generative model; and training or fine-tuning the generative model using the rewritten input prompt.
Facts
- Company
- Google (GOOGLE LLC)
- Official title
- User feedback for specific portions of responses generated using a large language model (LLM)
- Patent number
- US12737556B2
- Application number
- 18435750
- Filed
- Feb 7, 2024
- Granted
- Sep 15, 2026
- Inventors
- 2
- Claims
- 20
Classified under
G06F 40/40 Physics & computingMore from Google in AI & software
- Google patents video search that answers questions using AI descriptions Sep 15, 2026
- Google patents photo tool that removes people and their gear Sep 15, 2026
- Google patents AI that writes live meeting notes and summaries Sep 15, 2026
- Google patents AI tool that turns messy emergency notes into clear messages Sep 3, 2026
- Google patents AI that clicks through apps to finish tasks for you Sep 24, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.