/Patent Tracker
GoogleGranted patentAI & softwareInterest 6/10

Google patents feedback buttons for specific parts of AI answers

Google has patented a system that lets users click on specific images or text within an AI-generated answer to rate them. If a user marks a part as bad, the system asks why, then uses that specific complaint to adjust how the AI creates future responses.

Why it mattersThis helps AI developers fix specific mistakes in images or text rather than just getting a general 'thumbs down,' which could make AI answers more accurate over time.

In the filing’s own words

Implementations relate to providing a user feedback mechanism that enables a user to provide feedback towards one or more specific portions of a response. The response can be generated based on processing of a user query using a generative model such as a large language model (LLM). The one or more specific portions can be a textual portion that includes textual content, and/or a media content portion that include media content such as one or more images, one or more videos, one or more audio pieces, etc. The feedback towards one or more of the specific portions of the response can be utilized in training or fine-tuning the generative model (or an additional generative model) via approaches such as supervised training or reinforced learning.

What exactly they claim (claim 1)

1. A method implemented using one or more processors, the method comprising: receiving a user query, the user query being received via a user interface of a client device; generating, using a generative model, a generative response that is responsive to the user query and that includes at least media content to be rendered and one or more selectable elements to be rendered with respect to media content, wherein each of the one or more selectable elements are selectable and correspond to a respective type of user feedback that evaluates the media content with respect to the user query, and wherein the one or more selectable elements includes a given selectable element that corresponds to negative user feedback; causing the media content to be rendered at the user interface; causing the one or more selectable elements to be rendered at the user interface and with respect to the media content; in response to receiving user input that selects the given selectable element, of the one or more selectable elements, that corresponds to the negative user feedback: determining, based on the received user input that selects the given selectable element, user feedback that evaluates the media content with respect to the user query, wherein determining the user feedback that evaluates the media content with respect to the user query comprises: causing a feedback window to be rendered at the user interface, wherein the feedback window is rendered in response to receiving the user input that selects the given selectable element, and wherein the feedback window includes one or more selectable options each displaying a corresponding description that classifies the negative user feedback; receiving additional user input that selects one of the one or more selectable options; and determining a classification of the negative user feedback based on the additional user input; and training or fine-tuning the generative model based on at least the user feedback that evaluates the media content with respect to the user query, wherein training or fine-tuning the generative model based on the user query and the user feedback that evaluates the media content with respect to the user query comprises: in response to determining that the classification of the negative user feedback is a first classification: reinforcing the generative model to not output a tag or prompt utilized to obtain the media content in response to the user query, and in response to determining that the classification of the negative user feedback is a second classification different from the first classification: rewriting an input prompt that is processed as input using the generative model; and training or fine-tuning the generative model using the rewritten input prompt.

Facts

Company
Google (GOOGLE LLC)
Official title
User feedback for specific portions of responses generated using a large language model (LLM)
Patent number
US12737556B2
Application number
18435750
Filed
Feb 7, 2024
Granted
Sep 15, 2026
Inventors
2
Claims
20

Classified under

G06F 40/40 Physics & computing

More from Google in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.