Google patents editing photos by typing what you want to change
Google has filed a patent for a system that lets users edit photos using plain English instead of complex software tools. The technology identifies a specific object in an image based on a text description and then modifies that object according to a second set of instructions.
In the filing’s own words
Provided are computer systems and methods for image manipulation based on natural language manipulation instructions. In particular, the present disclosure introduces an entirely new problem space of referring object manipulation (ROM). In ROM, a computer system aims to generate photo-realistic image edits regarding two textual descriptions: 1) a reference text referring to an object in the input image and 2) a target text describing how to manipulate the referred object. The successful ROM models described herein enable users to simply use natural language to manipulate images, removing the need for learning sophisticated image editing software.
What exactly they claim (claim 1)
1. A computer system for image manipulation, the computer system comprising: one or more processors; a machine-learned image manipulation model configured to receive and process an input image and a natural language instruction to generate an edited image in accordance with the natural language instruction, wherein the natural language instruction comprises a reference portion that refers to a region of the input image and a target portion that describes a desired manipulation to be performed in the region of the input image; and one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising: obtaining the input image and the natural language instruction; processing the input image and the natural language instruction with the machine-learned image manipulation model to generate the edited image, wherein the desired manipulation has been performed in the region of the input image to generate the edited image; and providing the edited image as an output.
Facts
- Company
- Google (Google LLC)
- Official title
- Systems And Methods For Image Manipulation Based On Natural Language Manipulation Instructions
- Publication number
- US20260289845A1
- Application number
- 18873289
- Filed
- Jun 8, 2022
- Published
- Sep 24, 2026
- Inventors
- 1
- Claims
- 20
Classified under
G06T 11/60 Physics & computingG06T 5/77 Physics & computingG06T 7/11 Physics & computingMore from Google in AI & software
- Google patents video search that answers questions using AI descriptions Sep 15, 2026
- Google patents photo tool that removes people and their gear Sep 15, 2026
- Google patents AI that writes live meeting notes and summaries Sep 15, 2026
- Google patents AI tool that turns messy emergency notes into clear messages Sep 3, 2026
- Google patents AI that clicks through apps to finish tasks for you Sep 24, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.