Google patents AI tool that removes lens flare from photos
This patent describes a method that uses a machine learning model to detect and remove lens flare, a common light artifact, from digital images. The system can also adjust the amount of flare present, allowing users to either eliminate it entirely or modify its appearance in the final picture.
In the filing’s own words
A method includes obtaining an input image that contains a particular representation of lens flare, and processing the input image by a machine learning model to generate a de-flared image that includes the input image with at least part of the particular representation of lens flare removed. The machine learning (ML) model may be trained by generating training images that combine respective baseline images with corresponding lens flare images. For each respective training image, a modified image may be determined by processing the respective training image by the ML model, and a loss value may be determined based on a loss function comparing the modified image to a corresponding baseline image used to generate the respective training image. Parameters of the ML model may be adjusted based on the loss value determined for each respective training image and the loss function.
What exactly they claim (claim 1)
1. A computer-implemented method comprising: obtaining an input image that contains a visual representation of lens flare; generating, based on processing the input image by a machine learning model, (i) a de-flared image comprising the input image with at least part of the visual representation of lens flare removed and (ii) a recovered lens flare image, wherein: the de-flared image is generated by the machine learning model and the recovered lens flare image is based on a difference between the de-flared image and the input image; or the recovered lens flare image is generated by the machine learning model, and the de-flared image is based on a difference between the recovered lens flare image and the input image; generating a modified version of the input image by adjusting the visual representation of lens flare in the input image based on the recovered lens flare image, wherein the modified version of the input image comprises an adjusted visual representation of lens flare that differs from the visual representation of lens flare in the input image; and outputting the modified version of the input image.
Facts
- Company
- Google (Google LLC)
- Official title
- Learning-based lens flare removal
- Patent number
- US12771960B2
- Application number
- 18734000
- Filed
- Jun 5, 2024
- Granted
- Oct 20, 2026
- Inventors
- 6
- Claims
- 20
Classified under
H04N 25/615 Electricity & electronicsG06T 3/40 Physics & computingG06T 5/10 Physics & computingG06T 5/20 Physics & computingG06T 5/60 Physics & computingG06T 5/80 Physics & computingMore from Google in AI & software
- Google patents video search that answers questions using AI descriptions Sep 15, 2026
- Google patents photo tool that removes people and their gear Sep 15, 2026
- Google patents AI that writes live meeting notes and summaries Sep 15, 2026
- Google patents AI tool that turns messy emergency notes into clear messages Sep 3, 2026
- Google patents AI that clicks through apps to finish tasks for you Sep 24, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.