Amazon patents method to translate text in product images
Amazon has filed a patent for a system that automatically translates text found in product images, such as infographics or diagrams. The technology identifies which parts of the text need translation, removes them to create a blank space, and then places the translated text back into the image while adjusting the layout to fit.
In the filing’s own words
Systems and methods are provided for selectively translating text present in an infographic image describing an item. Text is identified within an image and classified as to-be-translated or not-to-be-translated text. The to-be-translated text is removed from the image to create and empty image. The to-be translated text is translated from a first language to a second language. The layout of the empty image is modified based on the translated text. The translated text is superimposed on the modified empty image.
What exactly they claim (claim 1)
1. A system comprising: at least one processor, and at least one non-transitory storage media storing instructions that, when executed by the at least one processor, cause the at least one processor to: detect text within an image, wherein the text comprises one or more lines of text, and wherein the text is in a first language; identify one or more bounding boxes associated with the one or more lines of text within the image; classify a first portion of the text as text to be translated and a second portion of the text as text not to be translated; group the one or more lines of the text associated with the first portion of the text into one or more semantic groups; translate, each of the one or more semantic groups of the first portion of the text, from the first language to a second language; generate an empty image by removing the first portion of text from the image, wherein the empty image comprises the second portion of the text; modify a text layout of at least one text box associated with the empty image based on the translated first portion of the text; and render a localized image comprising the empty image superimposed with the translated first portion of the text.
Facts
- Company
- Amazon (Amazon Technologies, Inc.)
- Official title
- MAINTAINING ITEM IDENTITY IN TRANSLATED IMAGES
- Publication number
- US20260301258A1
- Application number
- 19093115
- Filed
- Mar 27, 2025
- Published
- Oct 1, 2026
- Inventors
- 6
- Claims
- 20
Classified under
G06T 11/60 Physics & computingG06F 40/58 Physics & computingG06T 11/10 Physics & computingG06V 30/148 Physics & computingMore from Amazon in AI & software
- Amazon patents system that cites sources for AI answers Sep 29, 2026
- Amazon patents tech to swap words in movies using actor's voice Sep 8, 2026
- Amazon patents ML tool to add graphics to live sports from moving cameras Sep 15, 2026
- Amazon patents shopping assistant that remembers your search filters Oct 6, 2026
- Amazon patents system where AI agents split tasks and talk to each other Oct 20, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.