Google patents method to figure out how to read a document image
This patent describes a technique for determining the correct sequence in which to read parts of a scanned document. It combines text and visual details from the image and uses a specific type of computer model to predict the logical reading order.
In the filing’s own words
A method including receiving an image representing a document including a plurality of layout components, identifying textual information associated with the plurality of layout components, identifying visual information associated with the plurality of layout components, combining the textual information with the visual information, and predicting a reading order of the plurality of layout components based on the combined textual information and visual information using a self-attention encoder/decoder.
What exactly they claim (claim 1)
1. A method comprising: receiving an image representing a document including a plurality of layout components; identifying textual information associated with the plurality of layout components; identifying visual information associated with the plurality of layout components; combining the textual information with the visual information; and predicting a reading order of the plurality of layout components based on the combined textual information and visual information using: a self-attention encoder configured to generate an embedding based on a first sequence associated with the plurality of layout components; and a self-attention decoder configured to generate a second sequence based on the embedding.
Facts
- Company
- Google (Google LLC)
- Official title
- Reading order with pointer transformer networks
- Patent number
- US12762882B2
- Application number
- 18686233
- Filed
- Aug 25, 2022
- Granted
- Oct 13, 2026
- Inventors
- 3
- Claims
- 20
Classified under
G06V 30/416 Physics & computingG06V 10/44 Physics & computingG06V 10/82 Physics & computingG06V 30/412 Physics & computingMore from Google in AI & software
- Google patents video search that answers questions using AI descriptions Sep 15, 2026
- Google patents photo tool that removes people and their gear Sep 15, 2026
- Google patents AI that writes live meeting notes and summaries Sep 15, 2026
- Google patents AI tool that turns messy emergency notes into clear messages Sep 3, 2026
- Google patents AI that clicks through apps to finish tasks for you Sep 24, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.