Samsung patents method to focus on key sentences before processing words
Samsung describes a computer method that first looks at whole sentences to find the most important ones based on a score. It then breaks only those selected sentences into smaller parts called tokens to perform a deeper attention operation. This two-step process aims to help a processor focus its effort on relevant information within a text.
In the filing’s own words
A processor-implement method including converting an input sequence to a sentence vector matrix, calculating a sentence-level attention score based on the sentence vector matrix, selecting, from among sentences of the input sequence, a sentence with the sentence-level attention score being greater than or equal to a threshold value, converting the selected sentence to a token vector matrix, and performing an attention operation based on the token vector matrix.
What exactly they claim (claim 1)
1. A processor-implemented method, the method comprising: converting an input sequence to a sentence vector matrix; calculating a sentence-level attention score based on the sentence vector matrix; selecting, from among sentences of the input sequence, a sentence with the sentence-level attention score being greater than or equal to a threshold value; converting the selected sentence to a token vector matrix; and performing an attention operation based on the token vector matrix.
Facts
- Company
- Samsung (SAMSUNG ELECTRONICS CO., LTD.)
- Official title
- METHOD AND DEVICE WITH HIERARCHAL ATTENTION OPERATION
- Publication number
- US20260267891A1
- Application number
- 19325742
- Filed
- Sep 11, 2025
- Published
- Sep 10, 2026
- Inventors
- 3
- Claims
- 15
Classified under
G06F 16/3347 Physics & computingG06F 40/284 Physics & computingMore from Samsung in AI & software
- Samsung patents tool to erase objects from photos using AI Sep 24, 2026
- Samsung patents drawing objects into photos with AI Oct 15, 2026
- Samsung patents AI that creates personalized exercise videos Sep 10, 2026
- Samsung patents AI summaries for paused TV shows based on your viewing habits Sep 24, 2026
- Samsung patents turning chat conversations into image prompts Oct 1, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.