Apple patents AR feature that shows photo thumbnails to clarify search targets
Apple has been granted a patent for a head-mounted device that helps users visually search for specific items in their surroundings. When the device identifies a potential match, it displays a cropped photo thumbnail on the screen to confirm exactly which physical object is being searched for. If the image quality or conditions do not meet specific criteria, the system switches to showing a different, pre-stored image instead.
In the filing’s own words
A head-mounted device may be used to perform a visual search on a physical environment around the head-mounted device. A user may wish to visually search one out of multiple physical objects in the physical environment. To clearly show the user which physical object was the target of a visual search, the head-mounted device may present a thumbnail of the candidate physical object on a display. The thumbnail may be cropped and/or zoomed using an image from a camera on the head-mounted device. By displaying a thumbnail that is taken by a camera on the head-mounted device, the thumbnail will directly match the physical object in the user's physical environment, eliminating ambiguity regarding which physical object is the subject of the visual search.
What exactly they claim (claim 1)
1. An electronic device comprising: one or more sensors; one or more displays; one or more processors; and memory storing instructions configured to be executed by the one or more processors, the instructions for: selecting a subset of a physical environment for a visual search; obtaining, via a first subset of the one or more sensors, an image of the subset of the physical environment; determining a characteristic of the image of the subset of the physical environment; in accordance with a determination that the characteristic satisfies a criterion, presenting, using the one or more displays, a thumbnail that includes the image of the subset of the physical environment; and in response to determining that the characteristic fails to satisfy the criterion, foregoing presenting the thumbnail and presenting an additional image associated with the visual search of the subset of the physical environment, the additional image different than the obtained image of the subset of the physical environment.
Facts
- Company
- Apple (Apple Inc.)
- Official title
- Thumbnail for disambiguation in a visual search
- Patent number
- US12801324B2
- Application number
- 19212201
- Filed
- May 19, 2025
- Granted
- Nov 17, 2026
- Inventors
- 12
- Claims
- 18
Classified under
G06F 3/14 Physics & computingG06F 3/012 Physics & computingG06F 3/013 Physics & computingG06F 3/017 Physics & computingMore from Apple in AR, VR & displays
- Apple patents AR glasses that zoom in on what you look at Sep 8, 2026
- Apple patents finger ring that controls VR with taps and waves Sep 15, 2026
- Apple patents head-mounted device that types via eye swipes and hand pinches Oct 6, 2026
- Apple patents eye-tracking and hand gestures to select screen items Oct 20, 2026
- Apple patents AR glasses that adjust lens spacing to fit your eyes Nov 3, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.