AppleGranted patentAR, VR & displaysInterest 6/10

Apple patents AR feature that shows photo thumbnails to clarify search targets

Apple has been granted a patent for a head-mounted device that helps users visually search for specific items in their surroundings. When the device identifies a potential match, it displays a cropped photo thumbnail on the screen to confirm exactly which physical object is being searched for. If the image quality or conditions do not meet specific criteria, the system switches to showing a different, pre-stored image instead.

Why it mattersThis feature could make augmented reality searches more intuitive by visually confirming targets, reducing confusion when multiple similar objects are present in a user's field of view.

In the filing’s own words

A head-mounted device may be used to perform a visual search on a physical environment around the head-mounted device. A user may wish to visually search one out of multiple physical objects in the physical environment. To clearly show the user which physical object was the target of a visual search, the head-mounted device may present a thumbnail of the candidate physical object on a display. The thumbnail may be cropped and/or zoomed using an image from a camera on the head-mounted device. By displaying a thumbnail that is taken by a camera on the head-mounted device, the thumbnail will directly match the physical object in the user's physical environment, eliminating ambiguity regarding which physical object is the subject of the visual search.

What exactly they claim (claim 1)

1. An electronic device comprising: one or more sensors; one or more displays; one or more processors; and memory storing instructions configured to be executed by the one or more processors, the instructions for: selecting a subset of a physical environment for a visual search; obtaining, via a first subset of the one or more sensors, an image of the subset of the physical environment; determining a characteristic of the image of the subset of the physical environment; in accordance with a determination that the characteristic satisfies a criterion, presenting, using the one or more displays, a thumbnail that includes the image of the subset of the physical environment; and in response to determining that the characteristic fails to satisfy the criterion, foregoing presenting the thumbnail and presenting an additional image associated with the visual search of the subset of the physical environment, the additional image different than the obtained image of the subset of the physical environment.

Facts

Company
Apple (Apple Inc.)
Official title
Thumbnail for disambiguation in a visual search
Patent number
US12801324B2
Application number
19212201
Filed
May 19, 2025
Granted
Nov 17, 2026
Inventors
12
Claims
18

Classified under

G06F 3/14 Physics & computingG06F 3/012 Physics & computingG06F 3/013 Physics & computingG06F 3/017 Physics & computing

More from Apple in AR, VR & displays

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.