Samsung patents AR feature that suggests app actions based on what you see
Samsung describes a system where a phone analyzes a photo or camera view to identify objects and the surrounding scene. It then overlays interactive suggestions on the screen, recommending specific app functions that match the detected items and the user's habits.
In the filing’s own words
A method for providing augmented reality (AR) recommendations to a user by an electronic device include displaying, by the electronic device, an image on a screen of the electronic device, identifying, by the electronic device, at least one real world object in the image, determining, by the electronic device, at least one function of at least one application installed in the electronic device based on the at least one identified real world object, and augmenting, by the electronic device, the at least one function of the at least one application as an AR recommendation over the image.
What exactly they claim (claim 1)
1. A method for providing actionable content in an electronic device, the method comprising: obtaining, by the electronic device, an image; extracting, by the electronic device, scene information by analyzing a scene from the obtained image; identifying, by the electronic device, at least one object from the scene information; determining, by the electronic device, at least one scene description from the scene information and the at least one object; determining, by the electronic device, a scene context based on the at least one object and the at least one scene description, wherein the scene context comprises activity related with the at least one object; determining, by the electronic device, a user context including a temporal context or a network context; displaying, by the electronic device, an augmented reality (AR) mode providing visual suggestion over the image; identifying, by the electronic device, a user's input selecting the AR mode; extracting, by the electronic device, a list of application functions based on the at least one object; filtering, by the electronic device, application functions from the list of application functions based on the scene context and the user context; prioritizing, by the electronic device, the filtered application functions based on a historical usage frequency of the filtered application functions; displaying, by the electronic device, an interactive message corresponding to at least one of the prioritized application functions at a position corresponding to the at least one object; receiving, by the electronic device, a user's selection on the displayed interactive message; in response to receiving the user's selection on the displayed interactive message, displaying, by the electronic device and at a position corresponding to the interactive message, an application icon corresponding to an application configured to execute an application function corresponding to the displayed interactive message; and launching, by the electronic device, the application configured to execute the application function corresponding to the displayed interactive message based on a user's selection from the displayed application icon.
Facts
- Company
- Samsung (SAMSUNG ELECTRONICS CO., LTD.)
- Official title
- Method and electronic device for providing augmented reality recommendations
- Patent number
- US12738053B2
- Application number
- 18071968
- Filed
- Nov 30, 2022
- Granted
- Sep 15, 2026
- Inventors
- 5
- Claims
- 15
Classified under
G06V 20/20 Physics & computingG06F 3/0482 Physics & computingG06F 9/451 Physics & computingG06T 11/00 Physics & computingG06V 10/764 Physics & computingMore from Samsung in AR, VR & displays
- Samsung patents screen that predicts where your eyes will look next Sep 29, 2026
- Samsung patents AR headset that adjusts images using eye tracking Sep 17, 2026
- Samsung patents camera feature that identifies objects and shows AR info Sep 17, 2026
- Samsung patents method to animate avatars from photos and voice Sep 24, 2026
- Samsung patents AR glasses that blend real objects into virtual scenes Oct 1, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.