Samsung patents camera feature that identifies objects and shows AR info
Samsung describes a system that uses a camera to detect objects in real-time while showing the live feed on a screen. It combines a standard database search with a Vision Language Model to analyze the detected object, then overlays text and visual markers on the screen to provide information about it.
In the filing’s own words
Artificial intelligence in camera with augmented reality (AR) includes detecting, by a device, an object in a camera feed concurrently with displaying the camera feed on a display screen of the device. A knowledge based is queried with a knowledge base query including a bounding box image of the object detected from the camera feed. A Vision Language Model (VLM) performs inference in response to a VLM request specifying the bounding box image of the object and a knowledge base result obtained from the knowledge base query. The inference generates a VLM result. An AR overlay is displayed on the display screen of the device over the camera feed. The AR overlay visually distinguishes the object within the camera feed and displays VLM information for the object specified by the VLM result.
What exactly they claim (claim 1)
1. A method, comprising: within a device, detecting an object in a camera feed concurrently with displaying the camera feed on a display screen of the device; querying a knowledge base with a knowledge base query including a bounding box image of the object detected from the camera feed; performing inference using a Vision Language Model (VLM) in response to a VLM request specifying the bounding box image of the object and a knowledge base result obtained from the knowledge base query, wherein the inference generates a VLM result; and displaying, on the display screen of the device, an augmented reality (AR) overlay over the camera feed, wherein the AR overlay visually distinguishes the object within the camera feed and displays VLM information for the object specified by the VLM result.
Facts
- Company
- Samsung (SAMSUNG ELECTRONICS CO., LTD.)
- Official title
- ARTIFICIAL INTELLIGENCE IN CAMERA WITH AUGMENTED REALITY
- Publication number
- US20260279081A1
- Application number
- 19376863
- Filed
- Oct 31, 2025
- Published
- Sep 17, 2026
- Inventors
- 2
- Claims
- 20
Classified under
G06V 20/70 Physics & computingG06T 19/006 Physics & computingG06V 20/20 Physics & computingMore from Samsung in AR, VR & displays
- Samsung patents screen that predicts where your eyes will look next Sep 29, 2026
- Samsung patents AR headset that adjusts images using eye tracking Sep 17, 2026
- Samsung patents method to animate avatars from photos and voice Sep 24, 2026
- Samsung patents AR glasses that blend real objects into virtual scenes Oct 1, 2026
- Samsung patents AR glasses tech to sharpen virtual images by blocking light Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.