SamsungPatent applicationAR, VR & displaysInterest 8/10

Samsung patents eye-tracking to align video in AR glasses

Illustration of the invention — Illustration based on the patent drawing. Not a photo of a real product.

Patent drawing from the official filing.

Samsung describes a method for AR headsets that uses cameras to track the user's eye position and orientation. The system calculates how to shift and adjust the video feed from the headset's cameras so the virtual image lines up correctly with the real world, even as the user moves their eyes or head.

Why it mattersThis technology could make mixed reality displays feel more natural and less disorienting by ensuring digital objects stay fixed in place relative to the user's actual line of sight.

In the filing’s own words

A method includes obtaining first image frames of a scene captured using one or more see-through cameras of a video-see through (VST) extended reality (XR) device and obtaining second image frames of eyes of a user of the VST XR device. The method also includes determining positions of pupils of the user's eyes and orientations of the user's eyes based on the second image frames. The method further includes determining geometric transformations based on (i) the positions of the user's pupils and the orientations of the user's eyes and (ii) poses of the see-through cameras. In addition, the method includes performing passthrough transformations of the first image frames based on the geometric transformations to generate transformed image frames and rendering images for display based on the transformed image frames.

What exactly they claim (claim 1)

1. A method comprising: obtaining, using at least one processing device of a video-see through (VST) extended reality (XR) device, first image frames of a scene captured using one or more see-through cameras of the VST XR device; obtaining, using the at least one processing device, second image frames of eyes of a user of the VST XR device; determining, using the at least one processing device, positions of pupils of the user's eyes and orientations of the user's eyes based on the second image frames; determining, using the at least one processing device, geometric transformations based on (i) the positions of the user's pupils and the orientations of the user's eyes and (ii) poses of the see-through cameras; performing, using the at least one processing device, passthrough transformations of the first image frames based on the geometric transformations to generate transformed image frames; and rendering, using the at least one processing device, images for display based on the transformed image frames.

Facts

Company: Samsung (Samsung Electronics Co., Ltd.)
Official title: DYNAMICALLY-ADAPTIVE GEOMETRIC TRANSFORMATIONS BASED ON EYE POSE AND CAMERA POSE CHANGES FOR VIDEO SEE-THROUGH (VST) EXTENDED REALITY (XR)
Publication number: US20260340769A1
Application number: 19552999
Filed: Feb 27, 2026
Published: Oct 29, 2026
Inventors: 1
Claims: 20

Classified under

G06T 3/60 Physics & computingG06T 3/20 Physics & computingG06V 40/18 Physics & computing

Read the full filing (official PDF) ↗ Open in the Patent Tracker

More from Samsung in AR, VR & displays

Samsung patents AR glasses that hide real-world objects on demand Nov 3, 2026
Samsung patents screen that predicts where your eyes will look next Sep 29, 2026
Samsung patents VR system that overlays real-world objects based on user actions Oct 27, 2026
Samsung patents AR glasses that dim bright spots to prevent glare Nov 3, 2026
Samsung patents HMD that shows hidden body parts from another headset Nov 3, 2026

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.