Apple patents method to track 3D object size and position using mixed sensor data
Apple describes a technique for estimating the three-dimensional size and location of objects by analyzing video frames. The system uses depth data when available, but when depth information is missing, it relies on previous size estimates and image details to calculate the object's position.
In the filing’s own words
Various implementations of the systems, methods, and electronic devices described herein estimate three-dimensional (3D) size and position of objects. An example process may include obtaining sensor data for a sequence of frames, determining a representation of an object, and determining 3D positions and size estimates. For each frame that includes image data and depth data, the 3D position is determined based on the device pose data and the depth data for each corresponding frame, and the size estimate is determined based on the image data and the depth data. For each frame of the sequence of frames that includes image data and excludes depth data, the size estimate is determined based on a prior size estimate from a prior frame, and the 3D position is determined based on the size estimate of the representation of the object and a portion of the image data.
What exactly they claim (claim 1)
1. A method comprising: at a device having a processor: obtaining a representation of an object; and for a frame of a sequence of frames of sensor data associated with the object that includes image data and excludes depth data, determining a three-dimensional (3D) position and a size estimate of the representation of the object, wherein (i) the size estimate is determined based on a prior size estimate from a prior frame of the sequence of frames that included image data and depth data, and (ii) the 3D position is determined based on the size estimate and a portion of the image data.
Facts
- Company
- Apple (Apple Inc.)
- Official title
- SIZE AND POSITION ESTIMATION DETERMINATION OF 3D OBJECTS
- Publication number
- US20260301215A1
- Application number
- 19709494
- Filed
- Jun 16, 2026
- Published
- Oct 1, 2026
- Inventors
- 6
- Claims
- 20
Classified under
G06T 7/70 Physics & computingG06T 7/20 Physics & computingG06T 7/62 Physics & computingG06T 17/00 Physics & computingMore from Apple in AI & software
- Apple patents AI that acts on voicemails for you Oct 15, 2026
- Apple patents letting users teach custom hand gestures to their devices Oct 22, 2026
- Apple patents AI that acts on voicemails for you Sep 1, 2026
- Apple patents video tool that swaps focus between subjects after filming Oct 20, 2026
- Apple patents system that changes room ambience based on what you look at Sep 3, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.