Nvidia patents 3D camera system to measure passengers in vehicles
Nvidia describes a system that uses a camera to create a 3D model of a person inside a vehicle. It combines a standard image with depth information to estimate the passenger's size, pose, and potential weight.
In the filing’s own words
In various examples, image-based three-dimensional occupant assessment for in-cabin monitoring systems and applications are provided. An evaluation function may determine a 3D representation of an occupant of a machine by evaluating sensor data comprising an image frame from an optical image sensor. The 3D representation may comprise at least one characteristic representative of a size of the occupant, (e.g., a 3D pose and/or 3D shape), which may be used to derive other characteristics such as, but not limited to weight, height, and/or age. A first processing path may generate a representation of one or more features corresponding to at least a portion of the occupant based on optical image data, and a second processing path may determine a depth corresponding to the one or more features based on depth data derived from the optical image data and ground truth depth data corresponding to the interior of the machine.
What exactly they claim (claim 1)
1. A system comprising: one or more processing units comprising circuitry to: detect one or more features representing at least a portion of an occupant of a machine based at least on two-dimensional optical image data; determine a depth corresponding to the one or more features based at least on the optical image data and a ground truth cabin depth image corresponding to an interior of the machine; generate a three-dimensional representation of the occupant based at least on the one or more features and the depth of the one or more features, wherein the three-dimensional representation comprises at least one characteristic representative of a size of the occupant; and control at least one operation of the machine based at least on the at least one characteristic.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- Image-based three-dimensional occupant assessment for in-cabin monitoring systems and applications
- Patent number
- US12762869B2
- Application number
- 18349853
- Filed
- Jul 10, 2023
- Granted
- Oct 13, 2026
- Inventors
- 8
- Claims
- 20
Classified under
G06V 20/59 Physics & computingG06T 7/50 Physics & computingG06T 17/00 Physics & computingG06T 2207/20081 Physics & computingG06T 2207/20084 Physics & computingG06T 2207/30268 Physics & computingMore from Nvidia in Cars & transport
- Nvidia patents robotaxi system with AI dispatcher and virtual rails Sep 15, 2026
- Nvidia patents car drowsiness check that uses your body clock Oct 13, 2026
- Nvidia patents cruise control that predicts driver's next move Oct 20, 2026
- Nvidia patents dual-brain system for self-driving cars Sep 17, 2026
- Nvidia patents method for self-driving cars to see around corners Sep 17, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
