Nvidia patents method to improve 360-degree camera views for self-driving cars
Nvidia describes a way to create a clear 360-degree view of the area around a vehicle by combining images from multiple cameras. The system calculates how much each part of the view is stretched or magnified and adjusts the image quality processing only for the pixels that are actually visible on the screen.
In the filing’s own words
In various examples, an ego-machine may be equipped with any number and type of sensor(s), the sensor(s) may be used to generate frames of overlapping images, and a reverse projection may be used to sample the image data from corresponding sensor(s) and generate a reverse projection view through a designated or applicable viewport. Regional magnification factors or pixel densities may be measured or computed, and different sampling strategies may be used to sample the image data for different regions of the reverse projection view based on the regional magnification factors or pixel densities to control local sampling strategies in local regions of the reverse projection view. Image quality processing may be performed on the pixels that are visible in the reverse projection view (e.g., instead of on the original image data). The resulting visualization may be presented on a display visible to an occupant or operator of the ego-machine.
What exactly they claim (claim 1)
1. One or more processors comprising processing circuitry to: generate at least one frame representing a reverse projection view of an environment surrounding an ego-machine based at least on reverse projecting from a two-dimensional ( 2 D) viewport to one or more frames of a plurality of frames of image data that represent at least partially overlapping views of the environment; and perform one or more image quality operations to the at least one frame.
Facts
- Company
- Nvidia (NVIDIA CORPORATION)
- Official title
- OPTIMIZATION OF VISIBLE PIXELS FOR SURROUND VIEW AND OTHER ENVIRONMENT VISUALIZATIONS
- Publication number
- US20260330615A1
- Application number
- 19180963
- Filed
- Apr 16, 2025
- Published
- Oct 22, 2026
- Inventors
- 6
- Claims
- 20
Classified under
G06T 5/77 Physics & computingG06T 3/4053 Physics & computingG06T 5/70 Physics & computingG06T 2207/10024 Physics & computingMore from Nvidia in Cars & transport
- Nvidia patents robotaxi system with AI dispatcher and virtual rails Sep 15, 2026
- Nvidia patents car drowsiness check that uses your body clock Oct 13, 2026
- Nvidia patents 3D camera system to measure passengers in vehicles Oct 13, 2026
- Nvidia patents cruise control that predicts driver's next move Oct 20, 2026
- Nvidia patents dual-brain system for self-driving cars Sep 17, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.