Nvidia patents method to remove objects from 3D scenes consistently
Nvidia describes a technique for editing 3D environments by removing objects while filling in the hidden background. It uses a diffusion model to predict what should be behind the removed items, ensuring the new background looks correct from every viewing angle.
In the filing’s own words
Mechanisms to process multi-view RGB images and object masks into an inpainted Gaussian representation with removed objects, wherein occluded regions are consistently inpainted across views. A diffusion model trained with object masks in operated to remove objects from the scene and refined unseen mask generation, depth-aware Gaussian initialization, and SDEdit-like RGB detail enhancement are performed to produce the final rendered views.
What exactly they claim (claim 1)
1. A computer-implemented process for geometrically aligned depth and multiview-consistent scene reconstruction, the process comprising: transforming an image latent representation, an incomplete depth map comprising known depth values and missing depth values, and an unseen mask identifying missing regions in the incomplete depth map to generate a set of depth initialized Gaussians; rendering training views using the depth initialized Gaussians; for each rendered training view: generating a noisy version of the rendered training view by injecting noise across multiple iterations; and applying a diffusion denoising process to the noisy version of the rendered training view to generate an inpainted image for the training view.
Facts
- Company
- Nvidia (NVIDIA Corp.)
- Official title
- AUGMENTED UNSEEN REGION ALIGNMENT FOR REFERENCE-BASED SCENE INPAINTING
- Publication number
- US20260268580A1
- Application number
- 19543594
- Filed
- Feb 18, 2026
- Published
- Sep 10, 2026
- Inventors
- 6
- Claims
- 20
Classified under
G06T 15/08 Physics & computingG06N 3/0475 Physics & computingG06T 5/30 Physics & computingG06T 5/70 Physics & computingG06T 5/77 Physics & computingG06T 7/10 Physics & computingMore from Nvidia in AR, VR & displays
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.