Microsoft patents camera system that removes unwanted objects from photos
This patent describes a device with two cameras that work together to clean up images. One camera captures the main scene while the other helps identify objects that do not belong, such as a person walking into the frame. The device then uses depth data to replace those unwanted objects with the background pixels from the original image.
In the filing’s own words
A computing device is provided. The computing device may include a first camera configured to capture a primary image sequence of a scene, and a second camera configured to substantially concurrently capture a secondary image sequence of the scene. The computing device may include a processor configured to execute instructions stored in memory to obtain a depth map for an image of the primary image sequence, and based on the depth map, generate a reference frame of background pixels from the primary image sequence. The processor may be configured to execute the instructions to detect an intrusive object in the secondary image sequence, replace the intrusive object in the primary image sequence with corresponding background pixels of the reference frame to generate a modified primary image sequence, and output on a display at least one image of the modified primary image sequence.
What exactly they claim (claim 1)
1. A computing device, comprising: a first camera configured to capture a primary image sequence of a scene; a second camera configured to substantially concurrently capture a secondary image sequence of the scene; and a processor configured to execute instructions stored in memory to: generate a reference frame of background pixels from the primary image sequence; detect objects in the secondary image sequence; determine that one of the detected objects is an intrusive object based on at least one of pose and distance from a principal subject from among the detected objects; replace the intrusive object in the primary image sequence with corresponding background pixels of the reference frame to generate a modified primary image sequence; and output on a display at least one image of the modified primary image sequence.
Facts
- Company
- Microsoft (Microsoft Technology Licensing, LLC)
- Official title
- Device for replacing intrusive object in images
- Patent number
- US12776005B2
- Application number
- 18899788
- Filed
- Sep 27, 2024
- Granted
- Oct 27, 2026
- Inventors
- 4
- Claims
- 20
Classified under
G06T 5/50 Physics & computingG06T 7/55 Physics & computingG06V 10/25 Physics & computingG06V 10/26 Physics & computingG06T 2207/20221 Physics & computingG06T 2207/20224 Physics & computingMore from Microsoft in Cameras & imaging
- Microsoft patents camera pixels that turn off to save power and reduce noise Nov 17, 2026
- Microsoft patents thermal lens design for better center detection Oct 1, 2026
- Microsoft patents method to fill gaps in 3D depth maps from sparse data Nov 10, 2026
- Microsoft patents method for aligning images from different sensors Sep 8, 2026
- Microsoft patents method to limit faulty pixels in camera images Nov 10, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
