MicrosoftGranted patentCameras & imagingInterest 6/10

Microsoft patents camera system that removes unwanted objects from photos

Patent drawing
Patent drawing from the official filing.

This patent describes a device with two cameras that work together to clean up images. One camera captures the main scene while the other helps identify objects that do not belong, such as a person walking into the frame. The device then uses depth data to replace those unwanted objects with the background pixels from the original image.

Why it mattersThis could make taking clean photos in busy places easier by automatically fixing common mistakes like people walking into the shot.

In the filing’s own words

A computing device is provided. The computing device may include a first camera configured to capture a primary image sequence of a scene, and a second camera configured to substantially concurrently capture a secondary image sequence of the scene. The computing device may include a processor configured to execute instructions stored in memory to obtain a depth map for an image of the primary image sequence, and based on the depth map, generate a reference frame of background pixels from the primary image sequence. The processor may be configured to execute the instructions to detect an intrusive object in the secondary image sequence, replace the intrusive object in the primary image sequence with corresponding background pixels of the reference frame to generate a modified primary image sequence, and output on a display at least one image of the modified primary image sequence.

What exactly they claim (claim 1)

1. A computing device, comprising: a first camera configured to capture a primary image sequence of a scene; a second camera configured to substantially concurrently capture a secondary image sequence of the scene; and a processor configured to execute instructions stored in memory to: generate a reference frame of background pixels from the primary image sequence; detect objects in the secondary image sequence; determine that one of the detected objects is an intrusive object based on at least one of pose and distance from a principal subject from among the detected objects; replace the intrusive object in the primary image sequence with corresponding background pixels of the reference frame to generate a modified primary image sequence; and output on a display at least one image of the modified primary image sequence.

Facts

Company
Microsoft (Microsoft Technology Licensing, LLC)
Official title
Device for replacing intrusive object in images
Patent number
US12776005B2
Application number
18899788
Filed
Sep 27, 2024
Granted
Oct 27, 2026
Inventors
4
Claims
20

Classified under

G06T 5/50 Physics & computingG06T 7/55 Physics & computingG06V 10/25 Physics & computingG06V 10/26 Physics & computingG06T 2207/20221 Physics & computingG06T 2207/20224 Physics & computing

More from Microsoft in Cameras & imaging

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.