Google patents video tool that fills in hidden backgrounds during calls

1. A method comprising: determining a first background layer and a first foreground layer of a first frame of a video stream provided by a client device associated with a first participant of a plurality of participants of a video conference; determining, during the video conference, a second background layer and a second foreground layer of a second frame of the video stream; combining, during the video conference, the first background layer and the second background layer to obtain a combined background layer, wherein the combined background layer comprises a region obscured by both the first foreground layer and the second foreground layer; performing, during the video conference and using a generative machine learning model, inpainting of the obscured region to obtain an image of the obscured region; modifying, during the video conference and using the image of the obscured region and the combined background layer, background layers of subsequent frames of the video stream; performing iterative modifications on the image for subsequent frames of the video stream as portions of the obscured region are revealed, wherein the iterative modifications are performed until a fidelity level of the combined background layer satisfies a fidelity level criterion, wherein the fidelity level is based on an area of the combined background layer compared to an area of the image of the obscured region combined with the area of the combined background layer; and providing, during the video conference, the video stream with modified background layers for presentation on one or more client devices of one or more of the plurality of participants of the video conference.