Sony patents method to fix video glitches using motion data

1. An image processing system comprising: at least one processor; and computer-readable media storing instructions which, when executed by the at least one processor, cause the image processing system to perform operations comprising: acquiring first through n-th input frames by rendering three dimensional data indicating one or more objects and in which a virtual space is viewed from a predetermined viewpoint; and acquiring an n-th estimated frame that is to be output from a machine learning model as a result of an n-th input frame and (n-1)-th auxiliary information being input to the machine learning model, the (n-1)-th auxiliary information being based on (n-1)-th feature information indicating a feature of an (n-1)-th input frame, wherein acquiring the n-th estimated frame comprises: acquiring (n-1)-th depth information indicating a depth of each pixel of the (n-1)-th input frame and n-th depth information indicating a depth of each pixel of the n-th input frame; identifying, based on the (n-1)-th depth information and the n-th depth information, an appearing pixel that is among pixels of the n-th input frame and is in an area in which a whole or part of an object of the one or more objects not displayed in the (n-1)-th input frame; acquiring the (n-1)-th auxiliary information by replacing a pixel value of the appearing pixel in the (n-1)-th feature information with a predetermined value; acquiring an (n-1)-th amount of motion indicating magnitude of motion in each pixel of the (n-1)-th input frame and an n-th amount of motion indicating magnitude of motion in each pixel of the n-th input frame; and when the (n-1)-th amount of motion in a predetermined pixel in the (n-1)-th input frame is less than a first threshold and the n-th amount of motion in the predetermined pixel in the n-th input frame is less than a second threshold, input the n-th input frame and (n-1)-th auxiliary information to the machine learning model to acquire the n-th estimate frame.