Sony patents video trick to erase ghosting from moving objects
Sony describes a system that cleans up video frames by finding areas where moving objects create blurry 'ghosts.' It uses a deep learning network to predict the current image based on this cleaned-up history.
In the filing’s own words
An information processing apparatus includes a motion compensation unit, an occlusion region detection unit, a ghost removal unit, and a DNN. The motion compensation unit performs motion compensation on an inference result for a past frame to generate corrected history. The occlusion region detection unit detects an occlusion region in the corrected history in which a ghost may occur based on a motion vector indicating a motion of a subject between frames. The ghost removal unit performs ghost removal processing on the occlusion region. The DNN infers a current frame, based on the corrected history subjected to the ghost removal processing and current which is an image of the current frame to be processed.
What exactly they claim (claim 1)
1. An information processing apparatus comprising: a motion compensation unit configured to generate corrected history by performing motion compensation on an inference result for a past frame; an occlusion region detection unit configured to detect an occlusion region in the corrected history in which a ghost has a possibility of occurring, based on a motion vector indicating a motion of a subject between frames; a ghost removal unit configured to perform ghost removal processing on the occlusion region; and a DNN configured to infer a current frame, based on the corrected history on which the ghost removal processing has been performed and current that is an image of the current frame to be processed.
Facts
- Company
- Sony (Sony Group Corporation)
- Official title
- INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND COMPUTER-READABLE NON-TRANSITORY STORAGE MEDIUM
- Publication number
- US20260289753A1
- Application number
- 19490958
- Filed
- Nov 28, 2023
- Published
- Sep 24, 2026
- Inventors
- 1
- Claims
- 11
Classified under
G06T 5/77 Physics & computingG06T 5/60 Physics & computingG06T 7/248 Physics & computingG06T 7/50 Physics & computingG06V 10/25 Physics & computingG06V 10/26 Physics & computingMore from Sony in AI & software
- Sony patents AI that plays video games in your style Oct 6, 2026
- Sony patents AI that swaps game visuals for accessibility formats Sep 17, 2026
- Sony patents AI that changes game characters based on your play Oct 1, 2026
- Sony patents method to turn 2D videos into high-detail 3D animations Oct 15, 2026
- Sony patents AI bots that mimic your friends' gaming styles Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.