Google patents method to fill gaps in panning videos with AI
Google describes a system that takes a video where a camera pans across a scene and uses a machine-learning model to create a full 360-degree view. The software identifies missing parts of the image and generates new pixels to fill those gaps, creating a seamless panoramic video.
In the filing’s own words
A media application receives an input panning video that includes image frames captured with a camera that pans at least once from a first side to a second side. The media application includes reprojecting the input panning video onto a panoramic canvas, wherein the panoramic canvas includes the image frames and missing regions. The media application further includes outputting, with a generative machine-learning model, a panoramic video that includes synthesized pixels for the missing regions of the panoramic canvas by: generating a base video at a coarse temporal scale that includes the synthesized pixels for the missing regions and refining the base video by performing temporal upsampling, merging the temporally upsampled base video with the panoramic canvas, and resynthesizing the synthesized pixels for the missing regions in the base video.
What exactly they claim (claim 1)
1. A computer-implemented method comprising: receiving an input panning video that includes image frames captured with a camera that pans at least once from a first side to a second side; reprojecting the input panning video onto a panoramic canvas, wherein the panoramic canvas includes the image frames and missing regions; and outputting, with a generative machine-learning model, a panoramic video that includes synthesized pixels for the missing regions of the panoramic canvas, wherein the generative machine-learning model outputs the panoramic video by: generating a base video at a coarse temporal scale that includes the synthesized pixels for the missing regions; and refining the base video by performing temporal upsampling, merging the temporally upsampled base video with input pixels from the panoramic canvas, and resynthesizing the synthesized pixels for the missing regions.
Facts
- Company
- Google (Google LLC)
- Official title
- GENERATING PANORAMIC VIDEOS
- Publication number
- US20260320868A1
- Application number
- 19485952
- Filed
- Dec 27, 2024
- Published
- Oct 15, 2026
- Inventors
- 8
- Claims
- 20
Classified under
G06T 11/60 Physics & computingMore from Google in AI & software
- Google patents video search that answers questions using AI descriptions Sep 15, 2026
- Google patents photo tool that removes people and their gear Sep 15, 2026
- Google patents AI that writes live meeting notes and summaries Sep 15, 2026
- Google patents AI tool that turns messy emergency notes into clear messages Sep 3, 2026
- Google patents AI that clicks through apps to finish tasks for you Sep 24, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.