Sony patents method to boost visible photos using multispectral data
Sony describes a system that combines a standard visible-light photo with a multispectral image of the same scene. It uses a trained machine-learning model to process both inputs and produce a new visible-light image with improved quality or properties.
In the filing’s own words
An apparatus for image enhancement is provided. The apparatus includes interface circuitry configured to receive first image data representing a multispectral image of a scene. The interface circuitry is further configured to receive second image data representing a first image of the scene in the visible light spectrum. In addition, the apparatus includes processing circuitry configured to generate, based on the multispectral image of the scene and the first image of the scene in the visible light spectrum and using a trained machine learning model for image enhancement, a second image of the scene in the visible light spectrum with at least one enhanced image property compared to the first image of the scene in the visible light spectrum.
What exactly they claim (claim 1)
1. An apparatus for image enhancement, the apparatus comprising: interface circuitry configured to: receive first image data representing a multispectral image of a scene; and receive second image data representing a first image of the scene in the visible light spectrum; and processing circuitry configured to generate, based on the multispectral image of the scene and the first image of the scene in the visible light spectrum and using a trained machine-learning model for image enhancement, a second image of the scene in the visible light spectrum with at least one enhanced image property compared to the first image of the scene in the visible light spectrum.
Facts
- Company
- Sony (Sony Semiconductor Solutions Corporation)
- Official title
- APPARATUS AND METHOD FOR IMAGE ENHANCEMENT AND APPARATUS AND METHOD FOR TRAINING A MACHINE-LEARNING MODEL FOR IMAGE ENHANCEMENT
- Publication number
- US20260268452A1
- Application number
- 19167398
- Filed
- Mar 21, 2024
- Published
- Sep 10, 2026
- Inventors
- 5
- Claims
- 16
Classified under
G06T 5/60 Physics & computingG06T 3/4015 Physics & computingG06T 7/337 Physics & computingH04N 23/11 Electricity & electronicsH04N 23/13 Electricity & electronicsG06T 2207/20081 Physics & computingMore from Sony in AI & software
- Sony patents AI that plays video games in your style Oct 6, 2026
- Sony patents AI that swaps game visuals for accessibility formats Sep 17, 2026
- Sony patents AI that changes game characters based on your play Oct 1, 2026
- Sony patents method to turn 2D videos into high-detail 3D animations Oct 15, 2026
- Sony patents AI bots that mimic your friends' gaming styles Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.