Sony patents camera system that uses AI to decide what data to process
Sony describes a sensor device where a camera chip sends data to a processor only when a trigger unit decides it is needed. The system uses machine learning to coordinate the camera, the trigger, and the processor so they work together efficiently.
In the filing’s own words
A sensor device includes a vision sensor with a pixel array that receives light, performs photoelectric conversion, and outputs a data stream; a trigger unit that receives portions of the data stream and generates trigger signals based on the portions and, optionally, feedback from a processing unit; and the processing unit, which receives the trigger signals and executes predetermined processing on the indicated portions of the data stream. The processing unit employs a first machine-learning module trained to optimize the predetermined processing jointly with a second machine-learning module used by the trigger unit to produce the trigger signals and/or a third machine-learning module used by the vision sensor to generate the data stream.
What exactly they claim (claim 1)
1. A sensor device comprising: a vision sensor that comprises a pixel array having a plurality of pixels each being configured to receive light and to perform photoelectric conversion to generate an electrical signal, based on which electrical signals a data stream is formed and output by the vision sensor; a trigger unit that is configured to receive portions of the data stream and to generate trigger signals based on said portions of the data stream; and a processing unit that is configured to receive the trigger signals and to carry out a predetermined processing of a portion of the data stream for which the predetermined processing was indicated to be allowed by the respective trigger signal; wherein the processing unit is configured to use a first machine learning module to carry out the predetermined processing which first machine learning module has been trained such as to optimize the predetermined processing together with a second machine learning module used by the trigger unit to generate the trigger signals and/or a third machine learning module used by the vision sensor to generate the data stream.
Facts
- Company
- Sony (Sony Semiconductor Solutions Corporation)
- Official title
- SENSOR DEVICE AND METHOD FOR OPERATING A SENSOR DEVICE
- Publication number
- US20260270575A1
- Application number
- 19166602
- Filed
- Aug 10, 2023
- Published
- Sep 10, 2026
- Inventors
- 3
- Claims
- 15
Classified under
H04N 25/47 Electricity & electronicsG06V 10/70 Physics & computingG06V 20/44 Physics & computingH04N 25/707 Electricity & electronicsMore from Sony in AI & software
- Sony patents AI that plays video games in your style Oct 6, 2026
- Sony patents AI that swaps game visuals for accessibility formats Sep 17, 2026
- Sony patents AI that changes game characters based on your play Oct 1, 2026
- Sony patents method to turn 2D videos into high-detail 3D animations Oct 15, 2026
- Sony patents AI bots that mimic your friends' gaming styles Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.