Sony patents device that uses motion sensors to estimate object depth
Sony describes an electronic device that combines an event-driven camera with an inertial measurement unit (IMU) to track movement. The system matches the visual data from the camera with pre-stored patterns of motion to estimate how far away objects are.
In the filing’s own words
Provided is an electronic device including an event-driven vision sensor including a sensor array having a sensor that generates an event signal when detecting a change in the intensity of incident light, an IMU whose positional relation with the vision sensor is known and which measures at least one physical quantity, and an additional information generating section that generates additional information related to the event signal or an output value of the IMU by associating flow information detected on the basis of the event signal with a flow pattern associated in advance with the at least one physical quantity or an estimated value based on the at least one physical quantity.
What exactly they claim (claim 1)
1. An electronic device comprising: a vision sensor that is an event-driven type sensor that includes a sensor array having a sensor, and that is configured to generate an event signal when detecting a change in an intensity of incident light; an inertial measurement unit whose positional relation with the vision sensor is known and which is configured to measure at least one physical quantity; and processing circuitry configured to: generate additional information related to the event signal or an output value of the inertial measurement unit by associating (a) flow information detected on a basis of the event signal with (b) a flow pattern associated in advance with (i) the at least one physical quantity or (ii) an estimated value based on the at least one physical quantity, wherein the additional information includes depth information concerning a subject of the vision sensor, wherein the flow pattern is associated with a depth of the subject in addition to (i) the at least one physical quantity or (ii) the estimated value based on the at least one physical quantity, and wherein generating the additional information comprises: extracting the flow pattern corresponding to (i) the output value acquired in synchronization with the flow information or (ii) an estimated value based on the output value; and generating the depth information on a basis of the depth of the subject associated with a flow pattern which the flow information at least partially matches in the extracted flow pattern.
Facts
- Company
- Sony (Sony Interactive Entertainment Inc.)
- Official title
- Electronic device, information processing method, and program
- Patent number
- US12804275B2
- Application number
- 18730332
- Filed
- Jan 28, 2022
- Granted
- Nov 17, 2026
- Inventors
- 3
- Claims
- 12
Classified under
H04N 25/47 Electricity & electronicsG01C 21/1656 Physics & computingG06T 7/269 Physics & computingMore from Sony in Chips & hardware
- Sony patents stacked image sensor with built-in AI processing Nov 17, 2026
- Sony patents light sensor that adjusts how it counts incoming photons Sep 1, 2026
- Sony patents camera sensor with two pixel types for better motion detection Sep 1, 2026
- Sony patents game graphics that adjust quality based on hardware heat Sep 8, 2026
- Sony patents camera sensor design that stacks chips to shrink pixels Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
