SonyGranted patentChips & hardwareInterest 6/10

Sony patents device that uses motion sensors to estimate object depth

Patent drawing
Patent drawing from the official filing.

Sony describes an electronic device that combines an event-driven camera with an inertial measurement unit (IMU) to track movement. The system matches the visual data from the camera with pre-stored patterns of motion to estimate how far away objects are.

Why it mattersThis approach could help compact devices like handheld controllers or cameras calculate distance to objects without needing expensive stereo cameras or laser sensors.

In the filing’s own words

Provided is an electronic device including an event-driven vision sensor including a sensor array having a sensor that generates an event signal when detecting a change in the intensity of incident light, an IMU whose positional relation with the vision sensor is known and which measures at least one physical quantity, and an additional information generating section that generates additional information related to the event signal or an output value of the IMU by associating flow information detected on the basis of the event signal with a flow pattern associated in advance with the at least one physical quantity or an estimated value based on the at least one physical quantity.

What exactly they claim (claim 1)

1. An electronic device comprising: a vision sensor that is an event-driven type sensor that includes a sensor array having a sensor, and that is configured to generate an event signal when detecting a change in an intensity of incident light; an inertial measurement unit whose positional relation with the vision sensor is known and which is configured to measure at least one physical quantity; and processing circuitry configured to: generate additional information related to the event signal or an output value of the inertial measurement unit by associating (a) flow information detected on a basis of the event signal with (b) a flow pattern associated in advance with (i) the at least one physical quantity or (ii) an estimated value based on the at least one physical quantity, wherein the additional information includes depth information concerning a subject of the vision sensor, wherein the flow pattern is associated with a depth of the subject in addition to (i) the at least one physical quantity or (ii) the estimated value based on the at least one physical quantity, and wherein generating the additional information comprises: extracting the flow pattern corresponding to (i) the output value acquired in synchronization with the flow information or (ii) an estimated value based on the output value; and generating the depth information on a basis of the depth of the subject associated with a flow pattern which the flow information at least partially matches in the extracted flow pattern.

Facts

Company
Sony (Sony Interactive Entertainment Inc.)
Official title
Electronic device, information processing method, and program
Patent number
US12804275B2
Application number
18730332
Filed
Jan 28, 2022
Granted
Nov 17, 2026
Inventors
3
Claims
12

Classified under

H04N 25/47 Electricity & electronicsG01C 21/1656 Physics & computingG06T 7/269 Physics & computing

More from Sony in Chips & hardware

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.