Sony patents VR controller that shows you where to put your hand
Sony has patented a system for head-mounted displays that uses a camera to track the position of a physical controller. It overlays a visual guide on the screen showing exactly where to insert your hand and grip the device.
In the filing’s own words
A captured image obtaining section obtains a captured image resulting from capturing in a front direction of a user wearing a head-mounted display (HMD). An estimation processing section estimates the position of an input device on the basis of the captured image in which a controller (input device) including a gripping portion to be gripped by the user after the user inserts a hand through a curved portion appears. A display control section displays the captured image resulting from capturing in the front direction of the user on the HMD. The display control section further displays an object indicating a part to be gripped by the user together with the captured image on the basis of an estimation result of the position of the input device.
What exactly they claim (claim 1)
1. An information processing device comprising: one or more memory devices configured to store instructions; and one or more processors, that upon execution of the instructions, are configured to: obtain a captured image resulting from capturing a front of a user wearing a head-mounted display; estimate a position of a controller based on determining a respective position of a plurality of markers arranged on a surface of the controller, the controller including a gripping portion to be gripped by the user on a basis of the captured image in which the controller appears; display the captured image resulting from capturing the front of the user on the head-mounted display; display a first object indicating a part to be gripped by the user together with the captured image on a basis of an estimation result of the position of the controller; and display a second object that moves in a direction in which to insert a hand in a vicinity of the controller appearing in the captured image, wherein the one or more processors are further configured to set the second object in a non-display state in a case where a non-stationary state of the controller continues for a first time or more.
Facts
- Company
- Sony (Sony Interactive Entertainment Inc.)
- Official title
- Information processing device, controller display method, and computer program
- Patent number
- US12737044B2
- Application number
- 18870464
- Filed
- May 25, 2023
- Granted
- Sep 15, 2026
- Inventors
- 6
- Claims
- 18
Classified under
G06F 3/014 Physics & computingG06T 7/70 Physics & computingG06T 11/00 Physics & computingMore from Sony in AR, VR & displays
- Sony patents device that warms or cools you when you touch virtual objects Sep 15, 2026
- Sony patents VR box that mimics a transparent fish tank Oct 13, 2026
- Sony patents cloud gaming that puts characters in your room Oct 15, 2026
- Sony patents LED screens that show unique views to each person in a room Oct 15, 2026
- Sony patents cloud gaming that adjusts to your brain state Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.