SonyGranted patentAR, VR & displaysInterest 6/10

Sony patents system to show 3D avatars that match your fast movements

Patent drawing
Patent drawing from the official filing.

Sony describes a system that uses motion sensors on your body to create a 3D avatar that moves with you. To keep the image smooth, the system only sends data from body parts moving quickly to a server, which then updates the avatar in real-time.

Why it mattersThis could make virtual meetings or games feel more natural by reducing the lag between your physical movement and the digital character's response.

In the filing’s own words

A device and method generate and display a user posture-reflected three-dimensional avatar image with less delay with respect to a user motion are implemented. A user terminal inputs a detection value of a motion sensor attached to a body of a user and a user posture is estimated, and further, the sensor detection value of a part having a fast motion is selected and transmitted to a server. The server generates a user posture-reflected three-dimensional avatar image using the user posture and the sensor detection values and transmits the user posture-reflected three-dimensional avatar image to the user terminal. The user terminal outputs the received user posture-reflected three-dimensional avatar image to a display unit. The server performs, for an avatar image based on the user posture, image correction of reflecting a user part position estimated based on a newer sensor detection value to generate a user posture-reflected three-dimensional avatar image.

What exactly they claim (claim 1)

1. An information processing device comprising: a posture estimation unit configured to estimate a user posture by inputting sensor detection values of motion sensors attached to a plurality of parts of a body of a user; and a sensor detection value selection unit configured to selectively acquire a sensor detection value of a part having a motion faster than a prescribed threshold, wherein the user posture estimated by the posture estimation unit and the sensor detection value selected by the sensor detection value selection unit to an external device or a posture-reflected three-dimensional avatar image generation unit in the information processing device, and a user posture-reflected three-dimensional avatar image generated by the posture-reflected three-dimensional avatar image generation unit using the user posture and the sensor detection value is output to a display unit.

Facts

Company
Sony (Sony Group Corporation)
Official title
Information processing device, information processing system, and information processing method
Patent number
US12801209B2
Application number
18726132
Filed
Nov 22, 2022
Granted
Nov 17, 2026
Inventors
1
Claims
19

Classified under

G06F 3/011 Physics & computingG02B 27/0101 Physics & computingG02B 27/017 Physics & computingG06F 3/017 Physics & computingG06T 13/40 Physics & computingG06V 40/10 Physics & computing

More from Sony in AR, VR & displays

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.