Sony patents AI that customizes virtual humans and pets in metaverses
Sony describes a system that uses machine learning to change the look and voice of virtual characters in metaverse environments. The technology analyzes user images or speech recordings to adjust a character's appearance and voice to match the user's preferences or demographics.
In the filing’s own words
Deep learning is used to dynamically adapt virtual humans in metaverse applications. The adaptation can be according to user preferences. In addition or alternatively, virtual humans and pets can be adapted for metaverse applications based on demographics of the user. The user's personal demographics may be used to establish the costume, skin color, emotion, voice, and behavior of the virtual humans. Similar considerations may be used to adapt virtual pets to the user's experience of the metaverse.
What exactly they claim (claim 1)
1. A device comprising: at least one computer storage that is not a transitory signal and that comprises instructions executable by at least one processor to: execute A, or B, or both A and B, wherein A comprises: receive at least one image of a person; input the image to a machine learning (ML) model; receive from the ML model first information regarding customization of a virtual being in a metaverse; and present on a display the virtual being with a customized appearance altered from an original appearance from original game software according to the first information from the ML model; and wherein B comprises: receive at least one recording of speech of the person; input the recording to the ML model; responsive to inputting the recording to the ML model, receive from the ML model second information regarding customization of the virtual being; and present the virtual being with a customized voice altered from an original voice from the original game software according to the second information from the ML model; and send the first information regarding customization to at least one display presenting a metaverse other than the display so that the virtual being appears in customized form on the at least one display presenting the metaverse, the first information regarding customization being sent to the at least one display presenting the metaverse based on a status of the person.
Facts
- Company
- Sony (SONY INTERACTIVE ENTERTAINMENT INC.)
- Official title
- Customized digital humans and pets for metaverse
- Patent number
- US12762762B2
- Application number
- 18806342
- Filed
- Aug 15, 2024
- Granted
- Oct 13, 2026
- Inventors
- 1
- Claims
- 19
Classified under
G06T 11/60 Physics & computingG06T 11/10 Physics & computingMore from Sony in AI & software
- Sony patents AI that plays video games in your style Oct 6, 2026
- Sony patents AI that swaps game visuals for accessibility formats Sep 17, 2026
- Sony patents AI that changes game characters based on your play Oct 1, 2026
- Sony patents method to turn 2D videos into high-detail 3D animations Oct 15, 2026
- Sony patents AI bots that mimic your friends' gaming styles Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.