Sony patents system that syncs virtual performer sounds to motion speed
Sony describes a device that uses motion capture data to estimate how fast virtual avatars are moving in a shared space. It then selects specific sound effects for each performer based on that speed and plays them in sync.
In the filing’s own words
An information processing device according to the present technology includes: an operation estimation unit that estimates a performance operation speed for each of a plurality of performers whose avatars are arranged in common virtual space based on pieces of motion capture data on the performers; and an output sound control unit that selects performance sound data in accordance with the performance operation speed estimated by the operation estimation unit among pieces of performance sound data prepared for each of performance operation speeds for each of the performers, and performs control to output selected pieces of performance sound data for each of the performers in synchronization with each other.
What exactly they claim (claim 1)
1. An information processing device including: an operation estimation unit that estimates a performance operation speed for each of a plurality of performers whose own avatars are arranged in common virtual space based on motion capture data on the performers; and an output sound control unit that selects performance sound data corresponding to the performance operation speed estimated by the operation estimation unit among performance sound data prepared for each of performance operation speeds for each of the performers, and performs control to output selected performance sound data for each of the performers in synchronization.
Facts
- Company
- Sony (Sony Group Corporation)
- Official title
- INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD, AND PROGRAM
- Publication number
- US20260277535A1
- Application number
- 19168699
- Filed
- Dec 27, 2023
- Published
- Sep 17, 2026
- Inventors
- 3
- Claims
- 16
Classified under
G06F 3/165 Physics & computingG06F 3/011 Physics & computingG10H 1/0025 Physics & computingH05B 47/115 Electricity & electronicsG06F 2203/011 Physics & computingG10H 2210/071 Physics & computingMore from Sony in AR, VR & displays
- Sony patents device that warms or cools you when you touch virtual objects Sep 15, 2026
- Sony patents VR box that mimics a transparent fish tank Oct 13, 2026
- Sony patents cloud gaming that puts characters in your room Oct 15, 2026
- Sony patents LED screens that show unique views to each person in a room Oct 15, 2026
- Sony patents cloud gaming that adjusts to your brain state Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.