Sony patents system to search dance moves by body position and emotion
Sony has been granted a patent for a system that turns video of human movement into searchable data. It uses a computer network to identify specific details like facial expressions, body posture, and hand gestures from a video clip. The system then compares these details to a database to see if the move is a known pose or a new one.
In the filing’s own words
An electronic device and a method for digitization of human motion data for semantic search is provided. The electronic device receives a sequence of input images depicting a physical performance associated with a body movement discipline and extracts a localized instance of a performer associated with the physical performance from an image frame of the sequence of image frames. The electronic device determines a plurality of performance attributes associated with the performer based on application of an attribute recognition network on the localized instance. The plurality of performance attributes comprises an emotion attribute, a posture attribute, and a hand gesture attribute. The electronic device searches a performance database based on the plurality of performance attributes to generate a search result. The search result specifies whether the localized instance represents an unregistered pose or a registered pose of the body movement discipline.
What exactly they claim (claim 1)
1. An electronic device, comprising: circuitry configured to: receive a sequence of input images that depicts a physical performance associated with a body movement discipline; extract a localized instance of a performer associated with the physical performance from an image frame of the sequence of image frames; determine a plurality of performance attributes associated with the performer based on application of an attribute recognition network on the localized instance, wherein the plurality of performance attributes comprises: an emotion attribute that includes positional information associated with a set of facial features of the performer, a posture attribute associated with a body of the performer, and a hand gesture attribute associated with each hand of the performer; and search a performance database based on the plurality of performance attributes to generate a first search result, wherein the first search result specifies that the localized instance represents an unregistered pose or a registered pose of the body movement discipline.
Facts
- Company
- Sony (SONY GROUP CORPORATION)
- Official title
- Digitization of human motion data for semantic search
- Patent number
- US12749343B2
- Application number
- 18806393
- Filed
- Aug 15, 2024
- Granted
- Sep 29, 2026
- Inventors
- 3
- Claims
- 20
Classified under
G06V 40/23 Physics & computingG06F 16/532 Physics & computingG06V 10/82 Physics & computingG06V 40/171 Physics & computingG06V 40/174 Physics & computingG06V 40/28 Physics & computingMore from Sony in AI & software
- Sony patents AI that plays video games in your style Oct 6, 2026
- Sony patents AI that swaps game visuals for accessibility formats Sep 17, 2026
- Sony patents AI that changes game characters based on your play Oct 1, 2026
- Sony patents method to turn 2D videos into high-detail 3D animations Oct 15, 2026
- Sony patents AI bots that mimic your friends' gaming styles Sep 8, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.