Disney patents system to mix body and face motion capture in real time
This filing describes a software tool that records facial and body movements simultaneously using different sensors. It allows animators to combine or swap these movement data sets from different performances to create a final animation.
In the filing’s own words
Embodiments provide for improved capture and modification of sensor data. A first performance in a physical environment is recorded, and a first data object is generated, comprising at least a first motion capture element from the first performance, where the first motion capture element includes at least one of (i) body data or (ii) facial data. A request to modify the first data object based on a second data object including motion capture data from a second performance is received, and the first data object is modified by adding, to the first data object, a second motion capture element from the second data object. The modified first data object including the first motion capture element and the second motion capture element is outputted.
What exactly they claim (claim 1)
1. A method, comprising: configuring a recording aspect of a first take object through a selection of a first sensor data type and a second sensor data type within a take object region of a user interface, wherein the first sensor data type is different from the second sensor data type, and wherein the first take object is a unified and parameterized data object configured to combine and synchronize first data of the first sensor data type with second data of the second sensor data type; initiating, through selection of a graphic element of the user interface and for a first performance in a physical environment, simultaneous capture of first sensor data from a first sensor and second sensor data from a second sensor based on the selection of the first and second sensor data types, respectively; responsive to the selection of the graphic element, transitioning the user interface to an armed state for locking one or more recording attributes used for recording the first and second sensor data to generate combined captured sensor data including facial movement capture data from the first sensor and body movement capture data from the second sensor, wherein the one or more recording attributes include at least one of (a) a character for which the combined recorded data should be used, (b) a recording path defining where the combined recorded data will be stored, (c) a display name for the first take object, (d) an audio selection for the first take object, (e) an indication to output the audio selection in the physical environment during recording of the first and second sensor data, and (f) an indication that the first and second sensor data will be recorded for the first take object; synchronizing the captured first sensor data with the captured second data to generate synchronized data that aligns a first data stream of the captured first sensor data with a second data stream of the captured second sensor data; storing the synchronized data as the first take object including at least one first motion capture element from the first performance; displaying an indication of the first take object on a timeline; generating an animatic based on the first take object; and generating an animation based on (a) the animatic, and (b) a modified take object created (i) by adding a second motion capture element from a second performance included in a second take object different from the first take object, or (ii) by replacing the first motion capture element with the second motion capture element.
Facts
- Company
- Disney (Disney Enterprises, Inc.)
- Official title
- Real-time animation motion capture
- Patent number
- US12762775B2
- Application number
- 17344603
- Filed
- Jun 10, 2021
- Granted
- Oct 13, 2026
- Inventors
- 4
- Claims
- 21
Classified under
G06T 13/40 Physics & computingMore from Disney in AI & software
- Disney patents AI character that creates art from your shared memories Sep 8, 2026
- Disney patents video compression using generative models to cut file sizes Sep 3, 2026
- Disney patents AI characters that create art from shared memories Oct 22, 2026
- Disney patents tech to sync translated speech with body gestures Sep 17, 2026
- Disney patents AI characters that pause and react when you interrupt them Sep 24, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
