/Patent Tracker
DisneyGranted patentAI & softwareInterest 6/10

Disney patents system to mix body and face motion capture in real time

Patent drawing
Patent drawing from the official filing.

This filing describes a software tool that records facial and body movements simultaneously using different sensors. It allows animators to combine or swap these movement data sets from different performances to create a final animation.

Why it mattersIt streamlines the animation workflow by letting creators easily mix specific body and face movements from separate takes.

In the filing’s own words

Embodiments provide for improved capture and modification of sensor data. A first performance in a physical environment is recorded, and a first data object is generated, comprising at least a first motion capture element from the first performance, where the first motion capture element includes at least one of (i) body data or (ii) facial data. A request to modify the first data object based on a second data object including motion capture data from a second performance is received, and the first data object is modified by adding, to the first data object, a second motion capture element from the second data object. The modified first data object including the first motion capture element and the second motion capture element is outputted.

What exactly they claim (claim 1)

1. A method, comprising: configuring a recording aspect of a first take object through a selection of a first sensor data type and a second sensor data type within a take object region of a user interface, wherein the first sensor data type is different from the second sensor data type, and wherein the first take object is a unified and parameterized data object configured to combine and synchronize first data of the first sensor data type with second data of the second sensor data type; initiating, through selection of a graphic element of the user interface and for a first performance in a physical environment, simultaneous capture of first sensor data from a first sensor and second sensor data from a second sensor based on the selection of the first and second sensor data types, respectively; responsive to the selection of the graphic element, transitioning the user interface to an armed state for locking one or more recording attributes used for recording the first and second sensor data to generate combined captured sensor data including facial movement capture data from the first sensor and body movement capture data from the second sensor, wherein the one or more recording attributes include at least one of (a) a character for which the combined recorded data should be used, (b) a recording path defining where the combined recorded data will be stored, (c) a display name for the first take object, (d) an audio selection for the first take object, (e) an indication to output the audio selection in the physical environment during recording of the first and second sensor data, and (f) an indication that the first and second sensor data will be recorded for the first take object; synchronizing the captured first sensor data with the captured second data to generate synchronized data that aligns a first data stream of the captured first sensor data with a second data stream of the captured second sensor data; storing the synchronized data as the first take object including at least one first motion capture element from the first performance; displaying an indication of the first take object on a timeline; generating an animatic based on the first take object; and generating an animation based on (a) the animatic, and (b) a modified take object created (i) by adding a second motion capture element from a second performance included in a second take object different from the first take object, or (ii) by replacing the first motion capture element with the second motion capture element.

Facts

Company
Disney (Disney Enterprises, Inc.)
Official title
Real-time animation motion capture
Patent number
US12762775B2
Application number
17344603
Filed
Jun 10, 2021
Granted
Oct 13, 2026
Inventors
4
Claims
21

Classified under

G06T 13/40 Physics & computing

More from Disney in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.