Microsoft patents 3D video system to suggest health-related gestures
Microsoft has been granted a patent for a system that uses multiple cameras to create 3D models of a person moving over time. The software compares these models to a database to identify missing movement data and suggests specific gestures the person should perform to improve the capture.
In the filing’s own words
The present disclosure relates to a four-dimensional (4D) recommendation system for training and implementing a 4D recommendation model to provide health-related recommendation for an individual that is a subject of a volumetric capture performed by a calibrated multi-camera system. In particular, the 4D recommendation system may capture 4D data objects including time-series three-dimensional models and associated annotations and generate a knowledge base including a collection of 4D data objects stored thereon. An input 4D data object may be obtained and compared to the collection of 4D data objects to determine one or more recommendations for the input 4D data object related to the health status of the individual.
What exactly they claim (claim 1)
1. A method, comprising: receiving a plurality of four-dimensional (4D) data objects, the plurality of 4D data objects including time-series three-dimensional (3D) models of individuals and annotations associated with the time-series 3D models, each time-series 3D model from the plurality of 4D objects including media content captured by a multi-camera system and combined into 3D models showing movement of an individual over a duration of time; generating a knowledge base of the plurality of 4D data objects, the knowledge base including an accessible storage of the plurality of 4D data objects; and training a 4D recommendation model to; identify features of a given 4D data object; compare the identified features to features of the knowledge base of the plurality of 4D data objects to determine a subset of 4D data objects from the knowledge base having a threshold similarity to the given 4D data object; compare the given 4D data object to the subset of 4D data objects from the knowledge base to determine that one or more features are missing from the given 4D data object; and generate an output including a recommendation associated with the subset of 4D data objects and based on determining that the one or more features are missing from the given 4D data object, the recommendation including a gesture to perform by a given individual such that capturing additional media content while the given individual performs the gesture would capture the one or more features that are missing from the given 4D data object.
Facts
- Company
- Microsoft (Microsoft Technology Licensing, LLC)
- Official title
- Training and implementing a four-dimensional data object recommendation model
- Patent number
- US12770736B2
- Application number
- 17889147
- Filed
- Aug 16, 2022
- Granted
- Oct 20, 2026
- Inventors
- 4
- Claims
- 18
Classified under
G16H 50/20 Physics & computingG16H 50/30 Physics & computingMore from Microsoft in Health & body
- Microsoft patents system to compress and link different types of health data Sep 10, 2026
- Microsoft patents method to sort cells using random rules Oct 22, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.