Microsoft patents system to adapt mixed reality workflows to new locations
This filing describes a method for creating mixed reality instructions that automatically adjust to different physical spaces. It analyzes how a user performs tasks in one location, identifies the specific objects used, and then matches those objects to similar items in a new location to generate a tailored workflow.
In the filing’s own words
A computer-implemented method of generating a mixed reality workflow is described. The method comprises identifying a series of tasks and generating an input task-to-object-mapping by analyzing data that defines a process performed by a first user interacting with objects in a first location. The input task-to-object-mapping that maps each task from the series of tasks to an object used in the respective task. A task-specific non-spatial characteristic of each object in the input task-to-object-mapping is determined and used to map each object in the input task-to-object-mapping to a candidate object identified at a second location to generate an output task-to-object-mapping. The series of tasks, location data defining a position of each candidate object in the second location and output task-to-object-mapping are used to generate a mapped workflow which is then output to a device in the second location.
What exactly they claim (claim 1)
1. A computer-implemented method of generating a mixed reality workflow, the method comprising: identifying a series of tasks and generating an input task-to-object-mapping by analyzing data that defines a process performed by a first user interacting with objects in a first location, wherein the input task-to-object-mapping comprises, for each task in the series of tasks, a mapping of the task to an object used in the task; determining a task-specific non-spatial characteristic of each object in the input task-to-object-mapping; identifying a plurality of candidate objects in a second location, location data defining a position of each candidate object within the second location and a non-spatial characteristic of each candidate object by analyzing data received from the second location; generating an output task-to-object mapping by mapping each object in the input task-to-object-mapping to a candidate object using the task-specific non-spatial characteristic of each object in the input task-to-object-mapping and the non-spatial characteristic of each candidate object; generating a mapped workflow comprising a process path using the series of tasks, the location data and the output task-to-object-mapping; and outputting the mapped workflow to a device in the second location.
Facts
- Company
- Microsoft (Microsoft Technology Licensing, LLC)
- Official title
- MIXED REALITY WORKFLOW GENERATION
- Publication number
- US20260311435A1
- Application number
- 19384987
- Filed
- Nov 10, 2025
- Published
- Oct 8, 2026
- Inventors
- 6
- Claims
- 20
Classified under
G06T 19/006 Physics & computingG06F 3/011 Physics & computingG06F 3/017 Physics & computingG06F 3/04842 Physics & computingG06Q 10/06316 Physics & computingG06T 13/40 Physics & computingMore from Microsoft in AR, VR & displays
- Microsoft patents 3D video calls that highlight body parts doctors mention Oct 1, 2026
- Microsoft patents AR glasses that slide to fit different eye spacing Oct 13, 2026
- Microsoft patents AR glasses that hide your eyes from others Sep 3, 2026
- Microsoft patents thinner lens coating for mixed reality glasses Sep 1, 2026
- Microsoft patents matching 3D spaces to share holograms between remote users Sep 1, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.