Microsoft patents tool that turns spoken stories into formatted guides
Microsoft has patented a system that takes unstructured spoken narration and uses a large language model to turn it into a well-organized document. The technology analyzes how you speak, including volume and tone, to adjust the structure and formatting of the final guide automatically.
In the filing’s own words
The disclosed techniques provide enhanced generation of formatted and organized guides from unstructured spoken narrative using a large language model. A system uses unstructured verbal narrative as input in place of written input. The system uses a large language model to organize an unstructured narrative into a structured guide that follows specific formatting requirements. For example, the formatting requirements may define specific headers, steps, bullets, image locations, etc. The formatting requirements may also define category requirements. For example, category requirements may indicate that a structured guide is to include a title, topics for each header, etc. The system can also suggest new categories, relevant explanations, additional image locations, and other references the author may not have considered. The process is automated, resulting in a complete guide having a consistent structure in a particular format.
What exactly they claim (claim 1)
1. A method of generating a structured document from a speech audio input comprising an unstructured verbal narrative using a large language model, the method for execution on a computing system, the method comprising: receiving fine-tuning data having a layout that follows one or more formatting requirements, the fine-tuning data comprising individual sections of content associated with individual categories; determining the one or more formatting requirements by analyzing the fine-tuning data, wherein the analysis determines the one or more formatting requirements based on a format or a layout of the content of the fine-tuning data; receiving the speech audio input at a microphone in communication with the computing system, the speech audio input including the unstructured verbal narrative; analyzing the speech audio input to determine speech characteristics that include at least one of a volume of the voice, a tone of voice, and one or more inflections of a voice included in the speech audio input; converting the speech audio input including the unstructured verbal narrative into a text translation of the unstructured verbal narrative; determining one or more categories by analyzing the text translation of the unstructured verbal narrative; identifying individual sections of select content by analyzing the text translation of the unstructured verbal narrative, wherein the individual sections of select content are associated with individual categories of the one or more categories; modifying the one or more formatting requirements based on the speech characteristics, wherein at least one of the volume of the voice, the tone of the voice, and one or more inflections of a voice modifies as least one of an order of the individual sections or a format of the individual sections; and providing the one or more formatting requirements identified from the fine-tuning data, the one or more categories, and the individual sections of select content identified from the text translation of the unstructured verbal narrative to the large language model for causing the large language model to generate the structured document, wherein the structured document comprises the individual sections of select content each associated with the one or more categories, wherein the individual sections of select content and the one or more categories are ordered and formatted according to the one or more formatting requirements identified by the analysis of the fine-tuning data and the speech characteristics that include at least one of the volume, the tone of voice, and the one or more inflections of the voice included in the speech audio input.
Facts
- Company
- Microsoft (MICROSOFT TECHNOLOGY LICENSING, LLC)
- Official title
- Enhanced generation of formatted and organized guides from unstructured spoken narrative using large language models
- Patent number
- US12762324B2
- Application number
- 18457086
- Filed
- Aug 28, 2023
- Granted
- Oct 13, 2026
- Inventors
- 6
- Claims
- 20
Classified under
G06F 40/106 Physics & computingG06F 16/355 Physics & computingG06F 16/382 Physics & computingG06F 40/30 Physics & computingMore from Microsoft in AI & software
- Microsoft patents method to check AI answers against verified facts Oct 20, 2026
- Microsoft patents AI that presents PowerPoint slides for you Sep 3, 2026
- Microsoft patents method to check if LLM answers are based on real data Sep 10, 2026
- Microsoft patents system to blend multiple AI agents into one chat Oct 1, 2026
- Microsoft patents system that answers questions using your screen history Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.