Microsoft patents method to group video clips by topic for easier search
This patent describes a system that analyzes transcripts of media content to identify topics and group related sentences into segments. It uses a combination of topic recognition and timing to label these segments, allowing users to search for and play specific parts of a video based on the subject matter.
In the filing’s own words
Systems and methods for semantic temporal segmentation based on topic recognition are disclosed. Text classification and segmentation may be used to index media content for subsequent searches. The method may include using a text classification model to semantically analyze sentences in a text file (such as a transcript) to determine topics with which sentences are associated. The output of the text classification model may be provided to a text segmentation model to enable more-accurate identification of text segments (e.g., paragraphs) within the text file. In some examples, the output of a text segmentation model is provided to a text classification model to enable the text classification model to perform more-accurate classification based on text segments rather than (or in addition to) performing classification on single sentences. The classification of the text segments may be used to assign labels to the text segments to enable subsequent searches based on the labels.
What exactly they claim (claim 1)
1. A computer-implemented method, comprising: obtaining a first set of tokens associated with a first sentence of a transcript and a second set of tokens associated with a second sentence of the transcript; determining, by a text classification model and based on the first set of tokens, a first probability that a first class is associated with the first sentence; determining, by the text classification model and based on the second set of tokens, a second probability that the first class is associated with the second sentence; identifying a first text segment that includes the first sentence and the second sentence based on: a comparison of a semantic similarity of the first class associated with the first probability to the first class associated with the second probability; and a comparison of a temporal proximity of a first timestamp associated with the first sentence to a second timestamp associated with the second sentence; determining a third probability that the first class is associated with the first text segment based on the first set of tokens and the second set of tokens, wherein the third probability is used to adjust a parameter of the text classification model; determining a label associated with the first text segment based on the third probability; in response to receiving input indicating a selection of the label, identifying media content corresponding to the first text segment; and providing the media content for presentation.
Facts
- Company
- Microsoft (Microsoft Technology Licensing, LLC)
- Official title
- Semantic text segmentation based on topic recognition
- Patent number
- US12737547B2
- Application number
- 18507322
- Filed
- Nov 13, 2023
- Granted
- Sep 15, 2026
- Inventors
- 2
- Claims
- 20
Classified under
G06F 40/30 Physics & computingMore from Microsoft in AI & software
- Microsoft patents method to check AI answers against verified facts Oct 20, 2026
- Microsoft patents AI that presents PowerPoint slides for you Sep 3, 2026
- Microsoft patents method to check if LLM answers are based on real data Sep 10, 2026
- Microsoft patents system to blend multiple AI agents into one chat Oct 1, 2026
- Microsoft patents system that answers questions using your screen history Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.