MicrosoftGranted patentAI & softwareInterest 6/10

Microsoft patents search method that blends concepts with background knowledge

Patent drawing
Patent drawing from the official filing.

Microsoft describes a system that improves search results by combining user queries with a 'prototype' drawn from a large knowledge base. The model adjusts the weight of these background details to ensure the final answer fits the specific context of the search, rather than relying only on the words in the query.

Why it mattersThis approach could make search engines better at understanding the context behind a question, leading to more relevant answers for users.

In the filing’s own words

A knowledge injection model for generative commonsense reasoning. In examples, an encoder-decoder model is used to generate a model output ( 204) a plausible description for a set of concepts. A prototype ( 218) is generated from an in-domain or out-of-domain knowledge corpus, which is further used as input ( 202) for the encoder-decoder model. Concept input tokens and prototype input tokens are scaled to limit potential skew that may be introduced by the prototype ( 218). Additionally, position indicators are generated for each input token, which indicate the relative position each respective input token as compared to other input tokens. As such, when decoding the scaled encoded input tokens, the decoder ( 214) may be more attuned to the scenario bias that is introduced by the prototype ( 218) when generating a model output ( 204). Thus, the encoder-decoder model need not rely solely on the set of concepts when generating the model output ( 204).

What exactly they claim (claim 1)

1. A system comprising: at least one processor; and memory storing instructions that, when executed by the at least one processor, causes the system to perform a set of operations, the set of operations comprising: receiving an indication comprising a search query from a computing device; obtaining, based on a knowledge corpus, a prototype for a set of concepts associated with the search query; encoding an input based on the set of concepts and the obtained prototype, the input comprising one or more concept input tokens for the set of concepts and one or more prototype input tokens for the obtained prototype; scaling the encoded input to decrease a first norm for an encoded output state of a first prototype input token that is similar to a first concept input token of the concept input tokens; generating a set of position indicators for input tokens of the input; decoding the scaled encoded output based on the set of position indicators to generate a model output; identifying, based on the generated model output, targeted content; and providing, to the computing device, the identified targeted content in response to the received indication.

Facts

Company
Microsoft (Microsoft Technology Licensing, LLC)
Official title
Knowledge injection model for generative commonsense reasoning
Patent number
US12801948B2
Application number
18035849
Filed
Nov 12, 2020
Granted
Nov 17, 2026
Inventors
6
Claims
20

Classified under

G06N 5/04 Physics & computingG06N 5/02 Physics & computingG06N 5/022 Physics & computing

More from Microsoft in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.