/Patent Tracker
SamsungGranted patentAI & softwareInterest 6/10

Samsung patents TV that answers questions about what you are watching

Samsung describes a display device that lets users ask questions while watching a video. It uses a neural network to find relevant text passages from a database and generates a written answer based on the current video and the user's query.

Why it mattersThis could make televisions more interactive by allowing viewers to get instant, context-aware answers about the content they are watching without leaving the screen.

In the filing’s own words

Disclosed is a display apparatus. The display apparatus includes a display; and one or more processors configured to, based on a user input being received while a video is provided through the display, obtain at least one passage by inputting information on the user input and the video to a first encoder, obtain a text by using a part of a plurality of tokens included in the at least one passage by inputting the video, the information on the user input, and the at least one passage into a neural network model, and output the obtained text.

What exactly they claim (claim 1)

1. A display apparatus comprising: a display; and one or more processors configured to: based on a user input being received while a video is provided through the display, obtain at least one passage by inputting information on the user input and the video to a first encoder, obtain a text by using a part of a plurality of tokens included in the at least one passage by inputting the video, the information on the user input, and the at least one passage into a neural network model, wherein the neural network model is separate from the first encoder, and output the obtained text, wherein obtaining the at least one passage comprises to: obtain, by the first encoder, a first feature vector corresponding to the information on the user input and the video under the control of the one or more processors, obtain, by the first encoder, at least one second feature vector having a similarity equal to or greater than a threshold value with the first feature vector among a plurality of second feature vectors included in a preset dataset, and output, by the first encoder, the at least one passage corresponding to the at least one second feature vector, wherein the preset dataset comprises the plurality of second feature vectors corresponding to each of a plurality of articles obtained by inputting the plurality of articles to a second encoder.

Facts

Company
Samsung (SAMSUNG ELECTRONICS CO., LTD.)
Official title
Display apparatus that provides answer to question based on image and controlling method thereof
Patent number
US12749311B2
Application number
18383765
Filed
Oct 25, 2023
Granted
Sep 29, 2026
Inventors
2
Claims
20

Classified under

G06V 20/46 Physics & computingG06F 40/284 Physics & computingG06F 40/40 Physics & computing
Read the full filing (official PDF) ↗ Open in the Patent Tracker

More from Samsung in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.