OpenAIGranted patentAI & softwareInterest 8/10

OpenAI patents remote control for AI agents running on your device

Illustration of the invention
Illustration based on the patent drawing. Not a photo of a real product.
Patent drawing
Patent drawing from the official filing.

OpenAI has patented a system that lets users monitor and adjust AI agents running on their local devices from a remote location. The system creates a live mirror of the AI's tasks on a server, which is then displayed as a visual interface on a second device. Users can interact with this visual representation to change how the local AI agent operates in real time.

Why it mattersThis could allow users to pause, redirect, or tweak AI assistants running on their phones or computers from a different screen, adding a layer of manual oversight to automated tasks.

In the filing’s own words

The present disclosure relates to systems, non-transitory computer-readable media, and methods for remotely monitoring and/or modifying operations of a locally executing generative agent operating on an executing client device. In some embodiments, the disclosed systems can establish a persistent bi-directional connection between the executing client device and a backend runtime service. The disclosed systems can utilize the backend runtime service to construct a mirrored task object based on executable tasks performed by the locally executing generative agent. Further, the disclosed systems can provide a visual representation of the mirrored task object for display on a remote client device. Based on determining an interaction with the visual representation, the disclosed systems can utilize the persistent bi-directional connection to modify operations of the locally executing generative agent.

What exactly they claim (claim 1)

1. A computer-implemented method comprising: initiating, at a first client device, a locally executing generative agent running in a local runtime environment on the first client device; establishing a persistent bi-directional connection between the local runtime environment and a backend runtime service running on one or more server devices remotely separated from the first client device; generating, at the backend runtime service through the persistent bi-directional connection, a mirrored task object comprising executable tasks of the locally executing generative agent running in the local runtime environment; and generating, for display on a second client device interfacing with the backend runtime service and remotely separated from the one or more server devices, a remote agent control interface displaying a visual representation of one or more executable tasks of the mirrored task object.

Facts

Company
OpenAI (OpenAI OpCo, LLC)
Official title
Remote control and monitoring of a locally executing generative agent
Patent number
US12786264B1
Application number
19631809
Filed
Mar 27, 2026
Granted
Nov 3, 2026
Inventors
2
Claims
20

Classified under

H04L 67/025 Electricity & electronics

More from OpenAI in AI & software

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.