OpenAI patents remote control for AI agents running on your device


OpenAI has patented a system that lets users monitor and adjust AI agents running on their local devices from a remote location. The system creates a live mirror of the AI's tasks on a server, which is then displayed as a visual interface on a second device. Users can interact with this visual representation to change how the local AI agent operates in real time.
In the filing’s own words
The present disclosure relates to systems, non-transitory computer-readable media, and methods for remotely monitoring and/or modifying operations of a locally executing generative agent operating on an executing client device. In some embodiments, the disclosed systems can establish a persistent bi-directional connection between the executing client device and a backend runtime service. The disclosed systems can utilize the backend runtime service to construct a mirrored task object based on executable tasks performed by the locally executing generative agent. Further, the disclosed systems can provide a visual representation of the mirrored task object for display on a remote client device. Based on determining an interaction with the visual representation, the disclosed systems can utilize the persistent bi-directional connection to modify operations of the locally executing generative agent.
What exactly they claim (claim 1)
1. A computer-implemented method comprising: initiating, at a first client device, a locally executing generative agent running in a local runtime environment on the first client device; establishing a persistent bi-directional connection between the local runtime environment and a backend runtime service running on one or more server devices remotely separated from the first client device; generating, at the backend runtime service through the persistent bi-directional connection, a mirrored task object comprising executable tasks of the locally executing generative agent running in the local runtime environment; and generating, for display on a second client device interfacing with the backend runtime service and remotely separated from the one or more server devices, a remote agent control interface displaying a visual representation of one or more executable tasks of the mirrored task object.
Facts
- Company
- OpenAI (OpenAI OpCo, LLC)
- Official title
- Remote control and monitoring of a locally executing generative agent
- Patent number
- US12786264B1
- Application number
- 19631809
- Filed
- Mar 27, 2026
- Granted
- Nov 3, 2026
- Inventors
- 2
- Claims
- 20
Classified under
H04L 67/025 Electricity & electronicsMore from OpenAI in AI & software
- OpenAI patents voice system that detects when you stop talking Sep 22, 2026
- OpenAI patents system to catch AI models cheating on tasks Sep 10, 2026
- OpenAI patents method to check AI thinking for cheating Sep 10, 2026
- OpenAI patents system that turns photos into new AI-generated images Sep 10, 2026
- OpenAI patents AI that answers questions using only your company's secure files Sep 17, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.