Google patents app automation engine for virtual assistants
Google describes a system that embeds a script execution engine directly into mobile apps to automate tasks. The engine runs pre-generated scripts made up of basic user interface actions, allowing a virtual assistant to complete tasks without needing specific developer-built tools.
In the filing’s own words
Various implementations include in-app automation to automate the execution of tasks in a user application by a virtual assistant and/or a generative model. In some implementations, a script execution engine is integrated directly into the user application, where the script execution engine executes script(s) to perform task(s) in the user application without extensive use of developer-implemented application programming interfaces. In many implementations, a given script (composed of a sequence of low level user interface actions) is automatically generated using various techniques. In various implementations, the script execution engine and/or corresponding scripts can be automatically integrated into the user application when the application is uploaded to an application store (e.g., published) and/or can be integrated via a software development kit by the developer of the user application.
What exactly they claim (claim 1)
1. A method implemented by one or more processors, the method comprising: receiving user interface input which includes at least an instruction for a user application to perform a given task, wherein the user application is stored locally at a client device; processing the instruction using a script execution engine of the user application to determine whether an automatically generated script of a set of automatically generated scripts can perform the given task, wherein the automatically generated script of the set of automatically generates scripts includes a sequence of application automation actions to perform the given task of the user application, and wherein the automatically generated script was generated prior to receiving the user interface input; in response to determining the automatically generated script can perform the task, executing the automatically generated script using the execution engine of the user application to perform the given task; and causing the user application to perform one or more actions based on the execution of the automatically generated script.
Facts
- Company
- Google (GOOGLE LLC)
- Official title
- SCRIPT EXECUTION ENGINE(S) FOR APPLICATION AUTOMATION
- Publication number
- US20260277771A1
- Application number
- 19077919
- Filed
- Mar 12, 2025
- Published
- Sep 17, 2026
- Inventors
- 7
- Claims
- 19
Classified under
G06F 11/3612 Physics & computingG06F 8/30 Physics & computingMore from Google in AI & software
- Google patents video search that answers questions using AI descriptions Sep 15, 2026
- Google patents photo tool that removes people and their gear Sep 15, 2026
- Google patents AI that writes live meeting notes and summaries Sep 15, 2026
- Google patents AI tool that turns messy emergency notes into clear messages Sep 3, 2026
- Google patents AI that clicks through apps to finish tasks for you Sep 24, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.