GoogleGranted patentRobots & automationInterest 8/10

Google patents telling robots how to walk using text commands

Illustration of the invention
Illustration based on the patent drawing. Not a photo of a real product.
Patent drawing
Patent drawing from the official filing.

This patent describes a system where a robot receives a text description of a task and uses a large language model to figure out how to move. The model translates the text into a specific sequence of foot placements, which the robot then uses to walk or move across a surface.

Why it mattersIt shows how advanced language tools can be used to give high-level instructions to physical robots, potentially making them easier to direct without complex programming.

In the filing’s own words

Various implementations are provided which include receiving an instance of natural language (NL) text input indicating a task for a multi-legged robot to perform in an environment. In many implementations, the system can process the NL text input using a large language model (LLM) to generate a foot contact pattern, indicating a sequence of leg positions of the robot relative to the surface, where one or more of the legs of the robot are in contact with the surface. Additionally or alternatively, the system can generate low-level robot control output by processing the foot contact pattern using a locomotion controller.

What exactly they claim (claim 1)

1. A method implemented by one or more processors, the method comprising: receiving an instance of natural language (NL) text input, wherein the instance of NL text input indicates a task for a robot to perform in an environment, wherein the robot has a plurality of legs, and wherein the robot is on a surface in the environment; processing the instance of NL text input using a large language model (LLM) to generate a foot contact pattern, wherein the foot contact pattern indicates a sequence of leg positions relative to the surface, of the plurality of legs of the robot, and wherein one or more of the legs of the robot are in contact with the surface; generating control output by processing the foot contact pattern using a locomotion controller of the robot; and causing the robot to perform one or more actions based on the control output.

Facts

Company
Google (GOOGLE LLC)
Official title
Foot contact pattern(s) as interface for language to control robot(s)
Patent number
US12801150B2
Application number
19079035
Filed
Mar 13, 2025
Granted
Nov 17, 2026
Inventors
5
Claims
22

Classified under

G05D 1/43 Physics & computingG05D 1/2285 Physics & computingB62D 57/032 Operations & transportG05D 2101/10 Physics & computingG05D 2109/12 Physics & computing

More from Google in Robots & automation

Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.