Skip to content
Latest briefingsTopicsCompaniesGlossaryAbout
Glossary · EXPLAINER

What is a robot foundation model?

A robot foundation model is a large AI model pretrained on broad robot, simulation and web data, then adapted to many tasks and robot bodies instead of being trained for one job.

Updated:

Definition

A robot foundation model is a large neural network trained on broad and varied data so that one model can be adapted to many tasks, environments and robot bodies. The idea comes from language models: pretrain once at scale, then specialise cheaply.

How it works

  1. Pretrain on a mix of robot trajectories, simulation, human video and image-text data, often starting from a pretrained vision-language model.
  2. Post-train on demonstrations from the target robot and tasks.
  3. Deploy, usually with a fast low-level controller underneath that turns the model's output into motor commands.

The output can be actions (a VLA model), predicted future states (a world model) or a plan in language that other modules execute.

Why it matters

Classic robot software needs a new program or policy for every task. Foundation models aim to make new skills a matter of data and prompting instead. Their bottleneck is data: robot experience is scarce compared with web text, which is why teams invest in teleoperation fleets, motion capture and synthetic data. See also embodied AI.

Frequently asked questions

Is a VLA model a robot foundation model?

Yes. A VLA is one kind of robot foundation model, the kind that outputs robot actions directly. Others predict future video (world models) or plan steps in language.

Where does the training data come from?

Teleoperated robot demonstrations, datasets pooled from many robot types, simulation and synthetic data, human video and motion capture, plus the web knowledge inherited from the vision-language model it starts from.

Does one model work on any robot?

Not out of the box. Most need fine-tuning with data from the target robot, although training across many robot bodies reduces how much new data that takes.

Coverage

Companies

Newsletter

Robrief Weekly

One email a week with the robotics news that matters. Free, unsubscribe anytime.