Polymorph/Physical AI, ExplainedGlossary

Physical AI glossary

What is Teleoperation?

Teleoperation: a person controlling the robot remotely; it delivers a service and produces training data.

In the guide: 1.2 Seventy years of slow progress

Robotics was one of the first goals of artificial intelligence research, and it has shown the least visible progress. Old footage makes the point. In 1957 a robot at a public exhibition was controlled by a person behind a curtain using a leader-follower rig: a second, matching arm that the operator moves by hand while the real arm reproduces each motion. Today this method is called teleoperation, and most labs still collect their robot training data this way. In the 1960s a university robot looked at a picture of stacked blocks and assembled the same stack from real ones, a task researchers called the "blocks world". Colorized and given a modern voiceover, those films would be hard for most viewers to tell apart from a 2026 demo.

Read 1.2 in context →

In the guide: 1.3 From programming robots to training them

In the last few years, robots have begun to learn behaviour from data instead of following hand-written instructions. The most common approach is imitation learning: a person demonstrates a task many times, usually by teleoperation, and a neural network learns to map what the robot sensed at each moment to the action the person took. A second approach, reinforcement learning, lets the robot improve by trial and error against a reward signal, often in simulation. In both cases the engineer's job shifts. Less time goes into specifying motions and enumerating failure cases, and more goes into where the data comes from, how good it is, and how to obtain more of it.

Read 1.3 in context →

In the guide: 2.3 Data got 60% cheaper

The report puts the cost of a fully loaded hour of labelled teleoperation data at about $340 in early 2024, falling to $118 by March 2026. Teleoperation is the practice of a human operator controlling a robot remotely while the system records what the robot sensed and what it was commanded to do; each recorded attempt at a task is an episode, and a collection of good episodes becomes training data for imitation learning. "Fully loaded" means the figure includes everything required to produce a usable hour: operator wages, equipment, the robot's time, supervision, annotation and quality control, rather than the operator's time alone. "Labelled" means the episodes have been annotated with information such as task boundaries, success or failure, and language descriptions of what was done.

Read 2.3 in context →

All 54 terms in the glossary · Read Physical AI, Explained