Polymorph/Physical AI, ExplainedGlossary

Physical AI glossary

What is Out of distribution?

Out of distribution: a situation unlike anything in the training data.

In the guide: 6.2 Recovering from mistakes

A standard model trained purely by imitation shows the opposite behaviour. It performs well until it makes a small mistake, then typically goes out of distribution, meaning it faces a situation unlike anything in its training data, and from there it gets stuck or makes things worse. The mechanism is well understood. In imitation learning, also called behaviour cloning, a policy is trained to copy the actions in human demonstrations, and those demonstrations almost always show an expert doing the task correctly. The model therefore never sees what to do after an error. Once a small deviation occurs, the robot is in a state the demonstrations did not cover, its next action is less accurate, which pushes it further from familiar states, and the errors accumulate. This is called compounding error, and the mismatch between the states seen in training and the states the robot actually visits is called covariate shift. The standard remedy, associated with an algorithm known as dataset aggregation, is to let the robot run its own policy, record the states it drifts into, and have a human supply the correct action in those states, so that the training data comes to include the situations the robot itself creates.

Read 6.2 in context →

All 54 terms in the glossary · Read Physical AI, Explained