Polymorph/Physical AI, ExplainedGlossary

Physical AI glossary

What is Active learning?

Active learning: letting the model's own weaknesses decide which data to collect next.

In the guide: 6.5 Human-in-the-loop active learning

A third route to reliability sits between collecting more demonstrations and letting the robot practise alone. The robot runs on the real task, the reward model shows where it struggles, people record demonstrations of how to recover in exactly those situations, the model is retrained, and the cycle repeats. The model's own weaknesses decide what data to collect next, which is what active learning means: instead of gathering data uniformly, the learner directs collection toward the examples it is most uncertain about or most likely to get wrong. Uniform collection spends most of its effort on situations the model already handles, while targeted collection spends it on the failure modes that limit reliability.

Read 6.5 in context →

All 54 terms in the glossary · Read Physical AI, Explained