Polymorph/Physical AI, ExplainedGlossary

Physical AI glossary

What is Closed-loop simulation?

Closed-loop (reactive) simulation: a virtual world that responds to the robot's actions, unlike an open-loop replay of a recording.

In the guide: 3.11 Memory and context

Most state-of-the-art robot foundation models have no memory or context. They act only on what the cameras show at that moment, a property called being memoryless or reactive. That suffices for short, repetitive motions, where the current image contains everything needed to choose the next action, but long jobs require memory. Halfway through opening a microwave, a single frame cannot show whether the robot is opening or closing it. A dryer's blinking indicator may appear off in one frame even though the machine is running. In both cases the correct action depends on information that is no longer visible, and a memoryless policy can oscillate, repeat a completed step or abandon one halfway.

Read 3.11 in context →

In the guide: 4.9 Simulation spectrum and world models

A working definition: a world model is a simulation close enough to reality, and responsive enough, that a robot can act in it and the world reacts appropriately. A reactive (closed-loop) world responds to what the robot does, so a policy can be tested or trained inside it. An open-loop world simply replays a recording regardless of the robot's actions, which is useful for evaluating perception but cannot show the consequences of a different decision.

Read 4.9 in context →

All 54 terms in the glossary · Read Physical AI, Explained