Physical AI glossary
What is Throughput?
Throughput: useful output per hour, combining success rate and speed.
In the guide: 4.10 Evaluation
- A three-stage check before deployment. First, set targets for accuracy and time (if one bus bar takes a day, no deployment wants it). Second, work through a list of disruptions, such as a box left in the way or the lights going off, to measure how the robot behaves outside the conditions it was trained in. Third, test safety rules, such as stopping when someone cuts the camera cable, to confirm that faults lead to a safe state.
- Benchmarks based on paid tasks. Use customers' real tasks and parts, so that passing the benchmark means the robot is commercially useful rather than merely competent on a laboratory proxy.
- Throughput, not only success rate. Measures such as boxes per hour combine success and speed in a single figure, and companion measures such as interventions per hour and mean time between failures (MTBF) capture how often a human must step in and how long the robot runs unaided.
- The customer's standard, not the researcher's. A restaurant grades a folded napkin on a scale where acceptable and unacceptable can differ by about an inch in a single fold, a distinction a binary research label of success or failure would miss.
In the guide: 6.4 Making real-world RL affordable
Each cycle produces a better policy, whose deployment produces better data, which trains a better value function. Reported results include roughly double the throughput from the RL stage alone, over 90 percent success at making espresso, a latte service that ran for 13 hours straight, and a real box-assembly job at a customer's factory, a job the workers there disliked. These results are still not 99.99 percent reliable, and the robots are still slower than people.
In the guide: 6.7 Speed
The usual measure is throughput, the number of units of work completed per hour, which combines speed and reliability: a fast robot that needs frequent resets can have lower throughput than a slower one that never stops.