Polymorph/Physical AI, ExplainedGlossary

Physical AI, Explained · Part 1

Physical AI vs. digital AI

Read this part in the book →

1.1 Two kinds of AI

Digital AI operates entirely on information: conversation, code, search, ad ranking, image and video generation. It is trained mostly on data gathered from the internet, its inputs and outputs are both symbols (text, pixels, numbers), and an error usually costs little, because a wrong answer can be ignored, corrected or regenerated before it affects anything.

Physical AI controls machines that move in the real world: cars, trucks, drones, factory arms, humanoids. Such a system runs a continuous cycle of perception (reading cameras, joint encoders, force and touch sensors), decision (choosing the next action) and actuation (sending commands to the motors). Its output is a change in the physical world, which often cannot be undone: a dropped part stays dropped, and a collision has already happened by the time anyone notices it.

Four differences shape almost everything else about the field:

  1. There is no internet to train on. The useful data, such as how a particular factory line runs or how a hand closes on an egg without crushing it, is not on the web. Video of people working shows what happened but not the forces involved, and it is recorded from a human body, not a robot's. Robot data is also tied to the machine that produced it: a recording of one arm's joint angles does not transfer directly to an arm with different link lengths or a different gripper, a problem known as the embodiment gap. Someone has to go and collect this data, usually one demonstration at a time, which is why data is the field's biggest bottleneck (Part 4).
  2. Safety comes first. A heavy machine, or a humanoid that could fall on a child, needs far more testing than software does. What matters is behaviour in the long tail, the large set of rare situations that each occur seldom but together occur often: a reflective surface that confuses a camera, a person stepping into the work area, an object of an unfamiliar shape. A system can perform well on average and still fail badly in exactly these cases, so its average performance says little about whether it is safe to deploy.
  3. It runs in real time. A chatbot waits for a prompt and then answers. A robot works continuously and must react within milliseconds; the low-level control loops that hold a joint at its commanded position typically run at hundreds of hertz to a kilohertz. The robot also depends on hardware that changes over time: motors overheat and lose torque, sensors drift out of calibration, gears wear, and cables fatigue. The software has to keep working as the body underneath it degrades.
  4. It is tied to national interests. Physical AI touches defence, critical infrastructure, export controls and national rules on where data may be stored. Robots also record video inside factories, warehouses and homes, which raises questions of security and privacy that pure software rarely does. As a result each country tends to develop its own market rather than adopting one global product.

Why it matters: These four constraints, more than any shortage of ideas, explain why robotics has been "10 years away" for decades. Most of world GDP comes from physical industries, so companies that succeed in putting intelligence into machines could eventually become larger than purely digital ones.

1.2 Seventy years of slow progress

Robotics was one of the first goals of artificial intelligence research, and it has shown the least visible progress. Old footage makes the point. In 1957 a robot at a public exhibition was controlled by a person behind a curtain using a leader-follower rig: a second, matching arm that the operator moves by hand while the real arm reproduces each motion. Today this method is called teleoperation, and most labs still collect their robot training data this way. In the 1960s a university robot looked at a picture of stacked blocks and assembled the same stack from real ones, a task researchers called the "blocks world". Colorized and given a modern voiceover, those films would be hard for most viewers to tell apart from a 2026 demo.

Over the same period, chips, phones, computer vision and language technology advanced dramatically. Robotics did not, for two related reasons. First, the field treated robots mainly as a hardware problem, investing in better arms, motors and sensors while lacking a general-purpose way to decide what the machine should do. Second, researchers consistently underestimated how hard everyday physical skill is. AI researchers have long observed that tasks humans find intellectually demanding, such as chess or algebra, turned out to be comparatively easy for computers, while tasks a small child performs without thought, such as picking up an unfamiliar object or walking over uneven ground, turned out to be extremely hard. Human perception and motor control are the product of a very long evolutionary history, and they feel effortless precisely because so much of the work happens below conscious awareness, which hid their difficulty from the people trying to replicate them.

1.3 From programming robots to training them

For about 65 years, people programmed robots by hand. An engineer studied a task and specified every motion explicitly: the sequence of positions the gripper should pass through, the speed along each segment, and the conditions under which to stop. Converting a desired gripper position into the joint angles that produce it is called inverse kinematics, and classical industrial robotics is built on solving it precisely for positions known in advance. This works inside a cage, where every part sits in a known position to a fraction of a millimetre, because the robot is replaying a trajectory, not reacting to what it sees. It fails as soon as something moves. The cage, the fixtures (custom clamps and jigs that hold each part in exactly the expected place) and the measuring equipment around a classic factory robot can cost several times more than the robot itself, and any change to the product means redesigning the whole setup. This is why hand-programmed robots spread through high-volume, low-variation work such as car body welding and painting, and almost nowhere else.

In the last few years, robots have begun to learn behaviour from data instead of following hand-written instructions. The most common approach is imitation learning: a person demonstrates a task many times, usually by teleoperation, and a neural network learns to map what the robot sensed at each moment to the action the person took. A second approach, reinforcement learning, lets the robot improve by trial and error against a reward signal, often in simulation. In both cases the engineer's job shifts. Less time goes into specifying motions and enumerating failure cases, and more goes into where the data comes from, how good it is, and how to obtain more of it.

Until recently, robots had no meaningful intelligence in this sense: they could repeat, but not adapt. In roughly the last 18 months, learned systems have started to cope with uncertainty. Because the model reads its cameras continuously and chooses each action from the current scene, it can notice that an object has shifted, react, and still finish the task when things move around it. The change is in the source of the behaviour, which now comes from examples rather than from code, and this lets the same software approach extend to tasks that no engineer could have specified step by step.

Why it matters: Earlier "year of the robot" announcements came with no new method; the current wave comes with the learning method that already works for language and images.

1.4 Robots have to act without a person checking

Almost every successful AI product so far, from product recommendations to chatbots to coding assistants, leaves the final decision to a person. A recommendation can be skipped, a chatbot answer reread, a suggested line of code rejected before it runs. This arrangement, called human-in-the-loop, is why imperfect models are still useful: the person catches most errors, and the remaining ones are usually cheap.

A robot earns its keep only when nobody has to check each move. If an operator must watch the machine and step in whenever it hesitates, the labour saving largely disappears. Physical tasks also compound errors in a way single answers do not. A task such as unloading a bin is a long chain of steps (locate, grasp, lift, move, place), and the task succeeds only if every step does, so a small per-step failure rate multiplies into a much larger per-task failure rate. A learned policy has a further weakness: after one small error it finds itself in a situation that looks slightly unlike its training examples, which makes the next error more likely. Practitioners therefore measure deployed robots by how often a person has to intervene, typically as interventions per hour or the time between failures, rather than by accuracy on a test set.

Why it matters: Reliability without supervision is the central problem in the field today (Part 6), and a demo video, which shows a successful attempt and not the failure rate, says little about it.

1.5 Why it has to be a robot

Almost none of the universe is inside a computer: the internet is very small, and the universe is very big. Text and images record what people chose to write down or photograph, not how objects actually behave when pushed, lifted, squeezed or dropped. On this argument, a machine that understands physical things has to learn from the physical world, through a body that can act and observe the consequences. Cognitive scientists call the general idea embodied cognition: the claim that intelligence is shaped by, and partly built from, interaction between a body and its environment.

A stronger version of the argument starts from evolution. Animals spent hundreds of millions of years developing physical skill and then vision, while human language is only tens of thousands of years old. On this view, language is a late product of intelligence and not its foundation, and the capacity to perceive and act in the physical world is the main route to general intelligence. A model trained only on text would then be learning the thin final layer of intelligence without the deep structure beneath it.

The debate: That position is philosophical and unproven. The opposing bet is that text and video, at sufficient scale, can teach a machine most of what it needs, with robot data required only to fill the remaining gap. The evolutionary view remains a useful check on the common assumption that robotics will simply follow the path of language models.


  Part 2. The industry in numbers, 2026 →