Physical AI glossary
What is Compositional generalization?
Compositional generalization: combining known skills or concepts in a new way never seen in training.
In the guide: 3.9 Compositional generalization
A capable language model can write whole paragraphs in the phonetic alphabet, even though dictionaries show that alphabet only one word at a time. Combining known pieces in a new way like this is called compositional generalization. An image generator can likewise draw an armchair shaped like an avocado. The model never needed a picture of that exact combination, because it had learned "armchair" and "avocado" as separable concepts that can be recombined.