Distillation

Training a smaller model to copy the behavior of a larger one, keeping much of the quality at lower cost.

Why it matters

Distillation is how labs ship fast, cheap models that still perform well.