Inference

The act of running a trained model to get an output, as opposed to training it.

Why it matters

Inference is what happens every time you send a prompt, and it is where most of the ongoing cost of running AI comes from.