Glossary
What is Inference?
Inference is an already-trained model producing an output.
Inference cost has been falling sharply, which is part of why the model layer is now a commodity. Training teaches a model; inference uses it.
Updated
- Related terms