Inference — AI Glossary

Inference is the process of using a trained AI model to generate predictions or outputs from new inputs. When you send a prompt to ChatGPT or Claude and receive a response, the model is performing inference — applying its learned patterns to produce output tokens one at a time. Inference speed, cost, and quality are key considerations when deploying AI applications.