Logits — AI Glossary

Logits are the raw, unnormalized numerical scores that a language model assigns to each token in its vocabulary as the potential next token. Before being converted into probabilities through a softmax function, logits represent the model's relative confidence in each option. Accessing logits directly enables advanced techniques like constrained decoding, custom sampling strategies, and classifier-free guidance.