Temperature
Temperature is a parameter that controls the randomness and creativity of an AI model's output. A lower temperature (e.g., 0.1) makes the model more deterministic and focused, favoring the most probable tokens, while a higher temperature (e.g., 1.0) increases randomness, producing more diverse and creative but potentially less accurate responses.
Example
For a factual Q&A bot, you set temperature to 0.2 for consistent, accurate answers. For a creative writing assistant generating story ideas, you set temperature to 0.9 to encourage more varied and imaginative suggestions.
Frequently asked questions
What is Temperature?
- Temperature is a parameter that controls the randomness and creativity of an AI model's output. 0) increases randomness, producing more diverse and creative but potentially less accurate responses.
Can you give an example of Temperature?
- For a factual Q&A bot, you set temperature to 0.2 for consistent, accurate answers. For a creative writing assistant generating story ideas, you set temperature to 0.9 to encourage more varied and imaginative suggestions.