
Explanation:
To achieve consistent, reproducible outputs across multiple calls to the same model with the same input, you need:
Low temperature: Temperature controls the randomness of the model's outputs. A low temperature (closer to 0) makes the model more deterministic and focused on the highest probability tokens.
Fixed random seed: The random seed ensures that any random processes in the model are initialized the same way each time, providing reproducibility.
Why other options are incorrect:
Key takeaway: For reproducible results in generative AI models, use low temperature combined with a fixed random seed.
Ultimate access to all questions.
A product manager wants consistent, reproducible outputs across multiple calls to the same model using the same input. Which configuration should they use?
A
High temperature
B
Randomized seed
C
Low temperature and fixed random seed
D
High top-p value
No comments yet.