AWS Certified Cloud Practitioner

Explanation

Temperature is a parameter that controls the randomness of AI model outputs:

• Temperature = 0.0: Produces deterministic, predictable responses by always selecting the most probable next token. This eliminates randomness but can make responses repetitive and less creative.
• Temperature = 0.7: Provides a good balance between randomness and relevance. It allows some variability while keeping responses mostly on-topic.

Why temperature = 0.7 is correct:

1. The chatbot is currently producing overly random responses with off-topic tokens - this indicates the temperature is likely set too high (e.g., 1.0 or higher).
2. The team wants to keep responses relevant - lowering temperature helps with this.
3. The team still wants to allow some variability - temperature = 0.0 would eliminate all variability, making responses too predictable.
4. Temperature = 0.7 is a commonly recommended value that provides a good balance between creativity and coherence.

Temperature scale:

• 0.0-0.3: Very low randomness, highly predictable
• 0.4-0.7: Balanced randomness (recommended for most applications)
• 0.8-1.0: High randomness, more creative but less focused
• >1.0: Very high randomness, often produces nonsensical or off-topic responses

By setting temperature to 0.7, the chatbot will produce more relevant responses while maintaining enough variability to avoid sounding robotic or repetitive.