
Answer-first summary for fast verification
Answer: Temperature = 0.1, top-p = 0.5
## Explanation For a financial compliance chatbot that requires **factual and deterministic answers**, the key parameters to consider are: ### Temperature Parameter - **Temperature controls the randomness/creativity** of the model's output - **Lower temperature (closer to 0)** = more deterministic, focused, and factual responses - **Higher temperature (closer to 1 or above)** = more creative, diverse, and random responses ### Top-p (Nucleus Sampling) - **Top-p controls the cumulative probability threshold** for token selection - **Lower top-p values** = more focused on high-probability tokens - **Higher top-p values** = more diverse token selection ### Analysis of Options: **A. Temperature = 0.1, top-p = 0.5** ✓ **CORRECT** - Temperature 0.1 is very low → highly deterministic - Top-p 0.5 is moderate → focuses on high-probability tokens - This combination produces consistent, factual responses **B. Temperature = 1.0, top-k = 100** - Temperature 1.0 is high → introduces randomness - Top-k 100 allows many tokens → increases diversity - Not suitable for factual compliance responses **C. Temperature = 0.9, top-p = 0.95** - Temperature 0.9 is high → too much randomness - Top-p 0.95 is very high → includes many low-probability tokens - Creates creative but potentially inaccurate responses **D. Temperature = 1.2, enable repetition penalty** - Temperature 1.2 is very high → maximum randomness - Repetition penalty prevents repetition but doesn't ensure factual accuracy - Worst choice for factual compliance chatbot ### Why Option A is Best: 1. **Low temperature (0.1)** minimizes randomness and ensures the model chooses the most likely, factual tokens 2. **Moderate top-p (0.5)** focuses on high-probability tokens without being overly restrictive 3. This combination produces **consistent, reliable, and deterministic** responses essential for financial compliance 4. Financial compliance requires **zero creativity** and **maximum factual accuracy** ### Key Takeaway: For applications requiring factual, deterministic outputs (compliance, legal, medical, technical documentation), always use **low temperature values (0.1-0.3)** and **moderate to low top-p values (0.5-0.7)** to ensure consistency and accuracy.
Author: Ritesh Yadav
Ultimate access to all questions.
No comments yet.
A financial compliance chatbot must produce very factual, deterministic answers. Which configuration is best?
A
Temperature = 0.1, top-p = 0.5
B
Temperature = 1.0, top-k = 100
C
Temperature = 0.9, top-p = 0.95
D
Temperature = 1.2, enable repetition penalty