Answer-first summary for fast verification
Answer: Allows the model to consider a broader range of likely next words, increasing variability
Top-p (nucleus sampling) controls the cumulative probability distribution of tokens. When you increase the top-p value, you're allowing the model to consider a broader range of likely next words from the probability distribution, which increases variability and creativity while still maintaining coherence by excluding very low-probability tokens.
Author: Ritesh Yadav
Ultimate access to all questions.
You are configuring a Bedrock model for generating marketing slogans. To ensure the output remains creative but not too random, you adjust the top-p (nucleus sampling) parameter. What effect does increasing the top-p value have?
A
Limits the model to only the top 1% of probable words
B
Allows the model to consider a broader range of likely next words, increasing variability
C
Makes the model more deterministic and repetitive
D
Forces the model to only select the most probable token each time
No comments yet.