Explanation
Correct Answer: B (Increase top-p to 0.95)
Why this is correct:
- Top-p (nucleus sampling) controls the diversity of generated text by considering only the top tokens whose cumulative probability exceeds the threshold p.
- Increasing top-p to 0.95 means the model considers a broader range of possible tokens (95% of the probability mass), allowing for more diverse and creative outputs.
- For ad copy and marketing content, creativity and imagination are crucial. A higher top-p value encourages the model to explore more varied word choices and sentence structures, making the output less predictable and more engaging.
Why other options are incorrect:
- A. Lower temperature to 0.3: Temperature controls randomness - lower temperature (0.3) makes outputs more deterministic and conservative, which would make the text even more robotic, not less.
- C. Reduce max-tokens: This limits the length of generated text but doesn't directly affect creativity or imagination in the content.
- D. Add stop-sequence after each sentence: This controls when generation stops but doesn't improve the quality or creativity of the content itself.
Key Concept: In generative AI models like those in Amazon Bedrock, top-p (nucleus sampling) is particularly effective for balancing creativity with coherence, making it ideal for creative writing tasks like ad copy generation.