AWS Certified Cloud Practitioner
Get started today
Ultimate access to all questions.
Deep dive into the quiz with AI chat providers.
We prepare a focused prompt with your quiz and certificate details so each AI can offer a more tailored, in-depth explanation.
An AI chatbot for banking customers sometimes continues responding after "Thank you for contacting us." Which parameter should you use to end generation at that phrase?
Real Exam
Community
RRitesh
A
stop-sequences
B
temperature
C
top-p
D
max-tokens
Explanation:
Explanation
stop-sequences is the correct parameter to use when you want to stop text generation at specific phrases or sequences.
Why stop-sequences is correct:
-
Purpose: Stop sequences allow you to define specific strings or phrases where the model should stop generating text
-
Use case: When you want to end generation at a particular phrase like "Thank you for contacting us."
-
Functionality: The model will stop generating once it encounters any of the specified stop sequences
Why other options are incorrect:
-
B. temperature: Controls randomness in generation (higher = more random, lower = more deterministic)
-
C. top-p: Controls diversity via nucleus sampling (probability mass threshold)
-
D. max-tokens: Limits the maximum number of tokens generated, but doesn't stop at specific phrases
Practical Application:
In banking chatbots, using stop sequences ensures that responses end cleanly with standard closing phrases, preventing awkward or unnecessary continuation of conversation after the intended endpoint.
Comments
Loading comments...