Databricks Certified Data Engineer - Associate
Get started today
Ultimate access to all questions.
An engineering manager wants to monitor the performance of a recent project using a Databricks SQL query. For the first week following the project's release, the manager wants the query results to be updated every minute. However, the manager is concerned that the compute resources used for the query will be left running and cost the organization a lot of money beyond the first week of the project's release.
Which of the following approaches can the engineering team use to ensure the query does not cost the organization any money beyond the first week of the project's release?
Real Exam
Community
KKeng
A
They can set a limit to the number of DBUs that are consumed by the SQL Endpoint.
B
They can set the query's refresh schedule to end after a certain number of refreshes.
C
They cannot ensure the query does not cost the organization money beyond the first week of the project's release.
D
They can set a limit to the number of individuals that are able to manage the query's refresh schedule.
E
They can set the query's refresh schedule to end on a certain date in the query scheduler.
Explanation:
Explanation
The correct answer is E because Databricks SQL queries with scheduled refreshes can be configured with an end date in the query scheduler. This allows the engineering team to:
- Set up the query to refresh every minute during the first week
- Configure the schedule to automatically end after the first week
- Ensure that no further compute resources are consumed beyond that period
Why other options are incorrect:
- A: Setting a limit to the number of DBUs consumed by the SQL Endpoint would limit overall endpoint usage but wouldn't specifically stop this query's scheduled refreshes after the first week.
- B: Setting the query's refresh schedule to end after a certain number of refreshes could work, but option E is more precise since it allows ending on a specific date (after exactly one week).
- C: This is incorrect because Databricks provides mechanisms to control scheduled query execution.
- D: Limiting who can manage the query's refresh schedule doesn't prevent the query from continuing to run and incurring costs.
Best Practice: When setting up time-bound monitoring queries in Databricks SQL, always configure an end date in the scheduler to prevent unnecessary costs from ongoing refreshes.
Comments
Loading comments...