Databricks Certified Data Engineer - Associate
Get started today
Ultimate access to all questions.
An engineering manager is responsible for monitoring the ingestion latency of various data sources using a Databricks SQL query. This query provides critical insights into the performance and timeliness of data ingestion processes. Every day, the manager manually reruns this query and waits for the results, which can be time-consuming and inefficient. What steps can the manager take to automate the daily updating of the query results to improve efficiency and ensure up-to-date information is readily available?
An engineering manager is responsible for monitoring the ingestion latency of various data sources using a Databricks SQL query. This query provides critical insights into the performance and timeliness of data ingestion processes. Every day, the manager manually reruns this query and waits for the results, which can be time-consuming and inefficient. What steps can the manager take to automate the daily updating of the query results to improve efficiency and ensure up-to-date information is readily available?
Explanation:
The manager can schedule the query to refresh every 1 day from the query’s page in Databricks SQL. This can be done by going to the Query Editor, clicking on Schedule > Add schedule, and specifying the frequency, period, starting time, and time zone. This ensures that the query runs automatically each day, providing updated results without manual intervention.