Answer-first summary for fast verification
Answer: The required compute resources could be costly
The correct answer is A because the primary concern with refreshing a dashboard every minute is the significant compute cost associated with frequent queries and processing. While Structured Streaming with Delta Live Tables (DLT) can handle real-time data and incremental refreshes efficiently, the continuous compute resources required for minute-by-minute dashboard updates would be expensive. Option B is incorrect because gold-level tables are typically clean and suitable for business reporting. Option C is wrong as streaming data is appropriate for dashboards. Option D is not valid since streaming clusters are designed to be fault-tolerant. Option E is incorrect because dashboards can technically be refreshed quickly, though at high cost.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
A data engineering team has implemented a Structured Streaming pipeline that populates gold-level tables by processing data in micro-batches triggered every minute. A data analyst is creating a dashboard based on this gold-level data, and stakeholders require the dashboard results to update within one minute or less of new data arriving in the tables.
Which of the following cautions should the data analyst share before configuring the dashboard to meet this requirement?
A
The required compute resources could be costly
B
The gold-level tables are not appropriately clean for business reporting
C
The streaming data is not an appropriate data source for a dashboard
D
The streaming cluster is not fault tolerant
E
The dashboard cannot be refreshed that quickly
No comments yet.