Databricks Certified Data Engineer - Associate
Get started today
Ultimate access to all questions.
In a Delta Live Table pipeline configured to run in Production mode with Continuous Pipeline Mode, there are five datasets: two defined using STREAMING LIVE TABLE and three defined against Delta Lake table sources using LIVE TABLE. Given that previously unprocessed data exists and all dataset definitions are valid, what is the expected outcome upon clicking Start to update the pipeline?
In a Delta Live Table pipeline configured to run in Production mode with Continuous Pipeline Mode, there are five datasets: two defined using STREAMING LIVE TABLE and three defined against Delta Lake table sources using LIVE TABLE. Given that previously unprocessed data exists and all dataset definitions are valid, what is the expected outcome upon clicking Start to update the pipeline?
Explanation:
In Continuous Pipeline Mode within Delta Live Tables, the pipeline continuously processes data at set intervals as long as the pipeline is running. When configured in Production mode, the compute resources are actively engaged during updates and are terminated when the pipeline is stopped. This ensures that the datasets are updated continuously and the resources are optimized by releasing them once the pipeline is halted.