Databricks Certified Data Engineer - Associate

Explanation

Correct Answer: C

This question tests understanding of Delta Live Tables (DLT) pipeline modes, specifically Continuous Pipeline Mode in Production mode.

Key Concepts:

1. Continuous Pipeline Mode:

   • In Continuous mode, the pipeline runs continuously and processes data as it arrives
   • It doesn't stop after a single update
   • The pipeline keeps running until explicitly stopped

2. Production Mode:

   • In Production mode, compute resources are managed efficiently
   • Compute clusters are deployed when needed for processing
   • Resources are terminated when the pipeline is stopped to optimize costs

3. Dataset Types:

   • STREAMING LIVE TABLE: Processes streaming data continuously
   • LIVE TABLE: Processes batch data
   • Both types will be updated according to the pipeline mode

Why Option C is Correct:

• "All datasets will be updated at set intervals until the pipeline is shut down": This matches Continuous mode behavior where the pipeline runs continuously, processing data at regular intervals
• "The compute resources will be deployed for the update and terminated when the pipeline is stopped": This matches Production mode behavior where resources are managed efficiently - deployed when needed and terminated when the pipeline stops

Why Other Options are Incorrect:

• A: Incorrect because it says "compute resources will persist" - in Production mode, resources are terminated when the pipeline stops
• B: Incorrect because Continuous mode doesn't run once and shut down; it runs continuously
• D: Incorrect because Continuous mode doesn't run once and shut down; it runs continuously until manually stopped

Additional Context:

• In Development mode, compute resources persist after pipeline runs for testing purposes
• In Triggered mode, the pipeline runs once and then stops
• The combination of Continuous + Production mode ensures continuous processing with efficient resource management