Explanation:
Checkpoints cannot be shared between separate streams. Each stream must have its own checkpoint directory to maintain processing guarantees. Reference: Databricks Blog on Streaming Production Best Practices
Ultimate access to all questions.
Which of the following statements about checkpointing in Spark Structured Streaming is not correct?
A
Checkpointing enables the streaming engine to monitor the progress of stream processing.
B
Checkpoints are used to save the current state of a streaming job to cloud storage.
C
Checkpoints can be shared between different streams.
D
The checkpointLocation option is used to specify the checkpoint in a streaming query.
E
Fault-tolerant stream processing is ensured by checkpointing with the write-ahead logs mechanism.
No comments yet.