Explanation:
In stream-stream joins, Spark buffers past inputs as a streaming state for both input streams. This allows every future input to be matched with past inputs. The state can be limited by using watermarks. Reference: Introducing Stream-Stream Joins in Apache Spark 2.3.
Ultimate access to all questions.
What is the correct statement about streaming state in Stream-Stream Joins?
A
Stream-Stream Joins are stateless, meaning Spark does not buffer past inputs as a streaming state for the input streams.
B
Spark buffers past inputs as a streaming state for the left input stream only, to match future right inputs with past left inputs.
C
Spark buffers past inputs as a streaming state for the right input stream only, to match future left inputs with past right inputs.
D
Spark buffers past inputs as a streaming state for both input streams, enabling every future input to be matched with past inputs.
E
Stream-Stream Joins do not support limiting the state information using watermarks.
No comments yet.