Ultimate access to all questions.
Upgrade Now 🚀
Sign in to unlock AI tutor
In a data pipeline that processes streaming data, how can you ensure data quality and handle data skew in real-time?
A
Implement a data validation process that checks for data completeness, consistency, accuracy, and integrity in real-time as the data is ingested.
B
Use a data skew detection mechanism that identifies and redistributes skewed data in real-time to balance the load across processing nodes.
C
Ignore data quality and skew issues in streaming data pipelines, focusing only on the speed of data processing.
D
Manually inspect a sample of the streaming data to ensure quality and consistency before processing.
