Answer-first summary for fast verification
Answer: Use Spark structured streaming to read the data from a storage account, perform real-time processing, apply sentiment analysis algorithms, and handle schema drift.
Option D is the correct approach as it covers all the necessary components for processing real-time social media data for sentiment analysis using Spark structured streaming. It includes reading the data in real-time, performing real-time processing, applying sentiment analysis algorithms, and handling schema drift. This approach ensures that the solution can handle the time-sensitive nature of social media data and provide insights into sentiment trends.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
You are working on a project that requires processing real-time social media data for sentiment analysis. The data is being ingested in real-time and needs to be processed and analyzed for positive, negative, and neutral sentiments. How would you approach this task using Spark structured streaming?
A
Use Spark structured streaming to read the data from a storage account and perform batch processing.
B
Use Spark structured streaming to read the data from a storage account and perform real-time processing.
C
Use Spark structured streaming to read the data from a storage account, perform real-time processing, and apply sentiment analysis algorithms.
D
Use Spark structured streaming to read the data from a storage account, perform real-time processing, apply sentiment analysis algorithms, and handle schema drift.
No comments yet.