
Ultimate access to all questions.
Consider a Databricks job that processes sensor data from IoT devices, performs real-time analytics, and stores the results in a database. The job has recently started failing due to an increase in the number of connected devices. Describe the steps you would take to scale the job to handle the increased load and ensure successful execution.
A
Increase the number of worker nodes in the cluster, optimize the data processing logic for performance, and rerun the job.
B
Reduce the scope of the data processing, keep the cluster size unchanged, and rerun the job.
C
Manually split the sensor data into smaller batches, process each batch separately, and aggregate the results.
D
Switch to a different cluster type with higher processing power, keep the data processing logic unchanged, and rerun the job.