To efficiently manage variable workloads by implementing predictive scaling for your Databricks clusters based on historical performance metrics, which combination of Azure services and features would you choose?

Real Exam

Azure Logic Apps to monitor Databricks metrics and scale clusters based on predefined rules

10.4%

Utilizing Databricks REST API to dynamically scale clusters in response to Azure Log Analytics alerts

12.5%

Azure Machine Learning to model workload patterns and Azure Function to adjust Databricks cluster size based on predictions

61.5%

Azure Monitor Autoscale to automatically scale Databricks clusters based on CPU and memory utilization

15.6%

Databricks Certified Data Engineer - Professional