In a scenario where a Databricks cluster is experiencing performance issues due to a memory leak, and the team is under pressure to minimize downtime while ensuring the issue is thoroughly resolved, what is the BEST course of action? Consider the need for quick resolution, the importance of identifying the root cause to prevent recurrence, and the impact on ongoing data processing tasks. Choose the most appropriate option from the following:

Simulated

Immediately restart the cluster to quickly resolve the performance issues without any investigation, as this is the fastest way to restore functionality.

3.9%

Investigate the cause of the memory leak by reviewing the application logs and code, apply necessary fixes to the code, and then restart the cluster to ensure the fixes are effective and to clear any residual issues.

90.3%

Continue running the cluster as is, monitoring the situation closely, but take no immediate action to avoid any disruption to ongoing processes.

1.6%

Restart the cluster and immediately rerun the same jobs without any changes, assuming the restart will permanently resolve the memory leak issue.

4.2%

Databricks Certified Data Engineer - Associate

Get started today

Comments