In your role as a Databricks Certified Data Engineer, you are tasked with optimizing the performance of a Databricks notebook that processes large datasets. The notebook is part of a critical data pipeline that feeds into a real-time analytics dashboard. The dashboard's performance has been degrading, and initial investigations suggest the notebook is the bottleneck. You need to ensure the solution is cost-effective, scalable, and complies with the organization's data governance policies. Which of the following approaches would BEST address these requirements? Choose one option. | Databricks Certified Data Engineer - Professional Quiz