In a Databricks workspace, your team is working on a project that involves multiple notebooks performing various tasks including data ingestion, data processing, and machine learning model training. The project is expected to scale over time, adding more notebooks and team members. Considering the need for maintainability, scalability, and collaboration, what is the BEST way to organize these notebooks? (Choose one option.)

Simulated

Maintain all notebooks in a single folder with descriptive naming conventions to differentiate tasks, despite the potential increase in volume.

7.2%

Create a hierarchical folder structure within the workspace, segregating notebooks into separate folders based on their task (e.g., ingestion, processing, ML training) and further organizing them by functionality or team.

59.8%

Distribute notebooks across multiple Databricks workspaces according to their task, utilizing Databricks Repos for version control and access management.

25.9%

Develop a custom web application to host all notebooks, using the application's navigation to switch between tasks, thereby centralizing access.

7.2%

Databricks Certified Data Engineer - Associate

Get started today

Comments