Explanation:
Correct Answer: D
dbutils.library.installPyPI('custom_lib') to the cluster's initialization script ensures the library is installed on all nodes, making it available to all notebooks.For widespread availability of custom_lib across all notebooks on a Databricks cluster, the team should implement Option D by incorporating the library installation command into the cluster's initialization script.
Ultimate access to all questions.
How can a data science team ensure that a custom Python library, custom_lib, is available to all notebooks running on a shared Databricks cluster?
A
Configure the cluster to use the Databricks Runtime for MLlib.
B
Include the path to custom_lib in the PYTHONPATH variable within the cluster configuration.
C
Execute %pip install custom_lib in any notebook connected to the cluster.
D
Add dbutils.library.installPyPI('custom_lib') to the cluster's initialization script.
E
It is impossible to make custom_lib available on the cluster.
No comments yet.