Databricks Certified Machine Learning - Associate
Get started today
Ultimate access to all questions.
Comments
Loading comments...
Ultimate access to all questions.
What is the most efficient method to handle medium-sized datasets (~100MB) in Hyperopt with SparkTrials, and why?
A
Use Databricks Runtime 7.0 ML or above for optimized handling of medium-sized datasets.
B
Broadcast the dataset explicitly using Spark and load it back onto workers using the broadcasted variable in the objective function.
C
Save the dataset to DBFS and load it back onto workers using the DBFS local file interface.
D
Load the dataset on the driver and call it directly from the objective function.