Ultimate access to all questions.
Upgrade Now 🚀
Sign in to unlock AI tutor
A data engineer in Databricks needs to convert temperatures from Celsius to Fahrenheit for a global weather dataset. What is the most efficient method to achieve this within a Databricks notebook?
A
Export the dataset to a CSV file, convert the temperatures using an external tool, and then re-import the dataset into Databricks.
B
Directly modify the dataset in the data lake to convert all temperatures to Fahrenheit before importing it into Databricks.
C
Use a built-in Spark SQL function that automatically converts temperatures from Celsius to Fahrenheit.
D
Create a UDF in Databricks that applies the conversion formula and use it in a Spark SQL query to transform the temperature column.