A data engineer in Databricks needs to convert temperatures from Celsius to Fahrenheit for a global weather dataset. What is the most efficient method to achieve this within a Databricks notebook?

Real Exam

Export the dataset to a CSV file, convert the temperatures using an external tool, and then re-import the dataset into Databricks.

0.7%

Directly modify the dataset in the data lake to convert all temperatures to Fahrenheit before importing it into Databricks.

2.7%

Use a built-in Spark SQL function that automatically converts temperatures from Celsius to Fahrenheit.

19.2%

Create a UDF in Databricks that applies the conversion formula and use it in a Spark SQL query to transform the temperature column.

77.4%

Databricks Certified Data Engineer - Associate