In a Databricks notebook, a data engineer is tasked with normalizing text data by converting all strings to lowercase and removing spaces. What is the most efficient method to achieve this within Databricks?

Real Exam

Manually edit each string in the dataset before loading it into Databricks.

1.4%

Export the dataset, process it with a script outside of Databricks, and then re-import the cleaned data.

1.4%

Utilize a Databricks built-in function for string normalization in a Spark SQL query.

37.8%

Implement a UDF in Databricks that lowercases and trims spaces from strings, applying it via a Spark SQL query.

59.5%

Databricks Certified Data Engineer - Associate