Databricks Certified Data Engineer - Associate

Databricks Certified Data Engineer - Associate

Get started today

Ultimate access to all questions.


In a scenario where you are working with a large dataset stored in multiple CSV files within a directory, each file named in the pattern 'data_YYYYMMDD.csv' (where YYYYMMDD represents the date), you need to write a Spark DataFrame query to efficiently extract and process this data. Considering the requirements for handling header rows and schema inference, along with the need to recursively look up all files matching the pattern, which of the following queries correctly specifies the data type as CSV and meets all the given requirements? Choose the single best option.