Ultimate access to all questions.
Upgrade Now 🚀
Sign in to unlock AI tutor
How can you parameterize a query to filter data based on a batch date that changes with each run, without manually altering the code each time?
A
Store the batch date in the Spark configuration and use a Spark DataFrame to filter the data based on the Spark configuration.
B
Create a notebook parameter for batch date, assign its value to a Python variable, and use a Spark DataFrame to filter the data based on this variable.
C
Manually edit the code every time to change the batch date.
D
Create a dynamic view that automatically calculates the batch date and use this view to query the data.
E
There is no way to combine a Python variable and Spark code for filtering.
