Ultimate access to all questions.
A team of data engineers is collaborating on notebooks attached to a shared cluster. The admin initially set the Spark config property spark.sql.autoBroadcastJoinThreshold
to 100b
during cluster creation. Later, a data engineer in the show_orders
notebook changes this property to 1024b
using spark.conf.set
. Subsequently, another data engineer in the fetch_results
notebook runs %run ./show_orders
followed by retrieving the property's value. What will be the output of this retrieval?