Explanation:
The query utilizes Autoloader (cloudFiles) to ingest raw JSON data from ordersLocation into the Bronze table named uncleanedOrders. This step is crucial in the medallion architecture for initial data ingestion. References: Medallion Architecture, Autoloader Documentation.
Ultimate access to all questions.
In the context of a multi-hop architecture, what is the primary function of the following Structured Streaming query?
.format("cloudFiles")
.option("cloudFiles.format", "json")
.load(ordersLocation)
.writeStream
.option("checkpointLocation", checkpointPath)
.table("uncleanedOrders")```
.format("cloudFiles")
.option("cloudFiles.format", "json")
.load(ordersLocation)
.writeStream
.option("checkpointLocation", checkpointPath)
.table("uncleanedOrders")```
A
Executing a data transfer from a Gold table into a production application
B
Conducting data quality checks before the Silver layer
C
Facilitating raw data ingestion into a Bronze table
D
Moving data from a Bronze table to a Silver table
E
Transitioning data from a Silver table to a Gold table
No comments yet.