Explanation:
The error in the code block is due to the incorrect use of the source parameter in the load() method, which is not a valid parameter. The correct approach to read a parquet file in Apache Spark is to either use the format() method followed by load() or directly use the parquet() method. The load() method itself does not accept a source parameter. Therefore, the source parameter should be removed, and the correct method to read a parquet file should be employed. Options A and B suggest incorrect alternatives, while option C is irrelevant to the error in question. Option D is incorrect because the filePath does not necessarily need to be quoted unless it's a string literal. Option E correctly identifies that the source parameter should be removed.
Ultimate access to all questions.
No comments yet.
The code block shown below contains an error. The code block intended to read a parquet at the file path filePath into a DataFrame. Identify the error.
spark.read.load(filePath, source – "parquet")
spark.read.load(filePath, source – "parquet")
A
There is no source parameter to the load() operation – the schema parameter should be used instead.
B
There is no load() operation – it should be parquet() instead.
C
The spark.read operation should be followed by parentheses to return a DataFrameReader object.
D
The filePath argument to the load() operation should be quoted.
E
There is no source parameter to the load() operation – it can be removed.