A data engineer is examining the `distinct()` and `dropDuplicates()` methods in Spark for de-duplicating a DataFrame. Which statement accurately describes the use of these methods for de-duplication?

Real Exam

The distinct() method can be used to remove duplicates based on specific columns by passing column names as arguments.

8.5%

In Databricks, the distinct() method is deprecated, leaving dropDuplicates() as the only supported method for de-duplication.

10.4%

The methods dropDuplicates() and drop_duplicates() are interchangeable, as per the official Spark documentation._

45.1%

Both distinct() and dropDuplicates() methods allow for the removal of duplicates based on specific columns.

21.3%

The dropDuplicates() method is restricted to RDDs, while the distinct() method is exclusively for DataFrames.

14.6%

Databricks Certified Data Engineer - Professional