You are working on a data transformation project using Apache Spark in Azure Databricks. The project involves joining two large datasets, 'Sales' and 'Products', on the 'ProductID' field and then performing a series of transformations, including filtering, aggregation, and sorting. Which Spark API would you use to achieve this, and how would you optimize the performance of the transformations? | Microsoft Azure Data Engineer Associate - DP-203 Quiz