In a big data processing environment, you are tasked with optimizing the performance of a data pipeline that processes a large volume of data with varying data types. How would you approach this task to ensure efficient processing and resource utilization?

Simulated

Implement a single, generic data processing function that can handle all data types.

16.7%

Create separate processing functions for different data types and dynamically select the appropriate function based on the data type.

33.3%

Use a fixed schema for all data, regardless of its original structure.

16.7%

Leverage a schema-on-read approach to handle varying data types efficiently.

33.3%

Microsoft Azure Data Engineer Associate - DP-203