Ultimate access to all questions.
Your company has a large dataset of customer transaction records stored in a relational database. You need to transform this data to analyze customer behavior patterns. Describe how you would use Apache Spark to process the data, including the steps involved in creating a resilient and scalable ETL pipeline.