Answer-first summary for fast verification
Answer: Amazon Managed Workflows for Apache Airflow (Amazon MWAA)
Amazon MWAA is a managed orchestration service for Apache Airflow. Airflow workflows are authored in Python as Directed Acyclic Graphs (DAGs). It natively handles retries, dependency management, and failures, and has providers/operators available for EMR, Redshift, and integrating with external APIs like Salesforce.
Author: Ritesh Yadav
Ultimate access to all questions.
A data engineer wants to orchestrate a set of extract, transform, and load (ETL) jobs that run on AWS. The ETL jobs contain tasks that must run Apache Spark jobs on Amazon EMR, make API calls to Salesforce, and load data into Amazon Redshift. The ETL jobs need to handle failures and retries automatically. The data engineer needs to use Python to orchestrate the jobs. Which service will meet these requirements?
A
Amazon Managed Workflows for Apache Airflow (Amazon MWAA)
B
AWS Step Functions
C
AWS Glue
D
Amazon EventBridge
No comments yet.