Explanation:
Amazon MWAA is a managed service for Apache Airflow, which is commonly used to programmatically author, schedule, and monitor workflows in Python. It has built-in operators for connecting to services like Amazon EMR, external systems via APIs (like Salesforce), and loading data to Amazon Redshift. Airflow is designed exactly for this type of orchestration in Python with retries and failure handling natively supported.
Ultimate access to all questions.
Question 51
A data engineer wants to orchestrate a set of extract, transform, and load (ETL) jobs that run on AWS. The ETL jobs contain tasks that must run Apache Spark jobs on Amazon EMR, make API calls to Salesforce, and load data into Amazon Redshift. The ETL jobs need to handle failures and retries automatically. The data engineer needs to use Python to orchestrate the jobs. Which service will meet these requirements?
A
Amazon Managed Workflows for Apache Airflow (Amazon MWAA)
B
AWS Step Functions
C
AWS Glue
D
Amazon EventBridge
No comments yet.