Explanation:
AWS Step Functions is a fully serverless orchestration service with native integrations for both Lambda and Glue — no servers to manage, no custom code for integrations, and built-in error handling, retries, and state management. Airflow on EC2 or EKS requires infrastructure management; a Glue workflow cannot directly invoke Lambda functions as workflow steps.
Ultimate access to all questions.
Question 35.
A data engineer must orchestrate a data pipeline that consists of one AWS Lambda function and one AWS Glue job. The solution must integrate with AWS services. Which solution will meet these requirements with the LEAST management overhead?
A
Use an AWS Step Functions workflow that includes a state machine. Configure the state machine to run the Lambda function and then the AWS Glue job.
B
Use an Apache Airflow workflow that is deployed on an Amazon EC2 instance. Define a directed acyclic graph (DAG) in which the first task is to call the Lambda function and the second task is to call the AWS Glue job.
C
Use an AWS Glue workflow to run the Lambda function and then the AWS Glue job.
D
Use an Apache Airflow workflow that is deployed on Amazon Elastic Kubernetes Service (Amazon EKS). Define a directed acyclic graph (DAG) in which the first task is to call the Lambda function and the second task is to call the AWS Glue job.
No comments yet.