Answer-first summary for fast verification
Answer: Job bookmarks
AWS Glue job bookmarks help AWS Glue maintain state information and prevent the reprocessing of old data. With job bookmarks, you can process new data incrementally when rerunning an ETL job, making it the appropriate feature for incremental data processing.
Author: Ritesh Yadav
Ultimate access to all questions.
Question 3
A data engineer is building an automated extract, transform, and load (ETL) ingestion pipeline by using AWS Glue. The pipeline ingests compressed files that are in an Amazon S3 bucket. The ingestion pipeline must support incremental data processing. Which AWS Glue feature should the data engineer use to meet this requirement?
A
Workflows
B
Triggers
C
Job bookmarks
D
Classifiers
No comments yet.