Answer-first summary for fast verification
Answer: Use AWS Glue crawlers to automatically detect and update partitions in the data catalog.
AWS Glue crawlers are designed to automatically detect changes in the data store, including the addition of new partitions, and update the AWS Glue Data Catalog accordingly, ensuring that the catalog remains in sync with the data lake.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
In a scenario where you need to synchronize partitions in an AWS Glue Data Catalog with a data lake stored in S3, what strategies would you employ to ensure that all partitions are correctly reflected in the catalog, especially when new data is frequently added?
A
Manually update the partitions in the AWS Glue Data Catalog each time new data is added.
B
Use AWS Glue crawlers to automatically detect and update partitions in the data catalog.
C
Write a custom script to map S3 directories to partitions in the AWS Glue Data Catalog.
D
Ignore partition synchronization as AWS Glue Data Catalog automatically handles it.
No comments yet.