Ultimate access to all questions.
Answer-first summary for fast verification
Answer: Use an AWS Glue crawler to scan the S3 bucket and update the data catalog with the latest partitions.
The most efficient way to synchronize partitions in an AWS Glue Data Catalog with the latest data in an S3 bucket is to use an AWS Glue crawler. By configuring the crawler to scan the S3 bucket, it can automatically discover and update the data catalog with the latest partitions. Manually updating the data catalog or creating a new AWS Glue job would be time-consuming and error-prone. Configuring S3 bucket notifications is not a direct method for updating the data catalog.
Author: LeetQuiz Editorial Team
You have been asked to synchronize partitions in an AWS Glue Data Catalog with the latest data in an S3 bucket. The data in the S3 bucket is partitioned by date. What is the most efficient way to update the data catalog with the latest partitions?
A
Manually update the data catalog by adding each new partition individually.
B
Use an AWS Glue crawler to scan the S3 bucket and update the data catalog with the latest partitions.
C
Create an AWS Glue job that reads the data from the S3 bucket and writes the updated partitions back to the data catalog.
D
Configure the S3 bucket to automatically notify AWS Glue when new partitions are added, and use AWS Glue to update the data catalog.
No comments yet.