Google Professional Data Engineer
Get started today
Ultimate access to all questions.
Comments
Loading comments...
Ultimate access to all questions.
You are transferring a large number of files from a public HTTPS endpoint to Cloud Storage, secured with signed URLs to prevent unauthorized access. After creating a TSV file with the object URLs and initiating a transfer job using Storage Transfer Service, the job fails after some time due to HTTP 403 errors on remaining files, despite no changes to the source system. What should you do to resolve this issue and ensure a smooth migration?
A
Set up Cloud Storage FUSE, mount the Cloud Storage bucket on a Compute Engine instance, remove completed files from the TSV file, and use a shell script to download remaining URLs to the FUSE mount point.
B
Renew the TLS certificate of the HTTPS endpoint, remove completed files from the TSV file, and rerun the Storage Transfer Service job.
C
Create a new TSV file for remaining files by generating signed URLs with a longer validity period, split the TSV file into smaller files, and submit them as separate Storage Transfer Service jobs in parallel.
D
Update the file checksums in the TSV file from MD5 to SHA256, remove completed files from the TSV file, and rerun the Storage Transfer Service job.