Answer-first summary for fast verification
Answer: Review the job logs to identify the data format issue, update the data preprocessing steps in the notebook to handle the new format, and rerun the job.
Troubleshooting a data format issue involves identifying the specific problem through logs and then modifying the data processing logic to accommodate the new format. This approach ensures that the job can handle similar issues in the future.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
Given a scenario where a Databricks job has failed due to an unexpected data format issue in the input dataset. Describe the steps you would take to troubleshoot the issue, modify the job to handle the data format, and ensure the job runs successfully.
A
Review the job logs to identify the data format issue, update the data preprocessing steps in the notebook to handle the new format, and rerun the job.
B
Ignore the data format issue, increase the cluster size to handle the unexpected format, and rerun the job.
C
Manually correct the data format in the input dataset, keep the job configuration unchanged, and rerun the job.
D
Disable the data validation checks in the job, assume the data format is correct, and rerun the job.
No comments yet.