Databricks Certified Data Engineer - Professional
Get started today
Ultimate access to all questions.
Comments
Loading comments...
Ultimate access to all questions.
As a Databricks Certified Data Engineer, you are tasked with monitoring the performance and resource usage of a Databricks job in a production environment. The job processes large datasets and is critical for daily operations. You need to ensure minimal downtime and optimal resource utilization. Given this scenario, which of the following CLI command sequences would you use to effectively monitor the job's progress and resource usage? Choose the best option that provides a comprehensive solution.
A
Use the 'databricks jobs list' command to view the list of jobs and their statuses, and then use the 'databricks jobs get' command to retrieve detailed information about a specific job. This approach is suitable for initial job identification but lacks detailed run information and resource metrics.
B
Use the 'databricks jobs list-runs' command to view the list of job runs and their statuses, and then use the 'databricks jobs get-run' command to retrieve detailed information about a specific run. This method allows for tracking the progress of individual runs and accessing detailed run information, including resource usage.
C
Use the 'databricks jobs monitor' command to continuously track the progress and resource usage of a job. While this command sounds ideal, it does not exist in the Databricks CLI, making this option incorrect.
D
Use the 'databricks jobs status' command to view the current status of a job, and then use the 'databricks jobs metrics' command to retrieve resource usage information. This option is partially correct but does not provide a complete solution as the 'databricks jobs metrics' command does not exist.