
Ultimate access to all questions.
In your role as a Databricks Certified Data Engineer - Professional, you are tasked with deploying and monitoring a Databricks job using the CLI. The job is critical for processing nightly data loads and must be monitored closely to ensure timely completion. Given the constraints of cost efficiency and the need for real-time monitoring, which of the following sequences of commands would you use to first deploy the job and then monitor its progress effectively? Choose the best option that aligns with Databricks CLI best practices.
A
Use the 'databricks jobs run-now' command to deploy the job, and then use the 'databricks jobs list-runs' command to monitor its progress. This approach is straightforward but lacks the initial job creation step.
B
Use the 'databricks jobs submit' command to deploy the job, and then use the 'databricks jobs get-run' command to monitor its progress. This option skips the job creation and directly submits the job, which may not be suitable for all scenarios.
C
Use the 'databricks jobs create' command to create the job, and then use the 'databricks jobs run-now' command to deploy it. Monitor its progress using the 'databricks jobs list-runs' command. This option provides a complete solution from job creation to deployment and monitoring.
D
Use the 'databricks jobs deploy' command to deploy the job, and then use the 'databricks jobs monitor' command to track its progress. This option uses non-existent commands, making it incorrect.