Ultimate access to all questions.
Upgrade Now 🚀
Sign in to unlock AI tutor
How can you leverage the Databricks CLI to automate the deployment and scheduling of a nightly batch data processing job, ensuring it works smoothly with your current CI/CD pipelines?
A
Develop a script that employs the Databricks CLI to establish a new job using the databricks jobs create command, detailing the notebook path and cron schedule.
databricks jobs create
B
Set up a Jenkins pipeline that calls the Databricks CLI to send Spark jobs via the databricks runs submit command every night.
databricks runs submit
C
Use the CLI to manually execute the databricks jobs run-now command within your CI/CD pipeline at a set time each night.
databricks jobs run-now
D
First configure the Databricks job through the UI, then use the CLI to initiate the job with databricks jobs run-now, embedding this command into a cron job on an external server.
