Databricks Certified Data Engineer - Professional
Get started today
Ultimate access to all questions.
Comments
Loading comments...
Ultimate access to all questions.
How can you leverage the Databricks CLI to automate the deployment and scheduling of a nightly batch data processing job, ensuring it works smoothly with your current CI/CD pipelines?
A
Develop a script that employs the Databricks CLI to establish a new job using the databricks jobs create command, detailing the notebook path and cron schedule.
B
Set up a Jenkins pipeline that calls the Databricks CLI to send Spark jobs via the databricks runs submit command every night.
C
Use the CLI to manually execute the databricks jobs run-now command within your CI/CD pipeline at a set time each night.
D
First configure the Databricks job through the UI, then use the CLI to initiate the job with databricks jobs run-now, embedding this command into a cron job on an external server.