Databricks Certified Data Engineer - Professional
Get started today
Ultimate access to all questions.
Ultimate access to all questions.
In a Databricks project, you are tasked with integrating multiple external APIs to fetch and process data. The project must adhere to strict security protocols and handle API rate limits efficiently to ensure uninterrupted data processing. Considering the need for security, scalability, and compliance with API usage policies, which of the following approaches is the BEST for securing API keys and access tokens, and managing API rate limits? Choose the single best option.
Explanation:
Option B is the correct choice because it leverages Databricks secrets management for secure storage of sensitive information, ensuring compliance with security best practices. The implementation of a retry mechanism with exponential backoff addresses API rate limits effectively, promoting scalability and reliability in data processing. This approach balances security, efficiency, and compliance with API policies, making it the best solution for the project's requirements.