Databricks Certified Data Engineer - Professional
Get started today
Ultimate access to all questions.
Ultimate access to all questions.
In a scenario where you need to design a system that controls for cost and latency SLAs for production streaming jobs, how would you approach the design to ensure that both cost and latency are optimized? Discuss the strategies you would employ to balance these two critical factors.
Explanation:
A hybrid approach allows for dynamic resource allocation based on current load and latency requirements, ensuring that resources are not over-provisioned (which would increase costs) and that latency remains within acceptable limits. This approach requires careful monitoring and adjustment based on real-time data.