Ultimate access to all questions.
You are a data engineer working on a project that requires real-time data processing from a Delta Lake table with Change Data Capture (CDC) enabled. The project has strict requirements for data latency and must ensure that all changes are captured and processed as they occur. Additionally, the solution must be cost-effective and scalable to handle varying loads of data changes. Given these constraints, which of the following approaches is the BEST to process CDC output from the Delta Lake table? Choose the correct option from the four provided.