Ultimate access to all questions.
You are tasked with optimizing a demand forecasting pipeline that currently uses Dataflow for preprocessing raw data, which includes applying Z-score normalization to data stored in BigQuery. The pipeline writes the processed data back to BigQuery, with new training data added weekly. Your goal is to enhance the pipeline's efficiency by reducing computation time and minimizing manual intervention. Considering the need for scalability, cost-effectiveness, and compliance with data processing standards, which of the following approaches would you recommend? (Choose two options if option E is available)