Ultimate access to all questions.
You are managing a demand forecasting pipeline in production. This pipeline leverages Dataflow to preprocess raw data before model training and prediction. The preprocessing step involves applying Z-score normalization to data stored in BigQuery, and the normalized data is then written back to BigQuery. New training data is added to the pipeline on a weekly basis. To enhance the efficiency of this process and reduce both computation time and manual intervention, what should you do?