After migrating a complex analytical Spark job with shuffling operations from an on-prem Hadoop cluster to Dataproc on GCS, how can you optimize its performance given the initial data is in parquet format (average size 200-400 MB each) and your organization is cost-sensitive? The job currently runs on preemptible VMs with only two non-preemptible workers. | Google Professional Data Engineer Quiz