In the context of optimizing a data pipeline that utilizes Delta Lake for incremental data processing, consider a scenario where the storage costs are escalating due to the accumulation of deleted files that are no longer needed for the pipeline's operations. The team is looking for a solution that not only addresses the immediate cost concern but also ensures the long-term maintainability and performance of the table. Given these requirements, what is the primary purpose of the `VACUUM` command in Delta Lake, and how does it contribute to the table's maintenance? Choose the best option from the following: | Databricks Certified Data Engineer - Associate Quiz