Databricks Certified Data Engineer - Professional

You are tasked with designing a data pipeline that processes raw data from a bronze table to a silver table. The raw data contains duplicates and requires incremental processing. Describe the steps you would take to ensure data quality and deduplication. Include how you would enforce data quality at each stage and the specific Delta Lake features you would use.