Build a new data discovery tool on Google Kubernetes Engine that helps with new source onboarding and data lineage tracking.

Use BigQuery to track data lineage, and use Dataprep to manage data and perform data quality validation.

Use BigLake to convert the current solution into a data lake architecture.

Use Dataplex to manage data, track data lineage, and perform data quality validation.