Mohammad Jibran

End-to-End Retail Data Pipeline

● Built a pipeline handling 5M+ records per batch with incremental loading via Delta Lake MERGE. ● Implemented Medallion Architecture (Bronze/Silver/Gold), modeling fact and dimension tables in the Gold layer for downstream reporting. ● Orchestrated end-to-end automation using ADF triggers and Databricks PySpark notebooks; built Power BI and Tableau dashboards on the Gold layer to monitor pipeline health and key metrics.