Priyadharshini Rajarathinam

Databus

Built configuration-driven mapping frameworks for automated data ingestion via Azure Data Factory across 10+ source feeds using ADLS Gen2, improving pipeline scalability and reducing manual setup effort by 40%. Designed and deployed parameterized, data-optimized transformation jobs using Medallion Architecture with Delta Lake on Azure Databricks, structuring Gold-layer aggregates for enhanced reporting and analytics performance. Implemented end-to-end data validation and monitoring mechanisms using SQL scripts, PySpark-based checks, and Azure Monitor, ensuring accuracy and consistency across pipeline stages, reducing data quality incidents by 35%.