Data Ingestion pipeline creation by Shubham SannyasiData Ingestion pipeline creation by Shubham Sannyasi

Data Ingestion pipeline creation

Shubham Sannyasi

Shubham Sannyasi

Implemented ETL/ELT pipelines in Databricks using PySpark, facilitating the data migration of 14 TB financial data to Azure Cloud data warehouse, resulting in the creation of 800+ Delta tables for a major banking client.
Like this project

Posted Oct 3, 2024

Implemented ETL/ELT ingestion pipelines in Databricks using PySpark.