Data Ingestion pipeline creation
Shubham Sannyasi
Data Modelling Analyst
Data Engineer
Apache Spark
Databricks
SQL
Implemented ETL/ELT pipelines in Databricks using PySpark, facilitating the data migration of 14 TB financial data to Azure Cloud data warehouse, resulting in the creation of 800+ Delta tables for a major banking client.
