Implemented ETL/ELT pipelines in Databricks using PySpark, facilitating the data migration of 14 TB financial data to Azure Cloud data warehouse, resulting in the creation of 800+ Delta tables for a major banking client.
Like this project
Posted Oct 3, 2024
Implemented ETL/ELT ingestion pipelines in Databricks using PySpark.