Data Migration from Snowflake to Microsoft Azure
Ahmad Kamiludin
Data Analyst
Data Engineer
Azure
Python
Snowflake
Introduction
The goal of this project is to demonstrate the process of migrating data from Snowflake to Azure Data Lake Storage Gen2 using Azure Synapse Analytics, performing data transformation using Azure Databricks, and connecting it to Power BI to create a dashboard.
Architecture
Simple Dashboard
Technology Used
Python
Snowflake
Azure Synapse Analytics
Azure Data Lake Storage Gen2
Azure Databricks
Power BI
Dataset Used
TLC Trip Record Data Yellow and green taxi trip records include fields capturing pick-up and drop-off dates/times, pick-up and drop-off locations, trip distances, itemized fares, rate types, payment types, and driver-reported passenger counts.
More info about dataset can be found here:
