Data Migration from Snowflake to Microsoft Azure
Ahmad Kamiludin
0
Data Analyst
Data Engineer
Azure
Python
Snowflake
Introduction
The goal of this project is to demonstrate the process of migrating data from Snowflake to Azure Data Lake Storage Gen2 using Azure Synapse Analytics, performing data transformation using Azure Databricks, and connecting it to Power BI to create a dashboard.
Architecture
Simple Dashboard
Technology Used
Python
Snowflake
Azure Synapse Analytics
Azure Data Lake Storage Gen2
Azure Databricks
Power BI
Dataset Used
TLC Trip Record Data Yellow and green taxi trip records include fields capturing pick-up and drop-off dates/times, pick-up and drop-off locations, trip distances, itemized fares, rate types, payment types, and driver-reported passenger counts.
More info about dataset can be found here:
Article About this Project
Like this project
0
Posted Nov 28, 2024
The goal of this project is to demonstrate the process of migrating data from Snowflake to Microsoft Azure.
Likes
0
Views
2
Tags
Data Analyst
Data Engineer
Azure
Python
Snowflake
Ahmad Kamiludin
Data Engineer | Python Developer | Cloud Data Architect
Data-Driven Using Airflow, Dbt Cloud, and AWS Tech Stack
Real-Time Data Pipeline Using Apache Kafka, Flink, and MongoDB
Scalable Data Pipeline with MySQL, Google Cloud, & Looker Studio
Analytics Engineering with Airbnb Data Using dbt