This project leverages modern data engineering tools to automate the collection, processing, and visualization of football data from Europe’s top leagues.
In this project, we built a real-time data pipeline that captures YouTube comments, streams them through Apache Kafka, and then processes the data with flink.
This project builds an automated, scalable ELT pipeline using MySQL, Google Cloud Platform and dbt core.
This project showcases the seamless integration of key data engineering and analytics tools such as dbt to analyze Airbnb listings in Brisbane, Australia.
This article outlines a real-time music data streaming workflow using Apache Kafka with Avenged Sevenfold data from Spotify.
The goal of this project is to demonstrate the process of migrating data from Snowflake to Microsoft Azure.