AWS Data Engineering project -Airflow-S3-EC2-AWS EMR-Glue-Athena

Dorian Teffo

0

Data Analyst

Data Engineer

Software Engineer

Apache Airflow

Python

SQL

Like this project
0

Posted Dec 23, 2023

Utilize Airflow on EC2 to schedule a data pipeline for ingesting data from S3, cleaning it with Spark on EMR, saving the processed data back to S3.

Likes

0

Views

5

Tags

Data Analyst

Data Engineer

Software Engineer

Apache Airflow

Python

SQL

Analytics-SQL-PowerBI
Analytics-SQL-PowerBI
ETL-pipeline-Docker-Python-Postgres-Metabase
ETL-pipeline-Docker-Python-Postgres-Metabase
AWS Cloud Data Engineering project-AWS S3-Athena-Glue-Spark
AWS Cloud Data Engineering project-AWS S3-Athena-Glue-Spark