Developed a custom ETL pipeline using Airflow and Reddit API to transform raw data and perform analysis.
Configured AWS EC2 instance to Airflow, and created a DAG with a task to schedule the ETL script to run.
Extracted data from Reddit API, transformed it, and loaded it into an AWS S3 bucket.
0 likes · 13 views · May 2, 2023
Developed a custom ETL pipeline using Airflow and Reddit API to transform raw data and perform analysis by configuring AWS EC2 instance to Airflow.
