ETL Pipeline Using Airflow and Reddit API
Aditya Goel
Backend Engineer
Cloud Security Engineer
Data Engineer
AWS
Python
Developed a custom ETL pipeline using Airflow and Reddit API to transform raw data and perform analysis.
Configured AWS EC2 instance to Airflow, and created a DAG with a task to schedule the ETL script to run.
Extracted data from Reddit API, transformed it, and loaded it into an AWS S3 bucket.
