Data Engineering Pipeline Development
Rohith Reddy
Expert at data modeling and architecting end-to-end data pipelines, optimal data lakes and warehouses.
Some of the tools I have worked with include:
Airflow
Spark
Kafka / Kinesis / PubSub
Redshift
Druid
MongoDB
Prefect
Streamsets
DynamoDB
Like this project
Posted Apr 17, 2023
Built an end-to-end data engineering pipeline using Apache Airflow, AWS S3, and Redshift that extracted data from various sources including APIs and databases. Transformed the data into a usable format before loading it into Redshift for analysis.
Likes
0
Views
10
