Developing Reliable Data Pipelines
Jineshwar Khatri
Data Engineer - June 2020 to till date - GrowExx
Developed hundreds of pipelines using Python and Airflow which fetches data from multiple data sources like PostgreSQL , MySQL as well as fetches data from APIs and stores it into AWS S3 buckets. Further the transformation is done and finally data is loaded into Snowflake for further analysis.
Like this project
Posted Jan 3, 2024
Developed pipelines using Python and Airflow which fetches data from various dat sources and APIs and stores it in AWS and then finally load into Snowflake
Likes
0
Views
26
