Implementing Real-time streaming pipeline
I built spark streaming application, consumer API endpoint and kafka setup for my pipeline. I created it for replacing one of the batch data pipeline. It helped downstream teams like analytical engineers.
Tip: Try to keep this description brief and under 150 words by highlighting the best parts of this project— recruiters don’t spend much time reading detailed descriptions! 💪
Like this project
0
Posted Nov 13, 2023
Built Flask api to consume and handle json payloads dynamically, adding streaming functionality using Kafka streams, spark streaming and big data
Likes
0
Views
2
Built data pipelines on AWS cloud
Data scrapped from 100+ APIs