Implementing Real-time streaming pipeline
Aditya Panda
Like this project
Posted Nov 13, 2023
Built Flask api to consume and handle json payloads dynamically, adding streaming functionality using Kafka streams, spark streaming and big data
Likes
0
Views
2
I built spark streaming application, consumer API endpoint and kafka setup for my pipeline. I created it for replacing one of the batch data pipeline. It helped downstream teams like analytical engineers.
Tip: Try to keep this description brief and under 150 words by highlighting the best parts of this project— recruiters don’t spend much time reading detailed descriptions! 💪