Built Flask api to consume and handle json payloads dynamically, adding streaming functionality using Kafka streams, spark streaming and big data

Built scala spark framework to enable full and incremental data load to redshift. Enabled near real time pipelines using lambda functions.

Developed application to seamlessly scrap data from multiple api's and apply transformations on top of it.