Developed config-driven data pipeline frameworks using Scala & Python for efficient data ingestion, transformation, and loading into the catalog zone.

Migrated Data Pipelines from On-Prim Hadoop ecosystem to Google Cloud Platform while performing various optimizations to the Scala and Python code

Built high-performance data pipelines to bring data from RDBMS systems into data lake using Sqoop & Spark and Improved efficiency (up to 350%)