Worked with Enterprise Data Pipeline
serhan sari
Automation Engineer
Backend Engineer
Data Engineer
AWS Lambda
Python
Snowflake
Progressive Insurance
● Worked in AWS environment (S3 / EC2 / ECS / Lambda / RDS)
● Used PySpark to process batch data pipelines
● Wrote unittest and integration test with pytest and moto
● Fetched all the snowflake-config- repos in GitHub into a base repo with gitmodules and Automate the CICD pipeline with Jenkins API, Git, and Python
● Worked with Snowflake to clear old entitlements from snowflake via python and pandas
