EDF

DataOps engineer · 2025–2026

Pipeline deployment from weeks to hours

Deploying a data pipeline took weeks, and business teams waited on engineers for each one.

My part

I designed and implemented the production pipelines, and built the self-service data platform on Kubernetes, with GitOps deployments and the monitoring and alerting behind it.

What the team delivered

Business teams deploy pipelines on their own

15+ production pipelines, 200GB a day

99.9% uptime

Infrastructure costs cut by 40%

Stack: Spark · Airflow · Docker · Kubernetes · Terraform · Python · AWS