Developed an alerting system for Airflow data pipeline monitoring
Improved scalability, resiliency, and performance of Airflow by renewing the deployment architecture using Kubernetes Executor
Implemented new features on existing ETL pipelines
0 likes ยท 11 views ยท May 16, 2024
This project highlights our proficiency in data pipeline management, scalable architecture, and continuous improvement in data processing systems.