MWAA Cost Reduction

Álvaro Ferreira Pires de Paiva

0

Platform Engineer

Apache Airflow

AWS

The MWAA is what we can call the "Airflow of AWS". In its default operation, it stores numerous metrics in CloudWatch that can be very costly in the long run, I configured MWAA to generate only a few metrics relevant to the business. In addition, I modified the way it reads the configuration files of the pods in the Kubernetes that it used to run the DAGs.
All this generated a cost reduction of more than $2000 per month.
Like this project
0

Posted Jun 29, 2023

I reduced costs in MWAA by modifying its metric generation and reading of configuration files.

Likes

0

Views

40

Tags

Platform Engineer

Apache Airflow

AWS

Internal CLI for company
Internal CLI for company
Deep Reinforcement Learning library on starcraft 2
Deep Reinforcement Learning library on starcraft 2
Coronavírus RN
Coronavírus RN