FastAPI Service on AWS, Workers That Scale on Queue Size by Joe EstephanFastAPI Service on AWS, Workers That Scale on Queue Size by Joe Estephan

FastAPI Service on AWS, Workers That Scale on Queue Size

Joe Estephan

Joe Estephan

An API service on AWS that takes a burst of requests without falling over. FastAPI sits behind a load balancer, and a worker process on Fargate scales up and down on the size of an SQS queue.
Files live in S3, data in DynamoDB and Postgres, and the containers run on ECS from ECR. Each piece can be swapped without touching the rest.
Like this project

Posted Oct 20, 2026

An API on AWS that takes a burst of requests without falling over: FastAPI behind a load balancer, with Fargate workers that scale on the size of an SQS queue.