
A technical guide I wrote on running GPU inference on Amazon EKS with Kubernetes 1.37.
What it covers
Requesting GPUs with DRA ResourceClaims and Karpenter
MIG versus time-slicing for sharing GPUs
Inference-aware routing with the Gateway API Inference Extension
HPA scale-to-zero and cold starts
Device taints, failure modes and a rollout checklist
Read it here: arjunkanojia.com/blog/llm-inference-eks-kubernetes-1-37
More posts on running AWS and Kubernetes platforms in production: arjunkanojia.com/blog
1 like · 0 views · Nov 14, 2026
Technical guide on GPU inference on EKS: DRA with Karpenter, MIG vs time-slicing, inference-aware routing, scale-to-zero and a rollout checklist.