DevOps & MLOps engineer who designs what he ships.
Delete a pod. Edit the cluster by hand. Penwave puts both back š
On EKS, the ReplicaSet saw 1 of 2 pods and made a replacement, which joined once its readiness probe on /ready passed. ArgoCD's self-heal re-applied the kubernetes branch, so the hand edit was gone.
The clip is a simulation of both, with the real ReplicaSet name. The EKS version of Penwave was built on EKS Auto Mode with ArgoCD and Helm, and has since been spun down.
What's the first thing you try to break on a new cluster? š
š aswin-shine.dev/work/penwave (http://aswin-shine.dev/work/penwave)
2
0
71
1,866 contributions on my GitHub graph š©, green all year, until 3 AM today, when the whole thing turned orange š§
When you run production systems, green turning orange is how a bad night starts š¬ So I checked the monitoring š, then went through the logs š, looking for whatever had failed.
Nothing had. Under the graph, GitHub had written "Happy Halloween!" š
Happy Halloween, everyone š» What's your best 3 AM false alarm? š
š github.com/Aswin-Shine
#Halloween #DevOps #GitHub #MotionDesign
1
0
156
