#DevOps(12)

August 2026
#Kubernetes #DevOps #FastAPI #Autoscaling #LLM

Autoscaling a FastAPI Service with the Kubernetes HPA

The Kubernetes HPA scales pods from a metric, but its defaults thrash and lag under real load. How the control loop works, how to tune it, and where it breaks.

Read more →
August 2026
#Kubernetes #GPU #DevOps #MLOps #LLM

Scheduling GPU Pods on Kubernetes

A GPU node won't run your Pods until a device plugin advertises it. How Kubernetes discovers GPUs, how to share one across Pods, and where scheduling breaks.

Read more →
August 2026
#Kubernetes #DevOps #Jobs #CronJobs #Batch

Kubernetes Jobs and CronJobs for Batch Work

Run finite and scheduled work on Kubernetes with Jobs and CronJobs: completions, parallelism, backoffLimit, cleanup, and the failure modes that bite.

Read more →
July 2026
#FastAPI #Kubernetes #Python #DevOps #LLM

Graceful Shutdown for FastAPI on Kubernetes

A rolling deploy sends SIGTERM and kills your FastAPI pod mid-request, dropping live SSE streams. How to catch it, drain connections, and shut down cleanly.

Read more →
July 2026
#Kubernetes #KEDA #Autoscaling #DevOps #HPA

Scale Kubernetes Workers on Queue Depth with KEDA

A CPU-based HPA can't see a backed-up queue, so workers fall behind. How KEDA autoscales Kubernetes workers on queue depth, and where it breaks.

Read more →
July 2026
#Kubernetes #ArgoCD #GitOps #DevOps #Observability

ArgoCD Sync Waves: Ordering a Kubernetes Rollout

ArgoCD applies your whole app at once, so a migration races the pods that need it. How sync waves and hooks order a Kubernetes rollout, and where they stall.

Read more →