✕ Clear all filters
12 articles

📰 Dev.to · Pavan Madduri

12 articles · Updated every 3 hours · View all reads

All Articles 84,451Blog Posts 106,828Tech Tutorials 20,756Research Papers 17,853News 14,077 ⚡ AI Lessons
Stop Downloading 8GB Models on Every Pod Restart - Use OCI Object Storage as a Model Cache
Dev.to · Pavan Madduri 2d ago
Stop Downloading 8GB Models on Every Pod Restart - Use OCI Object Storage as a Model Cache
The first time I deployed vLLM on OKE, the pod took 12 minutes to become ready. The model download...
Read article → + Playlist
Docker Model Runner Replaced My Entire Local AI Setup
Dev.to · Pavan Madduri 1mo ago
Docker Model Runner Replaced My Entire Local AI Setup
I used to have a ridiculous local AI setup. Ollama running as a service. A separate Python venv for...
Read article → + Playlist
Every GPU Container Bug I've Hit on OKE (and How I Fixed Them)
Dev.to · Pavan Madduri 1mo ago
Every GPU Container Bug I've Hit on OKE (and How I Fixed Them)
Running GPU containers on Kubernetes is one of those things that works perfectly in tutorials and...
Read article → + Playlist
From Docker Compose on My Laptop to OKE in Production — Same App, Zero Rewrites
Dev.to · Pavan Madduri 1mo ago
From Docker Compose on My Laptop to OKE in Production — Same App, Zero Rewrites
I have a rule: if I can't run the full stack on my laptop with docker compose up, the architecture is...
Read article → + Playlist
I Cut My Container Image Costs 60% by Building Multi-Arch Docker Images on OCI ARM
Dev.to · Pavan Madduri 1mo ago
I Cut My Container Image Costs 60% by Building Multi-Arch Docker Images on OCI ARM
I was running all my containers on AMD64 shapes because that's what I'd always done. x86, Intel/AMD,...
Read article → + Playlist
The Zero-Trust Docker Pipeline: Securing GPU/AI Container Images from Build to Production
Dev.to · Pavan Madduri 1mo ago
The Zero-Trust Docker Pipeline: Securing GPU/AI Container Images from Build to Production
GPU container images are the softest target in your infrastructure. A typical vLLM image is 15GB with...
Read article → + Playlist
GPU-Aware Autoscaling for Docker Containers: From NVML to Production
Dev.to · Pavan Madduri 1mo ago
GPU-Aware Autoscaling for Docker Containers: From NVML to Production
Every GPU inference container has the same problem: Kubernetes HPA can't see the GPU. You scale on...
Read article → + Playlist
I Replaced a $3/hr GPU Dev Workflow with Docker Model Runner. Here's How
Dev.to · Pavan Madduri 1mo ago
I Replaced a $3/hr GPU Dev Workflow with Docker Model Runner. Here's How
Last month I was debugging a prompt template for a vLLM inference service. The change was two lines —...
Read article → + Playlist
Docker + OKE: Running GPU Inference Containers on Oracle Cloud
Dev.to · Pavan Madduri 1mo ago
Docker + OKE: Running GPU Inference Containers on Oracle Cloud
I wanted to deploy an LLM inference API without spending $1,200/month on AWS GPU instances. OCI...
Read article → + Playlist
Running Docker Containers on OCI Without Kubernetes
Dev.to · Pavan Madduri 1mo ago
Running Docker Containers on OCI Without Kubernetes
I needed to run a container in the cloud. Not a microservices platform. Not a service mesh. Just one...
Read article → + Playlist
Deploying a Production-Ready K3s Cluster on OCI Always Free ARM Instances
Dev.to · Pavan Madduri 3mo ago
Deploying a Production-Ready K3s Cluster on OCI Always Free ARM Instances
Deploying a Production-Ready K3s Cluster on OCI Always Free ARM Instances How I turned...
Read article → + Playlist
Why Your Kubernetes Cluster Breaks 18 Minutes After a Successful Deployment
Dev.to · Pavan Madduri 3mo ago
Why Your Kubernetes Cluster Breaks 18 Minutes After a Successful Deployment
You merge the Pull Request. The CI/CD pipeline flashes green. ArgoCD reports that your application is...
Read article → + Playlist