Self-Host Ollama on Your Homelab: Local LLM Inference Without the Cloud Bill

I hit my OpenAI API billing dashboard last month and stared at $312.47. That's what three months of prototyping a RAG pipeline cost me — and most of those tokens were wasted on testing prompts that didn't work. Meanwhile, my homelab box sat in the closet pulling 85 watts, running Docker containers I hadn't touched in weeks. That's when I started looking at Ollama — a dead-simple way to run open-source LLMs locally. No API keys, no rate limits, no surprise invoices. Three weeks in, I've moved about 80% of my development-time inference off the cloud. Here's exactly how I set it up, what hardware actually matters, and the real performance numbers nobody talks about. Why Ollama over vLLM, LocalAI, or text-generation-webui I tried all four. Here's why I stuck with Ollama: vLLM is built for production throughput — batched inference, PagedAttention, the works. It's also a pain to configure if you just want to ask a model a question. Setup took me 45 minutes and required building from source t