I Built a RAG System for Our Analytics Team. It Worked Great Until We Added Real Data.

RAG was supposed to help analysts and stakeholders get answers about our data. But the system was wrong in ways that would have cost us money if anyone had acted on it. Institutional knowledge was scattered across Confluence pages that hadn't been updated in two years, Slack threads that disappeared after 90 days, and data dictionaries that were always incomplete.