How I built a real-time emotional spending intervention agent with Gemini Live

I built this project for the Gemini Live Agent Challenge 2026. The idea started from a simple observation: I and most of my friends regularly buy things we immediately regret. Not because we don't know our financial situation — but because the bad decision happens at 11 PM when we're stressed, and no tool is watching at that exact moment. So I built one. Sentience Finance is a Chrome extension that detects checkout pages automatically, reads your emotional state through your camera, and opens a Gemini Live voice conversation with your own spending history loaded in — before you click buy. The core architecture The extension ( content.js ) watches for financial page patterns — checkout URLs, payment selectors, keywords like "bKash" and "Cash on Delivery" for platforms like Daraz. When it fires, it injects a HUD token and sends the page context to the sidepanel. The sidepanel opens a WebSocket to a FastAPI backend, which connects to Gemini Live using the gemini-2.5-flash-native-audio-pre