Visual verification for AI agents: how to confirm web actions actually worked

Visual Verification for AI Agents: How to Confirm Web Actions Actually Worked AI agents that click buttons and fill forms have a blind spot: they can't tell if the action worked unless they check. A form submission might return a 200 but show an error message. A login might redirect to an unexpected page. A delete might require a confirmation step the agent didn't anticipate. The fix is visual verification: after each action, screenshot the current state and let the model evaluate whether the expected outcome happened. The problem with optimistic agents // This agent is optimistic — it assumes actions work const result = await agent . invoke ( " Login to https://example.com with email test@example.com password abc123 " ); // The agent says "Done" but has no way to confirm login succeeded // The actual page might show "Invalid credentials" or require 2FA Add a verification step import fetch from " node-fetch " ; const PAGEBOLT_KEY = process . env . PAGEBOLT_API_KEY ; async function scre