Introducing Agent Duelist: Benchmark LLM Providers Like a Pro

TL;DR: Agent Duelist is a TypeScript-first framework that pits multiple LLM providers against each other on the same tasks. Get structured, reproducible results for correctness, latency, tokens, and cost—all from one unified interface. The Problem You're building with LLMs and you need to answer questions like: Should I use GPT-5.2 or Claude Opus 4.6 for this task? Is Azure OpenAI faster than standard OpenAI for my use case? How much will switching models actually cost me? Which provider handles tool calls best? Right now, answering these questions means: Writing separate integration code for each provider Manually tracking metrics across runs Copying results into spreadsheets Making educated guesses about cost There has to be a better way. Enter Agent Duelist Agent Duelist is a benchmarking framework that lets you: ✅ Define tasks once, run them everywhere — OpenAI, Azure, Anthropic, Google Gemini, and any OpenAI-compatible gateway ✅ Get real metrics — Latency, token counts, and cost e