
I Built a Tool That Grades MCP Servers. Notion's Got an F.
This is a submission for the Notion MCP Challenge What I Built Here's the thing nobody tells you about MCP: the spec is beautiful. The implementations are a mess. I know this because I've been building an MCP tool schema linter for the past two weeks. It started as a simple question — how many tokens do my MCP tools actually cost? — and turned into a quality grading pipeline that has now audited 199 servers, 3,974 tools, and found thousands of issues. For this challenge, I built an MCP Quality Dashboard that connects two MCP servers together: agent-friend (my open-source tool schema linter) runs 13 correctness checks, measures token costs across 6 formats, applies 7 optimization rules, and produces a letter grade from A+ through F Notion MCP stores the results in a Notion database — one row per tool, sortable and filterable, creating a living quality record that persists across audits The workflow is simple: point the pipeline at any MCP server's tool definitions, it grades everything,
Continue reading on Dev.to
Opens in a new tab



