Every AI Benchmark Tests Coding. We Built One That Tests Infrastructure Work.

Every AI coding tool benchmark tests the same things. Autocomplete accuracy. Code generation. Refactoring. Test generation. Maybe a LeetCode problem for good measure. Not a single one tests the work infrastructure engineers actually do. I spend my days writing Terraform modules, debugging Kubernetes incidents, migrating CI/CD pipelines, and reviewing Helm charts for security issues. When I evaluated AI coding agents for my team, every vendor benchmark told me how well their tool could write a React component. None of them told me whether it could generate a production EKS module with networking, IAM, and logging that actually plans without errors. So we built the benchmark that should have existed. 20 tasks across 5 categories We designed 20 infrastructure tasks grouped into the five categories that eat most of a platform engineer's time: 1. Terraform module generation -- Generate complete, standards-compliant modules from organizational patterns. The test: does the output run terrafor