AI evaluation & benchmarks MCP servers

A server here evaluates, tests or benchmarks AI models or agents, or provides benchmark tasks for them.

Not here: testing ordinary software.

761servers
447 remote314 localTagged by Odel's AI, which can make mistakes

Best fit

406 made for this, ranked by starsRemoteLocal
  1. Colter @mfbahc/colterColter audits product pages for AI shopping agents and returns fixes, tests, and Evidence Packs.6% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  2. KATATAN TEST @katatan-org/katatan-testKATATAN E2E testing agent set — Playwright + KATATAN MCP integration5% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  3. Agent Card Health Check @kadopi/agent-card-health-checkFree no-storage MCP that checks A2A Agent Card connection readiness for authorized targets.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  4. Torneo @devlollc/torneoObservatory operated and funded by devlo: real tools on frozen tasks; intervals, cost, limits.4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  5. Verirun @baopeak/verirunExecution-grounded verification for AI coding agents on Windows: evidence, not agent claims.12% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  6. Conviction @abcxz/conviction-mcpThe arena where AI agents compete for real returns. Prompt a strategy.12% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  7. Ac Jobs @wchampe/ac-jobsAdmission gate for AI agents: submit a step, get admit/hold/reject vs your constitution.9% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from PyPI.
  8. Elite Reasoning @snehgabani/elite-reasoning-mcpEvidence-gated verification, selection, and measurement MCP for coding agents.8% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from PyPI.
  9. Word Is Bond @latimer-woods-tech/wordis-bondTest the voice agents you run: scored transcripts, pass/fail verdicts, latency and WER metrics.4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  10. IA-QA — 130+ QA & Dev Tools for AI Agents @jcjamet/ia-qa-toolbox130+ QA & dev tools for AI agents: prompt injection, RAG testing, VLM eval, guardrails. Free.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  11. MCP Selection Lab @changhuliu/mcp-selection-labBenchmark MCP tool selection with metadata-only routing, collision, abstention, and holdout checks.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  12. Rules MCP @akr1166/rules-mcpMCP for rules/skills/knowledge evaluation for Cursor, Claude, VS Code, and Antigravity.5% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  13. AIAgora @aiagora/agoraOpen square for AI agents: solve sandbox-tested problems, earn Ed25519-signed proofs.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  14. fixture.email — Email Testing for Agents @fixture/email-testingDisposable test mailboxes on a real domain: send, receive and assert on real email.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  15. Dungbeetle MCP @dungbeetle/mcpVisual regression & snapshot testing for AI agents — list runs, read semantic diffs, review.6% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  16. Spann Stays @spannhq/staysRead-only sample stays, booking constraints, and staged reservation actions for review.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  17. Rubrkit @rubrkit/rubrkitMCP-native AI evaluation: rubric audits, eval suites, and proof reports for AI/LLM output.4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  18. Arc Security @arcself/arc-securityScan AI agent skills for 25 attack classes + runtime monitoring. 1,316+ findings.9% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  19. IT Security — Access Change Request Recertify — Alder Court Partners (b578285f) @a2awire/benchmark-access-change-request-recertify-2026-09-15-b578285f12 synthetic access change request exception cases: duplicate payments, policy-watch list entries, m33% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  20. Employee Operations — Access Request Review — Larkspur Partners (81479355) @a2awire/benchmark-access-request-review-2026-09-10-8147935512 synthetic access request exception cases: duplicate payments, policy hold list entries, missing p22% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  21. Agent Coliseum MCP @nanocorp/agent-coliseum-mcpFree Streamable HTTP MCP arena for 1v1 AI agent skill battles and Gladiator Badges.9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  22. AFG: agents hire agents (test money) @afg/afgSandbox marketplace where AI agents hire agents for verified outcomes. Test money only.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  23. WebhookTest.net @webhooktest/webhook-testerAnonymous webhook capture, inspection, waiting, and response configuration for AI agents.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  24. WealthSchema @wealthschema/mcpCited 2026 U.S. planning figures (IRS, SSA, CMS), synthetic household samples, and an AI benchmark.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.