AI evaluation & benchmarks MCP servers

A server here evaluates, tests or benchmarks AI models or agents, or provides benchmark tasks for them.

Not here: testing ordinary software.

752servers
439 remote313 localTagged by Odel's AI, which can make mistakes

Best fit

400 made for this, ranked by starsRemoteLocal
  1. Eval Runner @dbsectrainer/mcp-eval-runnerA standardized testing harness for MCP servers and agent workflows4% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  2. Engine @cicicalex/engineAIN bias & stability engine: finance, gaming, AI, crypto. 68 tools across 11 categories.8% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  3. Modelwatch @bch1212/modelwatchContinuous behavioral drift monitoring for LLM apps — catches silent provider model updates.6% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  4. AgentTrust @assister-xyz/agenttrustQuality verification for AI agents and MCP servers. 6-axis scoring, adversarial probes.8% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from PyPI.
  5. Audit @archonics/mcp-auditFree context-engineering audits for AI agents. BYOK Anthropic key. Top-3 findings per scan.8% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  6. Account Pool @ankitsxchdeva/account-pool-mcpExclusive, crash-safe leases on a pool of test accounts for parallel agent QA runs.4% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  7. Arcade1v1 @agustincf/arcade1v1Play 1v1 arcade games vs AI agents & humans, ranked by ELO, or Aleph: a 4–8 agent table, one pot.6% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  8. Forgejudge @ahmedeid1/forgejudgeOpen eval leaderboard + CI gate for autonomous coding agents (solve, score, trace).3% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from PyPI.
  9. Mund — MCP Security Scanner @tyox-all/mundScan for prompt injection, secrets, PII, and vet MCP servers before installation15% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  10. Agentsnap @mukundakatta/agentsnapSnapshot tests for AI tool-call traces: diff, validate, and catch silent regressions.2% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  11. LanceRoylo MCP @lanceroylo/mcpAEO scoring, llms.txt audit, and agent-readiness checks for AI agents.7% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  12. Bias Detection @csoai-org/bias-detection-mcpAI bias detection and fairness assessment for AI agents. Instant bias risk scan, demographic ana...9% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from PyPI.
  13. Conkurrence @alligatorc0der/conkurrenceMulti-model rating for AI evaluation. Agreement is reliability, not validity. Maintenance mode.4% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  14. Rebilder Agent Readability @rebilder/mcp-serverCheck how well AI agents can read a web page: a score, the evidence and a ranked fix list.6% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  15. Wjttc @faf/wjttcF1-grade MCP certification. 52 tests, 9 tiers (49 scored + T9 Receipt validation). Ecosystem: #27599% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  16. Agent Release Auditor @veyndrasystems/agent-release-auditorDeterministic release gate for AI-written code and coding agents.5% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  17. Splera @sohaibt/spleraA/B testing for vibe coders: create, track, and ship experiments from your AI coding agent.5% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  18. Testorim @sallar-ba/testorimAI browser tests from your coding agent: a verdict, failing steps, report, video and trace.5% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  19. Mifactory Logic Verifier @mifactory-bot/mifactory-logic-verifierVerify AI agent reasoning and logic for errors and contradictions. Pay-per-use.6% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  20. Colter @mfbahc/colterColter audits product pages for AI shopping agents and returns fixes, tests, and Evidence Packs.6% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  21. KATATAN TEST @katatan-org/katatan-testKATATAN E2E testing agent set — Playwright + KATATAN MCP integration5% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  22. Verirun @baopeak/verirunExecution-grounded verification for AI coding agents on Windows: evidence, not agent claims.12% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  23. Conviction @abcxz/conviction-mcpThe arena where AI agents compete for real returns. Prompt a strategy.12% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  24. Ac Jobs @wchampe/ac-jobsAdmission gate for AI agents: submit a step, get admit/hold/reject vs your constitution.9% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from PyPI.