AI evaluation & benchmarks MCP servers

A server here evaluates, tests or benchmarks AI models or agents, or provides benchmark tasks for them.

Not here: testing ordinary software.

752servers
439 remote313 localTagged by Odel's AI, which can make mistakes

Best fit

400 made for this, ranked by starsRemoteLocal
  1. AgentTrust @assister-xyz/agenttrustQuality verification for AI agents and MCP servers. 6-axis scoring, adversarial probes.8% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from PyPI.
  2. Audit @archonics/mcp-auditFree context-engineering audits for AI agents. BYOK Anthropic key. Top-3 findings per scan.8% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  3. Account Pool @ankitsxchdeva/account-pool-mcpExclusive, crash-safe leases on a pool of test accounts for parallel agent QA runs.4% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  4. Arcade1v1 @agustincf/arcade1v1Play 1v1 arcade games vs AI agents & humans, ranked by ELO, or Aleph: a 4–8 agent table, one pot.6% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  5. Forgejudge @ahmedeid1/forgejudgeOpen eval leaderboard + CI gate for autonomous coding agents (solve, score, trace).3% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from PyPI.
  6. Bench Agent Discovery @virajmishra1/benchDiscover public AI agents, reusable recipes, and trusted benchmark evidence by task.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  7. Mund — MCP Security Scanner @tyox-all/mundScan for prompt injection, secrets, PII, and vet MCP servers before installation15% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  8. Agentsnap @mukundakatta/agentsnapSnapshot tests for AI tool-call traces: diff, validate, and catch silent regressions.2% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  9. LanceRoylo MCP @lanceroylo/mcpAEO scoring, llms.txt audit, and agent-readiness checks for AI agents.7% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  10. Conkurrence @alligatorc0der/conkurrenceMulti-model rating for AI evaluation. Agreement is reliability, not validity. Maintenance mode.4% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  11. Workspace Tools @vandorla/workspace-toolsSandbox workspace tools: search, file read, DB queries, integrations. Returns synthetic data.50% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  12. TitanStore Commerce MCP @fish-tacos/titan-storeMCP commerce surface for compute credits, API keys, GPU instances, and cloud storage.52% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  13. XFMS — Model Source @xpansion/xfmsPick the right LLM for any task. Ranked shortlist with rationale across 8 evaluators.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  14. AgentDilemma @patrickbakowski/agentdilemmaSubmit a dilemma for blind community verdict with reasoning to improve low confidence7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  15. Horizon Fidelity Monitor @leocelis/horizon-fidelity-monitorTracks conversation health in real time — drift, desync, and causal collapse — for any AI agent.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; it needs your API key.
  16. Ai Eval @lazymac2x/ai-evalCloudflare Workers MCP server: ai-eval4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  17. Agent Trace Auditor @lazymac2x/agent-trace-auditorCloudflare Workers MCP server: agent-trace-auditor4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  18. Hvilkenai @erorund/hvilkenai-mcpDaily Scandinavian AI benchmark — Norwegian, Swedish, Danish. 12+ models tested.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  19. El Buen Agente @apasztetnik/el-buen-agente-mcpLa guía 'El Buen Agente' como 18 tools para evaluar, mejorar y construir agentes LLM. En español.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  20. Project Substitute Arena @zero-nium/project-substitute-arenaAI agents replace the CEO of Toys R Us (2006-2017). 17 decisions, 44 quarters. Free entry.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  21. Mockmcp @k-cupples/mockmcpHosted MCP endpoint with realistic fake data for prototyping agents. 12 tools, no setup.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  22. Agent Replay Debugger @csoai-org/agent-replay-debugger-mcpAgent Replay Debugger MCP — record every agent step + deterministic replay. Step-debugger for12% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  23. Foresea Forecasting @foresea/forecastingForecast future events and scan prediction-market edges.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  24. Hlido Agent Reviews @hlido/mcpIndependent AI-agent reviews: trust checks, evidence scorecards, incident registry, recommendations.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.