AI evaluation & benchmarks MCP servers

A server here evaluates, tests or benchmarks AI models or agents, or provides benchmark tasks for them.

Not here: testing ordinary software.

752servers
439 remote313 localTagged by Odel's AI, which can make mistakes

Best fit

400 made for this, ranked by starsRemoteLocal
  1. Ergonia Works @ergonia/ergoniaVerifiable work for AI agents: every task carries a condition a stranger can execute.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  2. FlightSweeper @flightsweeper-webmcp/publicAnonymous public tools for FlightSweeper. See the published agent boundary before use.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  3. Liars Town Arena @liars/arenaPlay Werewolf against other AI agents. join once, then loop observe/act. Public ELO leaderboard.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  4. OAIA Arena @oaia/arenaScore AI trading agents against 2,048 coin-flipping monkeys. Public leaderboard.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  5. Agent Reliability @agentreliability/agent-reliabilityTesting, benchmarking and auditing autonomous AI agents — methods, harnesses, evidence3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  6. Agent Observatory @model-mischief-managed/agent-observatoryLive census of AI agents: prove you can reason (reverse CAPTCHA), check in, talk to other agents.14% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  7. AIO — AI Integrity Organization @aioq/aioAI integrity standards, benchmarks, and EU AI Act-aligned Tier 0 model certification4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  8. Twothumbs @asselwan/twothumbsVerifies AI agent work end to end: real artifacts and outcomes checked, not self-reported success.9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  9. Naturepedia Canonical Discovery @robbiegeorgephotography/naturepediaSearch and resolve Naturepedia, Robbie's Razor, and GC-MRD-v2.0 canonical resources.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  10. cloro @cloro/cloroScrape AI answer engines and Google Search/News with country and state-level geo-targeting.9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  11. LatAm Fintech Synthetic Data @jmendozapuche/latam-fintech-synthetic-dataPrivacy-safe synthetic financial data for LatAm fintech, AI agents, testing and ML.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; it needs your API key.
  12. AgentReady @agentready-market/auditAgentReady.market audit: can an AI shopping agent find, understand and BUY on this store? /100.4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  13. Before Users Do @bhuman-ai/beforeusersdoBrowser-backed QA with evidence and fix-ready reports for coding agents.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  14. Kit Memory Demo @peteratpondo/kit-memory-demoContinuity for agents: a live memory you can read and cite right now, outliving the context window.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  15. Mingxin @mingxinstorage/mingxin-mcp-serverMeasured AI-inference-storage benchmarks with citations, article search, KV-cache ROI estimation.9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  16. Whetstone @cyberelf/toolsVerifier-grounded AI promotion gates, disposable report cards, and signed PASS/HOLD/BLOCK receipts.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  17. Optionality @lonniev/optionality-mcpOptionality — AI-judged options trading drill, Tollbooth-monetized MCP server9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  18. Scorecard MCP @scorecard/mcpMCP server providing access to the Scorecard API to evaluate and optimize LLM systems.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  19. Hive A/B Test @srotzin/hive-mcp-abtestA/B experiment runner for the A2A network with x402 micropayments on Base USDC.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  20. Hive Evaluator @srotzin/hive-mcp-evaluatorMCP server: NEED + YIELD + CLEAN-MONEY gates with EIP-3009 attestations · Hive Civilization9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  21. operant-mcp @saagpatel/operant-mcpRead-only MCP server for the OPERANT AI operating-agent calibration benchmark.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  22. Bench Agent Discovery @virajmishra1/benchDiscover public AI agents, reusable recipes, and trusted benchmark evidence by task.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  23. Workspace Tools @vandorla/workspace-toolsSandbox workspace tools: search, file read, DB queries, integrations. Returns synthetic data.50% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  24. TitanStore Commerce MCP @fish-tacos/titan-storeMCP commerce surface for compute credits, API keys, GPU instances, and cloud storage.52% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.