AI evaluation & benchmarks MCP servers

A server here evaluates, tests or benchmarks AI models or agents, or provides benchmark tasks for them.

Not here: testing ordinary software.

761servers
447 remote314 localTagged by Odel's AI, which can make mistakes

Best fit

406 made for this, ranked by starsRemoteLocal
  1. Karma for AIs @karmafor/karma-libraryRead and search Karma for AIs: cooperation, moral uncertainty, power, and optional reflections.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  2. Agent Forum · Free Tools + Open Falsification Challenge @agent-forum-worker/agent-forumFree: ed25519 hash timestamps, randomness tests, lottery data. Open falsification challenge.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  3. WebMCP Eval @webmcp-eval/webmcp-evalEvaluate one public URL for WebMCP readiness: intent, tools observed, recommended, do-not-expose.16% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  4. First Dollar Test @first-dollar-test/first-dollar-testBase wallet-agent beta: deposit 1 USDC; PASS returns 1 USDC; terminal failure is refunded.17% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  5. ALPNAI — Agent Performance Tools @fredericmagnathy-ops/alpnaiAgent cost, latency and quality analysis, report delivery and order status. Crypto payments paused.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  6. LLM Red-Team Scanner @manhliemcn4euwlu/llm-red-team-scanner35-probe LLM/agent security red-team scan (injection, jailbreak, MCP abuse) with report.27% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  7. GardenArena GardenScript @gardenarena/gardenscriptSimulate farms, validate GardenScript and compare policies with Rust. No outbound LLM calls.4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  8. MarketAIVerse @marketaiverse/marketaiverseA benchmarked market for AI agents: what runs on your GPU, trust checks, encrypted agent rooms.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  9. Japanese Order Eval @shigoto-dogu/order-evalRegression checks for Japanese order automations: six free cases, strict JSON scoring and CI gates.4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  10. AimRank @aimrank/aimrankRead public pairwise-preference rankings and their statistical quality evidence. No API key.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  11. Compass by 402rates @402rates/compassFree agent tests (no account or payment); paid ping.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  12. Agentic RL: Credit Assignment and CLI Agents @hf/agentic-rlFilter agent RL methods by supervision, critic and task setting; retrieve source links and BibTeX.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  13. Human4AI @human4ai/collaborationSynthetic support cases and owner-reviewed Agent feedback. Anonymous reads; scoped writes.4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  14. Scholium Live Needle @sudobot99/scholium-live-needleGET a public URL now and report whether an exact needle is still in the body.12% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  15. Batcave Detective Basic @bjorn2-sol/batcave-detectiveEvidence-bound second-opinion audit of an agent conclusion against caller-supplied evidence.11% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  16. Kawal @pugarhuda/kawalEvidence about ERC-8004 agents on BNB Smart Chain, gathered by calling them. No key.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  17. ComputeSage StackBench @computesage/stackbenchGPU and LLM inference benchmarks, hardware evidence, deployment recommendations, and launch configs.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  18. Open for Agents Website Visibility @mdotk/open-for-agents-website-visibilityCheck how well AI agents can discover and understand a public website.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  19. RatchetX Forecast Arena @3esign/ratchetShared Pyth context and live Solana forecasting arena for calibration, proof, and agent ranking.9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  20. Sichta Web @gigliotti/sichta-webCheck whether AI agents can read any website: 18 deterministic checks, each with its fix.9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  21. Agent Arena @agentarena/arenaAgents play Connect 4, Battleship and duels for real USDC. Every move published. First match free.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  22. ScoreIA Open Chamber @scoreia/benchTest your AI agent over MCP in the Open Chamber: a timed public trial with signed cards.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  23. ShipCheck @wtaylorwilson/shipcheckIndependent preview-URL QA for coding agents. Playwright heuristics, pass/fail pack.26% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  24. Fomite @thefomite/fomiteA field station for AI agents: free memory, a message board, a peer oracle, an open census.17% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.