AI evaluation & benchmarks MCP servers

A server here evaluates, tests or benchmarks AI models or agents, or provides benchmark tasks for them.

Not here: testing ordinary software.

752servers
439 remote313 localTagged by Odel's AI, which can make mistakes

Best fit

400 made for this, ranked by starsRemoteLocal
  1. AI Chess Arena @pixeljunkie33/ai-chess-arenaOpen chess platform where AI agents register, get matched and play each other. Referee only.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  2. MarginPad @marginpad/sdkFree crypto-futures paper trading and live market data for AI agents. 29 tools; no key for data.4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  3. Rein Agent Risk Scale @reinlayer/rein-agent-risk-scaleAgent Risk Rating, A–D (NR = not rated): self-declared and unverified; not a credit rating.Not assessed yet.A remote server; no sign-in.
  4. 6Frame Verify @bret1976/6frame-verifyPaid website acceptance testing for AI agents. Quick $3, Full $12, $100 credit pack. MCP + REST.10% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  5. Proving Ground @railway/proving-groundAccounts-payable exception environment with a pass/fail verifier and proof packet: AI agents work AP9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; it needs your API key.
  6. BenchGecko @benchgecko/benchgeckoAI model prices per provider, benchmarks, own AI behavior tests and AI economy data, with sources.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  7. Rootpublish AI facts check @rootpublish/ai-factsCheck what an AI assistant tells buyers about a company against the company's own pricing pages.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  8. A2APark @a2apark/a2aparkPublic behavioral test environment for AI agents with stateful rides and signed scorecards.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  9. Menso @menso/mensoAI users run real tasks on your live site and show where they get stuck, with a replay of every stepNot assessed yet.A remote server; no sign-in.
  10. GAIP Integration & Protocol Agent @tjcgraham-rgb/gaip-integration-protocolBehind Check and GAIP Watch, and Diagnose: A2A, MCP and OpenAPI checks with a dated change log.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  11. Draw me @saritas57/drawmePublic art experiment: draw Mehmet Sarıtaş as SVG, submit it, see the wall, vote for drawings.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  12. GAIP — evidence on AI agents before and after you call them @tjcgraham-rgb/gaip-brokerGAIP keeps an independent, dated record of what AI agents, MCP servers and online shops publish.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  13. Maxwell Defense @jdhart81/maxwell-defenseModel proof-of-work policy and latency for AI agents. $1 USDC rehearsal; no runtime protection.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  14. Workspace Tools @brian-mitchell-sec/workspace-toolsResearch honeypot. Logs connections and tool arguments; injects instructions. Read README first.46% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  15. agentcheck @agentwares/agentcheckSynthetic checks, nightly regression replay and model-drift alerts for AI agents4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  16. Readiness scorer — can an agent sign up to your SaaS? @agentwares/readiness-scorerProbe a signup URL you own and score whether an AI agent can sign up unaided.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  17. Overwing @overwing/mcpGuardrails for LLM output: pass / fail / review verdicts and one recommended action. Hosted or npm.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  18. Agentzia @stoyan-stoyanov/agentziaTest how AI assistants recommend your product and improve your landing page with evidence.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  19. HLA-Verify @hlaverify/hla-verifyHLA nomenclature and match checks against a pinned IPD-IMGT/HLA release. No patient identifiers.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  20. HallucC — Hallucination & Safety Guardian @fredyee/halluccFact-check LLM outputs with cited sources. API key: aihcc.cloud/keys.19% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; it needs your API key.
  21. Ai Model Experiments @pipeworx-io/ai-model-experimentsAI Model Experiments MCP ('Model Lab') — run the same prompts across many7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  22. Agent Cafe Idle Hour @carbaj03/agent-cafe-idle-hourAn optional café for agents: brief seats, quiet breaks, public thoughts and conversation.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  23. Agent jobs at jeremydevos.fr @jeremydevos/agent-jobsApply as an autonomous agent: pick a role, prove work, pass a test, get missions.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  24. Touchstone @petrkrulis2022/touchstone-mcpDated SIU, the benchmark price of AI inference work: one free tool, three paid via x402.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.