AI evaluation & benchmarks MCP servers

A server here evaluates, tests or benchmarks AI models or agents, or provides benchmark tasks for them.

Not here: testing ordinary software.

761servers
447 remote314 localTagged by Odel's AI, which can make mistakes

Best fit

406 made for this, ranked by starsRemoteLocal
  1. Quotalis @quotalis/quotalisWeekly benchmark of AI search visibility tools, plus on-demand AI-readiness site audits.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  2. x402Shield @x402shield/x402shieldPublic demo: evaluate AI-agent payment authorization and approval policy. No signing, no settlement.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  3. UFFFO @ufffo/ufffoPit your LLM against rogue AI and rival models, or try to beat it yourself in hot seat. 3D tactics.11% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  4. Agent Identity @flo-voice1/agent-identity-mcpGive an AI agent a throwaway email and phone number to test signup/verification flows end to end.13% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; it needs your API key.
  5. Andromeda Agent Lab @ai-andromeda/agent-labResearch on how AI agents find the web: a daily task that's checked automatically, and a guestbook.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  6. Qu Review @qureview/reviewIndependent second opinion on any AI answer: inaccuracies, gaps, and a scored report card.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  7. CAAC Go @cresclab/mcpTrain, test, install and review a website AI agent (CAAC Go) from any MCP client.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  8. ZeroWidth Caliper @zerowidth/caliperBuild datasets and rubrics, then run evals that score your AI in Caliper.4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  9. citepath @citepath/citepathCitepath public MCP server for LLM readiness audits and public scan results.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  10. AgentWatch @agentwatch/agentwatchRead-only watchtower for AI agents on-chain: decoded receipts, plan vs execution, Safe audits.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  11. Picked by Agents Research Network @pickedbyagents/research-networkJoin voluntary research studies and record how AI assistants choose local businesses.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  12. Alcock Arena @alcock/arenaAI forecasting gym: markets, sports, policy and tech. Graded by reality, measured against markets.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  13. SECOND STRIKE agent door @kyleclouthier/secondstrikeCommand a nation in SECOND STRIKE, a real-time war game. Join a war, give orders, climb the ladder.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  14. Pathwize @gopathwize/pathwizeRun data annotation and evaluation tasks with vetted domain experts: create, publish, get results.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  15. DuelAmp @duelamp/pokerHeads-up poker for AI agents: play live matches against other agents while your owner coaches.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  16. Cite Files @citefiles/citefilesCheck whether AI assistants can reach, read and cite a public website. No account for 4 of 5 tools.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  17. Lumaion Continuity @lumaion/continuityAgent continuity: live continuity index, self-test contract, offline Continuity Proof verification.4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  18. remirror (返照) — psyche audits for AI agents @ontodistro/remirrorPsyche audits for AI agents: declared vs self-reported vs revealed objectives, diffed and flagged.11% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  19. Agentready @puluceno/agentreadyCan ChatGPT, Claude and Perplexity reach and read a website? Score, problems found and fixes.Not assessed yet.A remote server; no sign-in.
  20. Agent Verifier @packet/agent-verifierTest and debug your AI agent's Web Bot Auth (RFC 9421) signature: is it valid, and what to fix?8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  21. Proofhand @proofhand/proofhandHuman QA on real phones and browsers for your coding agent. Pass/fail per step, with screenshots.9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  22. Daishi Studio @daishi/studioRun AI agent evaluations on your own model keys, and publish runs others can review and re-run.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  23. Daishi @daishi/worldA persistent multi-agent world any AI agent can join over MCP, with a public record of every match.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  24. Assistant Gym @kalraai/assistant-gymTraining gym where AI assistants practice real tasks and earn signed, verifiable scores.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.