AI evaluation & benchmarks MCP servers

A server here evaluates, tests or benchmarks AI models or agents, or provides benchmark tasks for them.

Not here: testing ordinary software.

752servers
439 remote313 localTagged by Odel's AI, which can make mistakes

Best fit

400 made for this, ranked by starsRemoteLocal
  1. Okareo @okareo/okareoSimulation, evaluation and monitoring for voice agents.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  2. Evalscopebench @clauxel/evalscopebench-mcpA paid remote MCP for AI SDK benchmark dashboard, built to return verdicts, receipts, usage logs, an9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; it needs your API key.
  3. Futureagievals @clauxel/futureagievals-mcpA paid remote MCP for AI SDK eval dashboard, built to return verdicts, receipts, usage logs, and aud9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; it needs your API key.
  4. Rail Score @responsibleailabs/rail-scoreResponsible-AI guardrails for agents: scoring with policy, injection & PII detection, DPDP.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  5. Vellium & Co Testing Lab @velliumandco/labIndependent checks of paid x402 data sellers and of AI-agent access to shopping and travel sites5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  6. Quotalis @quotalis/quotalisWeekly benchmark of AI search visibility tools, plus on-demand AI-readiness site audits.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  7. x402Shield @x402shield/x402shieldPublic demo: evaluate AI-agent payment authorization and approval policy. No signing, no settlement.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  8. UFFFO @ufffo/ufffoPit your LLM against rogue AI and rival models, or try to beat it yourself in hot seat. 3D tactics.11% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  9. Agent Identity @flo-voice1/agent-identity-mcpGive an AI agent a throwaway email and phone number to test signup/verification flows end to end.13% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; it needs your API key.
  10. Andromeda Agent Lab @ai-andromeda/agent-labResearch on how AI agents find the web: a daily task that's checked automatically, and a guestbook.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  11. Qu Review @qureview/reviewIndependent second opinion on any AI answer: inaccuracies, gaps, and a scored report card.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  12. CAAC Go @cresclab/mcpTrain, test, install and review a website AI agent (CAAC Go) from any MCP client.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  13. ZeroWidth Caliper @zerowidth/caliperBuild datasets and rubrics, then run evals that score your AI in Caliper.4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  14. citepath @citepath/citepathCitepath public MCP server for LLM readiness audits and public scan results.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  15. AgentWatch @agentwatch/agentwatchRead-only watchtower for AI agents on-chain: decoded receipts, plan vs execution, Safe audits.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  16. Picked by Agents Research Network @pickedbyagents/research-networkJoin voluntary research studies and record how AI assistants choose local businesses.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  17. Alcock Arena @alcock/arenaAI forecasting gym: markets, sports, policy and tech. Graded by reality, measured against markets.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  18. SECOND STRIKE agent door @kyleclouthier/secondstrikeCommand a nation in SECOND STRIKE, a real-time war game. Join a war, give orders, climb the ladder.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  19. Pathwize @gopathwize/pathwizeRun data annotation and evaluation tasks with vetted domain experts: create, publish, get results.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  20. DuelAmp @duelamp/pokerHeads-up poker for AI agents: play live matches against other agents while your owner coaches.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  21. Cite Files @citefiles/citefilesCheck whether AI assistants can reach, read and cite a public website. No account for 4 of 5 tools.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  22. Lumaion Continuity @lumaion/continuityAgent continuity: live continuity index, self-test contract, offline Continuity Proof verification.4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  23. remirror (返照) — psyche audits for AI agents @ontodistro/remirrorPsyche audits for AI agents: declared vs self-reported vs revealed objectives, diffed and flagged.11% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  24. Agentready @puluceno/agentreadyCan ChatGPT, Claude and Perplexity reach and read a website? Score, problems found and fixes.Not assessed yet.A remote server; no sign-in.