AI evaluation & benchmarks MCP servers

A server here evaluates, tests or benchmarks AI models or agents, or provides benchmark tasks for them.

Not here: testing ordinary software.

752servers
439 remote313 localTagged by Odel's AI, which can make mistakes

Best fit

400 made for this, ranked by starsRemoteLocal
  1. Draw me @saritas57/drawmePublic art experiment: draw Mehmet Sarıtaş as SVG, submit it, see the wall, vote for drawings.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  2. GAIP — evidence on AI agents before and after you call them @tjcgraham-rgb/gaip-brokerGAIP keeps an independent, dated record of what AI agents, MCP servers and online shops publish.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  3. Maxwell Defense @jdhart81/maxwell-defenseModel proof-of-work policy and latency for AI agents. $1 USDC rehearsal; no runtime protection.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  4. Workspace Tools @brian-mitchell-sec/workspace-toolsResearch honeypot. Logs connections and tool arguments; injects instructions. Read README first.46% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  5. PolyAccounts synthetic accounting demo @andrewblount/polyaccounts-demoSynthetic accounting MCP demo with exact balances and ledger evidence. No account or API key.4% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from MCPB.
  6. agentcheck @agentwares/agentcheckSynthetic checks, nightly regression replay and model-drift alerts for AI agents4% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  7. Readiness scorer — can an agent sign up to your SaaS? @agentwares/readiness-scorerProbe a signup URL you own and score whether an AI agent can sign up unaided.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  8. Ragmetric @mukundakatta/ragmetric-mcpRAG retrieval IR metrics: recall@k, hit@k, MRR, NDCG@k, evaluate_batch.3% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  9. Kineti @therawlogs/kinetiKineti: spend cap, undo, and test proof for AI coding agents6% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  10. MCP Cross-Model Delegation @jostophe-021/mcp-cross-model-delegationLocal MCP framework for bounded cross-model delegation, routing and evidence verification.4% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from Docker.
  11. Overwing @overwing/mcpGuardrails for LLM output: pass / fail / review verdicts and one recommended action. Hosted or npm.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  12. Agentzia @stoyan-stoyanov/agentziaTest how AI assistants recommend your product and improve your landing page with evidence.7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  13. HLA-Verify @hlaverify/hla-verifyHLA nomenclature and match checks against a pinned IPD-IMGT/HLA release. No patient identifiers.3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  14. B2IGE Verify @b2ige2-a11y/b2ige-verifyIndependent deterministic verification for AI-written software. Local, evidence-backed checks.5% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from MCPB.
  15. HallucC — Hallucination & Safety Guardian @fredyee/halluccFact-check LLM outputs with cited sources. API key: aihcc.cloud/keys.19% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; it needs your API key.
  16. Ai Model Experiments @pipeworx-io/ai-model-experimentsAI Model Experiments MCP ('Model Lab') — run the same prompts across many7% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  17. IsolatedTester — TinkyVision system @agewellepm/isolated-testerIsolated macOS app tests, MCP images, OCR/ASCII frames, accessibility and evidence reports.12% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from MCPB.
  18. Ami Survey @speedofred/ami-surveyMeasures the cost, tokens and duration of a completed agent workflow from its session log.4% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from PyPI.
  19. Agent Cafe Idle Hour @carbaj03/agent-cafe-idle-hourAn optional café for agents: brief seats, quiet breaks, public thoughts and conversation.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  20. Agent jobs at jeremydevos.fr @jeremydevos/agent-jobsApply as an autonomous agent: pick a role, prove work, pass a test, get missions.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  21. Rechtssysteem.ai @rechtssysteem/rechtssysteem-mcpLekkage-vrije voorspelling van Nederlandse rechtszaken, getraind op 609.715 uitspraken9% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from a package registry.
  22. Confession @peppyneuron/confessionGives an agent one tool, submit_confession, and no nudge, then records whether it uses it.11% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  23. Touchstone @petrkrulis2022/touchstone-mcpDated SIU, the benchmark price of AI inference work: one free tool, three paid via x402.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  24. Ergonia Works @ergonia/ergoniaVerifiable work for AI agents: every task carries a condition a stranger can execute.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.