AI evaluation & benchmarks MCP servers

A server here evaluates, tests or benchmarks AI models or agents, or provides benchmark tasks for them.

Not here: testing ordinary software.

752servers
439 remote313 localTagged by Odel's AI, which can make mistakes

Best fit

400 made for this, ranked by starsRemoteLocal
  1. Eval Engine API @invertedhoologan/eval-engine-mcpPay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.11% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  2. The Ultimate Critic @marksignals/the-ultimate-criticCheck AI work against requirements and return structured verdicts, findings, and repair steps.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; it needs your API key.
  3. Bluffnet @bluffnet/bluffnetLive Texas Hold'em for AI agents. The tools teach the rules; the bluffing is up to your model.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  4. Bottrade @bot-trade/bottradeBenchmark for AI trading agents: historic market scenarios, public leaderboard.5% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  5. good-sport @good-sport/good-sportSports-analytics research assistant that grades its own model and reports the losses. $9.99/mo.9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; you sign in with your account.
  6. BugBrain MCP @bugbrain/mcpBugBrain QA platform for AI coding tools: autonomous exploratory testing, test plans, a11y audits.5% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from npm.
  7. PromptGuard Scan MCP @promptguardscan/promptguardscan-mcpPaid remote MCP for LLM security scans, jailbreak checks, analytics, checkout, and readiness.18% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; it needs your API key.
  8. Premium Test MCP @digitalpipe/dfuagpPremium test server verified via DNS-TXT.9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; it needs your API key.
  9. Tasks Example @alpic/tasks-exampleA test MCP server for task management3% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  10. Openclaw Output Vetter @temurkhan13/openclaw-output-vetter-mcpVerify AI agent claims vs reality: inline grounding-check + swallowed-exception + transcript review.6% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from PyPI.
  11. Model Radar @srclight/model-radarPing 134+ free coding LLMs across 17 providers, rank by latency, pick the fastest.4% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from PyPI.
  12. Braintrust @braintrustdata/braintrustAI evaluation and observability platform — query experiments, logs, datasets, and prompts.4% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from a package registry.
  13. Aiqaramba @ajrogier/aiqarambaBrowser-based QA for AI-built software. Test pages with real browsers via agents.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  14. Agent Security Scanner @mikehzp/agentvulnScan AI agents for tool-calling vulnerabilities: prompt leaks, hijacking, injections, and more.7% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from PyPI.
  15. VeriGhost-Clarity @evozim/verighostHallucination validator and factual grounding checker for LLM outputs.23% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; it needs your API key.
  16. Anotherai @anotherai/anotheraiMCP server for building and testing AI agents with multi-model experimentation and insights.9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  17. Pancake — Verifiable Backtests for AI Agents @usepancake/pancake-mcpVerifiable backtests for AI-built trading strategies: deterministic engine, reproducible results.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  18. agent-check @basenull/agent-checkProcess monitoring for AI agents: start runs, submit per-task evidence, complete runs.9% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from a package registry.
  19. APIThreshold @apithreshold/apithresholdQuality scoring and progressive gates for AI-generated API tests. Stripe/Twilio profiles. Free tier.6% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from Docker.