AI evaluation & benchmarks MCP servers

A server here evaluates, tests or benchmarks AI models or agents, or provides benchmark tasks for them.

Not here: testing ordinary software.

779servers
452 remote327 localTagged by Odel's AI, which can make mistakes

Best fit

413 made for this, ranked by starsRemoteLocal
  1. Braintrust @braintrustdata/braintrustAI evaluation and observability platform — query experiments, logs, datasets, and prompts.4% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from a package registry.
  2. Aiqaramba @ajrogier/aiqarambaBrowser-based QA for AI-built software. Test pages with real browsers via agents.8% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  3. Agent Security Scanner @mikehzp/agentvulnScan AI agents for tool-calling vulnerabilities: prompt leaks, hijacking, injections, and more.7% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from PyPI.
  4. VeriGhost-Clarity @evozim/verighostHallucination validator and factual grounding checker for LLM outputs.23% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; it needs your API key.
  5. Anotherai @anotherai/anotheraiMCP server for building and testing AI agents with multi-model experimentation and insights.9% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  6. Pancake — Verifiable Backtests for AI Agents @usepancake/pancake-mcpVerifiable backtests for AI-built trading strategies: deterministic engine, reproducible results.6% chance this is malicious. Assessed by AI, which can make mistakes.A remote server; no sign-in.
  7. agent-check @basenull/agent-checkProcess monitoring for AI agents: start runs, submit per-task evidence, complete runs.9% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from a package registry.
  8. APIThreshold @apithreshold/apithresholdQuality scoring and progressive gates for AI-generated API tests. Stripe/Twilio profiles. Free tier.6% chance this is malicious. Assessed by AI, which can make mistakes.Runs on your machine, installed from Docker.