Eval Runner vs com.clauxel.evalscopebench/evalscopebench-mcp
Eval Runner is no longer listed on any marketplace we read: these are its last known data, as of 2026‑11‑05.
Eval Runner is a plugin bundle for AI coding tools published by danielrosehill. No marketplace we read lists it any more. com.clauxel.evalscopebench/evalscopebench-mcp is an MCP server published by evalscopebench.clauxel.com. Marketplaces we read that list it: 1 (Official MCP Registry). As of our marketplace pass on 2026-11-08. A plugin in this pair is no longer listed on any marketplace we read, so search engines are asked not to index the page.
Where each is published
| Marketplace |  com.clauxel.evalscopebench/evalscopebench-mcp | |
|---|---|---|
| Community marketplace danielrosehill/claude-code-plugins | Removed on 2026-11-05 Version: 0.1.0 Forks (GitHub): 0 Stars (GitHub): 4 Not marked · First seen |
Not listed |
| Official MCP Registry | Not listed | Listed Version: 1.0.0 Forks (GitHub): 0 Stars (GitHub): 0 Not marked · First seen |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
The facts side by side
| Fact | Eval Runnerno longer listed · | com.clauxel.evalscopebench/evalscopebench-mcp |
|---|---|---|
| Marketplaces that list it (differs) | 0 | 1 |
| Stars (GitHub) (differs) | 4 | 0 |
| Forks (GitHub) | 0 | 0 |
| Last release | Not published | Not published |
| Where it runs (differs) | Installs as a plugin bundle | Remote server (evalscopebench.clauxel.com/mcp) |
| Transport (differs) | Not stated | Streamable HTTP |
| Tools it declares | Not published | Not published |
| Environment variables it asks for | Not published | Not published |
| Parts of the bundle (differs) | 14 | Not a bundle |
| Licence (differs) | MIT | Not stated |
| Repository (differs) | github.com/danielrosehill/claude-eval-runner-plugin | github.com/clauxel/evalscope-benchmark-mcp-mcp |
| Changes in the last 7 days (differs) | 2 | 0 |
| First seen (differs) | 2026-10-15 | 2026-10-11 |
| Endpoint at the last check (differs) | no remote endpoint we check | No HTTP response at the last check (10 h ago) |
Lines where the two differ have a tinted background and bold values. No value is marked better or worse: a plugin no marketplace lists any more is shown with its last known data, which we do not rank against current figures.
What to use instead of Eval Runner
Plugins still listed whose own names, descriptions, tools and skills are closest in meaning to it. Comparable, not endorsed.
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Agent skills for observing and evaluating LLM applications with LangSmith
-
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…
-
Set up evaluation of an OpenAI Java SDK tool-calling agent using Dokimos
-
agent-evals-and-observability
Design, run, review, or release framework- and vendor-neutral evaluations and observability for AI agents. Use when defining agent evals, datasets, graders, trajectory review…
-
Configures and runs LLM evaluation using Promptfoo framework. Use when setting up prompt testing, creating evaluation configs (promptfooconfig.yaml), writing Python custom…
What each says it does
Eval Runner
Scaffolding, running, documenting, and publishing AI evaluations. Ships skills and commands for setting up eval workspaces, creating custom evals (or adapting existing frameworks/benchmarks), running them, and publishing evals or datasets. Bundles a curated ground-truth list of open-source eval tools and benchmarks as a reference data source.
com.clauxel.evalscopebench/evalscopebench-mcp
A paid remote MCP for AI SDK benchmark dashboard, built to return verdicts, receipts, usage logs, an
How to run each
Eval Runner
No data for an automatic command: what its marketplaces declare does not say unambiguously how to connect it.
com.clauxel.evalscopebench/evalscopebench-mcp As a remote MCP server
claude mcp add --transport http evalscopebench-mcp https://evalscopebench.clauxel.com/mcpCommands built only from what the marketplaces declare; the full set for every client is on each card.
Only com.clauxel.evalscopebench/evalscopebench-mcp has a remote endpoint we check. How we check endpoints
Tools each declares
Neither one's marketplaces publish a list of tools, so there is nothing to compare.
Settings each asks for
Neither one's marketplaces publish the settings it asks for.
What it can do: Eval Runner · What it can do: com.clauxel.evalscopebench/evalscopebench-mcp · Compare two other plugins
Data comes from public marketplace files in GitHub repositories of their authors. Data comes from the Official MCP Registry (registry.modelcontextprotocol.io), CC0 1.0. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.