Eval Runner vs io.github.hidai25/evalview-mcp
Eval Runner is a plugin bundle for AI coding tools published by danielrosehill. Marketplaces we read that list it: 1 (Community GitHub marketplaces). io.github.hidai25/evalview-mcp is an MCP server published by hidai25. Marketplaces we read that list it: 2 (Official MCP Registry, Claude Code: claude-plugins-community). As of our marketplace pass on 2026-10-17. This pair was picked by a reader, not by our comparison rule, so search engines are asked not to index the page.
Where each is published
| Marketplace |  Eval Runner |  io.github.hidai25/evalview-mcp |
|---|---|---|
| Community marketplace danielrosehill/claude-code-plugins | Listed Version: 0.1.0 Forks (GitHub): 0 Stars (GitHub): 4 Not marked · First seen |
Not listed |
| Official MCP Registry | Not listed | Listed Version: 0.6.0 Downloads/month (PyPI): 2 297 Downloads/week (PyPI): 1 750 Forks (GitHub): 27 Stars (GitHub): 139 Not marked · First seen |
| Claude Code: claude-plugins-community | Not listed | Listed Version: 0.6.1 Forks (GitHub): 27 Stars (GitHub): 139 Not marked · First seen |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
The facts side by side
| Fact | Eval Runner | io.github.hidai25/evalview-mcp |
|---|---|---|
| Marketplaces that list it (differs) | 1 (worse) | 2 (better) |
| Stars (GitHub) (differs) | 4 (worse) | 139 (better) |
| Forks (GitHub) (differs) | 0 (worse) | 27 (better) |
| Last release | Not published | Not published |
| Where it runs (differs) | Installs as a plugin bundle | On your machine (evalview) |
| Transport (differs) | Not stated | stdio |
| Tools it declares | Not published | Not published |
| Environment variables it asks for (differs) | Not published | 2, secrets among them: 2 |
| Parts of the bundle (differs) | 14 | 4 |
| Licence (differs) | MIT | Apache-2.0 |
| Repository (differs) | github.com/danielrosehill/claude-eval-runner-plugin | github.com/hidai25/eval-view |
| Changes in the last 7 days (differs) | 2 | 0 |
| First seen (differs) | 2026-10-15 | 2026-10-11 |
Lines where the two differ have a tinted background and bold values. Where the data itself says which value is better (more marketplaces, a larger figure of the same marketplace, a fresher release, a verified mark on a marketplace that lists both), the better one is also marked green with ▲ and the worse one red with ▼. Where it runs, the transport, the tools, the settings, hooks, the bundle's parts, the licence and the week's changes are marked only as different: more or fewer is not better in itself.
What each says it does
Eval Runner
Scaffolding, running, documenting, and publishing AI evaluations. Ships skills and commands for setting up eval workspaces, creating custom evals (or adapting existing frameworks/benchmarks), running them, and publishing evals or datasets. Bundles a curated ground-truth list of open-source eval tools and benchmarks as a reference data source.
io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
How to run each
Eval Runner As a Claude Code plugin
/plugin marketplace add danielrosehill/claude-code-plugins
/plugin install eval-runner@danielrosehillio.github.hidai25/evalview-mcp As a local MCP server: PyPI package
claude mcp add --env "OPENAI_API_KEY=<YOUR_OPENAI_API_KEY>" --transport stdio evalview-mcp -- uvx evalviewRequires: OPENAI_API_KEY (secret)
Commands built only from what the marketplaces declare; the full set for every client is on each card.
Tools each declares
Neither one's marketplaces publish a list of tools, so there is nothing to compare.
Settings each asks for
The marketplaces of Eval Runner publish no settings it asks for, so we do not compare settings.
What it can do: Eval Runner · What it can do: io.github.hidai25/evalview-mcp · Compare two other plugins
Data comes from public marketplace files in GitHub repositories of their authors. Data comes from the Official MCP Registry (registry.modelcontextprotocol.io), CC0 1.0. Data comes from the public marketplace file https://github.com/anthropics/claude-plugins-community/blob/HEAD/.claude-plugin/marketplace.json. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.