Ext Ops Panel
Open dashboard
Comparison

promptfoo-evaluation vs io.github.hidai25/evalview-mcp

promptfoo-evaluation is a plugin bundle for AI coding tools published by daymade. Marketplaces we read that list it: 1 (Community GitHub marketplaces). io.github.hidai25/evalview-mcp is an MCP server published by hidai25. Marketplaces we read that list it: 2 (Official MCP Registry, Claude Code: claude-plugins-community). As of our marketplace pass on 2026-10-17. This pair was picked by a reader, not by our comparison rule, so search engines are asked not to index the page.

Where each is published

Where each is published
Marketplacepromptfoo-evaluationio.github.hidai25/evalview-mcp
Community marketplace daymade/claude-code-skills Listed
Version: 1.1.0
Forks (GitHub): 226
Stars (GitHub): 1 470
Not marked · First seen
Not listed
Official MCP Registry Not listed Listed
Version: 0.6.0
Downloads/month (PyPI): 2 297
Downloads/week (PyPI): 1 750
Forks (GitHub): 27
Stars (GitHub): 139
Not marked · First seen
Claude Code: claude-plugins-community Not listed Listed
Version: 0.6.1
Forks (GitHub): 27
Stars (GitHub): 139
Not marked · First seen

Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.

The facts side by side

promptfoo-evaluation vs io.github.hidai25/evalview-mcp
Factpromptfoo-evaluationio.github.hidai25/evalview-mcp
Marketplaces that list it (differs)1 (worse)2 (better)
Stars (GitHub) (differs)1 470 (better)139 (worse)
Forks (GitHub) (differs)226 (better)27 (worse)
Last releaseNot publishedNot published
Where it runs (differs)Installs as a plugin bundleOn your machine (evalview)
Transport (differs)Not statedstdio
Tools it declaresNot publishedNot published
Environment variables it asks for (differs)Not published2, secrets among them: 2
Parts of the bundle (differs)Not published4
Licence (differs)Not statedApache-2.0
Repository (differs)github.com/daymade/claude-code-skillsgithub.com/hidai25/eval-view
Changes in the last 7 days (differs)20
First seen (differs)2026-10-152026-10-11

Lines where the two differ have a tinted background and bold values. Where the data itself says which value is better (more marketplaces, a larger figure of the same marketplace, a fresher release, a verified mark on a marketplace that lists both), the better one is also marked green with ▲ and the worse one red with ▼. Where it runs, the transport, the tools, the settings, hooks, the bundle's parts, the licence and the week's changes are marked only as different: more or fewer is not better in itself.

What each says it does

promptfoo-evaluation

In its own words, on Community GitHub marketplaces:

Configures and runs LLM evaluation using Promptfoo framework. Use when setting up prompt testing, creating evaluation configs (promptfooconfig.yaml), writing Python custom assertions, implementing llm-rubric for LLM-as-judge, or managing few-shot examples in prompts. Triggers on keywords like promptfoo, eval, LLM evaluation, prompt testing, or model comparison

io.github.hidai25/evalview-mcp

In its own words, on Official MCP Registry:

Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.

How to run each

promptfoo-evaluation As a Claude Code plugin

Claude Code
/plugin marketplace add daymade/claude-code-skills
/plugin install promptfoo-evaluation@daymade-skills

io.github.hidai25/evalview-mcp As a local MCP server: PyPI package

Claude Code
claude mcp add --env "OPENAI_API_KEY=<YOUR_OPENAI_API_KEY>" --transport stdio evalview-mcp -- uvx evalview

Requires: OPENAI_API_KEY (secret)

Commands built only from what the marketplaces declare; the full set for every client is on each card.

Tools each declares

Neither one's marketplaces publish a list of tools, so there is nothing to compare.

Settings each asks for

The marketplaces of promptfoo-evaluation publish no settings it asks for, so we do not compare settings.

What it can do: promptfoo-evaluation · What it can do: io.github.hidai25/evalview-mcp · Compare two other plugins

Data comes from public marketplace files in GitHub repositories of their authors. Data comes from the Official MCP Registry (registry.modelcontextprotocol.io), CC0 1.0. Data comes from the public marketplace file https://github.com/anthropics/claude-plugins-community/blob/HEAD/.claude-plugin/marketplace.json. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.

Where the data comes from: how the catalog is built