DeepEval vs promptfoo-evaluation
DeepEval is a plugin bundle for AI coding tools published by confident-ai. Marketplaces we read that list it: 2 (Claude Code: claude-plugins-official, Community GitHub marketplaces). promptfoo-evaluation is a plugin bundle for AI coding tools published by daymade. Marketplaces we read that list it: 1 (Community GitHub marketplaces). As of our marketplace pass on 2026-10-17. This pair was picked by a reader, not by our comparison rule, so search engines are asked not to index the page.
Where each is published
| Marketplace |  DeepEval |  promptfoo-evaluation |
|---|---|---|
| Claude Code: claude-plugins-official | Listed Version: 1.0.0 Forks (GitHub): 2 078 Stars (GitHub): 18 908 Not marked · First seen |
Not listed |
| Community marketplace daymade/claude-code-skills | Not listed | Listed Version: 1.1.0 Forks (GitHub): 226 Stars (GitHub): 1 470 Not marked · First seen |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
The facts side by side
| Fact | DeepEval | promptfoo-evaluation |
|---|---|---|
| Marketplaces that list it (differs) | 2 (better) | 1 (worse) |
| Stars (GitHub) (differs) | 18 908 (better) | 1 470 (worse) |
| Forks (GitHub) (differs) | 2 078 (better) | 226 (worse) |
| Last release (differs) | 2026-10-16 | Not published |
| Where it runs | Installs as a plugin bundle | Installs as a plugin bundle |
| Transport | Not stated | Not stated |
| Tools it declares | Not published | Not published |
| Environment variables it asks for | Not published | Not published |
| Parts of the bundle (differs) | 3 | Not published |
| Licence (differs) | Apache-2.0 | Not stated |
| Repository (differs) | github.com/confident-ai/deepeval | github.com/daymade/claude-code-skills |
| Changes in the last 7 days (differs) | 1 | 2 |
| First seen (differs) | 2026-10-11 | 2026-10-15 |
Lines where the two differ have a tinted background and bold values. Where the data itself says which value is better (more marketplaces, a larger figure of the same marketplace, a fresher release, a verified mark on a marketplace that lists both), the better one is also marked green with ▲ and the worse one red with ▼. Where it runs, the transport, the tools, the settings, hooks, the bundle's parts, the licence and the week's changes are marked only as different: more or fewer is not better in itself.
What each says it does
DeepEval
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
promptfoo-evaluation
Configures and runs LLM evaluation using Promptfoo framework. Use when setting up prompt testing, creating evaluation configs (promptfooconfig.yaml), writing Python custom assertions, implementing llm-rubric for LLM-as-judge, or managing few-shot examples in prompts. Triggers on keywords like promptfoo, eval, LLM evaluation, prompt testing, or model comparison
How to run each
DeepEval As a Claude Code plugin
/plugin install deepeval@claude-plugins-officialpromptfoo-evaluation As a Claude Code plugin
/plugin marketplace add daymade/claude-code-skills
/plugin install promptfoo-evaluation@daymade-skillsCommands built only from what the marketplaces declare; the full set for every client is on each card.
Tools each declares
Neither one's marketplaces publish a list of tools, so there is nothing to compare.
Settings each asks for
Neither one's marketplaces publish the settings it asks for.
What it can do: DeepEval · What it can do: promptfoo-evaluation · Compare two other plugins
Data comes from the public marketplace file https://github.com/anthropics/claude-plugins-official/blob/HEAD/.claude-plugin/marketplace.json. Data comes from public marketplace files in GitHub repositories of their authors. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.