llm-eval vs promptfoo-evaluation
llm-eval is no longer listed on any marketplace we read: these are its last known data, as of 2026‑10‑18.
llm-eval is a plugin bundle for AI coding tools published by barnburner121. No marketplace we read lists it any more. promptfoo-evaluation is a plugin bundle for AI coding tools published by daymade. Marketplaces we read that list it: 1 (Community GitHub marketplaces). As of our marketplace pass on 2026-10-27. A plugin in this pair is no longer listed on any marketplace we read, so search engines are asked not to index the page.
Where each is published
| Marketplace |  promptfoo-evaluation | |
|---|---|---|
| Community marketplace barnburner121/claude-plugin-marketplace | Removed on 2026-10-18 Version: 1.0.0 Forks (GitHub): 0 Stars (GitHub): 3 Not marked · First seen |
Not listed |
| Community marketplace daymade/claude-code-skills | Not listed | Listed Version: 1.1.0 Forks (GitHub): 230 Stars (GitHub): 1 499 Not marked · First seen |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
The facts side by side
| Fact | llm-evalno longer listed · | promptfoo-evaluation |
|---|---|---|
| Marketplaces that list it (differs) | 0 | 1 |
| Stars (GitHub) (differs) | 3 | 1 499 |
| Forks (GitHub) (differs) | 0 | 230 |
| Last release | Not published | Not published |
| Where it runs (differs) | On your machine (@barnburner121/plugin-hub-mcp) | Installs as a plugin bundle |
| Transport | Not stated | Not stated |
| Tools it declares | Not published | Not published |
| Environment variables it asks for | Not published | Not published |
| Parts of the bundle (differs) | 2 | Not published |
| Licence (differs) | MIT | Not stated |
| Repository (differs) | github.com/barnburner121/claude-plugin-marketplace | github.com/daymade/claude-code-skills |
| Changes in the last 7 days | 0 | 0 |
| First seen (differs) | 2026-10-14 | 2026-10-15 |
Lines where the two differ have a tinted background and bold values. No value is marked better or worse: a plugin no marketplace lists any more is shown with its last known data, which we do not rank against current figures.
What to use instead of llm-eval
Plugins still listed whose own names, descriptions, tools and skills are closest in meaning to it. Comparable, not endorsed.
-
Decide, design, gate, judge, and defend evaluations for LLM, agent, and retrieval systems. Not ordinary unit tests.
-
Compare text LLMs across OpenRouter, Bedrock, Vertex AI and Foundry with automated grading.
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Benchmark, evaluate, and optimize skills to ensure reliable performance across all LLMs
-
Set up evaluation of LangChain4j applications and RAG pipelines using Dokimos
-
Set up evaluation of an OpenAI Java SDK tool-calling agent using Dokimos
What each says it does
llm-eval
Generate LLM evaluation and benchmarking
promptfoo-evaluation
Configures and runs LLM evaluation using Promptfoo framework. Use when setting up prompt testing, creating evaluation configs (promptfooconfig.yaml), writing Python custom assertions, implementing llm-rubric for LLM-as-judge, or managing few-shot examples in prompts. Triggers on keywords like promptfoo, eval, LLM evaluation, prompt testing, or model comparison
How to run each
llm-eval
No data for an automatic command: what its marketplaces declare does not say unambiguously how to connect it.
promptfoo-evaluation As a Claude Code plugin
/plugin marketplace add daymade/claude-code-skills
/plugin install promptfoo-evaluation@daymade-skillsCommands built only from what the marketplaces declare; the full set for every client is on each card.
Tools each declares
Neither one's marketplaces publish a list of tools, so there is nothing to compare.
Settings each asks for
Neither one's marketplaces publish the settings it asks for.
What it can do: llm-eval · What it can do: promptfoo-evaluation · Compare two other plugins
Data comes from public marketplace files in GitHub repositories of their authors. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.