promptfoo-evaluation vs IA-QA — 130+ QA & Dev Tools for AI Agents
promptfoo-evaluation is a plugin bundle for AI coding tools published by daymade. Marketplaces we read that list it: 1 (Community GitHub marketplaces). IA-QA — 130+ QA & Dev Tools for AI Agents is an MCP server published by JcJamet. Marketplaces we read that list it: 1 (Official MCP Registry). As of our marketplace pass on 2026-10-21. This pair was picked by a reader, not by our comparison rule, so search engines are asked not to index the page.
Where each is published
| Marketplace |  promptfoo-evaluation |  IA-QA — 130+ QA & Dev Tools for AI Agents |
|---|---|---|
| Community marketplace daymade/claude-code-skills | Listed Version: 1.1.0 Forks (GitHub): 228 Stars (GitHub): 1 482 Not marked · First seen |
Not listed |
| Official MCP Registry | Not listed | Listed Version: 1.0.0 No figure published Not marked · First seen |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
The facts side by side
| Fact | promptfoo-evaluation | IA-QA — 130+ QA & Dev Tools for AI Agents |
|---|---|---|
| Marketplaces that list it | 1 | 1 |
| Stars (GitHub) (differs) | 1 482 | No figure on GitHub |
| Forks (GitHub) (differs) | 228 | No figure on GitHub |
| Last release | Not published | Not published |
| Where it runs (differs) | Installs as a plugin bundle | Remote server (www.ia-qa.com/mcp) |
| Transport (differs) | Not stated | Streamable HTTP |
| Tools it declares | Not published | Not published |
| Environment variables it asks for | Not published | Not published |
| Licence | Not stated | Not stated |
| Repository (differs) | github.com/daymade/claude-code-skills | github.com/jcjamet/ia-qa |
| Changes in the last 7 days (differs) | 2 | 0 |
| First seen (differs) | 2026-10-15 | 2026-10-11 |
| Endpoint at the last check (differs) | no remote endpoint we check | Responded 5 days ago |
Lines where the two differ have a tinted background and bold values. Where the data itself says which value is better (more marketplaces, a larger figure of the same marketplace, a fresher release, a verified mark on a marketplace that lists both), the better one is also marked green with ▲ and the worse one red with ▼. Where it runs, the transport, the tools, the settings, hooks, the bundle's parts, the licence and the week's changes are marked only as different: more or fewer is not better in itself.
What each says it does
promptfoo-evaluation
Configures and runs LLM evaluation using Promptfoo framework. Use when setting up prompt testing, creating evaluation configs (promptfooconfig.yaml), writing Python custom assertions, implementing llm-rubric for LLM-as-judge, or managing few-shot examples in prompts. Triggers on keywords like promptfoo, eval, LLM evaluation, prompt testing, or model comparison
IA-QA — 130+ QA & Dev Tools for AI Agents
130+ QA & dev tools for AI agents: prompt injection, RAG testing, VLM eval, guardrails. Free.
How to run each
promptfoo-evaluation As a Claude Code plugin
/plugin marketplace add daymade/claude-code-skills
/plugin install promptfoo-evaluation@daymade-skillsIA-QA — 130+ QA & Dev Tools for AI Agents As a remote MCP server
claude mcp add --transport http ia-qa-toolbox https://www.ia-qa.com/mcpCommands built only from what the marketplaces declare; the full set for every client is on each card.
Only IA-QA — 130+ QA & Dev Tools for AI Agents has a remote endpoint we check. How we check endpoints
Tools each declares
Neither one's marketplaces publish a list of tools, so there is nothing to compare.
Settings each asks for
Neither one's marketplaces publish the settings it asks for.
What it can do: promptfoo-evaluation · What it can do: IA-QA — 130+ QA & Dev Tools for AI Agents · Compare two other plugins
Data comes from public marketplace files in GitHub repositories of their authors. Data comes from the Official MCP Registry (registry.modelcontextprotocol.io), CC0 1.0. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.