IA-QA Eval & RAG — 38 tools vs io.github.hidai25/evalview-mcp
IA-QA Eval & RAG — 38 tools is an MCP server published by JcJamet. Marketplaces we read that list it: 1 (Official MCP Registry). io.github.hidai25/evalview-mcp is an MCP server published by hidai25. Marketplaces we read that list it: 2 (Official MCP Registry, Claude Code: claude-plugins-community). As of our marketplace pass on 2026-10-30. This pair was picked by a reader, not by our comparison rule, so search engines are asked not to index the page.
Where each is published
| Marketplace |  IA-QA Eval & RAG — 38 tools |  io.github.hidai25/evalview-mcp |
|---|---|---|
| Official MCP Registry | Listed Version: 1.0.1 Forks (GitHub): 0 Stars (GitHub): 0 Not marked · First seen |
Listed Version: 0.6.0 Downloads/month (PyPI): 2 297 Downloads/week (PyPI): 1 978 Forks (GitHub): 27 Stars (GitHub): 140 Not marked · First seen |
| Claude Code: claude-plugins-community | Not listed | Listed Version: 0.6.1 Forks (GitHub): 27 Stars (GitHub): 140 Not marked · First seen |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
The facts side by side
| Fact | IA-QA Eval & RAG — 38 tools | io.github.hidai25/evalview-mcp |
|---|---|---|
| Marketplaces that list it (differs) | 1 (worse) | 2 (better) |
| Stars (GitHub) (differs) | 0 (worse) | 140 (better) |
| Forks (GitHub) (differs) | 0 (worse) | 27 (better) |
| Last release (differs) | 2026-10-26 | Not published |
| Where it runs (differs) | Remote server (www.ia-qa.com/mcp/eval) | On your machine (evalview) |
| Transport (differs) | Streamable HTTP | stdio |
| Tools it declares | Not published | Not published |
| Environment variables it asks for (differs) | Not published | 2, secrets among them: 2 |
| Parts of the bundle (differs) | Not a bundle | 4 |
| Licence (differs) | Not stated | Apache-2.0 |
| Repository (differs) | github.com/ia-qa-com/mcp | github.com/hidai25/eval-view |
| Changes in the last 7 days (differs) | 4 | 0 |
| First seen (differs) | 2026-10-26 | 2026-10-11 |
| Endpoint at the last check (differs) | not checked yet | no remote endpoint we check |
Lines where the two differ have a tinted background and bold values. Where the data itself says which value is better (more marketplaces, a larger figure of the same marketplace, a fresher release, a verified mark on a marketplace that lists both), the better one is also marked green with ▲ and the worse one red with ▼. Where it runs, the transport, the tools, the settings, hooks, the bundle's parts, the licence and the week's changes are marked only as different: more or fewer is not better in itself.
What each says it does
IA-QA Eval & RAG — 38 tools
LLM & RAG evals: hallucination, eval contracts, semantic tests, tokens & model info. Free, no key.
io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
How to run each
IA-QA Eval & RAG — 38 tools As a remote MCP server
claude mcp add --transport http ia-qa-eval https://www.ia-qa.com/mcp/evalio.github.hidai25/evalview-mcp As a local MCP server: PyPI package
claude mcp add --env "OPENAI_API_KEY=<YOUR_OPENAI_API_KEY>" --transport stdio evalview-mcp -- uvx evalviewRequires: OPENAI_API_KEY (secret)
Commands built only from what the marketplaces declare; the full set for every client is on each card.
Tools each declares
Neither one's marketplaces publish a list of tools, so there is nothing to compare.
Settings each asks for
The marketplaces of IA-QA Eval & RAG — 38 tools publish no settings it asks for, so we do not compare settings.
What it can do: IA-QA Eval & RAG — 38 tools · What it can do: io.github.hidai25/evalview-mcp · Compare two other plugins
Data comes from the Official MCP Registry (registry.modelcontextprotocol.io), CC0 1.0. Data comes from the public marketplace file https://github.com/anthropics/claude-plugins-community/blob/HEAD/.claude-plugin/marketplace.json. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.