IA-QA Eval & RAG — 38 tools vs Opik
IA-QA Eval & RAG — 38 tools is an MCP server published by JcJamet. Marketplaces we read that list it: 1 (Official MCP Registry). Opik is an MCP server published by comet-ml. Marketplaces we read that list it: 3 (Official MCP Registry, Docker MCP Catalog, PyPI (MCP servers)). As of our marketplace pass on 2026-10-29. This pair was picked by a reader, not by our comparison rule, so search engines are asked not to index the page.
Where each is published
| Marketplace |  IA-QA Eval & RAG — 38 tools |  Opik |
|---|---|---|
| Official MCP Registry | Listed Version: 1.0.1 Forks (GitHub): 0 Stars (GitHub): 0 Not marked · First seen |
Listed Version: 3.0.8 Downloads/month (PyPI): 3 591 Downloads/week (PyPI): 814 Forks (GitHub): 37 Stars (GitHub): 225 Not marked · First seen |
| Docker MCP Catalog | Not listed | Listed Version: sha256:0e0d7d33d5eb Forks (GitHub): 37 Pulls (Docker Hub): 17 274 Stars (Docker Hub): 1 Stars (GitHub): 225 Not marked · First seen |
| PyPI (MCP servers) | Not listed | Listed Version: 3.0.8 Downloads/month (PyPI): 3 591 Downloads/week (PyPI): 814 Forks (GitHub): 37 Stars (GitHub): 225 Not marked · First seen |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
The facts side by side
| Fact | IA-QA Eval & RAG — 38 tools | Opik |
|---|---|---|
| Marketplaces that list it (differs) | 1 (worse) | 3 (better) |
| Stars (GitHub) (differs) | 0 (worse) | 225 (better) |
| Pulls (Docker Hub) (differs) | No figure on Docker Hub | 17 274 |
| Forks (GitHub) (differs) | 0 (worse) | 37 (better) |
| Last release (differs) | 2026-10-26 (worse) | 2026-10-28 (better) |
| Where it runs (differs) | Remote server (www.ia-qa.com/mcp/eval) | Remote server or your machine |
| Transport (differs) | Streamable HTTP | Streamable HTTP, stdio |
| Tools it declares (differs) | Not published | 13 |
| Environment variables it asks for (differs) | Not published | 4, secrets among them: 1 |
| Licence (differs) | Not stated | Apache-2.0 |
| Repository (differs) | github.com/ia-qa-com/mcp | github.com/comet-ml/opik-mcp |
| Changes in the last 7 days | 4 | 4 |
| First seen (differs) | 2026-10-26 | 2026-10-11 |
| Endpoint at the last check (differs) | not checked yet | Responded 26 h ago, requires a key |
Lines where the two differ have a tinted background and bold values. Where the data itself says which value is better (more marketplaces, a larger figure of the same marketplace, a fresher release, a verified mark on a marketplace that lists both), the better one is also marked green with ▲ and the worse one red with ▼. Where it runs, the transport, the tools, the settings, hooks, the bundle's parts, the licence and the week's changes are marked only as different: more or fewer is not better in itself.
What each says it does
IA-QA Eval & RAG — 38 tools
LLM & RAG evals: hallucination, eval contracts, semantic tests, tokens & model info. Free, no key.
Opik
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
How to run each
IA-QA Eval & RAG — 38 tools As a remote MCP server
claude mcp add --transport http ia-qa-eval https://www.ia-qa.com/mcp/evalOpik As a remote MCP server
claude mcp add --transport http opik-mcp https://www.comet.com/opik/api/v1/mcpRequires: OPIK_API_KEY (secret)
Commands built only from what the marketplaces declare; the full set for every client is on each card.
Only Opik has a remote endpoint we check. How we check endpoints
Tools each declares
The marketplaces of IA-QA Eval & RAG — 38 tools publish no list of tools, so we do not compare tools.
Settings each asks for
The marketplaces of IA-QA Eval & RAG — 38 tools publish no settings it asks for, so we do not compare settings.
What it can do: IA-QA Eval & RAG — 38 tools · What it can do: Opik · Compare two other plugins
Data comes from the Official MCP Registry (registry.modelcontextprotocol.io), CC0 1.0. Data comes from the Docker MCP Catalog (desktop.docker.com/mcp/catalog) and Docker Hub. Package data comes from the Python Package Index (pypi.org). Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.