llm-eval vs Opik
llm-eval is no longer listed on any marketplace we read: these are its last known data, as of 2026‑10‑18.
llm-eval is a plugin bundle for AI coding tools published by barnburner121. No marketplace we read lists it any more. Opik is an MCP server published by comet-ml. Marketplaces we read that list it: 3 (Official MCP Registry, Docker MCP Catalog, PyPI (MCP servers)). As of our marketplace pass on 2026-11-07. A plugin in this pair is no longer listed on any marketplace we read, so search engines are asked not to index the page.
Where each is published
| Marketplace |  Opik | |
|---|---|---|
| Community marketplace barnburner121/claude-plugin-marketplace | Removed on 2026-10-18 Version: 1.0.0 Forks (GitHub): 0 Stars (GitHub): 3 Not marked · First seen |
Not listed |
| Official MCP Registry | Not listed | Listed Version: 3.0.9 Downloads/month (PyPI): 3 591 Downloads/week (PyPI): 778 Forks (GitHub): 37 Stars (GitHub): 225 Not marked · First seen |
| Docker MCP Catalog | Not listed | Listed Version: sha256:0e0d7d33d5eb Forks (GitHub): 37 Pulls (Docker Hub): 17 337 Stars (Docker Hub): 1 Stars (GitHub): 225 Not marked · First seen |
| PyPI (MCP servers) | Not listed | Listed Version: 3.0.9 Downloads/month (PyPI): 3 591 Downloads/week (PyPI): 778 Forks (GitHub): 37 Stars (GitHub): 225 Not marked · First seen |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
The facts side by side
| Fact | llm-evalno longer listed · | Opik |
|---|---|---|
| Marketplaces that list it (differs) | 0 | 3 |
| Stars (GitHub) (differs) | 3 | 225 |
| Pulls (Docker Hub) (differs) | No figure on Docker Hub | 17 337 |
| Forks (GitHub) (differs) | 0 | 37 |
| Last release (differs) | Not published | 2026-11-07 |
| Where it runs (differs) | On your machine (@barnburner121/plugin-hub-mcp) | Remote server or your machine |
| Transport (differs) | Not stated | Streamable HTTP, stdio |
| Tools it declares (differs) | Not published | 13 |
| Environment variables it asks for (differs) | Not published | 4, secrets among them: 1 |
| Parts of the bundle (differs) | 2 | Not a bundle |
| Licence (differs) | MIT | Apache-2.0 |
| Repository (differs) | github.com/barnburner121/claude-plugin-marketplace | github.com/comet-ml/opik-mcp |
| Changes in the last 7 days (differs) | 0 | 2 |
| First seen (differs) | 2026-10-14 | 2026-10-11 |
| Endpoint at the last check (differs) | no remote endpoint we check | Status out of date: last check 46 h ago returned HTTP 401 |
Lines where the two differ have a tinted background and bold values. No value is marked better or worse: a plugin no marketplace lists any more is shown with its last known data, which we do not rank against current figures.
What to use instead of llm-eval
Plugins still listed whose own names, descriptions, tools and skills are closest in meaning to it. Comparable, not endorsed.
-
evaluation
LLM benchmarking and evaluation including lm-evaluation-harness, BigCode Evaluation Harness, and NeMo Evaluator. Use when benchmarking models or measuring performance.
-
Configures and runs LLM evaluation using Promptfoo framework. Use when setting up prompt testing, creating evaluation configs (promptfooconfig.yaml), writing Python custom…
-
Create fine-tuned LLM-as-a-judge evaluators on the Plurai platform
-
Compare text LLMs across OpenRouter, Bedrock, Vertex AI and Foundry with automated grading.
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Benchmark, evaluate, and optimize skills to ensure reliable performance across all LLMs
What each says it does
llm-eval
Generate LLM evaluation and benchmarking
Opik
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
How to run each
llm-eval
No data for an automatic command: what its marketplaces declare does not say unambiguously how to connect it.
Opik As a remote MCP server
claude mcp add --transport http opik-mcp https://www.comet.com/opik/api/v1/mcpRequires: OPIK_API_KEY (secret)
Commands built only from what the marketplaces declare; the full set for every client is on each card.
Only Opik has a remote endpoint we check. How we check endpoints
Tools each declares
The marketplaces of llm-eval publish no list of tools, so we do not compare tools.
Settings each asks for
The marketplaces of llm-eval publish no settings it asks for, so we do not compare settings.
What it can do: llm-eval · What it can do: Opik · Compare two other plugins
Data comes from public marketplace files in GitHub repositories of their authors. Data comes from the Official MCP Registry (registry.modelcontextprotocol.io), CC0 1.0. Data comes from the Docker MCP Catalog (desktop.docker.com/mcp/catalog) and Docker Hub. Package data comes from the Python Package Index (pypi.org). Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.