retriEVAL
LLM evals as MCP tools: score outputs for faithfulness, relevancy, and hallucination.
Servidor MCP · de hcarrillo001
Resumen
retriEVAL es un servidor MCP publicado por hcarrillo001. Marketplaces que leemos y que lo publican: 1 (Official MCP Registry). Lo vimos por primera vez el 2026-10-11 y desde entonces no hemos registrado cambios. Según nuestra pasada por los marketplaces del 2026-10-14.
Qué pide
- Se ejecuta en tu equipo
- Secretos: 1
- Ajustes: 4
Requiere: ANTHROPIC_API_KEY (secreta)
Lo que declara, pide y ejecuta, completo
Instale solo plugins de desarrolladores en los que confíe. Mostramos lo que publican los marketplaces y no probamos plugins.
Funciona con
- Claude Code
- Codex
- Cursor
- VS Code
- Copilot CLI
Según los marketplaces que lo listan y el transporte MCP que declara, tal como lo documenta cada cliente. No probamos plugins.
Conectar
Comandos y configuraciones generados solo a partir de lo que declaran sus marketplaces. No los ejecutamos por usted ni probamos plugins.
Como servidor MCP local: imagen de Docker
Generado a partir de lo que declara Official MCP Registry.
claude mcp add --env "ANTHROPIC_API_KEY=<YOUR_ANTHROPIC_API_KEY>" --transport stdio retrieval-mcp -- docker run -i --rm -e ANTHROPIC_API_KEY ghcr.io/hcarrillo001/retrieval-mcp:1.0.0
[mcp_servers.retrieval-mcp]
command = "docker"
args = ["run", "-i", "--rm", "-e", "ANTHROPIC_API_KEY", "ghcr.io/hcarrillo001/retrieval-mcp:1.0.0"]
[mcp_servers.retrieval-mcp.env]
ANTHROPIC_API_KEY = "<YOUR_ANTHROPIC_API_KEY>"
{
"mcpServers": {
"retrieval-mcp": {
"command": "docker",
"args": [
"run",
"-i",
"--rm",
"-e",
"ANTHROPIC_API_KEY",
"ghcr.io/hcarrillo001/retrieval-mcp:1.0.0"
],
"env": {
"ANTHROPIC_API_KEY": "<YOUR_ANTHROPIC_API_KEY>"
}
}
}
}
docker run -i --rm -e "ANTHROPIC_API_KEY=<YOUR_ANTHROPIC_API_KEY>" ghcr.io/hcarrillo001/retrieval-mcp:1.0.0
Sustituya los valores entre corchetes angulares por los suyos. Mostramos los nombres de los ajustes, nunca valores.
Ajustes opcionales que también indica: RETRIEVAL_BUDGET_USD, RETRIEVAL_JUDGE_BACKEND, RETRIEVAL_JUDGE_MODEL.
Dónde está publicado
| Marketplace | Estado | Versión | Cifras | Verificado | Visto por primera vez |
|---|---|---|---|---|---|
| Official MCP Registry (Abrir el registro) | Publicado | 1.0.0 | Forks (GitHub): 0 Estrellas (GitHub): 0 |
Sin marca |
Cada cifra es del propio marketplace y nunca se suma entre marketplaces. Un marketplace que no publica cifras no muestra ninguna: sin número no es cero.
Qué cambió
Nada ha cambiado en este plugin desde que lo seguimos.
Plugins similares
Productos cuyos propios nombres, descripciones, herramientas y skills son los más cercanos a este por su significado, en todos los marketplaces que leemos. La cercanía se ordena solo dentro de esta lista.
-
mcp io.github.LanceRoylo/mcp
AEO scoring, llms.txt audit, and agent-readiness checks for AI agents.
-
mcp io.scorecard/mcp
MCP server providing access to the Scorecard API to evaluate and optimize LLM systems.
-
Stop shipping agents on vibes — agent eval for any MCP workflow. Score output quality, catch PII and prompt injection, verify citations, and enforce cost budgets. 12 MCP tools +…
-
hone io.github.derekchoyai/hone
Score your judgment over AI-assisted work. Hone scores you, not the model.
-
Pay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.
-
agent-services-mcp io.github.Gareth1953/agent-services-mcp
MCP server: x402-paid & free tools for AI agents — provenance, quality scoring, action audit.
-
llm-output-quality-monitor io.github.lazymac2x/llm-output-quality-monitor
Cloudflare Workers MCP server: llm-output-quality-monitor
-
Prompt evals over MCP: run a prompt on your dataset, score each output 1-5 with an LLM judge.
-
Ask free LLMs (DeepSeek, GLM, Gemini, Mistral) for a second opinion from any MCP client.
-
perf-mcp io.github.Perf-AI/perf-mcp
Fact-check and fix AI outputs. Hallucination detection, schema validation, auto-repair.
Plugins similares por marketplace
La misma pregunta a cada marketplace por separado: ¿hay allí un equivalente de este plugin?
Publicado en Claude Code: claude-plugins-community (5)
-
Stop shipping agents on vibes. Score every agent output for quality, safety, and cost.
-
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
Context engineering plugin for Claude Code — real-time prompt scoring, RLM adaptive weights, and token optimization. Scores every tool use across 5 dimensions (token utilization…
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
Publicado en Claude Code: claude-plugins-official (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
Skills for tracing, evaluating, and improving AI agents with MLflow. Supports the full agent improvement loop: instrument → trace → evaluate → iterate → validate.
-
Figma design platform integration. Access design files, extract component information, read design tokens, and translate designs into code. Bridge the gap between design and…
-
Langfuse observability plugin for Claude Code — captures and exports traces, spans, and session telemetry from Claude Code to Langfuse for LLM monitoring, debugging, and evaluation
Publicado en Claude: knowledge-work-plugins (5)
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
Figma design platform integration. Access design files, extract component information, read design tokens, and translate designs into code. Bridge the gap between design and…
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
Connects Claude Code to the Synthflow AI voice-agent platform through its hosted MCP server, with skills for reviewing calls and auditing agent prompts, plus a docs-search…
-
Hosted MCP server for AI-assisted Grafana Cloud observability — no local installation required.
Publicado en Codex: openai-curated (openai/plugins) (5)
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
-
Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…
-
Available for US1 customers only. Analyze, investigate, and act on your Datadog telemetry directly from ChatGPT using natural language. Ask questions about your production…
-
Answer product and business questions with data
Publicado en Community GitHub marketplaces (5)
-
Stop shipping agents on vibes — agent eval for any MCP workflow. Score output quality, catch PII and prompt injection, verify citations, and enforce cost budgets. 12 MCP tools +…
-
ai-architect-mcp-spec io.github.cdeust/ai-architect-mcp-spec
PRD verification and host-driven generation with multi-judge consensus across 17 MCP tools.
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Generate LLM evaluation and benchmarking
-
The judgement layer for reading an LLM eval result, and an MCP server that measures, reads and explains — and cannot promote a baseline, because approval is a person's commit…
Publicado en Copilot CLI: github/awesome-copilot (5)
-
Three-layer verification pipeline for AI output. Extracts claims, finds sources, and flags hallucination risks so humans can verify before acting.
-
A runtime-portable 5-agent quality gate that adjudicates text artifacts before they ship. Five role-conditioned LLM deliberators run a 2-round async protocol with cross-read…
-
Safe BLE diagnostics, evidence workflows, and guarded automation for AI agents.
-
Figma design platform integration. Access design files, extract component information, read design tokens, and translate designs into code. Bridge the gap between design and…
-
Run a lightweight, role-separated AI development team with flexible tools, developer-selected models, proportionate planning, and optional QA.
Publicado en Copilot CLI: github/copilot-plugins (5)
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
mcp-apps
Generate MCP App widgets for MCP tools. Produces self-contained HTML widgets using the MCP Apps protocol.
-
workiq
Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.
-
workiq-productivity
WorkIQ productivity skills powered by the local WorkIQ CLI — read-only insights across email, meetings, calendar, Teams, SharePoint, projects, and people.
-
model-apps
Build and deploy Power Apps generative pages for model-driven apps with specialist agents for planning, entity creation, and parallel code generation. Requires PAC CLI >= 2.7.0…
Publicado en Cursor: cursor/plugins (5)
-
Incremental transcript-driven memory updates for AGENTS.md using high-signal bullet points only.
-
Iterative self-referential AI loops using the Ralph Wiggum technique.
-
Track AI visibility, sentiment, and citations.
-
Consult a stronger model before major decisions, when stuck, and before declaring done.
-
Search company knowledge and draft verified answers.
Publicado en Docker MCP Catalog (5)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
The Official Model Context Protocol (MCP) server for Kagi Search & other tools.
-
Discover and connect to a curated marketplace of MCP servers for extending AI agent capabilities.
-
Wayfound’s MCP server allows business users to govern, supervise, and improve AI Agents.
-
MCP server providing Prometheus metrics access and PromQL query execution for AI assistants
Publicado en Official MCP Registry (5)
-
mcp io.github.LanceRoylo/mcp
AEO scoring, llms.txt audit, and agent-readiness checks for AI agents.
-
mcp io.scorecard/mcp
MCP server providing access to the Scorecard API to evaluate and optimize LLM systems.
-
hone io.github.derekchoyai/hone
Score your judgment over AI-assisted work. Hone scores you, not the model.
-
Pay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.
-
agent-services-mcp io.github.Gareth1953/agent-services-mcp
MCP server: x402-paid & free tools for AI agents — provenance, quality scoring, action audit.
Encontrados por significado, no por código ni repositorio compartidos: los plugins similares siguen siendo productos distintos, y esto no es una reseña ni una recomendación.
¿Es tu plugin?
Añádelo a tus proyectos y demuestra que lo mantienes con un archivo en su repositorio, un archivo en tu dominio o un registro DNS. Recibirás avisos cuando un marketplace lo publique, lo retire, cambie su marca verificada o lo que pide, y su endpoint remoto quedará monitorizado como un servicio web.
Datos de Official MCP Registry. Las cifras proceden de nuestros propios recorridos periódicos por los marketplaces, leída por última vez el . No publicamos datos de contacto de los editores de plugins.