io.github.cyanheads/evals-mcp-server
Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.
Servidor MCP · de cyanheads
Resumen
io.github.cyanheads/evals-mcp-server es un servidor MCP publicado por cyanheads. Marketplaces que leemos y que lo publican: 1 (Official MCP Registry). Lo vimos por primera vez el 2026-10-11 y desde entonces no hemos registrado cambios. Según nuestra pasada por los marketplaces del 2026-10-13.
Qué pide
- Se ejecuta en tu equipo
- Ajustes: 10
Lo que declara, pide y ejecuta, completo
Instale solo plugins de desarrolladores en los que confíe. Mostramos lo que publican los marketplaces y no probamos plugins.
Paquete
npm @cyanheads/evals-mcp-server (@cyanheads/evals-mcp-server en npm)
- Descargas de npm por semana: 266 (2026-10-12)
- Descargas de npm por mes: 655 (2026-10-12)
- Última versión en npm: 0.1.5, publicada el 2026-10-07
- La versión declarada 0.1.5 no figura en npm
Los datos de npm proceden del registro público de npm (registry.npmjs.org, api.npmjs.org). Cada cifra es del propio registro y nunca se suma a otra. Un registro que no publica una cifra no muestra ninguna: sin cifra no es cero.
Funciona con
- Claude Code
- Codex
- Cursor
- VS Code
- Copilot CLI
Un enlace de un clic abre el cliente, que pide confirmación antes de añadir el servidor.
Según los marketplaces que lo listan y el transporte MCP que declara, tal como lo documenta cada cliente. No probamos plugins.
Conectar
Comandos y configuraciones generados solo a partir de lo que declaran sus marketplaces. No los ejecutamos por usted ni probamos plugins.
Como servidor MCP local: paquete npm
Generado a partir de lo que declara Official MCP Registry.
claude mcp add --transport stdio evals-mcp-server -- npx -y @cyanheads/evals-mcp-server[mcp_servers.evals-mcp-server]
command = "npx"
args = ["-y", "@cyanheads/evals-mcp-server"]{
"mcpServers": {
"evals-mcp-server": {
"command": "npx",
"args": [
"-y",
"@cyanheads/evals-mcp-server"
]
}
}
}Ajustes opcionales que también indica: EVALS_CAPTURE_DIR, EVALS_DATA_DIR, EVALS_DEFAULT_LICENSE, EVALS_REQUIRE_CONFIRMATION, MCP_AUTH_MODE, MCP_HTTP_ENDPOINT_PATH, MCP_HTTP_HOST, MCP_HTTP_PORT, MCP_LOG_LEVEL, MCP_TRANSPORT_TYPE.
Dónde está publicado
| Marketplace | Estado | Versión | Cifras | Verificado | Visto por primera vez |
|---|---|---|---|---|---|
| Official MCP Registry (Abrir el registro) | Publicado | 0.1.5 | Descargas por mes (npm): 655 Descargas por semana (npm): 266 Forks (GitHub): 0 Estrellas (GitHub): 1 |
Sin marca |
Cada cifra es del propio marketplace y nunca se suma entre marketplaces. Un marketplace que no publica cifras no muestra ninguna: sin número no es cero.
Qué cambió
Nada ha cambiado en este plugin desde que lo seguimos.
Plugins similares
Productos cuyos propios nombres, descripciones, herramientas y skills son los más cercanos a este por su significado, en todos los marketplaces que leemos. La cercanía se ordena solo dentro de esta lista.
-
mcp-eval-runner io.github.dbsectrainer/mcp-eval-runner
A standardized testing harness for MCP servers and agent workflows
-
LLM evals as MCP tools: score outputs for faithfulness, relevancy, and hallucination.
-
codegworkspace-mcp com.clauxel.codegworkspace/codegworkspace-mcp
A paid remote MCP for CodeG, built to return verdicts, receipts, usage logs, and audit-ready JSON.
-
futureagievals-mcp com.clauxel.futureagievals/futureagievals-mcp
A paid remote MCP for AI SDK eval dashboard, built to return verdicts, receipts, usage logs, and aud
-
server io.mcpskills/server
Trust scoring for MCP servers, AI skills & npm packages — 15 signals + safety scanning.
-
Git/CI MCP server with the full protocol surface (tools, resources, prompts, roots, sampling).
-
mcp io.github.DojoGenesis/mcp
Practice library for coding agents: skill search/invoke, seed patches, scout, reflect, ADR writer
-
Agentic code review, no signup to try: reality gates + frontier-model review, with veto.
-
rubrkit com.rubrkit/rubrkit
MCP-native AI evaluation: rubric audits, eval suites, and proof reports for AI/LLM output.
-
evalgate io.github.ipezygj/evalgate
Statistical checks an agent runs before trusting an AI eval number (is #1 real, judge bias, more).
Plugins similares por marketplace
La misma pregunta a cada marketplace por separado: ¿hay allí un equivalente de este plugin?
Publicado en Claude Code: claude-plugins-community (5)
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
Generate MCP server scaffold and tool implementation code from a natural language description. Describe what tools you want in plain language, choose TypeScript or Python, and get…
-
Convert MCP servers to token-efficient CLI tools with auto-generated SKILL.md files for Claude Code agents
-
mcp-server io.github.cap-js/mcp-server
Model Context Protocol (MCP) server for AI-assisted development of CAP applications.
-
vynn-mcp io.github.beee003/vynn-mcp
Self-improving AI workflows with backtesting, prompt optimization, and scheduling
Publicado en Claude Code: claude-plugins-official (5)
-
mcp-server io.github.cap-js/mcp-server
Model Context Protocol (MCP) server for AI-assisted development of CAP applications.
-
Skills for designing and building MCP servers that work seamlessly with Claude. Guides you through deployment models (remote HTTP, MCPB, local), tool design patterns, auth, and…
-
mdk-mcp-server io.github.SAP/mdk-mcp-server
Model Context Protocol (MCP) server for AI-assisted development of MDK applications.
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
firebase-mcp io.github.firebase/firebase-mcp
Gives AI development tools Firebase-specific capabilities and expertise.
Publicado en Claude: knowledge-work-plugins (5)
-
MCP server for terminal commands, file operations, and process management
-
Figma design platform integration. Access design files, extract component information, read design tokens, and translate designs into code. Bridge the gap between design and…
-
gk-cli com.gitkraken/gk-cli
The GitKraken MCP Server for managing repos, PRs, issues across GitHub, GitLab, Bitbucket and more.
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
Hosted MCP server for AI-assisted Grafana Cloud observability — no local installation required.
Publicado en Codex: openai-curated (openai/plugins) (5)
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…
-
Inspect repositories, triage pull requests and issues, debug CI, and publish changes through a hybrid GitHub connector and CLI workflow.
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
-
Cloudflare platform plugin with curated skills for Workers, Wrangler, and Agents SDK plus the official Cloudflare API MCP server.
Publicado en Community GitHub marketplaces (5)
-
4da-mcp-server io.github.4DA-Systems/4da-mcp-server
Upgrade intelligence for AI agents: what an upgrade changes, where it touches your code, CVE scans.
-
Self-hosted GitHub MCP server. PAT auth, stdio transport, transport-agnostic so it works with…
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
bettermemory io.github.0Mattias/bettermemory
Memory for coding agents, checked against the filesystem and git before it is believed.
-
inquisitor io.github.1111111111111111111114oLvT2/inquisitor
Hypothesis-driven problem solving for AI agents: probe, falsify, escalate.
Publicado en Copilot CLI: github/awesome-copilot (5)
-
Complete toolkit for building Model Context Protocol (MCP) servers in Kotlin using the official io.modelcontextprotocol:kotlin-sdk library. Includes instructions for best…
-
Complete toolkit for building Model Context Protocol (MCP) servers in Go using the official github.com/modelcontextprotocol/go-sdk. Includes instructions for best practices, a…
-
Complete toolkit for building Model Context Protocol (MCP) servers in TypeScript/Node.js using the official SDK. Includes instructions for best practices, a prompt for generating…
-
Safe BLE diagnostics, evidence workflows, and guarded automation for AI agents.
-
Figma design platform integration. Access design files, extract component information, read design tokens, and translate designs into code. Bridge the gap between design and…
Publicado en Copilot CLI: github/copilot-plugins (5)
-
mcp-apps
Generate MCP App widgets for MCP tools. Produces self-contained HTML widgets using the MCP Apps protocol.
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
Build Power Apps Canvas Apps using the Canvas Authoring MCP server.
-
Advanced Security plugin for GitHub Copilot.
-
Navigate and interact with your C++ code using the Microsoft C++ Language Server.
Publicado en Cursor: cursor/plugins (5)
-
Build apps, scripts, and automations with the TypeScript SDK.
-
Fan large tasks out across parallel cloud agents with planners, workers, verifiers, and structured handoffs.
-
CLI-backed repo compatibility scans plus agents that audit startup, validation, and docs against reality.
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Skills for building on the Cursor Origin API. Fetch the live spec first, then follow the Origin rules for credentials, scopes, webhooks, paging, and errors. Includes a skill that…
Publicado en Docker MCP Catalog (5)
-
testkube-mcp io.github.kubeshop/testkube-mcp
MCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants
-
Giving Claude ability to run code with E2B via MCP (Model Context Protocol).
-
Dynatrace-mcp io.github.dynatrace-oss/Dynatrace-mcp
[DEPRECATED] Dynatrace MCP Server. Migrate to dynatrace-for-ai or Dynatrace Remote MCP Server.
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Access to Rube's catalog of remote MCP servers.
Publicado en Official MCP Registry (5)
-
mcp-eval-runner io.github.dbsectrainer/mcp-eval-runner
A standardized testing harness for MCP servers and agent workflows
-
LLM evals as MCP tools: score outputs for faithfulness, relevancy, and hallucination.
-
codegworkspace-mcp com.clauxel.codegworkspace/codegworkspace-mcp
A paid remote MCP for CodeG, built to return verdicts, receipts, usage logs, and audit-ready JSON.
-
futureagievals-mcp com.clauxel.futureagievals/futureagievals-mcp
A paid remote MCP for AI SDK eval dashboard, built to return verdicts, receipts, usage logs, and aud
-
server io.mcpskills/server
Trust scoring for MCP servers, AI skills & npm packages — 15 signals + safety scanning.
Encontrados por significado, no por código ni repositorio compartidos: los plugins similares siguen siendo productos distintos, y esto no es una reseña ni una recomendación.
¿Es tu plugin?
Añádelo a tus proyectos y demuestra que lo mantienes con un archivo en su repositorio, un archivo en tu dominio o un registro DNS. Recibirás avisos cuando un marketplace lo publique, lo retire, cambie su marca verificada o lo que pide, y su endpoint remoto quedará monitorizado como un servicio web.
Datos de Official MCP Registry. Las cifras proceden de nuestros propios recorridos periódicos por los marketplaces, leída por última vez el . No publicamos datos de contacto de los editores de plugins.