io.github.cyanheads/evals-mcp-server
Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.
Servidor MCP · de cyanheads
Resumo
io.github.cyanheads/evals-mcp-server é um servidor MCP publicado por cyanheads. Marketplaces que lemos e que o listam: 1 (Official MCP Registry). A última mudança que registramos foi em 2026-10-13. Conforme nossa passagem pelos marketplaces em 2026-10-15.
O que pede
- Roda na sua máquina
- Configurações: 10
O que declara, pede e executa, por completo
Instale apenas plugins de desenvolvedores em quem você confia. Mostramos o que os marketplaces publicam e não testamos plugins.
Pacote
npm @cyanheads/evals-mcp-server (@cyanheads/evals-mcp-server no npm)
- Downloads do npm por semana: 266 (2026-10-12)
- Downloads do npm por mês: 655 (2026-10-12)
- Última versão no npm: 0.1.5, publicada em 2026-10-07
- A versão declarada 0.1.6 não consta no npm
Os dados do npm vêm do registro público do npm (registry.npmjs.org, api.npmjs.org). Cada número é do próprio registro e nunca é somado a outro. Um registro que não publica um número não mostra nenhum: sem número não é zero.
Funciona com
- Claude Code
- Codex
- Cursor
- VS Code
- Copilot CLI
Um link de um clique abre o cliente, que pede confirmação antes de adicionar o servidor.
Pelos marketplaces que o listam e pelo transporte MCP que declara, conforme cada cliente documenta. Não testamos plugins.
Conectar
Comandos e configurações gerados apenas a partir do que os marketplaces declaram. Não os executamos por você e não testamos plugins.
Como servidor MCP local: pacote npm
Gerado a partir do que Official MCP Registry declara.
claude mcp add --transport stdio evals-mcp-server -- npx -y @cyanheads/evals-mcp-server[mcp_servers.evals-mcp-server]
command = "npx"
args = ["-y", "@cyanheads/evals-mcp-server"]{
"mcpServers": {
"evals-mcp-server": {
"command": "npx",
"args": [
"-y",
"@cyanheads/evals-mcp-server"
]
}
}
}Configurações opcionais que também indica: EVALS_CAPTURE_DIR, EVALS_DATA_DIR, EVALS_DEFAULT_LICENSE, EVALS_REQUIRE_CONFIRMATION, MCP_AUTH_MODE, MCP_HTTP_ENDPOINT_PATH, MCP_HTTP_HOST, MCP_HTTP_PORT, MCP_LOG_LEVEL, MCP_TRANSPORT_TYPE.
Onde está publicado
| Marketplace | Status | Versão | Números | Verificado | Visto pela primeira vez |
|---|---|---|---|---|---|
| Official MCP Registry (Abrir o registro) | Listado | 0.1.6 | Downloads por mês (npm): 655 Downloads por semana (npm): 266 Forks (GitHub): 0 Estrelas (GitHub): 1 |
Sem marcação |
Cada número é do próprio marketplace e nunca é somado entre marketplaces. Um marketplace que não publica números não mostra nenhum: sem número não é zero.
O que mudou
- Official MCP Registry: lançou a versão 0.1.6 (antes 0.1.5)
Plugins semelhantes
Produtos cujos próprios nomes, descrições, ferramentas e skills são os mais próximos deste pelo significado, em todos os marketplaces que lemos. A proximidade é ordenada apenas dentro desta lista.
-
mcp-eval-runner io.github.dbsectrainer/mcp-eval-runner
A standardized testing harness for MCP servers and agent workflows
-
LLM evals as MCP tools: score outputs for faithfulness, relevancy, and hallucination.
-
codegworkspace-mcp com.clauxel.codegworkspace/codegworkspace-mcp
A paid remote MCP for CodeG, built to return verdicts, receipts, usage logs, and audit-ready JSON.
-
futureagievals-mcp com.clauxel.futureagievals/futureagievals-mcp
A paid remote MCP for AI SDK eval dashboard, built to return verdicts, receipts, usage logs, and aud
-
server io.mcpskills/server
Trust scoring for MCP servers, AI skills & npm packages — 15 signals + safety scanning.
-
Git/CI MCP server with the full protocol surface (tools, resources, prompts, roots, sampling).
-
mcp io.github.DojoGenesis/mcp
Practice library for coding agents: skill search/invoke, seed patches, scout, reflect, ADR writer
-
Agentic code review, no signup to try: reality gates + frontier-model review, with veto.
-
rubrkit com.rubrkit/rubrkit
MCP-native AI evaluation: rubric audits, eval suites, and proof reports for AI/LLM output.
-
evalgate io.github.ipezygj/evalgate
Statistical checks an agent runs before trusting an AI eval number (is #1 real, judge bias, more).
Plugins semelhantes por marketplace
A mesma pergunta feita a cada marketplace separadamente: existe lá um equivalente deste plugin?
Listado em Claude Code: claude-plugins-community (5)
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
Generate MCP server scaffold and tool implementation code from a natural language description. Describe what tools you want in plain language, choose TypeScript or Python, and get…
-
Convert MCP servers to token-efficient CLI tools with auto-generated SKILL.md files for Claude Code agents
-
mcp-server io.github.cap-js/mcp-server
Model Context Protocol (MCP) server for AI-assisted development of CAP applications.
-
vynn-mcp io.github.beee003/vynn-mcp
Self-improving AI workflows with backtesting, prompt optimization, and scheduling
Listado em Claude Code: claude-plugins-official (5)
-
mcp-server io.github.cap-js/mcp-server
Model Context Protocol (MCP) server for AI-assisted development of CAP applications.
-
Skills for designing and building MCP servers that work seamlessly with Claude. Guides you through deployment models (remote HTTP, MCPB, local), tool design patterns, auth, and…
-
mdk-mcp-server io.github.SAP/mdk-mcp-server
Model Context Protocol (MCP) server for AI-assisted development of MDK applications.
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
firebase-mcp io.github.firebase/firebase-mcp
Gives AI development tools Firebase-specific capabilities and expertise.
Listado em Claude: knowledge-work-plugins (5)
-
MCP server for terminal commands, file operations, and process management
-
Figma design platform integration. Access design files, extract component information, read design tokens, and translate designs into code. Bridge the gap between design and…
-
gk-cli com.gitkraken/gk-cli
The GitKraken MCP Server for managing repos, PRs, issues across GitHub, GitLab, Bitbucket and more.
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
Hosted MCP server for AI-assisted Grafana Cloud observability — no local installation required.
Listado em Codex: openai-curated (openai/plugins) (5)
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…
-
Inspect repositories, triage pull requests and issues, debug CI, and publish changes through a hybrid GitHub connector and CLI workflow.
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
-
Cloudflare platform plugin with curated skills for Workers, Wrangler, and Agents SDK plus the official Cloudflare API MCP server.
Listado em Community GitHub marketplaces (5)
-
4da-mcp-server io.github.4DA-Systems/4da-mcp-server
Upgrade intelligence for AI agents: what an upgrade changes, where it touches your code, CVE scans.
-
Self-hosted GitHub MCP server. PAT auth, stdio transport, transport-agnostic so it works with…
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
bettermemory io.github.0Mattias/bettermemory
Memory for coding agents, checked against the filesystem and git before it is believed.
-
inquisitor io.github.1111111111111111111114oLvT2/inquisitor
Hypothesis-driven problem solving for AI agents: probe, falsify, escalate.
Listado em Copilot CLI: github/awesome-copilot (5)
-
Complete toolkit for building Model Context Protocol (MCP) servers in Kotlin using the official io.modelcontextprotocol:kotlin-sdk library. Includes instructions for best…
-
Complete toolkit for building Model Context Protocol (MCP) servers in Go using the official github.com/modelcontextprotocol/go-sdk. Includes instructions for best practices, a…
-
Complete toolkit for building Model Context Protocol (MCP) servers in TypeScript/Node.js using the official SDK. Includes instructions for best practices, a prompt for generating…
-
Safe BLE diagnostics, evidence workflows, and guarded automation for AI agents.
-
Figma design platform integration. Access design files, extract component information, read design tokens, and translate designs into code. Bridge the gap between design and…
Listado em Copilot CLI: github/copilot-plugins (5)
-
mcp-apps
Generate MCP App widgets for MCP tools. Produces self-contained HTML widgets using the MCP Apps protocol.
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
Build Power Apps Canvas Apps using the Canvas Authoring MCP server.
-
Advanced Security plugin for GitHub Copilot.
-
Navigate and interact with your C++ code using the Microsoft C++ Language Server.
Listado em Cursor: cursor/plugins (5)
-
Build apps, scripts, and automations with the TypeScript SDK.
-
Fan large tasks out across parallel cloud agents with planners, workers, verifiers, and structured handoffs.
-
CLI-backed repo compatibility scans plus agents that audit startup, validation, and docs against reality.
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Skills for building on the Cursor Origin API. Fetch the live spec first, then follow the Origin rules for credentials, scopes, webhooks, paging, and errors. Includes a skill that…
Listado em Docker MCP Catalog (5)
-
testkube-mcp io.github.kubeshop/testkube-mcp
MCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants
-
Giving Claude ability to run code with E2B via MCP (Model Context Protocol).
-
Dynatrace-mcp io.github.dynatrace-oss/Dynatrace-mcp
[DEPRECATED] Dynatrace MCP Server. Migrate to dynatrace-for-ai or Dynatrace Remote MCP Server.
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Access to Rube's catalog of remote MCP servers.
Listado em Official MCP Registry (5)
-
mcp-eval-runner io.github.dbsectrainer/mcp-eval-runner
A standardized testing harness for MCP servers and agent workflows
-
LLM evals as MCP tools: score outputs for faithfulness, relevancy, and hallucination.
-
codegworkspace-mcp com.clauxel.codegworkspace/codegworkspace-mcp
A paid remote MCP for CodeG, built to return verdicts, receipts, usage logs, and audit-ready JSON.
-
futureagievals-mcp com.clauxel.futureagievals/futureagievals-mcp
A paid remote MCP for AI SDK eval dashboard, built to return verdicts, receipts, usage logs, and aud
-
server io.mcpskills/server
Trust scoring for MCP servers, AI skills & npm packages — 15 signals + safety scanning.
Encontrados pelo significado, não por código ou repositório em comum: plugins semelhantes continuam sendo produtos distintos, e isto não é uma avaliação nem uma recomendação.
Quer esta marca no seu plugin em nosso catálogo?
Prove que o mantém com um arquivo no repositório, um arquivo no seu domínio ou um registro DNS, e você poderá mostrar esta marca na ficha, com banners ao vivo para o seu site e o README. Como funciona a verificação
Você também recebe alertas quando um marketplace o publica, o remove, muda a marca de verificado ou o que ele pede, e o endpoint remoto passa a ser monitorado como um serviço web.
Dados de Official MCP Registry. Os números vêm das nossas próprias passagens regulares pelos marketplaces, última leitura em . Não publicamos dados de contato dos editores de plugins.