io.github.ipezygj/evalgate
Statistical checks an agent runs before trusting an AI eval number (is #1 real, judge bias, more).
Servidor MCP · de ipezygj
Resumo
io.github.ipezygj/evalgate é um servidor MCP publicado por ipezygj. Marketplaces que lemos e que o listam: 1 (Official MCP Registry). Vimos pela primeira vez em 2026-10-11 e não registramos mudanças desde então. Conforme nossa passagem pelos marketplaces em 2026-10-13.
O que pede
- Roda na sua máquina
Nenhum dos marketplaces que lemos publica as ferramentas ou as configurações que ele pede.
O que declara, pede e executa, por completo
Instale apenas plugins de desenvolvedores em quem você confia. Mostramos o que os marketplaces publicam e não testamos plugins.
Pacote
PyPI eval-integrity (eval-integrity no PyPI)
- Não encontrado no PyPI na última verificação (2026-10-13)
Os dados do PyPI vêm do pypi.org e os downloads do PyPI do pypistats.org. Cada número é do próprio registro e nunca é somado a outro. Um registro que não publica um número não mostra nenhum: sem número não é zero.
Funciona com
- Claude Code
- Codex
- Cursor
- VS Code
- Copilot CLI
Um link de um clique abre o cliente, que pede confirmação antes de adicionar o servidor.
Pelos marketplaces que o listam e pelo transporte MCP que declara, conforme cada cliente documenta. Não testamos plugins.
Conectar
Comandos e configurações gerados apenas a partir do que os marketplaces declaram. Não os executamos por você e não testamos plugins.
Como servidor MCP local: pacote PyPI
Gerado a partir do que Official MCP Registry declara.
claude mcp add --transport stdio evalgate -- uvx eval-integrity[mcp_servers.evalgate]
command = "uvx"
args = ["eval-integrity"]{
"mcpServers": {
"evalgate": {
"command": "uvx",
"args": [
"eval-integrity"
]
}
}
}Onde está publicado
| Marketplace | Status | Versão | Números | Verificado | Visto pela primeira vez |
|---|---|---|---|---|---|
| Official MCP Registry (Abrir o registro) | Listado | 0.4.1 | Nenhum número publicado | Sem marcação |
Cada número é do próprio marketplace e nunca é somado entre marketplaces. Um marketplace que não publica números não mostra nenhum: sem número não é zero.
O que mudou
Nada mudou neste plugin desde que começamos a acompanhá-lo.
Plugins semelhantes
Produtos cujos próprios nomes, descrições, ferramentas e skills são os mais próximos deste pelo significado, em todos os marketplaces que lemos. A proximidade é ordenada apenas dentro desta lista.
-
Quality verification for AI agents and MCP servers. 6-axis scoring, adversarial probes.
-
veridict io.github.xkumakichi/veridict
Know if you can trust your MCP server. Trust judgment for AI agents.
-
agent-trust io.github.Garl-Protocol/agent-trust
Tamper-evident action receipts, trust scoring & capability tokens for AI agents. 29 MCP tools.
-
mcp io.github.LanceRoylo/mcp
AEO scoring, llms.txt audit, and agent-readiness checks for AI agents.
-
futureagievals-mcp com.clauxel.futureagievals/futureagievals-mcp
A paid remote MCP for AI SDK eval dashboard, built to return verdicts, receipts, usage logs, and aud
-
Evaluate, benchmark, and simulate AI agents on the VerifyAX agent-evaluation platform.
-
qc-validator io.github.mdfifty50-boop/qc-validator
Output quality control and validation for AI agents
-
agent-services-mcp io.github.Gareth1953/agent-services-mcp
MCP server: x402-paid & free tools for AI agents — provenance, quality scoring, action audit.
-
Trust scoring for AI agents. Check scores, fidelity, and flags for x402 services.
-
trustmodel-mcp io.github.karlmehta/trustmodel-mcp
Score any AI for trust across 10 dimensions; evaluate, monitor & govern LLMs and agents.
Plugins semelhantes por marketplace
A mesma pergunta feita a cada marketplace separadamente: existe lá um equivalente deste plugin?
Listado em Claude Code: claude-plugins-community (5)
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…
-
deepmiro io.github.kakarot-dev/deepmiro
Simulate hundreds of AI agents to predict how communities react to events and policies
-
Stop shipping agents on vibes. Score every agent output for quality, safety, and cost.
-
Skills to streamline adoption and usage of Giskard products (OSS, Hub, Guards) for testing, evaluating, and red-teaming AI agents.
Listado em Claude Code: claude-plugins-official (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
Skills for tracing, evaluating, and improving AI agents with MLflow. Supports the full agent improvement loop: instrument → trace → evaluate → iterate → validate.
-
firebase-mcp io.github.firebase/firebase-mcp
Gives AI development tools Firebase-specific capabilities and expertise.
-
Detect AI agents in your codebase and instrument them with Pendo Agent Analytics via the best-fit path: Python SDK, TypeScript SDK, client-side trackAgent, or the Conversations…
Listado em Claude: knowledge-work-plugins (5)
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
AI-first project auditor and re-engineer based on the 9 design principles and 7 design patterns from the TechWolf AI-First Bootcamp
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
A suite of agent skills for the full GrowthBook feature flag and experimentation lifecycle.
-
Connects Claude Code to the Synthflow AI voice-agent platform through its hosted MCP server, with skills for reviewing calls and auditing agent prompts, plus a docs-search…
Listado em Codex: openai-curated (openai/plugins) (5)
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
-
Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…
-
CrowdStrike Falcon Foundry development skills for building cybersecurity applications on the Falcon platform. Includes UI development, collections, functions, workflows, API…
-
Available for US1 customers only. Analyze, investigate, and act on your Datadog telemetry directly from ChatGPT using natural language. Ask questions about your production…
Listado em Community GitHub marketplaces (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
4da-mcp-server io.github.4DA-Systems/4da-mcp-server
Upgrade intelligence for AI agents: what an upgrade changes, where it touches your code, CVE scans.
-
inquisitor io.github.1111111111111111111114oLvT2/inquisitor
Hypothesis-driven problem solving for AI agents: probe, falsify, escalate.
-
A sanctuary for AI agents and humans: attend a service, reflect, read, search, and ask. No auth.
-
Endor Labs AI Plugins (Legacy)
Legacy Claude Code plugin id for Endor Labs Agent Kit workflows.
Listado em Copilot CLI: github/awesome-copilot (5)
-
A runtime-portable 5-agent quality gate that adjudicates text artifacts before they ship. Five role-conditioned LLM deliberators run a 2-round async protocol with cross-read…
-
Three-layer verification pipeline for AI output. Extracts claims, finds sources, and flags hallucination risks so humans can verify before acting.
-
Safe BLE diagnostics, evidence workflows, and guarded automation for AI agents.
-
Visualizes live session AI-credit usage as a Pac-Man board with pellets, ghosts, fruit milestones, and game-over limits.
-
Run a lightweight, role-separated AI development team with flexible tools, developer-selected models, proportionate planning, and optional QA.
Listado em Copilot CLI: github/copilot-plugins (5)
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
Advanced Security plugin for GitHub Copilot.
-
model-apps
Build and deploy Power Apps generative pages for model-driven apps with specialist agents for planning, entity creation, and parallel code generation. Requires PAC CLI >= 2.7.0…
-
Bring Azure DevOps work-item, repository, and pull-request workflows into GitHub Copilot.
-
workiq
Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.
Listado em Cursor: cursor/plugins (5)
-
CLI-backed repo compatibility scans plus agents that audit startup, validation, and docs against reality.
-
Track AI visibility, sentiment, and citations.
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Inspect and manage feature gates, experiments, dynamic configs, and metrics.
-
Iterative self-referential AI loops using the Ralph Wiggum technique.
Listado em Docker MCP Catalog (5)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Wayfound’s MCP server allows business users to govern, supervise, and improve AI Agents.
-
Discover and connect to a curated marketplace of MCP servers for extending AI agent capabilities.
-
The Official Model Context Protocol (MCP) server for Kagi Search & other tools.
-
MCP server providing Prometheus metrics access and PromQL query execution for AI assistants
Listado em Official MCP Registry (5)
-
Quality verification for AI agents and MCP servers. 6-axis scoring, adversarial probes.
-
veridict io.github.xkumakichi/veridict
Know if you can trust your MCP server. Trust judgment for AI agents.
-
agent-trust io.github.Garl-Protocol/agent-trust
Tamper-evident action receipts, trust scoring & capability tokens for AI agents. 29 MCP tools.
-
mcp io.github.LanceRoylo/mcp
AEO scoring, llms.txt audit, and agent-readiness checks for AI agents.
-
futureagievals-mcp com.clauxel.futureagievals/futureagievals-mcp
A paid remote MCP for AI SDK eval dashboard, built to return verdicts, receipts, usage logs, and aud
Encontrados pelo significado, não por código ou repositório em comum: plugins semelhantes continuam sendo produtos distintos, e isto não é uma avaliação nem uma recomendação.
Este plugin é seu?
Adicione-o aos seus projetos e prove que o mantém com um arquivo no repositório, um arquivo no seu domínio ou um registro DNS. Você recebe alertas quando um marketplace o publica, o remove, muda a marca de verificado ou o que ele pede, e o endpoint remoto passa a ser monitorado como um serviço web.
Dados de Official MCP Registry. Os números vêm das nossas próprias passagens regulares pelos marketplaces, última leitura em . Não publicamos dados de contato dos editores de plugins.