Ext Ops Panel
Abrir el panel

ML Referee

Evaluate ML features beyond a baseline and test bounded feature repairs. Invite-only beta.

Servidor MCP · de scarrico

Resumen

ML Referee es un servidor MCP publicado por scarrico. Marketplaces que leemos y que lo publican: 1 (Official MCP Registry). Lo vimos por primera vez el 2026-10-27 y desde entonces no hemos registrado cambios. Según nuestra pasada por los marketplaces del 2026-11-03.

Qué pide

  • Se ejecuta en remoto

Ninguno de los marketplaces que leemos publica sus herramientas ni los ajustes que pide.

Lo que declara, pide y ejecuta, completo

Instala solo plugins de desarrolladores en los que confíes. Mostramos lo que publican los marketplaces y no probamos plugins.

Funciona con

  • Claude Code
  • Codex
  • Cursor
  • VS Code
  • Copilot CLI

Un enlace de un clic abre el cliente, que pide confirmación antes de añadir el servidor.

Según los marketplaces que lo listan y el transporte MCP que declara, tal como lo documenta cada cliente. No probamos plugins.

Conectar

Comandos y configuraciones generados solo a partir de lo que declaran sus marketplaces. No los ejecutamos por ti ni probamos plugins.

Como servidor MCP remoto

Generado a partir de lo que declara Official MCP Registry.

Claude CodeTerminal
claude mcp add --transport http mlreferee https://api.mlreferee.com/mcp
Codex~/.codex/config.toml
[mcp_servers.mlreferee]
url = "https://api.mlreferee.com/mcp"
Cursor~/.cursor/mcp.json
{
  "mcpServers": {
    "mlreferee": {
      "url": "https://api.mlreferee.com/mcp"
    }
  }
}

Dónde está publicado

MarketplaceEstadoVersiónCifrasVerificadoVisto por primera vez
Official MCP Registry (Abrir el registro) Publicado 1.1.0 Sin cifra publicada Sin marca

Cada cifra es del propio marketplace y nunca se suma entre marketplaces. Un marketplace que no publica cifras no muestra ninguna: sin número no es cero.

Qué cambió

  1. Pasó a ser un producto que seguimos
  2. Official MCP Registry: apareció

Plugins similares

Productos cuyos propios nombres, descripciones, herramientas y skills son los más cercanos a este por su significado, en todos los marketplaces que leemos. La cercanía se ordena solo dentro de esta lista.

  • good-sport

    Sports-analytics research assistant that grades its own model and reports the losses. $9.99/mo.

    de good-sport.ai · Servidor MCP

    Publicado en: Official MCP Registry · Describe casi la misma tarea

  • AI Arena Agent Tools

    Read-only US public-data screening tools with free Basic and Evidence tiers.

    de ai-arena.ca · Servidor MCP

    Publicado en: Official MCP Registry · Describe casi la misma tarea

  • Batru — Competitive Game Intelligence for AI Agents

    Live competitive-game predictions, meta data and decision tools for AI agents.

    de batru.gg · Servidor MCP

    Publicado en: Official MCP Registry · Describe casi la misma tarea

  • RaceHooks

    Predictive models and analytics for motorsport — race intelligence delivered to your endpoint.

    de racehooks · Servidor MCP

    Publicado en: Official MCP Registry · Describe casi la misma tarea

  • mcp-server-lol io.github.ebrunet001/mcp-server-lol

    League of Legends AI coaching: player profiles, match history, ranked stats & performance analysis

    de ebrunet001 · Servidor MCP

    Publicado en: Official MCP Registry · Describe casi la misma tarea

  • AI Stupid Level

    LLM benchmark rankings, drift status, incidents and Smart Router previews from AI Stupid Level.

    de StudioPlatforms · Servidor MCP

    Publicado en: Official MCP Registry · Describe casi la misma tarea

  • Agent Referee

    Neutral tie-breaks between AI agents and sealed review of an agent's output, with signed receipts.

    de ccheez34 · Servidor MCP

    Publicado en: Official MCP Registry · Describe casi la misma tarea

  • The Ultimate Critic

    Check AI work against requirements and return structured verdicts, findings, and repair steps.

    de marksignals · Servidor MCP

    Publicado en: Official MCP Registry · Describe casi la misma tarea

  • Ask Jev

    Evaluate state with typed choice, score, and probability questions.

    de pollinations · Servidor MCP

    Publicado en: Official MCP Registry · Describe casi la misma tarea

  • Cue

    Score and improve AI prompts with Cue Free and Pro account access.

    de KingMonkey1 · Servidor MCP

    Publicado en: Official MCP Registry · Describe casi la misma tarea

Plugins similares por marketplace

La misma pregunta a cada marketplace por separado: ¿hay allí un equivalente de este plugin?

Publicado en Claude Code: claude-plugins-community (5)
  • memoriant-eval-sandbox-skill

    AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…

    de NathanMaine · Paquete de plugins

    Publicado en: Claude Code: claude-plugins-community · Describe casi la misma tarea

  • contextstellar

    Context engineering plugin for Claude Code — real-time prompt scoring, RLM adaptive weights, and token optimization. Scores every tool use across 5 dimensions (token utilization…

    de sunnypatneedi · Paquete de plugins

    Publicado en: Claude Code: claude-plugins-community · Describe casi la misma tarea

  • grainulator

    Research sprint orchestrator for Claude Code. Ask a question, get a decision-ready brief — every finding is tracked as a typed claim, adversarially challenged, confidence-graded…

    de grainulation · Paquete de plugins

    Publicado en: Claude Code: claude-plugins-community, Community GitHub marketplaces · Describe casi la misma tarea

  • datarobot-agent-skills

    DataRobot Agent Skills - Agentic skills for DataRobot enterprise AI and ML workflows. Covers model training, deployment, predictions, feature engineering, monitoring…

    de datarobot-oss · Paquete de plugins

    Publicado en: Claude Code: claude-plugins-community · Describe casi la misma tarea

  • accelbyte-ai-plugins

    Public AI coding agents, skills, and MCP servers for AccelByte.

    de AccelByte · Paquete de plugins

    Publicado en: Claude Code: claude-plugins-community · Describe casi la misma tarea

Publicado en Claude Code: claude-plugins-official (5)
  • DeepEval

    Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.

    de confident-ai · Paquete de plugins

    Publicado en: Claude Code: claude-plugins-official, Community GitHub marketplaces · Describe casi la misma tarea

  • langfuse

    Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.

    de langfuse · Paquete de plugins

    Publicado en: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Claude Code: claude-plugins-community · Describe casi la misma tarea

  • datarobot-agent-skills

    DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…

    de datarobot-oss · Paquete de plugins

    Publicado en: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Community GitHub marketplaces · Describe casi la misma tarea

  • NVIDIA Skills

    Find the right NVIDIA skill for GPU acceleration, CUDA, AI agents, data loading, training, inference, robotics, Physical AI, Omniverse, simulation, and other NVIDIA-powered…

    de NVIDIA · Paquete de plugins

    Publicado en: Claude Code: claude-plugins-official, Claude Code: claude-plugins-community, Community GitHub marketplaces · Describe casi la misma tarea

  • MLflow Skills

    Skills for tracing, evaluating, and improving AI agents with MLflow. Supports the full agent improvement loop: instrument → trace → evaluate → iterate → validate.

    de mlflow · Paquete de plugins

    Publicado en: Claude Code: claude-plugins-official · Describe casi la misma tarea

Publicado en Claude: knowledge-work-plugins (5)
  • langfuse

    Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.

    de langfuse · Paquete de plugins

    Publicado en: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Claude Code: claude-plugins-community · Describe casi la misma tarea

  • datarobot-agent-skills

    DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…

    de datarobot-oss · Paquete de plugins

    Publicado en: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Community GitHub marketplaces · Describe casi la misma tarea

  • AI-Firstify

    AI-first project auditor and re-engineer based on the 9 design principles and 7 design patterns from the TechWolf AI-First Bootcamp

    de techwolf-ai · Paquete de plugins

    Publicado en: Claude: knowledge-work-plugins, Claude Code: claude-plugins-community, Community GitHub marketplaces · Describe casi la misma tarea

  • Synthflow

    Connects Claude Code to the Synthflow AI voice-agent platform through its hosted MCP server, with skills for reviewing calls and auditing agent prompts, plus a docs-search…

    de SynthFlowAI · Paquete de plugins

    Publicado en: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Claude Code: claude-plugins-community · Describe casi la misma tarea

  • figma

    Figma design platform integration. Access design files, extract component information, read design tokens, and translate designs into code. Bridge the gap between design and…

    de figma · Paquete de plugins

    Publicado en: Claude Code: claude-plugins-official, Official MCP Registry, Claude: knowledge-work-plugins, Copilot CLI: github/awesome-copilot · Describe casi la misma tarea

Publicado en Codex: openai-curated (openai/plugins) (5)
  • Plugin Eval

    Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.

    de OpenAI Codex · Paquete de plugins

    Publicado en: Codex: openai-curated (openai/plugins) · Describe casi la misma tarea

  • NVIDIA

    Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…

    de NVIDIA · Paquete de plugins

    Publicado en: Codex: openai-curated (openai/plugins) · Describe casi la misma tarea

  • OpenAI Developers

    Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.

    de OpenAI · Paquete de plugins

    Publicado en: Codex: openai-curated (openai/plugins) · Describe casi la misma tarea

  • PostHog

    PostHog gives your AI agent direct access to your product analytics, feature flags, experiments, error tracking, surveys, logs, and LLM analytics. Ask questions about your data…

    de PostHog Inc. · Paquete de plugins

    Publicado en: Codex: openai-curated (openai/plugins) · Describe casi la misma tarea

  • Datadog (Preview)

    Available for US1 customers only. Analyze, investigate, and act on your Datadog telemetry directly from ChatGPT using natural language. Ask questions about your production…

    de Datadog · Paquete de plugins

    Publicado en: Codex: openai-curated (openai/plugins) · Describe casi la misma tarea

Publicado en Community GitHub marketplaces (4)
  • baizhi-agent-toolkit

    Connect Baizhi Agent Toolkit through an authenticated remote MCP server, with an optional skill for bounded research and source verification. Requires a Baizhi account and API…

    de ct-jaryn · Paquete de plugins

    Publicado en: Community GitHub marketplaces · Describe casi la misma tarea

  • system-one

    Design, integrate, evaluate, self-host, and troubleshoot typed System One decision models including TypeSafe Jev, Convai Innovations Laya, CLM, and experimental Strands Decider…

    de magnus919 · Paquete de plugins

    Publicado en: Community GitHub marketplaces · Describe casi la misma tarea

  • DeepEval

    Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.

    de confident-ai · Paquete de plugins

    Publicado en: Claude Code: claude-plugins-official, Community GitHub marketplaces · Describe casi la misma tarea

  • evals

    LLM evaluation methodology and eval-suite design, based on Anthropic's evaluation guidance. /evals:methodology answers questions on success criteria, eval design, and grading…

    de Melodic Software · Paquete de plugins

    Publicado en: Community GitHub marketplaces · Describe casi la misma tarea

Publicado en Copilot CLI: github/awesome-copilot (5)
  • token-pacman

    Visualizes live session AI-credit usage as a Pac-Man board with pellets, ghosts, fruit milestones, and game-over limits.

    de James Montemagno · Paquete de plugins

    Publicado en: Copilot CLI: github/awesome-copilot · Describe casi la misma tarea

  • BLEA

    Safe BLE diagnostics, evidence workflows, and guarded automation for AI agents.

    de Nitmi · Servidor MCP

    Publicado en: Official MCP Registry, Copilot CLI: github/awesome-copilot · Describe casi la misma tarea

  • ai-team-orchestration

    Run a lightweight, role-separated AI development team with flexible tools, developer-selected models, proportionate planning, and optional QA.

    de Denis Evdokimov · Paquete de plugins

    Publicado en: Copilot CLI: github/awesome-copilot · Describe casi la misma tarea

  • doublecheck

    Three-layer verification pipeline for AI output. Extracts claims, finds sources, and flags hallucination risks so humans can verify before acting.

    de Awesome Copilot Community · Paquete de plugins

    Publicado en: Copilot CLI: github/awesome-copilot · Describe casi la misma tarea

  • chronicle-stats

    See your local Copilot token usage by day, model, and session, and get tips to use it more efficiently.

    de Julia Muiruri · Paquete de plugins

    Publicado en: Copilot CLI: github/awesome-copilot · Describe casi la misma tarea

Publicado en Copilot CLI: github/copilot-plugins (5)
  • microsoft-365-agents-toolkit

    Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.

    de microsoft · Paquete de plugins

    Publicado en: Copilot CLI: github/copilot-plugins · Describe casi la misma tarea

  • workiq

    Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.

    de microsoft · Paquete de plugins

    Publicado en: Copilot CLI: github/copilot-plugins, npm registry (MCP servers) · Describe casi la misma tarea

  • workiq-productivity

    WorkIQ productivity skills powered by the local WorkIQ CLI — read-only insights across email, meetings, calendar, Teams, SharePoint, projects, and people.

    de microsoft · Paquete de plugins

    Publicado en: Copilot CLI: github/copilot-plugins · Describe casi la misma tarea

  • advanced-security

    Advanced Security plugin for GitHub Copilot.

    de github · Paquete de plugins

    Publicado en: Copilot CLI: github/copilot-plugins · Describe casi la misma tarea

  • model-apps

    Build and deploy Power Apps generative pages for model-driven apps with specialist agents for planning, entity creation, and parallel code generation. Requires PAC CLI >= 2.7.0…

    de microsoft · Paquete de plugins

    Publicado en: Copilot CLI: github/copilot-plugins · Describe casi la misma tarea

Publicado en Cursor: cursor/plugins (5)
  • Ralph Loop

    Iterative self-referential AI loops using the Ralph Wiggum technique.

    de Cursor · Paquete de plugins

    Publicado en: Cursor: cursor/plugins · Describe casi la misma tarea

  • PostHog MCP

    Work with PostHog from chat: query product analytics and run SQL, manage feature flags and experiments, triage error tracking issues, and review session replays, surveys, and…

    de Cursor · Paquete de plugins

    Publicado en: Cursor: cursor/plugins · Describe casi la misma tarea

  • Databricks Genie One

    Ask Databricks Genie questions about your workspace's data in plain language.

    de Cursor · Paquete de plugins

    Publicado en: Cursor: cursor/plugins · Describe casi la misma tarea

  • Statsig

    Inspect and manage feature gates, experiments, dynamic configs, and metrics.

    de Cursor · Paquete de plugins

    Publicado en: Cursor: cursor/plugins · Describe casi la misma tarea

  • Continual Learning

    Incremental transcript-driven memory updates for AGENTS.md using high-signal bullet points only.

    de Eric Zakariasson · Paquete de plugins

    Publicado en: Cursor: cursor/plugins · Describe casi la misma tarea

Publicado en Docker MCP Catalog (5)
  • Opik

    Read and score Opik traces, experiments, datasets and prompts from your AI assistant.

    de comet-ml · Servidor MCP

    Publicado en: Official MCP Registry, Docker MCP Catalog, PyPI (MCP servers) · Describe casi la misma tarea

  • Wayfound

    Wayfound’s MCP server allows business users to govern, supervise, and improve AI Agents.

    de docker · Servidor MCP

    Publicado en: Docker MCP Catalog · Describe casi la misma tarea

  • Kagi Search

    The Official Model Context Protocol (MCP) server for Kagi Search & other tools.

    de kagisearch · Servidor MCP

    Publicado en: Docker MCP Catalog · Describe casi la misma tarea

  • OpenMesh

    Discover and connect to a curated marketplace of MCP servers for extending AI agent capabilities.

    de docker · Servidor MCP

    Publicado en: Docker MCP Catalog · Describe casi la misma tarea

  • Plugged.in Proxy

    A unified MCP proxy that aggregates multiple MCP servers into one interface, enabling seamless tool discovery and management across all your AI interactions. Manage all your MCP…

    de VeriTeknik · Servidor MCP

    Publicado en: Docker MCP Catalog · Describe casi la misma tarea

Publicado en Official MCP Registry (5)
  • good-sport

    Sports-analytics research assistant that grades its own model and reports the losses. $9.99/mo.

    de good-sport.ai · Servidor MCP

    Publicado en: Official MCP Registry · Describe casi la misma tarea

  • AI Arena Agent Tools

    Read-only US public-data screening tools with free Basic and Evidence tiers.

    de ai-arena.ca · Servidor MCP

    Publicado en: Official MCP Registry · Describe casi la misma tarea

  • Batru — Competitive Game Intelligence for AI Agents

    Live competitive-game predictions, meta data and decision tools for AI agents.

    de batru.gg · Servidor MCP

    Publicado en: Official MCP Registry · Describe casi la misma tarea

  • RaceHooks

    Predictive models and analytics for motorsport — race intelligence delivered to your endpoint.

    de racehooks · Servidor MCP

    Publicado en: Official MCP Registry · Describe casi la misma tarea

  • mcp-server-lol io.github.ebrunet001/mcp-server-lol

    League of Legends AI coaching: player profiles, match history, ranked stats & performance analysis

    de ebrunet001 · Servidor MCP

    Publicado en: Official MCP Registry · Describe casi la misma tarea

Publicado en PyPI (MCP servers) (5)
  • Opik

    Read and score Opik traces, experiments, datasets and prompts from your AI assistant.

    de comet-ml · Servidor MCP

    Publicado en: Official MCP Registry, Docker MCP Catalog, PyPI (MCP servers) · Describe casi la misma tarea

  • digline

    Read, measure and explain LLM eval runs of a digline suite. Cannot promote a baseline.

    de digline.dev · Servidor MCP

    Publicado en: Official MCP Registry, PyPI (MCP servers) · Describe casi la misma tarea

  • gut

    Judgment calls on small, cheap models: is this spam, which team, how urgent. YES, NO or UNSURE.

    de Kungie · Servidor MCP

    Publicado en: Official MCP Registry, PyPI (MCP servers) · Describe casi la misma tarea

  • air-blackbox-mcp io.github.airblackbox/air-blackbox-mcp

    EU AI Act compliance scanner for Python AI agents. 14 tools across 6 articles.

    de airblackbox · Servidor MCP

    Publicado en: Official MCP Registry, PyPI (MCP servers) · Describe casi la misma tarea

  • Futureweb Intervals MCP

    Self-hosted Intervals.icu MCP server: training analytics, Garmin data, wellness, workout planning

    de futureweb · Servidor MCP

    Publicado en: Official MCP Registry, PyPI (MCP servers) · Describe casi la misma tarea

Publicado en npm registry (MCP servers) (5)
  • OpenJEV

    Typed AI judgments for agents: choice, score, and yes/no probabilities instead of prose.

    de markylaredo · Servidor MCP

    Publicado en: Official MCP Registry, npm registry (MCP servers) · Describe casi la misma tarea

  • Jarroba Tools

    140 deterministic tools for your AI: logs, tests, SQL, diagrams, SPARQL. Local, no network.

    de Invarato · Servidor MCP

    Publicado en: Official MCP Registry, npm registry (MCP servers) · Describe casi la misma tarea

  • whoop-mcp io.github.davidmosiah/whoop-mcp

    Privacy-first, unofficial WHOOP MCP server for AI health, sleep, recovery, and performance agents.

    de davidmosiah · Servidor MCP

    Publicado en: Official MCP Registry, npm registry (MCP servers) · Describe casi la misma tarea

  • VibeRevert

    Local MCP server for AI coding safety: risk checks, sessions, checkpoints, and fix prompts.

    de viberevert.com · Servidor MCP

    Publicado en: Official MCP Registry, npm registry (MCP servers) · Describe casi la misma tarea

  • Contentrain

    Git content governance, 23 deterministic MCP tools. Hosted: docs.contentrain.io/developer/mcp-cloud

    de Contentrain · Servidor MCP

    Publicado en: Official MCP Registry, npm registry (MCP servers) · Describe casi la misma tarea

Encontrados por significado, no por código ni repositorio compartidos: los plugins similares siguen siendo productos distintos, y esto no es una reseña ni una recomendación.

¿Quieres esta marca para tu plugin en nuestro catálogo?

Demuestra que lo mantienes con un archivo en su repositorio, un archivo en tu dominio o un registro DNS, y podrás mostrar esta marca en la ficha, con banners en vivo para tu web y tu README. Cómo funciona la verificación

Además recibirás avisos cuando un marketplace lo publique, lo retire, cambie su marca verificada o lo que pide, y su endpoint remoto quedará monitorizado como un servicio web.

Datos de Official MCP Registry. Las cifras proceden de nuestros propios recorridos periódicos por los marketplaces, leída por última vez el . No publicamos datos de contacto de los editores de plugins.

De dónde salen los datos: cómo se elabora el catálogo