Ext Ops Panel
Abrir o painel

memoriant-eval-sandbox-skill

AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…

Pacote de plugins · de NathanMaine

Resumo

memoriant-eval-sandbox-skill é um pacote de plugins para ferramentas de programação com IA publicado por NathanMaine. Marketplaces que lemos e que o listam: 1 (Claude Code: claude-plugins-community). Vimos pela primeira vez em 2026-10-11 e não registramos mudanças desde então. Conforme nossa passagem pelos marketplaces em 2026-10-13.

Nas próprias palavras, em Claude Code: claude-plugins-community:

AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit trails with integrity hashes. Test your agents before deploying them. Includes full Python evaluation framework.

O que pede

  • Instala-se como pacote de plugins

Nenhum dos marketplaces que lemos publica as ferramentas ou as configurações que ele pede.

O que declara, pede e executa, por completo

Instale apenas plugins de desenvolvedores em quem você confia. Mostramos o que os marketplaces publicam e não testamos plugins.

Funciona com

  • Claude Code

Pelos marketplaces que o listam e pelo transporte MCP que declara, conforme cada cliente documenta. Não testamos plugins.

Conectar

Comandos e configurações gerados apenas a partir do que os marketplaces declaram. Não os executamos por você e não testamos plugins.

Como plugin do Claude Code

Gerado a partir do que Claude Code: claude-plugins-community declara.

Claude CodeDentro de uma sessão do Claude Code
/plugin marketplace add anthropics/claude-plugins-community
/plugin install memoriant-eval-sandbox-skill@claude-community

Onde está publicado

MarketplaceStatusVersãoNúmerosVerificadoVisto pela primeira vez
Claude Code: claude-plugins-community (Abrir o código no GitHub) Listado 1.0.0 Forks (GitHub): 0
Estrelas (GitHub): 0
Sem marcação

Cada número é do próprio marketplace e nunca é somado entre marketplaces. Um marketplace que não publica números não mostra nenhum: sem número não é zero.

O que o pacote contém

Conforme publicado em Claude Code: claude-plugins-community.

Skills: 1

  • eval-sandbox

Agentes: 1

  • eval-sandbox-runner

O que mudou

Nada mudou neste plugin desde que começamos a acompanhá-lo.

Plugins semelhantes

Produtos cujos próprios nomes, descrições, ferramentas e skills são os mais próximos deste pelo significado, em todos os marketplaces que lemos. A proximidade é ordenada apenas dentro desta lista.

  • evalview-mcp io.github.hidai25/evalview-mcp

    Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.

    de hidai25 · Servidor MCP

    Listado em: Official MCP Registry, Claude Code: claude-plugins-community · Descreve quase a mesma tarefa

  • VerifyAX

    Evaluate, benchmark, and simulate AI agents on the VerifyAX agent-evaluation platform.

    de verifyax · Servidor MCP

    Listado em: Official MCP Registry · Descreve quase a mesma tarefa

  • DeepEval

    Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.

    de confident-ai · Pacote de plugins

    Listado em: Claude Code: claude-plugins-official, Community GitHub marketplaces · Descreve quase a mesma tarefa

  • IA-QA — 130+ QA & Dev Tools for AI Agents

    130+ QA & dev tools for AI agents: prompt injection, RAG testing, VLM eval, guardrails. Free.

    de JcJamet · Servidor MCP

    Listado em: Official MCP Registry · Descreve quase a mesma tarefa

  • Plugin Eval

    Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.

    de OpenAI Codex · Pacote de plugins

    Listado em: Codex: openai-curated (openai/plugins) · Descreve quase a mesma tarefa

  • Eval Engine API

    Pay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.

    de invertedhoologan · Servidor MCP

    Listado em: Official MCP Registry · Descreve quase a mesma tarefa

  • giskard-skills

    Skills to streamline adoption and usage of Giskard products (OSS, Hub, Guards) for testing, evaluating, and red-teaming AI agents.

    de Giskard-AI · Pacote de plugins

    Listado em: Claude Code: claude-plugins-community · Descreve quase a mesma tarefa

  • whycant io.github.sattyamjjain/whycant

    Roast any AI agent idea from your IDE: verdict tier, readiness score, top risk, shareable URL.

    de sattyamjjain · Servidor MCP

    Listado em: Official MCP Registry · Descreve quase a mesma tarefa

  • DebugBundle

    DebugBundle MCP: runtime error reporting, incident response, health checks, and product analytics.

    de debugbundle.com · Servidor MCP

    Listado em: Official MCP Registry, Community GitHub marketplaces · Descreve quase a mesma tarefa

  • sosa-compliance-checker

    Audit your Claude plugins, skills, and coding agents against the SOSA methodology — Supervised Orchestrated Secured Agents. Scans your entire plugin ecosystem and evaluates each…

    de MSApps-Mobile · Pacote de plugins

    Listado em: Claude Code: claude-plugins-community · Descreve quase a mesma tarefa

Plugins semelhantes por marketplace

A mesma pergunta feita a cada marketplace separadamente: existe lá um equivalente deste plugin?

Listado em Claude Code: claude-plugins-community (5)
  • evalview-mcp io.github.hidai25/evalview-mcp

    Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.

    de hidai25 · Servidor MCP

    Listado em: Official MCP Registry, Claude Code: claude-plugins-community · Descreve quase a mesma tarefa

  • giskard-skills

    Skills to streamline adoption and usage of Giskard products (OSS, Hub, Guards) for testing, evaluating, and red-teaming AI agents.

    de Giskard-AI · Pacote de plugins

    Listado em: Claude Code: claude-plugins-community · Descreve quase a mesma tarefa

  • sosa-compliance-checker

    Audit your Claude plugins, skills, and coding agents against the SOSA methodology — Supervised Orchestrated Secured Agents. Scans your entire plugin ecosystem and evaluates each…

    de MSApps-Mobile · Pacote de plugins

    Listado em: Claude Code: claude-plugins-community · Descreve quase a mesma tarefa

  • pskoett-ai-skills

    A self-improving agent skill pipeline that prevents common AI coding agent failures. Includes 6 skills (plan-interview, intent-framed-agent, context-surfing, simplify-and-harden…

    de pskoett · Pacote de plugins

    Listado em: Claude Code: claude-plugins-community · Descreve quase a mesma tarefa

  • contextstellar

    Context engineering plugin for Claude Code — real-time prompt scoring, RLM adaptive weights, and token optimization. Scores every tool use across 5 dimensions (token utilization…

    de sunnypatneedi · Pacote de plugins

    Listado em: Claude Code: claude-plugins-community · Descreve quase a mesma tarefa

Listado em Claude Code: claude-plugins-official (5)
  • DeepEval

    Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.

    de confident-ai · Pacote de plugins

    Listado em: Claude Code: claude-plugins-official, Community GitHub marketplaces · Descreve quase a mesma tarefa

  • outputai

    Output.ai workflow development toolkit for Claude Code. Adds 5 specialist agents (planner, builder, debugger, prompt writer, quality reviewer), 40+ slash-command skills covering…

    de growthxai · Pacote de plugins

    Listado em: Claude Code: claude-plugins-official, Claude Code: claude-plugins-community, Community GitHub marketplaces · Descreve quase a mesma tarefa

  • langfuse

    Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.

    de langfuse · Pacote de plugins

    Listado em: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Claude Code: claude-plugins-community · Descreve quase a mesma tarefa

  • atomic-agents

    Comprehensive development workflow for building AI agents with the Atomic Agents framework. Includes specialized agents for schema design, architecture planning, code review, and…

    de BrainBlend-AI · Pacote de plugins

    Listado em: Claude Code: claude-plugins-official, Claude Code: claude-plugins-community, Community GitHub marketplaces · Descreve quase a mesma tarefa

  • datarobot-agent-skills

    DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…

    de datarobot-oss · Pacote de plugins

    Listado em: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Community GitHub marketplaces · Descreve quase a mesma tarefa

Listado em Claude: knowledge-work-plugins (5)
  • langfuse

    Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.

    de langfuse · Pacote de plugins

    Listado em: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Claude Code: claude-plugins-community · Descreve quase a mesma tarefa

  • datarobot-agent-skills

    DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…

    de datarobot-oss · Pacote de plugins

    Listado em: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Community GitHub marketplaces · Descreve quase a mesma tarefa

  • AI-Firstify

    AI-first project auditor and re-engineer based on the 9 design principles and 7 design patterns from the TechWolf AI-First Bootcamp

    de techwolf-ai · Pacote de plugins

    Listado em: Claude: knowledge-work-plugins, Claude Code: claude-plugins-community · Descreve quase a mesma tarefa

  • Synthflow

    Connects Claude Code to the Synthflow AI voice-agent platform through its hosted MCP server, with skills for reviewing calls and auditing agent prompts, plus a docs-search…

    de SynthFlowAI · Pacote de plugins

    Listado em: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Claude Code: claude-plugins-community · Descreve quase a mesma tarefa

  • growthbook

    A suite of agent skills for the full GrowthBook feature flag and experimentation lifecycle.

    de growthbook · Pacote de plugins

    Listado em: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Community GitHub marketplaces · Descreve quase a mesma tarefa

Listado em Codex: openai-curated (openai/plugins) (5)
  • Plugin Eval

    Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.

    de OpenAI Codex · Pacote de plugins

    Listado em: Codex: openai-curated (openai/plugins) · Descreve quase a mesma tarefa

  • OpenAI Developers

    Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.

    de OpenAI · Pacote de plugins

    Listado em: Codex: openai-curated (openai/plugins) · Descreve quase a mesma tarefa

  • NVIDIA

    Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…

    de NVIDIA · Pacote de plugins

    Listado em: Codex: openai-curated (openai/plugins) · Descreve quase a mesma tarefa

  • crowdstrike-falcon-foundry

    CrowdStrike Falcon Foundry development skills for building cybersecurity applications on the Falcon platform. Includes UI development, collections, functions, workflows, API…

    de CrowdStrike · Pacote de plugins

    Listado em: Claude Code: claude-plugins-official, Codex: openai-curated (openai/plugins), Copilot CLI: github/awesome-copilot, Community GitHub marketplaces, Claude Code: claude-plugins-community · Descreve quase a mesma tarefa

  • Superpowers

    An agentic skills framework & software development methodology that works: planning, TDD, debugging, and collaboration workflows.

    de Jesse Vincent · Pacote de plugins

    Listado em: Codex: openai-curated (openai/plugins) · Descreve uma tarefa semelhante

Listado em Community GitHub marketplaces (5)
  • DeepEval

    Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.

    de confident-ai · Pacote de plugins

    Listado em: Claude Code: claude-plugins-official, Community GitHub marketplaces · Descreve quase a mesma tarefa

  • DebugBundle

    DebugBundle MCP: runtime error reporting, incident response, health checks, and product analytics.

    de debugbundle.com · Servidor MCP

    Listado em: Official MCP Registry, Community GitHub marketplaces · Descreve quase a mesma tarefa

  • Entroly

    Context Assurance for AI agents: context engineering, AI cost optimization, verification.

    de juyterman1000 · Servidor MCP

    Listado em: Official MCP Registry, Community GitHub marketplaces · Descreve quase a mesma tarefa

  • iris-eval

    Stop shipping agents on vibes — agent eval for any MCP workflow. Score output quality, catch PII and prompt injection, verify citations, and enforce cost budgets. 12 MCP tools +…

    de Iris · Pacote de plugins

    Listado em: Community GitHub marketplaces · Descreve quase a mesma tarefa

  • outputai

    Output.ai workflow development toolkit for Claude Code. Adds 5 specialist agents (planner, builder, debugger, prompt writer, quality reviewer), 40+ slash-command skills covering…

    de growthxai · Pacote de plugins

    Listado em: Claude Code: claude-plugins-official, Claude Code: claude-plugins-community, Community GitHub marketplaces · Descreve quase a mesma tarefa

Listado em Copilot CLI: github/awesome-copilot (5)
  • ai-team-orchestration

    Run a lightweight, role-separated AI development team with flexible tools, developer-selected models, proportionate planning, and optional QA.

    de Denis Evdokimov · Pacote de plugins

    Listado em: Copilot CLI: github/awesome-copilot · Descreve quase a mesma tarefa

  • copilot-goal-skill

    Goal-driven task orchestration with independent verification. Interviews the user to define a clear goal, then loops between a Builder subagent (does the work) and an Inspector…

    de gsemet · Pacote de plugins

    Listado em: Copilot CLI: github/awesome-copilot · Descreve quase a mesma tarefa

  • microsoft-foundry

    Skills and interactive Copilot canvas for designing, configuring, testing and deploying agents to Microsoft Foundry.

    de microsoft · Pacote de plugins

    Listado em: Copilot CLI: github/awesome-copilot · Descreve quase a mesma tarefa

  • agent-council

    A runtime-portable 5-agent quality gate that adjudicates text artifacts before they ship. Five role-conditioned LLM deliberators run a 2-round async protocol with cross-read…

    de Avyayalaya · Pacote de plugins

    Listado em: Copilot CLI: github/awesome-copilot · Descreve quase a mesma tarefa

  • skills-for-copilot-studio

    Microsoft Copilot Studio plugins for AI coding agents

    de microsoft · Pacote de plugins

    Listado em: Copilot CLI: github/awesome-copilot · Descreve quase a mesma tarefa

Listado em Copilot CLI: github/copilot-plugins (5)
  • microsoft-365-agents-toolkit

    Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.

    de microsoft · Pacote de plugins

    Listado em: Copilot CLI: github/copilot-plugins · Descreve quase a mesma tarefa

  • advanced-security

    Advanced Security plugin for GitHub Copilot.

    de github · Pacote de plugins

    Listado em: Copilot CLI: github/copilot-plugins · Descreve quase a mesma tarefa

  • model-apps

    Build and deploy Power Apps generative pages for model-driven apps with specialist agents for planning, entity creation, and parallel code generation. Requires PAC CLI >= 2.7.0…

    de microsoft · Pacote de plugins

    Listado em: Copilot CLI: github/copilot-plugins · Descreve quase a mesma tarefa

  • azure-devops-copilot-plugin

    Bring Azure DevOps work-item, repository, and pull-request workflows into GitHub Copilot.

    de microsoft · Pacote de plugins

    Listado em: Copilot CLI: github/copilot-plugins · Descreve quase a mesma tarefa

  • workiq-productivity

    WorkIQ productivity skills powered by the local WorkIQ CLI — read-only insights across email, meetings, calendar, Teams, SharePoint, projects, and people.

    de microsoft · Pacote de plugins

    Listado em: Copilot CLI: github/copilot-plugins · Descreve quase a mesma tarefa

Listado em Cursor: cursor/plugins (5)
  • Ralph Loop

    Iterative self-referential AI loops using the Ralph Wiggum technique.

    de Cursor · Pacote de plugins

    Listado em: Cursor: cursor/plugins · Descreve quase a mesma tarefa

  • Agent Compatibility

    CLI-backed repo compatibility scans plus agents that audit startup, validation, and docs against reality.

    de Cursor · Pacote de plugins

    Listado em: Cursor: cursor/plugins · Descreve quase a mesma tarefa

  • Orchestrate

    Fan large tasks out across parallel cloud agents with planners, workers, verifiers, and structured handoffs.

    de Cursor · Pacote de plugins

    Listado em: Cursor: cursor/plugins · Descreve quase a mesma tarefa

  • Cursor SDK

    Build apps, scripts, and automations with the TypeScript SDK.

    de Cursor · Pacote de plugins

    Listado em: Cursor: cursor/plugins · Descreve quase a mesma tarefa

  • Advisor

    Consult a stronger model before major decisions, when stuck, and before declaring done.

    de Cursor · Pacote de plugins

    Listado em: Cursor: cursor/plugins · Descreve quase a mesma tarefa

Listado em Docker MCP Catalog (5)
  • Opik

    Read and score Opik traces, experiments, datasets and prompts from your AI assistant.

    de comet-ml · Servidor MCP

    Listado em: Official MCP Registry, Docker MCP Catalog · Descreve quase a mesma tarefa

  • Wayfound

    Wayfound’s MCP server allows business users to govern, supervise, and improve AI Agents.

    de docker · Servidor MCP

    Listado em: Docker MCP Catalog · Descreve quase a mesma tarefa

  • Zen

    Bridges multiple AI models and CLIs, enabling orchestrated workflows across Claude Code, Gemini CLI, Codex CLI, and other AI development tools.

    de BeehiveInnovations · Servidor MCP

    Listado em: Docker MCP Catalog · Descreve quase a mesma tarefa

  • testkube-mcp io.github.kubeshop/testkube-mcp

    MCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants

    de kubeshop · Servidor MCP

    Listado em: Official MCP Registry, Docker MCP Catalog · Descreve quase a mesma tarefa

  • E2B

    Giving Claude ability to run code with E2B via MCP (Model Context Protocol).

    de e2b-dev · Servidor MCP

    Listado em: Docker MCP Catalog · Descreve quase a mesma tarefa

Listado em Official MCP Registry (5)
  • evalview-mcp io.github.hidai25/evalview-mcp

    Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.

    de hidai25 · Servidor MCP

    Listado em: Official MCP Registry, Claude Code: claude-plugins-community · Descreve quase a mesma tarefa

  • VerifyAX

    Evaluate, benchmark, and simulate AI agents on the VerifyAX agent-evaluation platform.

    de verifyax · Servidor MCP

    Listado em: Official MCP Registry · Descreve quase a mesma tarefa

  • IA-QA — 130+ QA & Dev Tools for AI Agents

    130+ QA & dev tools for AI agents: prompt injection, RAG testing, VLM eval, guardrails. Free.

    de JcJamet · Servidor MCP

    Listado em: Official MCP Registry · Descreve quase a mesma tarefa

  • Eval Engine API

    Pay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.

    de invertedhoologan · Servidor MCP

    Listado em: Official MCP Registry · Descreve quase a mesma tarefa

  • whycant io.github.sattyamjjain/whycant

    Roast any AI agent idea from your IDE: verdict tier, readiness score, top risk, shareable URL.

    de sattyamjjain · Servidor MCP

    Listado em: Official MCP Registry · Descreve quase a mesma tarefa

Encontrados pelo significado, não por código ou repositório em comum: plugins semelhantes continuam sendo produtos distintos, e isto não é uma avaliação nem uma recomendação.

Este plugin é seu?

Adicione-o aos seus projetos e prove que o mantém com um arquivo no repositório, um arquivo no seu domínio ou um registro DNS. Você recebe alertas quando um marketplace o publica, o remove, muda a marca de verificado ou o que ele pede, e o endpoint remoto passa a ser monitorado como um serviço web.

Dados de Claude Code: claude-plugins-community. Os números vêm das nossas próprias passagens regulares pelos marketplaces, última leitura em . Não publicamos dados de contato dos editores de plugins.

De onde vêm os dados: como o catálogo é montado