Eval Skills
Skills that take a coding agent from your first trace to evals you can trust: error analysis, datasets, validated graders, eval runs, and production monitoring.
Pacote de plugins · de Confident AI
Resumo
Eval Skills é um pacote de plugins para ferramentas de programação com IA publicado por Confident AI. Marketplaces que lemos e que o listam: 1 (Community GitHub marketplaces). Vimos pela primeira vez em 2026-10-15 e não registramos mudanças desde então. Conforme nossa passagem pelos marketplaces em 2026-10-16.
O que pede
- Instala-se como pacote de plugins
Nenhum dos marketplaces que lemos publica as ferramentas ou as configurações que ele pede.
O que declara, pede e executa, por completo
Instale apenas plugins de desenvolvedores em quem você confia. Mostramos o que os marketplaces publicam e não testamos plugins.
Funciona com
- Claude Code
Pelos marketplaces que o listam e pelo transporte MCP que declara, conforme cada cliente documenta. Não testamos plugins.
Conectar
Comandos e configurações gerados apenas a partir do que os marketplaces declaram. Não os executamos por você e não testamos plugins.
Como plugin do Claude Code
Gerado a partir do que Community GitHub marketplaces declara.
/plugin marketplace add confident-ai/eval-skills
/plugin install eval-skills@eval-skillsOnde está publicado
| Marketplace | Status | Versão | Números | Verificado | Visto pela primeira vez |
|---|---|---|---|---|---|
| Marketplace da comunidade confident-ai/eval-skills (Abrir o código no GitHub) | Listado | 1.1.0 | Forks (GitHub): 1 Estrelas (GitHub): 10 |
Sem marcação |
Cada número é do próprio marketplace e nunca é somado entre marketplaces. Um marketplace que não publica números não mostra nenhum: sem número não é zero.
Listado em um marketplace da comunidade
| Marketplace | Repositório | Estrelas (GitHub) |
|---|---|---|
| eval-skills | confident-ai/eval-skills | 10 |
O que o pacote contém
Conforme publicado em Community GitHub marketplaces.
Skills: 10
eval-auditeval-buildeval-dataseteval-descenteval-discovereval-error-analysiseval-gradeeval-maintaineval-runeval-trace
O que mudou
- Passou a ser um produto que acompanhamos
- Community GitHub marketplaces: apareceu
Plugins semelhantes
Produtos cujos próprios nomes, descrições, ferramentas e skills são os mais próximos deste pelo significado, em todos os marketplaces que lemos. A proximidade é ordenada apenas dentro desta lista.
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Scaffolding, running, documenting, and publishing AI evaluations. Ships skills and commands for setting up eval workspaces, creating custom evals (or adapting existing…
-
Decide, design, gate, judge, and defend evaluations for LLM, agent, and retrieval systems. Not ordinary unit tests.
-
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…
-
Compare AI coding skills head-to-head to find which one works best for your task. Run controlled A/B tests: same model (Claude Code), same tasks, different skills. Each candidate…
-
setup-doctor io.github.saxenakapil/setup-doctor
Score and improve your AI coding agent setup. Local-only, open source.
-
Collection of analysis skills including code review and iterative answer self-review with blind sub-agent verification
-
Grade an agent setup from real conversation history — a rebuild of warpdotdev/common-skills' skill-doctor (MIT). Harvests recent local Claude Code and Codex sessions scoped to one…
-
A self-improving agent skill pipeline that prevents common AI coding agent failures. Includes 6 skills (plan-interview, intent-framed-agent, context-surfing, simplify-and-harden…
Plugins semelhantes por marketplace
A mesma pergunta feita a cada marketplace separadamente: existe lá um equivalente deste plugin?
Listado em Claude Code: claude-plugins-community (5)
-
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…
-
Compare AI coding skills head-to-head to find which one works best for your task. Run controlled A/B tests: same model (Claude Code), same tasks, different skills. Each candidate…
-
A self-improving agent skill pipeline that prevents common AI coding agent failures. Includes 6 skills (plan-interview, intent-framed-agent, context-surfing, simplify-and-harden…
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
Audits, diagnoses, and upgrades your Claude Code skills and agents
Listado em Claude Code: claude-plugins-official (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
Output.ai workflow development toolkit for Claude Code. Adds 5 specialist agents (planner, builder, debugger, prompt writer, quality reviewer), 40+ slash-command skills covering…
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
Create new skills, improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, update or optimize an existing skill, run evals to…
Listado em Claude: knowledge-work-plugins (5)
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
AI-first project auditor and re-engineer based on the 9 design principles and 7 design patterns from the TechWolf AI-First Bootcamp
-
Bring Qodo's codebase intelligence, coding standards, and code review into your coding agent.
-
Streamline engineering workflows — standups, code review, architecture decisions, incident response, and technical documentation. Works with your existing tools or standalone.
Listado em Codex: openai-curated (openai/plugins) (5)
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
-
AI-powered code review in Codex, powered by CodeRabbit.
-
An agentic skills framework & software development methodology that works: planning, TDD, debugging, and collaboration workflows.
-
Qodo setup, code intelligence, and review workflows.
Listado em Community GitHub marketplaces (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Scaffolding, running, documenting, and publishing AI evaluations. Ships skills and commands for setting up eval workspaces, creating custom evals (or adapting existing…
-
Decide, design, gate, judge, and defend evaluations for LLM, agent, and retrieval systems. Not ordinary unit tests.
-
setup-doctor io.github.saxenakapil/setup-doctor
Score and improve your AI coding agent setup. Local-only, open source.
-
Collection of analysis skills including code review and iterative answer self-review with blind sub-agent verification
Listado em Copilot CLI: github/awesome-copilot (5)
-
Run a lightweight, role-separated AI development team with flexible tools, developer-selected models, proportionate planning, and optional QA.
-
Goal-driven task orchestration with independent verification. Interviews the user to define a clear goal, then loops between a Builder subagent (does the work) and an Inspector…
-
Meta prompts that help you discover and generate curated GitHub Copilot agents, instructions, prompts, and skills.
-
Analyze any repository and generate AI-ready configuration — AGENTS.md, copilot-instructions.md, CI workflows, issue templates, and more. Mines your PR review patterns and creates…
-
Task Researcher and Task Planner for intermediate to expert users and large codebases - Brought to you by microsoft/edge-ai
Listado em Copilot CLI: github/copilot-plugins (5)
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
Advanced Security plugin for GitHub Copilot.
-
Bring Azure DevOps work-item, repository, and pull-request workflows into GitHub Copilot.
-
workiq-productivity
WorkIQ productivity skills powered by the local WorkIQ CLI — read-only insights across email, meetings, calendar, Teams, SharePoint, projects, and people.
-
Build and manage Microsoft Dataverse solutions using natural language. Includes table/column creation, solution lifecycle, data operations, and MCP server configuration.
Listado em Cursor: cursor/plugins (5)
-
Build apps, scripts, and automations with the TypeScript SDK.
-
Consult a stronger model before major decisions, when stuck, and before declaring done.
-
Skills for building on the Cursor Origin API. Fetch the live spec first, then follow the Origin rules for credentials, scopes, webhooks, paging, and errors. Includes a skill that…
-
if you want to go fast, go deep first. pstack helps you write less, but higher quality code. rigorous agent workflows you can parallelize with confidence.
-
Iterative self-referential AI loops using the Ralph Wiggum technique.
Listado em Docker MCP Catalog (5)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Bridges multiple AI models and CLIs, enabling orchestrated workflows across Claude Code, Gemini CLI, Codex CLI, and other AI development tools.
-
Stop stitching context for Copilot and Cursor. With Sequa MCP, your AI tools know your entire codebase and docs out of the box.
-
Tools and resources for writing Effect code in Typescript.
-
testkube-mcp io.github.kubeshop/testkube-mcp
MCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants
Listado em Official MCP Registry (5)
-
setup-doctor io.github.saxenakapil/setup-doctor
Score and improve your AI coding agent setup. Local-only, open source.
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
Context Assurance for AI agents: context engineering, AI cost optimization, verification.
-
Pay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.
-
Run local prompt regression checks from prompt-response logs in AI coding assistants.
Encontrados pelo significado, não por código ou repositório em comum: plugins semelhantes continuam sendo produtos distintos, e isto não é uma avaliação nem uma recomendação.
Quer esta marca no seu plugin em nosso catálogo?
Prove que o mantém com um arquivo no repositório, um arquivo no seu domínio ou um registro DNS, e você poderá mostrar esta marca na ficha, com banners ao vivo para o seu site e o README. Como funciona a verificação
Você também recebe alertas quando um marketplace o publica, o remove, muda a marca de verificado ou o que ele pede, e o endpoint remoto passa a ser monitorado como um serviço web.
Dados de Community GitHub marketplaces. Os números vêm das nossas próprias passagens regulares pelos marketplaces, última leitura em . Não publicamos dados de contato dos editores de plugins.