eval-guide
AI agent evaluation toolkit for Copilot Studio. Plan evals, generate test cases, interpret results, and triage failures.
Pacote de plugins · de microsoft
Resumo
eval-guide é um pacote de plugins para ferramentas de programação com IA publicado por microsoft. Marketplaces que lemos e que o listam: 1 (Community GitHub marketplaces). A última mudança que registramos foi em 2026-11-04. Conforme nossa passagem pelos marketplaces em 2026-11-06.
O que pede
- Instala-se como pacote de plugins
Nenhum dos marketplaces que lemos publica as ferramentas ou as configurações que ele pede.
O que declara, pede e executa, por completo
Instale apenas plugins de desenvolvedores em quem você confia. Mostramos o que os marketplaces publicam e não testamos plugins.
Funciona com
- Claude Code
Pelos marketplaces que o listam e pelo transporte MCP que declara, conforme cada cliente documenta. Não testamos plugins.
Conectar
Comandos e configurações gerados apenas a partir do que os marketplaces declaram. Não os executamos por você e não testamos plugins.
Como plugin do Claude Code
Gerado a partir do que Community GitHub marketplaces declara.
/plugin marketplace add microsoft/eval-guide
/plugin install eval-guide@eval-guideOnde está publicado
| Marketplace | Status | Versão | Números | Verificado | Visto pela primeira vez |
|---|---|---|---|---|---|
| Marketplace da comunidade microsoft/eval-guide (Abrir o código no GitHub) | Listado | 1.0.0 | Forks (GitHub): 22 Estrelas (GitHub): 140 |
Sem marcação |
Cada número é do próprio marketplace e nunca é somado entre marketplaces. Um marketplace que não publica números não mostra nenhum: sem número não é zero.
Listado em um marketplace da comunidade
| Marketplace | Repositório | Estrelas (GitHub) |
|---|---|---|
| eval-guide | microsoft/eval-guide | 140 |
Como os números mudaram
- 2026-10-30140
- 2026-10-31139
- 2026-11-04140
- 2026-11-06140
Cada ponto é um dia em que lemos um número diferente; os trechos planos são dias em que o número não mudou. Números de marketplaces diferentes nunca são somados.
O que o pacote contém
Conforme publicado em Community GitHub marketplaces.
Skills: 6
eval-faqeval-generatoreval-guideeval-result-interpretereval-suite-plannereval-triage-and-improvement
O que mudou
- Passou a ser um produto que acompanhamos
- Community GitHub marketplaces: apareceu
Plugins semelhantes
Produtos cujos próprios nomes, descrições, ferramentas e skills são os mais próximos deste pelo significado, em todos os marketplaces que lemos. A proximidade é ordenada apenas dentro desta lista.
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Connect providers and targets, write eval suites, and set up or run red team scans with promptfoo
-
Testers.ai CARBON Test Harness Lite
Local QA workflows, test evidence, screenshot maps and confidence reports for AI coding agents.
-
Measure AI output quality, user satisfaction, task success, and design effectiveness.
-
Agent skills for observing and evaluating LLM applications with LangSmith
-
IA-QA — 152 QA & Dev Tools for AI Agents
152 free QA tools for agents: injection scan, evals, RAG, web audits. Smaller packs: /mcp/{pack}.
-
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…
-
QA testing pipeline with 5 personas (smoke, UX, adversarial, performance, mobile) — generate workflows, convert to Playwright tests, run interactively or in CI. Quantified UX…
-
QA specialist agent for test planning and quality assurance
Plugins semelhantes por marketplace
A mesma pergunta feita a cada marketplace separadamente: existe lá um equivalente deste plugin?
Listado em Claude Code: claude-plugins-community (5)
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…
-
Natural-language end-to-end tests for any software surface, powered by getlark.ai
-
Teaches AI coding agents to create and maintain promptfoo eval suites. Encodes best practices like deterministic assertions first, file-based test organization, correct…
-
Use TestDino inside Claude Code through the hosted remote MCP server to inspect test runs, debug failing test cases, manage manual tests, and run TestDino audits.
Listado em Claude Code: claude-plugins-official (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
A suite of agent skills for the full GrowthBook feature flag and experimentation lifecycle.
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
Detect AI agents in your codebase and instrument them with Pendo Agent Analytics via the best-fit path: Python SDK, TypeScript SDK, client-side trackAgent, or the Conversations…
-
Output.ai workflow development toolkit for Claude Code. Adds 5 specialist agents (planner, builder, debugger, prompt writer, quality reviewer), 40+ slash-command skills covering…
Listado em Claude: knowledge-work-plugins (5)
-
A suite of agent skills for the full GrowthBook feature flag and experimentation lifecycle.
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
Bring Pendo product analytics into Claude Code: account health, feature adoption, session replay lookup and triage, feedback analysis, and data-informed planning grounded in real…
-
AI agent skills that make SaaS products data-ready for product analytics — from codebase scan to tracking plan to working instrumentation code.
-
AI-first project auditor and re-engineer based on the 9 design principles and 7 design patterns from the TechWolf AI-First Bootcamp
Listado em Codex: openai-curated (openai/plugins) (5)
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
PostHog gives your AI agent direct access to your product analytics, feature flags, experiments, error tracking, surveys, logs, and LLM analytics. Ask questions about your data…
-
Answer product and business questions with data
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
-
Inspect recent issues and events in Sentry from Codex.
Listado em Community GitHub marketplaces (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Connect providers and targets, write eval suites, and set up or run red team scans with promptfoo
-
Measure AI output quality, user satisfaction, task success, and design effectiveness.
-
Agent skills for observing and evaluating LLM applications with LangSmith
-
QA testing pipeline with 5 personas (smoke, UX, adversarial, performance, mobile) — generate workflows, convert to Playwright tests, run interactively or in CI. Quantified UX…
Listado em Copilot CLI: github/awesome-copilot (5)
-
Microsoft Copilot Studio YAML authoring toolkit. Create, edit, validate, and test Copilot Studio agents using YAML files.
-
Helps GitHub Copilot investigate mobile app telemetry, diagnose crashes, manage [bitdrift](bitdrift.ai) workflows and dashboards, integrate the Capture SDK into iOS, Android, and…
-
Codebase-grounded concept-mastery quizzes with an interactive BrainMax Canvas dashboard.
-
Turn your Copilot sessions into proof of impact — research-grounded HTML reports with effort estimation, skills analysis, and ROI metrics from local session logs.
-
See your local Copilot token usage by day, model, and session, and get tips to use it more efficiently.
Listado em Copilot CLI: github/copilot-plugins (5)
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
workiq
Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.
-
workiq-productivity
WorkIQ productivity skills powered by the local WorkIQ CLI — read-only insights across email, meetings, calendar, Teams, SharePoint, projects, and people.
-
model-apps
Build and deploy Power Apps generative pages for model-driven apps with specialist agents for planning, entity creation, and parallel code generation. Requires PAC CLI >= 2.7.0…
-
Build Power Apps Canvas Apps using the Canvas Authoring MCP server.
Listado em Cursor: cursor/plugins (5)
-
Work with PostHog from chat: query product analytics and run SQL, manage feature flags and experiments, triage error tracking issues, and review session replays, surveys, and…
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Inspect and manage feature gates, experiments, dynamic configs, and metrics.
-
Ask Databricks Genie questions about your workspace's data in plain language.
-
CLI-backed repo compatibility scans plus agents that audit startup, validation, and docs against reality.
Listado em Docker MCP Catalog (5)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
testkube-mcp io.github.kubeshop/testkube-mcp
MCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants
-
MCP server for AI access to SmartBear tools, including BugSnag, Reflect, Swagger, PactFlow, QTM4J.
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Wayfound’s MCP server allows business users to govern, supervise, and improve AI Agents.
Listado em Official MCP Registry (5)
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
Testers.ai CARBON Test Harness Lite
Local QA workflows, test evidence, screenshot maps and confidence reports for AI coding agents.
-
IA-QA — 152 QA & Dev Tools for AI Agents
152 free QA tools for agents: injection scan, evals, RAG, web audits. Smaller packs: /mcp/{pack}.
-
Free human usability tests for agent-built websites. Submit tasks; get written findings as JSON.
-
Score and improve AI prompts with Cue Free and Pro account access.
Listado em PyPI (MCP servers) (5)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Read, measure and explain LLM eval runs of a digline suite. Cannot promote a baseline.
-
air-blackbox-mcp io.github.airblackbox/air-blackbox-mcp
EU AI Act compliance scanner for Python AI agents. 14 tools across 6 articles.
-
Audit an MCP server and get a scored, actionable quality report in seconds.
-
220 browser automation tools for Chrome, Edge, and Firefox via CDP + BiDi. 100% Python.
Listado em npm registry (MCP servers) (5)
-
Context Assurance for AI agents: context engineering, AI cost optimization, verification.
-
Build AI-powered forms, scored assessments and professional reports on FormLM, by natural language.
-
Official MCP server for Qase — manage test cases, runs, suites, defects via AI tools.
-
Audits tests instead of writing them: what each one really asserts. 4 tools, local.
-
Contextual prompts and agent skills for 140+ AI platforms.
Encontrados pelo significado, não por código ou repositório em comum: plugins semelhantes continuam sendo produtos distintos, e isto não é uma avaliação nem uma recomendação.
Quer esta marca no seu plugin em nosso catálogo?
Prove que o mantém com um arquivo no repositório, um arquivo no seu domínio ou um registro DNS, e você poderá mostrar esta marca na ficha, com banners ao vivo para o seu site e o README. Como funciona a verificação
Você também recebe alertas quando um marketplace o publica, o remove, muda a marca de verificado ou o que ele pede, e o endpoint remoto passa a ser monitorado como um serviço web.
Dados de Community GitHub marketplaces. Os números vêm das nossas próprias passagens regulares pelos marketplaces, última leitura em . Não publicamos dados de contato dos editores de plugins.