evaluate-agent
Set up evaluation of AI agents with tool call validation, correctness checks, and task completion using Dokimos
Pacote de plugins · de Dokimos Contributors
Resumo
evaluate-agent é um pacote de plugins para ferramentas de programação com IA publicado por Dokimos Contributors. Marketplaces que lemos e que o listam: 1 (Community GitHub marketplaces). A última mudança que registramos foi em 2026-10-19. Conforme nossa passagem pelos marketplaces em 2026-10-21.
O que pede
- Instala-se como pacote de plugins
Nenhum dos marketplaces que lemos publica as ferramentas ou as configurações que ele pede.
O que declara, pede e executa, por completo
Instale apenas plugins de desenvolvedores em quem você confia. Mostramos o que os marketplaces publicam e não testamos plugins.
Funciona com
- Claude Code
Pelos marketplaces que o listam e pelo transporte MCP que declara, conforme cada cliente documenta. Não testamos plugins.
Conectar
Comandos e configurações gerados apenas a partir do que os marketplaces declaram. Não os executamos por você e não testamos plugins.
Como plugin do Claude Code
Gerado a partir do que Community GitHub marketplaces declara.
/plugin marketplace add dokimos-dev/dokimos
/plugin install evaluate-agent@dokimosOnde está publicado
| Marketplace | Status | Versão | Números | Verificado | Visto pela primeira vez |
|---|---|---|---|---|---|
| Marketplace da comunidade dokimos-dev/dokimos (Abrir o código no GitHub) | Listado | 0.2.0 | Forks (GitHub): 5 Estrelas (GitHub): 60 |
Sem marcação |
Cada número é do próprio marketplace e nunca é somado entre marketplaces. Um marketplace que não publica números não mostra nenhum: sem número não é zero.
Listado em um marketplace da comunidade
| Marketplace | Repositório | Estrelas (GitHub) |
|---|---|---|
| dokimos | dokimos-dev/dokimos | 60 |
Como os números mudaram
- 2026-10-195
- 2026-10-205
Cada ponto é um dia em que lemos um número diferente; os trechos planos são dias em que o número não mudou. Números de marketplaces diferentes nunca são somados.
O que o pacote contém
Conforme publicado em Community GitHub marketplaces.
Skills: 1
evaluate-agent
O que mudou
- Passou a ser um produto que acompanhamos
- Community GitHub marketplaces: apareceu
Plugins semelhantes
Produtos cujos próprios nomes, descrições, ferramentas e skills são os mais próximos deste pelo significado, em todos os marketplaces que lemos. A proximidade é ordenada apenas dentro desta lista.
-
Evaluate, benchmark, and simulate AI agents on the VerifyAX agent-evaluation platform.
-
Set up evaluation of an OpenAI Java SDK tool-calling agent using Dokimos
-
Decide, design, gate, judge, and defend evaluations for LLM, agent, and retrieval systems. Not ordinary unit tests.
-
Score any website's AI-agent readiness. Open Agent Registry scanner + platform tools.
-
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…
-
IA-QA — 130+ QA & Dev Tools for AI Agents
130+ QA & dev tools for AI agents: prompt injection, RAG testing, VLM eval, guardrails. Free.
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
frootai-evaluation-skills
FrootAI evaluation skills — benchmarking, test generation, load testing, SLA checks, and quality gates. (152 skills)
-
Discover public AI agents, reusable recipes, and trusted benchmark evidence by task.
Plugins semelhantes por marketplace
A mesma pergunta feita a cada marketplace separadamente: existe lá um equivalente deste plugin?
Listado em Claude Code: claude-plugins-community (5)
-
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
JoAi is a platform for creating and managing your own AI agents.
-
Skills to streamline adoption and usage of Giskard products (OSS, Hub, Guards) for testing, evaluating, and red-teaming AI agents.
-
Make your AI agent get stronger with use. Includes two skills: /skill-review (periodic audit of all skills for staleness, missing gotchas, and improvements) and…
Listado em Claude Code: claude-plugins-official (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Comprehensive development workflow for building AI agents with the Atomic Agents framework. Includes specialized agents for schema design, architecture planning, code review, and…
-
Output.ai workflow development toolkit for Claude Code. Adds 5 specialist agents (planner, builder, debugger, prompt writer, quality reviewer), 40+ slash-command skills covering…
-
Build, deploy, and operate AI agents on AWS. Skills for scaffolding agents with Amazon Bedrock AgentCore, connecting tools, memory, policies, evaluation, debugging, and production…
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
Listado em Claude: knowledge-work-plugins (5)
-
AI-first project auditor and re-engineer based on the 9 design principles and 7 design patterns from the TechWolf AI-First Bootcamp
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
Connects Claude Code to the Synthflow AI voice-agent platform through its hosted MCP server, with skills for reviewing calls and auditing agent prompts, plus a docs-search…
-
Build multimodal AI applications with Pixeltable -- tables, computed columns, embedding search, UDFs, tool-calling agents, and 25+ AI provider integrations.
Listado em Codex: openai-curated (openai/plugins) (5)
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
-
Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…
-
An agentic skills framework & software development methodology that works: planning, TDD, debugging, and collaboration workflows.
-
CrowdStrike Falcon Foundry development skills for building cybersecurity applications on the Falcon platform. Includes UI development, collections, functions, workflows, API…
Listado em Community GitHub marketplaces (5)
-
Set up evaluation of an OpenAI Java SDK tool-calling agent using Dokimos
-
Decide, design, gate, judge, and defend evaluations for LLM, agent, and retrieval systems. Not ordinary unit tests.
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
frootai-evaluation-skills
FrootAI evaluation skills — benchmarking, test generation, load testing, SLA checks, and quality gates. (152 skills)
-
Govern and audit AI agent systems with policy enforcement, OWASP Agentic Security Initiative controls, supply-chain integrity, and evidence-quality gates. Use when designing…
Listado em Copilot CLI: github/awesome-copilot (5)
-
Run a lightweight, role-separated AI development team with flexible tools, developer-selected models, proportionate planning, and optional QA.
-
Three-layer verification pipeline for AI output. Extracts claims, finds sources, and flags hallucination risks so humans can verify before acting.
-
A runtime-portable 5-agent quality gate that adjudicates text artifacts before they ship. Five role-conditioned LLM deliberators run a 2-round async protocol with cross-read…
-
Task Researcher and Task Planner for intermediate to expert users and large codebases - Brought to you by microsoft/edge-ai
-
Microsoft Copilot Studio plugins for AI coding agents
Listado em Copilot CLI: github/copilot-plugins (5)
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
workiq-productivity
WorkIQ productivity skills powered by the local WorkIQ CLI — read-only insights across email, meetings, calendar, Teams, SharePoint, projects, and people.
-
workiq
Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.
-
Advanced Security plugin for GitHub Copilot.
-
model-apps
Build and deploy Power Apps generative pages for model-driven apps with specialist agents for planning, entity creation, and parallel code generation. Requires PAC CLI >= 2.7.0…
Listado em Cursor: cursor/plugins (5)
-
Iterative self-referential AI loops using the Ralph Wiggum technique.
-
Consult a stronger model before major decisions, when stuck, and before declaring done.
-
Incremental transcript-driven memory updates for AGENTS.md using high-signal bullet points only.
-
CLI-backed repo compatibility scans plus agents that audit startup, validation, and docs against reality.
-
Patterns for designing CLIs that coding agents can run reliably: flags, help with examples, pipelines, errors, idempotency, dry-run.
Listado em Docker MCP Catalog (5)
-
Wayfound’s MCP server allows business users to govern, supervise, and improve AI Agents.
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Sequential Thinking (Reference)
Dynamic and reflective problem-solving through thought sequences.
-
Bridges multiple AI models and CLIs, enabling orchestrated workflows across Claude Code, Gemini CLI, Codex CLI, and other AI development tools.
-
Documentation on AgentCore platform services.
Listado em Official MCP Registry (5)
-
Evaluate, benchmark, and simulate AI agents on the VerifyAX agent-evaluation platform.
-
Score any website's AI-agent readiness. Open Agent Registry scanner + platform tools.
-
IA-QA — 130+ QA & Dev Tools for AI Agents
130+ QA & dev tools for AI agents: prompt injection, RAG testing, VLM eval, guardrails. Free.
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
Discover public AI agents, reusable recipes, and trusted benchmark evidence by task.
Listado em npm registry (MCP servers) (5)
-
One workspace for every AI coding assistant. Shared tasks, memory, and governance.
-
mcp com.dechonet/mcp
30 security tools for AI agents: phishing links, exposure maps, DNS, SSL, PQC, history, pivots.
-
dealflowpro io.github.jbechtel-97/dealflowpro
Multifamily real estate deal analysis — cap rate, DSCR, IRR, DFP Score, max offer price
-
depwire io.github.atef-ataya/depwire
Dependency graph + 24 MCP tools. Impact analysis, simulation, security, agent coordination
-
Browser-local and CLI static evidence for deployed AI model artifacts.
Encontrados pelo significado, não por código ou repositório em comum: plugins semelhantes continuam sendo produtos distintos, e isto não é uma avaliação nem uma recomendação.
Quer esta marca no seu plugin em nosso catálogo?
Prove que o mantém com um arquivo no repositório, um arquivo no seu domínio ou um registro DNS, e você poderá mostrar esta marca na ficha, com banners ao vivo para o seu site e o README. Como funciona a verificação
Você também recebe alertas quando um marketplace o publica, o remove, muda a marca de verificado ou o que ele pede, e o endpoint remoto passa a ser monitorado como um serviço web.
Dados de Community GitHub marketplaces. Os números vêm das nossas próprias passagens regulares pelos marketplaces, última leitura em . Não publicamos dados de contato dos editores de plugins.