llm-eval
Generate LLM evaluation and benchmarking
Paquete de plugins · de barnburner121
Resumen
llm-eval es un paquete de plugins para herramientas de programación con IA publicado por barnburner121. Marketplaces que leemos y que lo publican: 1 (Community GitHub marketplaces). Lo vimos por primera vez el 2026-10-14 y desde entonces no hemos registrado cambios. Según nuestra pasada por los marketplaces del 2026-10-14.
Qué pide
- Se ejecuta en tu equipo
Ninguno de los marketplaces que leemos publica sus herramientas ni los ajustes que pide.
Lo que declara, pide y ejecuta, completo
Instala solo plugins de desarrolladores en los que confíes. Mostramos lo que publican los marketplaces y no probamos plugins.
Funciona con
- Claude Code
Según los marketplaces que lo listan y el transporte MCP que declara, tal como lo documenta cada cliente. No probamos plugins.
Conectar
Comandos y configuraciones generados solo a partir de lo que declaran sus marketplaces. No los ejecutamos por ti ni probamos plugins.
Como plugin de Claude Code
Generado a partir de lo que declara Community GitHub marketplaces.
/plugin marketplace add barnburner121/claude-plugin-marketplace
/plugin install llm-eval@barnburner121-pluginsDónde está publicado
| Marketplace | Estado | Versión | Cifras | Verificado | Visto por primera vez |
|---|---|---|---|---|---|
| Marketplace de la comunidad barnburner121/claude-plugin-marketplace (Abrir el código en GitHub) | Publicado | 1.0.0 | Sin cifra publicada | Sin marca |
Cada cifra es del propio marketplace y nunca se suma entre marketplaces. Un marketplace que no publica cifras no muestra ninguna: sin número no es cero.
Figura en un marketplace de la comunidad
| Marketplace | Repositorio | Estrellas (GitHub) |
|---|---|---|
| barnburner121-plugins | barnburner121/claude-plugin-marketplace | 3 |
Qué contiene el paquete
Tal como se publica en Community GitHub marketplaces.
Servidores MCP: 1
plugin-hub
Skills: 1
llm-eval
Qué cambió
- Pasó a ser un producto que seguimos
- Community GitHub marketplaces: apareció
Posiblemente el mismo plugin
Fichas que comparten una señal con esta, pero no lo suficiente para tratarlas como el mismo producto.
Plugins similares
Productos cuyos propios nombres, descripciones, herramientas y skills son los más cercanos a este por su significado, en todos los marketplaces que leemos. La cercanía se ordena solo dentro de esta lista.
-
Compare text LLMs across OpenRouter, Bedrock, Vertex AI and Foundry with automated grading.
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
IA-QA — 130+ QA & Dev Tools for AI Agents
130+ QA & dev tools for AI agents: prompt injection, RAG testing, VLM eval, guardrails. Free.
-
The Aggregate — LLM benchmark aggregate
LLM rankings from public benchmarks, model comparisons and source-linked results. Updated daily.
-
Pay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.
-
llm-observability-orchestration-agent-langchain-community ai.getvda/llm-observability-orchestration-agent-langchain-community
LLM Observability & Orchestration Agent (LangChain Community)
-
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…
-
mcp-server io.github.arkheiaai/mcp-server
Detect fabrication and hallucination in any LLM output. 30+ models supported.
-
Evaluate, benchmark, and simulate AI agents on the VerifyAX agent-evaluation platform.
-
Trace inspection, failure diagnosis, and replay-driven iteration for AI-powered code. Instrument your LLM calls, build regression datasets, and measure improvements — all inside…
Plugins similares por marketplace
La misma pregunta a cada marketplace por separado: ¿hay allí un equivalente de este plugin?
Publicado en Claude Code: claude-plugins-community (5)
-
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…
-
Trace inspection, failure diagnosis, and replay-driven iteration for AI-powered code. Instrument your LLM calls, build regression datasets, and measure improvements — all inside…
-
Skills to streamline adoption and usage of Giskard products (OSS, Hub, Guards) for testing, evaluating, and red-teaming AI agents.
-
Claude model selection advisor — recommends optimal model for each task via shell hook. Zero attack surface.
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
Publicado en Claude Code: claude-plugins-official (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
Build, train, evaluate, and use open source AI models, datasets, and spaces.
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
Output.ai workflow development toolkit for Claude Code. Adds 5 specialist agents (planner, builder, debugger, prompt writer, quality reviewer), 40+ slash-command skills covering…
Publicado en Claude: knowledge-work-plugins (5)
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
AI-first project auditor and re-engineer based on the 9 design principles and 7 design patterns from the TechWolf AI-First Bootcamp
-
Build multimodal AI applications with Pixeltable -- tables, computed columns, embedding search, UDFs, tool-calling agents, and 25+ AI provider integrations.
-
Atlan data catalog plugin for Claude Code. Search, explore, govern, and manage your data assets through natural language. Powered by the Atlan MCP server with semantic search…
Publicado en Codex: openai-curated (openai/plugins) (5)
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
-
Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…
-
An agentic skills framework & software development methodology that works: planning, TDD, debugging, and collaboration workflows.
-
AI-powered code review in Codex, powered by CodeRabbit.
Publicado en Community GitHub marketplaces (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Trace inspection, failure diagnosis, and replay-driven iteration for AI-powered code. Instrument your LLM calls, build regression datasets, and measure improvements — all inside…
-
A catalogue of LLM and agent anti-patterns, and the corrections for them
-
Multi-model LLM Council and parallel AI window for Claude Code. Fork any model, fold results back.
-
Multi-LLM orchestration MCP server. Delegate tasks to Claude Code, Codex, and Gemini CLIs with session management, retry logic, async job orchestration, and token optimization.
Publicado en Copilot CLI: github/awesome-copilot (5)
-
Run a lightweight, role-separated AI development team with flexible tools, developer-selected models, proportionate planning, and optional QA.
-
Three-layer verification pipeline for AI output. Extracts claims, finds sources, and flags hallucination risks so humans can verify before acting.
-
Task Researcher and Task Planner for intermediate to expert users and large codebases - Brought to you by microsoft/edge-ai
-
A runtime-portable 5-agent quality gate that adjudicates text artifacts before they ship. Five role-conditioned LLM deliberators run a 2-round async protocol with cross-read…
-
Goal-driven task orchestration with independent verification. Interviews the user to define a clear goal, then loops between a Builder subagent (does the work) and an Inspector…
Publicado en Copilot CLI: github/copilot-plugins (5)
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
Advanced Security plugin for GitHub Copilot.
-
model-apps
Build and deploy Power Apps generative pages for model-driven apps with specialist agents for planning, entity creation, and parallel code generation. Requires PAC CLI >= 2.7.0…
-
workiq
Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.
-
Bring Azure DevOps work-item, repository, and pull-request workflows into GitHub Copilot.
Publicado en Cursor: cursor/plugins (5)
-
Iterative self-referential AI loops using the Ralph Wiggum technique.
-
Consult a stronger model before major decisions, when stuck, and before declaring done.
-
Incremental transcript-driven memory updates for AGENTS.md using high-signal bullet points only.
-
Build apps, scripts, and automations with the TypeScript SDK.
-
Fan large tasks out across parallel cloud agents with planners, workers, verifiers, and structured handoffs.
Publicado en Docker MCP Catalog (5)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Discovers and retrieves llms.txt from websites.
-
Bridges multiple AI models and CLIs, enabling orchestrated workflows across Claude Code, Gemini CLI, Codex CLI, and other AI development tools.
-
Provides tools to search and retrieve Google Gemini API documentation.
-
Tools for interacting with Hugging Face models, datasets, research papers, and more.
Publicado en Official MCP Registry (5)
-
Compare text LLMs across OpenRouter, Bedrock, Vertex AI and Foundry with automated grading.
-
IA-QA — 130+ QA & Dev Tools for AI Agents
130+ QA & dev tools for AI agents: prompt injection, RAG testing, VLM eval, guardrails. Free.
-
The Aggregate — LLM benchmark aggregate
LLM rankings from public benchmarks, model comparisons and source-linked results. Updated daily.
-
Pay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.
-
llm-observability-orchestration-agent-langchain-community ai.getvda/llm-observability-orchestration-agent-langchain-community
LLM Observability & Orchestration Agent (LangChain Community)
Encontrados por significado, no por código ni repositorio compartidos: los plugins similares siguen siendo productos distintos, y esto no es una reseña ni una recomendación.
¿Es tu plugin?
Añádelo a tus proyectos y demuestra que lo mantienes con un archivo en su repositorio, un archivo en tu dominio o un registro DNS. Recibirás avisos cuando un marketplace lo publique, lo retire, cambie su marca verificada o lo que pide, y su endpoint remoto quedará monitorizado como un servicio web.
Datos de Community GitHub marketplaces. Las cifras proceden de nuestros propios recorridos periódicos por los marketplaces, leída por última vez el . No publicamos datos de contacto de los editores de plugins.