io.github.MetriLLM/metrillm
Benchmark local LLM models — speed, quality & hardware fitness verdict from any MCP client
Servidor MCP · de MetriLLM
Resumo
io.github.MetriLLM/metrillm é um servidor MCP publicado por MetriLLM. Marketplaces que lemos e que o listam: 1 (Official MCP Registry). Vimos pela primeira vez em 2026-10-11 e não registramos mudanças desde então. Conforme nossa passagem pelos marketplaces em 2026-10-12.
O que pede
- Roda na sua máquina
Nenhum dos marketplaces que lemos publica as ferramentas ou as configurações que ele pede.
O que declara, pede e executa, por completo
Instale apenas plugins de desenvolvedores em quem você confia. Mostramos o que os marketplaces publicam e não testamos plugins.
Funciona com
- Claude Code
- Codex
- Cursor
- VS Code
- Copilot CLI
Um link de um clique abre o cliente, que pede confirmação antes de adicionar o servidor.
Pelos marketplaces que o listam e pelo transporte MCP que declara, conforme cada cliente documenta. Não testamos plugins.
Conectar
Comandos e configurações gerados apenas a partir do que os marketplaces declaram. Não os executamos por você e não testamos plugins.
Como servidor MCP local: pacote npm
Gerado a partir do que Official MCP Registry declara.
claude mcp add --transport stdio metrillm -- npx -y metrillm-mcp[mcp_servers.metrillm]
command = "npx"
args = ["-y", "metrillm-mcp"]{
"mcpServers": {
"metrillm": {
"command": "npx",
"args": [
"-y",
"metrillm-mcp"
]
}
}
}Não guardamos argumentos de inicialização. Se o servidor precisar de algum, a própria documentação dele os indica.
Onde está publicado
| Marketplace | Status | Versão | Números | Verificado | Visto pela primeira vez |
|---|---|---|---|---|---|
| Official MCP Registry (Abrir o registro) | Listado | 0.2.6 | Forks (GitHub): 1 Estrelas (GitHub): 8 |
Sem marcação |
Cada número é do próprio marketplace e nunca é somado entre marketplaces. Um marketplace que não publica números não mostra nenhum: sem número não é zero.
O que mudou
Nada mudou neste plugin desde que começamos a acompanhá-lo.
Plugins semelhantes
Produtos cujos próprios nomes, descrições, ferramentas e skills são os mais próximos deste pelo significado, em todos os marketplaces que lemos. A proximidade é ordenada apenas dentro desta lista.
-
llmtest-mcp io.github.tjacquesson/llmtest-mcp
Benchmark AI models on real prompts. Find cheaper, faster alternatives across 340+ models.
-
inferbench io.github.RudrenduPaul/inferbench
Benchmarks local LLM inference speed (tokens/sec) on your own hardware via MCP tools.
-
quelllm-mcp io.github.MGM-FALCON/quelllm-mcp
MCP server for quelllm.fr: 190+ open-weights LLM catalog - list, compare, VRAM and cost estimates
-
llm-output-quality-monitor io.github.lazymac2x/llm-output-quality-monitor
Cloudflare Workers MCP server: llm-output-quality-monitor
-
Call your local Ollama or vLLM model over MCP with schema-validated JSON output
-
Access 100+ LLMs with one API: GPT-4, Claude, Gemini, Mistral, and more.
-
Read-only: which local LLMs a GPU or Mac can run - VRAM fit, tokens/sec, model specs.
-
Wraps local Ollama models so bulk generation runs on your own hardware, not a paid API.
-
evalscopebench-mcp com.clauxel.evalscopebench/evalscopebench-mcp
A paid remote MCP for AI SDK benchmark dashboard, built to return verdicts, receipts, usage logs, an
-
vetted-consumer io.github.TheBaronofAI/vetted-consumer
Will a local LLM run on your hardware? GGUF quant, buy-vs-rent-vs-API cost, used-GPU prices.
Plugins semelhantes por marketplace
A mesma pergunta feita a cada marketplace separadamente: existe lá um equivalente deste plugin?
Listado em Claude Code: claude-plugins-community (5)
-
Synthetic monitoring for LLM inference endpoints. Probe TTFT, latency, throughput, and errors across OpenAI, Anthropic, Google, Azure, Bedrock, and any OpenAI-compatible server.
-
Claude model selection advisor — recommends optimal model for each task via shell hook. Zero attack surface.
-
Multi-LLM orchestration MCP server. Delegate tasks to Claude Code, Codex, and Gemini CLIs with session management, retry logic, async job orchestration, and token optimization.
-
vynn-mcp io.github.beee003/vynn-mcp
Self-improving AI workflows with backtesting, prompt optimization, and scheduling
-
eu-ai-act-compliance-mcp io.github.CSOAI-ORG/eu-ai-act-compliance-mcp
Eu Ai Act Compliance MCP Server by MEOK AI Labs
Listado em Claude Code: claude-plugins-official (5)
-
AMD's verified Agent Skills in one plugin: route image/audio through local AI on Ryzen AI, serve LLMs on AMD Instinct GPUs with vLLM, optimize inference throughput with Hyperloom…
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Skills for tracing, evaluating, and improving AI agents with MLflow. Supports the full agent improvement loop: instrument → trace → evaluate → iterate → validate.
-
Build, train, evaluate, and use open source AI models, datasets, and spaces.
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
Listado em Claude: knowledge-work-plugins (5)
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
Agent skills for Qdrant vector search covering scaling, performance optimization, search quality, monitoring, deployment, model migration, version upgrades, and SDK usage across…
-
Hosted MCP server for AI-assisted Grafana Cloud observability — no local installation required.
-
Build multimodal AI applications with Pixeltable -- tables, computed columns, embedding search, UDFs, tool-calling agents, and 25+ AI provider integrations.
Listado em Codex: openai-curated (openai/plugins) (5)
-
Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
-
Available for US1 customers only. Analyze, investigate, and act on your Datadog telemetry directly from ChatGPT using natural language. Ask questions about your production…
-
CrowdStrike Falcon Foundry development skills for building cybersecurity applications on the Falcon platform. Includes UI development, collections, functions, workflows, API…
Listado em Community GitHub marketplaces (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Build, train, and deploy AI models with deep AWS AI/ML expertise brought directly into your coding assistants, covering the surface area of Amazon SageMaker AI.
-
AMD's verified Agent Skills in one plugin: route image/audio through local AI on Ryzen AI, serve LLMs on AMD Instinct GPUs with vLLM, optimize inference throughput with Hyperloom…
-
Accurate API model IDs, pricing, and specs for 46 models across 7 AI providers.
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
Listado em Copilot CLI: github/awesome-copilot (5)
-
Run a lightweight, role-separated AI development team with flexible tools, developer-selected models, proportionate planning, and optional QA.
-
Safe BLE diagnostics, evidence workflows, and guarded automation for AI agents.
-
Arize AX platform skills for LLM observability, evaluation, and optimization. Includes trace export, instrumentation, datasets, experiments, evaluators, AI provider integrations…
-
Complete toolkit for building Model Context Protocol (MCP) servers in Go using the official github.com/modelcontextprotocol/go-sdk. Includes instructions for best practices, a…
-
Phoenix AI observability skills for LLM application debugging, evaluation, and tracing. Includes CLI debugging tools, LLM evaluation workflows, and OpenInference tracing…
Listado em Copilot CLI: github/copilot-plugins (5)
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
mcp-apps
Generate MCP App widgets for MCP tools. Produces self-contained HTML widgets using the MCP Apps protocol.
-
model-apps
Build and deploy Power Apps generative pages for model-driven apps with specialist agents for planning, entity creation, and parallel code generation. Requires PAC CLI >= 2.7.0…
-
Analyze MSVC build performance using vcperf.exe and ETL traces.
-
Navigate and interact with your C++ code using the Microsoft C++ Language Server.
Listado em Cursor: cursor/plugins (5)
-
Fan large tasks out across parallel cloud agents with planners, workers, verifiers, and structured handoffs.
-
Iterative self-referential AI loops using the Ralph Wiggum technique.
-
Build apps, scripts, and automations with the TypeScript SDK.
-
CLI-backed repo compatibility scans plus agents that audit startup, validation, and docs against reality.
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
Listado em Docker MCP Catalog (5)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Bridges multiple AI models and CLIs, enabling orchestrated workflows across Claude Code, Gemini CLI, Codex CLI, and other AI development tools.
-
MCP server providing Prometheus metrics access and PromQL query execution for AI assistants
-
testkube-mcp io.github.kubeshop/testkube-mcp
MCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants
-
Discover and connect to a curated marketplace of MCP servers for extending AI agent capabilities.
Listado em Official MCP Registry (5)
-
llmtest-mcp io.github.tjacquesson/llmtest-mcp
Benchmark AI models on real prompts. Find cheaper, faster alternatives across 340+ models.
-
inferbench io.github.RudrenduPaul/inferbench
Benchmarks local LLM inference speed (tokens/sec) on your own hardware via MCP tools.
-
quelllm-mcp io.github.MGM-FALCON/quelllm-mcp
MCP server for quelllm.fr: 190+ open-weights LLM catalog - list, compare, VRAM and cost estimates
-
llm-output-quality-monitor io.github.lazymac2x/llm-output-quality-monitor
Cloudflare Workers MCP server: llm-output-quality-monitor
-
Call your local Ollama or vLLM model over MCP with schema-validated JSON output
Encontrados pelo significado, não por código ou repositório em comum: plugins semelhantes continuam sendo produtos distintos, e isto não é uma avaliação nem uma recomendação.
Este plugin é seu?
Adicione-o aos seus projetos e prove que o mantém com um arquivo no repositório, um arquivo no seu domínio ou um registro DNS. Você recebe alertas quando um marketplace o publica, o remove, muda a marca de verificado ou o que ele pede, e o endpoint remoto passa a ser monitorado como um serviço web.
Dados de Official MCP Registry. Os números vêm das nossas próprias passagens regulares pelos marketplaces, última leitura em . Não publicamos dados de contato dos editores de plugins.