Ext Ops Panel
Open dashboard

io.github.RudrenduPaul/inferbench

Benchmarks local LLM inference speed (tokens/sec) on your own hardware via MCP tools.

MCP server · by RudrenduPaul

About

io.github.RudrenduPaul/inferbench is an MCP server published by RudrenduPaul. Marketplaces we read that list it: 1 (Official MCP Registry). We first saw it on 2026-10-11 and have recorded no change since. As of our marketplace pass on 2026-10-12.

What it asks for

  • Runs on your machine

None of the marketplaces we read publishes its tools or the settings it asks for.

What it declares, asks for and runs, in full

Only install plugins from developers you trust. We list what marketplaces publish and do not test plugins.

Works with

  • Claude Code
  • Codex
  • Cursor
  • VS Code
  • Copilot CLI

A one-click link opens the client, which asks you to confirm before it adds the server.

From the marketplaces that list it and the MCP transport it declares, as each client documents them. We do not test plugins.

Connect

Commands and configs built only from what its marketplaces declare. We do not run them for you and do not test plugins.

As a local MCP server: PyPI package

Built from what Official MCP Registry declares.

Claude CodeTerminal
claude mcp add --transport stdio inferbench -- uvx inferbench-cli
Codex~/.codex/config.toml
[mcp_servers.inferbench]
command = "uvx"
args = ["inferbench-cli"]
Cursor~/.cursor/mcp.json
{
  "mcpServers": {
    "inferbench": {
      "command": "uvx",
      "args": [
        "inferbench-cli"
      ]
    }
  }
}

We do not store launch arguments. If the server needs any, its own documentation names them.

Where it is published

MarketplaceStatusVersionFiguresVerifiedFirst seen
Official MCP Registry (Open the registry record) Listed 0.1.7 Forks (GitHub): 0
Stars (GitHub): 0
Not marked

Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.

What changed

Nothing has moved on this plugin since we started watching it.

Similar plugins

Products whose own names, descriptions, tools and skills are closest in meaning to this one, on every marketplace we read. Closeness is ranked within this list only.

  • metrillm io.github.MetriLLM/metrillm

    Benchmark local LLM models — speed, quality & hardware fitness verdict from any MCP client

    by MetriLLM · MCP server

    Listed on: Official MCP Registry · Describes nearly the same job

  • llmtest-mcp io.github.tjacquesson/llmtest-mcp

    Benchmark AI models on real prompts. Find cheaper, faster alternatives across 340+ models.

    by tjacquesson · MCP server

    Listed on: Official MCP Registry · Describes nearly the same job

  • ComputeSage StackBench

    GPU and LLM inference benchmarks, hardware evidence, deployment recommendations, and launch configs.

    by computesage.com · MCP server

    Listed on: Official MCP Registry · Describes nearly the same job

  • vetted-consumer io.github.TheBaronofAI/vetted-consumer

    Will a local LLM run on your hardware? GGUF quant, buy-vs-rent-vs-API cost, used-GPU prices.

    by TheBaronofAI · MCP server

    Listed on: Official MCP Registry · Describes nearly the same job

  • Ollama / vLLM Bridge

    Call your local Ollama or vLLM model over MCP with schema-validated JSON output

    by setheerwagen · MCP server

    Listed on: Official MCP Registry · Describes nearly the same job

  • evalscopebench-mcp com.clauxel.evalscopebench/evalscopebench-mcp

    A paid remote MCP for AI SDK benchmark dashboard, built to return verdicts, receipts, usage logs, an

    by evalscopebench.clauxel.com · MCP server

    Listed on: Official MCP Registry · Describes a similar job

  • quelllm-mcp io.github.MGM-FALCON/quelllm-mcp

    MCP server for quelllm.fr: 190+ open-weights LLM catalog - list, compare, VRAM and cost estimates

    by MGM-FALCON · MCP server

    Listed on: Official MCP Registry · Describes a similar job

  • Inference AIops

    Governed GPU inference ops (vLLM + Ray Serve): latency RCA, scaling, drain, 39 tools.

    by AIops-tools · MCP server

    Listed on: Official MCP Registry · Describes a similar job

  • hardware-probe io.github.yamaru-eu/hardware-probe

    Hardware probe for performance diagnostics, thermal monitoring, and LLM optimization.

    by yamaru-eu · MCP server

    Listed on: Official MCP Registry · Describes a similar job

  • qsp-mcp io.github.qso-graph/qsp-mcp

    QSP — relay MCP tools to any OpenAI-compatible local LLM (llama.cpp, Ollama, vLLM)

    by qso-graph · MCP server

    Listed on: Official MCP Registry · Describes a similar job

Similar plugins by marketplace

The same question asked of one marketplace at a time: is there an analog of this plugin there?

Has a listing on Claude Code: claude-plugins-community (5)
  • llmprobe

    Synthetic monitoring for LLM inference endpoints. Probe TTFT, latency, throughput, and errors across OpenAI, Anthropic, Google, Azure, Bedrock, and any OpenAI-compatible server.

    by Jwrede · Plugin bundle

    Listed on: Claude Code: claude-plugins-community · Describes nearly the same job

  • llm-gateway

    Multi-LLM orchestration MCP server. Delegate tasks to Claude Code, Codex, and Gemini CLIs with session management, retry logic, async job orchestration, and token optimization.

    by verivus-oss · Plugin bundle

    Listed on: Claude Code: claude-plugins-community · Describes nearly the same job

  • vynn-mcp io.github.beee003/vynn-mcp

    Self-improving AI workflows with backtesting, prompt optimization, and scheduling

    by beee003 · MCP server

    Listed on: Official MCP Registry, Claude Code: claude-plugins-community · Describes nearly the same job

  • model-advisor

    Claude model selection advisor — recommends optimal model for each task via shell hook. Zero attack surface.

    by Jaace · Plugin bundle

    Listed on: Claude Code: claude-plugins-community · Describes nearly the same job

  • NVIDIA Skills

    Find the right NVIDIA skill for GPU acceleration, CUDA, AI agents, data loading, training, inference, robotics, Physical AI, Omniverse, simulation, and other NVIDIA-powered…

    by NVIDIA · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Claude Code: claude-plugins-community · Describes nearly the same job

Has a listing on Claude Code: claude-plugins-official (5)
  • amd-skills

    AMD's verified Agent Skills in one plugin: route image/audio through local AI on Ryzen AI, serve LLMs on AMD Instinct GPUs with vLLM, optimize inference throughput with Hyperloom…

    by amd · Plugin bundle

    Listed on: Claude Code: claude-plugins-official · Describes nearly the same job

  • NVIDIA Skills

    Find the right NVIDIA skill for GPU acceleration, CUDA, AI agents, data loading, training, inference, robotics, Physical AI, Omniverse, simulation, and other NVIDIA-powered…

    by NVIDIA · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Claude Code: claude-plugins-community · Describes nearly the same job

  • huggingface-skills

    Build, train, evaluate, and use open source AI models, datasets, and spaces.

    by huggingface · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Claude Code: claude-plugins-community · Describes nearly the same job

  • codspeed

    CodSpeed is the all-in-one performance testing toolkit. Dive into benchmarking results, flamegraphs, and performance comparisons — give Claude granular profiling context to…

    by CodSpeedHQ · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Community GitHub marketplaces, Claude Code: claude-plugins-community · Describes nearly the same job

  • togetherai-skills

    Agent Skills for Together AI platform — inference, training, embeddings, audio, video, images, function calling, and infrastructure. Covers serverless chat completions…

    by togethercomputer · Plugin bundle

    Listed on: Claude Code: claude-plugins-official · Describes nearly the same job

Has a listing on Claude: knowledge-work-plugins (5)
  • langfuse

    Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.

    by langfuse · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Claude Code: claude-plugins-community · Describes nearly the same job

  • datarobot-agent-skills

    DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…

    by datarobot-oss · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Community GitHub marketplaces · Describes nearly the same job

  • qdrant-skills

    Agent skills for Qdrant vector search covering scaling, performance optimization, search quality, monitoring, deployment, model migration, version upgrades, and SDK usage across…

    by qdrant · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Claude Code: claude-plugins-community · Describes nearly the same job

  • Grafana Cloud MCP

    Hosted MCP server for AI-assisted Grafana Cloud observability — no local installation required.

    by grafana · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins · Describes nearly the same job

  • figma

    Figma design platform integration. Access design files, extract component information, read design tokens, and translate designs into code. Bridge the gap between design and…

    by figma · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Official MCP Registry, Claude: knowledge-work-plugins, Copilot CLI: github/awesome-copilot · Describes nearly the same job

Has a listing on Codex: openai-curated (openai/plugins) (5)
  • NVIDIA

    Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…

    by NVIDIA · Plugin bundle

    Listed on: Codex: openai-curated (openai/plugins) · Describes nearly the same job

  • Plugin Eval

    Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.

    by OpenAI Codex · Plugin bundle

    Listed on: Codex: openai-curated (openai/plugins) · Describes nearly the same job

  • OpenAI Developers

    Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.

    by OpenAI · Plugin bundle

    Listed on: Codex: openai-curated (openai/plugins) · Describes nearly the same job

  • Datadog (Preview)

    Available for US1 customers only. Analyze, investigate, and act on your Datadog telemetry directly from ChatGPT using natural language. Ask questions about your production…

    by Datadog · Plugin bundle

    Listed on: Codex: openai-curated (openai/plugins) · Describes nearly the same job

  • Cloudflare

    Cloudflare platform plugin with curated skills for Workers, Wrangler, and Agents SDK plus the official Cloudflare API MCP server.

    by Cloudflare · Plugin bundle

    Listed on: Codex: openai-curated (openai/plugins) · Describes nearly the same job

Has a listing on Community GitHub marketplaces (5)
  • amd-skills

    AMD's verified Agent Skills in one plugin: route image/audio through local AI on Ryzen AI, serve LLMs on AMD Instinct GPUs with vLLM, optimize inference throughput with Hyperloom…

    by amd · Plugin bundle

    Listed on: Community GitHub marketplaces · Describes nearly the same job

  • codspeed

    CodSpeed is the all-in-one performance testing toolkit. Dive into benchmarking results, flamegraphs, and performance comparisons — give Claude granular profiling context to…

    by CodSpeedHQ · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Community GitHub marketplaces, Claude Code: claude-plugins-community · Describes nearly the same job

  • Dash0 Observability

    OpenTelemetry observability for OpenAI Codex sessions. Captures prompts, tool calls, MCP calls, sub-agent activity, and token usage as OTel traces.

    by Dash0 · Plugin bundle

    Listed on: Community GitHub marketplaces · Describes nearly the same job

  • sagemaker-ai

    Build, train, and deploy AI models with deep AWS AI/ML expertise brought directly into your coding assistants, covering the surface area of Amazon SageMaker AI.

    by awslabs · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Community GitHub marketplaces · Describes nearly the same job

  • DeepEval

    Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.

    by confident-ai · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Community GitHub marketplaces · Describes nearly the same job

Has a listing on Copilot CLI: github/awesome-copilot (5)
  • BLEA

    Safe BLE diagnostics, evidence workflows, and guarded automation for AI agents.

    by Nitmi · MCP server

    Listed on: Official MCP Registry, Copilot CLI: github/awesome-copilot · Describes nearly the same job

  • ai-team-orchestration

    Run a lightweight, role-separated AI development team with flexible tools, developer-selected models, proportionate planning, and optional QA.

    by Denis Evdokimov · Plugin bundle

    Listed on: Copilot CLI: github/awesome-copilot · Describes nearly the same job

  • go-mcp-development

    Complete toolkit for building Model Context Protocol (MCP) servers in Go using the official github.com/modelcontextprotocol/go-sdk. Includes instructions for best practices, a…

    by Awesome Copilot Community · Plugin bundle

    Listed on: Copilot CLI: github/awesome-copilot · Describes nearly the same job

  • typescript-mcp-development

    Complete toolkit for building Model Context Protocol (MCP) servers in TypeScript/Node.js using the official SDK. Includes instructions for best practices, a prompt for generating…

    by Awesome Copilot Community · Plugin bundle

    Listed on: Copilot CLI: github/awesome-copilot · Describes nearly the same job

  • kotlin-mcp-development

    Complete toolkit for building Model Context Protocol (MCP) servers in Kotlin using the official io.modelcontextprotocol:kotlin-sdk library. Includes instructions for best…

    by Awesome Copilot Community · Plugin bundle

    Listed on: Copilot CLI: github/awesome-copilot · Describes nearly the same job

Has a listing on Copilot CLI: github/copilot-plugins (5)
  • microsoft-365-agents-toolkit

    Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.

    by microsoft · Plugin bundle

    Listed on: Copilot CLI: github/copilot-plugins · Describes nearly the same job

  • build-perf-cpp

    Analyze MSVC build performance using vcperf.exe and ETL traces.

    by Ion Todirel and Eve Silfanus · Plugin bundle

    Listed on: Copilot CLI: github/copilot-plugins · Describes nearly the same job

  • cpp-language-server

    Navigate and interact with your C++ code using the Microsoft C++ Language Server.

    by microsoft · Plugin bundle

    Listed on: Copilot CLI: github/copilot-plugins · Describes nearly the same job

  • mcp-apps

    Generate MCP App widgets for MCP tools. Produces self-contained HTML widgets using the MCP Apps protocol.

    by microsoft · Plugin bundle

    Listed on: Copilot CLI: github/copilot-plugins · Describes nearly the same job

  • advanced-security

    Advanced Security plugin for GitHub Copilot.

    by github · Plugin bundle

    Listed on: Copilot CLI: github/copilot-plugins · Describes nearly the same job

Has a listing on Cursor: cursor/plugins (5)
  • Orchestrate

    Fan large tasks out across parallel cloud agents with planners, workers, verifiers, and structured handoffs.

    by Cursor · Plugin bundle

    Listed on: Cursor: cursor/plugins · Describes nearly the same job

  • Cursor SDK

    Build apps, scripts, and automations with the TypeScript SDK.

    by Cursor · Plugin bundle

    Listed on: Cursor: cursor/plugins · Describes nearly the same job

  • Ralph Loop

    Iterative self-referential AI loops using the Ralph Wiggum technique.

    by Cursor · Plugin bundle

    Listed on: Cursor: cursor/plugins · Describes nearly the same job

  • pstack

    if you want to go fast, go deep first. pstack helps you write less, but higher quality code. rigorous agent workflows you can parallelize with confidence.

    by Lauren Tan · Plugin bundle

    Listed on: Cursor: cursor/plugins · Describes nearly the same job

  • Agent Compatibility

    CLI-backed repo compatibility scans plus agents that audit startup, validation, and docs against reality.

    by Cursor · Plugin bundle

    Listed on: Cursor: cursor/plugins · Describes nearly the same job

Has a listing on Docker MCP Catalog (5)
  • Opik

    Read and score Opik traces, experiments, datasets and prompts from your AI assistant.

    by comet-ml · MCP server

    Listed on: Official MCP Registry, Docker MCP Catalog · Describes nearly the same job

  • Zen

    Bridges multiple AI models and CLIs, enabling orchestrated workflows across Claude Code, Gemini CLI, Codex CLI, and other AI development tools.

    by BeehiveInnovations · MCP server

    Listed on: Docker MCP Catalog · Describes nearly the same job

  • testkube-mcp io.github.kubeshop/testkube-mcp

    MCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants

    by kubeshop · MCP server

    Listed on: Official MCP Registry, Docker MCP Catalog · Describes nearly the same job

  • E2B

    Giving Claude ability to run code with E2B via MCP (Model Context Protocol).

    by e2b-dev · MCP server

    Listed on: Docker MCP Catalog · Describes nearly the same job

  • Polar Signals

    MCP server for Polar Signals Cloud continuous profiling platform, enabling AI assistants to analyze CPU performance, memory usage, and identify optimization opportunities in…

    by docker · MCP server

    Listed on: Docker MCP Catalog · Describes nearly the same job

Has a listing on Official MCP Registry (5)
  • metrillm io.github.MetriLLM/metrillm

    Benchmark local LLM models — speed, quality & hardware fitness verdict from any MCP client

    by MetriLLM · MCP server

    Listed on: Official MCP Registry · Describes nearly the same job

  • llmtest-mcp io.github.tjacquesson/llmtest-mcp

    Benchmark AI models on real prompts. Find cheaper, faster alternatives across 340+ models.

    by tjacquesson · MCP server

    Listed on: Official MCP Registry · Describes nearly the same job

  • ComputeSage StackBench

    GPU and LLM inference benchmarks, hardware evidence, deployment recommendations, and launch configs.

    by computesage.com · MCP server

    Listed on: Official MCP Registry · Describes nearly the same job

  • vetted-consumer io.github.TheBaronofAI/vetted-consumer

    Will a local LLM run on your hardware? GGUF quant, buy-vs-rent-vs-API cost, used-GPU prices.

    by TheBaronofAI · MCP server

    Listed on: Official MCP Registry · Describes nearly the same job

  • Ollama / vLLM Bridge

    Call your local Ollama or vLLM model over MCP with schema-validated JSON output

    by setheerwagen · MCP server

    Listed on: Official MCP Registry · Describes nearly the same job

Found by meaning, not by shared code or a shared repository: similar plugins stay separate products, and this is not a review or a recommendation.

Is this your plugin?

Add it to your projects and prove you maintain it with a file in its repository, a file on your domain or a DNS record. You get alerts when a marketplace lists it, drops it, changes its verified mark or what it asks for, and its remote endpoint goes on monitoring as a web service.

Data comes from the Official MCP Registry (registry.modelcontextprotocol.io), CC0 1.0. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.

Where the data comes from: how the catalog is built