llmprobe
Synthetic monitoring for LLM inference endpoints. Probe TTFT, latency, throughput, and errors across OpenAI, Anthropic, Google, Azure, Bedrock, and any OpenAI-compatible server.
Plugin bundle · by Jwrede
About
llmprobe is a plugin bundle for AI coding tools published by Jwrede. Marketplaces we read that list it: 1 (Claude Code: claude-plugins-community). We first saw it on 2026-10-11 and have recorded no change since. As of our marketplace pass on 2026-10-12.
What it asks for
- Installs as a plugin bundle
None of the marketplaces we read publishes its tools or the settings it asks for.
What it declares, asks for and runs, in full
Only install plugins from developers you trust. We list what marketplaces publish and do not test plugins.
Connect
No data for an automatic command: what its marketplaces declare does not say unambiguously how to connect it.
Where it is published
| Marketplace | Status | Version | Figures | Verified | First seen |
|---|---|---|---|---|---|
| Claude Code: claude-plugins-community (Open the source on GitHub) | Listed | 1.4.0 | Forks (GitHub): 0 Stars (GitHub): 7 |
Not marked |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
What the bundle contains
As published on Claude Code: claude-plugins-community.
MCP servers: 1
llmprobe
What changed
Nothing has moved on this plugin since we started watching it.
Similar plugins
Products whose own names, descriptions, tools and skills are closest in meaning to this one, on every marketplace we read. Closeness is ranked within this list only.
-
Ping 134+ free coding LLMs across 17 providers, rank by latency, pick the fastest.
-
Test and compare prompts across any AI provider. Bring your own keys.
-
noveum ai.noveum/noveum
Trace, evaluate, and optimize your LLM, RAG, and agent apps with Noveum observability.
-
Cross-vendor SaaS status aggregator for AI agents (Anthropic/OpenAI/AWS/GH/Stripe/CF).
-
llm-observability-orchestration-agent-langchain-community ai.getvda/llm-observability-orchestration-agent-langchain-community
LLM Observability & Orchestration Agent (LangChain Community)
-
Agent tracing, cost tracking, anomaly detection for LLM agents
-
apidrift com.edgethirteen.www/apidrift
Alerts on breaking changes, deprecations, and pricing shifts across major LLM provider APIs.
-
prismix-status-mcp io.github.Prismor/prismix-status-mcp
Real-time status for 75+ AI services (OpenAI, Anthropic, Cursor). No auth, CORS-enabled.
-
divlens io.github.Lohithry/divlens
Real-time system diagnostics for AI agents — CPU, RAM, disk, network, hardware health. 17 tools.
-
llm-observability-orchestration-agent-langchain ai.getvda/llm-observability-orchestration-agent-langchain
LLM Observability & Orchestration Agent (Langchain)
Similar plugins by marketplace
The same question asked of one marketplace at a time: is there an analog of this plugin there?
Has a listing on Claude Code: claude-plugins-community (5)
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
OpenTelemetry observability for Claude Code sessions. Captures tool calls, LLM invocations, token usage, and errors as OTel traces. Send telemetry to Dash0 or any…
-
The MCP-native AI API gateway for developers building with LLMs. Every app using AI needs API keys, cost control, and provider flexibility — Styx gives you all three through one…
-
Compliance-first LLM gateway for Claude Code. Policy-as-code enforcement (YAML policy definitions), tamper-evident audit trails, PII redaction, token budget enforcement, and…
-
Langfuse observability plugin for Claude Code — captures and exports traces, spans, and session telemetry from Claude Code to Langfuse for LLM monitoring, debugging, and evaluation
Has a listing on Claude Code: claude-plugins-official (5)
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
OpenTelemetry observability for Claude Code sessions. Captures tool calls, LLM invocations, token usage, and errors as OTel traces. Send telemetry to Dash0 or any…
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Langfuse observability plugin for Claude Code — captures and exports traces, spans, and session telemetry from Claude Code to Langfuse for LLM monitoring, debugging, and evaluation
-
Dynatrace observability skills: DQL query patterns, application and infrastructure monitoring, log analysis, problem investigation, and incident response workflows, with the…
Has a listing on Claude: knowledge-work-plugins (5)
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
Use Datadog directly in Claude Code through a preconfigured Datadog MCP server. Query logs, metrics, traces, dashboards, and more through natural conversation. This plugin is in…
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
Hosted MCP server for AI-assisted Grafana Cloud observability — no local installation required.
-
Official SigNoz plugin for MCP setup, docs, queries, dashboards, and alerts
Has a listing on Codex: openai-curated (openai/plugins) (5)
-
Available for US1 customers only. Analyze, investigate, and act on your Datadog telemetry directly from ChatGPT using natural language. Ask questions about your production…
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
-
Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Cloudflare platform plugin with curated skills for Workers, Wrangler, and Agents SDK plus the official Cloudflare API MCP server.
Has a listing on Community GitHub marketplaces (5)
-
Dash0 Observability
OpenTelemetry observability for OpenAI Codex sessions. Captures prompts, tool calls, MCP calls, sub-agent activity, and token usage as OTel traces.
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Accurate API model IDs, pricing, and specs for 46 models across 7 AI providers.
-
Dynatrace observability skills: DQL query patterns, application and infrastructure monitoring, log analysis, problem investigation, and incident response workflows, with the…
-
Build, deploy, and operate AI agents on AWS. Skills for scaffolding agents with Amazon Bedrock AgentCore, connecting tools, memory, policies, evaluation, debugging, and production…
Has a listing on Copilot CLI: github/awesome-copilot (5)
-
See your local Copilot token usage by day, model, and session, and get tips to use it more efficiently.
-
Arize AX platform skills for LLM observability, evaluation, and optimization. Includes trace export, instrumentation, datasets, experiments, evaluators, AI provider integrations…
-
Use Datadog directly in Copilot / VS Code through a preconfigured Datadog MCP server. Query logs, metrics, traces, dashboards, and more through natural conversation.
-
Phoenix AI observability skills for LLM application debugging, evaluation, and tracing. Includes CLI debugging tools, LLM evaluation workflows, and OpenInference tracing…
-
Run a lightweight, role-separated AI development team with flexible tools, developer-selected models, proportionate planning, and optional QA.
Has a listing on Copilot CLI: github/copilot-plugins (5)
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
Advanced Security plugin for GitHub Copilot.
-
Bring Azure DevOps work-item, repository, and pull-request workflows into GitHub Copilot.
-
workiq
Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.
-
model-apps
Build and deploy Power Apps generative pages for model-driven apps with specialist agents for planning, entity creation, and parallel code generation. Requires PAC CLI >= 2.7.0…
Has a listing on Cursor: cursor/plugins (5)
-
Inspect and manage feature gates, experiments, dynamic configs, and metrics.
-
Fan large tasks out across parallel cloud agents with planners, workers, verifiers, and structured handoffs.
-
Track AI visibility, sentiment, and citations.
-
CLI-backed repo compatibility scans plus agents that audit startup, validation, and docs against reality.
-
Explore datasets and tables and run SQL queries.
Has a listing on Docker MCP Catalog (5)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Bridges multiple AI models and CLIs, enabling orchestrated workflows across Claude Code, Gemini CLI, Codex CLI, and other AI development tools.
-
Analyze documents, images, videos, and audio.
-
Documentation on AgentCore platform services.
-
Amazon CloudWatch Application Signals
Application performance monitoring and insights.
Has a listing on Official MCP Registry (5)
-
Ping 134+ free coding LLMs across 17 providers, rank by latency, pick the fastest.
-
Test and compare prompts across any AI provider. Bring your own keys.
-
noveum ai.noveum/noveum
Trace, evaluate, and optimize your LLM, RAG, and agent apps with Noveum observability.
-
Cross-vendor SaaS status aggregator for AI agents (Anthropic/OpenAI/AWS/GH/Stripe/CF).
-
llm-observability-orchestration-agent-langchain-community ai.getvda/llm-observability-orchestration-agent-langchain-community
LLM Observability & Orchestration Agent (LangChain Community)
Found by meaning, not by shared code or a shared repository: similar plugins stay separate products, and this is not a review or a recommendation.
Is this your plugin?
Prove you maintain it with a file in its repository, a file on your domain or a DNS record. You get alerts when a marketplace lists it, drops it, changes its verified mark or what it asks for, and can put its remote endpoint on monitoring as a web service.
Data comes from the public marketplace file https://github.com/anthropics/claude-plugins-community/blob/HEAD/.claude-plugin/marketplace.json. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.