Ext Ops Panel
Open dashboard

experiment-protocol

Pre-registers a performance study, numerical comparison, parameter sweep, or benchmark: thresholds, tolerances, environment pins, and verdict conditions locked into the validation…

Plugin bundle · by iowarp

About

experiment-protocol is a plugin bundle for AI coding tools published by iowarp. Marketplaces we read that list it: 1 (Community GitHub marketplaces). We first saw it on 2026-10-13 and have recorded no change since. As of our marketplace pass on 2026-10-13.

In its own words, on Community GitHub marketplaces:

Pre-registers a performance study, numerical comparison, parameter sweep, or benchmark: thresholds, tolerances, environment pins, and verdict conditions locked into the validation contract before any measurement. Not for diagnosing a stalled bug; use scientific-debugging.

What it asks for

  • Installs as a plugin bundle

None of the marketplaces we read publishes its tools or the settings it asks for.

What it declares, asks for and runs, in full

Only install plugins from developers you trust. We list what marketplaces publish and do not test plugins.

Works with

  • Claude Code

From the marketplaces that list it and the MCP transport it declares, as each client documents them. We do not test plugins.

Connect

Commands and configs built only from what its marketplaces declare. We do not run them for you and do not test plugins.

As a Claude Code plugin

Built from what Community GitHub marketplaces declares.

Claude CodeInside a Claude Code session
/plugin marketplace add iowarp/clio-kit
/plugin install experiment-protocol@clio-kit

Where it is published

MarketplaceStatusVersionFiguresVerifiedFirst seen
Community marketplace iowarp/clio-kit (Open the source on GitHub) Listed 0.3.1 Forks (GitHub): 5
Stars (GitHub): 8
Not marked

Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.

Listed in one community marketplace
MarketplaceRepositoryStars (GitHub)
clio-kit iowarp/clio-kit 29

Which marketplaces we read and how we check them

What changed

  1. Became a product we track
  2. Community GitHub marketplaces: appeared

Similar plugins

Products whose own names, descriptions, tools and skills are closest in meaning to this one, on every marketplace we read. Closeness is ranked within this list only.

  • scientific-modernization

    Modernizes, ports, rewrites, packages, or replaces established scientific software in independently validated stages against an external scientific oracle, settling compatibility…

    by iowarp · Plugin bundle

    Listed on: Community GitHub marketplaces · Describes nearly the same job

  • scientific-debugging

    Diagnoses stalled or cross-system failures and wrong, NaN, nondeterministic, or unexpectedly slow scientific results through falsifiable hypotheses across distinct fault classes…

    by iowarp · Plugin bundle

    Listed on: Community GitHub marketplaces · Describes nearly the same job

  • aurora-science

    Measurement-science methodology for evaluation: equal engineering baselines, discriminating experiments, certificates, metamorphic evaluation, figures, and research dossiers.

    by AURORA-NEURO · Plugin bundle

    Listed on: Community GitHub marketplaces · Describes nearly the same job

  • tdd

    Builds a feature or fix test-first, red to green at pre-agreed public seams, one vertical slice at a time. Not for designing benchmark criteria; use experiment-protocol.

    by iowarp · Plugin bundle

    Listed on: Community GitHub marketplaces · Describes nearly the same job

  • insight-blueprint

    Hypothesis-driven data analysis workflow and catalog MCP server

    by etoyama · Plugin bundle

    Listed on: Claude Code: claude-plugins-community · Describes nearly the same job

  • prototype

    Answers a design question with throwaway code: a clearly marked, runnable, no-persistence prototype whose verdict is kept and whose code is discarded. Not for pre-registered…

    by iowarp · Plugin bundle

    Listed on: Community GitHub marketplaces · Describes nearly the same job

  • popper-probe

    A research companion based on Karl Popper's philosophy of falsification that interrogates your hypotheses to find what would prove them wrong. It acts like an adversarial…

    by mashathepotato · Plugin bundle

    Listed on: Claude Code: claude-plugins-community · Describes nearly the same job

  • clio-performance

    Work out why a finished job was slower than it should have been.

    by IoWarp Team - Gnosis Research Center · Plugin bundle

    Listed on: Community GitHub marketplaces · Describes nearly the same job

  • preflight

    Know exactly where your system breaks before you ship. Scans codebases, traces service calls, and simulates what happens when real users hit your system. Finds bottlenecks, cost…

    by Nancy-Chauhan · Plugin bundle

    Listed on: Claude Code: claude-plugins-community · Describes nearly the same job

  • ResiliReplay

    Run bounded, deterministic MCP reliability tests and generate executable regressions.

    by aliengineering-byte · MCP server

    Listed on: Official MCP Registry, Community GitHub marketplaces · Describes nearly the same job

Similar plugins by marketplace

The same question asked of one marketplace at a time: is there an analog of this plugin there?

Has a listing on Claude Code: claude-plugins-community (5)
  • insight-blueprint

    Hypothesis-driven data analysis workflow and catalog MCP server

    by etoyama · Plugin bundle

    Listed on: Claude Code: claude-plugins-community · Describes nearly the same job

  • popper-probe

    A research companion based on Karl Popper's philosophy of falsification that interrogates your hypotheses to find what would prove them wrong. It acts like an adversarial…

    by mashathepotato · Plugin bundle

    Listed on: Claude Code: claude-plugins-community · Describes nearly the same job

  • preflight

    Know exactly where your system breaks before you ship. Scans codebases, traces service calls, and simulates what happens when real users hit your system. Finds bottlenecks, cost…

    by Nancy-Chauhan · Plugin bundle

    Listed on: Claude Code: claude-plugins-community · Describes nearly the same job

  • sindri

    Sindri turns a one-line goal like "reduce bundle_bytes by 15%" into an autonomous, overnight experiment loop. It proposes candidates,applies them in fresh subagent contexts, runs…

    by 4KMetrics · Plugin bundle

    Listed on: Claude Code: claude-plugins-community · Describes nearly the same job

  • meta-harness-ygn

    Meta-Harness-YGN is a Claude Code plugin (namespace /mh) that brings scientific rigor to harness engineering: every proposed change produces a falsifiable hypothesis, a…

    by yannabadie · Plugin bundle

    Listed on: Claude Code: claude-plugins-community · Describes nearly the same job

Has a listing on Claude Code: claude-plugins-official (5)
  • codspeed

    CodSpeed is the all-in-one performance testing toolkit. Dive into benchmarking results, flamegraphs, and performance comparisons — give Claude granular profiling context to…

    by CodSpeedHQ · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Community GitHub marketplaces, Claude Code: claude-plugins-community · Describes nearly the same job

  • growthbook

    A suite of agent skills for the full GrowthBook feature flag and experimentation lifecycle.

    by growthbook · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Community GitHub marketplaces · Describes nearly the same job

  • Qodo Standards

    Optional Qodo rules discovery and standards administration workflows.

    by qodo-ai · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins · Describes nearly the same job

  • confidence

    Access Confidence feature flags, experiments, and migration tools directly from Claude Code.

    by spotify · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Community GitHub marketplaces · Describes nearly the same job

  • Chrome DevTools MCP

    MCP server for Chrome DevTools

    by ChromeDevTools · MCP server

    Listed on: Official MCP Registry, Claude Code: claude-plugins-official, Copilot CLI: github/awesome-copilot, Community GitHub marketplaces, Claude Code: claude-plugins-community · Describes nearly the same job

Has a listing on Claude: knowledge-work-plugins (5)
  • growthbook

    A suite of agent skills for the full GrowthBook feature flag and experimentation lifecycle.

    by growthbook · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Community GitHub marketplaces · Describes nearly the same job

  • Qodo Standards

    Optional Qodo rules discovery and standards administration workflows.

    by qodo-ai · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins · Describes nearly the same job

  • honeycomb

    Skills, agents, and workflows for Honeycomb observability — query patterns, production investigations, SLOs, OpenTelemetry instrumentation, and Beeline migration. Designed to…

    by honeycombio · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Community GitHub marketplaces · Describes nearly the same job

  • Bio Research

    Connect to preclinical research tools and databases (literature search, genomics analysis, target prioritization) to accelerate early-stage life sciences R&D

    by Anthropic · Plugin bundle

    Listed on: Claude: knowledge-work-plugins · Describes nearly the same job

  • vanta

    The Vanta plugin connects Claude Code to Vanta's security and compliance platform through the Vanta MCP server. It combines Vanta's test-specific remediation intelligence with…

    by VantaInc · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Claude: knowledge-work-plugins, Claude Code: claude-plugins-community · Describes nearly the same job

Has a listing on Codex: openai-curated (openai/plugins) (5)
  • Plugin Eval

    Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.

    by OpenAI Codex · Plugin bundle

    Listed on: Codex: openai-curated (openai/plugins) · Describes nearly the same job

  • Consensus

    Consensus is the go-to MCP for academic research. Connect directly to 220M+ peer-reviewed papers to search, synthesize, and build structured research outputs from within your…

    by Consensus · Plugin bundle

    Listed on: Codex: openai-curated (openai/plugins) · Describes nearly the same job

  • crowdstrike-falcon-fusion

    CrowdStrike Falcon Fusion skills for authoring, deploying, and executing Fusion workflows. Includes live action discovery, YAML authoring with schema validation, workflow import…

    by CrowdStrike · Plugin bundle

    Listed on: Claude Code: claude-plugins-official, Codex: openai-curated (openai/plugins), Copilot CLI: github/awesome-copilot, Community GitHub marketplaces · Describes nearly the same job

  • Qodo

    Qodo setup, code intelligence, and review workflows.

    by qodo-ai · Plugin bundle

    Listed on: Codex: openai-curated (openai/plugins) · Describes nearly the same job

  • Life Sciences NGS Analysis

    Guided NGS intake, local execution, and public-pipeline routing for BCL, FASTQ, DNA variant, RNA-seq, single-cell, epigenomics, amplicon, and metagenomics analyses, with deeper…

    by OpenAI · Plugin bundle

    Listed on: Codex: openai-curated (openai/plugins) · Describes nearly the same job

Has a listing on Community GitHub marketplaces (5)
  • scientific-modernization

    Modernizes, ports, rewrites, packages, or replaces established scientific software in independently validated stages against an external scientific oracle, settling compatibility…

    by iowarp · Plugin bundle

    Listed on: Community GitHub marketplaces · Describes nearly the same job

  • scientific-debugging

    Diagnoses stalled or cross-system failures and wrong, NaN, nondeterministic, or unexpectedly slow scientific results through falsifiable hypotheses across distinct fault classes…

    by iowarp · Plugin bundle

    Listed on: Community GitHub marketplaces · Describes nearly the same job

  • aurora-science

    Measurement-science methodology for evaluation: equal engineering baselines, discriminating experiments, certificates, metamorphic evaluation, figures, and research dossiers.

    by AURORA-NEURO · Plugin bundle

    Listed on: Community GitHub marketplaces · Describes nearly the same job

  • tdd

    Builds a feature or fix test-first, red to green at pre-agreed public seams, one vertical slice at a time. Not for designing benchmark criteria; use experiment-protocol.

    by iowarp · Plugin bundle

    Listed on: Community GitHub marketplaces · Describes nearly the same job

  • prototype

    Answers a design question with throwaway code: a clearly marked, runnable, no-persistence prototype whose verdict is kept and whose code is discarded. Not for pre-registered…

    by iowarp · Plugin bundle

    Listed on: Community GitHub marketplaces · Describes nearly the same job

Has a listing on Copilot CLI: github/awesome-copilot (5)
  • technical-spike

    Tools for creation, management and research of technical spikes to reduce unknowns and assumptions before proceeding to specification and implementation of solutions.

    by Awesome Copilot Community · Plugin bundle

    Listed on: Copilot CLI: github/awesome-copilot · Describes nearly the same job

  • dotnet-diag

    Skills for .NET performance investigations, debugging, and incident analysis.

    by dotnet · Plugin bundle

    Listed on: Copilot CLI: github/awesome-copilot · Describes nearly the same job

  • testing-automation

    Comprehensive collection for writing tests, test automation, and test-driven development including unit tests, integration tests, and end-to-end testing strategies.

    by Awesome Copilot Community · Plugin bundle

    Listed on: Copilot CLI: github/awesome-copilot · Describes nearly the same job

  • bd-skills

    Helps GitHub Copilot investigate mobile app telemetry, diagnose crashes, manage [bitdrift](bitdrift.ai) workflows and dashboards, integrate the Capture SDK into iOS, Android, and…

    by bitdriftlabs · Plugin bundle

    Listed on: Copilot CLI: github/awesome-copilot · Describes nearly the same job

  • cast-imaging

    A comprehensive collection of specialized agents for software analysis, impact assessment, structural quality advisories, and architectural review using CAST Imaging.

    by Awesome Copilot Community · Plugin bundle

    Listed on: Copilot CLI: github/awesome-copilot · Describes nearly the same job

Has a listing on Copilot CLI: github/copilot-plugins (5)
  • build-perf-cpp

    Analyze MSVC build performance using vcperf.exe and ETL traces.

    by Ion Todirel and Eve Silfanus · Plugin bundle

    Listed on: Copilot CLI: github/copilot-plugins · Describes nearly the same job

  • power-automate

    Build, edit, run, and debug Power Automate cloud flows via the FlowAgent MCP server — connection lifecycle, surgical edits, copy across environments, run management, and validated…

    by microsoft · Plugin bundle

    Listed on: Copilot CLI: github/copilot-plugins · Describes nearly the same job

  • mcp-apps

    Generate MCP App widgets for MCP tools. Produces self-contained HTML widgets using the MCP Apps protocol.

    by microsoft · Plugin bundle

    Listed on: Copilot CLI: github/copilot-plugins · Describes a similar job

  • advanced-security

    Advanced Security plugin for GitHub Copilot.

    by github · Plugin bundle

    Listed on: Copilot CLI: github/copilot-plugins · Describes a similar job

  • code-apps-preview

    Build and deploy Power Apps code apps using React, Vite, and Power Platform connectors.

    by microsoft · Plugin bundle

    Listed on: Copilot CLI: github/copilot-plugins · Describes a similar job

Has a listing on Cursor: cursor/plugins (5)
  • Statsig

    Inspect and manage feature gates, experiments, dynamic configs, and metrics.

    by Cursor · Plugin bundle

    Listed on: Cursor: cursor/plugins · Describes nearly the same job

  • Agent Compatibility

    CLI-backed repo compatibility scans plus agents that audit startup, validation, and docs against reality.

    by Cursor · Plugin bundle

    Listed on: Cursor: cursor/plugins · Describes nearly the same job

  • Thermos

    Thermo-nuclear branch review: deep security/correctness audits, harsh code-quality rubrics, parallel subagents, thermos orchestration, and optional merge-ready PR flows.

    by Cursor · Plugin bundle

    Listed on: Cursor: cursor/plugins · Describes nearly the same job

  • Create Plugin

    Scaffold and validate new agent plugins.

    by Cursor · Plugin bundle

    Listed on: Cursor: cursor/plugins · Describes nearly the same job

  • pstack

    if you want to go fast, go deep first. pstack helps you write less, but higher quality code. rigorous agent workflows you can parallelize with confidence.

    by Lauren Tan · Plugin bundle

    Listed on: Cursor: cursor/plugins · Describes nearly the same job

Has a listing on Docker MCP Catalog (5)
  • Opik

    Read and score Opik traces, experiments, datasets and prompts from your AI assistant.

    by comet-ml · MCP server

    Listed on: Official MCP Registry, Docker MCP Catalog · Describes nearly the same job

  • Hackle

    Remote MCP server for the Hackle Admin API: experiments, feature flags, remote config, messaging.

    by hackle-io · MCP server

    Listed on: Official MCP Registry, Docker MCP Catalog · Describes nearly the same job

  • testkube-mcp io.github.kubeshop/testkube-mcp

    MCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants

    by kubeshop · MCP server

    Listed on: Official MCP Registry, Docker MCP Catalog · Describes nearly the same job

  • SmartBear MCP

    MCP server for AI access to SmartBear tools, including BugSnag, Reflect, Swagger, PactFlow, QTM4J.

    by smartbear.com · MCP server

    Listed on: Official MCP Registry, Docker MCP Catalog · Describes nearly the same job

  • Polar Signals

    MCP server for Polar Signals Cloud continuous profiling platform, enabling AI assistants to analyze CPU performance, memory usage, and identify optimization opportunities in…

    by docker · MCP server

    Listed on: Docker MCP Catalog · Describes nearly the same job

Has a listing on Official MCP Registry (5)
  • ResiliReplay

    Run bounded, deterministic MCP reliability tests and generate executable regressions.

    by aliengineering-byte · MCP server

    Listed on: Official MCP Registry, Community GitHub marketplaces · Describes nearly the same job

  • Academic Research Kernel

    Deterministic research state, evidence validation and statistical recomputation.

    by xngg1021 · MCP server

    Listed on: Official MCP Registry · Describes nearly the same job

  • Verdict QA

    Read-only MCP server over Verdict QA state: verdicts, findings, flaky quarantine, history.

    by ArtJack · MCP server

    Listed on: Official MCP Registry, Community GitHub marketplaces · Describes nearly the same job

  • tewip io.github.hmamut39/tewip

    Proves software work: triages failing tests, checks whether a test can fail, and reads migrations.

    by hmamut39 · MCP server

    Listed on: Official MCP Registry, Community GitHub marketplaces · Describes nearly the same job

  • Research Repo Doctor

    Deterministic Artifact Evaluation preflight and run-path grader for research repositories.

    by Tom409114 · MCP server

    Listed on: Official MCP Registry · Describes nearly the same job

Found by meaning, not by shared code or a shared repository: similar plugins stay separate products, and this is not a review or a recommendation.

Is this your plugin?

Add it to your projects and prove you maintain it with a file in its repository, a file on your domain or a DNS record. You get alerts when a marketplace lists it, drops it, changes its verified mark or what it asks for, and its remote endpoint goes on monitoring as a web service.

Data comes from public marketplace files in GitHub repositories of their authors. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.

Where the data comes from: how the catalog is built