langsmith-skills
Agent skills for observing and evaluating LLM applications with LangSmith
Pacote de plugins · de LangChain
Resumo
langsmith-skills é um pacote de plugins para ferramentas de programação com IA publicado por LangChain. Marketplaces que lemos e que o listam: 1 (Community GitHub marketplaces). A última mudança que registramos foi em 2026-10-27. Conforme nossa passagem pelos marketplaces em 2026-10-30.
O que pede
- Instala-se como pacote de plugins
Nenhum dos marketplaces que lemos publica as ferramentas ou as configurações que ele pede.
O que declara, pede e executa, por completo
Instale apenas plugins de desenvolvedores em quem você confia. Mostramos o que os marketplaces publicam e não testamos plugins.
Funciona com
- Claude Code
Pelos marketplaces que o listam e pelo transporte MCP que declara, conforme cada cliente documenta. Não testamos plugins.
Conectar
Comandos e configurações gerados apenas a partir do que os marketplaces declaram. Não os executamos por você e não testamos plugins.
Como plugin do Claude Code
Gerado a partir do que Community GitHub marketplaces declara.
/plugin marketplace add langchain-ai/langsmith-skills
/plugin install langsmith-skills@langsmith-skillsOnde está publicado
| Marketplace | Status | Versão | Números | Verificado | Visto pela primeira vez |
|---|---|---|---|---|---|
| Marketplace da comunidade langchain-ai/langsmith-skills (Abrir o código no GitHub) | Listado | 0.1.0 | Forks (GitHub): 17 Estrelas (GitHub): 164 |
Sem marcação |
Cada número é do próprio marketplace e nunca é somado entre marketplaces. Um marketplace que não publica números não mostra nenhum: sem número não é zero.
Listado em um marketplace da comunidade
| Marketplace | Repositório | Estrelas (GitHub) |
|---|---|---|
| langsmith-skills | langchain-ai/langsmith-skills | 164 |
O que o pacote contém
Conforme publicado em Community GitHub marketplaces.
Skills: 6
langsmith-custom-appslangsmith-datasetlangsmith-evaluatorlangsmith-experiment-diagnosislangsmith-online-eval-engineeringlangsmith-trace
O que mudou
- Community GitHub marketplaces: composição mudou (agora 6 partes): adicionado: skill langsmith-experiment-diagnosis
- Passou a ser um produto que acompanhamos
- Community GitHub marketplaces: apareceu
Plugins semelhantes
Produtos cujos próprios nomes, descrições, ferramentas e skills são os mais próximos deste pelo significado, em todos os marketplaces que lemos. A proximidade é ordenada apenas dentro desta lista.
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Scaffolding, running, documenting, and publishing AI evaluations. Ships skills and commands for setting up eval workspaces, creating custom evals (or adapting existing…
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
Decide, design, gate, judge, and defend evaluations for LLM, agent, and retrieval systems. Not ordinary unit tests.
-
2 AI engineering skills: LLM evals and LLM observability
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Set up evaluation of an OpenAI Java SDK tool-calling agent using Dokimos
-
Langfuse public API (Cloud and self-hosted): traces, prompts, datasets and gated writes.
-
Configures and runs LLM evaluation using Promptfoo framework. Use when setting up prompt testing, creating evaluation configs (promptfooconfig.yaml), writing Python custom…
-
Create and run AI evaluations, record traces, and inspect results with scoped organization access.
Plugins semelhantes por marketplace
A mesma pergunta feita a cada marketplace separadamente: existe lá um equivalente deste plugin?
Listado em Claude Code: claude-plugins-community (5)
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
Context engineering plugin for Claude Code — real-time prompt scoring, RLM adaptive weights, and token optimization. Scores every tool use across 5 dimensions (token utilization…
-
OpenTelemetry observability for Claude Code sessions. Captures tool calls, LLM invocations, token usage, and errors as OTel traces. Send telemetry to Dash0 or any…
Listado em Claude Code: claude-plugins-official (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
Skills for tracing, evaluating, and improving AI agents with MLflow. Supports the full agent improvement loop: instrument → trace → evaluate → iterate → validate.
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
OpenTelemetry observability for Claude Code sessions. Captures tool calls, LLM invocations, token usage, and errors as OTel traces. Send telemetry to Dash0 or any…
Listado em Claude: knowledge-work-plugins (5)
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
Build multimodal AI applications with Pixeltable -- tables, computed columns, embedding search, UDFs, tool-calling agents, and 25+ AI provider integrations.
-
Atlan data catalog plugin for Claude Code. Search, explore, govern, and manage your data assets through natural language. Powered by the Atlan MCP server with semantic search…
-
A suite of agent skills for the full GrowthBook feature flag and experimentation lifecycle.
Listado em Codex: openai-curated (openai/plugins) (5)
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
-
Answer product and business questions with data
-
PostHog gives your AI agent direct access to your product analytics, feature flags, experiments, error tracking, surveys, logs, and LLM analytics. Ask questions about your data…
-
Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…
Listado em Community GitHub marketplaces (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Scaffolding, running, documenting, and publishing AI evaluations. Ships skills and commands for setting up eval workspaces, creating custom evals (or adapting existing…
-
Decide, design, gate, judge, and defend evaluations for LLM, agent, and retrieval systems. Not ordinary unit tests.
-
2 AI engineering skills: LLM evals and LLM observability
-
Set up evaluation of an OpenAI Java SDK tool-calling agent using Dokimos
Listado em Copilot CLI: github/awesome-copilot (5)
-
Run a lightweight, role-separated AI development team with flexible tools, developer-selected models, proportionate planning, and optional QA.
-
See your local Copilot token usage by day, model, and session, and get tips to use it more efficiently.
-
Microsoft Copilot Studio YAML authoring toolkit. Create, edit, validate, and test Copilot Studio agents using YAML files.
-
Three-layer verification pipeline for AI output. Extracts claims, finds sources, and flags hallucination risks so humans can verify before acting.
-
Task Researcher and Task Planner for intermediate to expert users and large codebases - Brought to you by microsoft/edge-ai
Listado em Copilot CLI: github/copilot-plugins (5)
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
workiq
Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.
-
workiq-productivity
WorkIQ productivity skills powered by the local WorkIQ CLI — read-only insights across email, meetings, calendar, Teams, SharePoint, projects, and people.
-
model-apps
Build and deploy Power Apps generative pages for model-driven apps with specialist agents for planning, entity creation, and parallel code generation. Requires PAC CLI >= 2.7.0…
-
Build Power Apps Canvas Apps using the Canvas Authoring MCP server.
Listado em Cursor: cursor/plugins (5)
-
Ask Databricks Genie questions about your workspace's data in plain language.
-
Work with PostHog from chat: query product analytics and run SQL, manage feature flags and experiments, triage error tracking issues, and review session replays, surveys, and…
-
Incremental transcript-driven memory updates for AGENTS.md using high-signal bullet points only.
-
Inspect and manage feature gates, experiments, dynamic configs, and metrics.
-
Iterative self-referential AI loops using the Ralph Wiggum technique.
Listado em Docker MCP Catalog (5)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Analyze documents, images, videos, and audio.
-
Wayfound’s MCP server allows business users to govern, supervise, and improve AI Agents.
-
Bridges multiple AI models and CLIs, enabling orchestrated workflows across Claude Code, Gemini CLI, Codex CLI, and other AI development tools.
-
testkube-mcp io.github.kubeshop/testkube-mcp
MCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants
Listado em Official MCP Registry (5)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Langfuse public API (Cloud and self-hosted): traces, prompts, datasets and gated writes.
-
Create and run AI evaluations, record traces, and inspect results with scoped organization access.
-
Prompt evals over MCP: run a prompt on your dataset, score each output 1-5 with an LLM judge.
-
llm-observability-orchestration-agent-langchain-community ai.getvda/llm-observability-orchestration-agent-langchain-community
LLM Observability & Orchestration Agent (LangChain Community)
Listado em PyPI (MCP servers) (5)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Read, measure and explain LLM eval runs of a digline suite. Cannot promote a baseline.
-
Langfuse MCP server for accessing and analyzing telemetry data via natural language
-
air-blackbox-mcp io.github.airblackbox/air-blackbox-mcp
EU AI Act compliance scanner for Python AI agents. 14 tools across 6 articles.
-
lineai-mcp-server io.github.lineai-intelligence/lineai-mcp-server
An MCP Server to utilize Lineai's rich software dependency data in your AI programming assistant.
Listado em npm registry (MCP servers) (5)
-
140 deterministic tools for your AI: logs, tests, SQL, diagrams, SPARQL. Local, no network.
-
Build AI-powered forms, scored assessments and professional reports on FormLM, by natural language.
-
Git-native content governance for AI agents — 27 deterministic MCP tools over stdio and HTTP.
-
rubber-duck io.github.nesquikm/rubber-duck
Bridge to multiple LLMs and CLI agents: councils, debates, voting, and more
-
dossier ai.imboard/dossier
MCP server for dossier automation standard - enables LLMs to discover, verify, and execute dossiers
Encontrados pelo significado, não por código ou repositório em comum: plugins semelhantes continuam sendo produtos distintos, e isto não é uma avaliação nem uma recomendação.
Quer esta marca no seu plugin em nosso catálogo?
Prove que o mantém com um arquivo no repositório, um arquivo no seu domínio ou um registro DNS, e você poderá mostrar esta marca na ficha, com banners ao vivo para o seu site e o README. Como funciona a verificação
Você também recebe alertas quando um marketplace o publica, o remove, muda a marca de verificado ou o que ele pede, e o endpoint remoto passa a ser monitorado como um serviço web.
Dados de Community GitHub marketplaces. Os números vêm das nossas próprias passagens regulares pelos marketplaces, última leitura em . Não publicamos dados de contato dos editores de plugins.