LangSmith
LangSmith is the observability, debugging, and evaluation platform for LLM applications, built by LangChain. The LangSmith API exposes tracing, dataset management, evaluation, prompt-hub, and Fleet agent functionality for AI engineering teams.
Limited machine-readable signal and partial portal coverage — documentation a human can read, but little a machine or agent can consume without scraping.
API Evangelist profiles LangSmith the way a machine reads it — 80 machine-readable artifacts across 73 APIs, pulled from the provider's own public surface and indexed so a developer, an analyst, or an AI agent can evaluate it against every other provider on the network.
Every provider in the network is reduced to the same set of machine-readable artifacts — OpenAPI contracts, event specifications, GraphQL schemas, runnable collections, pricing and rate-limit signals, security posture, OAuth scopes, and the agent surfaces (MCP servers and skills) that let software drive the API on its own. We profile them because the interface is the part of a company you can actually inspect: it is a truer signal of what a provider does than any marketing page. From those artifacts we compute the Kin Score — LangSmith scores 41.0/100 (thin), with a separate agent-readiness read of 48/100 (agent ready). The full breakdown is below, followed by every artifact we hold — each card links through to its machine-readable definition on apis.io.
Kin Score
This is the API Evangelist rating — a single, repeatable read computed from the artifacts on this page. Green fill is points earned; the red track is points possible, so every bar shows earned-versus-possible at a glance.
Kin Score
How this is scored →scored 2026-07-27 · rubric v0.5
How we profile LangSmith
Each block below is one kind of artifact we hold for LangSmith. For each we say what it is and why it earns a place in the profile, then list every one we've indexed — capped at two rows, scroll within the panel for the rest.
APIs 73
Each API is captured as its own OpenAPI definition — every operation, parameter, and response. This is the single most useful machine-readable description of what an API does, and it's what lets us score, lint, mock, and generate against it without asking the provider for anything.
Individual APIs this provider publishes, each with its own machine-readable definition.
LangSmith access_policies API
The access_policies API from LangSmith — 3 operation(s) for access_policies.
LangSmith ace API
The ace API from LangSmith — 1 operation(s) for ace.
LangSmith agents API
The agents API from LangSmith — 2 operation(s) for agents.
LangSmith alert_rules API
The alert_rules API from LangSmith — 3 operation(s) for alert_rules.
LangSmith annotation-queues API
The annotation-queues API from LangSmith — 17 operation(s) for annotation-queues.
LangSmith api-key API
The api-key API from LangSmith — 4 operation(s) for api-key.
LangSmith audit-logs API
The audit-logs API from LangSmith — 1 operation(s) for audit-logs.
LangSmith auth API
The auth API from LangSmith — 7 operation(s) for auth.
LangSmith aws_marketplace API
The aws_marketplace API from LangSmith — 1 operation(s) for aws_marketplace.
LangSmith backfills API
The backfills API from LangSmith — 1 operation(s) for backfills.
LangSmith beacon API
The beacon API from LangSmith — 1 operation(s) for beacon.
LangSmith bulk-exports API
The bulk-exports API from LangSmith — 7 operation(s) for bulk-exports.
LangSmith charts API
The charts API from LangSmith — 13 operation(s) for charts.
LangSmith comments API
The comments API from LangSmith — 3 operation(s) for comments.
LangSmith commits API
The commits API from LangSmith — 2 operation(s) for commits.
LangSmith data_planes API
The data_planes API from LangSmith — 1 operation(s) for data_planes.
LangSmith datasets API
The datasets API from LangSmith — 28 operation(s) for datasets.
LangSmith directories API
The directories API from LangSmith — 2 operation(s) for directories.
LangSmith evaluators API
The evaluators API from LangSmith — 2 operation(s) for evaluators.
LangSmith examples API
The examples API from LangSmith — 9 operation(s) for examples.
LangSmith experiment-view-overrides API
The experiment-view-overrides API from LangSmith — 2 operation(s) for experiment-view-overrides.
LangSmith experiments API
The experiments API from LangSmith — 1 operation(s) for experiments.
LangSmith features API
The features API from LangSmith — 4 operation(s) for features.
LangSmith feedback API
The feedback API from LangSmith — 7 operation(s) for feedback.
LangSmith feedback-configs API
The feedback-configs API from LangSmith — 1 operation(s) for feedback-configs.
LangSmith fleet auth API
The fleet auth API from LangSmith — 10 operation(s) for fleet auth.
LangSmith fleet github-app API
The fleet github-app API from LangSmith — 9 operation(s) for fleet github-app.
LangSmith fleet integrations API
The fleet integrations API from LangSmith — 3 operation(s) for fleet integrations.
LangSmith fleet mcp API
The fleet mcp API from LangSmith — 7 operation(s) for fleet mcp.
LangSmith fleet threads API
The fleet threads API from LangSmith — 5 operation(s) for fleet threads.
LangSmith fleet usage API
The fleet usage API from LangSmith — 4 operation(s) for fleet usage.
LangSmith fleet_webhooks API
The fleet_webhooks API from LangSmith — 1 operation(s) for fleet_webhooks.
LangSmith gateway API
The gateway API from LangSmith — 4 operation(s) for gateway.
LangSmith gateway-policies API
The gateway-policies API from LangSmith — 2 operation(s) for gateway-policies.
LangSmith hub_environments API
The hub_environments API from LangSmith — 2 operation(s) for hub_environments.
LangSmith info API
The info API from LangSmith — 2 operation(s) for info.
LangSmith integrations API
The integrations API from LangSmith — 1 operation(s) for integrations.
LangSmith likes API
The likes API from LangSmith — 1 operation(s) for likes.
LangSmith mcp API
The mcp API from LangSmith — 2 operation(s) for mcp.
LangSmith mcp_vendors API
The mcp_vendors API from LangSmith — 6 operation(s) for mcp_vendors.
LangSmith me API
The me API from LangSmith — 4 operation(s) for me.
LangSmith metrics API
The metrics API from LangSmith — 1 operation(s) for metrics.
LangSmith model-price-map API
The model-price-map API from LangSmith — 2 operation(s) for model-price-map.
LangSmith nps API
The nps API from LangSmith — 1 operation(s) for nps.
LangSmith oauth API
The oauth API from LangSmith — 8 operation(s) for oauth.
LangSmith Ok API
The Ok API from LangSmith — 1 operation(s) for ok.
LangSmith optimization-jobs API
The optimization-jobs API from LangSmith — 4 operation(s) for optimization-jobs.
LangSmith Organizations API
The Organizations API from LangSmith — 1 operation(s) for organizations.
LangSmith orgs API
The orgs API from LangSmith — 39 operation(s) for orgs.
LangSmith ownerships API
The ownerships API from LangSmith — 1 operation(s) for ownerships.
LangSmith playground-settings API
The playground-settings API from LangSmith — 2 operation(s) for playground-settings.
LangSmith prompt-webhooks API
The prompt-webhooks API from LangSmith — 3 operation(s) for prompt-webhooks.
LangSmith prompts API
The prompts API from LangSmith — 2 operation(s) for prompts.
LangSmith public API
The public API from LangSmith — 20 operation(s) for public.
LangSmith repos API
The repos API from LangSmith — 5 operation(s) for repos.
LangSmith run API
The run API from LangSmith — 19 operation(s) for run.
LangSmith runs API
The runs API from LangSmith — 7 operation(s) for runs.
LangSmith sandboxes API
The sandboxes API from LangSmith — 12 operation(s) for sandboxes.
LangSmith sandboxes-internal API
The sandboxes-internal API from LangSmith — 1 operation(s) for sandboxes-internal.
LangSmith SCIM Tokens API
The SCIM Tokens API from LangSmith — 2 operation(s) for scim tokens.
LangSmith service-accounts API
The service-accounts API from LangSmith — 2 operation(s) for service-accounts.
LangSmith sessions API
The sessions API from LangSmith — 1 operation(s) for sessions.
LangSmith settings API
The settings API from LangSmith — 2 operation(s) for settings.
LangSmith skills API
The skills API from LangSmith — 2 operation(s) for skills.
LangSmith tag-transitions API
The tag-transitions API from LangSmith — 1 operation(s) for tag-transitions.
LangSmith tags API
The tags API from LangSmith — 2 operation(s) for tags.
LangSmith tenant API
The tenant API from LangSmith — 1 operation(s) for tenant.
LangSmith threads API
The threads API from LangSmith — 2 operation(s) for threads.
LangSmith tools API
The tools API from LangSmith — 3 operation(s) for tools.
LangSmith tracer-sessions API
The tracer-sessions API from LangSmith — 14 operation(s) for tracer-sessions.
LangSmith TTL Settings API
The TTL Settings API from LangSmith — 2 operation(s) for ttl settings.
LangSmith usage-limits API
The usage-limits API from LangSmith — 3 operation(s) for usage-limits.
LangSmith workspaces API
The workspaces API from LangSmith — 25 operation(s) for workspaces.
Scroll within the panel for all 73 ·
Open Collections 1
Open, tool-agnostic collections carry the same runnable value as Postman without locking you to one client — the portable, forkable form of the same exercise.
Open, tool-agnostic API collections (OpenAPI-derived and Bruno).
LangSmith
OPEN COLLECTIONPricing Plans 1
Pricing is part of the interface. Machine-readable plans tell you what a tier costs and includes before you commit — one of the six things the Kin Score reads for commercial clarity.
Published pricing tiers and plan structures.
Rate Limits 1
Rate limits are the difference between a demo that works and a production integration that doesn't fall over. Publishing them is an operational-transparency signal — and a hard requirement for any agent that plans its own throughput.
Documented rate limits and quota policies.
Langsmith Rate Limits
RATE LIMITSFinOps 1
Cost, billing, and metering signals let a buyer model the financial operations of an API before it's live. We profile them for the same reason we profile pricing: the money is part of the contract.
Cost, billing, and metering signals for API financial operations.
Langsmith Finops
FINOPSSecurity Posture 2
Authentication, domain security, vulnerability disclosure, and trust-center signals — the evidence that a provider takes security seriously enough to document it. We profile it because you can't govern what you can't see.
Authentication, domain security, vulnerability disclosure, and trust-center signals.
Agentic Access 1
An x-agentic-access contract marks which operations are safe for an agent to run on its own and which need a human in the loop. It is the difference between an API an agent can use and one it can use safely.
Recommended x-agentic-access execution contracts for AI agents.
Resources
Every other property we hold for LangSmith — documentation, portals, status pages, policies, and corporate surface — grouped by the job it does, following the integrator's arc from getting started to running in production.
Documentation 1
Reference material describing how the API behaves
Agent Surfaces 1
MCP servers, agent skills, and machine-readable catalogs
Access & Security 2
Authentication, authorization, and security posture
Operate 1
Status, limits, changes, and where to get help
Commercial 3
Pricing, plans, and the legal terms of use
Company 2
The organization behind the API
← All providers · Data indexed from github.com/api-evangelist/langsmith · machine-readable index on apis.io