Need help with your APIs? I offer API discovery, governance & evangelism services. Explore services →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC
Opik website screenshot

Opik

Opik is an open-source LLM evaluation, testing, and tracing platform developed by Comet ML that enables developers to debug, evaluate, and monitor LLM applications, RAG systems, and agentic workflows. The platform provides a REST API for logging traces and spans, running automated evaluations with LLM-as-a-judge metrics, managing datasets and experiments, and tracking production performance. Opik supports over 40 framework integrations including LangChain, LlamaIndex, and OpenAI, and is available as a self-hosted open-source deployment or as a managed cloud service on Comet's platform.

agent aware

Real signal across most facets with visible, nameable gaps — the contract exists but is thin, or the portal is good while governance and commercial terms are absent.

Kin Score

API Evangelist profiles Opik the way a machine reads it — 52 machine-readable artifacts across 39 APIs, pulled from the provider's own public surface and indexed so a developer, an analyst, or an AI agent can evaluate it against every other provider on the network.

Every provider in the network is reduced to the same set of machine-readable artifacts — OpenAPI contracts, event specifications, GraphQL schemas, runnable collections, pricing and rate-limit signals, security posture, OAuth scopes, and the agent surfaces (MCP servers and skills) that let software drive the API on its own. We profile them because the interface is the part of a company you can actually inspect: it is a truer signal of what a provider does than any marketing page. From those artifacts we compute the Kin Score — Opik scores 57.3/100 (developing), with a separate agent-readiness read of 24/100 (agent aware). The full breakdown is below, followed by every artifact we hold — each card links through to its machine-readable definition on apis.io.

Kin Score

This is the API Evangelist rating — a single, repeatable read computed from the artifacts on this page. Green fill is points earned; the red track is points possible, so every bar shows earned-versus-possible at a glance.

Kin Score Kin Score How this is scored →
scored 2026-07-27 · rubric v0.5
Composite quality — 57.3/100 · developing
Contract Quality 14.3 / 25
Developer Ergonomics 2.2 / 20
Commercial Clarity 11.6 / 20
Operational Transparency 8.9 / 13
Governance 10.4 / 12
Discoverability 10.0 / 10
Agent readiness — 24/100 · agent aware
Machine-Readable Contract 18 / 18
Agentic Access Contract 0 / 15
MCP Server 0 / 12
Machine-Readable Auth 0 / 10
Idempotency 0 / 9
Stable Error Semantics 0 / 8
Request/Response Examples 0 / 7
Rate-Limit Signaling 7 / 7
Typed Event Surface 0 / 6
Agent Skills 0 / 5
Well-Known Catalog 0 / 4
Consent & Bot Identity 0 / 3

How we profile Opik

Each block below is one kind of artifact we hold for Opik. For each we say what it is and why it earns a place in the profile, then list every one we've indexed — capped at two rows, scroll within the panel for the rest.

APIs 39

Each API is captured as its own OpenAPI definition — every operation, parameter, and response. This is the single most useful machine-readable description of what an API does, and it's what lets us score, lint, mock, and generate against it without asking the provider for anything.

Individual APIs this provider publishes, each with its own machine-readable definition.

Opik Agent Configs API

Agent configuration management

Opik AI Spend API

Coding-agent spend analytics

Opik Alerts API

Alert resources

Opik Annotation Queues API

Private annotation queue operations

Opik Assertion Results API

Assertion result related resources

Opik Attachments API

Attachments related resources

Opik Automation rule evaluators API

Automation rule evaluators resource

Opik Chat Completions API

Chat Completions related resources

Opik Check API

Access check resources

Opik Dashboards API

Workspace Dashboard resources

Opik Datasets API

Dataset resources

Opik Environments API

Environment related resources

Opik Experiments API

Experiment resources

Opik Feedback-definitions API

Feedback definitions related resources

Opik Guardrails API

Guardrails related resources

Opik Insights Views API

Insights View resources

Opik Is Alive API

The Is Alive API from Opik — 2 operation(s) for is alive.

Opik LLM Models API

LLM model registry resources

Opik LlmProviderKey API

LLM Provider Key

Opik Manual Evaluation API

Manual evaluation resources for traces, threads, and spans

Opik MCP OAuth API

MCP OAuth 2.1 Authorization Server resources

Opik Ollama API

Ollama provider configuration endpoints with OpenAI-compatible API support.

Opik Ollie State API

Ollie pod state persistence

Opik OpenTelemetry Ingestion API

Resource to ingest Traces and Spans via OpenTelemetry

Opik Optimizations API

Optimization resources

Opik Pairing API

Pairing sessions for the `opik connect` and `opik endpoint` CLI commands

Opik Projects API

Project related resources

Opik Prompts API

Prompt resources

Opik Redirect API

Redirects for SDK generated links

Opik Reports API

Ollie daily report management

Opik Retention Rules API

Data retention rule management

Opik Runners API

Local runner management endpoints

Opik Service Toggles API

Service Toggles resources

Opik Spans API

Span related resources

Opik System usage API

System usage related resource

Opik Traces API

Trace related resources

Opik Welcome Wizard API

Welcome wizard tracking resources

Opik Workspace permissions API

Workspace permissions related resources

Opik Workspaces API

Workspace related resources

Scroll within the panel for all 39 ·

Pricing Plans 1

Pricing is part of the interface. Machine-readable plans tell you what a tier costs and includes before you commit — one of the six things the Kin Score reads for commercial clarity.

Published pricing tiers and plan structures.

Opik Plans Pricing

5 plans

PLANS

Rate Limits 1

Rate limits are the difference between a demo that works and a production integration that doesn't fall over. Publishing them is an operational-transparency signal — and a hard requirement for any agent that plans its own throughput.

Documented rate limits and quota policies.

Opik Rate Limits

4 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals let a buyer model the financial operations of an API before it's live. We profile them for the same reason we profile pricing: the money is part of the contract.

Cost, billing, and metering signals for API financial operations.

Opik Finops

FINOPS

Semantic Vocabularies 1

JSON-LD contexts give the data shared meaning across APIs. We profile them because semantics are what let a machine reconcile 'customer' here with 'customer' somewhere else.

JSON-LD contexts and semantic vocabularies used across these APIs.

Opik Context

0 classes · 56 properties

JSON-LD

Spectral Rules 1

Governance rulesets we run against this provider's specs — the automated checks behind parts of the score. Profiling them makes the quality bar explicit and re-runnable, not a matter of opinion.

Opik API Rules

5 rules · 4 warnings

SPECTRAL

JSON Schema 3

Standalone JSON Schema definitions describe the data models behind the API. We profile them so the shapes are validatable on their own — useful long after a single request is forgotten.

Standalone JSON Schema definitions for this provider's data models.

Experiment

20 properties

JSON SCHEMA

Span

24 properties

JSON SCHEMA

Trace

21 properties

JSON SCHEMA

Examples 3

Real request and response payloads are what turn a spec from abstract into obvious — and they're one of the twelve things an agent needs to call an API correctly on the first try.

Example request and response payloads for these APIs.

Opik Experiment Example

18 fields

EXAMPLE

Opik Span Example

21 fields

EXAMPLE

Opik Trace Example

18 fields

EXAMPLE

Security Posture 2

Authentication, domain security, vulnerability disclosure, and trust-center signals — the evidence that a provider takes security seriously enough to document it. We profile it because you can't govern what you can't see.

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Opik Domain Security

TLSv1.3 · HSTS · DMARC

SECURITY

Opik Trust Center

SOC 2, ISO 27001

SECURITY

Resources

Every other property we hold for Opik — documentation, portals, status pages, policies, and corporate surface — grouped by the job it does, following the integrator's arc from getting started to running in production.

Design & Contract 2

Pagination, idempotency, versioning, errors, and events

Build 2

SDKs, sample code, and the tooling you integrate with

Access & Security 2

Authentication, authorization, and security posture

Operate 4

Status, limits, changes, and where to get help

Commercial 3

Pricing, plans, and the legal terms of use

Company 3

The organization behind the API

Other 1

Properties that don't map to a standard resource type

← All providers · Data indexed from github.com/api-evangelist/opik · machine-readable index on apis.io