Runloop
Runloop is the AI Agent Accelerator — secure code sandboxes (Devboxes), evaluation infrastructure (Benchmarks, Scenarios), and production-grade orchestration for AI coding agents at enterprise scale. The platform provides a single REST API and matched Python/TypeScript SDKs covering Devbox lifecycle, Blueprint image building, Snapshot branching, Agent registry, Axon event streams with Broker bridges, Storage Objects, Secrets, Network Policies, Agent Gateways, MCP Configs, and a turnkey eval framework (SWE-Bench Verified, SWE-smith, custom benchmarks). Runloop runs on a custom bare-metal hypervisor with microVM-level isolation and is SOC 2 Type II, HIPAA, and GDPR compliant, with VPC deployment available for regulated workloads. Founded 2023 by Jonathan Wall (Google File System lead, Google Wallet co-founder, Index CTO acquired by Stripe).
Solid contracts, transparent operations, and an easy start — typically complete on four or five facets with one clear soft spot.
API Evangelist profiles Runloop the way a machine reads it — 120 machine-readable artifacts across 14 APIs, pulled from the provider's own public surface and indexed so a developer, an analyst, or an AI agent can evaluate it against every other provider on the network.
Every provider in the network is reduced to the same set of machine-readable artifacts — OpenAPI contracts, event specifications, GraphQL schemas, runnable collections, pricing and rate-limit signals, security posture, OAuth scopes, and the agent surfaces (MCP servers and skills) that let software drive the API on its own. We profile them because the interface is the part of a company you can actually inspect: it is a truer signal of what a provider does than any marketing page. From those artifacts we compute the Kin Score — Runloop scores 61.1/100 (strong), with a separate agent-readiness read of 23/100 (agent aware). The full breakdown is below, followed by every artifact we hold — each card links through to its machine-readable definition on apis.io.
Kin Score
This is the API Evangelist rating — a single, repeatable read computed from the artifacts on this page. Green fill is points earned; the red track is points possible, so every bar shows earned-versus-possible at a glance. Every facet and dimension name is a link: it opens that measurement's page on APIs.io, where the rating runs across the whole catalog — the exact checks that feed it, how every profiled provider distributes on it, and who is at the top of it.
Put this on your own site. The badge is drawn live from Runloop's current Kin Score — paste it once and it updates itself every time the score is recomputed. It follows your visitor's light or dark setting, and it links back here so anyone who sees it can read the full breakdown.
<!-- Kin Score · API Evangelist -->
<a href="https://providers.apievangelist.com/providers/runloop-ai/"
title="Runloop on API Evangelist — API profile and Kin Score">
<img src="https://apis.io/badge/runloop-ai.svg"
alt="Runloop Kin Score — API readiness rating by API Evangelist" width="150" height="150" loading="lazy">
</a>
[](https://providers.apievangelist.com/providers/runloop-ai/)
<!-- Kin Score · API Evangelist -->
<a href="https://providers.apievangelist.com/providers/runloop-ai/"
title="Runloop on API Evangelist — API profile and Kin Score">
<img src="https://apis.io/badge/runloop-ai/card.svg"
alt="Runloop Kin Score — API readiness rating by API Evangelist" width="340" height="120" loading="lazy">
</a>
More shapes, themes and sizes → · Score as JSON · How badges work
How we profile Runloop
Each block below is one kind of artifact we hold for Runloop. For each we say what it is and why it earns a place in the profile, then list every one we've indexed — capped at two rows, scroll within the panel for the rest.
APIs 24
Each API is captured as its own OpenAPI definition — every operation, parameter, and response. This is the single most useful machine-readable description of what an API does, and it's what lets us score, lint, mock, and generate against it without asking the provider for anything.
Individual APIs this provider publishes, each with its own machine-readable definition.
Runloop agents API
The agents API from Runloop — 5 operation(s) for agents.
Runloop apikeys API
The apikeys API from Runloop — 1 operation(s) for apikeys.
Runloop axons API
The axons API from Runloop — 7 operation(s) for axons.
Runloop Benchmark API
The Benchmark API from Runloop — 25 operation(s) for benchmark.
Runloop Blueprint API
The Blueprint API from Runloop — 11 operation(s) for blueprint.
Runloop Blueprint-Lifecycle API
The Blueprint-Lifecycle API from Runloop — 3 operation(s) for blueprint-lifecycle.
Runloop Blueprint-ObservabilityTools API
The Blueprint-ObservabilityTools API from Runloop — 2 operation(s) for blueprint-observabilitytools.
Runloop Devbox API
The Devbox API from Runloop — 40 operation(s) for devbox.
Runloop Devbox-FileTools API
The Devbox-FileTools API from Runloop — 4 operation(s) for devbox-filetools.
Runloop Devbox-Lifecycle API
The Devbox-Lifecycle API from Runloop — 7 operation(s) for devbox-lifecycle.
Runloop Devbox-NetworkTools API
The Devbox-NetworkTools API from Runloop — 4 operation(s) for devbox-networktools.
Runloop Devbox-ObservabilityTools API
The Devbox-ObservabilityTools API from Runloop — 3 operation(s) for devbox-observabilitytools.
Runloop Devbox-PersistenceTools API
The Devbox-PersistenceTools API from Runloop — 11 operation(s) for devbox-persistencetools.
Runloop Devbox-ShellTools API
The Devbox-ShellTools API from Runloop — 9 operation(s) for devbox-shelltools.
Runloop executions API
The executions API from Runloop — 2 operation(s) for executions.
Runloop gateway-configs API
The gateway-configs API from Runloop — 3 operation(s) for gateway-configs.
Runloop mcp-configs API
The mcp-configs API from Runloop — 3 operation(s) for mcp-configs.
Runloop network-policies API
The network-policies API from Runloop — 3 operation(s) for network-policies.
Runloop objects API
The objects API from Runloop — 8 operation(s) for objects.
Runloop restricted_keys API
The restricted_keys API from Runloop — 1 operation(s) for restricted_keys.
Runloop Scenario API
The Scenario API from Runloop — 17 operation(s) for scenario.
Runloop ScenarioScorer API
The ScenarioScorer API from Runloop — 2 operation(s) for scenarioscorer.
Runloop secrets API
The secrets API from Runloop — 3 operation(s) for secrets.
Runloop streaming API
The streaming API from Runloop — 2 operation(s) for streaming.
Scroll within the panel for all 24 ·
Postman Collections 13
A runnable collection turns the contract into something a developer can execute in seconds. We profile them because the fastest way to trust an API is to make a real call against it.
Ready-to-run Postman collections for exercising this provider's APIs.
Runloop Agents API
POSTMANRunloop API Keys API
POSTMANRunloop Axons API
POSTMANRunloop Benchmark API
POSTMANRunloop Blueprint API
POSTMANRunloop Devbox API
POSTMANRunloop Executions API
POSTMANRunloop Gateway Configs API
POSTMANRunloop MCP Configs API
POSTMANRunloop Network Policies API
POSTMANRunloop Objects API
POSTMANRunloop Scenario API
POSTMANRunloop Secrets API
POSTMANScroll within the panel for all 13 ·
Open Collections 39
Open, tool-agnostic collections carry the same runnable value as Postman without locking you to one client — the portable, forkable form of the same exercise.
Open, tool-agnostic API collections (OpenAPI-derived and Bruno).
API Collection
OPEN COLLECTIONRunloop Agents API
OPEN COLLECTIONRunloop agents API
OPEN COLLECTIONRunloop agents apikeys API
OPEN COLLECTIONRunloop agents axons API
OPEN COLLECTIONRunloop agents Benchmark API
OPEN COLLECTIONRunloop agents Blueprint API
OPEN COLLECTIONRunloop agents Blueprint-Lifecycle API
OPEN COLLECTIONRunloop agents Blueprint-ObservabilityTools API
OPEN COLLECTIONRunloop agents Devbox API
OPEN COLLECTIONRunloop agents Devbox-FileTools API
OPEN COLLECTIONRunloop agents Devbox-Lifecycle API
OPEN COLLECTIONRunloop agents Devbox-NetworkTools API
OPEN COLLECTIONRunloop agents Devbox-ObservabilityTools API
OPEN COLLECTIONRunloop agents Devbox-PersistenceTools API
OPEN COLLECTIONRunloop agents Devbox-ShellTools API
OPEN COLLECTIONRunloop agents executions API
OPEN COLLECTIONRunloop agents gateway-configs API
OPEN COLLECTIONRunloop agents mcp-configs API
OPEN COLLECTIONRunloop agents network-policies API
OPEN COLLECTIONRunloop agents objects API
OPEN COLLECTIONRunloop agents restricted_keys API
OPEN COLLECTIONRunloop agents Scenario API
OPEN COLLECTIONRunloop agents ScenarioScorer API
OPEN COLLECTIONRunloop agents secrets API
OPEN COLLECTIONRunloop agents streaming API
OPEN COLLECTIONRunLoop API
OPEN COLLECTIONRunloop API Keys API
OPEN COLLECTIONRunloop Axons API
OPEN COLLECTIONRunloop Benchmark API
OPEN COLLECTIONRunloop Blueprint API
OPEN COLLECTIONRunloop Devbox API
OPEN COLLECTIONRunloop Executions API
OPEN COLLECTIONRunloop Gateway Configs API
OPEN COLLECTIONRunloop MCP Configs API
OPEN COLLECTIONRunloop Network Policies API
OPEN COLLECTIONRunloop Objects API
OPEN COLLECTIONRunloop Scenario API
OPEN COLLECTIONRunloop Secrets API
OPEN COLLECTIONScroll within the panel for all 39 ·
Arazzo Workflows 10
Real integrations are rarely a single call. Arazzo describes the multi-step sequences — auth, then create, then confirm — so both a human and an agent can follow the choreography, not just the endpoints.
Multi-step API workflows described with the Arazzo specification.
Runloop Bootstrap a Devbox from an Object Artifact
Create and complete a storage object, generate its download URL, then boot a devbox and pull the artifact into it.
ARAZZORunloop Build Blueprint and Launch Devbox
Build a custom blueprint image, poll until the build completes, then launch a devbox from it and wait for running.
ARAZZORunloop Create Scenario and Run It
Define a repeatable AI coding evaluation scenario, start a run of it, poll until it is scored, then complete the run.
ARAZZORunloop Graceful Snapshot and Shutdown
Synchronously snapshot a running devbox's disk to preserve its state, then permanently shut the devbox down.
ARAZZORunloop Provision Devbox and Run a Command
Create a devbox, wait for it to reach running, then execute a shell command asynchronously and wait for completion.
ARAZZORunloop Publish an Object Artifact
Create a storage object, mark its upload complete to make it read-only, then generate a presigned download URL for it.
ARAZZORunloop Score a Running Scenario Run
Start a run of an existing scenario, wait for it to be running, trigger scoring, then complete the run.
ARAZZORunloop Snapshot and Restore a Devbox
Take an asynchronous disk snapshot of a running devbox, poll until it completes, then launch a new devbox from that snapshot.
ARAZZORunloop Suspend and Resume a Devbox
Suspend a running devbox to free compute, wait until it is suspended, then resume it and wait until it is running again.
ARAZZORunloop Write, Execute, and Read a File on a Devbox
Boot a devbox, write a file into it, run a command that transforms the file, then read the resulting contents back.
ARAZZOScroll within the panel for all 10 ·
Pricing Plans 1
Pricing is part of the interface. Machine-readable plans tell you what a tier costs and includes before you commit — one of the things the Kin Score reads for access clarity — renamed from commercial clarity in rubric 0.12, because a free statutory interface has access terms and no commercial ones.
Published pricing tiers and plan structures.
Rate Limits 1
Rate limits are the difference between a demo that works and a production integration that doesn't fall over. Publishing them is an operational-transparency signal — and a hard requirement for any agent that plans its own throughput.
Documented rate limits and quota policies.
Runloop Ai Rate Limits
RATE LIMITSFinOps 1
Cost, billing, and metering signals let a buyer model the financial operations of an API before it's live. We profile them for the same reason we profile pricing: the money is part of the contract.
Cost, billing, and metering signals for API financial operations.
Runloop Ai Finops
FINOPSSemantic Vocabularies 1
JSON-LD contexts give the data shared meaning across APIs. We profile them because semantics are what let a machine reconcile 'customer' here with 'customer' somewhere else.
JSON-LD contexts and semantic vocabularies used across these APIs.
Runloop Context
JSON-LDSpectral Rules 2
Governance rulesets we run against this provider's specs — the automated checks behind parts of the score. Profiling them makes the quality bar explicit and re-runnable, not a matter of opinion.
Runloop API Rules
SPECTRALRunloop API Rules
SPECTRALJSON Schema 18
Standalone JSON Schema definitions describe the data models behind the API. We profile them so the shapes are validatable on their own — useful long after a single request is forgotten.
Standalone JSON Schema definitions for this provider's data models.
Runloop Agent
JSON SCHEMARunloop Api Key
JSON SCHEMARunloop Axon
JSON SCHEMARunloop Benchmark Run
JSON SCHEMARunloop Benchmark
JSON SCHEMARunloop Blueprint
JSON SCHEMARunloop Devbox
JSON SCHEMARunloop Execution
JSON SCHEMARunloop Gateway Config
JSON SCHEMARunloop Launch Parameters
JSON SCHEMARunloop Mcp Config
JSON SCHEMARunloop Network Policy
JSON SCHEMARunloop Object
JSON SCHEMARunloop Restricted Key
JSON SCHEMARunloop Scenario
JSON SCHEMARunloop Secret
JSON SCHEMARunloop Snapshot
JSON SCHEMARunloop Tunnel
JSON SCHEMAScroll within the panel for all 18 ·
JSON Structure 1
JSON Structure captures the data shapes in a form built for tooling — a complement to JSON Schema that keeps the model machine-legible.
JSON Structure definitions describing this provider's data shapes.
Runloop Devbox Structure
JSON STRUCTUREExamples 5
Real request and response payloads are what turn a spec from abstract into obvious — and they're one of the twelve things an agent needs to call an API correctly on the first try.
Example request and response payloads for these APIs.
Runloop Devbox Exec Example
EXAMPLESecurity Posture 3
Authentication, domain security, vulnerability disclosure, and trust-center signals — the evidence that a provider takes security seriously enough to document it. We profile it because you can't govern what you can't see.
Authentication, domain security, vulnerability disclosure, and trust-center signals.
Agentic Access 1
An x-agentic-access contract marks which operations are safe for an agent to run on its own and which need a human in the loop. It is the difference between an API an agent can use and one it can use safely.
Recommended x-agentic-access execution contracts for AI agents.
Resources
Every other property we hold for Runloop — documentation, portals, status pages, policies, and corporate surface — grouped by the job it does, following the integrator's arc from getting started to running in production.
Get Started 2
Portal, sign-up, and the first successful call
Documentation 7
Reference material describing how the API behaves
Scroll within the panel for all 7 ·
Agent Surfaces 1
MCP servers, agent skills, and machine-readable catalogs
Design & Contract 13
Pagination, idempotency, versioning, errors, and events
Scroll within the panel for all 13 ·
Build 20
SDKs, sample code, and the tooling you integrate with
Scroll within the panel for all 20 ·
Access & Security 5
Authentication, authorization, and security posture
Learn 1
Tutorials, courses, talks, and written guidance
Operate 4
Status, limits, changes, and where to get help
Commercial 3
Pricing, plans, and the legal terms of use
Company 6
The organization behind the API
Other 3
Properties that don't map to a standard resource type
← All providers · Data indexed from github.com/api-evangelist/runloop-ai · machine-readable index on apis.io
This is an independent, third-party profile of Runloop, published by API Evangelist. We do not operate, host, resell, or support these APIs, and we are not affiliated with or endorsed by the company unless stated above. Everything here is built from publicly available information — the company's own site, developer portal, documentation, public repositories, and the specifications it publishes for public use. Nothing is obtained by breaching a system, defeating an access control, or using credentials.
The Kin Score and Agent Readiness rating are independently calculated assessments of a company's public API artifacts, scored against a published rubric. They are not certifications, endorsements, security assessments, or audits.
Corrections, re-scores, and removal are free — no partnership or purchase required, and you do not need to justify the request. A removed company is recorded as unrated, never scored zero for having asked. Acknowledgement within one business day; removal within two.
info@apievangelist.com
·
Read the full data-sourcing policy →
On a security or compliance team? Put security in the subject line and
you will get a person, not a form — we will tell you exactly which public URLs this profile was built from.