Kong AI Gateway
Kong AI Gateway is the AI-native capability layer built on top of Kong Gateway and managed through Kong Konnect. It exposes a normalized, provider-agnostic LLM API across 16+ providers (OpenAI, Anthropic, Azure AI, Amazon Bedrock, Google Gemini, Vertex AI, Cohere, Hugging Face, Llama, Mistral, xAI, DashScope, Cerebras, Ollama, Databricks, DeepSeek, vLLM), and adds prompt firewalls, PII sanitization, semantic caching, automated RAG injection, token-level observability, per-agent cost allocation, MCP traffic governance, and Agent Gateway support for agent-to-agent (A2A) communication. It is profiled here as a standalone product surface; the parent provider profile lives at github.com/api-evangelist/kong.
Limited machine-readable signal and partial portal coverage — documentation a human can read, but little a machine or agent can consume without scraping.
API Evangelist profiles Kong AI Gateway the way a machine reads it — 46 machine-readable artifacts across 21 APIs, pulled from the provider's own public surface and indexed so a developer, an analyst, or an AI agent can evaluate it against every other provider on the network.
Every provider in the network is reduced to the same set of machine-readable artifacts — OpenAPI contracts, event specifications, GraphQL schemas, runnable collections, pricing and rate-limit signals, security posture, OAuth scopes, and the agent surfaces (MCP servers and skills) that let software drive the API on its own. We profile them because the interface is the part of a company you can actually inspect: it is a truer signal of what a provider does than any marketing page. From those artifacts we compute the Kin Score — Kong AI Gateway scores 34.7/100 (thin), with a separate agent-readiness read of 18/100 (agent aware). The full breakdown is below, followed by every artifact we hold — each card links through to its machine-readable definition on apis.io.
Kin Score
This is the API Evangelist rating — a single, repeatable read computed from the artifacts on this page. Green fill is points earned; the red track is points possible, so every bar shows earned-versus-possible at a glance.
Kin Score
How this is scored →scored 2026-07-27 · rubric v0.5
How we profile Kong AI Gateway
Each block below is one kind of artifact we hold for Kong AI Gateway. For each we say what it is and why it earns a place in the profile, then list every one we've indexed — capped at two rows, scroll within the panel for the rest.
APIs 21
Each API is captured as its own OpenAPI definition — every operation, parameter, and response. This is the single most useful machine-readable description of what an API does, and it's what lets us score, lint, mock, and generate against it without asking the provider for anything.
Individual APIs this provider publishes, each with its own machine-readable definition.
Kong AI Gateway
Kong AI Gateway is the connectivity and governance layer for AI-native applications. Built on Kong Gateway, it provides a universal LLM API across 16+ providers, semantic cachin...
AI Proxy Plugin
The AI Proxy plugin transforms and proxies requests to a configured AI provider and model, shielding client applications from provider-specific request and response shapes.
AI Proxy Advanced Plugin
The AI Proxy Advanced plugin extends AI Proxy with load balancing, weighted distribution, and fallback across multiple providers and models simultaneously.
AI Rate Limiting Advanced Plugin
Token-aware rate limiting tailored for LLM traffic, with per-consumer and per-model budgets rather than just request counts.
AI Prompt Guard Plugin
Enforces allow- and deny-lists for prompts and text completions, blocking disallowed content before it reaches the model.
AI Semantic Prompt Guard Plugin
Topic-aware variant of AI Prompt Guard that classifies prompts by meaning and blocks restricted topics regardless of phrasing.
AI PII Sanitizer Plugin
Detects and redacts personally identifiable information from prompts and responses traversing the gateway.
AI Semantic Cache Plugin
Caches LLM responses by prompt similarity so semantically equivalent requests can be served from cache, reducing latency and provider spend.
AI RAG Injector Plugin
Automates retrieval-augmented generation by injecting retrieved context into prompts at the gateway, so application code does not need to implement RAG plumbing.
AI Prompt Template Plugin
Provides reusable, fill-in-the-blank prompt templates managed at the gateway layer.
AI Prompt Decorator Plugin
Prepends or appends messages to chat history before requests reach the model.
AI Prompt Compressor Plugin
Reduces prompt token count before forwarding to the provider to lower latency and cost.
AI Azure Content Safety Plugin
Integrates Azure AI Content Safety for content moderation on prompts and responses.
AI AWS Guardrails Plugin
Integrates Amazon Bedrock Guardrails for safety enforcement on traffic passing through Kong AI Gateway.
AI GCP Model Armor Plugin
Integrates Google Cloud Model Armor for safety inspection on prompts and responses.
AI Lakera Guard Plugin
Integrates Lakera Guard for prompt-injection and jailbreak detection.
AI Semantic Response Guard Plugin
Inspects model responses by meaning and blocks responses that violate configured semantic policies.
AI Custom Guardrail Plugin
Lets operators define custom guardrail logic for prompts and responses without writing a full Kong plugin.
AI Request/Response Transformer Plugin
Uses LLMs at the gateway to transform request and response payloads (for example, reshaping JSON or translating fields) on the data path.
Kong Agent Gateway
Kong Agent Gateway is a capability of Kong AI Gateway (GA April 2026 with AI Gateway 3.14) that governs agent-to-agent (A2A) communication. It enforces agent identity verificati...
Kong MCP Registry
Kong MCP Registry (launched February 2026) is an enterprise directory inside Kong Konnect for registering, discovering, and governing MCP servers and AI-native tools. It provide...
Scroll within the panel for all 21 ·
MCP Servers 1
Model Context Protocol servers expose these APIs directly to AI agents. We profile them because agent-native access is the fastest-growing way this provider's capabilities actually get used.
Model Context Protocol servers that expose these APIs to AI agents.
Kong Konnect MCP Server
MCP SERVERPricing Plans 1
Pricing is part of the interface. Machine-readable plans tell you what a tier costs and includes before you commit — one of the six things the Kin Score reads for commercial clarity.
Published pricing tiers and plan structures.
Rate Limits 1
Rate limits are the difference between a demo that works and a production integration that doesn't fall over. Publishing them is an operational-transparency signal — and a hard requirement for any agent that plans its own throughput.
Documented rate limits and quota policies.
Kong Ai Gateway Rate Limits
RATE LIMITSFinOps 1
Cost, billing, and metering signals let a buyer model the financial operations of an API before it's live. We profile them for the same reason we profile pricing: the money is part of the contract.
Cost, billing, and metering signals for API financial operations.
Kong Ai Gateway Finops
FINOPSFeatures 10
The notable capabilities this provider advertises, captured as structured features so they can be searched and compared instead of read one landing page at a time.
Notable capabilities this provider offers.
Universal LLM API
One normalized request shape across 16+ providers (OpenAI, Anthropic, Azure AI, Bedrock, Gemini, Vertex AI, Cohere, Hugging Face, Llama, Mistral, xAI, DashScope, Cerebras, Ollam...
Prompt Firewalls and PII Sanitization
AI Prompt Guard, AI Semantic Prompt Guard, and AI PII Sanitizer block disallowed content and redact sensitive data before it hits the model.
Semantic Caching
AI Semantic Cache serves semantically similar prompts from cache to cut latency and provider spend.
Token-Aware Rate Limiting
AI Rate Limiting Advanced enforces per-consumer and per-model token budgets, not just request counts.
Automated RAG Injection
AI RAG Injector pulls retrieved context into prompts at the gateway so application code stays simple.
Multi-Provider Load Balancing
AI Proxy Advanced distributes traffic across providers with weighted distribution and fallback.
Content Safety Integrations
Built-in integrations with Azure Content Safety, AWS Bedrock Guardrails, GCP Model Armor, and Lakera Guard.
MCP Traffic Governance
Kong MCP Registry registers and governs MCP servers and tools that AI agents discover and call through the gateway.
Agent-to-Agent Governance
Kong Agent Gateway (GA April 2026 with AI Gateway 3.14) governs A2A traffic with identity, policy, and observability.
Token-Level Observability
Per-request, per-agent, and per-model token and cost telemetry surfaced into Konnect dashboards.
Scroll within the panel for all 10 ·
Security Posture 1
Authentication, domain security, vulnerability disclosure, and trust-center signals — the evidence that a provider takes security seriously enough to document it. We profile it because you can't govern what you can't see.
Authentication, domain security, vulnerability disclosure, and trust-center signals.
Use Cases 5
What developers actually build with this provider — captured so the catalogue answers 'what is this for', not just 'what does this expose'.
What developers build with this provider.
Provider-Agnostic LLM Access
Give applications a stable LLM endpoint while swapping providers and models behind the gateway.
AI Cost Control
Apply token budgets, semantic caching, and prompt compression to keep LLM spend bounded.
AI Safety and Compliance
Enforce prompt firewalls, PII redaction, jailbreak detection, and content safety on every prompt and response.
Agentic Tool Governance
Govern which MCP tools agents can discover and call, and inspect agent-to-agent traffic in production.
RAG at the Edge
Inject retrieval context into prompts at the gateway without changing client code.
Integrations 5
Pre-built integrations with other platforms tell you where this provider already fits in a stack.
Pre-built integrations with other platforms and tools.
OpenAI, Anthropic, Azure AI, Bedrock, Gemini, Vertex AI
Native provider integrations exposed through the AI Proxy plugin's normalized API.
Cohere, Hugging Face, Llama, Mistral, xAI, DashScope, Cerebras, Ollama, Databricks, DeepSeek, vLLM
Additional native provider targets for AI Proxy and AI Proxy Advanced.
Lakera Guard
Prompt-injection and jailbreak detection as a guardrail plugin.
Azure AI Content Safety / AWS Bedrock Guardrails / GCP Model Armor
Cloud-native content safety integrations available as Kong AI plugins.
Prometheus, Grafana, OpenTelemetry
Standard Kong Gateway observability stack carries LLM, MCP, and A2A telemetry.
Resources
Every other property we hold for Kong AI Gateway — documentation, portals, status pages, policies, and corporate surface — grouped by the job it does, following the integrator's arc from getting started to running in production.
Get Started 2
Portal, sign-up, and the first successful call
Documentation 2
Reference material describing how the API behaves
Agent Surfaces 2
MCP servers, agent skills, and machine-readable catalogs
Build 4
SDKs, sample code, and the tooling you integrate with
Access & Security 1
Authentication, authorization, and security posture
Operate 2
Status, limits, changes, and where to get help
Commercial 1
Pricing, plans, and the legal terms of use
Company 2
The organization behind the API
← All providers · Data indexed from github.com/api-evangelist/kong-ai-gateway · machine-readable index on apis.io