Overview

LLM Gateway, Overview

The Xybern LLM Gateway is a transparent reverse proxy that sits between your AI agent and any LLM provider. Every completion request passes through the enforcement engine, policies, trust scoring, escalation, and vault logging, without requiring any changes to your agent code.

Without Xybern:
  Agent → OpenAI        (no policies, no audit, no control)
  Agent → Anthropic     (no policies, no audit, no control)

With Xybern LLM Gateway:
  Agent → Xybern Gateway → [enforce] → OpenAI     ✓ allowed
                          → [enforce] → Anthropic  ⏸ escalated
                          → [enforce] → Azure      ✗ blocked

All you change is the base_url (or endpoint_url for Bedrock). Your existing provider credentials pass through. Xybern identifies your workspace via the X-Xybern-API-Key header.