The SDK drops into your backend as Python, Node, or Go middleware — most teams are enforcing policy on production traffic in under 24 hours. Input policies screen what users send in; output policies screen what your feature says back. Your application code doesn't change.
Per-user and per-tier rate limits, token budgets with hard caps, and anomaly detection for scripted abuse. When a user trips a limit, the response is a clean product decision — throttle, downgrade, or suspend — instead of a surprise on the invoice.
Model changes roll out behind policy gates: route a fraction of traffic, watch the guardrail telemetry, and roll back in seconds if behavior drifts. Prompt-injection defense and PII redaction apply uniformly across whichever model serves the request.
Inline evaluation runs at sub-38ms p99 — below perceptual thresholds for chat-style features and far below typical model inference time.
Yes. The middleware sits between your application and any inference endpoint — hosted APIs and self-hosted models get the same policies.
Policy evaluation happens inline; prompt content is not used to train models. Retention of logs is configurable, and PII can be redacted before it ever reaches your model or ours.
Yes — policies are scoped, so free-tier users can carry tighter budgets and stricter content rules than enterprise seats, from one policy file.