The SDK drops into your backend as Python, Node, or Go middleware. Most teams are enforcing policy on production traffic in under 24 hours. Input policies screen what users send in; output policies screen what your feature says back. Your application code doesn't change.
Per-user and per-tier rate limits, token budgets with hard caps, and anomaly detection for scripted abuse. When a user trips a limit, the response is a clean product decision (throttle, downgrade, or suspend) instead of a surprise on the invoice.
Model changes roll out behind policy gates: route a fraction of traffic, watch the guardrail telemetry, and roll back in seconds if behavior drifts. Prompt-injection defense and PII redaction apply uniformly across whichever model serves the request.
Inline evaluation runs at sub-38ms p99, below perceptual thresholds for chat-style features and far below typical model inference time.
Yes. The middleware sits between your application and any inference endpoint, hosted APIs and self-hosted models get the same policies.
Policy evaluation happens inline; prompt content is not used to train models. Retention of logs is configurable, and PII can be redacted before it ever reaches your model or ours.
Yes. Policies are scoped, so free-tier users can carry tighter budgets and stricter content rules than enterprise seats, from one policy file.