01
Identity-first proxy
Cloudflare Worker between your app and the model. Every request carries the user identity from your IDP. RBAC, rate limits, and PII redaction happen here.
★ Enterprise LLMDirect LLM · no framework8-week engagement
ENTERPRISE LLM · SECURITY + GOVERNANCELLM that passes legal, security, and procurement.
Production LLM for regulated industries — SSO, RBAC, audit trails, data-residency, and PII redaction enforced at the proxy. Vendor-neutral abstraction so your CISO doesn't lock you to a single model.
TypeScriptPostgreSQLOpenTelemetryOAuth
Cycle
8 weeks · governance-first
Stack
Your IDP · your VPC · your auditors
Output
Proxy + policies + audit pipeline
Compliance
SOC 2 / HIPAA / ISO-friendly
[WHY THIS EXISTS]
Most LLM rollouts die in procurement.
Engineering ships a prototype, legal reviews the vendor's privacy policy, security flags raw-prompt logging, and the project quietly disappears. Enterprise LLM means designing for the second meeting, not the first demo.
- Prompt + completion logs scrubbed of PII before they leave your VPC
- Per-user, per-team RBAC on tools, data sources, and models
- Audit trail every model call — who, what, when, which prompt version
- Vendor abstraction so OpenAI → Anthropic → on-prem is a config change
[HOW WE BUILD IT]
Governance is a layer, not a feature.
02
Policy as code
Data-classification rules, allowed-tool lists, output-redaction patterns — declared in TypeScript, version-controlled, eval-tested.
03
Audit pipeline
Every prompt + completion shipped to your SIEM with PII removed. Retention controls match your compliance window.
04
Vendor-neutral SDK
Wrapper that exposes the same interface for OpenAI, Anthropic, Google, and self-hosted. Swap with a config flag — no consumer-side rewrite.
[OUTCOMES AT HANDOFF]
What's live at week eight.
Zero
Raw-prompt logs leaving the VPC
5 min
From new role to provisioned access
1 config
To swap model vendor
SOC 2
Audit-ready event stream
[ALSO WORTH READING]
Related LLM engagements.
DIRECT LLM · APPLIED KBring the problem.
Bring the problem.
We’ll bring the build.
Eight weeks, fixed price, eval suite at handoff. Direct LLM engineering on top of the K-Framework. Two Q3 slots remain.