⚡ Bifrost AI Gateway

High-performance LLM gateway · OpenAI-compatible · Multi-provider · CalypsoAI guardrails via calypso/* models

Client
User / App
F5 XC RE
PoP / WAF
F5 XC CE
192.168.1.226
OpenShift
192.168.1.187
AI Gateway
⚡ Bifrost
ollama/*
Ollama :11434
calypso/* (scan+route)
🛡️ calypso-direct → CalypsoAI → Ollama
anthropic/*
Anthropic Claude
deepseek/*
DeepSeek

Service Details

ComponentLocationPortStatus
Bifrost GatewayOCP namespace: bifrost8080 → NodePort 30800Live
Web UI / APIbifrost-cmiller.amer-ent.f5demos.com443Live
Ollama LLM Backend192.168.1.212:1143411434Internal
CalypsoAI Guardrailswww.calypsoai.app443Cloud
calypso-direct (scan proxy)ai-demo ns · ClusterIP8000Internal

F5 Security Layer

FeatureProductDetail
WAFF5 XC App Firewallappfw-cmiller-ai policy
API DiscoveryF5 XC API Security7-day retention
AI Content ScanningCalypsoAI + F5 XCViolence/weapons semantic scanner
TLS TerminationF5 XCManaged cert, HTTPS only
Identity-based AccessF5 BIG-IP APMGitHub OAuth · millerch-lab org required

Supported Models (via Bifrost)

ModelProviderUse Case
ollama/llama3.2:latestOllama (local)Tool calling, chatbots
ollama/qwen2.5-coder:latestOllama (local)Code generation
calypso/llama3.2:latestcalypso-direct → CalypsoAI → OllamaGuardrail-enforced inference
calypso/qwen2.5-coder:latestcalypso-direct → CalypsoAI → OllamaGuardrail-enforced code gen
deepseek/*DeepSeek APIGeneral inference
anthropic/*Anthropic ClaudeAdvanced reasoning