GATEWAY
One OpenAI-compatible entry point
Model catalog · per-team keys · routing by data sensitivity
budgets · throughput allocation · guardrails · audit
SERVING
Inference, tuned per workload
vLLM · SGLang · Ollama · model servers for classical ML and custom frameworks
WORKSPACES AND TRAINING
Build, train, publish
Notebooks with GPU profiles · templated training jobs · experiment tracking · registry
DATA AND ARTIFACTS
Nothing crosses twice
Object storage for datasets, models, checkpoints · container registry · caches
OBSERVABILITY AND COST
Measured, then billed
LGTM stack over workloads and platform · per-team metering · showback or chargeback
SUBSTRATE
Kubernetes, scheduling what matters
GPU operator · device plugins · partitioning and time-slicing · priority classes and preemption
OpenShift where enterprise support is required, upstream or OKD where it is not
HARDWARE
Whatever the estate holds. The platform is hardware-agnostic.