One doc tagged with "inference"

PaletteAI Inference Launchpad is Spectro Cloud's inference gateway. It runs on a Kubernetes cluster and serves models to callers over an OpenAI-compatible API, applying authentication and usage metering on every request.