Skip to main content
Version: v1.3.x

PaletteAI Inference Launchpad

This section describes how to manage PaletteAI Inference Launchpad from PaletteAI. Inference Launchpad can also run standalone; the tasks in this section apply only when you use PaletteAI as its central control plane. When you do, PaletteAI is the single place where clusters are provisioned, usage budgets are defined, credentials are issued, and model prices are catalogued, and the hub federates each of those to every Launchpad-enabled Compute Pool.

For how Inference Launchpad fits into the wider PaletteAI experience, refer to PaletteAI Inference Launchpad. For the gateway behavior itself, refer to the PaletteAI Inference Launchpad documentation.

Deploy an Inference Launchpad Cluster​

An Inference Launchpad cluster is a standard Compute Pool whose Profile Bundle opts the spoke in to Inference Launchpad. Once you have such a Compute Pool, deploying a vLLM-backed model to it is the same as any other Model Deployment — the gateway automatically proxies it. To bring up an Inference Launchpad cluster end to end, including the Profile Bundle and networking inputs the bundle asks for, refer to Deploy an Inference Launchpad Cluster.

Manage Inference Quotas​

An Inference Quota is a usage budget the Inference Launchpad gateway enforces on inference requests. Quotas live at the System, Tenant, or Project scope, either as the scope-total budget that caps all inference at that scope or as a per-model budget that narrows a specific set of Model Deployments. To create a new per-model quota, edit the limits on an existing quota, or delete a quota, refer to Manage Inference Quotas.

Manage API Keys​

An API Key is a bearer credential that a client presents to the Inference Launchpad gateway to authenticate an inference request. Each key draws against exactly one Inference Quota and is scoped to the OIDC groups its holder must belong to. To issue a new key, copy its value out for distribution, edit its OIDC groups or expiration, revoke it, or delete it, refer to Manage API Keys.

Configure Model Pricing​

Model pricing is the install-wide catalog of per-model rates (USD per 1,000,000 tokens) the Inference Launchpad gateway uses for cost accounting and that the Cost dimension of Inference Quotas is measured against. It is a System-admin-only task and is set once at the System scope. To edit the default rate, add or update per-model rates, or delete a rate, refer to Configure Model Pricing.