5 docs tagged with "system"

This guide describes how to configure model pricing at the System scope. Model pricing is the install-wide catalog of per-model rates (USD per 1,000,000 tokens) that the Inference Launchpad gateway uses for cost accounting and that the Cost dimension of Inference Quotas is measured against. PaletteAI federates the catalog to every Launchpad-enabled spoke; each served model that appears in the catalog gets an explicit rate, and every other served model falls back to the Default rate. Without a Default and an explicit price for a model, that model's requests do not contribute to the Cost dimension of any quota.

Use System Settings to manage System-scoped configuration in the PaletteAI UI. System is the top-level scope, backed by the pai-system namespace and managed by platform operators. From this page, you can manage organization-wide configuration such as integrations, GPU limits, Compute Configs, Scaling Policies, Model as a Service Mappings, and Multi-Instance GPU (MIG) availability that cascades to every Tenant and Project.

System is the top-level scope in PaletteAI, backed by the pai-system namespace and managed by platform operators. It sits above Tenants and Projects in the scope hierarchy.

In an air-gapped deployment, the AIWorkloads that PaletteAI deploys must resolve their images and charts from the internal Zot registry. To make that registry available to workload templates without manual setup, PaletteAI injects a set of registry variables into the system VariableSet named mural-variables. Workload profiles reference these variables with the {{ var. }} macro syntax.

This page provides troubleshooting guidance for common issues with the cluster-wide System resource, which defines the top-level PaletteAI configuration that Tenants and Projects inherit, including GPU quotas, model settings, and the system compute.