Custom models
Custom models will let you serve your own weights on our infrastructure, and call them through the same OpenAI-compatible API and keys as catalog models.
How we expect it to work
Section titled “How we expect it to work”- Provide the weights — from a model registry, or uploaded directly.
- Choose a serving configuration — GPU type, count and precision. Larger models need more VRAM, and quantisation trades quality for cost.
- We start a dedicated endpoint for it.
- Call it by its model ID, exactly like any other model.
What we expect to hold true
Section titled “What we expect to hold true”- Your weights stay private to your workspace.
- Billed on GPU time, not tokens — a dedicated endpoint costs the same whether it is saturated or idle.
- You are responsible for holding a licence that permits your intended use.
This suits models you have fine-tuned elsewhere, architectures we don’t carry, or weights you cannot share with a third-party API.