---
description: "Call open models on Verda through an OpenAI-compatible API. Enable a model, create an API key, and pay per token from your project balance."
revision_date: 04.11.2026
---

# Inference

Verda Inference is the easiest way to use open models on Verda. The API is OpenAI-compatible: if you already use an OpenAI client, point it at Verda's base URL and use your Verda API key.

!!! note "Preview"
    Verda Inference is in **preview**. It's live and ready for real workloads. We're defining **SLAs** and **SLOs** for uptime and performance, usage limits apply, and details may change before general availability. Send feedback through the chat in the [Console](https://console.verda.com/).

We don't use your prompts or responses to train models, and we don't store them. See [Your data](#your-data).

## Get started

<div class="grid cards" markdown>

- :verda-inference: **Quickstart**

    ---

    Enable a model, create an API key, and make your first call.

    [:octicons-arrow-right-24: Quickstart](https://docs.verda.com/inference/quickstart/)

- :verda-container: **Models**

    ---

    The models you can call, their model IDs, and how to enable them.

    [:octicons-arrow-right-24: Models](https://docs.verda.com/inference/models/)

- :verda-code: **OpenAI compatibility**

    ---

    Use the OpenAI SDKs with Verda: streaming, reasoning output, and errors.

    [:octicons-arrow-right-24: OpenAI compatibility](https://docs.verda.com/inference/openai-compatibility/)

- :verda-terminal: **Coding agents**

    ---

    Use Verda models in OpenCode and Pi Coder.

    [:octicons-arrow-right-24: Coding agents](https://docs.verda.com/inference/coding-agents/)

</div>

## Models

| Model | Provider | Model ID |
|-------|----------|----------|
| [Kimi K3.1 Pro](https://docs.verda.com/inference/models/kimi-k3-1-pro/) | Moonshot AI | `kimi-k3-1-pro` |

You'll find the full list, with prices and live status, under **Inference > Models** in the [Console](https://console.verda.com/).

## Rate limits

Each project has its own requests-per-minute and tokens-per-minute limits for each model. See [Rate limits](https://docs.verda.com/inference/rate-limits/).

## Where it runs

Models run on Verda GPUs in our datacenters in Europe. Each model's page lists the country it runs in.

## Pricing

You pay per token, from your project balance:

- **Input**: the tokens you send.
- **Cached input**: input tokens that repeat the start of a recent request, such as an agent resending its history. They cost less on models that offer a cached input price. Caching is automatic, and context stays cached for up to 2 hours.
- **Output**: the tokens the model generates, including reasoning.

Each model's page in the Console shows its prices per 1M tokens, in your billing currency. Every model runs on the Standard tier.

Requests that fail or are interrupted, including timeouts, client disconnects and streams that end early, aren't charged.

Your project needs a balance of at least $1 to enable a model. The minimum top-up is $20. If the balance runs low, inference is paused until you [top up](https://docs.verda.com/welcome-to-verda/pricing-and-billing/#topping-up-in-the-console). You can follow token usage under **Inference > Usage** and costs under **Billing > Billing history > Inference**.

## Your data

- **Prompts and responses aren't stored.** Request context is held briefly in an in-memory inference cache and is removed within 2 hours. We keep only the operational metadata needed to run the service and bill you.
- **No training.** We don't use your inputs or outputs to train any AI model.
- **Nothing is shared with the model provider.** Models run on Verda's own infrastructure, and no request data is sent to the model developer or any other third party.

See the [FAQ](https://docs.verda.com/inference/faq/#data-and-security) for more, and the [Trust Center](https://trust.verda.com) for our certifications.

## When to use something else

- **Your own or fine-tuned model**: deploy it on [serverless containers](https://docs.verda.com/containers/overview/).
- **Your own serving stack, steady high volume or full control**: use [GPU instances](https://docs.verda.com/cpu-and-gpu-instances/set-up-a-gpu-instance/) or [Instant Clusters](https://docs.verda.com/clusters/instant-clusters/).

## Terms

Inference is covered by the [Terms of Service](https://verda.com/terms-and-conditions), including the AI Terms of Service in Schedule 5, and by each model's own license, linked from its model page. The [Privacy Policy](https://verda.com/privacy-policy) explains how we handle personal data.