---
title: "POST /v1/generate/{model}"
method: POST
path: "/v1/generate/{model}"
tags: ["inference"]
---

# POST /v1/generate/{model}

`POST /v1/generate/{model}`

Blocking text generation (walking-skeleton surface). The model path parameter must use the SIE-safe ID (e.g. ``Qwen__Qwen3-4B-Instruct``); HF-style slashes are rejected with 400.

## Path parameters

- `model` string, required

## Headers

- `X-SIE-MACHINE-PROFILE` string, nullable
- `X-SIE-Pool` string, nullable
- `X-SIE-SDK-Version` string, nullable

## Request body

- GenerateRequest — SIE-native blocking text-generation request.
  - `frequency_penalty` number, double, nullable
  - `grammar` unknown
  - `max_new_tokens` integer, required
  - `presence_penalty` number, double, nullable
  - `prompt` string, required
  - `prompt_cache_key` string, nullable
  - `routing_key` string, nullable
  - `safety_identifier` string, nullable — Sensitive PII - parsed and dropped, never logged or forwarded.
  - `stop` string[], nullable — Stop sequences for the native generate surface.
  - `temperature` number, float, nullable
  - `top_p` number, float, nullable

## Response `200`

Generated text response

- GenerateResponse
  - `attempt_id` string, required
  - `finish_reason` string, required
  - `model` string, required
  - `text` string, required
  - `tpot_ms` number, double, nullable
  - `ttft_ms` number, double, nullable
  - `usage` GenerateUsage
    - `completion_tokens` integer, required
    - `prompt_tokens` integer, required
    - `total_tokens` integer, required

## Other responses

- `202` — Worker provisioning in progress
- `400` — Invalid request
- `401` — Missing or invalid bearer token (inference token)
- `404` — Model not found
- `500` — Worker emitted malformed response; gateway auth enabled but no tokens configured
- `503` — Queue unavailable or model loading
- `504` — Generation timeout

## Changes

- **2026-05-27** `d145a90eb76e` — 1 info
  - endpoint added
- **2026-05-08** `a499d5bea359` — 1 breaking
  - api path removed without deprecation

[Change history](https://skmtc.dev/superlinked/apis/sie-gateway/changes/v1/generate/:model/post.md)

---

[API](https://skmtc.dev/superlinked/apis/sie-gateway.md) · [All operations](https://skmtc.dev/superlinked/apis/sie-gateway/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/superlinked/sie-gateway/revisions/d145a90eb76e/schema)