---
title: "Generate tokens if `stream == false` or a stream of token if `stream == true`"
method: POST
path: "/"
tags: ["Text Generation Inference"]
---

# Generate tokens if `stream == false` or a stream of token if `stream == true`

`POST /`

Generate tokens if `stream == false` or a stream of token if `stream == true`

## Request body

- CompatGenerateRequest — unresolved $ref

## Response `200`

See /generate or /generate_stream

## Other responses

- `422` — Input validation error
- `424` — Generation Error
- `429` — Model is overloaded
- `500` — Incomplete generation

## Changes

- **2023-04-18** `de34bec00da8` — 1 info
  - endpoint added
- **2023-02-03** `a9059df72b92` — 1 breaking
  - api path removed without deprecation

[Change history](https://skmtc.dev/preemo-inc/apis/text-generation-inference/changes/post.md)

---

[API](https://skmtc.dev/preemo-inc/apis/text-generation-inference.md) · [All operations](https://skmtc.dev/preemo-inc/apis/text-generation-inference/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/preemo-inc/text-generation-inference/revisions/de34bec00da8/schema)