---
title: "Generate a stream of token using Server-Sent Events"
method: POST
path: "/generate_stream"
tags: ["LoRAX"]
---

# Generate a stream of token using Server-Sent Events

`POST /generate_stream`

Generate a stream of token using Server-Sent Events

## Request body

- GenerateRequest — unresolved $ref

## Response `200`

Generated Text

## Other responses

- `422` — Input validation error
- `424` — Generation Error
- `429` — Model is overloaded
- `500` — Incomplete generation

## Changes

- **2024-03-19** `cca02625fbcd` — 1 info
  - added the new optional request property `parameters/ignore_eos_token`
- **2024-02-12** `7a5ed91a6ffa` — 1 info
  - added the new optional request property `parameters/schema`
- **2024-02-01** `bf530b15fd2b` — 1 info
  - added the new optional request property `parameters/merged_adapters`
- **2024-01-10** `906cbf329039` — 1 info
  - added the new optional request property `parameters/apply_chat_template`
- **2024-01-09** `d3c70dbaab3b` — 1 info
  - added the required property `details/allOf[#/components/schemas/StreamDetails]/prompt_tokens` to the response with the `200` status

[Full history](https://skmtc.dev/predibase/apis/lorax/changes/generate_stream/post.md)

---

[API](https://skmtc.dev/predibase/apis/lorax.md) · [All operations](https://skmtc.dev/predibase/apis/lorax/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/predibase/lorax/revisions/cca02625fbcd/schema)