---
title: "Inference"
method: POST
path: "/inference"
---

# Inference

`POST /inference`

## Request body

- InferenceRequest
  - `text` string, required — Topic, e.g. 'haunted places'
  - `max_new_tokens` integer

## Response `200`

Successful Response

- InferenceResponse
  - `output` string, required
  - `prompt` string, required
  - `n_tokens` integer, required
  - `seconds` number, required
  - `tokens_per_second` number, required

## Other responses

- `422` — Validation Error

---

[API](https://skmtc.dev/baudlabs/apis/fastapi.md) · [All operations](https://skmtc.dev/baudlabs/apis/fastapi/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/baudlabs/fastapi/revisions/fca81b5e2abb/schema)