---
title: "Inference"
method: POST
path: "/inference"
---

# Inference

`POST /inference`

## Request

- Base URL: `https://api.baudlabs.ai` (the document declares no server; this is the origin it was published from)
- URL: `https://api.baudlabs.ai/inference`
- Auth: none declared

## Request body

- InferenceRequest
  - `text` string, required: Topic, e.g. 'haunted places'
  - `max_new_tokens` integer

## Response `200`

Successful Response

- InferenceResponse
  - `output` string, required
  - `prompt` string, required
  - `n_tokens` integer, required
  - `seconds` number, required
  - `tokens_per_second` number, required

## Other responses

- `422`: Validation Error

---

[API](https://skmtc.dev/baudlabs/apis/baudlabs-api.md) - [All operations](https://skmtc.dev/baudlabs/apis/baudlabs-api/llms.txt) - [OpenAPI document](https://skmtc.dev/baudlabs/apis/baudlabs-api/revisions/fca81b5e2abb?raw)