Inference

post/inference

Request body

textstring required

Topic, e.g. 'haunted places'

max_new_tokensinteger

Successful Response

outputstring required

promptstring required

n_tokensinteger required

secondsnumber required

tokens_per_secondnumber required