Text Embeddings Inference

OpenAI compatible route. Returns a 424 status code if the model is not an embedding model.

OpenAI compatible route. Returns a 424 status code if the model is not an embedding model.

post/embeddings

Request body

modelstring nullable
userstring nullable

Example request

{
  "model": "null",
  "user": "null"
}

Response

Embeddings

modelstring required
objectstring required

Example response

{
  "data": [
    {
      "embedding": [
        "0.0",
        "1.0",
        "2.0"
      ],
      "object": "embedding"
    }
  ],
  "model": "thenlper/gte-base",
  "object": "list"
}

Changes