Sign in
Text Embeddings Inference

Text Embeddings Inference endpoint info

Text Embeddings Inference endpoint info

get/info

Response

Served model info

docker_labelstring nullable
max_batch_requestsinteger nullable
max_batch_tokensinteger required
max_client_batch_sizeinteger required
max_concurrent_requestsinteger required

Router Parameters

max_input_lengthinteger required
model_dtypestring required
model_idstring required

Model info

model_poolingstring required
model_shastring nullable
shastring nullable
tokenization_workersinteger required
versionstring required

Router Info

Example response

{
  "docker_label": "null",
  "model_dtype": "float16",
  "model_id": "thenlper/gte-base",
  "model_pooling": "cls",
  "model_sha": "fca14538aa9956a46526bd1d0d11d69e19b5a101",
  "sha": "null",
  "version": "0.5.0"
}

Changes