/
/Text Embeddings Inference
ChangesDocsSign in
Sign in
  • APIs
  • Generators
  • Stacks
  • Projects
  • Docs
  • History
  • Schema
Checked 29m ago · Updated 2mo ago
Text Embeddings Inference12
  • postDecode input ids
  • postGet Embeddings. Returns a 424 status code if the model is not an embedding model.
  • postGet all Embeddings without Pooling.
  • postGet Sparse Embeddings. Returns a 424 status code if the model is not an embedding model with SPLADE pooling.
  • postOpenAI compatible route. Returns a 424 status code if the model is not an embedding model.
  • getHealth check method
  • getText Embeddings Inference endpoint info
  • getPrometheus metrics scrape endpoint
  • postGet Predictions. Returns a 424 status code if the model is not a Sequence Classification model
  • postGet Ranks. Returns a 424 status code if the model is not a Sequence Classification model with
  • postTokenize inputs
  • postGenerate embeddings from a Vertex request
    Text Embeddings Inference

    Generate embeddings from a Vertex request

    Generate embeddings from a Vertex request

    post/vertex

    Request body

    Example request

    {
      "instances": [
        {
          "query": "What is Deep Learning?",
          "texts": [
            "Deep Learning is ..."
          ]
        }
      ]
    }

    Response

    Results

    Changes