inference

Mixed-success batches return 200 with only successful items; the response carries no per-item error envelope. For per-item error visibility, send single-item batches.

post/v1/score/{model}

Request

  • The document declares no server URL.
  • Auth
    • HTTP bearer
    • or API key in header x-api-key

Path parameters

modelstring required

Model id. Runtime route is Axum catch-all /v1/score/{*model}; clients using this OpenAPI path template should percent-encode slashes in model ids, for example BAAI%2Fbge-m3.

Headers

X-SIE-MACHINE-PROFILEstring nullable

Preferred GPU or machine profile

X-SIE-Poolstring nullable

Explicit pool routing override

X-SIE-SDK-Versionstring nullable

Client SDK version for skew warnings

X-SIE-Remote'forbid'

Require local serving through a current worker execution fence. A selected remote profile returns 400; no verified local worker returns retryable 503. Duplicate or other values return 400.

Request body

instructionstring nullable
optionsunknown

Response

Score response

modelstring required
query_idstring nullable

Changes

    • info

      added the new optional header request parameter X-SIE-Remote

    • breaking

      the /////// request property contentEncoding changed from to base64 (media type: application/json)

    • breaking

      the /////// request property contentEncoding changed from to base64 (media type: application/msgpack)

    • breaking

      the /////// request property contentEncoding changed from to base64 (media type: application/vnd.msgpack)

    • breaking

      the /////// request property contentEncoding changed from to base64 (media type: application/x-msgpack)

    • breaking

      the //// request property contentEncoding changed from to base64 (media type: application/json)

    • breaking

      the //// request property contentEncoding changed from to base64 (media type: application/msgpack)

    • breaking

      the //// request property contentEncoding changed from to base64 (media type: application/vnd.msgpack)

    • breaking

      the //// request property contentEncoding changed from to base64 (media type: application/x-msgpack)

    • breaking

      the ////// request property contentEncoding changed from to base64 (media type: application/json)

    • breaking

      the ////// request property contentEncoding changed from to base64 (media type: application/msgpack)

    • breaking

      the ////// request property contentEncoding changed from to base64 (media type: application/vnd.msgpack)

    • breaking

      the ////// request property contentEncoding changed from to base64 (media type: application/x-msgpack)

    • breaking

      the /// request property contentEncoding changed from to base64 (media type: application/json)

    • breaking

      the /// request property contentEncoding changed from to base64 (media type: application/msgpack)

    • breaking

      the /// request property contentEncoding changed from to base64 (media type: application/vnd.msgpack)

    • breaking

      the /// request property contentEncoding changed from to base64 (media type: application/x-msgpack)

    • breaking

      the /////// request property type changed from array to string (media type: application/json)

    • breaking

      the //// request property type changed from array to string (media type: application/json)

    • breaking

      the ////// request property type changed from array to string (media type: application/json)

    • breaking

      the /// request property type changed from array to string (media type: application/json)

    • info

      added the new optional request property // (media type: application/json)

    • info

      added the new optional request property // (media type: application/msgpack)

    • info

      added the new optional request property // (media type: application/vnd.msgpack)

    • info

      added the new optional request property // (media type: application/x-msgpack)

    • info

      added the new optional request property // (media type: application/json)

    • info

      added the new optional request property // (media type: application/msgpack)

    • info

      added the new optional request property // (media type: application/vnd.msgpack)

    • info

      added the new optional request property // (media type: application/x-msgpack)

    • info

      added the new optional request property / (media type: application/json)

    • info

      added the new optional request property / (media type: application/msgpack)

    • info

      added the new optional request property / (media type: application/vnd.msgpack)

    • info

      added the new optional request property / (media type: application/x-msgpack)

    • info

      added the new optional request property / (media type: application/json)

    • info

      added the new optional request property / (media type: application/msgpack)

    • info

      added the new optional request property / (media type: application/vnd.msgpack)

    • info

      added the new optional request property / (media type: application/x-msgpack)

    • info

      the /////// request property type was generalized from array to string (media type: application/msgpack)

    • info

      the /////// request property type was generalized from array to string (media type: application/vnd.msgpack)

    • info

      the /////// request property type was generalized from array to string (media type: application/x-msgpack)

    • info

      the //// request property type was generalized from array to string (media type: application/msgpack)

    • info

      the //// request property type was generalized from array to string (media type: application/vnd.msgpack)

    • info

      the //// request property type was generalized from array to string (media type: application/x-msgpack)

    • info

      the ////// request property type was generalized from array to string (media type: application/msgpack)

    • info

      the ////// request property type was generalized from array to string (media type: application/vnd.msgpack)

    • info

      the ////// request property type was generalized from array to string (media type: application/x-msgpack)

    • info

      the /// request property type was generalized from array to string (media type: application/msgpack)

    • info

      the /// request property type was generalized from array to string (media type: application/vnd.msgpack)

    • info

      the /// request property type was generalized from array to string (media type: application/x-msgpack)