Serverless

Create Endpoint

Changed on
post/api/v2/serverless/endpoints

Request

  • Base URL
    https://xcelsior.ca
  • URL
    https://xcelsior.ca/api/v2/serverless/endpoints
  • Auth
    HTTP bearer

Request body

namestring
modestring
managed_enginestring
model_namestring
model_refstring
image_refstring
docker_imagestring
source_typestring
source_refstring
source_ref_branchstring
gpu_typestring
gpu_tierstring
gpu_countinteger
regionstring
min_workersinteger
max_workersinteger
max_concurrencyinteger
idle_timeout_secinteger
scaledown_window_secinteger nullable
scaling_policy_typestring
scaling_policy_valueinteger
execution_modestring
queue_timeout_secinteger
startup_commandstring
http_portinteger
health_check_pathstring
health_endpointstring
cuda_versionstring
request_timeout_secinteger
max_request_bytesinteger
envobject
lora_adaptersobject[]

Response

Successful Response

unknown required

Changes

    • info

      added the new optional request property

    • info

      added the new optional request property

    • info

      added the new optional request property

    • info

      added the new optional request property

    • info

      added the new optional request property

    • info

      added the new optional request property

    • info

      added the new optional request property

    • info

      the request property default value changed from 300 to 60

    • info

      the request property default value changed from 4 to 1

    • info

      the request property default value changed from 4 to 3

    • info

      the request property default value changed from 0 to 1

    • info

      endpoint added