Sign in
Serverless

Create Endpoint

post/api/v2/serverless/endpoints

Request body

namestring
modestring
managed_enginestring
model_namestring
model_refstring
image_refstring
docker_imagestring
source_typestring
source_refstring
source_ref_branchstring
gpu_typestring
gpu_tierstring
gpu_countinteger
regionstring
min_workersinteger
max_workersinteger
max_concurrencyinteger
idle_timeout_secinteger
scaledown_window_secinteger nullable
scaling_policy_typestring
scaling_policy_valueinteger
execution_modestring
queue_timeout_secinteger
startup_commandstring
http_portinteger
health_check_pathstring
health_endpointstring
cuda_versionstring
request_timeout_secinteger
max_request_bytesinteger
envobject
lora_adaptersobject[]

Response

Successful Response

{"stackTrail":"paths:/api/v2/serverless/endpoints:post:responses:200:content:application/json:schema","oasType":"schema","type":"unknown"}

Changes

Changed in 2 of the 24 revisions of this API.12

  • 016014e1681011See the full diff
    • ○

      added the new optional request property

      new-optional-request-property

    • ○

      added the new optional request property

      new-optional-request-property

    • ○

      added the new optional request property

      new-optional-request-property

    • ○

      added the new optional request property

      new-optional-request-property

    • ○

      added the new optional request property

      new-optional-request-property

    • ○

      added the new optional request property

      new-optional-request-property

    • ○

      added the new optional request property

      new-optional-request-property

    • ○

      the request property default value changed from 300 to 60

      request-property-default-value-changed

    • ○

      the request property default value changed from 4 to 1

      request-property-default-value-changed

    • ○

      the request property default value changed from 4 to 3

      request-property-default-value-changed

    • ○

      the request property default value changed from 0 to 1

      request-property-default-value-changed

  • cbe3ad94235c1See the full diff
    • ○

      endpoint added

      endpoint-added

    This revision also has 1 change that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog