Serverless

Api Serverless Create Endpoint

post/api/v2/serverless/endpoints

Request body

namestring

modestring

model_namestring

model_refstring

image_refstring

docker_imagestring

gpu_typestring

gpu_tierstring

gpu_countinteger

regionstring

min_workersinteger

max_workersinteger

max_concurrencyinteger

idle_timeout_secinteger

scaledown_window_secinteger nullable

scaling_policy_typestring

scaling_policy_valueinteger

startup_commandstring

http_portinteger

health_check_pathstring

health_endpointstring

cuda_versionstring

request_timeout_secinteger

max_request_bytesinteger

envobject

Successful Response

{"stackTrail":"paths:/api/v2/serverless/endpoints:post:responses:200:content:application/json:schema","oasType":"schema","type":"unknown"}