Inference v2

Api Inference Create Endpoint

Create a serverless inference endpoint.

post/api/v2/inference/endpoints

Request body

model_namestring required
min_workersinteger
max_workersinteger
scaledown_window_secinteger

Response

Successful Response

{"stackTrail":"paths:/api/v2/inference/endpoints:post:responses:200:content:application/json:schema","oasType":"schema","type":"unknown"}

Changes