FRfriendli
Dedicated.Endpoint

Create a new endpoint

Create a new endpoint and return its status

post/dedicated/beta/endpoint

Request

Headers

X-Friendli-Teamstring nullable

ID of team to run requests as (optional parameter).

Request body

projectIdstring required

The ID of the project that owns the endpoint.

namestring required

The name of the endpoint.

instanceOptionIdstring required

The ID of the instance option.

Available options:

  • 1x NVIDIA A100 80GB: ShbPuOs4tfGb
  • 2x NVIDIA A100 80GB: mrAHuYt7T40o
  • 4x NVIDIA A100 80GB: JkNob0NMdoF3
  • 8x NVIDIA A100 80GB: sYH4kHmAcA5P
  • 1x NVIDIA H100: TwD5AqnBSVN0
  • 2x NVIDIA H100: zfTutSiLn0Hq
  • 4x NVIDIA H100: lfkRz5G48REc
  • 8x NVIDIA H100: GUA4qYFmsYz8
  • 1x NVIDIA H200: LnK1wTaKc7WO
  • 2x NVIDIA H200: Tu6GjBnfHPe4
  • 4x NVIDIA H200: OhTzYtZuomzI
  • 8x NVIDIA H200: ahBzWtOuomsI
  • 1x NVIDIA B200: 8GiQTLKfJNOr
  • 2x NVIDIA B200: brTZGIuYgVrs
  • 4x NVIDIA B200: AFoZMFXZnAdD
  • 8x NVIDIA B200: drbc6G9FxJWZ
hfModelRepostring required

HF ID of the model.

hfModelRepoRevisionstring nullable

HF commit hash of the model.

initialVersionCommentstring nullable

The comment for the initial version.

Response

Successfully created the endpoint.

status'UNKNOWN' | 'INITIALIZING' | 'RUNNING' | 'UPDATING' | 'SLEEPING' | 'AWAKING' | 'FAILED' | 'STOPPING' | 'TERMINATING' | 'TERMINATED' | 'READY' required

Status of inference deployment.

errorCode'WORKLOAD_INIT_UNKNOWN_ERROR' | 'WORKLOAD_INIT_SETTINGS_ERROR' | 'WORKLOAD_INIT_GRPC_ERROR' | 'WORKLOAD_INIT_MANIFEST_NOT_FOUND_ERROR' | 'WORKLOAD_INIT_MANIFEST_TYPE_ERROR' | 'WORKLOAD_INIT_DOWNLOAD_ERROR' | 'WORKLOAD_INIT_INVALID_TOKEN_ERROR' | 'WORKLOAD_INIT_CANNOT_ACCESS_REPO_ERROR' | 'WORKLOAD_INIT_HF_WANDB_API_ERROR' | 'WORKLOAD_INIT_INSUFFICIENT_DISK_ERROR' | 'INFERENCE_ENGINE_UNKNOWN_ERROR' | 'INFERENCE_ENGINE_INVALID_ARGUMENT_ERROR' | 'INFERENCE_ENGINE_MEMORY_ERROR' | 'INFERENCE_ENGINE_METERING_CLIENT_CONFIG_ERROR'

ErrorCode type.

createdAtstring date-time required

When the endpoint was created.

updatedAtstring date-time nullable

When the endpoint was last updated.

phase'REQUESTING_VIRTUAL_MACHINE' | 'DOWNLOADING_MODEL' | 'ENGINE_INITIALIZING' nullable

The current phase of the endpoint.

Changes

No recorded changes to this operation across all 1 revision of this API.