FRfriendli
Dedicated.Endpoint

Get endpoint specification

Get the specification of an endpoint

get/dedicated/beta/endpoint/{endpoint_id}

Request

Path parameters

endpoint_idstring required

The ID of the endpoint

Headers

X-Friendli-Teamstring nullable

ID of team to run requests as (optional parameter).

Response

Successfully retrieved the endpoint specification.

namestring required

The name of the endpoint.

gpuTypestring required

The type of GPU to use for the endpoint.

numGpuinteger required

The number of GPUs to use per replica.

instanceIdstring nullable

The ID of the instance.

projectIdstring required

The ID of the project that owns the endpoint.

creatorIdstring required

The ID of the user who created the endpoint.

teamIdstring required

The ID of the team that owns the endpoint.

autoscalingMininteger required

The minimum number of replicas to maintain.

autoscalingMaxinteger required

The maximum number of replicas allowed.

autoscalingCooldowninteger required

The cooldown period in seconds between scaling operations.

maxBatchSizeinteger required

The maximum batch size for inference requests.

maxInputLengthinteger nullable

The maximum allowed input length.

tokenizerSkipSpecialTokensboolean required

Whether to skip special tokens in tokenizer output.

tokenizerAddSpecialTokensboolean required

Whether to add special tokens in tokenizer input.

currReplicaCntinteger nullable

The current number of replicas.

desiredReplicaCntinteger nullable

The desired number of replicas.

updatedReplicaCntinteger nullable

The updated number of replicas.

Changes

No recorded changes to this operation across all 1 revision of this API.