Dedicated Models

Deploy Stats

Changed on
get/deploy/{deploy_id}/stats

Request

  • Base URL: https://api.deepinfra.com
  • URL: https://api.deepinfra.com/deploy/{deploy_id}/stats
  • Auth: HTTP bearer

Path parameters

deploy_idstring required

Query parameters

fromstring required

start of period, unix ts or 'now-5h', supported units s(ec), m(min), h(our), d(ay), w(eek), M(onth)

tostring

end of period, unix ts or now-relative, check from, defaults to now

Headers

xi-api-keystring nullable
x-api-keystring nullable

Response

Successful Response

requestsinteger required

number of inference requests in the provided interval

total_timeinteger required

total number of seconds spend in inference

total_tokensinteger required

total number of tokens generated

input_tokensinteger required

number of input tokens generated

output_tokensinteger required

number of output tokens generated

total_amountinteger required

total number of cents spent

avg_timenumber required

average millisecond inference time

avg95_timenumber required

95th percentile inference time (estimated)

errorsinteger required

number of errors

Changes