List available hardware configurations
Returns a list of available hardware configurations for deploying models. When a model parameter is provided, it returns only hardware configurations compatible with that model, including their current availability status.
Query parameters
Filter hardware configurations by model compatibility. When provided, the response includes availability status for each compatible configuration. See all of Together AI's dedicated models
Response
List of available hardware configurations
Example response
{
"data": [
{
"id": "2x_nvidia_a100_80gb_sxm",
"pricing": {
"cents_per_minute": 5.42
},
"specs": {
"gpu_type": "a100-80gb",
"gpu_link": "sxm",
"gpu_memory": 80,
"gpu_count": 2
}
}
]
}Changes
Changed in 1 of the 14 revisions of this API.3
- ▲
the
data/items/pricing/cents_per_minuteresponse's property type/format changed fromnumber/floattonumber/for status200response-property-type-changed
- ▲
the
data/items/specs/gpu_countresponse's property type/format changed frominteger/int32tointeger/for status200response-property-type-changed
- ▲
the
data/items/specs/gpu_memoryresponse's property type/format changed fromnumber/floattonumber/for status200response-property-type-changed
This revision also has 2 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog
- ▲