model-router

Invoke a model with routing

Changed on
post/v1/model-router/invoke

Request

Request body

router_config_idstring uuid nullable
config_overridesobject nullable
session_idstring uuid nullable
smart_routingboolean

Response

Successful Response

contentstring required
model_identifierstring required
providerstring required
input_tokensinteger required
output_tokensinteger required
total_tokensinteger required
input_cost_usdnumber required
output_cost_usdnumber required
cache_cost_usdnumber
total_cost_usdnumber required
latency_msinteger required
parsed_outputobject nullable
execution_engine'pydantic_text' | 'pydantic_structured'
cache_read_input_tokensinteger
cache_creation_input_tokensinteger
cache_hitboolean
route_decision_idstring nullable

Changes

    • breaking

      request property // was restricted to a list of enum values

    • breaking

      the request property's minItems was increased to 1

    • warning

      removed the optional property from the response with the status

    • info

      added the new assistant enum value to the request property //

    • info

      added the new system enum value to the request property //

    • info

      added the new user enum value to the request property //

    • info

      added the optional property to the response with the status

    • info

      added the optional property to the response with the status

    • info

      added the optional property to the response with the status

    • info

      added the optional property to the response with the status

    • info

      added the optional property to the response with the status

    • info

      removed the pydantic_tools enum value from the response property for the response status