Changes to Creates a model response for the given chat conversation

post/v1/chat/completions
    • info

      added the optional property usage/prompt_tokens_details to the response with the status

    • warning

      removed the request property grammar_path

    • info

      the request property model became optional

    • info

      the model request property default value qualcomm/Qwen3-4B-Instruct-2507 was removed

    • info

      added the new enum value to the request property spec_type

    • info

      the spec_n_max request property's min was decreased from 1.00 to 0.00

    • info

      the reasoning_format request property default value changed from none to deepseek

    • info

      added the new optional request property power_mode

    • info

      added the new optional request property max_tokens

    • warning

      removed the request property enable_json

    • warning

      removed the request property image_max_length

    • info

      added the new optional request property messages/items/reasoning_content

    • info

      added the new optional request property reasoning_format

    • info

      added the optional property choices/items/message/reasoning_content to the response with the status

    • info

      added the new optional request property spec_draft_model

    • info

      added the new optional request property spec_n_max

    • info

      added the new optional request property spec_n_min

    • info

      added the new optional request property spec_p_min

    • info

      added the new optional request property spec_type

    • info

      added the new optional request property compute

    • info

      the nctx request property default value 4096 was removed

    • warning

      removed the request property logit_bias

    • warning

      removed the request property n

    • warning

      removed the request property stop

    • warning

      removed the request property tool_choice

    • warning

      removed the request property user

    • info

      added the new optional request property stream_options

    • info

      the request property default value changed from {"role":"user","content":"What is the weather like in Boston today?"} to {"role":"user","content":"Hello! Briefly introduce yourself."}

    • info

      the model request property default value changed from Qwen/Qwen3-1.7B-GGUF to qualcomm/Qwen3-4B-Instruct-2507

    • info

      the frequency_penalty request property default value 0 was removed

    • info

      the grammar_path request property default value was removed

    • info

      the grammar_string request property default value was removed

    • info

      the image_max_length request property default value 512 was removed

    • info

      the min_p request property default value 0 was removed

    • info

      the ngl request property default value 999 was removed

    • info

      the presence_penalty request property default value 0 was removed

    • info

      the repetition_penalty request property default value 1 was removed

    • info

      the tools request property default value was removed

    • info

      the top_k request property default value 0 was removed

    • info

      the message response's property default value changed from {"role":"user","content":"What is the weather like in Boston today?"} to {"role":"user","content":"Hello! Briefly introduce yourself."} for the status

    • warning

      removed the request property compute

    • warning

      removed the request property stream_options

    • info

      added the new optional request property logit_bias

    • info

      added the new optional request property n

    • info

      added the new optional request property stop

    • info

      added the new optional request property tool_choice

    • info

      added the new optional request property user

    • info

      the frequency_penalty request property default value 0 was added

    • info

      the grammar_path request property default value was added

    • info

      the grammar_string request property default value was added

    • info

      the image_max_length request property default value 512 was added

    • info

      the min_p request property default value 0 was added

    • info

      the nctx request property default value 4096 was added

    • info

      the ngl request property default value 999 was added

    • info

      the presence_penalty request property default value 0 was added

    • info

      the repetition_penalty request property default value 1 was added

    • info

      the tools request property default value was added

    • info

      the top_k request property default value 0 was added

    • info

      the request property default value changed from {"role":"user","content":"Hello! Briefly introduce yourself."} to {"role":"user","content":"What is the weather like in Boston today?"}

    • info

      the model request property default value changed from qualcomm/Qwen3-4B-Instruct-2507 to Qwen/Qwen3-1.7B-GGUF

    • info

      the message response's property default value changed from {"role":"user","content":"Hello! Briefly introduce yourself."} to {"role":"user","content":"What is the weather like in Boston today?"} for the status