OpenAI responses.create compatible endpoint.

Accepts the same shape as openai.responses.create and returns a Response object.

Request Body:

• model: Model ID (required)
• input: User input a plain string or array of {"role": ..., "content": ...} dicts
• instructions (optional): System-level instructions
• max_output_tokens (optional): Maximum tokens to generate
• temperature (optional): Sampling temperature 0–2 (default: 1.0)
• top_p (optional): Nucleus sampling parameter
• stream (optional): Stream partial output as SSE (default: true). Set stream: false for one JSON response.

Example Request:

POST /api/v3/inference/responses
Headers: {"Authorization": "Bearer <api_key>"}

{
  "model": "Qwen/Qwen2.5-0.5B-Instruct",
  "input": "What is the capital of France?",
  "instructions": "You are a helpful assistant.",
  "max_output_tokens": 200,
  "stream": false
}

Example Response:

{
  "id": "resp_abc123",
  "object": "response",
  "created_at": 1704123600,
  "model": "Qwen/Qwen2.5-0.5B-Instruct",
  "output": [
    {
      "type": "message",
      "role": "assistant",
      "content": [{"type": "output_text", "text": "The capital of France is Paris."}]
    }
  ],
  "usage": {"input_tokens": 18, "output_tokens": 9, "total_tokens": 27}
}

{
  "model": "model_01kmqm4nrn9fw6r"
}

{
  "id": "resp_9f2c1a7b3d4e5f60718293a4"
}