PIpioneer
openai-compat

Responses

Changed on

OpenAI-compatible Responses API endpoint.

Thin shell over :func:services.inference.adapters.openai_responses.run_responses. The adapter handles input-item to chat-message translation, LLM-passthrough vs Fastino-task dispatch, SSE rendering, tool-call serialisation, persistence, and error mapping. The router keeps only HTTP-shaped concerns: route declaration, auth, rate limiting.

Args: body: Validated :class:ResponsesRequest. request: FastAPI request (forwarded so the adapter can read API-key billing context out of request.state for streaming responses). response: Response whose headers carry the deprecation and router-tip signals. auth: Authenticated request context.

Returns: JSON response payload or :class:StreamingResponse SSE stream in Responses API format.

post/responses

Request

Request body

modelstring required
instructionsstring
toolsobject[]
parallel_tool_callsboolean
storeboolean

Whether to store response state for turn-to-turn continuation. When true, Fastino preserves the response for previous_response_id replay, including available tool-call and reasoning context.

streamboolean
previous_response_idstring nullable

Fastino inference ID or stored Responses wire ID to continue from. When present, Fastino reconstructs the prior turn from inference history and prepends it to the new input.

includestring[]
service_tierstring nullable
prompt_cache_keystring nullable
max_output_tokensinteger nullable
temperaturenumber nullable
top_pnumber nullable
metadataobject nullable
extra_headersobject nullable
extra_bodyobject nullable
task_typestring nullable

Deprecated. Legacy task hint (extract_entities / classify_text / extract_json / ner / schema). The unified schema on text.format.schema disambiguates the task automatically. Submitting this field emits Deprecation: true and Sunset: <RFC 7231 date> headers on the response.

include_confidenceboolean nullable
include_spansboolean nullable

Response

Successful Response

unknown required

Changes

  • 0e5e86e2bae5Revision changes
    • warning

      removed the request property

    • warning

      removed the request property

  • 1cffaad2a921Revision changes
    • warning

      removed the optional property from the response with the status

    • info

      added the required property to the response with the status