PIpioneer
anthropic-compat

Messages

Changed on

Anthropic-compatible messages endpoint.

Thin shell over :func:services.inference.adapters.anthropic_messages.run_messages. The adapter handles content-block translation, LLM-passthrough vs Fastino-task dispatch, SSE rendering, persistence, and error mapping. The router keeps only HTTP-shaped concerns: route declaration, auth, rate limiting.

Args: body: Validated :class:AnthropicMessagesRequest. request: FastAPI request (forwarded so the adapter can read API-key billing context out of request.state for streaming responses). auth: Authenticated request context.

Returns: :class:AnthropicMessagesResponse for non-streaming, or a :class:StreamingResponse of Anthropic SSE events when body.stream is true.

post/v1/messages

Request

Request body

modelstring required
max_tokensinteger
temperaturenumber nullable
top_pnumber nullable
top_kinteger nullable
streamboolean
storeboolean
cache_controlobject nullable
toolsobject[] nullable
tool_choiceobject nullable
stop_sequencesstring[] nullable
speed'standard' | 'fast' nullable

Anthropic inference speed mode. "fast" opts into high output-tokens-per-second inference on supported models (e.g. the latest Opus). Fastino forwards this only to the native Anthropic upstream (with the required fast-mode beta header); Bedrock and gateway routes ignore it.

thinkingobject nullable

Opt-in Anthropic-style extended-thinking controls. Fastino does not enable thinking by default; send the Anthropic-native object: {'type': 'enabled', 'budget_tokens': N, 'display'?: 'summarized'|'omitted'} for manual mode, {'type': 'adaptive', 'effort'?: tier, 'display'?: ...} for adaptive mode (required on Opus 4.7+ / Mythos, recommended on Opus 4.6 / Sonnet 4.6), or {'type': 'disabled'} to turn thinking off on models that have it on by default. Fastino canonicalizes this into InferenceRequest.reasoning at the adapter boundary so the request routes correctly whether the upstream is Anthropic native, Bedrock, or the Vercel AI Gateway (which advertises the normalized reasoning field rather than thinking). On models that require adaptive mode, Fastino auto-upgrades manual configs (mapping budget_tokens to the nearest effort tier) rather than letting the upstream return a 400.

task_typestring nullable

Deprecated. Legacy task hint. The unified schema disambiguates the task automatically. Submitting this field emits Deprecation: true and Sunset: <RFC 7231 date> headers.

include_confidenceboolean
include_spansboolean

Response

Non-streaming Anthropic Messages response. When the request sets stream=true the server emits an Anthropic-shaped SSE event stream over text/event-stream instead; that stream shape is documented in the Anthropic Messages API reference.

idstring required
typestring
rolestring
contentobject[] required
modelstring required
stop_reasonstring nullable
stop_sequencestring nullable
fastino_inference_idstring nullable

Changes

  • 0e5e86e2bae5Revision changes
    • warning

      removed the request property

    • warning

      removed the request property

    • warning

      removed the optional property from the response with the status

    • warning

      removed the optional property from the response with the status

    • warning

      removed the optional property from the response with the status

    • info

      added the optional property to the response with the status

  • 1cffaad2a921Revision changes
    • breaking

      added to the response body oneOf list for the response status

    • breaking

      the response's body type changed from object to no type for status

    • warning

      removed the optional property from the response with the status