Bedrock Integration

Invoke model with streaming (Bedrock format)

Invokes a model with streaming using AWS Bedrock InvokeModelWithResponseStream API format.

post/bedrock/model/{modelId}/invoke-with-response-stream

Request

Base URL
http://localhost:8080
Auth
- HTTP bearer
- or HTTP basic
- or API key in header x-bf-vk
- or API key in header x-api-key
TypeScript
https://skmtc.dev/getbifrost/apis/bifrost-api/docs/bedrock/model/:modelId/invoke-with-response-stream/post.ts
A function with typed inputs. Its response is checked against the schema.

modelIdstring required

Model ID (e.g., anthropic.claude-3-sonnet-20240229-v1:0)

promptstring

Text prompt to complete

max_tokensinteger

max_tokens_to_sampleinteger

Anthropic-style max tokens

temperaturenumber

top_pnumber

top_kinteger

stopstring[]

stop_sequencesstring[]

Anthropic-style stop sequences

messagesobject[]

For Claude 3 models

anthropic_versionstring

Successful streaming response

No recorded changes to this operation across all 1 revision of this API.