---
title: "Async Invoke Model Endpoint"
method: POST
path: "/model/async_invoke"
tags: ["Model Invocation"]
---

# Async Invoke Model Endpoint

`POST /model/async_invoke`

## Endpoint to Invoke a Model on Bedrock Asynchronously
This endpoint allows users to invoke a model on Bedrock asynchronously using either a simple text prompt or a series of messages. It returns an invocation ID that can be used to retrieve the result later.

***

## Request Body

| Parameter       | Type                                                      | Description                                                                                           |
|-----------------|-----------------------------------------------------------|-------------------------------------------------------------------------------------------------------|
| model_name      | str                                                       | The name of the model to invoke. Must be one of the supported models.                                  |
| prompt          | str                                                       | A simple text prompt (str) or a list of messages (see below for message format).                       |
| max_tokens      | Optional[int]                                             | The maximum number of tokens to generate in the response.                                             |
| temperature     | Optional[float]                                           | Sampling temperature to use. Higher values make the output more random.                                |
| top_p           | Optional[float]                                           | Probability threshold for nucleus sampling.                                                           |
| top_k           | Optional[int]                                             | The number of highest probability vocabulary tokens to keep for top-k filtering.                       |
| stop_sequences  | Optional[List[str]]                                       | Sequences where the generation will stop.                                                             |


***

#### Example:

```json
{
    "model_name": "example_model",
    "prompt": "Translate the following text to French: 'Hello, how are you?'",
    "max_tokens": 100,
    "temperature": 0.7,
    "top_p": 0.9,
    "top_k": 50,
    "stop_sequences": ["\n"]
}
```
***
## Response Body

| Field          | Type   | Description                          |
|----------------|--------|--------------------------------------|
| invocation_id  | str    | The ID of the asynchronous invocation.|

***
#### Errors

- **400 Bad Request**: If the request parameters are invalid.
- **500 Internal Server Error**: If there is an unexpected error during model invocation.

## Request body

- InvokeModelRequest
  - `model_name` string, required
  - `prompt` union, required
    - string
    - object[]
  - `max_tokens` integer
  - `temperature` number
  - `top_p` number
  - `top_k` integer
  - `stop_sequences` string[]
  - `system_prompts` object[]

## Response `200`

Successful Response

- unknown

## Other responses

- `422` — Validation Error

---

[API](https://skmtc.dev/aws-samples/apis/generative-ai-foundational-platform-api.md) · [All operations](https://skmtc.dev/aws-samples/apis/generative-ai-foundational-platform-api/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/aws-samples/generative-ai-foundational-platform-api/revisions/8831d08902e9/schema)