Batch Completions

post/v2/batch-completions

Request body

CreateBatchCompletionsV2Request required— unresolved $ref

Successful Response

job_idstring required

input_data_pathstring nullable

Path to the input file. The input file should be a JSON file of type List[CreateBatchCompletionsRequestContent].

output_data_pathstring required

Path to the output file. The output file will be a JSON file of type List[CompletionOutput].

prioritystring nullable

Priority of the batch inference job. Default to None.

created_atstring required

expires_atstring required

completed_atstring nullable required

metadataobject nullable required

{
  "model_config": {
    "model": "mixtral-8x7b-instruct"
  }
}