reports

Create Evaluation Pipeline

post/reports

Request

Base URL
https://docs.promptlayer.com (the document declares no server; this is the origin it was published from)
Auth
API key in header X-API-KEY
TypeScript
https://skmtc.dev/promptlayer/apis/promptlayer-api/docs/reports/post.ts
A function with typed inputs. Its response is checked against the schema.

Request body

dataset_group_idinteger required

ID of the dataset group to use.

namestring nullable

Name for the pipeline. Auto-generated if omitted.

folder_idinteger nullable

Folder ID for organization.

dataset_version_numberinteger nullable

Specific dataset version. Uses latest published version if omitted.

Example request

{
  "columns": [
    {
      "column_type": "LLM_ASSERTION",
      "name": "Accuracy Check",
      "configuration": {
        "source": "response",
        "prompt": "Is this response accurate?"
      },
      "is_part_of_score": true
    }
  ],
  "score_configuration": {
    "code": "score = sum(1 for row in data if row.get(\"Accuracy Check\") is True) / len(data) * 100 if data else 0\nreturn {\"score\": score}",
    "code_language": "PYTHON"
  }
}

Response

Evaluation pipeline created.

successtrue required

report_idinteger required

ID of the created evaluation pipeline.

Changes

No recorded changes to this operation across all 3 revisions of this API.