Dimensions

✨ Get task agreement matrix

Changed on
<Card href="https://humansignal.com/goenterprise"> <img style="pointer-events: none; margin-left: 0px; margin-right: 0px;" src="https://docs.humansignal.com/images/badge.svg" alt="Label Studio Enterprise badge"/> <p style="margin-top: 10px; font-size: 14px;"> This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise) </p> </Card> Returns a pairwise agreement matrix between selected participants for a single task, averaged across all active dimensions or a single specified dimension.
get/api/projects/{project_pk}/tasks/{task_pk}/agreement-matrix

Request

  • Base URL
    http://localhost:8000
  • URL
    http://localhost:8000/api/projects/{project_pk}/tasks/{task_pk}/agreement-matrix
  • Auth
    API key in header Authorization

Path parameters

project_pkinteger required

Project ID

task_pkinteger required

Task ID

Query parameters

dimensioninteger

Dimension ID to compute agreement for. If not provided, averages across all active dimensions.

ground_truthboolean

JSON object specifying which participants to include in the agreement matrix

Response

usersobject[] required

Expanded participant details (annotators and/or model versions)

Changes