Projects

✨ Create annotator weights for statistics

<Card href="https://humansignal.com/goenterprise"> <img style="pointer-events: none; margin-left: 0px; margin-right: 0px;" src="https://docs.humansignal.com/images/badge.svg" alt="Label Studio Enterprise badge"/> <p style="margin-top: 10px; font-size: 14px;"> This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise) </p> </Card> Create annotator weights to be used in the annotation statistics for a project, such as when calculating kappa metrics for inter-annotator agreement. Affects dashboard-members stats, but old and unused.
post/api/projects/{id}/project-extra-params/

Request

  • Base URL
    http://localhost:8000
  • URL
    http://localhost:8000/api/projects/{id}/project-extra-params/
  • Auth
    API key in header Authorization

Path parameters

idinteger required

Request body

annotator_paramsobject nullable

User ID and user weight in score calculation. Format {user_id: weight} with weight in [0..1].

use_kappaboolean

If categorical variables are used in labeling (e.g. choices), Cohen's Kappa statistic is computed to measure inter-rater reliability instead of basic agreement

Response

Annotator weights created/updated

annotator_paramsobject nullable

User ID and user weight in score calculation. Format {user_id: weight} with weight in [0..1].

use_kappaboolean

If categorical variables are used in labeling (e.g. choices), Cohen's Kappa statistic is computed to measure inter-rater reliability instead of basic agreement

Changes

No operation changes recorded.