calibration

Calculate Kappa

Calculate Cohen's Kappa scores for a calibration run.

Compares human ratings (ground truth) with judge predictions for all three judge types: mention, recommendation, stance.

Args: run_id: Calibration run UUID current_user: Authenticated user db: Database session

Returns: Kappa scores and metadata for each judge type

Raises: HTTPException: If run not found or access denied

post/api/v1/calibration/runs/{run_id}/calculate

Request

  • Base URL: https://geo.sig.ai (the document declares no server; this is the origin it was published from)
  • URL: https://geo.sig.ai/api/v1/calibration/runs/{run_id}/calculate
  • Auth: HTTP bearer

Path parameters

run_idstring uuid required

Cookies

access_tokenstring nullable

Response

Successful Response

object required

Changes

No recorded changes to this operation across all 1 revision of this API.