scorer-feedback

Create Scorer Feedback

Changed on

Creates a new feedback item in the global queue for the specified scorer.

Validation:

  • Validates both original_value and annotated_value against scorer's output_type
  • Validates scorer_version_id exists and user has access
  • Validates user has access to the specified project
  • Auto-creates new queue if no active queue exists for this scorer
  • If active queue exists, adds feedback to that queue

Errors:

  • 422 - Invalid annotated_value/original_value format or validation failure
  • 404 - Project, run, scorer, or scorer_version not found
  • 409 - Queue is currently locked (generating, reviewing, or completed)
post/scorer-feedbacks

Request

  • Base URL
    https://api.galileo.ai
  • URL
    https://api.galileo.ai/scorer-feedbacks
  • Auth
    • API key in header Splunk-AO-API-Key
    • or API key in header Galileo-API-Key
    • or OAuth 2
      Password
      Token URL: https://api.galileo.ai/login
    • or HTTP basic

Request body

project_idstring uuid4 required

Project context for audit trail

run_idstring uuid4 required

Run context

scorer_idstring uuid4 required

Scorer being corrected

scorer_version_idstring uuid4 required

Version that produced the incorrect output

record_idstring uuid4 required

ID of the record that was scored

original_valuestring required

The original incorrect scorer output

annotated_valuestring required

Corrected value (validated against scorer output_type)

feedback_textstring nullable

Rationale/explanation for the correction

rationalestring nullable

Original scorer response (value + rationale) for CLHF context

Response

Successful Response

idstring uuid4 required
project_idstring uuid4 required
run_idstring uuid4 required
scorer_idstring uuid4 required
source_scorer_version_idstring uuid4 required
record_idstring uuid4 required
original_valuestring required
annotated_valuestring required
feedback_textstring nullable required
rationalestring nullable required
queue_idstring uuid4 required
created_bystring uuid4 nullable required
created_by_namestring nullable
created_atstring date-time required
updated_atstring date-time required

Changes