data
prompts
rows

Manual Llm Validate

Changed on

Validate an LLM scorer manually, with query/response passed inline (no file uploads).

Args: request: Raw request; body is parsed into a GeneratedScorerValidationRequest. ctx: Async request context with the authenticated user and read session.

Returns: A pending task result the caller can poll for validation results.

post/public/v2/scorers/llm/validate

Request

  • Base URL
    https://api.galileo.ai
  • URL
    https://api.galileo.ai/public/v2/scorers/llm/validate
  • Auth
    • API key in header Splunk-AO-API-Key
    • or API key in header Galileo-API-Key
    • or OAuth 2
      Password
      Token URL: https://api.galileo.ai/login
    • or HTTP basic

Response

Successful Response

task_result_idstring uuid4 required

Changes