data
prompts
rows

Autogen Llm Scorer

Changed on

Autogenerate an LLM scorer configuration.

Returns a Celery task ID that can be used to poll for the autogeneration results.

post/public/v2/scorers/llm/autogen

Request

  • Base URL
    https://api.galileo.ai
  • URL
    https://api.galileo.ai/public/v2/scorers/llm/autogen
  • Auth
    • API key in header Splunk-AO-API-Key
    • or API key in header Galileo-API-Key
    • or OAuth 2
      Password
      Token URL: https://api.galileo.ai/login
    • or HTTP basic

Request body

instructionsstring required
model_namestring required
output_type'boolean' | 'categorical' | 'count' | 'discrete' | 'freeform' | 'percentage' | 'multilabel' | 'retrieved_chunk_list_boolean' | 'boolean_multilabel' | 'boolean_probability' required

Enumeration of output types.

cot_enabledboolean required
scoreable_node_typesstring[] required

Response

Successful Response

task_result_idstring uuid4 required

Changes