data
prompts
rows

Create Luna Scorer Version

Changed on

Create a new custom Luna scorer version for the given scorer.

Args: create_luna_scorer_version_request: LoRA/fine-tuning parameters for the new version. scorer: The Luna scorer to create a new version for. ctx: Async request context with the authenticated user and read session.

Returns: The newly created scorer version.

post/scorers/{scorer_id}/version/luna

Request

  • Base URL
    https://api.galileo.ai
  • URL
    https://api.galileo.ai/scorers/{scorer_id}/version/luna
  • Auth
    • API key in header Splunk-AO-API-Key
    • or API key in header Galileo-API-Key
    • or OAuth 2
      Password
      Token URL: https://api.galileo.ai/login
    • or HTTP basic

Path parameters

scorer_idstring uuid4 required

Request body

lora_task_idinteger required
promptstring required
lora_weights_pathstring nullable
executor'action_completion_luna' | 'action_advancement_luna' | 'agentic_session_success' | 'agentic_session_success' | 'action_completion_vision' | 'action_completion_audio' | 'agentic_workflow_success' | 'agentic_workflow_success' | 'agent_efficiency' | 'agent_flow' | 'agent_flow_vision' | 'agent_flow_audio' | 'chunk_attribution_utilization_luna' | 'chunk_attribution_utilization' | 'chunk_relevance' | 'chunk_relevance_luna' | 'context_precision' | 'precision_at_k' | 'completeness_luna' | 'completeness' | 'context_adherence' | 'context_adherence_luna' | 'context_adherence_vision_luna' | 'context_adherence_vision' | 'context_adherence_audio' | 'context_relevance' | 'context_relevance_luna' | 'conversation_quality' | 'conversation_quality_vision' | 'conversation_quality_audio' | 'unsafe_output' | 'correctness' | 'correctness_vision' | 'correctness_audio' | 'ground_truth_adherence' | 'ground_truth_adherence_vision' | 'ground_truth_adherence_audio' | 'visual_fidelity' | 'visual_quality' | 'input_pii' | 'input_pii_vision_luna' | 'input_pii_gpt' | 'input_pii_vision' | 'input_pii_audio' | 'input_sexist' | 'input_sexist' | 'input_sexist_vision' | 'input_sexist_audio' | 'input_sexist_luna' | 'input_sexist_luna' | 'input_sexist_vision_luna' | 'input_tone' | 'input_tone_gpt' | 'input_toxicity' | 'input_toxicity_luna' | 'input_toxicity_vision_luna' | 'input_toxicity_vision' | 'input_toxicity_audio' | 'instruction_adherence' | 'instruction_adherence_vision' | 'instruction_adherence_audio' | 'output_pii' | 'output_pii_vision_luna' | 'output_pii_gpt' | 'output_pii_vision' | 'output_pii_audio' | 'output_sexist' | 'output_sexist' | 'output_sexist_vision' | 'output_sexist_audio' | 'output_sexist_luna' | 'output_sexist_luna' | 'output_sexist_vision_luna' | 'output_tone' | 'output_tone_gpt' | 'output_toxicity' | 'output_toxicity_luna' | 'output_toxicity_vision_luna' | 'output_toxicity_vision' | 'output_toxicity_audio' | 'prompt_injection' | 'prompt_injection_vision' | 'prompt_injection_audio' | 'prompt_injection_luna' | 'prompt_injection_vision_luna' | 'reasoning_coherence' | 'reasoning_coherence_vision' | 'reasoning_coherence_audio' | 'sql_efficiency' | 'sql_adherence' | 'sql_injection' | 'sql_correctness' | 'tool_error_rate' | 'tool_error_rate_luna' | 'tool_selection_quality' | 'tool_selection_quality_vision' | 'tool_selection_quality_audio' | 'tool_selection_quality_luna' | 'user_intent_change' | 'user_intent_change_vision' | 'user_intent_change_audio' | 'interruption_detection'
luna_input_type'span' | 'trace_object' | 'trace_input_output_only'
luna_output_type'float' | 'string' | 'string_list' | 'bool_list'

Response

Successful Response

idstring uuid4 required
versioninteger required
scorer_idstring uuid4 required
model_namestring nullable
num_judgesinteger nullable
cot_enabledboolean nullable
runtimestring nullable

The runtime a code metric version runs on, such as python3.14. Null for a version saved before runtimes were recorded, which runs on the legacy Python 3.12 runtime.

created_atstring date-time required
updated_atstring date-time required
scoreable_node_typesstring[] nullable
output_type'boolean' | 'categorical' | 'count' | 'discrete' | 'freeform' | 'percentage' | 'multilabel' | 'retrieved_chunk_list_boolean' | 'boolean_multilabel' | 'boolean_probability'

Enumeration of output types.

allowed_modelboolean nullable
created_bystring uuid4 nullable

Changes

  • 0b20eade6391Revision changes
    • info

      added subschema #2 to the // response property anyOf list for the response status

  • b58d68b6e6f7Revision changes
    • warning

      added the new context_adherence_vision_luna enum value to the /// response property for the response status

    • warning

      added the new input_pii_vision_luna enum value to the /// response property for the response status

    • warning

      added the new input_sexist_vision_luna enum value to the /// response property for the response status

    • warning

      added the new input_toxicity_vision_luna enum value to the /// response property for the response status

    • warning

      added the new output_pii_vision_luna enum value to the /// response property for the response status

    • warning

      added the new output_sexist_vision_luna enum value to the /// response property for the response status

    • warning

      added the new output_toxicity_vision_luna enum value to the /// response property for the response status

    • warning

      added the new prompt_injection_vision_luna enum value to the /// response property for the response status

    • info

      added the new context_adherence_vision_luna enum value to the request property /

    • info

      added the new input_pii_vision_luna enum value to the request property /

    • info

      added the new input_sexist_vision_luna enum value to the request property /

    • info

      added the new input_toxicity_vision_luna enum value to the request property /

    • info

      added the new output_pii_vision_luna enum value to the request property /

    • info

      added the new output_sexist_vision_luna enum value to the request property /

    • info

      added the new output_toxicity_vision_luna enum value to the request property /

    • info

      added the new prompt_injection_vision_luna enum value to the request property /

    • info

      added the optional property to the response with the status