Sign in

Changes to Metrics Testing Available Columns

POST /projects/{project_id}/metrics-testing/available_columns

Every recorded change to this endpoint, newest first. Back to the operation

Changed in 5 of the 14 revisions of this API.2428

  1. 83e63172503819
  2. 344acdc36dbb2
  3. 933e8c8e636614
  4. 1f7a6a4a81ad2
  5. 05003e7835a2105

What changed

  • 83e63172503819See the full diff
    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/chainpoll_template to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/class_name_to_vocab_ix to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/default_model_alias to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/ground_truth to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/lora_task_id to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/lora_weights_path to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/luna_input_type to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/luna_output_type to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/metric_name to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/model_alias to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/model_type to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/prompt to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/registered_scorer_id to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/required_metric_ids to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/required_scorers to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/requires_tools_in_llm_span to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/roll_up_strategy to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_path_name to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/user_code to the response with the 200 status

      response-optional-property-added

    This revision also has 15 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

  • 344acdc36dbb2See the full diff
    • ○

      added ScorerName to the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor response property anyOf list for the response status 200

      response-property-any-of-added

    • ○

      removed galileo_core__schemas__shared__scorers__scorer_name__ScorerName from the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor response property anyOf list for the response status 200

      response-property-any-of-removed

    This revision also has 44 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

  • 933e8c8e636614See the full diff
    • ●

      added the new agent_flow_audio enum value to the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new agent_flow_vision enum value to the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new conversation_quality_audio enum value to the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new conversation_quality_vision enum value to the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new input_sexist_audio enum value to the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new input_sexist_vision enum value to the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new instruction_adherence_audio enum value to the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new instruction_adherence_vision enum value to the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new output_sexist_audio enum value to the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new output_sexist_vision enum value to the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new prompt_injection_audio enum value to the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new prompt_injection_vision enum value to the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new tool_selection_quality_audio enum value to the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new tool_selection_quality_vision enum value to the columns/items/scorer_config/anyOf[subschema #1: RuntimeScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    This revision also has 8 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

  • 1f7a6a4a81ad2See the full diff
    • ○

      added RuntimeScorerConfig to the columns/items/scorer_config response property anyOf list for the response status 200

      response-property-any-of-added

    • ○

      removed ScorerConfig from the columns/items/scorer_config response property anyOf list for the response status 200

      response-property-any-of-removed

    This revision also has 2 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

  • 05003e7835a2105See the full diff
    • ●

      added the new action_completion_audio enum value to the columns/items/scorer_config/anyOf[subschema #1: ScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new action_completion_vision enum value to the columns/items/scorer_config/anyOf[subschema #1: ScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new correctness_audio enum value to the columns/items/scorer_config/anyOf[subschema #1: ScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new correctness_vision enum value to the columns/items/scorer_config/anyOf[subschema #1: ScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new ground_truth_adherence_audio enum value to the columns/items/scorer_config/anyOf[subschema #1: ScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new ground_truth_adherence_vision enum value to the columns/items/scorer_config/anyOf[subschema #1: ScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new reasoning_coherence_audio enum value to the columns/items/scorer_config/anyOf[subschema #1: ScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new reasoning_coherence_vision enum value to the columns/items/scorer_config/anyOf[subschema #1: ScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new user_intent_change_audio enum value to the columns/items/scorer_config/anyOf[subschema #1: ScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ●

      added the new user_intent_change_vision enum value to the columns/items/scorer_config/anyOf[subschema #1: ScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-added

    • ○

      the endpoint scheme security ClassicAPIKeyHeader was added to the API

      api-security-added

    • ○

      removed the bleu enum value from the columns/items/scorer_config/anyOf[subschema #1: ScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-removed

    • ○

      removed the prompt_perplexity enum value from the columns/items/scorer_config/anyOf[subschema #1: ScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-removed

    • ○

      removed the rouge enum value from the columns/items/scorer_config/anyOf[subschema #1: ScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-removed

    • ○

      removed the uncertainty enum value from the columns/items/scorer_config/anyOf[subschema #1: ScorerConfig]/scorer_version/anyOf[subschema #1: BaseScorerVersionDB]/finetuned_scorer/anyOf[subschema #1: BaseFinetunedScorerDB]/executor/anyOf[subschema #1: ScorerName]/ response property for the response status 200

      response-property-enum-value-removed

    This revision also has 15 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog