Run LLM Evals

Run online evals for your test cases using the metrics in metricCollection.

post/v1/evaluate

Request

Base URL
https://api.confident-ai.com
Auth
none declared
TypeScript
https://skmtc.dev/confident-ai/apis/confident-ai-metrics-api/docs/v1/evaluate/post.ts
A function with typed inputs. Its response is checked against the schema.

metricCollectionstring required

The name of the metric collection you wish to use for evaluation.

hyperparametersobject

This is any hyperparameters like model or prompt you wish to associate with the test run.

identifierstring

A unique identifier for the test run.

successboolean required

This is true if the test cases were successfully evaluated.

deprecatedboolean required

This is true if this endpoint is deprecated.

No operation changes recorded.