Gateway

Evaluate state against typed questions

Evaluation models: shared state plus typed questions in, calibrated probabilities out. A boolean answers with a probability, a choice with the selected option and a probability per option, a score with an interpolated value and a probability per rung. Several questions are answered in one round trip against the same state. NOT an OpenAI-compatible shape — there is no messages and no completion. Billed on input tokens. Requires inference.

post/v1/evaluate

Request

  • Base URL: https://api.roar-ai.com
  • URL: https://api.roar-ai.com/v1/evaluate
  • Auth: HTTP bearer

Request body

modelstring required
questionsobject required

Each key names an answer in the response. criteria differs per type: an optional true/false gloss for boolean, a record of option name to description for choice (two or more), an ordered array lowest-to-highest for score (two or more).

Response

An answer per question key

Changes

No recorded changes to this operation across all 1 revision of this API.