authed

Starts writing a test from a finished conversation an agent had with one of its users, up to its latest message. The test is written in the background: its status says when it's ready, refused or failed.

post/api/v1/eval-cases

Request

  • Base URL
    https://api.teaflask.com (the document declares no server; this is the origin it was published from)
  • URL
    https://api.teaflask.com/api/v1/eval-cases
  • Auth
    none declared

Request body

conversation_idstring uuid required

The conversation to turn into a test, as its agent served it.

notestring nullable

Why you're adding this test and what to look out for; the test's checks follow it. Leave it out to let the test's goal be inferred.

Response

Successful Response

idstring uuid required

The test's id.

agent_idstring uuid required

The agent the test belongs to.

conversation_idstring uuid required

The conversation the test came from.

conversation_titlestring required

That conversation's title.

titlestring required

The test's title; empty until it is written.

status'authoring' | 'authored' | 'admitting' | 'repairing' | 'ready' | 'broken' | 'refused' | 'failed' required
status_reasonstring nullable required

A sentence saying why the test is where it is, when there's more to say.

status_retryableboolean required

Whether writing the test can be tried again.

assertion_countinteger required

How many checks the test's latest version makes.

version_numberinteger nullable required

The test's latest version; null until it is written.

created_by_user_idstring uuid nullable required

The member who added it.

created_atstring date-time required

When it was added.

updated_atstring date-time required

When it last changed.

Changes