CEcekura
test_framework

Get multiple runs

Changed on

Retrieve multiple runs in a single request.

success: true indicates the run passed its quality evaluation. A run with success=false either failed to connect (check error_message) or failed an evaluation check. For detailed outcomes check: error_message, metadata.ended_reason, and evaluation.metrics[].result.

get/test_framework/v2/runs/bulk/

Request

  • Base URL
    https://api.cekura.ai
  • URL
    https://api.cekura.ai/test_framework/v2/runs/bulk/
  • Auth
    • API key in header X-CEKURA-API-KEY
    • or HTTP bearer
    • or HTTP bearer
    • or API key in header X-VOCERA-SHAREABLE-LINK-TOKEN
    • or HTTP bearer

Query parameters

run_idsstring required

Comma-separated list of run IDs. Example: 1,2,3

Must be a plain comma-separated string, not a JSON array — passing a JSON array returns a 400 error.

agent_idinteger

Tenant scope. Supply one of agent_id, result_id, project_id when authenticating with a user session or OAuth bearer token; omit when using an API key already scoped to the tenant.

result_idinteger

Tenant scope. Supply one of agent_id, result_id, project_id when authenticating with a user session or OAuth bearer token; omit when using an API key already scoped to the tenant.

project_idinteger

Tenant scope. Supply one of agent_id, result_id, project_id when authenticating with a user session or OAuth bearer token; omit when using an API key already scoped to the tenant.

Response

idinteger
provider_call_idstring

Call ID from the Assistant provider Example: call_abc123

trace_idstring

OpenTelemetry trace ID (32-char hex). Set when OTel tracing is enabled.

is_log_presentboolean

Whether provider execution logs are stored for this run.

scenariointeger nullable
scenario_namestring
scenario_typestring

Type of the run's scenario (e.g. instruction, conditional_actions), null if the scenario was deleted

personalityinteger nullable

Personality this run belongs to

personality_namestring

Name of the personality this run belongs to

agentinteger

ID of the agent associated with this run

agent_namestring

Name of the agent associated with this run

result_idinteger
result_namestring

Name of the result this run belongs to

expected_outcome_promptstring
rubricunknown
transcriptstring

Full text transcript of the call. Example:

[00:01] Testing Agent: Hello. 
[00:02] Main Agent: Hello, how can I help you today?
[00:03] Testing Agent: Well, I mean, sure. What time exactly are we talking about here
[00:04] Main Agent: 6 PM.
[00:05] Testing Agent: Great. I'll book that for you. Just a sec.
[00:06] Main Agent: Okay.
durationstring

Duration of the run in MM:SS format

voice_recording_urlstring

URL to access the voice recording of this run

email_idstring email nullable
status'running' | 'completed' | 'failed' | 'pending' | 'in_progress' | 'evaluating' | 'in_queue' | 'timeout' | 'cancelled' | 'scaling_up'
  • running - Running
  • completed - Completed
  • failed - Failed
  • pending - Pending
  • in_progress - In Progress
  • evaluating - Evaluating
  • in_queue - In Queue
  • timeout - Timeout
  • cancelled - Cancelled
  • scaling_up - Scaling Up
evaluation_status'success' | 'failure' | 'reviewed_success' | 'reviewed_failure'
  • success - Success
  • failure - Failure
  • reviewed_success - Reviewed Success
  • reviewed_failure - Reviewed Failure
metadataunknown
successboolean

Whether this run passed its quality evaluation. false means either the call failed to connect or an evaluation check did not pass. Check error_message for connection failures and evaluation for check results.

is_reviewedboolean

Whether the call has been reviewed. Example: true or false

feedbackstring
timestampstring date-time
executed_atstring date-time nullable
outbound_numberstring

Phone number used to make the outbound call for this run

inbound_numberstring

Phone number used to receive the inbound call for this run

error_messagestring
scenario_instructionsstring
run_as_textboolean
generated_mock_tool_entriesobject[]

Expected mock tool calls for this run's evaluator. Each entry has shape {tool_id, tool_name, new_entry: {input, output, response?}}.

mocked_tool_namesstring[]

Tool names whose calls in this run's transcript were served by Cekura mocks. Where the provider reports the URL it resolved per tool call (ElevenLabs), a mock-enabled tool the provider served from the customer's own endpoint is excluded; otherwise this is the set that was mock-enabled. Empty if no tools were mocked.

provider_call_detailsunknown
agent_numberstring nullable

Phone number of the agent (only for voice inbound calls)

testing_channel_indexinteger nullable

The channel index of the testing agent in the audio recording

waveformobject

Amplitude envelope of the recording, one array of values per audio channel, so a waveform can be drawn without downloading the audio. Null for recordings processed before peaks were stored.

run_typestring nullable

Run Execution Type

outbound_dial_window_opens_atstring

ISO timestamp when the outbound dial window opened. Null until the run reaches pending/waiting-for-call.

outbound_dial_window_secondsstring

Duration of the outbound dial window in seconds.

outbound_dial_window_closes_atstring

ISO timestamp when the outbound dial window closes. Null until the window opens.

Changes

  • a6fb6a739212Revision changes
    • breaking

      added subschema #2 to the / response property oneOf list for the response status

    • breaking

      the ///// response's property type changed from no type to object for status

    • breaking

      the / response's property type changed from string to no type for status

    • info

      api operation id runs-bulk-retrieve removed and replaced with runs-bulk-retrieve_3

    • info

      the endpoint scheme security embedded_session was added to the API

    • info

      the endpoint scheme security oauth2 was added to the API

    • info

      the endpoint scheme security shareable_link was added to the API

    • info

      the endpoint scheme security supabase_session was added to the API

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added the optional property / to the response with the status

    • info

      added to the / response property allOf list for the response status

    • info

      removed from the / response property allOf list for the response status

    • info

      added the required property ////// to the response with the status