Run test

<Info>This API is in beta. Endpoints, fields, and behavior may still change, so avoid depending on it in production.</Info>

Starts a run of a test. The testing agent opens url in a cloud browser, signs in as a temporary test user, and works toward the test's goal. A report follows once the browser session ends.

Leave url out and the run starts on the app's current preview, the same one Get preview URL returns. If the preview isn't running, this call starts it first, so it can take noticeably longer. The run works against the app's test data, not its live data.

To start on a different page, send url yourself. It must be on base44.app or base44.com, and a preview page also needs a fresh _preview_token from Get preview URL in its query, because each token works once and expires after 5 minutes.

The call returns once the run is queued. A run that repeats an earlier one can come back already finished. Otherwise poll Get test run until status is no longer pending, running or analyzing. Then read the verdict with Get test run report.

A run costs credits, and credits_charged on the finished run shows how many. The call is refused when the workspace is out of credits. A run that runs out of credits partway through stops with status set to paused and failure_reason set to out_of_credits.

A test runs one at a time. Starting it again while a run is still going returns a 409.

This is limited to 300 requests every 600 seconds per caller for each app. Some workspaces have a different limit.

<Note>This endpoint accepts a personal API key belonging to a user with editor access to the app. Read-only keys and workspace API keys are refused.</Note>

<Warning>The response includes fields beyond the ones documented here. Don't rely on undocumented response fields, as they can change at any time.</Warning>

post/api/apps/{app_id}/testing-agent/executions

Path parameters

app_idstring required

ID of the app.

ID of the app.

Request body

flow_idstring required

ID of the test to run.

urlstring

Page the run starts on. Leave it out to start on the app's current preview.

Example request

{
  "flow_id": "68a1c2e4f0b3d9001a7e5c21",
  "url": "https://preview-6820f3a4e7b91d003c45a1f2.base44.app/?_preview_token=FH-j7wHS7IR_fC1tUh4wCd_fNV1XGC479cuqNSYi9mA"
}

Response

The queued run.

idstring required

ID of the run.

app_idstring required

ID of the app.

flow_idstring required

ID of the test this run belongs to.

flow_goalstring required

The test's goal when the run started.

flow_rolestring nullable required

Role the run signs in as, including one Base44 picked from the test's name or goal. Set once the run starts. null when the run uses no role.

site_urlstring required

URL the run opened.

status'pending' | 'running' | 'analyzing' | 'success' | 'failed' | 'timeout' | 'cancelled' | 'paused' required

Where the run is. pending, running and analyzing mean it's still going. success means the browser session finished, and failed means it didn't. timeout, cancelled and paused mean the run stopped early. The test passed when goal_accomplished is true and failure_reason isn't platform or internal.

result_messagestring nullable required

The agent's account of how the run went, or null before the run finishes.

goal_accomplishedboolean nullable required

Whether the agent accomplished the goal, or null before the run finishes. Can be true on a run whose failure_reason is platform or internal, which counts as a technical failure.

live_statusstring nullable required

Short progress message for display, or null before the run starts.

analysis_status'pending' | 'completed' | 'failed' nullable required

Progress of the run's report. completed means Get test run report has it. null before the run reaches analysis.

failure_reason'app' | 'platform' | 'internal' | 'out_of_credits' nullable required

Why the run didn't pass, or null when no reason was recorded. app is a problem in your app. platform and internal are problems on Base44's side, so rerun the test. out_of_credits comes with status paused.

credits_chargednumber nullable required

Credits the run cost, or null before it's charged.

started_atstring nullable required

When the browser session started, as an ISO 8601 UTC timestamp, or null while pending.

completed_atstring nullable required

When the run ended, as an ISO 8601 UTC timestamp, or null while it's still going.

created_datestring required

When the run was requested, as an ISO 8601 UTC timestamp.

updated_datestring required

When the run last changed, as an ISO 8601 UTC timestamp.

Example response

{
  "id": "68a1c9b7f0b3d9001a7e5d04",
  "app_id": "6820f3a4e7b91d003c45a1f2",
  "flow_id": "68a1c2e4f0b3d9001a7e5c21",
  "flow_goal": "Sign up, create a project called Launch, and check that it appears on the dashboard.",
  "flow_role": "admin",
  "site_url": "https://preview-6820f3a4e7b91d003c45a1f2.base44.app/?_preview_token=FH-j7wHS7IR_fC1tUh4wCd_fNV1XGC479cuqNSYi9mA",
  "status": "success",
  "actions": [
    {
      "step_summary": "Clicked Sign up in the header to reach the registration form.",
      "step_title": "Opened the sign-up form"
    }
  ],
  "result_message": "Created the project and found it on the dashboard.",
  "goal_accomplished": true,
  "live_status": "Analyzing results",
  "analysis_status": "completed",
  "failure_reason": "app",
  "credits_charged": 1.5,
  "started_at": "2026-09-28T10:16:02+00:00",
  "completed_at": "2026-09-28T10:18:40+00:00",
  "created_date": "2026-09-28T10:16:00+00:00",
  "updated_date": "2026-09-28T10:18:40+00:00"
}

Changes

Changed in 1 of the 33 revisions of this API.1