Batch

List batches

List your batches from newest to oldest. Filter by status or continue with a cursor.

get/batch/list

Query parameters

limitinteger

Batches per page. Defaults to 25.

Batches per page. Defaults to 25.

cursorstring

Cursor from the previous page.

Cursor from the previous page.

status'queued' | 'running' | 'cancelling' | 'completed' | 'cancelled' | 'failed'

Filter by status.

Filter by status.

qstring

Free-text search term, matched against the batch id, crawl source (start URL or sitemap domain), and tags.

Example:batch_1a2b

Free-text search term, matched against the batch id, crawl source (start URL or sitemap domain), and tags.

search_type'exact' | 'prefix'

prefix for as-you-type prefix matching (default), exact for full-token matching.

prefix for as-you-type prefix matching (default), exact for full-token matching.

tagsstring

Comma-separated list of tags to filter by (matches batches having any of them).

Example:docs,competitor

Comma-separated list of tags to filter by (matches batches having any of them).

Response

Batch list

has_moreboolean

Whether another page is available.

next_cursorstring nullable

Cursor for the next page.

Example response

{
  "data": [
    {
      "id": "batch_9f2c8a",
      "tags": [
        "docs"
      ],
      "input": {
        "submitted": 25000,
        "accepted": 24817,
        "duplicates": 183
      },
      "progress": {
        "succeeded": 18091,
        "failed": 311,
        "pending": 6415
      },
      "credits": {
        "estimated": 24817,
        "charged": 18091
      },
      "errors": [
        {
          "code": "WEBSITE_ACCESS_ERROR",
          "count": 204
        }
      ]
    }
  ]
}

Changes