---
title: "List Crawl Pages"
method: GET
path: "/api/domains/{domain_id}/agent-desk/crawl-pages"
tags: ["agent_desk"]
---

# List Crawl Pages

`GET /api/domains/{domain_id}/agent-desk/crawl-pages`

## Request

- Base URL: `https://api-v1.unusual.ai` (the document declares no server; this is the origin it was published from)
- URL: `https://api-v1.unusual.ai/api/domains/{domain_id}/agent-desk/crawl-pages`
- Auth: OAuth 2
  - Password
  - Token URL: `/auth/login`

The crawl ledger: every page the desk crawler knows about, richest first.

Ordered by richness descending because that is the order the crawler keeps
them in — the top of this list is what the Knowledge Document was compiled
from, and human-pinned pages sort above the rest for the same reason. NULL
richness (a row discovered but never successfully fetched) sorts last.

Always 200s for an accessible domain: a desk that has never crawled returns
an empty ledger with `has_provenance` false, which is a legitimate state and
not an error.

## Path parameters

- `domain_id` string, required

## Query parameters

- `limit` integer
- `offset` integer

## Headers

- `x-view-as` string, nullable

## Response `200`

Successful Response

- CrawlLedgerOut
  - `pages` CrawlLedgerPageOut[], required
    - `id` string, required
    - `url` string, required
    - `title` string, nullable
    - `last_crawled_at` string, nullable
    - `last_changed_at` string, nullable
    - `changed_since_knowledge` boolean
    - `indexed` boolean
    - `http_status` integer, nullable
    - `richness_score` integer, nullable
    - `cited_by` string[]
    - `curation` 'pinned' | 'excluded', nullable
    - `curated_by` string, nullable
    - `curated_at` string, nullable
    - `importance_score` number, nullable
    - `importance_tier` 'head' | 'body' | 'tail', nullable
    - `importance_factors` object, nullable
    - `next_check_at` string, nullable
    - `recheck_reason` string, nullable
    - `llm_tier` string, nullable
    - `page_type` string, nullable
  - `total` integer
  - `knowledge_active_version_number` integer, nullable
  - `knowledge_activated_at` string, nullable
  - `changed_page_count` integer
  - `has_provenance` boolean
  - `tier_counts` object
  - `cadence_days` object
  - `site_recrawl_available_at` string, nullable
  - `last_crawl_at` string, nullable
  - `last_crawl_stats` object, nullable
  - `last_run` object, nullable
  - `crawl_running` boolean
  - `crawl_progress_stale` boolean
  - `pages_scored` integer
  - `pages_indexed` integer

## Other responses

- `422`: Validation Error

---

[API](https://skmtc.dev/unusual/apis/dashboard-server.md) - [All operations](https://skmtc.dev/unusual/apis/dashboard-server/llms.txt) - [OpenAPI document](https://skmtc.dev/unusual/apis/dashboard-server/revisions/89f716930ead?raw)
