UNunusual
agent_desk

Recrawl Site

Re-fetch the whole site now, ignoring every page's cadence.

RATE-LIMITED to one per MANUAL_SITE_RECRAWL_MIN_MINUTES per domain (default 60), and the limit is about the CUSTOMER'S server, not ours: a full run is up to CRAWL_MAX_DISCOVERED_URLS requests, and a button that can be held down is a load test against the site it is supposed to be reading. 429 with the wait, so the UI can say when rather than just "no".

The clock is only stamped once the message is actually queued — a broker failure must not burn the customer's hourly slot on work that never ran.

post/api/domains/{domain_id}/agent-desk/crawl/recrawl

Request

  • Base URL
    https://api-v1.unusual.ai (the document declares no server; this is the origin it was published from)
  • Auth
    OAuth 2
    Password
    Token URL: /auth/login

Path parameters

domain_idstring required

Headers

x-view-asstring nullable

Response

Successful Response

status'queued'
detailstring required

Changes

No recorded changes to this operation across all 1 revision of this API.