Site Explorer
get/site-explorer/crawled-pages

Request

  • Base URL
    https://api.ahrefs.com/v3
  • URL
    https://api.ahrefs.com/v3/site-explorer/crawled-pages
  • Auth
    HTTP bearer

Query parameters

selectstring required

A comma-separated list of fields to return.

  • first_seen
  • http_code
  • languages
  • last_attempt
  • last_crawled
  • page_category
  • page_type
  • publish_date
  • title
  • url
  • url_rating
order_bystring

A field to order the results by, with optional direction. Format: field_name:asc or field_name:desc (default desc).

  • first_seen
  • http_code
  • languages
  • last_attempt
  • last_crawled
  • page_category
  • page_type
  • publish_date
  • title
  • url
  • url_rating
wherestring

Supported fields:

url
type: url

http_code
type: integer

last_crawled
type: datetime

first_seen
type: datetime

last_attempt
type: datetime

url_rating
type: float

title
type: string nullable

publish_date
type: datetime nullable

languages
type: array(string)

page_type
type: string nullable

page_category
type: string nullable

Filter is a JSON string that represents a boolean expression, it should follow the following structure:

<bool_filter> ::= { "and" : <bool_filter>+ }
              |   { "or" : <bool_filter>+ }
              |   { "not" : <bool_filter> }
              |   <expr>

<expr> ::= {
             "field" : <dimension|metric>,
             ? "is": <condition>,
           }

<condition> ::= [ "eq", <value> ]
            |   [ "neq", <value> ]
            |   [ "gt", <value> ]
            |   [ "gte", <value> ]
            |   [ "lt", <value> ]
            |   [ "lte", <value> ]
            |   [ "substring", <value> ]
            |   [ "isubstring", <value> ]
            |   [ "phrase_match", <value> ]
            |   [ "iphrase_match", <value> ]
            |   [ "prefix", <value> ]
            |   [ "suffix", <value> ]
targetstring url required

The target of the search: a domain or a URL.

mode'exact' | 'prefix' | 'domain' | 'subdomains'

The scope of the target.

protocol'both' | 'http' | 'https'

The protocol of your target.

limitinteger

The number of results to return.

output'json' | 'php' | 'xml'

The output format.

Response

OK

Changes

    • breaking

      removed the enum value csv from the query request parameter output

    • info

      added the optional property // to the response with the status (media type: application/json)

    • info

      added the optional property // to the response with the status (media type: application/xml)

    • info

      added the optional property // to the response with the status (media type: application/json)

    • info

      added the optional property // to the response with the status (media type: application/xml)

    • info

      added the optional property // to the response with the status (media type: application/json)

    • info

      added the optional property // to the response with the status (media type: application/xml)

    • info

      added the optional property // to the response with the status (media type: application/json)

    • info

      added the optional property // to the response with the status (media type: application/xml)