Services

Create a CommonCrawl data dump

Executes a CommonCrawl data dump job for the specified crawl and returns the output directory path.

post/services/commoncrawldump

Request

  • Base URL
    http://localhost:8081
  • URL
    http://localhost:8081/services/commoncrawldump
  • Auth
    HTTP basic

Request body

crawlIdstring required

The crawl identifier.

confIdstring

The configuration ID.

argsobject

Additional arguments for the service operation.

Example request

{
  "crawlId": "crawl-01",
  "confId": "default",
  "args": {}
}

Response

The output directory path for the dump.

Changes

No recorded changes to this operation across all 1 revision of this API.