Scraping

Get the errors of a batch scrape job

get/batch/scrape/{id}/errors

Response

Successful response

robotsBlockedstring[]

List of URLs that were attempted in scraping but were blocked by robots.txt

Changes