Datasets

Search the website tech-stack dataset

Searches the website tech-stack index (dataset id enum value techstack) — one record per site listing the web technologies it is built with (frameworks, CMS, e-commerce, analytics, CDNs, servers, and more), BuiltWith / Wappalyzer-style. The reverse-index filters are the point: repeat technology to require several at once (AND), any_of to match at least one (OR), and not to exclude — e.g. sites on Shopify and Klaviyo but not Recharge. Sort enum: relevance, rank_asc, tech_count_desc, domain_asc, crawled_desc. render_tier enum: http, browser. Billing: this search costs 1 credit per record returned, with a minimum of 2 (an empty result costs 2, a full page of 100 costs 100).

get/datasets/techstack/search

Request

  • Base URL: https://api.crawlora.net/api/v1
  • URL: https://api.crawlora.net/api/v1/datasets/techstack/search
  • Auth: API key in header x-api-key

Query parameters

qstring

Substring match on the site domain, max 256 characters

technologystring[]

Repeatable exact technology name the site MUST use (AND), e.g. technology=Shopify&technology=Klaviyo

any_ofstring[]

Repeatable exact technology name; the site must use at least one (OR)

notstring[]

Repeatable exact technology name the site must NOT use (excludes)

categorystring

Exact category filter, e.g. Ecommerce, CMS, Analytics, Payment, CDN

cmsstring

Exact CMS filter, e.g. WordPress, Shopify, Webflow

ecommercestring

Exact e-commerce platform filter, e.g. Shopify, WooCommerce, Magento

cdnstring

Exact CDN / hosting filter, e.g. Cloudflare, Fastly, Vercel

web_serverstring

Exact web-server filter, e.g. nginx, Apache, IIS

server_languagestring

Exact server language / framework filter, e.g. PHP, ASP.NET, Ruby on Rails

tldstring

Exact top-level-domain filter, e.g. com, org, io

render_tier'http' | 'browser'

Fetch-tier filter. Enum: http, browser

seed_sourcestring

Source filter for where the domain was discovered, e.g. tranco

has_captchaboolean

true keeps only sites with a detected CAPTCHA

is_infrastructureboolean

false (the common case) excludes backend CDN/DNS/cloud-vendor hostnames that rank highly but were never meant to serve a public homepage, keeping only real, human-navigable sites; true keeps only those backend hostnames

reachableboolean

true keeps only sites whose homepage was fetched, false only sites that could not be fetched

min_tech_countinteger

Minimum number of detected technologies, 0 or greater

run_idstring

Scan run id; defaults to the latest run

sort'relevance' | 'rank_asc' | 'tech_count_desc' | 'domain_asc' | 'crawled_desc'

Sort enum: relevance, rank_asc, tech_count_desc, domain_asc, crawled_desc

pageinteger

Page number, defaults to 1

page_sizeinteger

Page size, defaults to 20 and maxes at 100; page * page_size must be <= 10000

Headers

x-api-keystring required

API key required

Response

OK

codeinteger
msgstring

Example response

{
  "code": 200,
  "msg": "OK"
}

Changes

No recorded changes to this operation across all 2 revisions of this API.