Scan For Pii

Request to scan dataset for PII or PHD

Response from PII/PHD scanning.

A scan has two detection mechanisms of very different quality -- the GLiNER model, and a three-pattern regex (or seven-keyword) sweep for cells the model could not read -- and until ENG-6775 the response was identical either way. findings_count: 0 therefore could not distinguish "the model read every cell and this dataset is clean" from "the model was down, and three regexes found nothing", which is the ENG-6537 false clean one layer up: the sweep stops an unread dataset reading as clean, but a sweep that also finds nothing returns to a bare zero.

Attributes: success: Always true; a scan that cannot run reports scan_status rather than a non-200, so the heuristic findings are not discarded. dataset_name: The scanned dataset. dataset_version: The scanned version. scan_type: Which scan ran. scan_status: How much of the dataset the model actually read. See ScanStatus. unscanned_cells: How many cells the model could not read. Text cells among them were covered by the heuristic sweep instead; non-text cells were covered by nothing, since the sweep skips them while the model would have read them as strings. total_cells: How many cells were in scope, so unscanned_cells has a denominator. Without it the magnitude is unrecoverable: 3 of 4 is a failed scan and 3 of 10,000 is a footnote, and both report unscanned_cells: 3. findings_count: Total findings, model-derived and heuristic combined. affected_rows: Distinct rows carrying at least one finding. findings: The findings themselves. These do not individually say which mechanism produced them -- that is ENG-6878. phases: Per-phase wall-clock cost, when measured.