Crawler · EN

published

InferensLab-Check crawler

InferensLab-Check visits public surfaces only when a domain is submitted to the check or an authorized audit.

Behavior

The crawler reads robots.txt, limits volume, does not bypass exclusions, does not impersonate another agent, and exposes a public identity page.

Exclusion

A site may exclude it in robots.txt. An exclusion is treated as a governance signal, not as permission to bypass.