Technical documentation
Crawler identity
How KlippradarBot identifies itself and how it behaves when crawling merchant sites.
User-Agent
KlippradarBot/1.0 (+https://klippradar.se/crawler; mailto:[email protected])
Core rules
- We respect
robots.txt. - We use merchant-specific pacing, concurrency limits, and backoff.
- We slow down or pause on repeated
403,429,5xx, or timeout patterns. - We prefer conditional requests where available, including
ETagandLast-Modified.
Contact
For crawler coordination, whitelisting, or merchant-specific guidance: