Our crawler
AIRankSurgeBot
The crawler that runs AIRankSurge audits — what it does, and how to block it.
AIRankSurgeBot is the crawler that runs AIRankSurge audits. It visits a site only when that site, or a competitor comparison, is requested by an AIRankSurge user.
- User agent:
AIRankSurgeBot/1.0 (+https://airanksurge.com/bot) - Fetches pages one at a time with a pause between requests, and at most 2,000 pages per audit.
- Respects robots.txt for page discovery. Block it with:
User-agent: AIRankSurgeBot Disallow: / - Never submits forms, logs in or reads private areas.
Questions: support@airanksurge.com.