AIRankSurge
Our crawler

AIRankSurgeBot

The crawler that runs AIRankSurge audits — what it does, and how to block it.

AIRankSurgeBot is the crawler that runs AIRankSurge audits. It visits a site only when that site, or a competitor comparison, is requested by an AIRankSurge user.

  • User agent: AIRankSurgeBot/1.0 (+https://airanksurge.com/bot)
  • Fetches pages one at a time with a pause between requests, and at most 2,000 pages per audit.
  • Respects robots.txt for page discovery. Block it with:
    User-agent: AIRankSurgeBot
    Disallow: /
  • Never submits forms, logs in or reads private areas.

Questions: support@airanksurge.com.