Our crawler

You found GEOwner-Audit in your logs.

It is the program we use to audit a website. It visited because someone entitled to ask ordered an audit of that site, or because the site was named as a competitor in one.

GEOwner-Audit/2.0 (+https://geowner.com/bot)

What it does

  • What it requests

    Public pages only: the checked page, robots.txt, the sitemap, up to 120 pages listed in the sitemap and up to 25 pages linked from them. It does not log in, submit forms or try to pass a challenge.

  • Crawler rules

    The public scanner respects robots.txt. The permission checkbox does not verify ownership or enable a bypass of crawler restrictions.

  • Requests under other names

    For the free check and for every audit, we also request the checked page under the names of AI crawlers, of Googlebot and of a browser, to see whether the site answers them differently. These requests come from our own server, not from those companies. They are a test, described in our method, and are sent only to the site being checked.

  • How much

    At most 120 pages from the sitemap and 25 linked pages per check, with no more than eight requests at a time. It is not a continuous crawler: it visits a site when a check or an audit is run, including an agreed re-measurement, and visits a small fixed set of public reference sites once a night to test itself.

  • What it keeps

    Short excerpts of public pages and the responses it received, as evidence in the audit report. No personal data is sought.

  • How to stop it

    On sites we reach on our own initiative, a robots.txt rule for GEOwner-Audit is obeyed. For anything else, write to us and we will exclude your site.contact@geowner.com