Search Buddy crawler

BuddySystemSearchBot: what it reads, and how to control it.

BuddySystemSearchBot is the crawler behind Search Buddy and the free tools from The Buddy System. It reads a few public pages of a website when someone asks for a check of that site.

What it does

A small, polite crawler.

What it reads. Public pages only: robots.txt, llms.txt, the sitemap and at most 25 pages per check, usually far fewer. It never logs in, never submits forms and refuses private or internal addresses.

How it identifies itself. The user agent contains BuddySystemSearchBot/1.0 and a link to this page.

How to control it. It honours robots.txt. To keep it out of your whole site, add User-agent: BuddySystemSearchBot followed by Disallow: /.

Questions or problems. Email info@onitdigital.com with your domain and we will respond within five business days.

See Buddy work.

Give it the goal. Get the campaign. A person still presses send.

BuddySystemSearchBot: what it reads, and how to control it.

A small, polite crawler.

Bring a real brief.

See Buddy work.