🇿🇦 Free directory for SA camp & 4x4 businesses
Claim your listing · List your business

KampreneurBot - Crawler disclosure

Last updated: 17 April 2026

What KampreneurBot does

KampreneurBot is an automated web crawler operated by Kampreneur (kampreneur.co.za), a free, bilingual South African directory of camping, caravan, 4x4 and outdoor businesses.

The crawler visits publicly accessible South African business directory websites to discover camping and outdoor businesses that may not yet be listed on Kampreneur. It reads publicly visible business information - name, address, phone number, website, and description - and creates a draft listing so that business owners can find and claim their own entry.

KampreneurBot does not access pages that require login, bypass paywalls, or collect personal data about individuals. It only processes information that business owners have chosen to make publicly available.

Rate limits and crawl behaviour

  • Maximum 1 request per second per host, with a minimum 2-second delay plus random jitter between requests.
  • KampreneurBot fully respects robots.txt directives. If your site disallows crawling via Disallow: / or a User-agent: KampreneurBot rule, the crawler will not visit.
  • Crawls run at most once per month per source. Content hashes are compared before any data is updated, so unchanged pages do not trigger writes.
  • Images are downloaded once and re-hosted locally - we do not hot-link your images.
  • All requests carry a Crawl-Delay-aware implementation and honour 429 Too Many Requests and 503 Service Unavailable back-off signals.

User-Agent string

All KampreneurBot requests use the following User-Agent header:

Mozilla/5.0 (compatible; KampreneurBot/1.0; +https://kampreneur.co.za/bot)

You can use this string to identify and block KampreneurBot in your server logs or robots.txt.

Blocking KampreneurBot

Add the following to your robots.txt to prevent KampreneurBot from crawling your site:

User-agent: KampreneurBot
Disallow: /

We check robots.txt before every crawl run. Entries take effect within 24 hours of our next scheduled run.

How to request removal

If a listing on Kampreneur contains incorrect information about your business, or you would like your business removed entirely, please use our takedown request form.

We aim to respond within 24 hours. Once a takedown is actioned, the listing is permanently removed and the source URL is added to our blacklist so it will not be re-imported in future crawl runs.

You can also contact us directly at [email protected] for crawler-related queries.

Interaction tracking

We record anonymous interactions (views, calls, WhatsApp clicks, website clicks) on every business listing - claimed and unclaimed alike - for analytics. We hash your IP address and browser identifier with a daily-rotating salt - we never store the raw values, and we cannot identify you from this data. The hashes rotate every 24 hours. Owners of claimed listings see aggregate counts only.

Attribution and imported listings

All listings imported by KampreneurBot are marked "Imported from public sources" and include a link to the original source URL. Business owners can claim their listing at any time via the claim flow - once claimed, the imported label is removed and the owner controls all content.