About the live24h.eu bots

Information and contact route for site operators: which live24h.eu bots fetch pages, how they behave and how to reach us.

live24h.eu operates two bots. This page is for site operators who want to attribute a request in their server logs or get in touch with us.

  • live24h-seo-monitor checks SEO directives on our customers’ own URLs, on their behalf.
  • The price monitoring fetcher retrieves publicly accessible product pages that customers have explicitly set up for observation.

Both bots follow the same rule: we only fetch publicly accessible pages, never content behind logins or paywalls. We do not circumvent protection measures and we do not disguise our requests as human traffic.

You can reach us at bot-support@live24h.eu . We usually answer allowlisting requests and reports from site operators within one business day.

live24h-seo-monitor (SEO monitoring)

live24h-seo-monitor is our SEO monitoring bot. On behalf of our customers it fetches their own URLs and checks SEO directives such as robots.txt, meta robots, X-Robots-Tag and <link rel="canonical">.

User agent

live24h-seo-monitor/1.0 (+https://live24h.eu/bot)

What this bot does

  • We fetch URLs only when our customer has explicitly added them to their monitoring.
  • We respect rate limits and back off automatically on HTTP 429 / 403.
  • We obey robots.txt from the configured user-agent perspective.
  • We do not crawl your site: one URL per check plus one /robots.txt fetch per host (cached).
  • By default we check the delivered HTML response without executing JavaScript. JavaScript rendering for individual checks can be enabled by our customers from the Business plan, within their monthly allowance.
  • We work without stored session data.

What this bot does not do

  • No site scanning or link traversal.
  • No bypassing of CAPTCHAs or anti-bot challenges.
  • No disguising of our requests as human traffic.

Allowlisting your WAF

The following instructions apply to live24h-seo-monitor only, that is the checks we run on your own URLs on your behalf. If this bot is being blocked or rate-limited by your WAF, you have several options.

Cloudflare

  1. Cloudflare dashboard → your zone → Security → WAF → Custom rules.
  2. Add rule: (http.user_agent contains "live24h-seo-monitor") → Action: Skip.

AWS WAF

Create a ManagedRuleGroupOverride that excludes live24h-seo-monitor from rate-limiting and bot-rules.

Akamai

In Akamai Bot Manager → Custom Bot Categories, allow live24h-seo-monitor.

Imperva

Add an allow-list rule for User-Agent live24h-seo-monitor.

Generic

Add an exception in your WAF for the user-agent live24h-seo-monitor.

Contact and deactivation

If you need help allowlisting this bot, or if you believe it is causing trouble on your site, please contact us at bot-support@live24h.eu .

  • If you are a live24h customer, sign in to your dashboard, open the SEO check for the URL, and click Disable or Delete.
  • If you are not a customer and want our bot to stop fetching one of your URLs, please email bot-support@live24h.eu with the URL in question. We review every report and respond appropriately: if you are responsible for the domain, we take the URLs out of monitoring after that review.

Price monitoring

The price monitoring fetcher retrieves publicly accessible product pages that our customers have explicitly set up for observation and extracts product facts such as price, strike price and availability.

How to recognise our fetches

The fetcher identifies itself as an automated agent and does not pose as a browser or as a human visitor. Unlike the SEO monitor, we do not publish the identifier it uses: this page is public, and the identifier can change at any time.

If you want to know whether a particular request came from us, send us a log excerpt with the timestamp, the requested address and the user agent, using the address below. We will tell you definitively whether it was one of our fetches.

How to reach us

If you do not want this fetcher to access pages of your domain, write to bot-support@live24h.eu (your domain or the affected URLs are enough). We review every report and respond appropriately: from adjusting the fetch rate to suspending the affected addresses.

We also evaluate your robots.txt. If a dedicated group names the identifier you see in your logs, we detect that and treat it like a report to bot support, with the same review and the same possible responses. An e-mail to bot-support@live24h.eu is the faster and more reliable route, because we can reply to you and clarify questions.

How this fetcher works

  • It fetches only the specifically named product pages: no site crawling, no link traversal.
  • Fetch intervals are plan-bound and throttled; a per-domain politeness budget applies on top.
  • If several customers watch the same product page in the same context, they share one fetch (deduplication). The principle keeps the number of requests to your page low.
  • Every fetch is tightly bounded (redirects, page size, duration) and runs without stored session data.
  • We store the recognized product facts (price, availability) with short text snippets as recognition evidence, not the full page.

What this fetcher does not do

  • No fetches behind logins or paywalls; no bypassing of CAPTCHAs or anti-bot measures.
  • No disguising of our requests as human traffic.