About live24h-seo-monitor
live24h.eu operates a small monitoring bot that fetches public URLs on behalf of our customers to check SEO directives such as robots.txt, meta robots, X-Robots-Tag and <link rel="canonical">.
User agent
live24h-seo-monitor/1.0 (+https://live24h.eu/bot)
What we do
- We fetch URLs only when our customer has explicitly added them to their monitoring.
- We respect rate limits and back off automatically on HTTP 429 / 403.
- We obey
robots.txtfrom the configured user-agent perspective. - We do not crawl your site — one URL per check plus one
/robots.txtfetch per host (cached). - We do not evaluate JavaScript.
- We do not persist cookies.
What we do not do
- No site scanning or link traversal.
- No bypassing of CAPTCHAs or anti-bot challenges.
- No browser fingerprint emulation.
- No residential proxies.
IP ranges
Outbound requests originate from Azure West Europe data-centre IPs. We publish the current static outbound IPs in our status documentation once finalised. Use the user-agent string above as the primary allowlisting signal.
Allowlisting your WAF
If our bot is being blocked or rate-limited by your WAF, you have several options.
Cloudflare
- Cloudflare dashboard → your zone → Security → WAF → Custom rules.
- Add rule:
(http.user_agent contains "live24h-seo-monitor")→ Action: Skip.
AWS WAF
Create a ManagedRuleGroupOverride that excludes live24h-seo-monitor from rate-limiting and bot-rules.
Akamai
In Akamai Bot Manager → Custom Bot Categories, allow live24h-seo-monitor.
Imperva
Add an allow-list rule for User-Agent live24h-seo-monitor.
Generic
Add an exception in your WAF for the user-agent live24h-seo-monitor or for our outbound IPs.
Contact
If you need help allowlisting our bot, or if you believe the bot is causing trouble on your site, please contact us at bot-support@live24h.eu . We respond within one business day.
Disable monitoring
- If you are a live24h customer, sign in to your dashboard, open the SEO check for the URL, and click Disable or Delete.
- If you are not a customer and want our bot to stop fetching one of your URLs, please email bot-support@live24h.eu with the URL in question. We will remove it from monitoring.