RecomazeBot

RecomazeBot is the crawler behind Recomaze. It visits your website to evaluate how well your pages are optimized for AI engines like ChatGPT, Perplexity, and Google AI Overviews.

User Agent

What RecomazeBot does

• Analyzes publicly accessible pages for AI optimization factors
• Checks schema markup and metadata
• Evaluates content quality and structure
• Measures page performance
• Respects robots.txt directives

Crawl behavior

• On-demand only — triggered when a user scans a URL
• Limited to 10–20 pages per scan
• Respectful rate limiting between requests
• Fully compliant with robots.txt

What we don't do

• We don't store your content
• We don't submit forms or interact with your site
• We don't crawl continuously or index your pages
• We don't share data with third parties

Allow or block RecomazeBot

robots.txt

# Allow RecomazeBot
User-agent: RecomazeBot
Allow: /

# Block RecomazeBot
User-agent: RecomazeBot
Disallow: /

Cloudflare

If you use Cloudflare, you can whitelist RecomazeBot in your WAF rules by matching the user agent string.

Firewall

To whitelist RecomazeBot in your firewall, allow requests with the user agent containing RecomazeBot.

Questions? Reach out at better@recomaze.ai