Robots.txt Configuration

Current Configuration

User-Agent: *
Allow: /

Host: https://manabgro.com
Sitemap: https://manabgro.com/sitemap.xml

What is robots.txt?

The robots.txt file is a standard used by websites to communicate with web crawlers and search engine bots. It tells bots which parts of the website they can and cannot access.

Your Configuration

  • ✓All Bots (User-Agent: *) — Allowed to crawl all pages
  • ✓AmazonBot — Specifically allowed to crawl all pages
  • ✓AmazonBotRelated — Allowed to crawl all pages

Access Location

The robots.txt file is publicly accessible at: /robots.txt