Better Robots.txt Premium GPL v3.0.1

Better Robots.txt Premium GPL Overview

Better Robots.txt is a smart WordPress plugin that helps you create and manage your robots.txt file with a guided, user-friendly workflow. Instead of manual editing, it offers presets, visual controls, and a preview step before publishing — making crawl management safer and easier. It lets you control search engines, AI crawlers, bad bots, and SEO tools while cleaning up low-value URLs to improve crawl efficiency. Ideal for site owners who want better SEO control, AI-ready governance, and optimized crawl behavior without writing code.

What the plugin does

Better Robots.txt gives WordPress teams a guided way to control which bots can access their content — and how.

Instead of editing a raw text field, you select a preset, adjust per-crawler rules, and publish a clean robots.txt with optional llms.txt and AI usage signals. The plugin handles:

• robots.txt generation with guided presets (Essential, AI-First, Fortress, Custom);
• per-crawler rules for GPTBot, ClaudeBot, Google-Extended, Applebot, and more;
• llms.txt publishing to tell AI systems what your site offers;
• crawl waste reduction by blocking bad bots and unnecessary paths;
• AI usage policy so crawlers know your stance on training, quoting, and indexing.