Robots.txt Editor

What it does and what it gives you

Edit robots.txt from within WordPress. You determine which pages search engines may crawl and add the sitemap URL.

How to use it

1. Go to Sitemaps → Robots.txt.
2. Review the current content.
3. Add or modify rules, e.g. Disallow: /wp-admin/.
4. Ensure there's a Sitemap: https://yoursite.com/sitemap.xml line.
5. Click Save.

Example

You have a PDF folder that doesn't need indexing. You add: Disallow: /pdf/. You ensure Sitemap: remains.

Potential issues & solutions

• Entire site is blocked: be careful with Disallow: /. Always test with the URL /robots.txt and the robots.txt tester in GSC.
• Changes not saved: check if your server permissions allow WordPress to serve robots.txt.