Plugin Tag: robots.txt
-
Block eCommerce Assets via robots.txt
(0 total ratings)Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
-
Check Search Engine Visibility on Migration
(1 total ratings)Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.
-
Unblock CSS & JS for Googlebot
(0 total ratings)Modifies robots.txt to allow Googlebot access JS and CSS files.
-
CeeWP Robots.txt Manager
(0 total ratings)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
AI Deny
(1 total ratings)Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
-
Block Common Crawl via robots.txt
(0 total ratings)Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
Copyright AI Content Licensing – Block AI Crawlers + Get Paid
(0 total ratings)AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
-
Block Feed and Comments via robots.txt
(0 total ratings)Blocks some Feed and Comment resources in order to avoid spam bots
-
IntentDeep Virtual Files – AI-Ready: Robots.txt, Security.txt, Ads.txt, LLMS.txt
(1 total ratings)Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.
-
ProAI TXT Manager for LLMS and Robots
(1 total ratings)Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.
-
ChatBot Blocker by CellarWeb
(0 total ratings)ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
-
LJPL Armored robots.txt
(0 total ratings)Add some directives to your robots.txt file to keep your site safer
-
Thin Content Manager
(1 total ratings)See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
-
Robots.txt Extender
(0 total ratings)Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
HumanGate
(0 total ratings)Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.
-
Markaevi AI Crawler Control
(0 total ratings)Establish full control over LLM crawlers and optimize your website framework for conversational AI engines.
-
CiteBoost GEO
(0 total ratings)Optimize your WordPress site for AI search engines like ChatGPT, Claude, Gemini, and Perplexity.
-
Laudia Connect
(0 total ratings)A narrow, auditable connection that lets Laudia publish only the AI-visibility fixes you approve. Nothing else.
-
Valvai – AI Traffic Control Center
(0 total ratings)Block, log and monetise AI crawlers directly from your WordPress dashboard.
-
Elthian AI Licensing Lite
(0 total ratings)Manage how AI models interact with your content. Implements llms.txt, robots.txt, AI Sitemaps, and machine-readable JSON policies.