Tag: crawler

Hide Email Address

(1 valutazioni totali)

Protect email address from being collected by web crawlers.

buntegiraffe 30+ installazioni attive Testato con WP 4.9.26
Block Common Crawl via robots.txt

(0 valutazioni totali)

Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

apasionados 30+ installazioni attive Testato con WP 6.3.5
AI Deny

(0 valutazioni totali)

Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.

Code For Broke 10+ installazioni attive Testato con WP 6.7.2
Robots.txt Extender

(0 valutazioni totali)

Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

bettoadami 10+ installazioni attive Testato con WP 5.0.22
rexCrawler

(0 valutazioni totali)

rexCrawler is a regular expression web-crawler plugin. Able to parse websites, save data and show them on pages.

Lars.D.Rasmussen 10+ installazioni attive Testato con WP 3.0.5
JaspreetChahal’s wordpress bot detector lite

(1 valutazioni totali)

This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …

Jaspreet Chahal 10+ installazioni attive Testato con WP 4.2.39
Page Modified

(1 valutazioni totali)

Display the results of your Page Modified crawls right within your WordPress Admin.

Chris Klosowski 10+ installazioni attive Testato con WP 4.9.26
SEObot Monitor for Googlebot, Bingbot and search engine spiders

(0 valutazioni totali)

With SEObot Monitor for Googlebot you will be able to dump the server logs to Google Analytics, easily and automatically. This will allow you to dete …

Santiago Alonso 10+ installazioni attive Testato con WP 5.8.10