# BLOCK USER AGENTS RewriteEngine on RewriteCond %{HTTP_USER_AGENT} EveryoneSocialBot/1\.0 [NC,OR] RewriteCond %{HTTP_USER_AGENT} EveryoneSocialBot [NC,OR] RewriteCond %{HTTP_USER_AGENT} AhrefsBot [NC,OR] RewriteCond %{HTTP_USER_AGENT} AhrefsBot [NC,OR] RewriteCond %{HTTP_USER_AGENT} AhrefsBot/5\.2;\ News;\ \+http\://ahrefs\.com/robot/ [NC,OR] RewriteCond %{HTTP_USER_AGENT} PaperLiBot/2\.1 [NC,OR] RewriteCond %{HTTP_USER_AGENT} PaperLiBot [NC,OR] RewriteCond %{HTTP_USER_AGENT} http\://support\.paper\.li/entries/20023257\-what\-is\-paper\-li [NC,OR] RewriteCond %{HTTP_USER_AGENT} Baiduspider/2\.0 [NC,OR] RewriteCond %{HTTP_USER_AGENT} Baiduspider [NC,OR] RewriteCond %{HTTP_USER_AGENT} \+http\://www\.baidu\.com/search/spider\.html [NC,OR] RewriteCond %{HTTP_USER_AGENT} Yahoo\!\ Slurp [NC,OR] RewriteCond %{HTTP_USER_AGENT} http\://help\.yahoo\.com/help/us/ysearch/slurp [NC,OR] RewriteCond %{HTTP_USER_AGENT} MetaURI\ API/2\.0\ \+metauri\.com [NC,OR] RewriteCond %{HTTP_USER_AGENT} MetaURI [NC,OR] RewriteCond %{HTTP_USER_AGENT} DotBot/1\.1 [NC,OR] RewriteCond %{HTTP_USER_AGENT} DotBot [NC,OR] RewriteCond %{HTTP_USER_AGENT} http\://www\.opensiteexplorer\.org/dotbot,\ help@moz\.com [NC,OR] RewriteCond %{HTTP_USER_AGENT} bingbot/2\.0 [NC,OR] RewriteCond %{HTTP_USER_AGENT} bingbot [NC,OR] RewriteCond %{HTTP_USER_AGENT} \+http\://www\.bing\.com/bingbot\.htm [NC,OR] RewriteCond %{HTTP_USER_AGENT} SeznamBot/3\.2 [NC,OR] RewriteCond %{HTTP_USER_AGENT} SeznamBot [NC,OR] RewriteCond %{HTTP_USER_AGENT} \+http\://napoveda\.seznam\.cz/en/seznambot\-intro/ [NC,OR] RewriteCond %{HTTP_USER_AGENT} proximic [NC,OR] RewriteCond %{HTTP_USER_AGENT} http\://www\.proximic\.com/info/spider\.php [NC,OR] RewriteCond %{HTTP_USER_AGENT} contxbot/1\.0 [NC,OR] RewriteCond %{HTTP_USER_AGENT} contxbot [NC,OR] RewriteCond %{HTTP_USER_AGENT} MJ12bot/v1\.4\.8;\ http\://mj12bot\.com/ [NC,OR] RewriteCond %{HTTP_USER_AGENT} MJ12bot [NC,OR] RewriteCond %{HTTP_USER_AGENT} BUbiNG\ \(\+http\://law\.di\.unimi\.it/BUbiNG\.html#wc\) [NC,OR] RewriteCond %{HTTP_USER_AGENT} BUbiNG [NC,OR] RewriteCond %{HTTP_USER_AGENT} MegaIndex\.ru/2\.0;\ \+http\://megaindex\.com/crawler [NC,OR] RewriteCond %{HTTP_USER_AGENT} MegaIndex\.ru [NC,OR] RewriteCond %{HTTP_USER_AGENT} Mail\.RU_Bot/Img/2\.0;\ \+http\://go\.mail\.ru/help/robots [NC,OR] RewriteCond %{HTTP_USER_AGENT} Mail\.RU_Bot/Img/2\.0 [NC,OR] RewriteCond %{HTTP_USER_AGENT} Sogou\ web\ spider/4\.0\(\+http\://www\.sogou\.com/docs/help/webmasters\.htm#07 [NC,OR] RewriteCond %{HTTP_USER_AGENT} Sogou\ web\ spider [NC,OR] RewriteCond %{HTTP_USER_AGENT} FAST\ Enterprise\ Crawler/5\.3\.4\ \(crawler@fast\.no [NC,OR] RewriteCond %{HTTP_USER_AGENT} FAST\ Enterprise\ Crawler [NC] RewriteRule !^robots\.txt$ - [F] # BLOCK BLANK USER AGENTS RewriteCond %{HTTP_USER_AGENT} ^-?$ RewriteRule ^ - [F] Sitemap: https://www.digitalgyd.com/sitemap_index.xml User-agent: * Disallow: /wp-admin/ Disallow: /trackback/ Disallow: /cgi-bin/ Disallow: /author/ Disallow: /page/ Allow: *.css Allow: *.js Allow: /wp-content/uploads/ User-agent: Mediapartners-Google* Allow: / Disallow: /wp-admin/ User-agent: Googlebot-Image Allow: /wp-content/uploads/ Disallow: /wp-admin/ User-agent: Adsbot-Google Allow: /User-agent: Googlebot-Mobile Allow: / Disallow: /wp-admin/