nginx屏蔽搜索引擎爬虫

2019-09-08
  if ($http_user_agent ~* "qihoobot|Baiduspider|Googlebot|Googlebot-Mobile|Googlebot-Image|Mediapartners-Google|Adsbot-Google|Feedfetcher-Google|Yahoo! Slurp|Yahoo! Slurp China|YoudaoBot|Sosospider|Sogou spider|Sogou web spider|MSNBot|ia_archiver|Tomato Bot") 
  {  
  return 403;  
  }  

标题:nginx屏蔽搜索引擎爬虫
作者:fbicloud
地址:https://blog.fbicloud.com/articles/2019/09/08/1567941260024.html

评论
发表评论