2.34. Blocking bots

By default, the hosting blocks:

  • Bots that create a senseless load on the site or scan it for vulnerabilities.
  • Requests from IP addresses, which we consider to be bots, for which clients do not support JavaScript.

Blocked User-Agent

List of User-Agents who have limited access to hosting (in response to requests, they receive answer 403) and which cannot be unlocked:

  1. JDatabaseDriverMysqli
  2. 80legs.com
  3. DLE_Spider.exe
  4. xpymep.exe
  5. libwww-perl
  6. BOT for JCE
  7. coccoc
  8. heritrix
  9. Aibot
  10. exabot.com
  11. butterfly
  12. CareerBot
  13. FTRF
  14. www.exb.de
  15. magpie-crawler
  16. SISTRIX
  17. radian6
  18. BLEXBot
  19. JikeSpider
  20. Sosospider
  21. Attentio
  22. filterdb.iss.net
  23. cmscrawler
  24. tkl.iis.u-tokyo.ac.jp
  25. J-BRO
  26. ApacheBench
  27. meanpathbot
  28. IndoXploitTools

Unlockable

Some User-Agents used by bots are blocked due to the creation of meaningless load, but their blocking can be disabled. This feature is available for bots:

  1. SemrushBot
  2. MegaIndex
  3. Dotbot
  4. LTX71
  5. Nmap
  6. velen.io
  7. Re-re Studio
  8. netEstate NE Crawler
  9. statdom.ru
  10. SEOkicks
  11. 7Siters
  12. Seekport Crawler
  13. serpstatbot
  14. panscient.com
  15. ZoominfoBot
  16. SearchAtlas
  17. DuckDuckBot
  18. AwarioRssBot
  19. AwarioSmartBot
  20. NetpeakSpiderBot
  21. GetIntent
  22. ia_archiver
  23. AspiegelBot
  24. WPScan
  25. https://gdnplus.com
  26. DuckDuckGo
  27. ApacheBench
  28. python-requests
  29. BorneoBot
  30. Ahrefs
  31. MJ12Bot

Unlocking

To disable the lock, in site settings opposite "Do not block bots»Select the bots you don't want to block and save the changes:

  • 0 Users Found This Useful
Was this answer helpful?

Related Articles

2.1. Hosting account

A hosting account is a virtual or business hosting service that hosts website files, databases,...

2.2. Additional services

Detailed information 2.2.1. Dedicated IP 2.2.2. Additional space on NVMe...

2.3. My sites

Sites and their settings are managed in the section "Hosting → My sites»: Detailed information...

2.4. Backup

Working with automatic backups is performed in the section "Hosting → Backup»: Detailed...