Indexing bots make frequent requests to site pages to update information and save it in their databases for subsequent issuance in search engines. These bots are useful, but too high a scan rate can cause unnecessary useless load.
For some indexing bots, you can configure restrictions:
To set the page scan interval, do the following:
-
Log in or register, if you do not have an account yet, in Google Search Console.
-
Add and confirm domain in this system, if it has not been verified.
-
Go to the management page scan rate settings and select the resource you want:
united states