PDA

View Full Version : What is a good speed for googlebot to crawl my website after upgrading to VPS?



TODmovies
12-15-2008, 10:23 AM
I have recently upgraded to a virtual private server. What is a safe speed for googlebot to crawl my website.

Can you please give me results in the format of:

xxx requests per second

xxx seconds between requests

Thanks!!

konratt
01-14-2009, 12:14 PM
Think nobody knows that.

david_smith01
05-03-2016, 06:09 AM
Crawl depth is the extent to which a search engine indexes pages within a website. Most sites contain multiple pages, which in turn can contain subpages. The pages and subpages grow deeper in a manner similar to the way folders and subfolders (or directories and subdirectories) grow deeper in computer storage.